Differences
This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revisionLast revisionBoth sides next revision | ||
public:grid_srm_software_installation [2012-11-29 15:43] – Adriaan Renting | public:grid_srm_software_installation [2017-03-08 15:27] – external edit 127.0.0.1 | ||
---|---|---|---|
Line 1: | Line 1: | ||
- | ====== GRID srm installation ====== | + | ====== GRID storage access tools installation ====== |
- | The following documentation was developed for the installation of a GRID tools and certificate | + | //This page describes the procedure to set up the tools for working directly |
- | There is also an instruction for installing on an [[public:grid: | + | //You might also be interested in the [[public:srmclientinstallation|portable package |
- | There is also an instruction for installing on [[http://glite.web.cern.ch/ | + | |
- | ===== 1 Installation of software packages ===== | + | The following documentation was developed for the installation of a GRID tools and certificates on an Ubuntu 12.04 system using a bash shell (using .bashrc as a configuration script). We have not tested the installation using csh derivatives but it is to be expected that not all scripts will work. Thanks to Martin van den Akker for providing notes of his installation procedure. |
+ | |||
+ | Sites that provide packages and further information on installation of grid middleware on linux based systems: | ||
+ | |||
+ | * [[http:// | ||
+ | * [[http:// | ||
+ | * [[http:// | ||
+ | |||
+ | NB We have tested the installation as described below only on Ubuntu 12 and CentOS 7. Please let us know if you have feedback or if you can contribute instructions on installations in different environments. | ||
+ | You might also first need to obtain a [[GRID certificate]]. | ||
+ | ===== Installation of software packages ===== | ||
Note: all installations require root permissions. | Note: all installations require root permissions. | ||
- | ==== 1.1 globus ==== | + | ==== globus |
- | You will need to install the file transfer tools from the Globus package, most importantly globus-url-copy: | + | The file transfer tools from the Globus package |
- | | + | Ubuntu |
+ | | ||
+ | CentOS | ||
+ | sudo yum install globus-gass-copy-progs | ||
- | ==== 1.2 voms ==== | + | ==== voms client software |
- | You will need to install the VOMS tools for logging in and user account management: | + | The VOMS tools for logging in and user account management: |
+ | Ubuntu | ||
sudo apt-get install voms-clients | sudo apt-get install voms-clients | ||
- | ==== 1.3 srmtools ==== | + | CentOS |
+ | sudo yum install voms-clients-cpp | ||
- | You will need to install the SRM tools to be able to communicate with the storage management system. | + | ==== Certificates for the Grid Certificate Authorities (CA) ==== |
+ | |||
+ | Execute the following commands | ||
+ | site of the European Grid Infrastructure (EGI) (root permissions are | ||
+ | required). | ||
+ | |||
+ | Ubuntu | ||
+ | sudo add-apt-repository 'deb http:// | ||
+ | sudo apt-get update | ||
+ | sudo apt-get install ca-policy-egi-core | ||
+ | |||
+ | CentOS | ||
+ | wget http:// | ||
+ | sudo mv EGI-trustanchors.repo / | ||
+ | sudo yum install ca-policy-egi-core | ||
+ | |||
+ | ==== srmtools ==== | ||
+ | |||
+ | The SRM tools are needed | ||
- Download srmtools | - Download srmtools | ||
- | * {{:public:srm.tar.gz|srm.tar.gz}} | + | * {{public:srmclient-2.6.28.tar.gz|srmclient-2.6.28.tar.gz}} |
- | * http://www.astro.ru.nl/ | + | * {{public:srmclient-2.2.25.tar.gz|srmclient-2.2.25.tar.gz}} (Java6) |
- | - Extract and install the srmtools in ''/ | + | - Extract and install the srmtools, e.g. in ''/ |
- | - Add the path to the srmtools to .bashrc:\\ '' | + | - Set the relevant environment |
- | ===== 2 Installation | + | NB The srm client tools depend on JAVA. There is a known issue with openjava version 7. If you have this version |
+ | export JAVA_HOME=/ | ||
- | ====2.1 Personal certificate ==== | + | The JAVA VM used by default in Ubuntu and CentOS can be selected using the following command: |
- | | + | |
- | * Install the certificate as described in the certificate e-mail | + | |
- | | + | |
- | | + | |
- | - [optional] Apply for authorization to use resources or services. Please consult your service provider or help desk for more information, | + | |
- | * https:// | + | |
- | * deisa-support@sara.nl for access to DEISA HPC Grid resources | + | |
- | * https:// | + | |
- | * https:// | + | |
- | ==== 2.2 Additional certificates from the site of the European Grid Infrastructure | + | ==== Certificate Revocation List retrieval |
- | Execute the following commands to install the certificates from the | + | The fetch-crl tool retrieves Certificate Revocation Lists. |
- | site of the European Grid Infrastructure (EGI) (root permissions are | + | |
- | required). | + | |
- | sudo add-repository 'deb http:// | + | Ubuntu |
- | sudo apt-get update | + | sudo apt-get install |
- | sudo apt-get install | + | |
+ | CentOS | ||
+ | sudo yum install fetch-crl | ||
- | ===== 3 Additional configuration ===== | + | NB This is not required unless you intend to allow others to access your system by providing their grid certificate. |
- | ==== 3.1 Add the vomses string for the LOFAR Virtual Organization (VO) to the vomses file ==== | + | ===== Additional configuration ===== |
- | You can find this string on the following website https:// | + | ==== VOMSES file for LOFAR ==== |
+ | Add the following string for the LOFAR Virtual Organization (VO) to the vomses file (any filename is fine). | ||
- | ==== 3.2 List of certificates (voms.grid.sara.nl.lsc) ==== | + | " |
- | Put the following string | + | You can find this string also on the following |
- | "/ | + | ==== List of certificates for voms.grid.sara.nl.lsc ==== |
+ | |||
+ | Put the following strings: | ||
+ | |||
+ | | ||
+ | / | ||
in the file (root permissions required): | in the file (root permissions required): | ||
Line 77: | Line 107: | ||
/ | / | ||
+ | NB If this step is skipped or nor configured correctly '' | ||
- | ==== 3.3 Environment ==== | + | ==== Environment |
- | Add the following settings | + | You may want to provide |
- | export | + | export |
- | export | + | export |
+ | export X509_CERT_DIR=/ | ||
export X509_VOMS_DIR=/ | export X509_VOMS_DIR=/ | ||
+ | export X509_USER_PROXY=$HOME/ | ||
export VOMS_USERCONF=$HOME/ | export VOMS_USERCONF=$HOME/ | ||
+ | | ||
+ | **Note:** For (t)csh, use *.csh init scripts and ' | ||
+ | ==== CRL cron job (optional) ==== | ||
+ | |||
+ | You may want to create a cron job to automatically retrieve certificate revocation lists (CRLs) by invoking the fetch-crl tool at regular intervals (at least once a year). | ||
+ | |||
+ | ===== Usage ===== | ||
+ | This creates a proxy (valid for 48 hours, increase if needed) in your home directory: | ||
+ | < | ||
+ | voms-proxy-init -valid 48:00 -voms lofar:/ | ||
+ | </ | ||
+ | You can test that everything works by copying this file from surfsara to your working directory: | ||
+ | < | ||
+ | srmcp -server_mode=passive srm:// | ||
+ | </ | ||
+ | If your firewall allows incoming connections to non-standard ports, you can try this command without the server_mode option which will enable utilization of multiple streams to increase performance. | ||
+ | If you have the [[public: | ||
+ | < | ||
+ | srmcp -use_urlcopy_script=true -urlcopy=./ | ||
+ | </ | ||
+ | **Note:** You may have to force the use of TLS, (export GLOBUS_GSSAPI_FORCE_TLS=1 or in / |