public:lofar_cluster

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
public:lofar_cluster [2017-05-01 14:06] Arno Schoenmakerspublic:lofar_cluster [2020-10-20 14:16] (current) Bernard Asabere
Line 1: Line 1:
 ====== The LOFAR Clusters ====== ====== The LOFAR Clusters ======
  
-This page describes the LOFAR clusters for (potential) users. The CEP2 cluster is used to store the data from the BlueGene and to run the pipelines that will do the "standard" reduction and calibration of this data. After this pipeline processing, the results are stored in the Lofar Export (staging) Archive. For further processing the CEP1 cluster can be used. +This page describes the LOFAR clusters for (potential) users. The CEP4 cluster is used to store the data from Cobalt and to run the pipelines that will do the "standard" reduction and calibration of this data. After this pipeline processing, the results are stored in the Lofar Export (staging) Archive. For further processing the CEP3 cluster can be used.
  
 We welcome authorized users on the LOFAR clusters. We welcome authorized users on the LOFAR clusters.
 +
 +===== CEP3 =====
 +
 +CEP3 is the processing cluster that is available to LOFAR users that need additional processing and storage of their data. Details on requesting access and its usage are [[:cep3:start|on this page]].
 +
 +===== CEP4 =====
 +
 +CEP4 is the main storage and processing cluster for online applications. It is not accessible by other users than LOFAR staff. Information on CEP4 can be found [[:cep4:start|on this page]].
  
 ===== User Access ===== ===== User Access =====
Line 9: Line 17:
 ==== Access through portal to Cluster frontend ==== ==== Access through portal to Cluster frontend ====
  
- +You can access the Lofar cluster through the portal. On your own system, try: 
-You can access the Lofar cluster through the portal. On your own system, try:<code>+<code>
 > ssh -X portal.lofar.eu > ssh -X portal.lofar.eu
-</code> to connect. We maintain a ssh whitelist, so only registered institutes are able to login. 
-Please send an email to //grit at astron.nl// or //h.paas at rug.nl// to add your institute or personal IP number to this white list. 
-When you are logged in for the first time, you'll have an empty home directory.  
  
-To get onto the CEP1 cluster, you first have to login at one of the two frontend nodes ''lfe001'' of''lfe002'' using ''ssh -X'' (as above). When you don't know which one, please use ''lfe001'' by default. +</code>
  
-To get onto the CEP2 clusteryou first have to login at one of the two frontend nodes ''lhn001'' of''lhn002'+to connect. We maintain a ssh whitelistso only registered institutes are able to login. Please send an email to //grit at astron.nl// or //rbokhorst at astron.nl// to add your institute or personal IP number to this white list. When you are logged in for the first time, you'll have an empty home directory.
  
-For more sophisticated useage of ''ssh'' read [[public:ssh-usage| this page]].+To get onto the CEP3 cluster, you first have to login to the frontend node ''lhdhead.offline.lofar'' using ''ssh -X'' (as above). 
 + 
 +For more sophisticated useage of ''ssh'' read [[:public:ssh-usage|this page]].
  
 ==== LOGIN environment ==== ==== LOGIN environment ====
  
-See [[public:lle|The Lofar Login Environment]] page for information on your default login environment. Only the default environment is supported, so if you defer from this, you're on your own..!+See [[:public:lle|The Lofar Login Environment]] page for information on your default login environment. Only the default environment is supported, so if you defer from this, you're on your own..!
  
 ==== Do and Don'ts ==== ==== Do and Don'ts ====
  
 **DON'T:** **DON'T:**
-  * :!: Store data in your ''$HOME'' on ''portal.lofar.eu'' ; this system has a ridiculously small disk and filling it will prevent other users to access properly :!:+ 
 +   * :!: Store data in your ''$HOME''  on ''portal.lofar.eu''  ; this system has a ridiculously small disk and filling it will prevent other users to access properly :!:
   * Pump around large amounts of data between nodes.   * Pump around large amounts of data between nodes.
   * Leave unused data on the systems. Clean it up, so others can make use of the available disk space.   * Leave unused data on the systems. Clean it up, so others can make use of the available disk space.
-  +
 **DO:** **DO:**
 +
   * Help improve the system by sending suggestions for improvements or new packages to the administrators   * Help improve the system by sending suggestions for improvements or new packages to the administrators
-  
  
 ===== Contributed Software ===== ===== Contributed Software =====
  
-Some groups or people would like their favourite tools or pipelines added to the cluster software. That can usually be accomodated, but there are some guidelines. Click [[user_software_guidelines|here]] to learn more! +Some groups or people would like their favourite tools or pipelines added to the cluster software. That can usually be accomodated, but there are some guidelines. Click [[:public:user_software_guidelines|here]] to learn more!
- +
- +
-===== CEP3 ====== +
- +
-CEP3 is the processing cluster that is available to LOFAR users that need additional processing and storage of their data. Details on requesting access and its usage are [[cep3:start|on this page]].+
  
  
  • Last modified: 2017-05-01 14:06
  • by Arno Schoenmakers