Differences
This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision | ||
public:meetings:2009-02_data_processing_school [2011-10-25 12:42] – uploading presentations Lars Bahren | public:meetings:2009-02_data_processing_school [2017-03-08 15:27] (current) – external edit 127.0.0.1 | ||
---|---|---|---|
Line 3: | Line 3: | ||
===== Workshops :: LOFAR Data Processing School (10.-12. Feb 2009, ASTRON, Dwingeloo) ===== | ===== Workshops :: LOFAR Data Processing School (10.-12. Feb 2009, ASTRON, Dwingeloo) ===== | ||
- | | + | |
- | | + | |
- | | + | |
+ | - [[#Hands-on exercises]] | ||
+ | * [[# | ||
+ | * [[# | ||
+ | * [[#Exercise instructions]] | ||
==== Who should attend? ==== | ==== Who should attend? ==== | ||
Line 43: | Line 47: | ||
* L. Bähren: {{.2009-02_processing_school: | * L. Bähren: {{.2009-02_processing_school: | ||
* H. Holties: {{.2009-02_processing_school: | * H. Holties: {{.2009-02_processing_school: | ||
+ | |||
+ | ==== Connecting to the cluster nodes ==== | ||
+ | |||
+ | Logging into the cluster nodes requires passing through at least one -- often two -- front-end node. So in order to access the cluster nodes from a machine located at ASTRON you will have to go through the following chain of connections: | ||
+ | < | ||
+ | ASTRON | ||
+ | </ | ||
+ | While this is the default sequence to connect to the reserved cluster nodes, the intermediate step going through the front-end-node (// | ||
+ | |||
+ | Here is the procedure for connecting to the cluster nodes set aside for the data processing school: | ||
+ | - @ ASTRON : <code bash> | ||
+ | ssh -X < | ||
+ | </ | ||
+ | - @ listfen : <code bash> | ||
+ | ssh -X lioff021 | ||
+ | </ | ||
+ | |||
+ | To initialize your environment for a package (e.g. AIPS): | ||
+ | <code csh> | ||
+ | source / | ||
+ | </ | ||
+ | For an overview of available initialization scripts: | ||
+ | <code csh> | ||
+ | ls / | ||
+ | </ | ||
==== Hands-on exercises ==== | ==== Hands-on exercises ==== | ||
- | == Connecting to the cluster nodes == | + | === Directories & file locations === |
+ | |||
+ | The workshop will mainly utilize some of the LOFAR offline | ||
+ | |||
+ | On these machines, there is an area set aside named "/ | ||
+ | |||
+ | < | ||
+ | / | ||
+ | |-- data | ||
+ | | |-- Exercise_01 | ||
+ | | |-- Exercise_02 | ||
+ | | |-- Exercise_03 | ||
+ | | ` | ||
+ | `-- users | ||
+ | </ | ||
+ | |||
+ | Each directory subdirectory will contain all the inputs, expected outputs, scripts, logfiles, instructions, | ||
+ | |||
+ | < | ||
+ | lioff023:/ | ||
+ | total 8 | ||
+ | -rw-r--r-- 1 wise wise 0 2009-02-04 19:26 example_01.log | ||
+ | -rw-r--r-- 1 wise wise 0 2009-02-04 19:26 example_01.py | ||
+ | drwxr-xr-x 2 wise wise 4096 2009-02-04 19:25 inputs/ | ||
+ | -rw-r--r-- 1 wise wise 0 2009-02-04 19:27 instructions.txt | ||
+ | drwxr-xr-x 2 wise wise 4096 2009-02-04 19:25 outputs/ | ||
+ | -rw-r--r-- 1 wise wise 0 2009-02-04 19:26 README | ||
+ | lioff023:/ | ||
+ | </ | ||
+ | |||
+ | === Preparation === | ||
+ | |||
+ | Everything in "/ | ||
+ | * ''/ | ||
+ | cd / | ||
+ | mkdir myname | ||
+ | cd myname | ||
+ | </ | ||
+ | * Create a working copy of the exercise within your directory, so e.g. <code bash> | ||
+ | cp -r / | ||
+ | </ | ||
+ | |||
+ | === Exercise instructions === | ||
+ | |||
+ | - [[.2009-02_processing_school: | ||
+ | - [[.2009-02_processing_school: | ||
+ | - [[.2009-02_processing_school: | ||
+ | - [[.2009-02_processing_school: | ||
+ | - [[.2009-02_processing_school: | ||
+ | - [[.2009-02_processing_school: | ||
+ | - [[.2009-02_processing_school: | ||
+ | - [[.2009-02_processing_school: | ||
+ | - [[.2009-02_processing_school: | ||
+ | - [[.2009-02_processing_school: | ||
+ | - [[.2009-02_processing_school: | ||
+ | - [[.2009-02_processing_school: | ||
+ | - [[.2009-02_processing_school: | ||
+ | - [[.2009-02_processing_school: | ||
+ | - [[.2009-02_processing_school: | ||
+ | - [[.2009-02_processing_school: | ||
+ | - [[.2009-02_processing_school: | ||
+ | - [[.2009-02_processing_school: | ||
+ | - [[.2009-02_processing_school: | ||
+ | - [[.2009-02_processing_school: | ||
+ | - [[.2009-02_processing_school: | ||
+ | - [[.2009-02_processing_school: | ||