public:meetings:2009-02_data_processing_school

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision		 Previous revision
public:meetings:2009-02_data_processing_school [2011-10-25 12:46] – Lars Bahrenpublic:meetings:2009-02_data_processing_school [2017-03-08 15:27] (current) – external edit 127.0.0.1
Line 7: Line 7:
   - [[#Connecting to the cluster nodes]]   - [[#Connecting to the cluster nodes]]
   - [[#Hands-on exercises]]   - [[#Hands-on exercises]]
 +    * [[#Directories & file locations]]
 +    * [[#Preparation]]
 +    * [[#Exercise instructions]]
  
 ==== Who should attend? ==== ==== Who should attend? ====
Line 72: Line 75:
 ==== Hands-on exercises ==== ==== Hands-on exercises ====
  
 +=== Directories & file locations ===
 +
 +The workshop will mainly utilize some of the LOFAR offline cluster nodes to run the exercises. These machines are named "lioff0XX" where X goes from 21-29. To reach these machines, you have to first login to listfen. So ssh into listfen and then ssh into one of the working nodes.
 +
 +On these machines, there is an area set aside named "/data/lofarschool" where all the exercises will be stored. Within that directory there will be two sub-directories, one called "users" which the students will use as working areas and one called "data" which will contain subdirectories for each of the exercises:
 +
 +<code>
 +/data/lofarschool
 +      |-- data
 +      |   |-- Exercise_01
 +      |   |-- Exercise_02
 +      |   |-- Exercise_03
 +      |   `
 +      `-- users
 +</code>
 +
 +Each directory subdirectory will contain all the inputs, expected outputs, scripts, logfiles, instructions, etc associated with a  given exercise, i.e. :
 +
 +<code>
 +lioff023:/data/lofarschool/data/Exercise_01> ll
 +total 8
 +-rw-r--r-- 1 wise wise    0 2009-02-04 19:26 example_01.log
 +-rw-r--r-- 1 wise wise    0 2009-02-04 19:26 example_01.py
 +drwxr-xr-x 2 wise wise 4096 2009-02-04 19:25 inputs/
 +-rw-r--r-- 1 wise wise    0 2009-02-04 19:27 instructions.txt
 +drwxr-xr-x 2 wise wise 4096 2009-02-04 19:25 outputs/
 +-rw-r--r-- 1 wise wise    0 2009-02-04 19:26 README
 +lioff023:/data/lofarschool/data/Exercise_01>
 +</code>
 +
 +=== Preparation ===
 +
 +Everything in "/data/lofarschool/data" will be write protected. If users want to modify any of the input files or scripts, they can copy them to them working areas: 
 +  * ''/data/lofarschool/users'' and there create a new directory as your working area <code bash>
 +cd /data/lofarschool/users
 +mkdir myname
 +cd myname
 +</code>
 +  * Create a working copy of the exercise within your directory, so e.g. <code bash>
 +cp -r /data/lofarschool/data/Exercise-50 .
 +</code>
 +
 +=== Exercise instructions ===
 +
 +  - [[.2009-02_processing_school:Exercise 01A]] -- Station Data
 +  - [[.2009-02_processing_school:Exercise 02B]] -- Station Data
 +  - [[.2009-02_processing_school:Exercise 05]] -- Flagging, Compression along Freq, Time with DPPP
 +  - [[.2009-02_processing_school:Exercise 08]] -- Calibration with BBS
 +  - [[.2009-02_processing_school:Exercise 10]] -- AIPS and ParselTongue
 +  - [[.2009-02_processing_school:Exercise 45]] -- Visualizing the LOFAR LBA Beam
 +  - [[.2009-02_processing_school:Exercise 50]] -- Working with the Data Access Layer
 +  - [[.2009-02_processing_school:Exercise 51]] -- Working with the Data Access Layer
 +  - [[.2009-02_processing_school:Exercise 52]] -- Working with the Data Access Layer
 +  - [[.2009-02_processing_school:Exercise 53]] -- Working with the Data Access Layer
 +  - [[.2009-02_processing_school:Exercise 60]] -- Inspecting, flagging and imaging with CASA
 +  - [[.2009-02_processing_school:Exercise 61]] -- Inspecting, flagging and imaging with CASA
 +  - [[.2009-02_processing_school:Exercise 62]] -- Inspecting, flagging and imaging with CASA
 +  - [[.2009-02_processing_school:Exercise 63]] -- Inspecting and plotting visibility data with pyrap
 +  - [[.2009-02_processing_school:Exercise 64]] -- Image manipulation with pyrap
 +  - [[.2009-02_processing_school:Exercise PSR 01]] -- Pulsars/Beam-formed Data: Inspecting Timeries and Power Spectra
 +  - [[.2009-02_processing_school:Exercise PSR 02]] -- Pulsars/Beam-formed Data: Folding and Dedispersing to Detect a Pulsar
 +  - [[.2009-02_processing_school:Exercise PSR 03]] -- Pulsars/Beam-formed Data: Creating and Examining a Dynamic Spectrum
 +  - [[.2009-02_processing_school:Exercise CR0]] -- Setup, building of executables
 +  - [[.2009-02_processing_school:Exercise CR1]] -- DataReader 
 +  - [[.2009-02_processing_school:Exercise CR2]] -- Dynamic spectrum from LOFAR data
 +  - [[.2009-02_processing_school:Exercise CR3]] -- LOPES CR-pipeline
  
  • Last modified: 2011-10-25 12:46
  • by Lars Bahren