Differences
This shows you the differences between two versions of the page.
| Next revision | Previous revision | ||
| public:user_software:documentation:standard_imaging_pipeline [2016-12-15 07:57] – Document moved from software:standard_imaging_pipeline Arno Schoenmakers | public:user_software:documentation:standard_imaging_pipeline [2017-03-08 15:27] (current) – external edit 127.0.0.1 | ||
|---|---|---|---|
| Line 1: | Line 1: | ||
| - | ===== Documentation | + | ===== Some useful links for the Standard Imaging Pipeline ===== |
| - | + | ||
| - | === News === | + | |
| - | | 23-Apr-2015 | DPPP has option of user defined steps (possibly in Python) | | + | |
| - | | 22-Apr-2014 | Version 14.1 of the [[http:// | + | |
| - | | 25-Sep-2012 | Version 1.0 of the online pipeline documentation: | + | |
| - | | 06-Apr-2012 | Version 11.0 of the [[http:// | + | |
| - | | 26-Jan-2012 | Version 10.2 of the [[http:// | + | |
| - | | 14-Dec-2011 | Version 10.1 of the [[http:// | + | |
| - | | 13-Dec-2011 | New NDPPP msin parameters to combine subbands or to select baselines. \\ By default the aoflagger step writes statistical flag information into QUALITY subtables. | | + | |
| - | | 4-Nov-2011 | Version 10.0 of the [[http:// | + | |
| - | | 7-Sep-2011 | Specification of spectral index in BBS and [[public: | + | |
| - | | 26-Jul-2011 | [[software: | + | |
| - | | 10-Jul-2011 | Version 9.0 of the [[http:// | + | |
| - | | 26-Mar-2011 | Info needed for the BBS beam calculation must be part of the MeasurementSet. | + | |
| - | | 1-Mar-2011 | Version 6.0 of the [[http:// | + | |
| - | | 31-Jan-2011 | Added PhaseShift step to NDPPP | | + | |
| - | | 28-Jan-2011 | [[public: | + | |
| - | | [[previous news ]] || | + | |
| === User Documentation === | === User Documentation === | ||
| Line 24: | Line 6: | ||
| === MSSS processing === | === MSSS processing === | ||
| - | The processing of the MSSS observations will be done in an automated way by means of a few [[engineering: | + | The processing of the MSSS observations will be done in an automated way by means of a few [[engineering: |
| - | [[pipeline_changelist|Pipeline Framework Changelist]] | + | [[software:pipeline_changelist|Pipeline Framework Changelist]] |
| === RTCP processing === | === RTCP processing === | ||
| Line 32: | Line 14: | ||
| === Useful Tools === | === Useful Tools === | ||
| - | * [[engineering: | + | * [[engineering: |
| - | * [[engineering: | + | * [[engineering: |
| - | * [[engineering: | + | * [[cexecms| cexecms]]: run a script on cluster nodes for all data files matching a file name pattern |
| - | * [[engineering: | + | * [[engineering: |
| * [[engineering: | * [[engineering: | ||
| * [[http:// | * [[http:// | ||
| Line 42: | Line 24: | ||
| * {{ lofar_dppp_flags.pdf | Pre-flag document}} - V.N. Pandey | * {{ lofar_dppp_flags.pdf | Pre-flag document}} - V.N. Pandey | ||
| * {{ NDPPP_report.pdf | Testing of DPPP}} - David Rafferty, 11-Mar-2010 | * {{ NDPPP_report.pdf | Testing of DPPP}} - David Rafferty, 11-Mar-2010 | ||
| - | * [[public: | + | * [[ndppp| DPPP documentation]] |
| - | * [[engineering: | + | * [[engineering: |
| * [[http:// | * [[http:// | ||
| | | ||
| Line 50: | Line 32: | ||
| === BBS === | === BBS === | ||
| - | * [[public: | + | * [[bbs| BBS documentation]] |
| * {{performance_JvZ.pdf | Initial BBS performance}} 07Jan08 - Joris van Zwieten | * {{performance_JvZ.pdf | Initial BBS performance}} 07Jan08 - Joris van Zwieten | ||
| * {{parmdb.pdf | parmdb: Parameter Database}} - Ger van Diepen | * {{parmdb.pdf | parmdb: Parameter Database}} - Ger van Diepen | ||
| - | * [[public: | + | * [[parmdbm| parmdbm]]: program to maintain a parameter table |
| - | * [[public: | + | * [[parm-export| cross-calibration]]: |
| - | * [[public: | + | * [[makesourcedb| makesourcedb, |
| * {{makems.pdf | makems: Creating (distributed) MeasurementSet}} - Ger van Diepen | * {{makems.pdf | makems: Creating (distributed) MeasurementSet}} - Ger van Diepen | ||
| - | * [[engineering: | + | * [[makebeamtables| makebeamtables]]: |
| === Imaging === | === Imaging === | ||
| - | * [[engineering: | + | * [[engineering: |
| - | * [[engineering: | + | * [[engineering: |
| * {{ mwimager.pdf | description of mwimager, clusterdesc and VDS files }} - Ger van Diepen. | * {{ mwimager.pdf | description of mwimager, clusterdesc and VDS files }} - Ger van Diepen. | ||
| * {{ Cornwell_wprojection.pdf | W - Projection paper}} - Cornwell et al. | * {{ Cornwell_wprojection.pdf | W - Projection paper}} - Cornwell et al. | ||
| * {{ FreqResLOFARimaging_v1.0.pdf | Specification of the Frequency Resolution}} - Ger de Bruyn | * {{ FreqResLOFARimaging_v1.0.pdf | Specification of the Frequency Resolution}} - Ger de Bruyn | ||
| - | * [[engineering: | + | * [[engineering: |
| - | * [[engineering: | + | * [[engineering: |
| * [[http:// | * [[http:// | ||
| Line 81: | Line 63: | ||
| === Global Sky Model === | === Global Sky Model === | ||
| - | * [[public: | + | * [[gsm.py| gsm.py: extract input for makesourcedb from GSM]] |
| * {{tkp_expected_data_rates_volumes.pdf | Expected Data Rates and Volumes for the TKP}} - Bart Scheers | * {{tkp_expected_data_rates_volumes.pdf | Expected Data Rates and Volumes for the TKP}} - Bart Scheers | ||
| * {{tkp_transient_variability_detection.pdf | Transient and Variability Detection Algorithms}} - Bart Scheers | * {{tkp_transient_variability_detection.pdf | Transient and Variability Detection Algorithms}} - Bart Scheers | ||
| Line 92: | Line 74: | ||
| === ParSet documentation === | === ParSet documentation === | ||
| * {{parameterset_3.pdf | LOFAR ParameterSet}} - Ger van Diepen | * {{parameterset_3.pdf | LOFAR ParameterSet}} - Ger van Diepen | ||
| - | * NDPPP: [[public: | + | * NDPPP: [[ndppp# |
| - | * BBS: [[public: | + | * BBS: [[bbsconfigurationsyntax| BBS parameter set documentation]] |
| - | * mwimager: [[engineering: | + | * mwimager: [[engineering: |
| === Other documents === | === Other documents === | ||
| Line 103: | Line 85: | ||
| ==== Pipeline Profiling ==== | ==== Pipeline Profiling ==== | ||
| ---- | ---- | ||
| - | Some [[ software: | + | Some [[software: |
| - | + | ||
| - | ==== People ==== | + | |
| - | * [[User: | + | |
| - | * [[User:Ger van Diepen|Ger van Diepen]] (NDPPP, parmdb) | + | |
| - | * [[User: | + | |
| - | * [[User: | + | |
| - | * [[User:Bas vd Tol|Bas vd Tol]] (imaging, ionosphere, clock errors) | + | |
| - | * [[User: | + | |