Differences
This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revisionLast revisionBoth sides next revision | ||
public:user_software:prefactor [2016-02-10 16:42] – [Documentation] Andreas Horneffer | public:user_software:prefactor [2019-02-25 09:15] – [To do list] David Rafferty | ||
---|---|---|---|
Line 5: | Line 5: | ||
The official repository of prefactor is now on GitHub: https:// | The official repository of prefactor is now on GitHub: https:// | ||
- | I consists of parsets for the [[http:// | + | It consists of parsets for the [[http:// |
It includes: | It includes: | ||
Line 14: | Line 14: | ||
There are several pipeline parsets in this repository: | There are several pipeline parsets in this repository: | ||
- | * **Pre-Facet-Cal.parset** : The " | + | * **Pre-Facet-Calibrator.parset** : The calibrator |
- | * **Pre-Facet-Cal-RawData-Single.parset** : A pre-facet pipeline to work on raw (non NDPPP' | + | * **Pre-Facet-Target.parset** : The target |
- | * **Pre-Facet-Cal-RawData-PreAvg.parset** : A pre-facet | + | * **Initial-Subtract.parset** : A pipeline that generates full FoV images and subtracts the sky-models from the visibilities. (Needed for Factor.) |
- | * **Initial-Subtract.parset** : A pipeline that generates full FoV images and subtracts the sky-models from the visibilities. (Needed for facet-calibration, | + | |
==== Software requirements ==== | ==== Software requirements ==== | ||
- | * the full " | + | * the full " |
* LoSoTo | * LoSoTo | ||
- | * Python-PP | + | * LSMTool |
* Python matplotlib | * Python matplotlib | ||
- | * WSClean (for Initial-Subtract, version >=1.9) | + | * WSClean (for Initial-Subtract) |
+ | * Aplpy (see https:// | ||
+ | * See the prefactor GitHub page for more information | ||
==== Documentation ==== | ==== Documentation ==== | ||
- | There is a preliminary version of a cookbook chapter | + | Installation and setup is explained |
**Please read that first!** | **Please read that first!** | ||
Line 38: | Line 37: | ||
* observed with the same selection of stations (If calibrator and target observations have the same number of stations but different stations, then the pipeline will not fail but produce wrong results.) | * observed with the same selection of stations (If calibrator and target observations have the same number of stations but different stations, then the pipeline will not fail but produce wrong results.) | ||
* observed close enough in time that calibration values can be transferred | * observed close enough in time that calibration values can be transferred | ||
- | * Yes, updating | + | * For each observation you should process all the calibrator data at once together. (Clock/TEC separation and flagging of bad amplitudes work better with the full bandwidth.) |
- | * Get someone | + | * Calibrator and target data are typically processed separately. |
+ | * The target data can be processed one time- or frequency- block at a time, e.g. when you have limited disk space. (The processed data is a lot smaller than the input data.) | ||
+ | * Don't forget | ||
+ | |||
+ | |||
+ | ==== FAQ ==== | ||
+ | |||
+ | **BLAS Core affinity :** Your pipeline runs slow. All NDPPP-/ | ||
+ | On clusters like CEP-3 the OpenBLAS library is built with threading affinity. This means that by default the different processes all try to use the same core(s). The '' | ||
- | === FAQ === | ||
**KeyError ' | **KeyError ' | ||
Line 73: | Line 79: | ||
</ | </ | ||
That was caused by a bug in an old version of the genericpipeline. Update the software, make sure you use the new version of the software when starting the pipeline, and check the pathes in '' | That was caused by a bug in an old version of the genericpipeline. Update the software, make sure you use the new version of the software when starting the pipeline, and check the pathes in '' | ||
+ | |||
+ | **invalid value for ExecField executable: | ||
+ | < | ||
+ | 2016-04-25 15:53:23 ERROR | ||
+ | 2016-04-25 15:53:23 ERROR | ||
+ | 2016-04-25 15:53:23 ERROR | ||
+ | 2016-04-25 15:53:23 ERROR | ||
+ | 2016-04-25 15:53:23 ERROR | ||
+ | 2016-04-25 15:53:23 ERROR | ||
+ | </ | ||
+ | The given path points to a file that either doesn' | ||
+ | ==== To do list ==== | ||
+ | |||
+ | For prefactor please use the ToDo list on the GitHub wiki: | ||
+ | https:// | ||
+ | Or set up an issue in the GitHub issue List: | ||
+ | https:// | ||
+ |