Differences
This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision | ||
public:user_software:prefactor [2016-03-11 21:17] – [Documentation] Andreas Horneffer | public:user_software:prefactor [2019-02-25 09:16] (current) – [To do list] David Rafferty | ||
---|---|---|---|
Line 14: | Line 14: | ||
There are several pipeline parsets in this repository: | There are several pipeline parsets in this repository: | ||
- | * **Pre-Facet-Cal.parset** : The " | + | * **Pre-Facet-Calibrator.parset** : The calibrator |
- | * **Pre-Facet-Cal-RawData-Single.parset** : A pre-facet pipeline to work on raw (non NDPPP' | + | * **Pre-Facet-Target.parset** : The target |
- | * **Pre-Facet-Cal-RawData-PreAvg.parset** : A pre-facet | + | * **Initial-Subtract.parset** : A pipeline that generates full FoV images and subtracts the sky-models from the visibilities. (Needed for Factor.) |
- | * **Initial-Subtract.parset** : A pipeline that generates full FoV images and subtracts the sky-models from the visibilities. (Needed for facet-calibration, | + | |
==== Software requirements ==== | ==== Software requirements ==== | ||
- | * the full " | + | * the full " |
* LoSoTo | * LoSoTo | ||
* LSMTool (see https:// | * LSMTool (see https:// | ||
- | * Python-PP (see http:// | ||
* Python matplotlib | * Python matplotlib | ||
- | * WSClean (for Initial-Subtract, version >=1.9) | + | * WSClean (for Initial-Subtract) |
+ | * Aplpy (see https:// | ||
+ | * See the prefactor GitHub page for more information | ||
==== Documentation ==== | ==== Documentation ==== | ||
- | Installation and setup is explained | + | Installation and setup is explained |
**Please read that first!** | **Please read that first!** | ||
Line 40: | Line 38: | ||
* observed close enough in time that calibration values can be transferred | * observed close enough in time that calibration values can be transferred | ||
* For each observation you should process all the calibrator data at once together. (Clock/TEC separation and flagging of bad amplitudes work better with the full bandwidth.) | * For each observation you should process all the calibrator data at once together. (Clock/TEC separation and flagging of bad amplitudes work better with the full bandwidth.) | ||
- | * The target data can be processed one time- or frequency- block at a time. | + | |
- | * Yes, updating the LOFAR software can be annoying. But it is worth ist! Trust me. 8-) | + | |
- | * Get someone to write a better documentation for the genericpipeline. | + | |
* Don't forget to update the recipe_directories entry in the pipeline.cfg to include the pre-factor plugins, for example: < | * Don't forget to update the recipe_directories entry in the pipeline.cfg to include the pre-factor plugins, for example: < | ||
Line 83: | Line 80: | ||
That was caused by a bug in an old version of the genericpipeline. Update the software, make sure you use the new version of the software when starting the pipeline, and check the pathes in '' | That was caused by a bug in an old version of the genericpipeline. Update the software, make sure you use the new version of the software when starting the pipeline, and check the pathes in '' | ||
+ | **invalid value for ExecField executable: | ||
+ | < | ||
+ | 2016-04-25 15:53:23 ERROR | ||
+ | 2016-04-25 15:53:23 ERROR | ||
+ | 2016-04-25 15:53:23 ERROR | ||
+ | 2016-04-25 15:53:23 ERROR | ||
+ | 2016-04-25 15:53:23 ERROR | ||
+ | 2016-04-25 15:53:23 ERROR | ||
+ | </ | ||
+ | The given path points to a file that either doesn' | ||
==== To do list ==== | ==== To do list ==== | ||
- | == Pre factor == | + | For feature requests or bug reports, please open an issue on the GitHub at: |
- | + | https:// | |
- | * RMwriter | + | |
- | * Write script for automatic flagging | + | |
- | * TGSS global sky model (not really something to develop) | + | |
- | * Collect phase calibration solutions and fit to these and apply the fits (Reinout has script). | + | |
- | * Check fix for observations without continuous frequency coverage | + | |
- | * Move to NDPPP (waiting for NDPPP developments). | + | |
- | + | ||
- | == Subtract pipeline == | + | |
- | + | ||
- | * Create a deep image by stacking 10subband images and use this image or catalog of this image to help create facets and avoid sources at the boundaries. | + | |
- | + | ||
- | == FACTOR == | + | |
- | * Time correlation settings given by user. | ||
- | * Aplpy plots (Tammo has script on his github but change noise to 1mJy (current 5mJy)) | ||
- | * All WSclean (any aliasing issues?) | ||
- | * pybdsm boxes from restoring beam size. | ||
- | * outer uvrange option (maybe good for help create models for selfcalbration when working at full resolution) | ||
- | * Check that amplitudes are properly normalised | ||
- | * Second major iteration | ||
- | * High dynamic range option | ||
- | * optimize number of IO-intesive (NDPPP) processes |