public:lta_new

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
public:lta_new [2018-07-10 12:44] – [How to find data in the archive] Marco Iacobellipublic:lta_new [2018-07-10 15:11] (current) – [Release Notes] Reinoud Bokhorst
Line 11: Line 11:
  
 ^ Release ^ Description ^ ^ Release ^ Description ^
-| July 2018 | 1) All data is now searchable, not only released data or data of projects you're a member of. Note that for downloading data (staging) the proprietary restrictions still apply. \\ 2) All projects can now be selected by all users, not only by project members. This provides the means to filter data based on project.\\ 3) The user interface has been changed to improve user friendliness. Key points are a more intuitive menu structure, improved project selection/deselection and restyling. \\ 4) Improved cone search algorithm based on the Haversine formula for angular distance calculation. The calculated angular distance to the reference coordinates is now displayed in the search results. |+| July 2018 | 1) All data is now searchable, not only released data or data of projects you're a member of. Note that for downloading data (staging) the proprietary restrictions still apply. \\ 2) All projects can now be selected by all users, not only by project members. This provides the means to filter data based on project.\\ 3) The user interface has been changed to improve user friendliness. Key points are a more intuitive menu structure, improved project selection/deselection and restyling. \\ 4) Implemented cone search algorithm based on the Haversine formula for angular distance calculation. The calculated angular distance to the reference coordinates is now displayed in the search results. \\ 5) Search keys added for "time resolution", "Frequency resolution" and "nr. of subbands per subband group" \\ 6) Search keys removed: "sky model database", strategy name" |
  
 ====== Public vs Proprietary data ====== ====== Public vs Proprietary data ======
Line 68: Line 68:
 A search in the LTA catalogue can be initiated by clicking on the SEARCH DATA button on the menu. At this point a default basic search is setup, where users can select the data product type of interest and perform a cone search. An advanced search mode, with more advanced parameters per data type, can also be selected by clicking on the drop menu on the left side.  A search in the LTA catalogue can be initiated by clicking on the SEARCH DATA button on the menu. At this point a default basic search is setup, where users can select the data product type of interest and perform a cone search. An advanced search mode, with more advanced parameters per data type, can also be selected by clicking on the drop menu on the left side. 
  
-A "project" can be selected by clicking on the BROWSE PROJECTS button on the menu. This is particularly useful for project related searches, as well as for checking either public projects or users co-author membership. At this stage several actions are allowed to+A "project" can be selected by clicking on the BROWSE PROJECTS button on the menu. This is particularly useful for project related searches, as well as for checking either public projects or user'co-author membership. At this stage several actions are allowed
     * Click on the project name to view the project details and eventually select it.     * Click on the project name to view the project details and eventually select it.
     * Use the 'search' button to select the project and go to the search page. Subsequent searches will then be done within that project.     * Use the 'search' button to select the project and go to the search page. Subsequent searches will then be done within that project.
Line 75: Line 75:
 === Finding Data === === Finding Data ===
  
-{{:public:lta_observations_2017.png?900|}}+{{:public:lta_observations_2018.png?900|}}
  
 Depending on the search parameters, e.g., which data products were requested (observation, pipeline), lists of observations and/or pipelines will be returned (see observations example above). From this point there are several options: Depending on the search parameters, e.g., which data products were requested (observation, pipeline), lists of observations and/or pipelines will be returned (see observations example above). From this point there are several options:
  
-  - select observations/pipelines and stage (prepare for download) all date related to the selection+  - select observations/pipelines and stage (prepare for download) all data related to the selection
   - select observations and "show pipelines" related to the observations, then select pipelines and stage   - select observations and "show pipelines" related to the observations, then select pipelines and stage
   - select observations/pipelines, "show dataproducts" related to the selection, possibly filter the data products (to have smaller selections) and then select and stage the data products   - select observations/pipelines, "show dataproducts" related to the selection, possibly filter the data products (to have smaller selections) and then select and stage the data products
Line 104: Line 104:
 Once you have a list of dataproducts, observations or pipelines, you can use the check boxes to select which files you want to download. The first check box can be used to select or deselect all files or observations on a page. Once you have a list of dataproducts, observations or pipelines, you can use the check boxes to select which files you want to download. The first check box can be used to select or deselect all files or observations on a page.
  
-{{:public:lta_staging_1.png|}}+{{:public:lta_staging_1.png?900|}}
  
 The LOFAR Archive stores data on magnetic tape. This means that it cannot be downloaded right away, but has to be copied from tape to disk first. This process is called 'staging'. The LOFAR Archive stores data on magnetic tape. This means that it cannot be downloaded right away, but has to be copied from tape to disk first. This process is called 'staging'.
Line 110: Line 110:
 When you have made your selection of files, click on //stage//. This shows you the following message. It means that a request has been sent to the LTA staging service to start retrieving the requested files from the tape and make them available on disk. You will get a confirmation e-mail, to acknowledge that your staging request was received and the process was queued. When the files are staged, you will get a notification email informing you that your data are ready for retrieval. When you have made your selection of files, click on //stage//. This shows you the following message. It means that a request has been sent to the LTA staging service to start retrieving the requested files from the tape and make them available on disk. You will get a confirmation e-mail, to acknowledge that your staging request was received and the process was queued. When the files are staged, you will get a notification email informing you that your data are ready for retrieval.
  
-{{:public:lta_howto3.png|}}+{{:public:lta_howto_3.png?900|}}
  
 The e-mail that you get when the staging on disk is complete gives you a list of files and has several attachments. Amongst them are two files ''html.txt'' and ''srm.txt'': The e-mail that you get when the staging on disk is complete gives you a list of files and has several attachments. Amongst them are two files ''html.txt'' and ''srm.txt'':
  • Last modified: 2018-07-10 12:44
  • by Marco Iacobelli