public:hdf5

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
public:hdf5 [2010-09-14 07:49] alexovpublic:hdf5 [2017-03-08 15:27] (current) – external edit 127.0.0.1
Line 6: Line 6:
  
 Overview:  Overview: 
-    * Quincey Koziol from the HDF5 Group visited the LOFAR crew at the UvA on Thursday-Friday (Sept. 9-10th).  The agenda is listed below.  We gave Quincey an overview of LOFAR along with an intro to the LOFAR data format/structures from the Interface Control Documents (ICDs).  All presentations are attached below. Quincey's HDF5 presentations can also be found below.+    * Quincey Koziol from the HDF5 Group visited the LOFAR crew at the UvA on Thursday-Friday (Sept. 9-10th).  The agenda is listed below.  We gave Quincey an overview of LOFAR along with an introduction to the LOFAR data format/structures from the Interface Control Documents (ICDs).  All presentations are attached below. Quincey's HDF5 presentations can also be found below.
  
  
Line 15: Line 15:
 ==== Agenda ==== ==== Agenda ====
 Thursday 10AM-lunch: Thursday 10AM-lunch:
-LOFAR Overview (15-30 mins) - Swinbank +   LOFAR Overview (15-30 mins) - Swinbank, {{Swinbank-HDF5-LOFAR.pdf|An Introduction to LOFAR}} 
-- LOFAR Image cubes (15-30 mins) - Anderson +   LOFAR Image cubes (15-30 mins) - Anderson, {{LOFAR_HDF5_SkyImage.ppt|LOFAR Sky Image Cubes}} 
-(coffee break @11AM) +   * (coffee break @11AM) 
-LOFAR Beam-formed data (15-30 mins) -  Alexov +   * LOFAR Beam-formed data (15-30 mins) -  Alexov, {{LOFAR-HDF5_BFoverview_20100909.ppt|LOFAR Beam-Formed Data & Pipeline Overview}} 
-- LOFAR Coordinates (15-30 mins) -  Baehren +   LOFAR Coordinates (15-30 mins) -  Baehren, {{2010-09-09-DAL.pdf|The Data Access Library ([[engineering:software:tools:DAL]])}} 
-(lunch)+   *(lunch)
  
 Thursday 2PM-5PM: Thursday 2PM-5PM:
-HDF5 talk/tutorial (60 min)  -  Quincey Koziol +   HDF5 talk/tutorial (60 min)  -  Quincey Koziol 
-Discussion on questions/concerns listed below  - All+   * Discussion on questions/concerns listed below  - All
  
 Friday 10AM-lunch: Friday 10AM-lunch:
-Performance questions (15-30 mins) - van Diepen +   Performance questions (15-30 mins) - van Diepen, {{hdf5-casacore.ppt|HDF5 and casacore}} 
-Open discussion on performance +   * Open discussion on performance 
-(coffee break @11AM) +   * (coffee break @11AM) 
-HDF5/LOFAR-related questions - All +   * HDF5/LOFAR-related questions - All 
-(lunch)+   * (lunch)
  
 Friday 2PM-5PM: Friday 2PM-5PM:
-Open discussion - All+   Open discussion - All
  
 +==== HDF5 Presentations ====
 +
 +    * {{HDF5_Introduction1_Model.ppt|Introduction to HDF5}}
 +    * {{HDF5_Introduction2_Format.ppt|Introduction to HDF5 - Session Two - Data Model Comparison; HDF5 File Format}}
 +    * {{HDF5_Introduction3_Software.ppt|Introduction to HDF5 - Session Three - HDF5 Software Overview}}
 +    * {{HDF5_Introduction4_Java.ppt|Introduction to HDF5 - Session Four - Java Products}}
 +    * {{HDF5_DataValuesAreKey.ppt|Introduction to HDF5 - Session Five - Reading & Writing Raw Data Values}}
 +    * {{HDF5_Introduction-Datatypes.ppt|Introduction to HDF5 - Session Seven - Datatypes}}
 +    * {{HDF5_Introduction-IOPerformance.ppt|Introduction to HDF5 - High Performance I/O}}
 +    * {{HDF5_Introduction-Math.ppt|Introduction to HDF5 - Introduction to Mathematical Concepts}}
 +    * {{HDF5_Introduction-StorageOptions.ppt|Data Storage and I/O in HDF5}}
 +    * {{HDF5Update.ppt|HDF5 Update}}
  
 ==== QUESTION/TOPIC for DISCUSSION: ==== ==== QUESTION/TOPIC for DISCUSSION: ====
-performance benchmarks +   performance benchmarks 
-access patterns +   * access patterns 
-intelligent filtering and slicing +   * intelligent filtering and slicing 
-efficient data storage / chunking +   * efficient data storage / chunking 
-parallel I/O +   * parallel I/O 
-distributed storage +   * distributed storage 
-tools which exist for HDF5 (other than HDFView, h5py, pytables)+   * tools which exist for HDF5 (other than HDFView, h5py, pytables)
  
 ==== CONCERNS: ==== ==== CONCERNS: ====
Line 60: Line 72:
 === LOFAR ICD (Interface Control Documents): === === LOFAR ICD (Interface Control Documents): ===
  
-LOFAR Interface Control Documents (ICDs): [[documents:lofar_data_products]] +LOFAR Interface Control Documents (ICDs): [[http://usg.lofar.org/wiki/doku.php?id=documents:lofar_data_products]]
- +
-==== HDF5 Presentations ====+
  
  
  • Last modified: 2010-09-14 07:49
  • by alexov