HDF5 Papers

• NetCDF-4 and HDF5:
  • NetCDF-4 Performance Report (PDF)(June, 2008)
    Compares performance of netCDF-3 and netCDF-4; discusses netCDF-4 performance tuning and pitfalls (also applicable to HDF5).

• HDF5 Archival Information Package: (April 2006)
  • “HDF5 Archival Information Package (AIP): A METS Implementation” (PDF) (HTML)

• Issues in Parallel I/O: (2006)
  • Parallel I/O Performance Study with HDF5, a Scientific Data Package (PDF)
  • Using Collective I/O inside a High Performance I/O Software Package (PDF)

• Indexing in HDF5: (2005)
  • Requirements for Indexing Prototype in HDF5 - RFC (PDF)
  • High Level Indexing in HDF5 - RFC (PDF)

• HDF Software Process (PDF)   (12/04)

• Shuffling Performance Study (PDF) (2004)

• Compression I/O Experiments from SCIDAC (2004)
• Weather Research Forcast (WRF) I/O Module, Regional Ocean Model System (ROMS), Parallel Performance Studies
• BZIP Compression Study

• HDF4-HDF5 compatibility and conversion
  

• HDF4 vs HDF5 Performance (2000)
• HDF5 for HDF4 Users: A Short Guide (Dec. 2002) [pdf]
• Transition from HDF5 for HDF4 Users: status and goals (Dec. 2002) [pdf]
• Transition from HDF4 to HDF5: Issues   (Sep. 2000) (Slides)
• Tests of the NCSA h4toh5 utility with NASA Datasets, August, 2001. [HTML]
• Conversion of from HDF4 to HDF5: "Hybrid" HDF-EOS Files, Feburary. 2002. [HTML]
• Java, XML, Servlets, CORBA, etc.
• Robert E. McGrath. XML and Scientific File Formats (August, 2003)   [ pdf ]
• Robert E. McGrath. Experiment with XSL: translating scientific data  (February, 2001)   [ pdf ]
• Robert E. McGrath. An Experimental Comparison of HDF4, HDF5, and XML Representations of the Same Dataset   [ pdf ]
• Kun Yan and Robert E. McGrath. Experiments with JSP, XML, CORBA, and HDF (August, 2002)   [ pdf ]
• Kun Yan and Robert E. McGrath. Experiments with Remote Access to Scientific Data using HDF5 (May 15, 2002) [ ppt ]
• Kun Yan and Robert E. McGrath. Experiment on JSP, XML, and HDF (September, 2001)   [ pdf ] 
• Digital Libraries
• Mike Folk and Vailin Choi. Scientific formats for geospatial data preservation -- A study of suitability and performance   [ pdf ]

• Mike Folk and Bruce Barkstrom. Attributes of File Formats for Long-Term Preservation of Scientific and Engineering Data in Digital Libraries   [ doc ]

*Note: The information on this page is being retained for technical and historical reference only. The site is not under active maintenance and may include expired information and outdated links.*

Last Modified: May 28, 2010