============================================ Nagg version 1.6.2 released on 2016-07-22. ============================================ 1. Introduction =============== This document describes the NPP Aggregation tool, nagg, and contains information on platforms tested, changes since last release and any known problems. If you have any questions or comments, please send them to: help@hdfgroup.org 2. Platforms Tested =================== Linux 2.6.32 x86_64 with gcc 4.4.7, 4.9.3 and icc 15.0.3 3.10.0 x86_64 with gcc 4.8.5, 5.2.0 and 15.0.3 2.6.32 ppc64 with gcc 4.4.7 and IBM XL C V13.1 Mac OS X: Mt. Lion 10.8.5 with clang 5.1 Mavericks 10.9.5 with clang 6.0 Yosemite 10.10.5 with clang 6.0 El Capitan 10.11.4 with clang 7.3 3. New features and bug fixes since Version 1.6.1 ================================================= Configuration ------------- - None Features -------- - Added --onefile command option to produce a single output aggregation for each product containing all of the granules from the input files. These aggregations may be packaged in a single file or unpackaged in separate files. - Added --nofill command option to suppress creation of fill granules when granules are missing in a time series or when one or more products are missing for a time slot when multiple products are aggregated. - Added an environment variable to override the limit for total number of granules processed in a nagg operation. The built-in limit is now 20,000 granules, set by NAGG_Granule_info_max. The new environment variable is NAGG_MAX_GRANULES, which can raise the limit as much as the available memory will allow or lower the limit if the system cannot suppport the default limit. This limit may be eliminated in a future release. Bug Fixes --------- - nagg's function to calculate file and granule start and end times was not equipped to handle variable numbers of leap seconds, which was exposed by an additional leap second on June 30, 2015. The function was called to calculate granule and aggregation start and end times, most often when creating fill granules. In general, start and end times from real granules were used in the filenames when available. The code has been adapted to use start and end times from compatible granules in the same time slot if available, or otherwise to add/subtract the granule duration to/from the nearest available real granule, avoiding the need to update nagg whenever a new leap second occurs. (LK, 2016/07/22 JPSS-204) - A file was discovered that had a value for an AggregateNumberGranules attribute that did not match the actual number of granules in the aggregate product group. nagg now checks the number of granules in each group in the file, processes all granules and issues a warning to stderr if the attribute value does not match. (LK, 2016/07/22) - There was a change to h5dump in the HDF5 1.8.17 release that changed the output of several tests of nagg output with filter and layout options, causing make check to fail. The tests and the expected output were revised for both new and previous h5dump output. (LK, 2016/07/22) Limits ------ - See nagg.docx (html, pdf) in the same directory for proposed functionality. Current release has the following limitations: * Like (--like) option retrieves three properties (number of granules, types contained, and geolocation product or external geolocation file attribute) from the example file. Whether the output should be packaged or unpackaged is determined from the geolocation characteristics of the example file. Geolocation only aggregation is now supported, but origin and domain are determined only from the command line options. * Environment variables or command line options for compliance with file naming convention presume valid types and packaging as defined in the "nagg.h" file. * Warnings or failures if granule gaps exceed some threshold are not supported. * Options to choose repair granule are not supported; for now, the one with the latest version is used. * Option to replace existing granule with repair granule is not supported. * Restrictions on flags and input parameters: Directory input is not supported. 4. Known problems ================= - nagg copies the value of the BeginningOrbitNumber attribute from the first granule in an aggregation and the value of the EndingOrbitNumber attribute to the attributes in the ..._Aggr dataset for the aggregation. If either of those granules are fill granules the value of these attributes may be 0 or a fill value. - nagg may fail with a segmentation fault if there is insufficient disk drive space to hold the output files. In general the ouput files will require the same amount of disk space as the input files.