Release 2022
Release Tag: RELEASE-2022
Release Date: January 20, 2022
Contents: JSON manifest
neonUtilities: use v2.1.3 and higher
NEON’s second data Release, RELEASE-2022, includes 161 data products annotated by 129 DOIs.
- RELEASE-2022 includes Instrumented Systems (IS) and Airborne Observation Platform (AOP) data through June 2021 and Observational Systems (OS) data through December 2020.
- Data products that are exclusively hosted by an external repository are excluded. These are 1) the Phenocam data products Phenology images (DP1.00033.001), Land-water interface images (DP1.20002.001), and Snow depth and understory phenology images (DP1.00042.001), and 2) the AERONET product Spectral sun photometer - calibrated sky radiances (DP1.00043.001).
- Sub-products that are exclusively downloadable via a parent product are associated with the same DOI as their parent.
- Some data products or subsets of data products (certain date ranges) have been excluded. Data may be available in excluded products and time periods; these data are provisional, and subject to change. Please refer to the exclusion table below.
- For all OS data products, routine data entry errors (such as transcription errors, duplicate records, or adjusted spatial coordinates) have been corrected where possible. For all IS data products, data were reprocessed to incorporate minor and/or isolated corrections to quality control thresholds, sensor installation periods, geolocation data, and manual quality flags. More specific changes to data products between this release and the previous release have been described in a table below. Please refer to this table as well as the issue logs for each data product for more details.
- After January 2023, AOP data products, due to their high volumes, will be exclusively available in the most recent release. The DOIs for the AOP data products in this release will tombstoned.
Data Exclusions
| Data Product ID | Data Product Name | What is excluded besides 2021-01 (OS) or 2021-07 (IS, AOP) and later | Rationale |
|---|---|---|---|
| DP1.20059.001 | Windspeed and direction above water on-buoy | 2020 | New field measurements and re-processing imminent |
| DP4.00130.001 | Continuous discharge | WY2020 and WY2021 for all sites and additionally May 2019 - September 2019 for MCRA and September 2019 for CUPE | Re-processing with new rating curves imminent |
| DP4.00133.001 | Stage-discharge rating curves | WY2020 and WY2021 for all sites and additionally May 2019 - September 2019 for MCRA and September 2019 for CUPE | Re-processing of new rating curves imminent |
| DP1.20267.001 | Gauge height | 2020 | Data updates anticipated as rating curves are processed |
| DP1.20092.001 | Chemical properties of groundwater | 2020 | 2020 laboratory analyses incomplete |
| DP1.20093.001 | Chemical properties of surface water | 2020 | 2020 laboratory analyses incomplete |
| DP1.20206.001 | Stable isotopes in surface water | 2020 | 2020 laboratory analyses incomplete |
| DP1.20163.001 | Periphyton, seston, and phytoplankton chemical properties | 2020 | 2020 laboratory analyses incomplete |
| DP1.20166.001 | Periphyton, seston, and phytoplankton collection | 2020 | 2020 laboratory analyses incomplete |
| DP1.10020.001 | Ground beetle sequences DNA barcode | 2020 | 2020 sequencing incomplete |
| DP1.10022.001 | Ground beetles sampled from pitfall traps | 2020 | 2020 expert identification incomplete |
| DP1.20278.001 | Surface water microbe group abundances | 2020 | 2020 laboratory analyses incomplete |
| DP1.20281.001 | Surface water microbe metagenome sequences | 2020 | 2020 laboratory analyses incomplete |
| DP1.20282.001 | Surface water microbe marker gene sequences | 2019 and 2020 | 2020 sequencing and 2019 ITS sequencing incomplete |
| DP1.20141.001 | Surface water microbe community composition | 2019 and 2020 | 2020 sequencing and 2019 ITS sequencing incomplete |
| DP1.10107.001 | Soil microbe metagenome sequences | 2020 | 2020 laboratory analyses incomplete |
| DP1.10108.001 | Soil microbe marker gene sequences | 2019 and 2020 | 2020 sequencing and 2019 ITS sequencing incomplete |
| DP1.10081.001 | Soil microbe community composition | 2019 and 2020 | 2020 sequencing and 2019 ITS sequencing incomplete |
| DP1.20086.001 | Benthic microbe community composition | 2019 and 2020 | 2020 sequencing and 2019 ITS sequencing incomplete |
| DP1.20277.001 | Benthic microbe group abundances | 2020 | 2020 laboratory analyses incomplete |
| DP1.20280.001 | Benthic microbe marker gene sequences | 2019 and 2020 | 2020 sequencing and 2019 ITS sequencing incomplete |
| DP1.20279.001 | Benthic microbe metagenome sequences | 2020 | 2020 sequencing incomplete |
| DP4.00200.001 | Bundled data products – eddy covariance | BARR 05-2017 to 08-2017 BART 12-2016 to 1-2017 BONA 10-2017 CLBJ 09-2017 to 10-2017 CPER 11-2017 DELA 02-2017 DSNY 02-2017 JORN 03-2017 to 08-2017 LAJA 08-2017 to 04-2018 NOGP 09-2017 ORNL 03-2017 to 06-2017 SERC 03-2017 to 05-2017 TEAK 06-2018 UNDE 02-2017 WREF 09-2017 to 02-2018 YELL 08-2017 | Site start dates have been consistently defined in this release. The excluded site-months are prior to a site passing initial operation review or prior to installation of the 3D sonic anemometer |
| DP1.30001.001 | LiDAR Slant Range Waveform | 2020 – 07 RMNP 2020 – 06 ARIK 2020-07 UKFS 2020-06 WOOD | Filename updates required to conform filenames to the convention |
| DP1.30003.001 | Discrete Return LiDAR Point Cloud | 2018-05 GUIL | Colorization has not yet been added to the point cloud |
| DP1.30010.001 | High-resolution Orthorectified camera imagery | 2020-01 PUUM | Data coverage will be improved with a gap-filling routine |
| All AOP spectrometer data products | All AOP spectrometer data products | 2018-05 LAJA and 2018-05 GUAN | Error in the trajectory timing signal resulted in geolocation errors that require correction |
| All lidar products | All lidar products | 2016 – 07 STEI | Data from Chequamegon-Nicolet National Forest located in a UTM zone inconsistent with other years |
| All camera products | All camera products | 2016 – 07 STEI and 2017- 08 STEI | Data from Chequamegon-Nicolet National Forest located in a UTM zone inconsistent with other years |
| All AOP lidar and camera products | All AOP lidar and camera products | 2016 – 07 SERC | Correcting duplicate or incorrect naming convention |
Changes between RELEASE-2021 and RELEASE-2022
| Data Product ID | Data Product Name | Summary of changes between RELEASE-2021 and RELEASE-2022 |
|---|---|---|
| DP1.00001.001 | 2D wind speed and direction | All data were reprocessed with an updated algorithm to resolve errors in the computation of wind direction statistics (mean, variance, expanded uncertainty, and standard error of the mean) and wind speed expanded uncertainty. Sensor orientations and resultant wind directions were corrected for select sites and time periods. See data product issue log for details. |
| DP1.20059.001 | Windspeed and direction above water on-buoy | This is the initial release of this data product. Data from 2020 and on have been withheld from RELEASE-2022 as NEON works to correct wind direction data. |
| DP1.20288.001 | Water quality | Data were reprocessed using an updated algorithm to add seaLevelDissolvedOxygenSat (dissolved oxygen saturation corrected to sea level pressure) and localDissolvedOxygenSat (dissolved oxygen saturation as measured at local pressure) and remove dissolvedOxygenSaturation, which was the same as the new seaLevelDissolvedOxygenSat. Additional minor changes and/or corrections were made to quality control thresholds, sensor installation periods, and manual quality flags. |
| DP4.00133.001 | Stage-discharge rating curves | This is the initial release of this data product. |
| DP4.00130.001 | Continuous discharge | This is the initial release of this data product. |
| DP1.10045.001 | Non-herbaceous perennial vegetation structure | Data have been bundled with DP1.10098.001, and are no longer available independently. |
| DP1.10098.001 | Vegetation structure | Now includes all vegetation structure data, including data formerly accessible via DP1.10045.001 |
| DP1.20197.001 | Sediment physical properties | Data have been bundled with DP1.20194.001, and are no longer available independently. |
| DP1.20194.001 | Sediment chemical and physical properties | Now includes all sediment data, including data formerly accessible via DP1.20197.001 |
| DP1.10043.001 | Mosquitoes sampled from CO2 traps | New data table added, mos_subsampling. Simplifies data workflows by removing subsample definition from the mos_identification table. |
| All taxonomic products | All taxonomic products | Prior to the 2022 data release, publication of species identifications were obfuscated to a higher taxonomic rank when the taxon was found to be listed as threatened, endangered, or sensitive at the state level where the observation was recorded. Starting with RELEASE-2022, this process was removed from data publication at all locations excluding sites located in D01 and D20. Federally listed threatened and endangered or sensitive species remain obfuscated at all sites, and sensitive species remain redacted at National Park sites. |
| DP4.00200.001 | Bundled data products - eddy covariance | All data were reprocessed with the latest version of eddy4R. The LI-7200 IRGA drift correction code was updated to perform a benchmark evaluation to determine if each day’s validation is suitable for correcting CO2 concentration data. Coefficients and quality information from this evaluation were added to the expanded file. Ancillary turbulent exchange system quality flags (qf) were changed to quality indicators (qi) to reduce data over flagging. The atmospheric pressure spike test was changed to a qi until additional testing of parameters can be performed. Quality flags from the LI7200 were added to the qfqm determination for the tempAir data product because water vapor data from the LI-7200 are used in the conversion of sonic temperature to air temperature. The step test was removed from Picarro data products. UTC time offset and eddy4R code version metadata were added to the HDF5 file. Small changes to QAQC procedures were made during reprocessing to refine data flagging and science review flags were raised where necessary. See bundled data product and constituent data product issue logs for details. |
| DP1.00101.001 | Particulate Mass | New table dpm_filterBlank was added to the data product for users to have information about blank filters available at the Biorepository. Data include linking information so users can request blanks from the lot number matching samples of interest. |
| DP4.00132.001 | Bathymetric and morphological maps | Tables associated with AIS site surveys, Stage-discharge rating curves (DP4.00133.001), and Continuous discharge (DP4.00130.001) are no longer included in downloads. They are now included with the other relevant data products, though. |
| DP1.20120.001 | Macroinvertebrate collection | New sample identifier and sample class (mixedInvertVialID) to capture general macroinvertebrate vials stored at ASU biorepository. |
| DP1.20126.001 | Macroinvertebrate metabarcoding | The following supplemental tables are now published with this data product: inv_metabarcodeTaxonList, inv_metabarcodeSummary, inv_dnaStandardTaxon, inv_dnaExtractionStandard_pub, inv_pcrAmplificationStandard, inv_markerGeneSequencingStandard and inv_dnaRawDataFilesStandard. |
| DP1.20219.001 | Zooplankton collection | New zoo_perSample table available for this data product to capture data quality and sample-level information, such as general zooplankton vials stored at the Biorepository. |
| DP1.20221.001 | Zooplankton metabarcoding | The following supplemental tables are now published with this data product: inv_metabarcodeTaxonList, inv_metabarcodeSummary, inv_dnaExtractionStandard_pub, inv_pcrAmplificationStandard, inv_markerGeneSequencingStandard and inv_dnaRawDataFilesStandard. |
| DP1.10064.002 | Rodent pathogen status, tick-borne | This is a revision of DP1.10064.001 to report tick-borne pathogens found in rodent blood and ear samples rather than hantavirus infections. Data begin with a 2020 pilot experiment at five sites and will expand to be observatory-wide in future years. |
| DP1.20093.001 | Chemical properties of surface water |
New sample classes asi_fieldData_in.isotopePOMsampleID and asi_fieldData_in.isotopePOMRep2sampleID published in swc_externalLabDataByAnalyte for the analytes total particulate carbon (TPC) and nitrogen (TPN). Also, a new swc_asiPOMFieldData table published this data product to report field data for the new samples classes. Prototype data from 2011 were removed; these data can be found on the Prototype Datasets page. |
| DP1.30008.001 | Spectrometer Orthrorectified at-Sensor Radiance | Remaining legacy datasets were updated to the latest internal HDF5 structure which splits Radiance data into integer and decimal parts. Data were updated for the 2018 WREF and 2018 GUIL collection to correct a geolocation issue. |
| DP1.30001.001 | LiDAR Slant Range Waveform | Pulsewaves filenames were updated at several sites to the accepted naming convention |
| DP1.30003.001 | Discrete Return LiDAR Point Cloud | LAZ filenames updated at several sites to the accepted naming convention, point clouds that were previsously not colorized were updated to include colors. Data were updated for the 2018 WREF collection to correct a geolocation issue. Some missing files in the 2016 OSBS and 2016 UKFS collections were added. |
| DP1.30006.001 | Spectrometer Orthorectified Surface Directional Reflectance - flightline | Data were updated for the 2018 WREF and 2018 GUIL collection to correct a geolocation issue. |
| DP2.30019.001 | Canopy Water Indices - flightline | Data were updated for the 2018 WREF and 2018 GUIL collection to correct a geolocation issue. Checksums on data product files were updated. |
| DP2.30026.001 | Vegetation Indices - Spectrometer - flightline | Data were updated for the 2018 WREF and 2018 GUIL collection to correct a geolocation issue. Checksums on data product files were updated. |
| DP3.30015.001 | Ecosystem Structure | Filenames at several sites were updated to the accepted naming convention. Data were updated for the 2018 WREF collection to correct a geolocation issue. Data were updated at 2018 SRER and 2018 JORN to reflect an improvement in the algorithm for short stature vegetation. |
| DP3.30024.001 | Elevation - LiDAR | Filenames at several sites were updated to the accepted naming convention. Data were updated for the 2018 WREF collection to correct a geolocation issue. |
| DP3.30025.001 | Slope and Aspect - LiDAR | Filenames at several sites were updated to the accepted naming convention. Data were updated for the 2018 WREF collection to correct a geolocation issue. |
| DP2.30011.001 | Albedo - Spectrometer - flightline | Data were updated for the 2018 WREF and 2018 GUIL collection to correct a geolocation issue. |
| DP2.30012.001 | LAI - Spectrometer - flightline | Data were updated for the 2018 WREF and 2018 GUIL collection to correct a geolocation issue. |
| DP2.30014.001 | fPAR - Spectrometer - flightline | Data were updated for the 2018 WREF and 2018 GUIL collection to correct a geolocation issue. A tif tag describing the sensor used to collect the data was corrected. |
| DP3.30006.001 | Spectrometer Orthorectified Surface Directional Reflectance - mosaic | Data were updated for the 2018 WREF and 2018 GUIL collection to correct a geolocation issue. |
| DP3.30011.001 | Albedo - Spectrometer - mosaic | Data were updated for the 2018 WREF and 2018 GUIL collection to correct a geolocation issue. |
| DP3.30012.001 | LAI - Spectrometer - mosaic | Data were updated for the 2018 WREF and 2018 GUIL collection to correct a geolocation issue. |
| DP3.30014.001 | fPAR - Spectrometer - mosaic | Data were updated for the 2018 WREF and 2018 GUIL collection to correct a geolocation issue. A tif tag describing the sensor used to collect the data was corrected. |
| DP3.30019.001 | Canopy Water Indices - mosaic | Data were updated for the 2018 WREF and 2018 GUIL collection to correct a geolocation issue. Checksums on data product files were updated. |
| DP3.30026.001 | Vegetation Indices - Spectrometer - mosaic | Data were updated for the 2018 WREF and 2018 GUIL collection to correct a geolocation issue. Checksums on data product files were updated. |
| DP1.10058.001 | Plant Presence and Percent Cover | New table div_morphospecies provides updated taxonomic information for plant species that could not be identified in the field. |