NEON has completed development of an in-house data processing pipeline to generate the microbial community composition data products and has completed optimization of the parameters to be used in the data processing pipeline. Data reprocessing is expected to begin in mid-October.
On 8/13/20, we announced some impending changes to OS biogeochemistry data products. As of today, those changes are complete. Read more to learn about how to access these data. We hope this improves the overall user experience for NEON terrestrial biogeochemistry data products.
A subset of data in the Plant presence and percent cover data product ( DP1.10058.001) did not process correctly through the data pipeline, and were missing from published data. As of September 30, 2020, the missing records have been restored.
A fix was developed for the issue of missing atmospheric pressure corrections for the soil CO2 concentration data product (DP1.00095.001). All data have now been republished and are available on the NEON Data Portal.
All water chemistry external lab data have been transformed from wide format to long format; the "externalLabData_pub" table has been replaced with the "externalLabDataByAnalyte_pub" table.
Sites flown in 2017 did not have a uniform QAQC document available for the L3 tiles – a data quality measure implemented at the start of the 2018 flight season. As of August 19, 2020, these data have been corrected and available for download.
NEON has begun the process of reconfiguring the multisondes to report DO % saturation relative to local atmospheric pressure, which will be published as a new parameter in the water quality data product. In the interim, NEON has developed the localPressureDO R-package.
In order to improve usability of the Observational System terrestrial biogeochemistry data products, we are repackaging several data products to deliver all of the relevant data for sample sets in one download. We hope this improves the overall user experience for NEON terrestrial biogeochemistry data products.
NEON recently obtained approval to begin testing small mammal blood and ear tissue samples for tick-borne pathogens rather than hantaviruses. This change will be reflected in the data product beginning in the 2020 field season.
This is an update to past posts about microbial community composition data products. We are developing an in-house data processing pipeline to generate the microbial community composition data products.
The LI-840 Infrared Gas Analyzer requires more maintenance and has an observed failure rate higher than other NEON sensors measuring atmospheric carbon dioxide and water vapor. This has led to multiple data gaps and periods of flagged data. We are investigating the issue further.
We have recently discovered multiple instances where timestamps became out of sync between the Picarro G2131 and L2130 instruments and computers, and what was assigned to the data points upon transmission to NEON Headquarters. We are raising the science review flag for the affected time periods and investigating the possibility of data correction.
A review of the precipitation data product (part of DP1.00006.001) identified that spurious trace precipitation is recorded frequently for all primary precipitation sensors (weighing gauges). We are working on additional quality control algorithms in order to detect and remove spurious trace events in the primary precipitation data product.
A fix has been developed for the issue of missing atmospheric pressure corrections for the soil CO2 concentration data product (DP1.00095.001). Previously published soil CO2 concentration data has been flagged and corrected data are expected to be published by July.
The full timeseries of most instrumented data products (exceptions below) were reprocessed with the most recent algorithms, quality control thresholds, and/or other metadata to improve overall data coverage and quality.
Previously, we identified an issue with the 2D anemometers on the NEON towers. The data have been reprocessed, and, the corrected data will be available via the data portal in July 2020.
NEON recently discovered an error in the algorithm that creates the Wind speed and direction above water on-buoy (DP1.20059.001) data product. Data from the corrected algorithm will be republished following a large data republication effort.
Large data downloads using neonUtilities may fail to download all available data due to the new API rate limit. We are working to release a new version of neonUtilities that handles this situation smoothly.
Previously, we identified an issue with the 2019 Toolik airborne (AOP) spectrometer (NIS) data products. The data have been reprocessed, and, as of 30 April 2020, the corrected data are available via the data portal.
We have discovered that the atmospheric pressure correction for the soil CO2 concentration data product (DP1.00095.001) is not being performed, causing incorrect values to be reported. Work has begun to correct this issue with the expectation of having it resolved by approximately July 2020.
