This is an update to past posts about microbial community composition data products. We are developing an in-house data processing pipeline to generate the microbial community composition data products.
The LI-840 Infrared Gas Analyzer requires more maintenance and has an observed failure rate higher than other NEON sensors measuring atmospheric carbon dioxide and water vapor. This has led to multiple data gaps and periods of flagged data. We are investigating the issue further.
The full timeseries of most instrumented data products (exceptions below) were reprocessed with the most recent algorithms, quality control thresholds, and/or other metadata to improve overall data coverage and quality.
A review of the precipitation data product (part of DP1.00006.001) identified that spurious trace precipitation is recorded frequently for all primary precipitation sensors (weighing gauges). We are working on additional quality control algorithms in order to detect and remove spurious trace events in the primary precipitation data product.
A fix has been developed for the issue of missing atmospheric pressure corrections for the soil CO2 concentration data product (DP1.00095.001). Previously published soil CO2 concentration data has been flagged and corrected data are expected to be published by July.
NEON recently discovered an error in the algorithm that creates the Wind speed and direction above water on-buoy (DP1.20059.001) data product. Data from the corrected algorithm will be republished following a large data republication effort.
Large data downloads using neonUtilities may fail to download all available data due to the new API rate limit. We are working to release a new version of neonUtilities that handles this situation smoothly.
Previously, we identified an issue with the 2019 Toolik airborne (AOP) spectrometer (NIS) data products. The data have been reprocessed, and, as of 30 April 2020, the corrected data are available via the data portal.
We have discovered that the atmospheric pressure correction for the soil CO2 concentration data product (DP1.00095.001) is not being performed, causing incorrect values to be reported. Work has begun to correct this issue with the expectation of having it resolved by approximately July 2020.
We have identified that the timestamp of the on-site server was set at SYCA and WLOU for certain date ranges. All impacted data have been removed from the NEON data portal and will be re-streamed, re-processed, and re-published.
The terrestrial instrument system (TIS) team identified that the 2D anemometers on the NEON towers were producing 2D wind data that did not correlate with 2D wind data collected at NEON meteorological stations nearby. The TIS team is in the process of identifying site- and measurement-level--specific dates of incorrect anemometer orientation so that these data can be corrected.
Microbial community composition data products for all data analyzed after Jan 1, 2016 had an issue with the sequence data processing pipeline. This issue is causing the resulting community composition data to consist of very few counts and lower than expected diversity. We are in the process of evaluating the extent of the issue.
To date, all NEON groundwater and surface water elevation data has had high uncertainty due to unstable survey reference points and delays in reporting field-based sensor position adjustments. In-the-field infrastructure upgrades will improve NEON water elevation data products at many aquatic sites.