Skip to main content
NSF NEON, Operated by Battelle

Main navigation

  • About Us
    • Overview
      • Spatial and Temporal Design
      • History
    • Vision and Management
    • Advisory Groups
      • Science, Technology & Education Advisory Committee
      • Technical Working Groups (TWGs)
    • FAQ
    • Contact Us
      • Contact NEON Biorepository
      • Field Offices
    • User Accounts
    • Staff
    • Code of Conduct

    About Us

  • Data & Samples
    • Data Portal
      • Explore Data Products
      • Data Availability Charts
      • Spatial Data & Maps
      • Document Library
      • API & GraphQL
      • Prototype Data
      • External Lab Data Ingest (restricted)
    • Data Themes
      • Biogeochemistry
      • Ecohydrology
      • Land Cover and Processes
      • Organisms, Populations, and Communities
    • Samples & Specimens
      • Discover and Use NEON Samples
        • Sample Types
        • Sample Repositories
        • Sample Explorer
        • Megapit and Distributed Initial Characterization Soil Archives
      • Sample Processing
      • Sample Quality
      • Taxonomic Lists
    • Collection Methods
      • Protocols & Standardized Methods
      • Airborne Remote Sensing
        • Flight Box Design
        • Flight Schedules and Coverage
        • Daily Flight Reports
          • AOP Flight Report Sign Up
        • Camera
        • Imaging Spectrometer
        • Lidar
      • Automated Instruments
        • Site Level Sampling Design
        • Sensor Collection Frequency
        • Instrumented Collection Types
          • Meteorology
          • Phenocams
          • Soil Sensors
          • Ground Water
          • Surface Water
      • Observational Sampling
        • Site Level Sampling Design
        • Sampling Schedules
        • Observation Types
          • Aquatic Organisms
            • Aquatic Microbes
            • Fish
            • Macroinvertebrates & Zooplankton
            • Periphyton, Phytoplankton, and Aquatic Plants
          • Terrestrial Organisms
            • Birds
            • Ground Beetles
            • Mosquitoes
            • Small Mammals
            • Soil Microbes
            • Terrestrial Plants
            • Ticks
          • Hydrology & Geomorphology
            • Discharge
            • Geomorphology
          • Biogeochemistry
          • DNA Sequences
          • Pathogens
          • Sediments
          • Soils
            • Soil Descriptions
        • Optimizing the Observational Sampling Designs
    • Data Notifications
    • Data Guidelines and Policies
      • Acknowledging and Citing NEON
      • Publishing Research Outputs
      • Usage Policies
    • Data Management
      • Data Availability
      • Data Formats and Conventions
      • Data Processing
      • Data Quality
      • Data Product Bundles
      • Data Product Revisions and Releases
        • Release 2021
        • Release 2022
        • Release 2023
        • Release 2024
        • Release-2025
      • NEON and Google
      • Externally Hosted Data

    Data & Samples

  • Field Sites
    • About Field Sites and Domains
    • Explore Field Sites
    • Site Management Data Product

    Field Sites

  • Impact
    • Observatory Blog
    • Case Studies
    • Papers & Publications
    • Newsroom
      • NEON in the News
      • Newsletter Archive
      • Newsletter Sign Up

    Impact

  • Resources
    • Getting Started with NEON Data & Resources
    • Documents and Communication Resources
      • Papers & Publications
      • Document Library
      • Outreach Materials
    • Code Hub
      • Code Resources Guidelines
      • Code Resources Submission
      • NEON's GitHub Organization Homepage
    • Learning Hub
      • Science Videos
      • Tutorials
      • Workshops & Courses
      • Teaching Modules
    • Research Support Services
      • Field Site Coordination
      • Letters of Support
      • Mobile Deployment Platforms
      • Permits and Permissions
      • AOP Flight Campaigns
      • Research Support FAQs
      • Research Support Projects
    • Funding Opportunities

    Resources

  • Get Involved
    • Advisory Groups
      • Science, Technology & Education Advisory Committee
      • Technical Working Groups
    • Upcoming Events
    • NEON Ambassador Program
      • Exploring NEON-Derived Data Products Workshop Series
    • Research and Collaborations
      • Environmental Data Science Innovation and Inclusion Lab
      • Collaboration with DOE BER User Facilities and Programs
      • EFI-NEON Ecological Forecasting Challenge
      • NEON Great Lakes User Group
      • NEON Science Summit
      • NCAR-NEON-Community Collaborations
        • NCAR-NEON Community Steering Committee
    • Community Engagement
      • How Community Feedback Impacts NEON Operations
    • Science Seminars and Data Skills Webinars
      • Past Years
    • Work Opportunities
      • Careers
      • Seasonal Fieldwork
      • Internships
        • Intern Alumni
    • Partners

    Get Involved

  • My Account
  • Search

Search

Impact

  • Observatory Blog
  • Case Studies
  • Papers & Publications
  • Newsroom

Breadcrumb

  1. Impact
  2. Observatory Blog
  3. Big Data Part I: The "Big" in Ecological Big Data

Big Data Part I: The "Big" in Ecological Big Data

July 30, 2012

Big Data has already altered the way scientists view, study, and analyze the world, and appears poised to change the fields of ecology and environmental science forever. Deep and broad information on hundreds of biological and environmental variables collected across space and time will soon be at our fingertips. It may profoundly change the questions we are able to ask and answer about the world around us. With DataONE launching in July 2012, one huge piece of the tools and knowledge needed to make sense and science of environmental Big Data has moved into place. More data-driven pieces will click into place when NEON shifts into full operations. The journey toward the integration of Big Data into environmental science and ecology began in the last century. Sustained organizing efforts as well as parallel advances in technology are finally making it possible to realize some of the dreams of research visionaries of 40 or more years ago.

Biological datasets are often very large. Taxonomic data sets often contain hundreds of thousands or even millions of records, reflecting several centuries of collecting, identifying and classifying organisms. In the fields of genomics and metagenomics, sequencing systems record millions or even billions of base pairs in a single session. More recently, ecologists have begun to use new methods that produce massive amounts of data. Space-borne remote sensing instruments like LANDSAT and MODIS collect many types of data on each of millions of pixels per year, multiplied over decades. Here on the ground, citizen science programs produce massive quantities of data. The eBird program alone contains 63 million records. Visualizing and analyzing data on this scale requires sophisticated software and not infrequently, significant computing resources on a scale comparable to other environmental sciences such as meteorology and oceanography. However, the defining aspect of ecological Big Data is not raw size but another dimension: complexity. Consider the information associated with a small mammal, the pika. The pika’s scientific name is Ochotona princeps, and today five phylogenetic subspecies are recognized based on genomic data. Formerly, based on traditional taxonomy, there were as many as 36 subspecies identified. Each older pika record would have to be mapped to one of the current lineages in order to make sense of their genetics. The genomic data used to revise the classification must be linked to our hypothetical pika database, linking sequence and taxonomic data. Pika occur in widely separated habitats, so location data (latitude and longitude of presence, and perhaps absence, observations) is crucial. These data (presence and absence) are collected over time and must be linked to location and time of observation. Pika are strongly constrained by food availability, ambient air temperature and habitat. Our pika database must accommodate vegetation surveys, nutritional analyses of the vegetation, climate and habitat maps or satellite imagery. Researchers might also add detailed information on the physiology, population dynamics and behavior of pikas, and they might ask whether there are significant differences between subspecies, requiring all of this data to be linked back to the underlying classification of the species.

The defining aspect of ecological Big Data is not raw size but another dimension: complexity. If we begin to consider pikas in relation to their biological environment, we need to know what species they eat (and require similar information to the above on each food species) and what species eat them. This begins to build a web of information linking species to each other, and to the habitats in which they live. If we think of each biological datum as a point, connected to other points by links that define specific types of relationships, as much information exists in those links (the connections between different databases) as within the data points. While the geophysical sciences can conceptually link different data types (temperature, moisture, radiation, etc.) through numerical models based on physical principles, biological relationships are intrinsically more complex and include trophic relationships, phylogenetic relationships, behavioral interactions and indirect effects such as occur through keystone species and ecosystem engineers. Ecological and biological data thus create technical challenges to informatics: on the one hand through the complex data and metadata required to describe and curate biological data sets; and on the other, through the need for increasingly powerful analysis tools suitable for high dimensional problems.

Share

Related Posts:

NEON Data Release 2025 is available

January 29, 2025

New code release: neonutilities package available in Python

September 24, 2024

NEON at ESA 2024: Forecasting, Partnerships, Samples, and More

August 16, 2024

Ryan McClure behind the NEON exhibit booth at ESA 2024
NSF NEON, Operated by Battelle

Follow Us:

Join Our Newsletter

Get updates on events, opportunities, and how NEON is being used today.

Subscribe Now

Footer

  • About Us
  • Newsroom
  • Contact Us
  • Terms & Conditions
  • Careers
  • Code of Conduct

Copyright © Battelle, 2025

The National Ecological Observatory Network is a major facility fully funded by the U.S. National Science Foundation.

Any opinions, findings and conclusions or recommendations expressed in this material do not necessarily reflect the views of the U.S. National Science Foundation.