Skip to main content

Scikit Data Access Package for accessing scientific data sets.

Project description

Scikit Data Access

  • Import scientific data from various sources through one easy Python API.
  • Use iterator patterns for each data source (configurable data generators + functions to get next data chunk).
  • Skip parser programming and file format handling.
  • Enjoy a common namespace for all data and unleash the power of data fusion.
  • Handle data distribution in different modes: (1) local download, (2) caching of accessed data, or (3) online stream access
  • Easily pull data on cloud servers through Python scripts and facilitate large-scale parallel processing.
  • Build on an extensible plattform: Adding access to a new data source only requires addition of its "DataFetcher.py".
  • Open source (MIT License)

Scikit Data Access Overview

Supported data sets (for updates, follow https://twitter.com/scikit_data)

Namespace Description Preview Data Source
astro.kepler Light curves for stars imaged by the NASA Kepler Space Telescope Preview https://keplerscience.arc.nasa.gov
astro.voyager Data from the Voyager mission Preview https://spdf.gsfc.nasa.gov/
geo.era_interim Era-Interim data at different pressure values from the European Centre for Medium-Range Weather Forecasts accessed through the University Corporation for Atmospheric Research Preview https://rda.ucar.edu/datasets/ds627.0/
geo.gldas Land hydrology model produced by NASA. This version of the data is generated to match the GRACE temporal and spatial characteristics and is available as a complementary data product Preview https://grace.jpl.nasa.gov/data/get-data/land-water-content
geo.grace NASA GRACE Tellus Monthly Mass Grids. 30-day measurements of changes in Earth’s gravity field to quantify equivalent water thickness Preview https://grace.jpl.nasa.gov/data/get-data/monthly-mass-grids-land
geo.grace.mascon NASA GRACE Tellus Monthly Mass Grids - Global Mascons. 30-day measurements of changes in Earth’s gravity field to quantify equivalent water thickness Preview https://grace.jpl.nasa.gov/data/get-data/jpl_global_mascons
geo.groundwater United States groundwater monitoring wells measuring the depth to water level Preview https://waterservices.usgs.gov
geo.magnetometer Data collected at magnetic observatories operated by the U.S. Geological Survey Preview https://geomag.usgs.gov
geo.modis Spectroradiometer aboard the NASA Terra and Aqua image satellites. Generates approximately daily images of the Earth’s surface Preview https://modis.gsfc.nasa.gov
geo.pbo EarthScope - Plate Boundary Observatory (PBO): Daily GPS displacement time series measurements throughout the United States Preview http://www.unavco.org/projects/major-projects/pbo/pbo.html
geo.mahali.rinex Rinex files from the MIT led NSF project studying the Earth’s ionosphere with GPS Preview http://mahali.mit.edu
geo.mahali.tec Total Electron Content from the MIT led NSF project studying the Earth’s ionosphere with GPS Preview http://mahali.mit.edu
geo.mahali.temperature                                          Temperature data from the MIT led NSF project studying the Earth’s ionosphere with GPS Preview http://mahali.mit.edu
geo.sentinel_1 Sentinel-1 TOPSAR data from the European Space Agency retrieved from the Alaska Satellite Facility Preview https://www.asf.alaska.edu/
geo.srtm Elevation data at a one arc second resolution from the Shuttle Radar Topography Mission (SRTMGL1) Preview https://lpdaac.usgs.gov/dataset_discovery/measures/measures_products_table/srtmgl1_v003
geo.uavsar UAVSAR SLC data from JPL Preview https://uavsar.jpl.nasa.gov/
geo.wyoming_sounding Sounding data from the University of Wyoming Preview http://weather.uwyo.edu/upperair/sounding.html
planetary.ode Planetary data from PDS Geosciences Node's Orbital Data Explorer Preview http://pds-geosciences.wustl.edu/default.htm
solar.sdo Images from the Solar Dynamics Observatory Preview https://sdo.gsfc.nasa.gov/

Install

pip install scikit-dataaccess

Documentation

Contributors

Project lead: Victor Pankratius (MIT)
Contributors: Cody M. Rude, Justin D. Li, David M. Blair, Michael G. Gowanlock, Guillaume Rongier, Victor Pankratius

New contributors welcome! Contact to contribute and add interface code for your own datasets :smile:

Acknowledgements

We acknowledge support from NASA AIST14-NNX15AG84G, NASA AIST16-80NSSC17K0125, NSF ACI-1442997, and NSF AGS-1343967.

Examples

Code examples (Jupyter notebooks) for all datasets listed above are available at: /skdaccess/examples

Scikit Data Access Overview

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

scikit-dataaccess-1.9.12.post1.tar.gz (9.0 MB view hashes)

Uploaded Source

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page