scikit-dataaccess 1.9.10

Scikit Data Access Package for accessing scientific data sets.

• Import scientific data from various sources through one easy Python API.
• Use iterator patterns for each data source (configurable data generators + functions to get next data chunk).
• Skip parser programming and file format handling.
• Enjoy a common namespace for all data and unleash the power of data fusion.
• Handle data distribution in different modes: (1) local download, (2) caching of accessed data, or (3) online stream access
• Easily pull data on cloud servers through Python scripts and facilitate large-scale parallel processing.
• Build on an extensible plattform: Adding access to a new data source only requires addition of its “DataFetcher.py”.
• Open source (MIT License)

Supported data sets (For updates, follow https://twitter.com/scikit_data and https://twitter.com/mithaystack)

Namespace	Description	Preview	Data Source
astro.kepler	Light curves for stars imaged by the NASA Kepler Space Telescope		https://keplerscience.arc.nasa.gov
astro.voyager	Data from the Voyager mission		https://spdf.gsfc.nasa.gov
geo.groundwater	United States groundwater monitoring wells measuring the depth to water level		https://waterservices.usgs.gov
geo.pbo	EarthScope - Plate Boundary Observatory (PBO): Daily GPS displacement time series measurements throughout the United States		http://www.unavco.org/projects/major-projects/pbo/pbo.html
geo.grace	NASA GRACE Tellus Monthly Mass Grids. 30-day measurements of changes in Earth’s gravity field to quantify equivalent water thickness		https://grace.jpl.nasa.gov/data/get-data/monthly-mass-grids-land
geo.gldas	Land hydrology model produced by NASA. This version of the data is generated to match the GRACE temporal and spatial characteristics and is available as a complementary data product		https://grace.jpl.nasa.gov/data/get-data/land-water-content
geo.modis	Spectroradiometer aboard the NASA Terra and Aqua image satellites. Generates approximately daily images of the Earth’s surface		https://modis.gsfc.nasa.gov
geo.magnetometer	Data collected at magnetic observatories operated by the U.S. Geological Survey		https://geomag.usgs.gov
geo.mahali.rinex	Rinex files from the MIT led NSF project studying the Earth’s ionosphere with GPS		http://mahali.mit.edu
geo.mahali.tec	Total Electron Content from the MIT led NSF project studying the Earth’s ionosphere with GPS		http://mahali.mit.edu
geo.mahali.temperature	Temperature data from the MIT led NSF project studying the Earth’s ionosphere with GPS		http://mahali.mit.edu
solar.sdo	Images from the Solar Dynamics Observatory		https://sdo.gsfc.nasa.gov

Install

pip install scikit-dataaccess

Documentation

• User Manual: /docs/skdaccess_manual.pdf
• Code documentation (Doxygen): /docs/skdaccess_doxygen.pdf
• Code visualization (treemap): /docs/skdaccess_treemap.png
• Code class diagrams: /docs/class_diagrams

Contributors

Project lead: Victor Pankratius (MIT)

Contributors: Cody M. Rude, Justin D. Li, David M. Blair, Michael G. Gowanlock, Victor Pankratius

New contributors welcome! Contact to contribute and add interface code for your own datasets 😄

Acknowledgements

We acknowledge support from NASA AIST14-NNX15AG84G, NASA AIST16-80NSSC17K0125, NSF ACI-1442997, and NSF AGS-1343967.

Examples

Code examples (Jupyter notebooks) for all datasets listed above are available at: /skdaccess/examples