Scikit Data Access Package for accessing scientific data sets.
Project description
Import scientific data from various sources through one easy Python API.
Use iterator patterns for each data source (configurable data generators + functions to get next data chunk).
Skip parser programming and file format handling.
Enjoy a common namespace for all data and unleash the power of data fusion.
Handle data distribution in different modes: (1) local download, (2) caching of accessed data, or (3) online stream access
Easily pull data on cloud servers through Python scripts and facilitate large-scale parallel processing.
Build on an extensible plattform: Adding access to a new data source only requires addition of its “DataFetcher.py”.
Open source (MIT License)
Supported data sets (For updates, follow https://twitter.com/scikit_data and https://twitter.com/mithaystack)
Namespace |
Description |
Preview |
Data Source |
---|---|---|---|
astro.kepler |
Light curves for stars imaged by the NASA Kepler Space Telescope |
||
astro.voyager |
Data from the Voyager mission |
||
geo.groundwater |
United States groundwater monitoring wells measuring the depth to water level |
||
geo.pbo |
EarthScope - Plate Boundary Observatory (PBO): Daily GPS displacement time series measurements throughout the United States |
||
geo.grace |
NASA GRACE Tellus Monthly Mass Grids. 30-day measurements of changes in Earth’s gravity field to quantify equivalent water thickness |
https://grace.jpl.nasa.gov/data/get-data/monthly-mass-grids-land |
|
geo.gldas |
Land hydrology model produced by NASA. This version of the data is generated to match the GRACE temporal and spatial characteristics and is available as a complementary data product |
||
geo.modis |
Spectroradiometer aboard the NASA Terra and Aqua image satellites. Generates approximately daily images of the Earth’s surface |
||
geo.magnetometer |
Data collected at magnetic observatories operated by the U.S. Geological Survey |
||
geo.mahali.rinex |
Rinex files from the MIT led NSF project studying the Earth’s ionosphere with GPS |
||
geo.mahali.tec |
Total Electron Content from the MIT led NSF project studying the Earth’s ionosphere with GPS |
||
geo.mahali.temperature |
Temperature data from the MIT led NSF project studying the Earth’s ionosphere with GPS |
||
solar.sdo |
Images from the Solar Dynamics Observatory |
Install
pip install scikit-dataaccess
Documentation
User Manual: /docs/skdaccess_manual.pdf
Code documentation (Doxygen): /docs/skdaccess_doxygen.pdf
Code visualization (treemap): /docs/skdaccess_treemap.png
Code class diagrams: /docs/class_diagrams
Contributors
Acknowledgements
We acknowledge support from NASA AIST14-NNX15AG84G, NASA AIST16-80NSSC17K0125, NSF ACI-1442997, and NSF AGS-1343967.
Examples
Code examples (Jupyter notebooks) for all datasets listed above are available at: /skdaccess/examples
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.