Scikit Data Access Package for accessing scientific data sets.
Project Description
- Import scientific data from various sources through one easy Python API.
- Use iterator patterns for each data source (configurable data generators + functions to get next data chunk).
- Skip parser programming and file format handling.
- Enjoy a common namespace for all data and unleash the power of data fusion.
- Handle data distribution in different modes: (1) local download, (2) caching of accessed data, or (3) online stream access
- Easily pull data on cloud servers through Python scripts and facilitate large-scale parallel processing.
- Build on an extensible plattform: Adding access to a new data source only requires addition of its “DataFetcher.py”.
- Open source (MIT License)
Supported data sets (For updates, follow https://twitter.com/scikit_data and https://twitter.com/mithaystack)
Namespace | Description | Preview | Data Source |
---|---|---|---|
https://keplerscience.arc.nasa.gov | |||
https://spdf.gsfc.nasa.gov | |||
https://waterservices.usgs.gov | |||
http://www.unavco.org/projects/major-projects/pbo/pbo.html | |||
https://grace.jpl.nasa.gov/data/get-data/monthly-mass-grids-land | |||
https://grace.jpl.nasa.gov/data/get-data/land-water-content | |||
https://modis.gsfc.nasa.gov | |||
https://geomag.usgs.gov | |||
http://mahali.mit.edu | |||
http://mahali.mit.edu | |||
http://mahali.mit.edu | |||
https://sdo.gsfc.nasa.gov |
Install
pip install scikit-dataaccess
Documentation
- User Manual: /docs/skdaccess_manual.pdf
- Code documentation (Doxygen): /docs/skdaccess_doxygen.pdf
- Code visualization (treemap): /docs/skdaccess_treemap.png
- Code class diagrams: /docs/class_diagrams
Contributors
Project lead: Victor Pankratius (MIT)
Contributors: Cody M. Rude, Justin D. Li, David M. Blair, Michael G. Gowanlock, Victor Pankratius
New contributors welcome! Contact
to contribute and add interface code for your own datasets 😄
Acknowledgements
We acknowledge support from NASA AIST14-NNX15AG84G, NASA AIST16-80NSSC17K0125, NSF ACI-1442997, and NSF AGS-1343967.
Examples
Code examples (Jupyter notebooks) for all datasets listed above are available at: /skdaccess/examples
Release history Release notifications
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Filename, size & hash SHA256 hash help | File type | Python version | Upload date |
---|---|---|---|
scikit-dataaccess-1.9.10.tar.gz (4.2 MB) Copy SHA256 hash SHA256 | Source | None | Jan 26, 2018 |