Download dataset via DOI or landing page url
Project description
🗃️ DaGet
Simple utility to download datasets from data respositories.
The goal of this project is to explore machine readable metadata and learn more about writing python packages.
⚠️ script is in early development and needs testing ⚠️
Installation
to install daget using pip:
pip install daget
Usage
Download dataset via DOI or landing page url:
daget https://doi.org/10.5878/331q-3p13 ./destination
or short form doi:
daget 10.5878/331q-3p13 ./destination
Example
$ daget 10.7910/DVN/LFH4H8 ./test
destination: /home/user/test
landing page: https://dataverse.harvard.edu/dataset.xhtml?persistentId=doi:10.7910/DVN/LFH4H8
355.4KiB Annex.pdf
115.6KiB List of items for measuring conceptions of democracy.csv
81.1KiB List of items for measuring conceptions of democracy.xlsx
11.5KiB Script - Part 1 Conceptions of democracy.R
3.0KiB Script - Part 2 Analyze items used to measure conceptions of democracy.R
73.3KiB Spreadsheet - Conceptions of democracy 10-2021.csv
64.9KiB Spreadsheet - Conceptions of democracy 10-2021.xlsx
704.8KiB downloaded
Supported data respositories with file metadata
- schema.org/Dataset
- figshare
- zenodo
Alternatives
- datahugger - wider repository suport
Improve the script
Adding suport for additional repositories requires test cases and investigation arround how to get file metadata from the landing page.
Please help by testing and reporting issues
TODO
- Add error handling
- Check empty destination directory
- Improve documentation
- Package script for pip
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
daget-0.5.tar.gz
(5.2 kB
view hashes)
Built Distribution
daget-0.5-py3-none-any.whl
(6.3 kB
view hashes)