Manage DBnomics fetchers
Project description
DBnomics fetcher ops
Manage DBnomics fetchers: list, configure and run pipelines.
Install
pip install dbnomics-fetcher-ops[cli]
Usage
Configure a fetcher
The configure command needs write privileges. Create a GitLab personal access token having the api
scope, and pass it using the --gitlab-private-token
option or the GITLAB_PRIVATE_TOKEN
environment variable in ~/.config/dbnomics/dbnomics-fetchers.env
.
dbnomics-fetchers -v configure scsmich --dry-run
# If everything seems OK, remove the --dry-run flag:
dbnomics-fetchers -v configure scsmich
List fetchers
dbnomics-fetchers -v list
Run fetcher pipelines
# Replace PROVIDER_SLUG by the real value:
dbnomics-fetchers -v run --provider-slug PROVIDER_SLUG
# To run a pipeline for each fetcher:
dbnomics-fetchers -v list --slug | xargs -I {} dbnomics-fetchers -v run --provider-slug {}
Development
Install Poetry.
# git clone repo or fork
cd dbnomics-fetcher-ops
poetry install
cp .env.example .env
Run commands with:
poetry shell
dbnomics-fetchers COMMAND
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for dbnomics_fetcher_ops-0.4.16.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 96f785ec431d6845b0b0bf999e1f688fe39104887aab10d0c6b515f9dd82fd3d |
|
MD5 | e3764774011c6ca3660f9bcdfc44898b |
|
BLAKE2b-256 | 88887faf014c7039d88b95d46416f83dc83781d504af5f142bdd15efd7f70c8c |
Close
Hashes for dbnomics_fetcher_ops-0.4.16-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 223e12680b59c643300050cf545ed0193581b3765bfbb4c2b79a8e01120960d4 |
|
MD5 | 67a551361b6bc303660be09ebcfc5955 |
|
BLAKE2b-256 | 03863f766727a36ba505b650c05660b23c33d32caf08a30c7b50dced8096e6fc |