Manage DBnomics fetchers
Project description
DBnomics fetcher ops
Manage DBnomics fetchers: list, configure and run pipelines.
Install
pip install dbnomics-fetcher-ops[cli]
Usage
Configure a fetcher
The configure command needs write privileges. Create a GitLab personal access token having the api
scope, and pass it using the --gitlab-private-token
option or the GITLAB_PRIVATE_TOKEN
environment variable in ~/.config/dbnomics/dbnomics-fetchers.env
.
dbnomics-fetchers -v configure scsmich --dry-run
# If everything seems OK, remove the --dry-run flag:
dbnomics-fetchers -v configure scsmich
List fetchers
dbnomics-fetchers -v list
Run fetcher pipelines
# Replace PROVIDER_SLUG by the real value:
dbnomics-fetchers -v run --provider-slug PROVIDER_SLUG
# To run a pipeline for each fetcher:
dbnomics-fetchers -v list --slug | xargs -I {} dbnomics-fetchers -v run --provider-slug {}
Development
Install Poetry.
# git clone repo or fork
cd dbnomics-fetcher-ops
poetry install
cp .env.example .env
Run commands with:
poetry shell
dbnomics-fetchers COMMAND
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
dbnomics_fetcher_ops-0.5.2.tar.gz
(28.9 kB
view hashes)
Built Distribution
Close
Hashes for dbnomics_fetcher_ops-0.5.2.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 9ff68b1dd50222f99c73e72df088b49c5413616805b2d8133b1970296e0c311f |
|
MD5 | 9d88a5e053c201c6a83c2d9f0734e870 |
|
BLAKE2b-256 | cef17b9ed00c7d509537971f4eac8cdc7812ce0e7ad7f87a4705521d654c0b65 |
Close
Hashes for dbnomics_fetcher_ops-0.5.2-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8708d16f7d793325b9a64209d020fdc90be047af99439b6a28b4441a1a5a6c37 |
|
MD5 | 934b4536760ffeab167ce306dabe5f95 |
|
BLAKE2b-256 | 3210ec04974e5e023d00577aae58a20cdb29279805d48a0d3ce1ce39c01fd68a |