Manage DBnomics fetchers
Project description
DBnomics fetcher ops
Manage DBnomics fetchers: list, configure and run pipelines.
Install
pip install dbnomics-fetcher-ops[cli]
Usage
Configure a fetcher
The configure command needs write privileges. Create a GitLab personal access token having the api
scope, and pass it using the --gitlab-private-token
option or the GITLAB_PRIVATE_TOKEN
environment variable in ~/.config/dbnomics/dbnomics-fetchers.env
.
dbnomics-fetchers -v configure scsmich --dry-run
# If everything seems OK, remove the --dry-run flag:
dbnomics-fetchers -v configure scsmich
List fetchers
dbnomics-fetchers -v list
Run fetcher pipelines
# Replace PROVIDER_SLUG by the real value:
dbnomics-fetchers -v run --provider-slug PROVIDER_SLUG
# To run a pipeline for each fetcher:
dbnomics-fetchers -v list --slug | xargs -I {} dbnomics-fetchers -v run --provider-slug {}
Development
Install Poetry.
# git clone repo or fork
cd dbnomics-fetcher-ops
poetry install
cp .env.example .env
Run commands with:
poetry shell
dbnomics-fetchers COMMAND
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
dbnomics_fetcher_ops-0.5.4.tar.gz
(30.4 kB
view hashes)
Built Distribution
Close
Hashes for dbnomics_fetcher_ops-0.5.4.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 0583c16af72b9e7aff08ee3ff82f87c9e2da3c4264636a3ad94c361bd5ad3a35 |
|
MD5 | 210d2605214df49d4a7c0886d6731b08 |
|
BLAKE2b-256 | 941b0b4c452bb32ed9dd9f7e3e5b2a4013f91bcc5a8132c85adab23abb33c6a7 |
Close
Hashes for dbnomics_fetcher_ops-0.5.4-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | c6fdc5b286d601e9e313538346353fe666595970c8d3a418d4b218afcd4aee71 |
|
MD5 | abfa4aef9d2ba4f610d1efafd46a4163 |
|
BLAKE2b-256 | 4c4e43f5dd4314280555f61af5c399998f2211c155c8b8329bb80832ef22b12e |