Manage DBnomics fetchers
Project description
DBnomics fetcher ops
Manage DBnomics fetchers.
Usage
Install
pip install dbnomics-fetcher-ops
Configure a fetcher
Configure:
- GitLab private token: use
--gitlab-private-token
option orGITLAB_PRIVATE_TOKEN
environment variable. The private token can be a personal access token. It must have theapi
scope.
Run:
dbnomics-fetchers -v configure scsmich --dry-run
# If everything seems OK, remove the --dry-run flag:
dbnomics-fetchers -v configure scsmich
List fetchers
dbnomics-fetchers -v list
Run fetcher pipelines
# Replace PROVIDER_SLUG by the real value:
dbnomics-fetchers -v run --provider-slug PROVIDER_SLUG
# To run a pipeline for each fetcher:
dbnomics-fetchers -v list --slug | xargs -I {} dbnomics-fetchers -v run --provider-slug {}
Development
This repository uses Poetry.
# git clone repo or fork
cd dbnomics-fetcher-ops
poetry install
cp .env.example .env
Run commands with:
poetry run dbnomics-fetchers COMMAND
To use ipdb:
poetry shell
# Find venv dir with "which python"
ipdb3 /path/to/venv/bin/dbnomics-fetchers ...
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for dbnomics_fetcher_ops-0.4.13.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | e6149ab20c58b5974d85c9af65d4e86ffe9b337eeb8647ca57786034084699aa |
|
MD5 | a9eaad5deb5532881774b10142ead08c |
|
BLAKE2b-256 | 396ae40bf406d792805076d1bcc64297a50d353aa28e7caa5e06e239b616374b |
Close
Hashes for dbnomics_fetcher_ops-0.4.13-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 79aefaa8ba76aea692ce2ec905cbe65f312d8e2e3ec69b928ea1ff28098c40d4 |
|
MD5 | 9e4717340b7dff4fc27e227616e9f168 |
|
BLAKE2b-256 | 78d620f31bf308ac843c5f9df7f0b699fdf2d618fa14ec868435f1efa2fea18d |