Manage DBnomics fetchers
Project description
DBnomics fetcher ops
Manage DBnomics fetchers.
Usage
Install
pip install dbnomics-fetcher-ops
Configure a fetcher
Configure:
- GitLab private token: use
--gitlab-private-token
option orGITLAB_PRIVATE_TOKEN
environment variable. The private token can be a personal access token. It must have theapi
scope.
Run:
dbnomics-fetchers -v configure scsmich --dry-run
# If everything seems OK, remove the --dry-run flag:
dbnomics-fetchers -v configure scsmich
List fetchers
dbnomics-fetchers -v list
Run fetcher pipelines
# Replace PROVIDER_SLUG by the real value:
dbnomics-fetchers -v run --provider-slug PROVIDER_SLUG
# To run a pipeline for each fetcher:
dbnomics-fetchers -v list --slug | xargs -I {} dbnomics-fetchers -v run --provider-slug {}
Development
This repository uses Poetry.
# git clone repo or fork
cd dbnomics-fetcher-ops
poetry install
cp .env.example .env
Run commands with:
poetry run dbnomics-fetchers COMMAND
To use ipdb:
poetry shell
# Find venv dir with "which python"
ipdb3 /path/to/venv/bin/dbnomics-fetchers ...
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for dbnomics-fetcher-ops-0.4.11.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | be0faf23b500786966681ab18f0683e0b37d32b82ce53a4b877cbdf381d53627 |
|
MD5 | ef658ca957b1b9c59768552f9af9898e |
|
BLAKE2b-256 | f67a657495b25cade4709fbc61ede875cab79d8155310b55ef47db921523dde5 |
Close
Hashes for dbnomics_fetcher_ops-0.4.11-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e9fca84697010018012e1bd87444da1b294a420d939b683f7a9b71725516ec37 |
|
MD5 | 9aa2c5543fb508364f4b9598339277f7 |
|
BLAKE2b-256 | 42a9ae54a841ad66310a01d27c0af66ad754abbfcd3361f8922d57e239b3453f |