Skip to main content

Manage DBnomics fetchers

Project description

DBnomics fetcher ops

Manage DBnomics fetchers: list, configure and run pipelines.

Install

pip install dbnomics-fetcher-ops

Usage

Configure a fetcher

The configure command needs write privileges. Create a GitLab personal access token having the api scope, and pass it using the --gitlab-private-token option or the GITLAB_PRIVATE_TOKEN environment variable in ~/.config/dbnomics/dbnomics-fetchers.env.

dbnomics-fetchers -v configure scsmich --dry-run
# If everything seems OK, remove the --dry-run flag:
dbnomics-fetchers -v configure scsmich

List fetchers

dbnomics-fetchers -v list

Run fetcher pipelines

# Replace PROVIDER_SLUG by the real value:
dbnomics-fetchers -v run --provider-slug PROVIDER_SLUG

# To run a pipeline for each fetcher:
dbnomics-fetchers -v list --slug | xargs -I {} dbnomics-fetchers -v run --provider-slug {}

Development

Using uv is recommended.

git clone https://git.nomics.world/dbnomics/dbnomics-fetcher-ops.git
cd dbnomics-fetcher-ops
cp .env.example .env

Use with:

uv run dbnomics-fetchers COMMAND

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dbnomics_fetcher_ops-0.7.1.tar.gz (33.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

dbnomics_fetcher_ops-0.7.1-py3-none-any.whl (50.1 kB view details)

Uploaded Python 3

File details

Details for the file dbnomics_fetcher_ops-0.7.1.tar.gz.

File metadata

  • Download URL: dbnomics_fetcher_ops-0.7.1.tar.gz
  • Upload date:
  • Size: 33.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.12.0 {"installer":{"name":"uv","version":"0.12.0","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Debian GNU/Linux","version":"13","id":"trixie","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for dbnomics_fetcher_ops-0.7.1.tar.gz
Algorithm Hash digest
SHA256 b612cee411bd702d4af3760b4bc8543d0716c73de76fadc1ff42d29535865ba8
MD5 daa77238befa471af22188bb8448c6ad
BLAKE2b-256 e3f5051ba99c56d723cbebc802674e6e4e647b974eef610042f82ef697d1d80f

See more details on using hashes here.

File details

Details for the file dbnomics_fetcher_ops-0.7.1-py3-none-any.whl.

File metadata

  • Download URL: dbnomics_fetcher_ops-0.7.1-py3-none-any.whl
  • Upload date:
  • Size: 50.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.12.0 {"installer":{"name":"uv","version":"0.12.0","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Debian GNU/Linux","version":"13","id":"trixie","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for dbnomics_fetcher_ops-0.7.1-py3-none-any.whl
Algorithm Hash digest
SHA256 7a8b8275a2dd904a6c2957271a67b633edf10e63eaccd68dbddae44e4fd96d8f
MD5 64e2505bcba625843abb78421864c751
BLAKE2b-256 8d3556c75c372196da559493c131ba6bde852de37efd6c171d83b5630bdff396

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page