Skip to main content

Data Commons CLI

Project description

Data Commons CLI

Data Commons

Standard command-line interface for interacting with, deploying, and administering the Data Commons Platform.


Data Commons is an open-source project initiated by Google that aggregates data from hundreds of public sources, such as the US Census, Eurostat, CDC, and UN, into a unified, standard Knowledge Graph.

The Data Commons Platform provides the infrastructure to run your own private instance of Data Commons, allowing you to seamlessly combine public datasets with your own custom, private data using modern APIs, graph query engines, and visualization dashboards.


Installation

Install the Data Commons CLI using pip or uv:

Install with pip

pip install --user datacommons-cli

If the datacommons command is not found after installing, add Python's user-binary directory to your PATH:

export PATH="$PATH:$(python3 -m site --user-base)/bin"

Install with uv

uv tool install datacommons-cli

If the datacommons command is not found after installing, add the appropriate directory to your PATH:

export PATH="~/.local/bin:$PATH"

With uvx

Or execute datacommons-cli on-the-fly without installation using uvx:

uvx datacommons-cli --help

Help & Documentation

For full documentation, tutorials, and deployment guides, visit: 👉 docs.datacommons.org


Usage

The CLI exposes standard operations under the main datacommons entrypoint. You can check the version and get help instantly:

# Show help menu
datacommons --help

# Show version
datacommons --version

Administrative Commands

All infrastructure setup, database operations, and ingestion pipelines are managed under the admin sub-command group:

datacommons admin [COMMAND] --help

Available Commands

Command Description
init Scaffolds a localized Terraform configuration to deploy the Data Commons Platform on Google Cloud Platform (GCP).
init-db Configures database schemas and seeds baseline tables on GCP Spanner via the Ingestion Helper service.
seed-db Re-runs or updates base geographic and schema seeds on GCP Spanner.
ingest start Triggers a Cloud Run + Cloud Workflows background data ingestion pipeline to import your custom datasets.
ingest show-config Prints current background ingestion parameters, GCS bucket paths, and active GCP credentials.

Quickstart: Scaffolding a Private Data Commons

  1. Initialize your project configuration and scaffold Terraform templates:

    datacommons admin init --project-id my-gcp-project --namespace prod
    
  2. Change directories to the scaffolded directory (e.g. cd prod).

  3. Initialize and deploy your GCP infrastructure with Terraform:

    terraform init
    terraform apply
    
  4. Initialize and seed your Spanner database:

    datacommons admin init-db
    
  5. Trigger the data ingestion pipeline:

    datacommons admin ingest start
    

License: Apache-2.0

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

datacommons_cli-1.0.0.tar.gz (4.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

datacommons_cli-1.0.0-py3-none-any.whl (4.7 kB view details)

Uploaded Python 3

File details

Details for the file datacommons_cli-1.0.0.tar.gz.

File metadata

  • Download URL: datacommons_cli-1.0.0.tar.gz
  • Upload date:
  • Size: 4.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.19 {"installer":{"name":"uv","version":"0.11.19","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Debian GNU/Linux","version":"13","id":"trixie","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}

File hashes

Hashes for datacommons_cli-1.0.0.tar.gz
Algorithm Hash digest
SHA256 6caaaff5d26d946fbbc2d253ca2a082c5330e6188e5279b591a6bc3483381fe9
MD5 b9932ff14cc3a9e4b2ffb53e0ff82221
BLAKE2b-256 1ae429a21aa2718a38b38b54924470186108f07afb9f6233d8d06ca70889b82f

See more details on using hashes here.

File details

Details for the file datacommons_cli-1.0.0-py3-none-any.whl.

File metadata

  • Download URL: datacommons_cli-1.0.0-py3-none-any.whl
  • Upload date:
  • Size: 4.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.19 {"installer":{"name":"uv","version":"0.11.19","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Debian GNU/Linux","version":"13","id":"trixie","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}

File hashes

Hashes for datacommons_cli-1.0.0-py3-none-any.whl
Algorithm Hash digest
SHA256 46f8c4c0c87f226270a0eecb1a692c641c5a0a61add4c38fc5daac7b97342230
MD5 ddcbe6081fdf00d5793a231f2ec57da3
BLAKE2b-256 1ba424bb3bf07b87b148dc9aacd139b6ea7d2854711670d196df13dc7823b7fa

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page