Skip to main content

BigQuery client wrapper with clean API

Project description

BigFlow

Documentation

  1. What is BigFlow?
  2. Getting started
  3. Installing Bigflow
  4. Help me
  5. CLI
  6. Configuration
  7. Project setup and build
  8. Deployment
    1. Cloud Composer
    2. Kubernetes
    3. Vault
  9. Workflow & Job
  10. Starter
  11. Utils
    1. BigQuery
    2. Apache Beam
    3. Dataproc
    4. Job monitoring
  12. Roadmap

What is BigFlow?

TODO

Getting started

TODO

Installing BigFlow

Prerequisites. Before you start, make sure you have the following software installed:

  1. Python 3.7
  2. Google Cloud SDK
  3. Docker Engine

You can install the bigflow package globally but we recommend to install it locally with venv, in your project's folder:

python -m venv .bigflow_env
source .bigflow_env/bin/activate

Install the bigflow PIP package:

pip install bigflow

Test it:

bigflow -h

Read more about BigFlow CLI.

Help me

TODO

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

bigflow-1.0.dev30.tar.gz (51.3 kB view details)

Uploaded Source

Built Distribution

bigflow-1.0.dev30-py3-none-any.whl (46.8 kB view details)

Uploaded Python 3

File details

Details for the file bigflow-1.0.dev30.tar.gz.

File metadata

  • Download URL: bigflow-1.0.dev30.tar.gz
  • Upload date:
  • Size: 51.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.5.0.1 requests/2.24.0 setuptools/49.6.0 requests-toolbelt/0.9.1 tqdm/4.48.2 CPython/3.7.9

File hashes

Hashes for bigflow-1.0.dev30.tar.gz
Algorithm Hash digest
SHA256 01153c0e259c8182e44158a05bc595091f9f5771603ad31ebaa6041e76b56dab
MD5 a7b8b252b69f08d25575c0e6cb0f7f20
BLAKE2b-256 602f3354250ee1e38c48646c14dd3309375a98283fbc513230701652e41b466c

See more details on using hashes here.

Provenance

File details

Details for the file bigflow-1.0.dev30-py3-none-any.whl.

File metadata

  • Download URL: bigflow-1.0.dev30-py3-none-any.whl
  • Upload date:
  • Size: 46.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.5.0.1 requests/2.24.0 setuptools/49.6.0 requests-toolbelt/0.9.1 tqdm/4.48.2 CPython/3.7.9

File hashes

Hashes for bigflow-1.0.dev30-py3-none-any.whl
Algorithm Hash digest
SHA256 e0a04a0186134d9efefb6d02a39acd96571fc6801dc2529142ae1418d29f0b46
MD5 3e89fb80a62e8c69bf9300f26b152ca5
BLAKE2b-256 840a519ce11e14b48e162701ec61bc443d7c475178b4d9617002292d3b28136b

See more details on using hashes here.

Provenance

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page