Skip to main content

Wrapper around BigQuery & Snowflake libraries to simplify writing to/reading from Pandas DataFrames.

Project description

A lightweight Python wrapper around Google Cloud BigQuery’s API to simplify read and write between Pandas DataFrames and BigQuery.

Features

  • Create new tables with specified schema

  • Append DataFrames to existing tables

  • Simply read from tables or arbitrary SELECT statements

  • Get BigQuery metadata (datasets, tables, table schemas, etc.)

Dependencies

BQPipe supports Python 3.7+.

Installation requires NumPy, Pandas, Google-Cloud-BigQuery, and PyArrow.

Installation

The latest stable release (and older versions) can be installed from PyPI:

pip install bqpipe

You may instead want to use the development version from Github:

pip install git+https://github.com/4mile/bqpipe.git#egg=bqpipe

Testing

Coming Soon

Development

BQPipe development takes place on GitHub.

Please submit any reproducible bugs you encounter to the Issue Tracker.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

bqpipe-0.5.1.tar.gz (11.0 kB view details)

Uploaded Source

Built Distribution

bqpipe-0.5.1-py3-none-any.whl (22.6 kB view details)

Uploaded Python 3

File details

Details for the file bqpipe-0.5.1.tar.gz.

File metadata

  • Download URL: bqpipe-0.5.1.tar.gz
  • Upload date:
  • Size: 11.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.20.1 setuptools/39.0.1 requests-toolbelt/0.9.1 tqdm/4.31.1 CPython/3.7.1

File hashes

Hashes for bqpipe-0.5.1.tar.gz
Algorithm Hash digest
SHA256 c56eddf0e1712df63929d84ec8042ffe058e14ef29f5600fa6f099f8374eb947
MD5 08566b7e34669765226f3714e3beec21
BLAKE2b-256 90b2f60c5fca891de4e1a5f0da670ba068613b46ddc3040f35cecf563d1ddaad

See more details on using hashes here.

File details

Details for the file bqpipe-0.5.1-py3-none-any.whl.

File metadata

  • Download URL: bqpipe-0.5.1-py3-none-any.whl
  • Upload date:
  • Size: 22.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.20.1 setuptools/39.0.1 requests-toolbelt/0.9.1 tqdm/4.31.1 CPython/3.7.1

File hashes

Hashes for bqpipe-0.5.1-py3-none-any.whl
Algorithm Hash digest
SHA256 e88d571f6d417d66b43bf1afde8967ca65c4c194ce5b24dad3d418c4254c96ba
MD5 076cc0a398a4165d01393f6beab10056
BLAKE2b-256 078903627363c3979b945c7d22161b8b85217495e4418070d366cc89a58b04a7

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page