Skip to main content

Wrapper around BigQuery & Snowflake libraries to simplify writing to/reading from Pandas DataFrames.

Project description

A lightweight Python wrapper around Google Cloud BigQuery’s API to simplify read and write between Pandas DataFrames and BigQuery.

Features

  • Create new tables with specified schema

  • Append DataFrames to existing tables

  • Simply read from tables or arbitrary SELECT statements

  • Get BigQuery metadata (datasets, tables, table schemas, etc.)

Dependencies

BQPipe supports Python 3.7+.

Installation requires NumPy, Pandas, Google-Cloud-BigQuery, and PyArrow.

Installation

The latest stable release (and older versions) can be installed from PyPI:

pip install bqpipe

You may instead want to use the development version from Github:

pip install git+https://github.com/4mile/bqpipe.git#egg=bqpipe

Testing

Coming Soon

Development

BQPipe development takes place on GitHub.

Please submit any reproducible bugs you encounter to the Issue Tracker.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

bqpipe-0.5.0.tar.gz (11.0 kB view details)

Uploaded Source

Built Distribution

bqpipe-0.5.0-py3-none-any.whl (22.6 kB view details)

Uploaded Python 3

File details

Details for the file bqpipe-0.5.0.tar.gz.

File metadata

  • Download URL: bqpipe-0.5.0.tar.gz
  • Upload date:
  • Size: 11.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.20.1 setuptools/39.0.1 requests-toolbelt/0.9.1 tqdm/4.31.1 CPython/3.7.1

File hashes

Hashes for bqpipe-0.5.0.tar.gz
Algorithm Hash digest
SHA256 c7c12eae76f9c3221a00c7f612805d2a45a6dfb1c98f852655da509543d48e87
MD5 b6b45cd2489d1b783d5de859bf122535
BLAKE2b-256 45ede3873df0e1c99da568f7edfa1ff15b7328628d6e908c66cca59a552544a9

See more details on using hashes here.

File details

Details for the file bqpipe-0.5.0-py3-none-any.whl.

File metadata

  • Download URL: bqpipe-0.5.0-py3-none-any.whl
  • Upload date:
  • Size: 22.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.20.1 setuptools/39.0.1 requests-toolbelt/0.9.1 tqdm/4.31.1 CPython/3.7.1

File hashes

Hashes for bqpipe-0.5.0-py3-none-any.whl
Algorithm Hash digest
SHA256 17f67dd5ccfe6d721d1eaa30d12ee5aef1355735539ecbaddbf12a444bea4240
MD5 1708e5b5a8eeb0ef7741822ddf2248bc
BLAKE2b-256 33b35f18aa8c778c8e0d802124af6fe5d055076af8a60a9d3350c7941d861997

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page