Skip to main content

A lightweight Python wrapper around the Google Cloud BigQuery and Snowflake data platform APIs to simplify read and write between Pandas DataFrames and BigQuery/Snowflake.

Features

  • Create new tables with specified schema

  • Append DataFrames to existing tables

  • Simply read from tables or arbitrary SELECT statements

  • Get BigQuery metadata (datasets, tables, table schemas, etc.)

Dependencies

BQPipe supports Python 3.7+.

Installation requires NumPy, Pandas, Google-Cloud-BigQuery, Snowflake-Connector-Python, Snowflake-SQLAlchemy, and Cryptography.

Installation

The latest stable release (and older versions) can be installed from PyPI:

pip install bqpipe

You may instead want to use the development version from Github:

pip install git+https://github.com/4mile/bqpipe.git#egg=bqpipe

Testing

Coming Soon

Development

BQPipe development takes place on GitHub.

Please submit any reproducible bugs you encounter to the Issue Tracker.

Metadata

Release files for bqpipe 0.5.2

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for bqpipe 0.5.2
File Size Uploaded
bqpipe-0.5.2.tar.gz 11.7 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for bqpipe 0.5.2
File Interpreter ABI Platform
bqpipe-0.5.2-py3-none-any.whl Python 3 none any Details

Total release size: 34.8 kB

Release files / bqpipe-0.5.2.tar.gz

Download URL bqpipe-0.5.2.tar.gz
Size 11.7 kB
Tags Source
SHA-256 checksum
How to use checksums
dfda2bb0926bd95bd5d9cee9c9f1ac3f2adfdff16d313fab81ab28bf4631c806
BLAKE2b-256 checksum
How to use checksums
6ccf9463ecb2d43f65e055c6bed2c8bb3b4cdcd0e91fe5959cdcee0ad2b2eb20
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.1.1 pkginfo/1.5.0.1 requests/2.20.1 setuptools/39.0.1 requests-toolbelt/0.9.1 tqdm/4.31.1 CPython/3.7.1

Release files / bqpipe-0.5.2-py3-none-any.whl

Download URL bqpipe-0.5.2-py3-none-any.whl
Size 23.2 kB
Tags Python 3
SHA-256 checksum
How to use checksums
091010a6e66210591679c90f62b33abd639c8355f1ca3118bdfcc3d02e56512c
BLAKE2b-256 checksum
How to use checksums
4455477aa1e6afc81949433c7d141ede7fea4fb62fc0c5528be5666213ff2946
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.1.1 pkginfo/1.5.0.1 requests/2.20.1 setuptools/39.0.1 requests-toolbelt/0.9.1 tqdm/4.31.1 CPython/3.7.1

Release history Release notifications | RSS feed

This release

0.5.2 This release

2 release files

0.5.1

2 release files

0.5.0

2 release files

0.4.3

2 release files

0.4.2

2 release files

0.4.1

2 release files

0.4.0

2 release files

0.3.3

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page