Wrapper around BigQuery & Snowflake libraries to simplify writing to/reading from Pandas DataFrames.
Project description
A lightweight Python wrapper around Google Cloud BigQuery’s API to simplify read and write between Pandas DataFrames and BigQuery.
Features
Create new tables with specified schema
Append DataFrames to existing tables
Simply read from tables or arbitrary SELECT statements
Get BigQuery metadata (datasets, tables, table schemas, etc.)
Dependencies
BQPipe supports Python 3.7+.
Installation requires NumPy, Pandas, Google-Cloud-BigQuery, and PyArrow.
Installation
The latest stable release (and older versions) can be installed from PyPI:
pip install bqpipe
You may instead want to use the development version from Github:
pip install git+https://github.com/4mile/bqpipe.git#egg=bqpipe
Testing
Coming Soon
Development
BQPipe development takes place on GitHub.
Please submit any reproducible bugs you encounter to the Issue Tracker.
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file bqpipe-0.5.0.tar.gz
.
File metadata
- Download URL: bqpipe-0.5.0.tar.gz
- Upload date:
- Size: 11.0 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.20.1 setuptools/39.0.1 requests-toolbelt/0.9.1 tqdm/4.31.1 CPython/3.7.1
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | c7c12eae76f9c3221a00c7f612805d2a45a6dfb1c98f852655da509543d48e87 |
|
MD5 | b6b45cd2489d1b783d5de859bf122535 |
|
BLAKE2b-256 | 45ede3873df0e1c99da568f7edfa1ff15b7328628d6e908c66cca59a552544a9 |
File details
Details for the file bqpipe-0.5.0-py3-none-any.whl
.
File metadata
- Download URL: bqpipe-0.5.0-py3-none-any.whl
- Upload date:
- Size: 22.6 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.20.1 setuptools/39.0.1 requests-toolbelt/0.9.1 tqdm/4.31.1 CPython/3.7.1
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 17f67dd5ccfe6d721d1eaa30d12ee5aef1355735539ecbaddbf12a444bea4240 |
|
MD5 | 1708e5b5a8eeb0ef7741822ddf2248bc |
|
BLAKE2b-256 | 33b35f18aa8c778c8e0d802124af6fe5d055076af8a60a9d3350c7941d861997 |