Wrapper around BigQuery & Snowflake libraries to simplify writing to/reading from Pandas DataFrames.

Navigation

Verified details

These details have been verified by PyPI
Maintainers
Avatar for jmbrooks from gravatar.com jmbrooks

Unverified details

These details have not been verified by PyPI
Project links
Meta
  • License: Apache Software License (Type license() to see the full license text)
  • Author: Johnathan Brooks
  • Tags bigquery, snowflake, google, cloud, etl, data, engineering, dataframe, pandas
  • Requires: Python >=3.7, <4
Classifiers

Project description

A lightweight Python wrapper around the Google Cloud BigQuery and Snowflake data platform APIs to simplify read and write between Pandas DataFrames and BigQuery/Snowflake.

Features

  • Create new tables with specified schema

  • Append DataFrames to existing tables

  • Simply read from tables or arbitrary SELECT statements

  • Get BigQuery metadata (datasets, tables, table schemas, etc.)

Dependencies

BQPipe supports Python 3.7+.

Installation requires NumPy, Pandas, Google-Cloud-BigQuery, Snowflake-Connector-Python, Snowflake-SQLAlchemy, and Cryptography.

Installation

The latest stable release (and older versions) can be installed from PyPI:

pip install bqpipe

You may instead want to use the development version from Github:

pip install git+https://github.com/4mile/bqpipe.git#egg=bqpipe

Testing

Coming Soon

Development

BQPipe development takes place on GitHub.

Please submit any reproducible bugs you encounter to the Issue Tracker.

Project details

Verified details

These details have been verified by PyPI
Maintainers
Avatar for jmbrooks from gravatar.com jmbrooks

Unverified details

These details have not been verified by PyPI
Project links
Meta
  • License: Apache Software License (Type license() to see the full license text)
  • Author: Johnathan Brooks
  • Tags bigquery, snowflake, google, cloud, etl, data, engineering, dataframe, pandas
  • Requires: Python >=3.7, <4
Classifiers

Release history Release notifications | RSS feed

This version

0.5.2

0.5.1

0.5.0

0.4.3

0.4.2

0.4.1

0.4.0

0.3.3

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

bqpipe-0.5.2.tar.gz (11.7 kB view details)

Uploaded Source

Built Distribution

bqpipe-0.5.2-py3-none-any.whl (23.2 kB view details)

Uploaded Python 3

File details

Details for the file bqpipe-0.5.2.tar.gz.

File metadata

  • Download URL: bqpipe-0.5.2.tar.gz
  • Upload date:
  • Size: 11.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.20.1 setuptools/39.0.1 requests-toolbelt/0.9.1 tqdm/4.31.1 CPython/3.7.1

File hashes

Hashes for bqpipe-0.5.2.tar.gz
Algorithm Hash digest
SHA256 dfda2bb0926bd95bd5d9cee9c9f1ac3f2adfdff16d313fab81ab28bf4631c806
MD5 c8de1b4e426096bd43aa93baa9dbce10
BLAKE2b-256 6ccf9463ecb2d43f65e055c6bed2c8bb3b4cdcd0e91fe5959cdcee0ad2b2eb20

See more details on using hashes here.

File details

Details for the file bqpipe-0.5.2-py3-none-any.whl.

File metadata

  • Download URL: bqpipe-0.5.2-py3-none-any.whl
  • Upload date:
  • Size: 23.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.20.1 setuptools/39.0.1 requests-toolbelt/0.9.1 tqdm/4.31.1 CPython/3.7.1

File hashes

Hashes for bqpipe-0.5.2-py3-none-any.whl
Algorithm Hash digest
SHA256 091010a6e66210591679c90f62b33abd639c8355f1ca3118bdfcc3d02e56512c
MD5 745a67e7de61af07d2b77cce95c5fbfa
BLAKE2b-256 4455477aa1e6afc81949433c7d141ede7fea4fb62fc0c5528be5666213ff2946

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page