Easily integrate data in BigQuery
Project description
PyGBQ
Easily integrate data in BigQuery
Example
The following snippet
from pygbq import Client
import requests
client = Client(default_dataset='Finance')
@client.gbq(how='replace')
def transactions(start_date):
data = requests.get(url='some/api/endpoint', headers={'start_date': start_date}).json()
return data
if __name__ == "__main__":
transactions("2020-11-25")
will (re)create table Finance.transactions
in your default project.
Install and set up
pip install pygbq
Set up the authentication.
Documentation
- gbq - main decorator
- update_table_using_temp - if you want to use the decorator as a function
- table - friendly interface to get a table from BigQuery
- set_dataset - set default dataset in the project
- MyError - if you need to return a value with Flask
- read_jsonl - read newline delimited json
- generate_schema - might be useful for the first integration when you want to see schema
- get_secret - get a secret version from Secret Manager
- add_secret - add a secret version to Secret Manager
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
pygbq-0.22.tar.gz
(9.4 kB
view hashes)
Built Distribution
pygbq-0.22-py3-none-any.whl
(10.8 kB
view hashes)