No project description provided
Project description
BiqQueryEmulator Manager
this package is wrapper of bigquery-emulator which provides us BigQuery mock working in local machine.
using this package, you can
- do unit test of your sql
- download the schema of big query, and use it to make test data
usage
-
following instruction, download
bigquery-emulator
command. -
install this package.
pip install bqemulatormanager
- test your sql.
import bqemulatormanager as bqem
import pandas as pd
manager = bqem.Manager(project='test', schema_path='resources/schema_example.yaml')
with manager:
data = pd.DataFrame([
{'id': 1, 'name': 'sato'},
{'id': 2, 'name': 'yamada'}
])
manager.load(data, 'dataset1.table_a')
sql = 'SELECT id, name FROM `dataset1.table_a`'
df = manager.query(sql)
print(df)
automatically detect schema
When called Manager.load
, SchemaManager
search correspond table schema from schema_path
(default is master_schema.yaml
).
If schema definition canot be found, SchemaManager
request it from BigQuery in production environmant and update master schema file.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for bqemulatormanager-0.1.4-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6f342b8712d739733675315eca11911f881c58fcef04cf65b43dd6d94ec3e343 |
|
MD5 | 16c1e113563c72d013c4d6bdafece628 |
|
BLAKE2b-256 | 9400e1b7141fdcfb3963c41c6b04133feb999d09cd017fc7ab4bd4132bec8112 |