No project description provided
Project description
BiqQueryEmulator Manager
this package is wrapper of bigquery-emulator which provides us BigQuery mock working in local machine.
using this package, you can
- do unit test of your sql
- download the schema of big query, and use it to make test data
usage
-
following instruction, download
bigquery-emulator
command. -
install this package.
pip install bqemulatormanager
- test your sql.
import bqemulatormanager as bqem
import pandas as pd
manager = bqem.Manager(project='test', schema_path='resources/schema_example.yaml')
with manager:
data = pd.DataFrame([
{'id': 1, 'name': 'sato'},
{'id': 2, 'name': 'yamada'}
])
manager.load(data, 'dataset1.table_a')
sql = 'SELECT id, name FROM `dataset1.table_a`'
df = manager.query(sql)
print(df)
automatically detect schema
When called Manager.load
, SchemaManager
search correspond table schema from schema_path
(default is master_schema.yaml
).
If schema definition canot be found, SchemaManager
request it from BigQuery in production environmant and update master schema file.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for bqemulatormanager-0.1.5-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | c7a9a3f9423d8af46ab16f5a23da701956a6ea40a0f2c9b3f5a64d1fbaec8f37 |
|
MD5 | 0ff2a56439a89ad4bb8aeb4ad01e928c |
|
BLAKE2b-256 | 3918f8dc374969b460ab23d1a2cf6909a196fd9594960a6393ab5220d45aa0af |