bqemulatormanager is a wrapper of bigquery-emulator which provides us BigQuery mock working in local machine.
Project description
BiqQueryEmulator Manager
this package is wrapper of bigquery-emulator which provides us BigQuery mock working in local machine.
using this package, you can
- do unit test of your sql
- download the schema of big query, and use it to make test data
usage
-
following instruction, download
bigquery-emulator
command. -
install this package.
pip install bqemulatormanager
- test your sql.
import bqemulatormanager as bqem
import pandas as pd
manager = bqem.Manager(project='test', schema_path='resources/schema_example.yaml')
with manager:
data = pd.DataFrame([
{'id': 1, 'name': 'sato'},
{'id': 2, 'name': 'yamada'}
])
manager.load(data, 'dataset1.table_a')
sql = 'SELECT id, name FROM `dataset1.table_a`'
df = manager.query(sql)
print(df)
unit test example is here.
automatically detect schema
When called Manager.load
, SchemaManager
search correspond table schema from schema_path
(default is bqem_master_schema.yaml
).
If schema definition cannot be found, SchemaManager
request it from BigQuery in production environment and update master schema file.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for bqemulatormanager-0.2.2-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 59b2bb6c3bead22a283738a2332f8343e2c58031acdf6764dc3b016396e012d7 |
|
MD5 | dc2a09062c2049409d3590017dac6b36 |
|
BLAKE2b-256 | a7cc21c62cbc6f3833e6a767ed335e98c4ae6b97b7bbd5740d18f221690c349a |