bqemulatormanager is a wrapper of bigquery-emulator which provides us BigQuery mock working in local machine.
Project description
BiqQueryEmulator Manager
this package is wrapper of bigquery-emulator which provides us BigQuery mock working in local machine.
using this package, you can
- do unit test of your sql
- download the schema of big query, and use it to make test data
usage
-
following instruction, download
bigquery-emulator
command. -
install this package.
pip install bqemulatormanager
- test your sql.
import bqemulatormanager as bqem
import pandas as pd
manager = bqem.Manager(project='test', schema_path='resources/schema_example.yaml')
with manager:
data = pd.DataFrame([
{'id': 1, 'name': 'sato'},
{'id': 2, 'name': 'yamada'}
])
manager.load(data, 'dataset1.table_a')
sql = 'SELECT id, name FROM `dataset1.table_a`'
df = manager.query(sql)
print(df)
unit test example is here.
automatically detect schema
When called Manager.load
, SchemaManager
search correspond table schema from schema_path
(default is bqem_master_schema.yaml
).
If schema definition cannot be found, SchemaManager
request it from BigQuery in production environment and update master schema file.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for bqemulatormanager-0.2.1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 9c9d2f3a4eca09b72fecd883199eca570fd5403d66f9ba3486a5c899adaf8259 |
|
MD5 | 4c9795f0d75475262ecdb5eb8f0717bc |
|
BLAKE2b-256 | e03beca960c3855526c1c72a5a8d89af9ed5c08fc470a00302fa88698e044804 |