A package designed for helping everyone in the team to work with data ingestion
Project description
Changelog
- Version 2.0.0:
- Change all of the API code
- Allowed to set detailed configuration for schema of a BigQuery table
- Added more features to work with BigQuery
- Version 2.0.1:
- Changed some methods to become
staticmethod
- Changed some methods to become
- Version 2.0.2:
- Fixed minor error
- Version 2.0.3:
- Added new method
generate_dummy_schema_from_df
to generrate dummy schema from pandas DataFrame
- Added new method
- Version 2.0.4:
- Allowed to create Hive partitions
- Version 2.0.5:
- Unloaded the pyodbc in default connectors
- Version 2.0.9:
- Added a static method to get the full qualified table name
- Version 2.1.0:
- Added a method to update target schema with ease
- Version 2.1.1:
- Added Biglake connection support
The steps to work with Biglake =
- Create an external connection
- Get the
service account
from the connection and add to IAM - Try create a BigLake manually using the command below
- now you can use the code to do it
test_create_biglake.py
- Added Biglake connection support
The steps to work with Biglake =
- Version 2.1.2:
- Bug Fixed
- Version 2.1.3:
- Bug Fixed
- Version 2.1.4:
- Bug Fixed
- Version 2.1.5 to 2.1.11:
- Bug Fixed
- Version 2.1.12:
- Improved readability
- Version 2.1.13 14 15:
- Add tranformation config support
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
npgbq-2.1.21.tar.gz
(29.9 kB
view hashes)
Built Distribution
npgbq-2.1.21-py3-none-any.whl
(30.4 kB
view hashes)