Skip to main content

A package designed for helping everyone in the team to work with data ingestion

Project description

Changelog

  • Version 2.0.0:
    • Change all of the API code
    • Allowed to set detailed configuration for schema of a BigQuery table
    • Added more features to work with BigQuery
  • Version 2.0.1:
    • Changed some methods to become staticmethod
  • Version 2.0.2:
    • Fixed minor error
  • Version 2.0.3:
    • Added new method generate_dummy_schema_from_df to generrate dummy schema from pandas DataFrame
  • Version 2.0.4:
    • Allowed to create Hive partitions
  • Version 2.0.5:
    • Unloaded the pyodbc in default connectors
  • Version 2.0.9:
    • Added a static method to get the full qualified table name
  • Version 2.1.0:
    • Added a method to update target schema with ease
  • Version 2.1.1:
    • Added Biglake connection support The steps to work with Biglake =
      • Create an external connection
      • Get the service account from the connection and add to IAM
      • Try create a BigLake manually using the command below
      • now you can use the code to do it test_create_biglake.py
  • Version 2.1.2:
    • Bug Fixed
  • Version 2.1.3:
    • Bug Fixed
  • Version 2.1.4:
    • Bug Fixed
  • Version 2.1.5 to 2.1.11:
    • Bug Fixed
  • Version 2.1.12:
    • Improved readability
  • Version 2.1.13 14 15:
    • Add tranformation config support

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

npgbq-2.1.21.tar.gz (29.9 kB view hashes)

Uploaded Source

Built Distribution

npgbq-2.1.21-py3-none-any.whl (30.4 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page