Skip to main content

Data engineering & Data science Framework

Project description

py-analytics

Contains Data Enginner, Data Scientist and 3rd party integration tools capabilities

Installation

py-test-utility can be installed via pip

pip install ??find the name??

BigQuery

To access BigQuery you will need following environment variables:

  • BIGQUERY_PROJECT - name of the project in BigQuery. Default project cannot be changed in the code.
  • BIGQUERY_ACCESS_TOKEN_PATH - path to the json token file.

BigQuery functions wrap bigrquery functions to provide higher level API removing boilerplate instructions of the lower level API.

tdd_utility - module

class load_data(type,file,schema)

Contains methods to extract the equivalent json from csv with nested and repeated records structures

Methods

  • to_json()

    • if successfuls return the json obj extracted from the csv
  • to_new_line_delimiter_file(output_file_name)

    • return 0 if successfuls
    • create new line delimiter "output_file_name" file

Generating distribution archives

python3 -m pip install --user --upgrade setuptools wheel
python3 -m pip install --user --upgrade twine

Now run this command from the same directory where setup.py is located:

python3 setup.py sdist bdist_wheel

Uploading the distribution archives

python3 -m twine upload --repository-url dist/*

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for py-am, version 0.0.2
Filename, size File type Python version Upload date Hashes
Filename, size py_am-0.0.2-py3-none-any.whl (3.4 kB) File type Wheel Python version py3 Upload date Hashes View hashes
Filename, size py-am-0.0.2.tar.gz (2.1 kB) File type Source Python version None Upload date Hashes View hashes

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN SignalFx SignalFx Supporter DigiCert DigiCert EV certificate StatusPage StatusPage Status page