Microsoft Azure SQL functions
Project description
Pyplatform is a data analytics platform architeture built around Google BigQuery in a hybrid cloud environment.
the platorm:
- provides fast, scalable and reliable SQL database solution
- abstracts away the infrastuture by builiding data pipelines with serverless compute solutions in python runtime environments
- simplifies development environment by using jupyter lab as the main tool
Installation
pip install pyplatform
Setting up development environment
git clone https://github.com/mhadi813/pyplatform
cd pyplatform
conda env create -f pyplatform_dev.yml
Environment variables
import os
os.environ['GOOGLE_APPLICATION_CREDENTIALS'] = 'path/to/default_service_account.json'
os.environ['DATASET'] = 'default_bigquery_dataset_name'
os.environ['STORAGE_BUCKET'] = 'default_storage_bucket_id'
Usage
common data pipeline architectures:
- Http sources
- On-prem servers
- Bigquery integration with Azure Logic Apps
- Event driven ETL process
- Streaming pipelines
Exploring modules
import pyplatform as pyp
pyp.show_me()
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for pyplatform-database-0.0.2.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 48291a24a3898468016c18afaec58c13c15b5d17504282c43503251982be117b |
|
MD5 | 53c4b8e529c9d6dbd1c4cd52665e3381 |
|
BLAKE2b-256 | c52a8d15398f764c3f104c97a70f1002c6356865dc655ff69ccbff50b1fb3b24 |
Close
Hashes for pyplatform_database-0.0.2-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e2f7eda0712da7a1abce00339a07923331bacfc11947c396fe7b4e87ee830637 |
|
MD5 | d1d2da8bc018e4cfff064d67e4e286ac |
|
BLAKE2b-256 | d64b292dec49a7ff0f0e7f9b2f284266d81c49d8f25bd910a92985d705a5b522 |