Microsoft Azure SQL functions
Project description
Pyplatform is a data analytics platform architeture built around Google BigQuery in a hybrid cloud environment.
the platorm:
- provides fast, scalable and reliable SQL database solution
- abstracts away the infrastuture by builiding data pipelines with serverless compute solutions in python runtime environments
- simplifies development environment by using jupyter lab as the main tool
Installation
pip install pyplatform
Setting up development environment
git clone https://github.com/mhadi813/pyplatform
cd pyplatform
conda env create -f pyplatform_dev.yml
Environment variables
import os
os.environ['GOOGLE_APPLICATION_CREDENTIALS'] = 'path/to/default_service_account.json'
os.environ['DATASET'] = 'default_bigquery_dataset_name'
os.environ['STORAGE_BUCKET'] = 'default_storage_bucket_id'
Usage
common data pipeline architectures:
- Http sources
- On-prem servers
- Bigquery integration with Azure Logic Apps
- Event driven ETL process
- Streaming pipelines
Exploring modules
import pyplatform as pyp
pyp.show_me()
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for pyplatform-database-0.0.1.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | d94c6b66aae6de40431455d8f0cff567521d77b1b2bbeec8cb4b9932fcf1f6f9 |
|
MD5 | 77cb0682a3a2d3b53ae3d59cbbc23cf0 |
|
BLAKE2b-256 | abb2ff731d53d31d52a04487e1a7348dce9d2858534e84ad21d5aa0d17fa7b90 |
Close
Hashes for pyplatform_database-0.0.1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 0c68265b279ff23927c4200571c436cff24c62a1bd6d98f9d789681f4263b872 |
|
MD5 | 2e036f5fbefa9557c7ea398b76522d1c |
|
BLAKE2b-256 | 6f5c77671b1b442813ea61b23475ff4bd7d040a3adfa7b2e34482014960fac3b |