Pyplatform-datalake package provides functions for Google Cloud Storage and Microsoft Storage services.
Project description
Pyplatform-datalake package provides functions for Google Cloud Storage and Microsoft Storage services.
Installation
pip install pyplatform-datalake
Authentication and environment variables
Refer to main page for documentation on authentication
Exploring the modules
from pyplatform.datalake import *
show_me()
Usage
uploading in-memory data to Google Cloud Storage
import pyplatform.datalake as dlk
from io import BytesIO
# df #TODO create dataframe as source
in_mem_file = BytesIO()
df.to_excel(in_mem_file,index=False)
in_mem_file.seek(0)
dlk.gcs_upload_blob(in_mem_file,bucket_id='bucket',blobname='test.xlsx')
downloading and loading trained forecasting model from Google Cloud Storage
import pyplatform.datalake as dlk
from io import BytesIO
import pickle
gcs_uri = 'gs://bucket/folder_name/model_name'
model_name="fbprophet_forecast_daily"
dlk.gcs_download_blob(gcs_uri,filepath=model_name)
with open(model_name,"rb") as model:
my_model=pickle.load(model)
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for pyplatform-datalake-2020.12.1.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | d77e26cbd97c2b5e174ad410663f011de29df5498d343b97a7b8ac5c743cd3f6 |
|
MD5 | e916a295d0ad675d894848349a15424f |
|
BLAKE2b-256 | 38af1a5e7140a70e683d094d01564673345f98a632e85fa71e340a3ff7acf56f |
Close
Hashes for pyplatform_datalake-2020.12.1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e4de2840530eb2580c2d2fd4593864db6bd67f2ad04660e4f704e97bca00a124 |
|
MD5 | 3f0f890ee35222f3669c15092a7b3f3c |
|
BLAKE2b-256 | 5c02f46d8f939cfdd9e6103409511469a45d2458d390370d4162f35bea3c31e3 |