Pyplatform-datalake package provides functions for Google Cloud Storage and Microsoft Storage services.
Project description
Pyplatform-datalake package provides functions for Google Cloud Storage and Microsoft Storage services.
Installation
pip install pyplatform-datalake
Authentication and environment variables
Refer to main page for documentation on authentication
Exploring the modules
from pyplatform.datalake import *
show_me()
Usage
uploading in-memory data to Google Cloud Storage
import pyplatform.datalake as dlk
from io import BytesIO
# df #TODO create dataframe as source
in_mem_file = BytesIO()
df.to_excel(in_mem_file,index=False)
in_mem_file.seek(0)
dlk.gcs_upload_blob(in_mem_file,bucket_id='bucket',blobname='test.xlsx')
downloading and loading trained forecasting model from Google Cloud Storage
import pyplatform.datalake as dlk
from io import BytesIO
import pickle
gcs_uri = 'gs://bucket/folder_name/model_name'
model_name="fbprophet_forecast_daily"
dlk.gcs_download_blob(gcs_uri,filepath=model_name)
with open(model_name,"rb") as model:
my_model=pickle.load(model)
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for pyplatform-datalake-2020.11.1.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3ea1697c26e9251f93486fde38e4e9ff5df826a70bd3ebfffbf9d904cee2dffc |
|
MD5 | 107e8e5b64cc37a68e86387480946cbe |
|
BLAKE2b-256 | 61b9471f01290b310d41af5f44531899d434eb636007586380c802338503fbf8 |
Close
Hashes for pyplatform_datalake-2020.11.1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 0817a0c07efdf8cea5d93bbd2ae0fda826b431b7df43680d49dd533d73081340 |
|
MD5 | 51f7159ebd70378cfd1e0b7cc7d1cbc8 |
|
BLAKE2b-256 | dd5ac814e43854f7c6fa5f9468747aba2426b4aef2a23ed47a0ed158281585e7 |