Skip to main content

Pyplatform-datalake package provides functions for Google Cloud Storage and Microsoft Storage services.

Installation

pip install pyplatform-datalake

Authentication and environment variables

Refer to main page for documentation on authentication

Exploring the modules

from pyplatform.datalake import *
show_me()

Usage

uploading in-memory data to Google Cloud Storage

import pyplatform.datalake as dlk
from io import BytesIO
# df #TODO create dataframe as source
in_mem_file = BytesIO()
df.to_excel(in_mem_file,index=False)
in_mem_file.seek(0)
dlk.gcs_upload_blob(in_mem_file,bucket_id='bucket',blobname='test.xlsx')

downloading and loading trained forecasting model from Google Cloud Storage

import pyplatform.datalake as dlk
from io import BytesIO
import pickle

gcs_uri = 'gs://bucket/folder_name/model_name'
model_name="fbprophet_forecast_daily"
dlk.gcs_download_blob(gcs_uri,filepath=model_name)
with open(model_name,"rb") as model:
    my_model=pickle.load(model)

Metadata

Release files for pyplatform-datalake 2020.12.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for pyplatform-datalake 2020.12.1
File Size Uploaded Provenance
pyplatform-datalake-2020.12.1.tar.gz 6.9 kB Without provenance Details

Built distribution (wheel)

Table of built distributions (wheels) for pyplatform-datalake 2020.12.1
File Interpreter ABI Platform
pyplatform_datalake-2020.12.1-py3-none-any.whl Python 3 none any Details

Total release size: 14.2 kB

Release files / pyplatform-datalake-2020.12.1.tar.gz

Download URL pyplatform-datalake-2020.12.1.tar.gz
Size 6.9 kB
Tags Source
SHA-256 checksum
How to use checksums
d77e26cbd97c2b5e174ad410663f011de29df5498d343b97a7b8ac5c743cd3f6
BLAKE2b-256 checksum
How to use checksums
38af1a5e7140a70e683d094d01564673345f98a632e85fa71e340a3ff7acf56f
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.2.0 pkginfo/1.5.0.1 requests/2.23.0 setuptools/50.3.2 requests-toolbelt/0.9.1 tqdm/4.42.1 CPython/3.7.6

Release files / pyplatform_datalake-2020.12.1-py3-none-any.whl

Download URL pyplatform_datalake-2020.12.1-py3-none-any.whl
Size 7.3 kB
Tags Python 3
SHA-256 checksum
How to use checksums
e4de2840530eb2580c2d2fd4593864db6bd67f2ad04660e4f704e97bca00a124
BLAKE2b-256 checksum
How to use checksums
5c02f46d8f939cfdd9e6103409511469a45d2458d390370d4162f35bea3c31e3
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.2.0 pkginfo/1.5.0.1 requests/2.23.0 setuptools/50.3.2 requests-toolbelt/0.9.1 tqdm/4.42.1 CPython/3.7.6

Security for pyplatform-datalake 2020.12.1

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page