for managing data storage between local environments and Google Cloud Storage (GCS) bucketss.
Project description
gc-data-storage provides a unified interface for saving, reading, and managing various data types including DataFrames, plots, images, and generic files.
- Save data from your development environment to the bucket.
- Read data from the bucket into your development environment, with the option to keep a copy in the persistent disk.
- Copy data between different directories within the bucket or between two different buckets owned by the user.
- Obtain a list of data saved in the bucket or the persistent disk.
- Delete data saved in the bucket or the persistent disk.
- Obtain information on a file, using the full path or a partial string
Features:
- Universal GCP Compatibility: Works across all GCP environments including All of Us Researcher Workbench, Google Colab, Vertex AI Workbench, and local development
- Auto-detection: Automatically detects bucket names and project IDs from environment variables
- Multi-format Support: Handles DataFrames, plots, images, Excel workbooks, and generic files
- Robust Error Handling: Comprehensive logging and error management
- Flexible Path Management: Supports both relative and absolute GCS paths
- Batch Operations: Copy, list, and delete operations for file management
More information, including code examples, at https://github.com/AymoneKouame/google-cloud-data-storage.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
gc-data-storage-3.0.0.tar.gz
(8.1 kB
view details)
File details
Details for the file gc-data-storage-3.0.0.tar.gz.
File metadata
- Download URL: gc-data-storage-3.0.0.tar.gz
- Upload date:
- Size: 8.1 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.9.12
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
798929d12410aec63768e65acf519209c4f8a82e461beca684d1be5bdbb498d9
|
|
| MD5 |
27a946a704ee350053ec24a452e5778b
|
|
| BLAKE2b-256 |
989f6c6128d9c152842d36b7ef59674d22f6d9964862fd144844050caf1ffa02
|