Skip to main content

for managing data storage between local environments and Google Cloud Storage (GCS) bucketss.

Project description

gc-data-storage provides a unified interface for saving, reading, and managing various data types including DataFrames, plots, images, and generic files.

  • Save data from your development environment to the bucket.
  • Read data from the bucket into your development environment, with the option to keep a copy in the persistent disk.
  • Copy data between different directories within the bucket or between two different buckets owned by the user.
  • Obtain a list of data saved in the bucket or the persistent disk.
  • Delete data saved in the bucket or the persistent disk.
  • Obtain information on a file, using the full path or a partial string

Features:

  • Universal GCP Compatibility: Works across all GCP environments including All of Us Researcher Workbench, Google Colab, Vertex AI Workbench, and local development
  • Auto-detection: Automatically detects bucket names and project IDs from environment variables
  • Multi-format Support: Handles DataFrames, plots, images, Excel workbooks, and generic files
  • Robust Error Handling: Comprehensive logging and error management
  • Flexible Path Management: Supports both relative and absolute GCS paths
  • Batch Operations: Copy, list, and delete operations for file management

More information, including code examples, at https://github.com/AymoneKouame/google-cloud-data-storage.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

gc-data-storage-3.0.0.tar.gz (8.1 kB view details)

Uploaded Source

File details

Details for the file gc-data-storage-3.0.0.tar.gz.

File metadata

  • Download URL: gc-data-storage-3.0.0.tar.gz
  • Upload date:
  • Size: 8.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.9.12

File hashes

Hashes for gc-data-storage-3.0.0.tar.gz
Algorithm Hash digest
SHA256 798929d12410aec63768e65acf519209c4f8a82e461beca684d1be5bdbb498d9
MD5 27a946a704ee350053ec24a452e5778b
BLAKE2b-256 989f6c6128d9c152842d36b7ef59674d22f6d9964862fd144844050caf1ffa02

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page