Skip to main content

Python utility for data storage in Google Cloud Environments.

Project description

gc_data_storage lets you easily move data between your development environment (e.g. Jupyter Notebook) and your Google Cloud Workspace bucket. It integrates the command line tool gsutil.

  • Save data from your development environment to the bucket.

  • Read data from the bucket into your development environment, with the option to keep a copy in the persistent disk.

  • Copy data between different directories within the bucket or between two different buckets owned by the user.

  • Obtain a list of data saved in the bucket or the persistent disk.

  • Delete data saved in the bucket or the persistent disk.

gc_data_storage was originally written to be used within the All of Us Researcher Workbench environment but can be used in other Google Cloud Environments.

#install the package if not already done
##pip install gc-data-storage 

#import and initialize
## When initializing,  use the default AllofUS Researcher workbench bucket or input your own
from gc_data_storage import gc_data_storage as gs
gs = gs()

#list data in the bucket root directory 
gs.list_saved_data()

More information, including examples, at https://github.com/AymoneKouame/google-cloud-data-storage.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

gc_data_storage-0.2.3.tar.gz (4.5 kB view details)

Uploaded Source

File details

Details for the file gc_data_storage-0.2.3.tar.gz.

File metadata

  • Download URL: gc_data_storage-0.2.3.tar.gz
  • Upload date:
  • Size: 4.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.9.12

File hashes

Hashes for gc_data_storage-0.2.3.tar.gz
Algorithm Hash digest
SHA256 c410b76888ce2e758da7dee2253cbff9c505287eba2b2e4d54d060c6e2d7f7d1
MD5 b9b73d3081d17fcdc175f1c5e02ba581
BLAKE2b-256 1b452157aba1c74278ebc619eaf30689b125ac154612617af266b1a515e4b1f0

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page