Skip to main content

Utilities functions for interacting with GCP tools

Project description

gcp_utils

Utilities for working with Google Cloud Platform (GCP). Written in an effort to keep re-useable functions to a singular package.

Installation

pip install gcp_utils

Features

  • Upload and read CSVs from Google Cloud Storage
  • Access secrets from Google Secret Manager
  • Combine current and previous year GCS data

Example Usage

from gcp_utils import send_to_gcs, read_gcs_csv_to_df, access_secret_version, load_and_append_previous_year

# Upload a DataFrame to GCS
send_to_gcs('my-bucket', 'data/', my_dataframe, 'file.csv')

# Read a CSV from GCS
df = read_gcs_csv_to_df('gs://my-bucket/data/file.csv')

# Access a secret
creds = access_secret_version('my-project', 'my-secret')

# Combine current and previous year data
df = load_and_append_previous_year('my-bucket', 'etl/incoming/2024_file.csv')

License

MIT

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

gcp_utils_sds-0.1.0.tar.gz (5.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

gcp_utils_sds-0.1.0-py3-none-any.whl (4.9 kB view details)

Uploaded Python 3

File details

Details for the file gcp_utils_sds-0.1.0.tar.gz.

File metadata

  • Download URL: gcp_utils_sds-0.1.0.tar.gz
  • Upload date:
  • Size: 5.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.12.3

File hashes

Hashes for gcp_utils_sds-0.1.0.tar.gz
Algorithm Hash digest
SHA256 fe06ffda4ce47b9012843cfd58a446bb2e8c2bb4ebc4d4cd07daa062c56c916d
MD5 31a8060c01badbb306ffc91298288b42
BLAKE2b-256 cd60c3192ab7d28e6974baa202378fb878bfad18a10db74a975c2d588a3b2ca0

See more details on using hashes here.

File details

Details for the file gcp_utils_sds-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: gcp_utils_sds-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 4.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.12.3

File hashes

Hashes for gcp_utils_sds-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 aecc6e74da3aa5d549b518cad943b654c7321975cf0680f716c86791c735d3f6
MD5 d89d3a745fd070fabf7e7321e43eab0c
BLAKE2b-256 f19dd2043e767a45b974b55cc579732fd908cb6203468a5117ca948514bd7be8

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page