Skip to main content

No project description provided

Project description

Python Library for Deleting Objects in Google Cloud Storage Buckets

This library provides a function clean_up_gcs_bucket that helps you delete unwanted objects from a Google Cloud Storage (GCS) bucket based on a folder path and substring criteria.

** clean_up_gcs_bucket(bucket_name, folder_path, substring): **

The clean_up_gcs_bucket function takes the following arguments:

Parameters:

  1. bucket_name: (str) The name of the GCS bucket to clean up.
  2. folder_path (str, optional): An optional prefix to filter objects within a specific folder path in the bucket. Include a trailing slash. Defaults to listing all objects in the bucket.
  3. substring (str, optional): An optional substring to filter objects. Objects containing the substring (case-insensitive) will be deleted. Defaults to deleting all objects matching the folder_path criteria.

Example Usage:

from Clean_up_gcs_bucket import clean_up_gcs_bucket

# Replace with your information
bucket_name = "your-bucket-name"
folder_path = "path/to/your/folder/"  # Optional, defaults to all files in bucket
substring = "report"  # Optional, deletes objects containing the substring (case-insensitive)

clean_up_gcs_bucket(bucket_name, folder_path, substring)

Function Behavior

  1. Connects to GCS using storage.Client.
  2. Retrieves the bucket specified by bucket_name.
  3. Lists all blobs (objects) in the bucket, optionally filtered by folder_path.
  4. Iterates through each file in the bucket: a). Checks if the substring is provided: 1. If not provided, all objects matching the folder_path (if specified) will be deleted. 2. If provided, objects containing the substring (case-insensitive) and matching the folder_path (if specified) will be deleted. b). Deletes the matching blob using blob.delete(). c). Keeps a count of deleted objects.
  5. Prints a summary message indicating the number of deleted objects, bucket name, folder path (if provided), and the used substring (if provided).

Additional Notes:

  1. This function permanently deletes objects from GCS. Use caution and ensure you have backups if necessary.
  2. Be specific with folder_path and substring to avoid unintended deletions.
  3. This library uses the google-cloud-storage library. Ensure it is installed (pip install google-cloud-storage).

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

Clean_up_gcs_bucket-0.2.tar.gz (2.4 kB view details)

Uploaded Source

Built Distribution

Clean_up_gcs_bucket-0.2-py3-none-any.whl (3.0 kB view details)

Uploaded Python 3

File details

Details for the file Clean_up_gcs_bucket-0.2.tar.gz.

File metadata

  • Download URL: Clean_up_gcs_bucket-0.2.tar.gz
  • Upload date:
  • Size: 2.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.11.5

File hashes

Hashes for Clean_up_gcs_bucket-0.2.tar.gz
Algorithm Hash digest
SHA256 828830b01595c260900e4a4a8f176481cfd16f8373d0cce62e764d52f0de487d
MD5 6bf83b4ea606a9906e553eb66f827adc
BLAKE2b-256 27c724a0f9ea7b58ae3af466b58e273ba2cfae73490bcaed301dd957d2ce3fb8

See more details on using hashes here.

File details

Details for the file Clean_up_gcs_bucket-0.2-py3-none-any.whl.

File metadata

File hashes

Hashes for Clean_up_gcs_bucket-0.2-py3-none-any.whl
Algorithm Hash digest
SHA256 e59f8f49670ca34c94e2f8b571108946265cbfa340224df45bbca22bdfe8479c
MD5 8fa6844a2f1a28343133c404bc6f912f
BLAKE2b-256 bed7c4d3280d0c2cb2750da80bb3db55734bc4c0d2bb66c030e1b5e7e61393c8

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page