Skip to main content

Read-only, metadata-only cloud storage audit for stale and duplicate objects (AWS S3, GCS, Azure Blob).

Project description

PendragonDI Cloud Audit

Find stale, oversized, or duplicate files in cloud storage — without touching your data.

PendragonDI Cloud Audit is a lightweight command-line tool that helps you uncover hidden cost drivers in your cloud storage buckets:

  • Unused or stale files
  • Duplicate objects
  • Oversized resources
  • Cold data that hasn’t been touched in months

It runs entirely locally using your own credentials. No file content is ever read. No objects are ever modified.


🔍 Why It Exists

Most teams store more than they realize—and rarely clean up:

  • ☁️ Cloud object stores are treated like infinite file systems
  • 💸 Many orgs pay for millions of forgotten or duplicate files
  • 🧱 Native tools are clunky, slow, or deeply integrated with billing

PendragonDI Cloud Audit gives you a fast, metadata-only snapshot of wasteful storage across AWS S3, Google Cloud Storage, and Azure Blob—before it shows up on your invoice.


✅ Features

  • 🔍 Identifies stale files based on last-modified timestamp
  • 🪞 Detects potential duplicates using file size, name, and timestamp
  • 🧾 Outputs clean, readable HTML or CSV reports
  • 💡 Estimates storage cost impact
  • 🧪 Supports limit-based sampling for fast iteration
  • 🔐 Operates with your credentials — no external access required
  • 🔒 Never reads, moves, or deletes content

🛠️ Installation

Core CLI only (no provider):

pip install pendragondi-cloud-audit

With a provider:

pip install pendragondi-cloud-audit[aws]
pip install pendragondi-cloud-audit[gcs]
pip install pendragondi-cloud-audit[azure]
pip install pendragondi-cloud-audit[all]  # for all providers

🚀 Quickstart

1. Run a scan:

pendragondi-cloud-audit scan aws my-bucket --days-stale 90 --output report.html

You can also limit the number of objects scanned:

pendragondi-cloud-audit scan gcs my-bucket --days-stale 60 --limit 10000 --output audit.csv

📄 Example Report

Total Files: 3200 • Stale: 1800 • Duplicates: 400

Results can be opened in any browser or spreadsheet tool.


🧰 Supported Providers

Provider Install Extra Credential Method
AWS S3 aws Boto3 profile / ENV
GCS gcs Application Default / keyfile
Azure azure Connection string or container URL

🔐 Security & Compliance

PendragonDI Cloud Audit was built for zero-risk analysis:

Layer Behavior
Access Uses your own credentials
Data Privacy Never reads file content
Write Behavior Read-only (no writes)
Output Local CSV or HTML report

📜 License

MIT License


🧭 Why PendragonDI?

Cloud billing surprises happen when small inefficiencies scale. PendragonDI Cloud Audit was designed to help teams see storage drift before it gets expensive.

  • No dashboard logins.
  • No waiting on IT.
  • Just insight.

🤝 Contributing

We welcome contributions!

To contribute:

  • Fork this repo and work from main
  • Use type hints and docstrings
  • Submit focused pull requests
  • Report bugs or ideas via Issues

Questions or feedback? Email us: pendragondi@pendragondi.dev


💖 Support the Project

PendragonDI Cloud Audit is free and open-source. If this tool saved you time or money, consider supporting us on GitHub:

Sponsor on GitHub

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pendragondi_cloud_audit-0.2.3.tar.gz (5.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

pendragondi_cloud_audit-0.2.3-py3-none-any.whl (7.9 kB view details)

Uploaded Python 3

File details

Details for the file pendragondi_cloud_audit-0.2.3.tar.gz.

File metadata

  • Download URL: pendragondi_cloud_audit-0.2.3.tar.gz
  • Upload date:
  • Size: 5.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.11.9

File hashes

Hashes for pendragondi_cloud_audit-0.2.3.tar.gz
Algorithm Hash digest
SHA256 346b1c54be6df277a237e41970dedf715758e152c323f12b12177d780e99bdac
MD5 30b6e655575de59cca8514ad61277e1b
BLAKE2b-256 ddf94be1281c1f30b2891b84e63adcabcab41025735f42d4b30bf1eb3fc12b2d

See more details on using hashes here.

File details

Details for the file pendragondi_cloud_audit-0.2.3-py3-none-any.whl.

File metadata

File hashes

Hashes for pendragondi_cloud_audit-0.2.3-py3-none-any.whl
Algorithm Hash digest
SHA256 3f8d45c84b9a5e945205086e024889a99716a80da72944b38726533461c7d989
MD5 1218843f3d443b8678fe5e6aeb46de3c
BLAKE2b-256 8b4dd4294b3290d0835e8ed74b79a879bc60f4362c89abe94c2b20a8c19a3de9

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page