Skip to main content

Read-only, metadata-only cloud storage audit for stale and duplicate objects (AWS S3, GCS, Azure Blob).

Project description

PendragonDI Cloud Audit

Find stale, oversized, or duplicate files in cloud storage — without touching your data.

PendragonDI Cloud Audit is a lightweight command-line tool that helps you uncover hidden cost drivers in your cloud storage buckets:

  • Unused or stale files
  • Duplicate objects
  • Oversized resources
  • Cold data that hasn’t been touched in months

It runs entirely locally using your own credentials. No file content is ever read. No objects are ever modified.


🔍 Why It Exists

Most teams store more than they realize—and rarely clean up:

  • ☁️ Cloud object stores are treated like infinite file systems
  • 💸 Many orgs pay for millions of forgotten or duplicate files
  • 🧱 Native tools are clunky, slow, or deeply integrated with billing

PendragonDI Cloud Audit gives you a fast, metadata-only snapshot of wasteful storage across AWS S3, Google Cloud Storage, and Azure Blob—before it shows up on your invoice.


✅ Features

  • 🔍 Identifies stale files based on last-modified timestamp
  • 🪞 Detects potential duplicates using file size, name, and timestamp
  • 🧾 Outputs clean, readable HTML or CSV reports
  • 💡 Estimates storage cost impact
  • 🧪 Supports limit-based sampling for fast iteration
  • 🔐 Operates with your credentials — no external access required
  • 🔒 Never reads, moves, or deletes content

🛠️ Installation

Core CLI only (no provider):

pip install pendragondi-cloud-audit

With a provider:

pip install pendragondi-cloud-audit[aws]
pip install pendragondi-cloud-audit[gcs]
pip install pendragondi-cloud-audit[azure]
pip install pendragondi-cloud-audit[all]  # for all providers

🚀 Quickstart

1. Run a scan:

pendragondi-cloud-audit scan aws my-bucket --days-stale 90 --output report.html

You can also limit the number of objects scanned:

pendragondi-cloud-audit scan gcs my-bucket --days-stale 60 --limit 10000 --output audit.csv

📄 Example Report

Total Files: 3200 • Stale: 1800 • Duplicates: 400

Results can be opened in any browser or spreadsheet tool.


🧰 Supported Providers

Provider Install Extra Credential Method
AWS S3 aws Boto3 profile / ENV
GCS gcs Application Default / keyfile
Azure azure Connection string or container URL

🔐 Security & Compliance

PendragonDI Cloud Audit was built for zero-risk analysis:

Layer Behavior
Access Uses your own credentials
Data Privacy Never reads file content
Write Behavior Read-only (no writes)
Output Local CSV or HTML report

📜 License

MIT License


🧭 Why PendragonDI?

Cloud billing surprises happen when small inefficiencies scale. PendragonDI Cloud Audit was designed to help teams see storage drift before it gets expensive.

  • No dashboard logins.
  • No waiting on IT.
  • Just insight.

🤝 Contributing

We welcome contributions!

To contribute:

  • Fork this repo and work from main
  • Use type hints and docstrings
  • Submit focused pull requests
  • Report bugs or ideas via Issues

Questions or feedback? Email us: pendragondi@pendragondi.dev


💖 Support the Project

PendragonDI Cloud Audit is free and open-source. If this tool saved you time or money, consider supporting us on GitHub:

Sponsor on GitHub

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pendragondi_cloud_audit-0.2.8.tar.gz (9.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

pendragondi_cloud_audit-0.2.8-py3-none-any.whl (11.2 kB view details)

Uploaded Python 3

File details

Details for the file pendragondi_cloud_audit-0.2.8.tar.gz.

File metadata

  • Download URL: pendragondi_cloud_audit-0.2.8.tar.gz
  • Upload date:
  • Size: 9.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.11.9

File hashes

Hashes for pendragondi_cloud_audit-0.2.8.tar.gz
Algorithm Hash digest
SHA256 6c0ee5e3d1c971440b201684f2a33ac67f7fb8a71e4de4e4e02e47612c5d04c8
MD5 5270454e698aef15d28475a5cd214684
BLAKE2b-256 5e79abd3dac3f3f477ee54ef6e9561951629f4bf9daf9d5c5c8fc89dc2a0dac4

See more details on using hashes here.

File details

Details for the file pendragondi_cloud_audit-0.2.8-py3-none-any.whl.

File metadata

File hashes

Hashes for pendragondi_cloud_audit-0.2.8-py3-none-any.whl
Algorithm Hash digest
SHA256 9debdd8e949d8cd9138a440b9872b3ae9ec1eb8c4f5c75318fd33ad515250a6d
MD5 eb56bda21b53c8120a54ba49bc85a857
BLAKE2b-256 00479a43dd30573fa8719e016d29210b7ed575b3955e0f7ad59713aa4fcc3a24

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page