Cloudflare Web Application Firewall downloader
A library, CLI, and docker image that downloads Cloudflare WAF logs for a specified zone_id and time frame.
Schema
See src/waf_logs/resources/db/ for a list of schemas that are auto-applied at start. This can be disabled by passing --ensure_schema False.
Quickstart
The project is published to https://pypi.org/project/waf-downloader/. Install it via:
pip install waf-downloader
# or alternatively, directly from git
pip install "git+https://github.com/MihaiBojin/waf-downloader@main"
Build and run with Docker
Define secrets in an .env file (do not quote values):
CLOUDFLARE_TOKEN=...
DB_CONN_STR=...
The Cloudflare token is required, but the connection string is optional. If skipped, it will result in logs being printed to stdout.
Build and run:
# Build
make docker
# Load all logs in zone, starting 5 minutes prior
make docker-run ARGS="--zone_id [CLOUDFLARE_ZONE_ID] --start_minutes_ago -5"
# And alternatively, only output the logs
make docker-run ARGS="--zone_id [CLOUDFLARE_ZONE_ID] --start_minutes_ago -5" 2>/dev/null
Publishing to PyPI
GitHub-based version publishing
The simplest way to publish a new version (if you have committer rights) is to tag a commit and push it to the repo:
# At a certain commit, ideally after merging a PR to main
git tag v0.1.x
git push origin v0.1.x
A GitHub Action will run, build the library and publish it to the PyPI repositories.
Manual publish
These steps can also be performed locally. For these commands to work, you will need to export two environment variables (or define them in .env):
export TESTPYPI_PASSWORD=... # token for https://test.pypi.org/legacy/
export PYPI_PASSWORD=... # token for https://upload.pypi.org/legacy/
First, publish to the test repo and inspect the package:
make publish-test
If correct, distribute the wheel to the PyPI index:
make publish
Verify the distributed code
make publish-verify
Cloudflare WAF documentation
1 maintainer
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file waf_downloader-0.1.1.tar.gz.
File metadata
- Download URL: waf_downloader-0.1.1.tar.gz
- Upload date:
- Size: 19.8 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via:
twine/5.1.0 CPython/3.11.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
787e7c8829da5a0c33ed277ac5918c34fa042b083b24f0eee0ddceaf470d4483
|
|
| MD5 |
667f72bb72b6bbadc4e0735d71beea10
|
|
| BLAKE2b-256 |
2ac787146f4c1b06157f5d3df1a473467e25e0bbc14119b2414bb51da1688c6f
|
File details
Details for the file waf_downloader-0.1.1-py3-none-any.whl.
File metadata
- Download URL: waf_downloader-0.1.1-py3-none-any.whl
- Upload date:
- Size: 18.5 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via:
twine/5.1.0 CPython/3.11.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
005e2bcdff1559c2c3f271433c100b23a68748e19fc6e910aed6758b1b3cd5d6
|
|
| MD5 |
747d9fff0082eca10645a0587b9cb160
|
|
| BLAKE2b-256 |
06a8ea812509b2ed1fcfd00b199d18b905ad08b45ab3988eb46c7672fae9a725
|
