Skip to main content

A simple python script to identify and classify possible crawlers through analysis of web server log files. The script categorizes identified web crawlers in to three as “known”, “suspicious” and “other”.This works with log files in Apache common log format.

Information about installation:

http://code.google.com/p/crawler-detection/

Metadata

Release files for crawler_detection 0.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for crawler_detection 0.1
File Size Uploaded Provenance Actions
crawler-detection.zip 68.1 kB Without provenance Details for crawler-detection.zip

Release files / crawler-detection.zip

Download URL crawler-detection.zip
Size 68.1 kB
Tags Source
SHA-256 checksum
How to use checksums
4de31e61be1e710acaa8507f97d775690ba86548da10aa96224c2a286e724ba2
BLAKE2b-256 checksum
How to use checksums
4a12d09f97987b71e129a7e6d08e0f9004617e18c676bdf43b68bcba57fe6da7
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No

Security for crawler_detection 0.1

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Release history Release notifications | RSS feed

This release

0.1 This release

1 release file No provenance

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page