Skip to main content

A simple python script to identify and classify possible crawlers through analysis of web server log files. The script categorizes identified web crawlers in to three as “known”, “suspicious” and “other”.This works with log files in Apache common log format.

Information about installation:

http://code.google.com/p/crawler-detection/

Metadata

Release files for crawler_detection 0.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for crawler_detection 0.1
File Size Uploaded
crawler-detection.zip 68.1 kB Details

Release files / crawler-detection.zip

Download URL crawler-detection.zip
Size 68.1 kB
Tags Source
SHA-256 checksum
How to use checksums
4de31e61be1e710acaa8507f97d775690ba86548da10aa96224c2a286e724ba2
BLAKE2b-256 checksum
How to use checksums
4a12d09f97987b71e129a7e6d08e0f9004617e18c676bdf43b68bcba57fe6da7
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No

Release history Release notifications | RSS feed

This release

0.1 This release

1 release file

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page