A simple python script to identify and classify possible crawlers through analysis of web server log files. The script categorizes identified web crawlers in to three as “known”, “suspicious” and “other”.This works with log files in Apache common log format.
Information about installation:
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
crawler-detection.zip
(68.1 kB
view details)
File details
Details for the file crawler-detection.zip.
File metadata
- Download URL: crawler-detection.zip
- Upload date:
- Size: 68.1 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
4de31e61be1e710acaa8507f97d775690ba86548da10aa96224c2a286e724ba2
|
|
| MD5 |
67ed5a157109fedfcca0939b51246f79
|
|
| BLAKE2b-256 |
4a12d09f97987b71e129a7e6d08e0f9004617e18c676bdf43b68bcba57fe6da7
|