Skip to main content

A simple python script to identify and classify possible crawlers through analysis of web server log files

Project description

A simple python script to identify and classify possible crawlers through analysis of web server log files. The script categorizes identified web crawlers in to three as “known”, “suspicious” and “other”.This works with log files in Apache common log format.

Information about installation:

http://code.google.com/p/crawler-detection/

Project details


Release history Release notifications | RSS feed

This version

0.1

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

crawler-detection.zip (68.1 kB view details)

Uploaded Source

File details

Details for the file crawler-detection.zip.

File metadata

  • Download URL: crawler-detection.zip
  • Upload date:
  • Size: 68.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No

File hashes

Hashes for crawler-detection.zip
Algorithm Hash digest
SHA256 4de31e61be1e710acaa8507f97d775690ba86548da10aa96224c2a286e724ba2
MD5 67ed5a157109fedfcca0939b51246f79
BLAKE2b-256 4a12d09f97987b71e129a7e6d08e0f9004617e18c676bdf43b68bcba57fe6da7

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page