Skip to main content

Functions required by the access-logs-local-driver

Project description

# Access Logs Driver

Load the content of gzipped Apache HTTP log files Exclude bots, scrapers, etc., select URLs matching the provided regex(es), and generate a CSV of the relevant log entries.

Take postprocessed logs and strip out multiple hits in sessions, and resolve URLs to the chosen URI_SCHEME (e.g. info:doi).

We strip out entries where the same (IP address * user agent) pair has accessed a URL within the last SESSION_TIMEOUT (e.g. half-hour)

Additionally, we convert the URLs to ISBNs and collate request data by date, outputting a CSV for ingest via the stats system.

Release Notes: [0.0.3] - 2023-07-25

Changed:
  • Update requirements

  • Update using a pyproject.toml file as well as the new deployment structure

[0.0.2] - 2023-07-11

Added:
  • Unittests

Changed:
  • Moved the files out of the package and get the file’s data as parameters and return the filtered data.

  • renamed the plugin to access-logs-local

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

access_logs_local-0.0.3.tar.gz (9.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

access_logs_local-0.0.3-py3-none-any.whl (6.9 kB view details)

Uploaded Python 3

File details

Details for the file access_logs_local-0.0.3.tar.gz.

File metadata

  • Download URL: access_logs_local-0.0.3.tar.gz
  • Upload date:
  • Size: 9.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.10.6

File hashes

Hashes for access_logs_local-0.0.3.tar.gz
Algorithm Hash digest
SHA256 bcf6ee7a2814308a2b23b9dd9914313ee858b49eb3ca3ca04cc1dbda1daa6b57
MD5 06c3c22ab66e70bf7d9454cddd0983b7
BLAKE2b-256 c869f2744c4bf96ce2ef3c8e187958e33e374eec461d5b75a2484ed354903700

See more details on using hashes here.

File details

Details for the file access_logs_local-0.0.3-py3-none-any.whl.

File metadata

File hashes

Hashes for access_logs_local-0.0.3-py3-none-any.whl
Algorithm Hash digest
SHA256 32ba6298051ee1fd16d17f129577c38524a76312cc05d17e9382cf9005a1da43
MD5 bb694c6158bd6b7fab28a865b0140ba8
BLAKE2b-256 7cae10c574f5287fc513f25034474554d9079d4235e3f3c05cefb82e292693b5

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page