Skip to main content

Functions required by the access-logs-local-driver

Project description

# Access Logs Driver

Load the content of gzipped Apache HTTP log files Exclude bots, scrapers, etc., select URLs matching the provided regex(es), and generate a CSV of the relevant log entries.

Take postprocessed logs and strip out multiple hits in sessions, and resolve URLs to the chosen URI_SCHEME (e.g. info:doi).

We strip out entries where the same (IP address * user agent) pair has accessed a URL within the last SESSION_TIMEOUT (e.g. half-hour)

Additionally, we convert the URLs to ISBNs and collate request data by date, outputting a CSV for ingest via the stats system.

Release Notes: [0.0.4] - 2023-07-31

Changed:
  • Update file structure and name of the driver

Release Notes: [0.0.3] - 2023-07-25

Changed:
  • Update requirements

  • Update using a pyproject.toml file as well as the new deployment structure

[0.0.2] - 2023-07-11

Added:
  • Unittests

Changed:
  • Moved the files out of the package and get the file’s data as parameters and return the filtered data.

  • renamed the plugin to access-logs-local

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

access_logs_local-0.0.4.tar.gz (9.7 kB view details)

Uploaded Source

Built Distribution

access_logs_local-0.0.4-py3-none-any.whl (6.9 kB view details)

Uploaded Python 3

File details

Details for the file access_logs_local-0.0.4.tar.gz.

File metadata

  • Download URL: access_logs_local-0.0.4.tar.gz
  • Upload date:
  • Size: 9.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.10.6

File hashes

Hashes for access_logs_local-0.0.4.tar.gz
Algorithm Hash digest
SHA256 d541ad1fb362908e98178ec866f2d6fac7df38cde2eceefa6d4a2f022e15a925
MD5 1b8ebe16506e04f000c1a56b38f4c9d1
BLAKE2b-256 06449dffac06bd6e28c6760ceb8fde8255f389c08575dec1442f7a2e4c140872

See more details on using hashes here.

File details

Details for the file access_logs_local-0.0.4-py3-none-any.whl.

File metadata

File hashes

Hashes for access_logs_local-0.0.4-py3-none-any.whl
Algorithm Hash digest
SHA256 a71f6c0cb2bd86d46d1681c3def84aedaa356bb496734b7daad06209a121e659
MD5 0ace42085074b1a43a1e7510ce042de9
BLAKE2b-256 07bee81ef3f65ad692fd70e657837ef6e146351e6845936343a18dc82d77e4d0

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page