Functions required by the access-logs-local-driver
Project description
# Access Logs Driver
Load the content of gzipped Apache HTTP log files Exclude bots, scrapers, etc., select URLs matching the provided regex(es), and generate a CSV of the relevant log entries.
Take postprocessed logs and strip out multiple hits in sessions, and resolve URLs to the chosen URI_SCHEME (e.g. info:doi).
We strip out entries where the same (IP address * user agent) pair has accessed a URL within the last SESSION_TIMEOUT (e.g. half-hour)
Additionally, we convert the URLs to ISBNs and collate request data by date, outputting a CSV for ingest via the stats system.
Release Notes: [0.0.4] - 2023-07-31
- Changed:
Update file structure and name of the driver
Release Notes: [0.0.3] - 2023-07-25
- Changed:
Update requirements
Update using a pyproject.toml file as well as the new deployment structure
[0.0.2] - 2023-07-11
- Added:
Unittests
- Changed:
Moved the files out of the package and get the file’s data as parameters and return the filtered data.
renamed the plugin to access-logs-local
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file access_logs_local-0.0.4.tar.gz
.
File metadata
- Download URL: access_logs_local-0.0.4.tar.gz
- Upload date:
- Size: 9.7 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.10.6
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | d541ad1fb362908e98178ec866f2d6fac7df38cde2eceefa6d4a2f022e15a925 |
|
MD5 | 1b8ebe16506e04f000c1a56b38f4c9d1 |
|
BLAKE2b-256 | 06449dffac06bd6e28c6760ceb8fde8255f389c08575dec1442f7a2e4c140872 |
File details
Details for the file access_logs_local-0.0.4-py3-none-any.whl
.
File metadata
- Download URL: access_logs_local-0.0.4-py3-none-any.whl
- Upload date:
- Size: 6.9 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.10.6
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | a71f6c0cb2bd86d46d1681c3def84aedaa356bb496734b7daad06209a121e659 |
|
MD5 | 0ace42085074b1a43a1e7510ce042de9 |
|
BLAKE2b-256 | 07bee81ef3f65ad692fd70e657837ef6e146351e6845936343a18dc82d77e4d0 |