Skip to main content

HFT-grade Linux infrastructure validator. Audits kernel, CPU, network, and clock settings against trading latency best practices.

Project description

latency-audit

PyPI version Python Versions License: MIT Code style: Ruff Pre-commit CI Codecov

The HFT Validator. A ruthless CLI tool that audits Linux infrastructure against Tier 1 High-Frequency Trading standards.


The Problem

Default Linux kernels are tuned for throughput (web servers), not latency (trading).

A single misconfigured setting can cost you:

Misconfiguration Latency Penalty
swappiness > 0 +100µs (page fault)
transparent_hugepages=always +50µs (compaction stalls)
GRO/LRO enabled +30µs per packet
Wrong CPU governor +200µs (frequency scaling)
C-States enabled +500µs (wake-up latency)

In HFT, 1 microsecond = $1M/year. These defaults are silent killers.


What It Checks

Kernel

  • Swappiness (should be 0)
  • Transparent Hugepages (should be never)
  • Kernel preemption model

CPU

  • Frequency Governor (should be performance)
  • C-States (should be disabled)
  • Core Isolation (isolcpus configuration)
  • NUMA topology awareness

Network

  • NIC Offloads (GRO/LRO/TSO should be OFF for latency-critical paths)
  • IRQ affinity
  • Ring buffer sizes
  • UDP socket buffer drops (RcvbufErrors)
  • NIC hardware discards (rx_missed_errors)

Hardware

  • PCIe Link Width & Speed (validates NICs negotiated at max speed)
  • Memory Channel Balance (detects asymmetric DIMM population)

Process

  • Involuntary Context Switches (scheduler preemption)
  • Major Page Faults (disk I/O detection)

Clock

  • TSC reliability (constant_tsc, nonstop_tsc)
  • Clocksource configuration

Installation

pip install latency-audit

Or install from source for the latest:

pip install git+https://github.com/padalan/latency-audit.git

Usage

Quick Audit (Read-Only)

latency-audit

Example output:

latency-audit v0.1.3

┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┓
┃                           KERNEL CONFIGURATION                            ┃
┗━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┛
  [PASS] swappiness = 0
  [FAIL] transparent_hugepages = always (should be: never)
  [PASS] kernel.sched_min_granularity_ns = 100000

┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┓
┃                            CPU CONFIGURATION                              ┃
┗━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┛
  [PASS] governor = performance (all cores)
  [FAIL] C-States enabled (max_cstate = 9, should be: 0)

JSON Output (for CI/CD)

latency-audit --json
{
  "score": 72,
  "checks": [
    {"name": "swappiness", "status": "pass", "value": 0},
    {"name": "thp", "status": "fail", "value": "always", "expected": "never"}
  ]
}

Check Specific Categories

# System-level checks
latency-audit --category kernel
latency-audit --category cpu
latency-audit --category network
latency-audit --category hardware

# Process-specific checks (requires --pid)
latency-audit --category process --pid 1234

Monitor a Running Process

# Check if your trading application has any scheduler preemptions or disk I/O
latency-audit --category process --pid $(pgrep trading_app)

Security

This tool is read-only by design. It:

  • Reads /proc and /sys filesystem
  • Reads sysctl values
  • Inspects NIC settings via ethtool
  • Never modifies any settings
  • Never requires root (though some checks are more complete with it)

Contributing

Contributions are welcome! Please read CONTRIBUTING.md for guidelines.

# Clone and install dev dependencies
git clone https://github.com/padalan/latency-audit.git
cd latency-audit
pip install -e ".[dev]"

# Install pre-commit hooks
pre-commit install

# Run tests
pytest

Roadmap

  • --fix mode with guided remediation
  • Benchmark mode (measure actual latency)
  • Docker container for isolated testing
  • Ansible playbook generation
  • Integration with Prometheus/Grafana

License

MIT © Nikhil Padala


Built with obsessive attention to microseconds.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

latency_audit-0.1.4.tar.gz (30.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

latency_audit-0.1.4-py3-none-any.whl (24.0 kB view details)

Uploaded Python 3

File details

Details for the file latency_audit-0.1.4.tar.gz.

File metadata

  • Download URL: latency_audit-0.1.4.tar.gz
  • Upload date:
  • Size: 30.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for latency_audit-0.1.4.tar.gz
Algorithm Hash digest
SHA256 3ce501d11834e0f84a4e2c045d845f6434066783493331496e6e85038212f532
MD5 aef1f8143dbc724c8b77540314373044
BLAKE2b-256 e90baaa2e1b992b584ee3b831c63b37f10954d99098692374f13b3437b17b9ba

See more details on using hashes here.

Provenance

The following attestation bundles were made for latency_audit-0.1.4.tar.gz:

Publisher: publish.yml on padalan/latency-audit

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file latency_audit-0.1.4-py3-none-any.whl.

File metadata

  • Download URL: latency_audit-0.1.4-py3-none-any.whl
  • Upload date:
  • Size: 24.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for latency_audit-0.1.4-py3-none-any.whl
Algorithm Hash digest
SHA256 cf2ccbd764537ac3e29bb6ba42db8c48f912caba97cc11e04fd912c64e862c43
MD5 a542a453a43f9c991244e40b8ef9a5d4
BLAKE2b-256 b9543d548493026c03e5ea37c28645620edc1f8ad1a256e6071469b1451c8f15

See more details on using hashes here.

Provenance

The following attestation bundles were made for latency_audit-0.1.4-py3-none-any.whl:

Publisher: publish.yml on padalan/latency-audit

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page