Skip to main content

HFT-grade Linux infrastructure validator.

Project description

โšก latency-audit

PyPI version Python Versions License: MIT Code style: Ruff Pre-commit CI Codecov

The HFT Validator. A ruthless CLI tool that audits Linux infrastructure against Tier 1 High-Frequency Trading standards.


๐Ÿšจ The Problem

Default Linux kernels are tuned for throughput (web servers), not latency (trading).

A single misconfigured setting can cost you:

Misconfiguration Latency Penalty
swappiness > 0 +100ยตs (page fault)
transparent_hugepages=always +50ยตs (compaction stalls)
GRO/LRO enabled +30ยตs per packet
Wrong CPU governor +200ยตs (frequency scaling)
C-States enabled +500ยตs (wake-up latency)

In HFT, 1 microsecond = $1M/year. These defaults are silent killers.


๐Ÿ›  What It Checks

Kernel

  • Swappiness (should be 0)
  • Transparent Hugepages (should be never)
  • Kernel preemption model

CPU

  • Frequency Governor (should be performance)
  • C-States (should be disabled)
  • Core Isolation (isolcpus configuration)
  • NUMA topology awareness

Network

  • NIC Offloads (GRO/LRO/TSO should be OFF for latency-critical paths)
  • IRQ affinity
  • Ring buffer sizes

Clock

  • TSC reliability (constant_tsc, nonstop_tsc)
  • Clocksource configuration

๐Ÿ“ฆ Installation

pip install latency-audit

Or install from source for the latest:

pip install git+https://github.com/nikhilpadala/latency-audit.git

โšก Usage

Quick Audit (Read-Only)

latency-audit

Example output:

โšก latency-audit v0.1.0

โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”“
โ”ƒ                           KERNEL CONFIGURATION                            โ”ƒ
โ”—โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”›
  โœ… swappiness = 0
  โŒ transparent_hugepages = always (should be: never)
  โœ… kernel.sched_min_granularity_ns = 100000

โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”“
โ”ƒ                            CPU CONFIGURATION                              โ”ƒ
โ”—โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”›
  โœ… governor = performance (all cores)
  โŒ C-States enabled (max_cstate = 9, should be: 0)

JSON Output (for CI/CD)

latency-audit --json
{
  "score": 72,
  "checks": [
    {"name": "swappiness", "status": "pass", "value": 0},
    {"name": "thp", "status": "fail", "value": "always", "expected": "never"}
  ]
}

Check Specific Categories

latency-audit --category kernel
latency-audit --category cpu
latency-audit --category network

๐Ÿ”’ Security

This tool is read-only by design. It:

  • โœ… Reads /proc and /sys filesystem
  • โœ… Reads sysctl values
  • โœ… Inspects NIC settings via ethtool
  • โŒ Never modifies any settings
  • โŒ Never requires root (though some checks are more complete with it)

๐Ÿค Contributing

Contributions are welcome! Please read CONTRIBUTING.md for guidelines.

# Clone and install dev dependencies
git clone https://github.com/nikhilpadala/latency-audit.git
cd latency-audit
pip install -e ".[dev]"

# Install pre-commit hooks
pre-commit install

# Run tests
pytest

๐Ÿ“ˆ Roadmap

  • --fix mode with guided remediation
  • Benchmark mode (measure actual latency)
  • Docker container for isolated testing
  • Ansible playbook generation
  • Integration with Prometheus/Grafana

๐Ÿ“„ License

MIT ยฉ Nikhil Padala


Built with obsessive attention to microseconds.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

latency_audit-0.1.0.tar.gz (24.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

latency_audit-0.1.0-py3-none-any.whl (18.2 kB view details)

Uploaded Python 3

File details

Details for the file latency_audit-0.1.0.tar.gz.

File metadata

  • Download URL: latency_audit-0.1.0.tar.gz
  • Upload date:
  • Size: 24.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for latency_audit-0.1.0.tar.gz
Algorithm Hash digest
SHA256 19169a0238bcc9bb8d4e7b9e73848ee9a64248bc90e4c6a34a62d03f1211dcb7
MD5 da6b1c57a439bc33bef041302a15470b
BLAKE2b-256 b56b5b03366026aacf8c0228ba967278682bdfe8d1122bc2e266a0f1b4937de6

See more details on using hashes here.

Provenance

The following attestation bundles were made for latency_audit-0.1.0.tar.gz:

Publisher: publish.yml on padalan/latency-audit

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file latency_audit-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: latency_audit-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 18.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for latency_audit-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 08bf1c80f167cb8ab38cb8250ddae315b95fb1e01af05e006ac174ce518b0d15
MD5 d51c84d6af32b1b7915b0daa039560de
BLAKE2b-256 c7f5d4ff8df276bf04e698aea2301e6f1f21cc78f24cd0a7795b7ad3d0b31ed3

See more details on using hashes here.

Provenance

The following attestation bundles were made for latency_audit-0.1.0-py3-none-any.whl:

Publisher: publish.yml on padalan/latency-audit

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page