Nairobi OS: Heavy Iron Data Science Infrastructure with Lagos Vision (Hardware-Accelerated Zero-Copy Rendering)
Project description
Nairobi OS: Heavy Iron AI Infrastructure
[!IMPORTANT] Linux & WSL2 Only. We do not compromise on kernel physics.
Author: Kevin Chege. Location: Nairobi
License: PolyForm Noncommercial License 1.0.0
Nairobi OS is a high-performance data science operating system primitive designed for extreme resource efficiency. It enables memory-constrained environments (Edge, Containers, Serverless) to process large-scale datasets with hardware-accelerated ingestion and vectorized Rust analytics.
🚀 Version 0.2.1: The Fused Strike
This release introduces the Fused Analytics Pipeline, allowing ingestion, statistical distillation, and correlation to happen in a single, high-speed D-Bus round trip.
Key Features:
- Fused Pipeline:
nairobi_os.data.pipeline()for maximum throughput. - Zero-Copy Ingestion: Powered by
memfd,io_uring, and kernelcopy_file_range. - Extreme Speed: Ingest 450MB+ datasets 12x faster than standard Pandas.
- Rayon Parallelization: Vectorized analytics leveraging multi-core hardware saturation.
- Persistent Infrastructure: Cached D-Bus connections for low-latency calls.
🛠️ Installation
pip install nairobi-os==0.2.1
💻 Quick Start
import nairobi_os
import json
# Ignite the refinery daemon
nairobi_os.start_refinery()
# Run a fused analytics strike
# (Ingest + Mean/StdDev/Skew/Kurtosis + Pearson Correlation)
result_json = nairobi_os.data.pipeline(
"data.csv",
"target_column",
"col1,col2" # Correlation pair
)
result = json.loads(result_json)
print(f"Mean: {result['mean']}")
print(f"Correlation: {result['pearson']}")
# Shutdown refinery
nairobi_os.stop_refinery()
📊 Performance Benchmark (v0.2.1)
| Metric | Pandas (Unoptimized) | Nairobi OS | Speedup |
|---|---|---|---|
| Ingestion Latency | 6.38s | 0.52s | 12.2x |
| Statistical Distillation | 8.79s | 1.59s | 5.5x |
| Total Pipeline | 6.42s | 2.29s | 2.8x |
⚖️ Licensing
This project is licensed under the PolyForm Noncommercial License 1.0.0. It is free for personal, educational, and research use. For commercial inquiries, please contact the author.
© 2026 Kevin Chege. All Rights Reserved.
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distributions
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file nairobi_os-0.3.0-cp312-cp312-manylinux_2_34_x86_64.whl.
File metadata
- Download URL: nairobi_os-0.3.0-cp312-cp312-manylinux_2_34_x86_64.whl
- Upload date:
- Size: 18.8 MB
- Tags: CPython 3.12, manylinux: glibc 2.34+ x86-64
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.12.3
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
5da2c54d699d8fc1939f4eca154ed69dab7dff2168c7237f76062ad3cbcddf6b
|
|
| MD5 |
1f8857614a52aece1493d09bb5d98577
|
|
| BLAKE2b-256 |
ecf3dab37af042e14fd16fe17ef243df38781c6d586242a0edf7887a10e1da67
|