Free & open source CLI for AIF-BIN files. Convert documents to semantic memory format.
Project description
AIF-BIN Lite
Free & Open Source CLI for AI memory files.
| Version | Extension | Full Name | Format |
|---|---|---|---|
| v1 | .aimf |
AI Memory Format | JSON |
| v2 | .aif-bin |
AI Formatted - Binary | Binary (MessagePack) |
Documentation
- Technical Whitepaper - Full specification and theory
What is AIF-BIN?
A file format specification with two versions:
- AIMF (.aimf) - AI Memory Format, v1 JSON encoding for simplicity
- AIF-BIN (.aif-bin) - AI Formatted - Binary, v2 binary encoding for performance
A single .aimf or .aif-bin file contains:
- Original document — The source file preserved
- Extracted content — Text parsed into searchable chunks
- Metadata — Title, timestamps, checksums
This is the free, open source implementation. For semantic search, batch processing, see AIF-BIN Pro.
Format Versions
This repository contains both format versions:
| Version | Extension | File | Full Name | Format |
|---|---|---|---|---|
| v1 | .aimf |
aifbin_v1.py |
AI Memory Format | JSON |
| v2 | .aif-bin |
aifbin_v2.py |
AI Formatted - Binary | Binary (MessagePack) |
AIMF - AI Memory Format (v1)
Simple, human-readable JSON. Uses .aimf extension. Great for learning and debugging.
{
"version": "1.0.0-lite",
"format": "json",
"metadata": {
"source_file": "sample.md",
"created_at": "2026-01-30T10:00:00"
},
"chunks": [
{"id": 0, "content": "...", "type": "text"}
],
"original_raw": "# Original content..."
}
AIF-BIN - AI Formatted - Binary (v2)
Compact binary format with MessagePack encoding. Uses .aif-bin extension. Used by AIF-BIN Pro.
[Header: 64 bytes]
Magic: "AIFBIN\x00\x01"
Version, Offsets, Size
[Metadata Section]
MessagePack blob
[Original Raw Section]
Preserved source file
[Content Chunks]
Typed chunks with optional embeddings
[Footer]
Index + CRC64 Checksum
Installation
# Clone the repo
git clone https://github.com/Terronex-dev/aifbin-lite.git
cd aifbin-lite
Windows (PowerShell/CMD)
# Install dependencies
pip install -r requirements.txt
# v1 - No external dependencies needed, but included in requirements for simplicity
python aifbin_v1.py --help
# v2
python aifbin_v2.py --help
Linux / macOS / WSL
# Install dependencies
pip3 install -r requirements.txt
# v1 - No external dependencies needed, but included in requirements for simplicity
python3 aifbin_v1.py --help
# v2
python3 aifbin_v2.py --help
Usage
AIMF Commands (aifbin_v1.py)
Windows:
python aifbin_v1.py migrate sample.md # Convert to AIMF (JSON)
python aifbin_v1.py info sample.aimf # View file info
python aifbin_v1.py chunks sample.aimf # List chunks
python aifbin_v1.py extract sample.aimf # Extract original content
Linux / macOS / WSL:
python3 aifbin_v1.py migrate sample.md # Convert to AIMF (JSON)
python3 aifbin_v1.py info sample.aimf # View file info
python3 aifbin_v1.py chunks sample.aimf # List chunks
python3 aifbin_v1.py extract sample.aimf # Extract original content
AIF-BIN Commands (aifbin_v2.py)
Windows:
python aifbin_v2.py migrate sample.md # Convert to AIF-BIN (binary)
python aifbin_v2.py info sample.aif-bin # View file info
python aifbin_v2.py chunks sample.aif-bin # List chunks
python aifbin_v2.py extract sample.aif-bin # Extract original content
python aifbin_v2.py upgrade sample.aimf # Upgrade v1 to v2
Linux / macOS / WSL:
python3 aifbin_v2.py migrate sample.md # Convert to AIF-BIN (binary)
python3 aifbin_v2.py info sample.aif-bin # View file info
python3 aifbin_v2.py chunks sample.aif-bin # List chunks
python3 aifbin_v2.py extract sample.aif-bin # Extract original content
python3 aifbin_v2.py upgrade sample.aimf # Upgrade v1 to v2
Troubleshooting
error: externally-managed-environment (Debian/Ubuntu/WSL)
This error occurs when pip tries to install packages system-wide in environments where Python packages are managed by the OS.
Solution 1: Use the --break-system-packages flag:
pip3 install -r requirements.txt --break-system-packages
Solution 2 (Recommended): Use a Python virtual environment:
python3 -m venv .venv
source .venv/bin/activate
pip install -r requirements.txt
python3 aifbin_v2.py --help
# Deactivate when done:
deactivate
python3 not found on Windows
On Windows, use python instead of python3:
python aifbin_v1.py --help
Migrating from AIMF to AIF-BIN
Why Migrate?
- 50% smaller files — Binary format is more compact
- Faster parsing — Fixed-offset headers enable direct seeks
- Checksums — CRC64 verification for data integrity
- Embeddings — AIF-BIN supports vector embeddings for semantic search
- Typed chunks — TEXT, TABLE, IMAGE, AUDIO, VIDEO, CODE
How to Migrate
Option 1: Using the CLI (Recommended)
# Windows
python aifbin_v2.py upgrade sample.aimf -o sample.aif-bin
# Linux / macOS / WSL
python3 aifbin_v2.py upgrade sample.aimf -o sample.aif-bin
Option 2: Programmatically
from aifbin_v2 import migrate_from_v1
migrate_from_v1('sample.aimf', 'sample.aif-bin')
See examples/migrate_v1_to_v2.py for a complete migration script.
Examples
| File | Description |
|---|---|
examples/quickstart_v1.py |
Basic v1 usage |
examples/quickstart_v2.py |
Basic v2 usage |
examples/migrate_v1_to_v2.py |
Migration script |
Related Projects
| Project | Description |
|---|---|
| AIF-BIN Lite | Free CLI (this repo) |
| AIF-BIN Pro | Pro CLI + Inspector |
Lite vs Pro
AIF-BIN Lite (this repo) handles the format — converting your documents into portable, structured files.
AIF-BIN Pro adds the intelligence — AI-powered semantic search that lets you query your documents by meaning, not just keywords.
┌─────────────────────────────────────────────────────────────┐
│ Your Documents │
│ (Markdown, notes, docs) │
└─────────────────────────────────────────────────────────────┘
│
▼
┌─────────────────────────────────────────────────────────────┐
│ AIF-BIN Lite (Free) │
│ │
│ ✓ Convert to .aimf (JSON) or .aif-bin (binary) │
│ ✓ Chunking and metadata extraction │
│ ✓ Portable files you own │
│ ✗ No search — just format conversion │
└─────────────────────────────────────────────────────────────┘
│
▼
┌─────────────────────────────────────────────────────────────┐
│ AIF-BIN Pro (Paid) │
│ │
│ ✓ Everything in Lite, plus: │
│ ✓ AI embeddings (text → vectors) │
│ ✓ Semantic search ("What did I decide about X?") │
│ ✓ Plugins (LangChain, Obsidian, VS Code, etc.) │
└─────────────────────────────────────────────────────────────┘
Why This Architecture?
- Your data stays portable. Lite files work anywhere, with or without Pro.
- No vendor lock-in. The format spec is open (MIT). Build your own tools if you want.
- Pay for intelligence, not storage. Lite is free forever. Pro adds the AI layer.
Ready to Upgrade?
AIF-BIN Pro includes:
- Semantic search — Find by meaning, not keywords
- Batch processing — Convert entire directories
- Watch mode — Auto-sync on file changes
- Web Inspector — Visual file analyzer
- 5 embedding models — OpenAI, Cohere, local options
Legal
| Document | Description |
|---|---|
| LICENSE | MIT License — free to use, modify, distribute |
| NOTICE | Patent, trademark, and Lite vs Pro details |
| TERMS | Terms of use |
| PRIVACY | Privacy policy (TL;DR: no data collection) |
| SECURITY | Security policy and vulnerability reporting |
Patent Pending: The AIF-BIN format and methods are subject to a pending patent application. This open-source implementation is provided under the MIT License.
Trademark: "AIF-BIN" is a trademark of Terronex.dev. You may use it to describe format compatibility.
Links
- Website: terronex.dev/aifbin
- Pro: github.com/Terronex-dev/aifbin-pro
- Support: support@terronex.dev
Contributing
Contributions welcome! See CONTRIBUTING.md.
(c) 2026 Terronex.dev. All rights reserved.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file aifbin_lite-1.0.0.tar.gz.
File metadata
- Download URL: aifbin_lite-1.0.0.tar.gz
- Upload date:
- Size: 13.6 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.12.3
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
9840b1cc6e9a25117e07915a711a37f2726b8aa2281a49ddbd2f250e6acf00c5
|
|
| MD5 |
ca9590fab609f517df25f6a54598759b
|
|
| BLAKE2b-256 |
2b565d37112fef00f533c4a6f2da85ed1e86ab012a003d5e3dae5e104e7bbbc8
|
File details
Details for the file aifbin_lite-1.0.0-py3-none-any.whl.
File metadata
- Download URL: aifbin_lite-1.0.0-py3-none-any.whl
- Upload date:
- Size: 15.6 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.12.3
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
3f90de2e5b6c753c6a9de9844d706f8667a79bb75120a5a89d02e5f8a2d2f1df
|
|
| MD5 |
a8907a5f59db845d23035534bfeb1d6b
|
|
| BLAKE2b-256 |
6b41c05b1829303d694dde9e8a19dd19ed9135c1a6c3bb89e5d93d8abbb138e8
|