NOMTP — Network-Oriented Media Transfer Protocol

NOMTP is a modern, high-throughput, resilient application-layer binary protocol specifically engineered for file, media, object, and streaming data transfer over secure TCP+TLS and QUIC transports.

Key Features

• Binary Wire Protocol: Fixed 32-byte header with zero JSON overhead, CRC16 header verification, and Big-Endian encoding.
• Native Resumability: Sparse transfer maps, chunk bitmaps, and disk journals enabling resume after network loss or server restart.
• Hierarchical Integrity Trees: Merkle tree hashing (CRC32C / SHA-256 / BLAKE3) for incremental and whole-file validation.
• Parallel Chunk Transfer: Multiplexed concurrent chunk streams over single or pooled connections.
• Content Addressing & Deduplication: Cryptographic content digests preventing duplicate payload retransmission.
• Adaptive Chunking & Compression: Dynamic chunk sizing with zstd/gzip auto-detection and smart media bypass.
• Storage Abstraction: Seamless integration with Local Filesystem, In-Memory, and Object Storage (S3 / R2 / MinIO).
• Security & Multi-Tenancy: TLS 1.3, token authentication, permission masks, token-bucket rate limiting, and quotas.

Installation

pip install nomtp

Quick Start

Start Server

nomtp server ./storage --port 9000 --token secret123

Upload a File

nomtp upload video.mp4 --host localhost --port 9000 --token secret123 --parallel 4

Download a File

nomtp download video.mp4 ./downloaded.mp4 --host localhost --port 9000 --token secret123

Python API

import asyncio
from nomtp import Client

async def main():
    async with Client(host="localhost", port=9000, auth_token="secret123") as client:
        # Upload with automatic chunking and resume support
        result = await client.upload(
            local_path="movie.mkv",
            remote_path="videos/movie.mkv",
            parallel=4,
            resume=True
        )
        print(f"Uploaded {result.bytes_transferred} bytes (Transfer ID: {result.transfer_id})")

        # Download
        await client.download(
            remote_path="videos/movie.mkv",
            local_path="downloaded_movie.mkv",
            parallel=4,
            resume=True
        )

if __name__ == "__main__":
    asyncio.run(main())

Documentation

Comprehensive documentation, architecture guides, and protocol specifications are available at: https://nomtp.abdullah.dpdns.org

License

NOMTP is licensed under the Apache-2.0 License.