Termux-LlamaCpp

디바이스 리소스를 활용한 Android Termux ARM64 전용 GGUF LLM 런타임, 모델 매니저 및 OpenAI 호환 REST/SSE 서버
Production-Grade GGUF LLM Runtime Utilizing Device Resources, Model Manager & OpenAI Server for Android ARM64

📌 Architecture & Overview

검증된 Android Bionic ARM64 네이티브 바이너리와 필수 공유 라이브러리, 디바이스 리소스 최적화 연동을 통해 제로 컴파일 로컬 실행과 안정적인 OpenAI 호환 REST/SSE 스트리밍 서버를 제공합니다.

Ships verified Android ARM64 native binaries with bundled shared libraries and device resource optimization, enabling instant zero-compilation local inference and a robust OpenAI-compatible REST/SSE server.

🚀 Installation & Quickstart

Python (PyPI)

pip install termux-llamacpp

from termux_llamacpp import LlamaRuntime, RuntimeConfig

# 1. Initialize Runtime with Vulkan GPU Acceleration
config = RuntimeConfig(
    model_path="models/Llama-3.2-1B-Instruct-Q4_K_M.gguf",
    device="auto",
    threads=4,
    context_size=2048
)
runtime = LlamaRuntime(config)

# 2. Synchronous or Streaming Text Generation
output = runtime.generate("한국의 사계절 중 가을의 매력에 대해 설명해줘.", max_tokens=256)
print(output.text)
print(f"Speed: {output.metrics.eval_tokens_per_sec:.2f} t/s (Prompt: {output.metrics.prompt_tokens_per_sec:.2f} t/s)")

Node.js / TypeScript (npm)

npm install termux-llamacpp

import { LlamaRuntime } from "termux-llamacpp";

// 1. Initialize ESM Runtime
const runtime = new LlamaRuntime({
  modelPath: "models/Llama-3.2-1B-Instruct-Q4_K_M.gguf",
  device: "auto",
  threads: 4
});

// 2. Generate Completion
const result = await runtime.generate({
  prompt: "Explain the architectural philosophy of edge computing.",
  maxTokens: 256
});
console.log("Response:", result.text);
console.log(`Generation Speed: ${result.metrics.evalTokensPerSec} t/s`);

📖 Official Documentation & Benchmarks

📄 License

Metadata

Release files for termux-llamacpp 1.2.4

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for termux-llamacpp 1.2.4
File	Size	Uploaded
termux_llamacpp-1.2.4.tar.gz	271.5 kB	Sep 5, 2026	Details

Built distribution (wheel)

Table of built distributions (wheels) for termux-llamacpp 1.2.4
File	Interpreter	ABI	Platform	Reset
termux_llamacpp-1.2.4-py3-none-any.whl 172.1 kB Sep 5, 2026	Python 3	none	any	Details

Total release size: 443.6 kB

Release files / termux_llamacpp-1.2.4.tar.gz

Download URL	termux_llamacpp-1.2.4.tar.gz
Size	271.5 kB
Tags	Source
SHA-256 checksum How to use checksums	`40407c355e5655aec5734cb51ec6f6d218de39ea5451884931404ac7522f684e`
BLAKE2b-256 checksum How to use checksums	`638150acd29d3572c2710faca91aa951530a616ccd8a82db3f5aa5baf6bd080d`
Upload date	Sep 5, 2026
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/7.0.0 CPython/3.12.0`

Release files / termux_llamacpp-1.2.4-py3-none-any.whl

Download URL	termux_llamacpp-1.2.4-py3-none-any.whl
Size	172.1 kB
Tags	Python 3
SHA-256 checksum How to use checksums	`ff55afc9a34e2fc486e960e9bfab4e27e044fb75135c08236cab495846e262a0`
BLAKE2b-256 checksum How to use checksums	`eb3f46cd3e34aa4b3bd76e1d5fc93e2fe39f570b5f1370a185b54458f1f3cde9`
Upload date	Sep 5, 2026
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/7.0.0 CPython/3.12.0`