Termux-LlamaCpp

디바이스 리소스를 활용한 Android Termux ARM64 전용 GGUF LLM 런타임, 모델 매니저 및 OpenAI 호환 REST/SSE 서버
Production-Grade GGUF LLM Runtime Utilizing Device Resources, Model Manager & OpenAI Server for Android ARM64

📌 Architecture & Overview

검증된 Android Bionic ARM64 네이티브 바이너리와 필수 공유 라이브러리, 디바이스 리소스 최적화 연동을 통해 제로 컴파일 로컬 실행과 안정적인 OpenAI 호환 REST/SSE 스트리밍 서버를 제공합니다.

Ships verified Android ARM64 native binaries with bundled shared libraries and device resource optimization, enabling instant zero-compilation local inference and a robust OpenAI-compatible REST/SSE server.

🚀 Installation & Quickstart

Python (PyPI)

pip install termux-llamacpp

from termux_llamacpp import LlamaRuntime, RuntimeConfig

# 1. Initialize Runtime with Vulkan GPU Acceleration
config = RuntimeConfig(
    model_path="models/Llama-3.2-1B-Instruct-Q4_K_M.gguf",
    device="auto",
    threads=4,
    context_size=2048
)
runtime = LlamaRuntime(config)

# 2. Synchronous or Streaming Text Generation
output = runtime.generate("한국의 사계절 중 가을의 매력에 대해 설명해줘.", max_tokens=256)
print(output.text)
print(f"Speed: {output.metrics.eval_tokens_per_sec:.2f} t/s (Prompt: {output.metrics.prompt_tokens_per_sec:.2f} t/s)")

Node.js / TypeScript (npm)

npm install termux-llamacpp

import { LlamaRuntime } from "termux-llamacpp";

// 1. Initialize ESM Runtime
const runtime = new LlamaRuntime({
  modelPath: "models/Llama-3.2-1B-Instruct-Q4_K_M.gguf",
  device: "auto",
  threads: 4
});

// 2. Generate Completion
const result = await runtime.generate({
  prompt: "Explain the architectural philosophy of edge computing.",
  maxTokens: 256
});
console.log("Response:", result.text);
console.log(`Generation Speed: ${result.metrics.evalTokensPerSec} t/s`);

📖 Official Documentation & Benchmarks

📄 License

Metadata

Release files for termux-llamacpp 1.2.2

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for termux-llamacpp 1.2.2
File	Size	Uploaded
termux_llamacpp-1.2.2.tar.gz	264.3 kB	Sep 4, 2026	Details

Built distribution (wheel)

Table of built distributions (wheels) for termux-llamacpp 1.2.2
File	Interpreter	ABI	Platform	Reset
termux_llamacpp-1.2.2-py3-none-any.whl 167.8 kB Sep 4, 2026	Python 3	none	any	Details

Total release size: 432.1 kB

Release files / termux_llamacpp-1.2.2.tar.gz

Download URL	termux_llamacpp-1.2.2.tar.gz
Size	264.3 kB
Tags	Source
SHA-256 checksum How to use checksums	`151e5209cbb1677e306c67b5b2180068efd28c8a4b8188ec52b61f04e736014f`
BLAKE2b-256 checksum How to use checksums	`d408cb2c687d182b2a2ba7683fbddaeb1f5e11d92c98fb1491be9a223bbe5599`
Upload date	Sep 4, 2026
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/7.0.0 CPython/3.12.0`

Release files / termux_llamacpp-1.2.2-py3-none-any.whl

Download URL	termux_llamacpp-1.2.2-py3-none-any.whl
Size	167.8 kB
Tags	Python 3
SHA-256 checksum How to use checksums	`b21f5dfcdb606acfda210ee31f32e0ef6e83520719749636d44242cb0d5a2f81`
BLAKE2b-256 checksum How to use checksums	`0390feaf7a2c9c79653b91501363fe28e3b3f912d25f77192e4fd4e121bebb28`
Upload date	Sep 4, 2026
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/7.0.0 CPython/3.12.0`