Termux-LlamaCpp
디바이스 리소스를 활용한 Android Termux ARM64 전용 GGUF LLM 런타임, 모델 매니저 및 OpenAI 호환 REST/SSE 서버
Production-Grade GGUF LLM Runtime Utilizing Device Resources, Model Manager & OpenAI Server for Android ARM64
Architecture & Overview
검증된 Android Bionic ARM64 네이티브 바이너리와 필수 공유 라이브러리, 디바이스 리소스 최적화 연동을 통해 제로 컴파일 로컬 실행과 안정적인 OpenAI 호환 REST/SSE 스트리밍 서버를 제공합니다.
Ships verified Android ARM64 native binaries with bundled shared libraries and device resource optimization, enabling instant zero-compilation local inference and a robust OpenAI-compatible REST/SSE server.
Installation & Quickstart
Python (PyPI)
pip install termux-llamacpp
from termux_llamacpp import LlamaRuntime, RuntimeConfig
# 1. Initialize Runtime with Vulkan GPU Acceleration
config = RuntimeConfig(
model_path="models/Llama-3.2-1B-Instruct-Q4_K_M.gguf",
device="auto",
threads=4,
context_size=2048
)
runtime = LlamaRuntime(config)
# 2. Synchronous or Streaming Text Generation
output = runtime.generate("한국의 사계절 중 가을의 매력에 대해 설명해줘.", max_tokens=256)
print(output.text)
print(f"Speed: {output.metrics.eval_tokens_per_sec:.2f} t/s (Prompt: {output.metrics.prompt_tokens_per_sec:.2f} t/s)")
Node.js / TypeScript (npm)
npm install termux-llamacpp
import { LlamaRuntime } from "termux-llamacpp";
// 1. Initialize ESM Runtime
const runtime = new LlamaRuntime({
modelPath: "models/Llama-3.2-1B-Instruct-Q4_K_M.gguf",
device: "auto",
threads: 4
});
// 2. Generate Completion
const result = await runtime.generate({
prompt: "Explain the architectural philosophy of edge computing.",
maxTokens: 256
});
console.log("Response:", result.text);
console.log(`Generation Speed: ${result.metrics.evalTokensPerSec} t/s`);
Official Documentation & Benchmarks
- Official Architecture & API Reference
- Ecosystem Metrics & Registry Stats
- AMEVA Open-Source Foundation Portal
License
Licensed under the Apache-2.0 License. Copyright (c) 2026 Eunho Kim (@uno-km).
1 maintainer
Metadata
1 maintainer
Release files for termux-llamacpp 1.3.11
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| termux_llamacpp-1.3.11.tar.gz | 281.6 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| termux_llamacpp-1.3.11-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 462.2 kB
Release files / termux_llamacpp-1.3.11.tar.gz
| Download URL | termux_llamacpp-1.3.11.tar.gz |
|---|---|
| Size | 281.6 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
50bdfc3b116c167f6a45c6e43ae214d8d3d8aba4f727837c071eec3a73625861
|
|
BLAKE2b-256 checksum How to use checksums |
262c0ff70ad469cc00962495fc5278a5d9eb0b2b6c6460b1f548d278eea2ffa1
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.12.0
|
Release files / termux_llamacpp-1.3.11-py3-none-any.whl
| Download URL | termux_llamacpp-1.3.11-py3-none-any.whl |
|---|---|
| Size | 180.7 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
4b1e29b0b2b812376fc32bb6d747483341427eb2dd2f742d2697434fbff284e0
|
|
BLAKE2b-256 checksum How to use checksums |
4093a9e483f269677fe9900642d20ebba74e113831e20b915072288cd29160d6
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.12.0
|
