AMV-LlamaCpp
마이그레이션 안내: 이 패키지는
termux-llamacpp에서amv-llamacpp로 이름이 바뀌었습니다. 기존termux-llamacpp배포본(PyPI/npm)은 호환을 위해 당분간 유지되나 deprecated 상태이며 더 이상 갱신되지 않습니다.pip install amv-llamacpp/npm install amv-llamacpp로 전환하십시오.Android Termux 환경 또는 안드로이드 Linux 커널(루팅 없이 Linux 환경이 구동되는 모든 디바이스) 에서 동작합니다 — Termux 전용이 아닙니다.
디바이스 리소스를 활용한 Android Termux ARM64 전용 GGUF LLM 런타임, 모델 매니저 및 OpenAI 호환 REST/SSE 서버
Production-Grade GGUF LLM Runtime Utilizing Device Resources, Model Manager & OpenAI Server for Android ARM64
Architecture & Overview
검증된 Android Bionic ARM64 네이티브 바이너리와 필수 공유 라이브러리, 디바이스 리소스 최적화 연동을 통해 제로 컴파일 로컬 실행과 안정적인 OpenAI 호환 REST/SSE 스트리밍 서버를 제공합니다.
Ships verified Android ARM64 native binaries with bundled shared libraries and device resource optimization, enabling instant zero-compilation local inference and a robust OpenAI-compatible REST/SSE server.
Installation & Quickstart
Python (PyPI)
pip install amv-llamacpp
from termux_llamacpp import LlamaRuntime, RuntimeConfig
# 1. Initialize Runtime with Vulkan GPU Acceleration
config = RuntimeConfig(
model_path="models/Llama-3.2-1B-Instruct-Q4_K_M.gguf",
device="auto",
threads=4,
context_size=2048
)
runtime = LlamaRuntime(config)
# 2. Synchronous or Streaming Text Generation
output = runtime.generate("한국의 사계절 중 가을의 매력에 대해 설명해줘.", max_tokens=256)
print(output.text)
print(f"Speed: {output.metrics.eval_tokens_per_sec:.2f} t/s (Prompt: {output.metrics.prompt_tokens_per_sec:.2f} t/s)")
Node.js / TypeScript (npm)
npm install amv-llamacpp
import { LlamaRuntime } from "amv-llamacpp";
// 1. Initialize ESM Runtime
const runtime = new LlamaRuntime({
modelPath: "models/Llama-3.2-1B-Instruct-Q4_K_M.gguf",
device: "auto",
threads: 4
});
// 2. Generate Completion
const result = await runtime.generate({
prompt: "Explain the architectural philosophy of edge computing.",
maxTokens: 256
});
console.log("Response:", result.text);
console.log(`Generation Speed: ${result.metrics.evalTokensPerSec} t/s`);
Official Documentation & Benchmarks
- Official Architecture & API Reference
- Ecosystem Metrics & Registry Stats
- AMEVA Open-Source Foundation Portal
License
Licensed under the Apache-2.0 License. Copyright (c) 2026 Eunho Kim (@uno-km).
1 maintainer
Metadata
1 maintainer
Release files for amv-llamacpp 1.5.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | |
|---|---|---|---|---|
| amv_llamacpp-1.5.0.tar.gz | 185.9 kB | Without provenance | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| amv_llamacpp-1.5.0-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 265.3 kB
Release files / amv_llamacpp-1.5.0.tar.gz
| Download URL | amv_llamacpp-1.5.0.tar.gz |
|---|---|
| Size | 185.9 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
0e2c8140dd51fd17e657df3267007ea971aee884f749a5518c48456176b6204c
|
|
BLAKE2b-256 checksum How to use checksums |
ef9d4fce0845722aa7c61a2eba7bbc3c3a02ec3aeb419cb4315bda56d628bf33
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.11.17
|
Release files / amv_llamacpp-1.5.0-py3-none-any.whl
| Download URL | amv_llamacpp-1.5.0-py3-none-any.whl |
|---|---|
| Size | 79.4 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
fe1c765bce08ca763a0c9839e27d37bf3df5620bacf3a5d4885989ccfed2133f
|
|
BLAKE2b-256 checksum How to use checksums |
0264556a5dfe066cb1b41da654b4b6c28a44691b15846098822b8d8ca53b649f
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.11.17
|
Security for amv-llamacpp 1.5.0
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.
