LLM Inference, 开箱即用的本地 LLM 推理 SDK

安装

pip

pip install git+https://gitlab.changdu.ltd/060270/llm_inference.git@main

uv add git+https://gitlab.changdu.ltd/060270/llm_inference.git@main

from vllm_inference.translation.seed_x import translate

translation = translate('你好, 我叫吴子豪!', 'fr', max_tokens=2048, temperature=.0, top_p=.01)

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution for vllm-inference 0.0.19
File	Size	Uploaded
vllm_inference-0.0.19.tar.gz	3.1 kB	Aug 21, 2025	Details

Table of built distributions (wheels) for vllm-inference 0.0.19
File	Interpreter	ABI	Platform	Reset
vllm_inference-0.0.19-py3-none-any.whl 4.0 kB Aug 21, 2025	Python 3	none	any	Details

Total release size: 7.1 kB

Download URL	vllm_inference-0.0.19.tar.gz
Size	3.1 kB
Tags	Source
SHA-256 checksum How to use checksums	`8541a678ec672f9b4ca1fafd272519b10c5f879a108916276e63ca01f0a4b577`
BLAKE2b-256 checksum How to use checksums	`f11048ff9cd17cfac56a855a1c049af7863eabd09b95732288aa0a0613516cb0`
Upload date	Aug 21, 2025
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`uv/0.6.14`

Download URL	vllm_inference-0.0.19-py3-none-any.whl
Size	4.0 kB
Tags	Python 3
SHA-256 checksum How to use checksums	`8153c764c9a5d9df094d9f75f39b94224ed51585cd7abe26c81715dea7473505`
BLAKE2b-256 checksum How to use checksums	`c69ad64b778947bc79d48b4c966ec998eb200738f650331f8fe468fc0e6c311b`
Upload date	Aug 21, 2025
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`uv/0.6.14`