Inference locally.
Project description
LLM Inference, 开箱即用的本地 LLM 推理 SDK
安装
-
pip
pip install git+https://gitlab.changdu.ltd/060270/llm_inference.git@main -
uv
uv add git+https://gitlab.changdu.ltd/060270/llm_inference.git@main
主要功能
-
Seed-X 机器翻译
from vllm_inference.translation.seed_x import translate
translation = translate('你好, 我叫吴子豪!', 'fr', max_tokens=2048, temperature=.0, top_p=.01)
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
vllm_inference-0.0.15.tar.gz
(3.0 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file vllm_inference-0.0.15.tar.gz.
File metadata
- Download URL: vllm_inference-0.0.15.tar.gz
- Upload date:
- Size: 3.0 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: uv/0.6.14
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
c0aa7e2d267b124bfd1f0882d01da51e593ee439d068516c86dd4a288eb87934
|
|
| MD5 |
ff69c754d0f9ed57abb73a0368bdee26
|
|
| BLAKE2b-256 |
682e347466a0796f2333ba49c2f2b56049552589ce5f3c3b96c0f36524d195c4
|
File details
Details for the file vllm_inference-0.0.15-py3-none-any.whl.
File metadata
- Download URL: vllm_inference-0.0.15-py3-none-any.whl
- Upload date:
- Size: 3.7 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: uv/0.6.14
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
2f27f689493975e875c35fd1b2de2b3a61ae05698d769c09341fbc8bc2fbb6a0
|
|
| MD5 |
a2bc927f64ffa6ea75cc4626022967b3
|
|
| BLAKE2b-256 |
b0b9dfebf754eb0d0cea8fa11e8d49f95459d9f2e7bc5da57e9fabc3bbc61dee
|
