Sinapsis vLLM
Sinapsis templates for text, batch, streaming, and multimodal generation with vLLM.
🐍 Installation • 🚀 Features • 📚 Usage example • 📙 Documentation • 🔍 License
The sinapsis-vllm package provides Sinapsis templates built on top of vLLM for high-throughput text generation, batch inference, streaming, and vision-language completion.
🐍 Installation
Install using your preferred package manager. We strongly recommend using uv.
Install the base package:
uv pip install sinapsis-vllm --extra-index-url https://pypi.sinapsis.tech
Or with raw pip:
pip install sinapsis-vllm --extra-index-url https://pypi.sinapsis.tech
🚀 Features
Templates Supported
- vLLMTextCompletion: Standard packet-native text generation with vLLM.
- vLLMBatchTextCompletion: Batched generation for multiple conversations in one execution pass.
- vLLMStreamingTextCompletion: Async streaming variant that yields partial packets during generation.
- vLLMMultiModal: Vision-language completion using image packets from
container.images.
🧩 Common Attributes
init_args(vLLMInitArgs, required): Engine configuration such asllm_model_name,tensor_parallel_size,dtype,quantization,trust_remote_code,max_model_len, and memory settings.completion_args(vLLMCompletionArgs, required): Request-time generation parameters such astemperature,top_p,top_k,min_p,max_tokens, penalties, and structured-output settings.cleanup_response(bool, optional): Whether to clean leaked transport or template markers from the final response.reasoning_start_tag/reasoning_end_tag(str | None, optional): Optional tags used to extract reasoning into the packetreasoningfield and keep the final answer inresponse.
📚 Usage example
The following agent runs one vLLM text-completion step from an LLMConversationPacket.
Config
agent:
name: my_test_agent
templates:
- template_name: InputTemplate
class_name: InputTemplate
attributes: {}
- template_name: LLMConversationInput
class_name: LLMConversationInput
template_input: InputTemplate
attributes:
prompt: "Give three short tips for staying organized during a busy week."
system_prompt: "You are a helpful assistant."
- template_name: vLLMTextCompletion
class_name: vLLMTextCompletion
template_input: LLMConversationInput
attributes:
init_args:
llm_model_name: "Qwen/Qwen3-1.7B"
max_model_len: 4096
dtype: auto
seed: 42
gpu_memory_utilization: 0.9
cpu_offload_gb: 0
max_num_seqs: 8
disable_log_stats: true
completion_args:
temperature: 0.7
top_p: 0.8
top_k: 20
min_p: 0
max_tokens: 2048
seed: 42
📙 Documentation
Documentation for this and other sinapsis packages is available on the sinapsis website
Tutorials for different projects within sinapsis are available at sinapsis tutorials page
🔍 License
This project is licensed under the AGPLv3 license, which encourages open collaboration and sharing. For more details, please refer to the LICENSE file.
For commercial use, please refer to our official Sinapsis website for information on obtaining a commercial license.
Metadata
Release files for sinapsis-vllm 0.2.1
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | Actions |
|---|---|---|---|---|
| sinapsis_vllm-0.2.1.tar.gz | 23.5 kB | Without provenance | Details for sinapsis_vllm-0.2.1.tar.gz |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Actions Reset |
|---|---|---|---|---|
| sinapsis_vllm-0.2.1-py3-none-any.whl | Python 3 | none | any | Details for sinapsis_vllm-0.2.1-py3-none-any.whl |
Total release size: 48.5 kB
Release files / sinapsis_vllm-0.2.1.tar.gz
| Download URL | sinapsis_vllm-0.2.1.tar.gz |
|---|---|
| Size | 23.5 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
7036ae484e8d1a0080627c9e33c9fe62eb6499185a2b54436e2486bc492b884f
|
|
BLAKE2b-256 checksum How to use checksums |
3ed8632c2d985cccc9ee5e0e50658c25caa269b421cd566217bdd7441acd3dd3
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.5.16
|
Release files / sinapsis_vllm-0.2.1-py3-none-any.whl
| Download URL | sinapsis_vllm-0.2.1-py3-none-any.whl |
|---|---|
| Size | 25.0 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
a99906d815a18bbf0ac1d4decb1ed35d9d3d082432aed7a5ab669c3c3723ae05
|
|
BLAKE2b-256 checksum How to use checksums |
e952ad842b5dd945912db22fffec79c696b8aa338d92d08a26dde9d34364b1c1
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.5.16
|
Security for sinapsis-vllm 0.2.1
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.