A collection of commonly used code
Project description
Overview
This is a package of LLMs inference, including
- Engine (vllm) and no engine;
- Local or Remote
- API or Reading file
Tool list
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
llm_inferencer-0.0.11.tar.gz
(9.2 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file llm_inferencer-0.0.11.tar.gz.
File metadata
- Download URL: llm_inferencer-0.0.11.tar.gz
- Upload date:
- Size: 9.2 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.1.1 CPython/3.9.18
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
7efa11f80e9f855653689daa7d8818787b59c0dc6d1ed08271c0284787c4215b
|
|
| MD5 |
7c6281de8d93c11d36c9236dbdf225c0
|
|
| BLAKE2b-256 |
c4aea29b67f3aa6aee7fafa5735da33997ce2eed50290297ddad7d91de147846
|
File details
Details for the file llm_inferencer-0.0.11-py3-none-any.whl.
File metadata
- Download URL: llm_inferencer-0.0.11-py3-none-any.whl
- Upload date:
- Size: 11.3 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.1.1 CPython/3.9.18
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
40c098e0331d23d6642dbeb52119c68298b8230e77c5828b20a38ce4db15beb1
|
|
| MD5 |
b27b7fce6cd0c33df962052fecdb9331
|
|
| BLAKE2b-256 |
9ad2d959bf1a758c0b2804e59cdda49b5e550daeca8b3c3522ec802d382f284f
|
