Skip to main content

A collection of commonly used code

Project description

Overview

This is a package of LLMs inference, including

  • Engine (vllm) and no engine;
  • Local or Remote
  • API or Reading file

Tool list

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

llm_inferencer-0.0.20.tar.gz (11.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

llm_inferencer-0.0.20-py3-none-any.whl (17.4 kB view details)

Uploaded Python 3

File details

Details for the file llm_inferencer-0.0.20.tar.gz.

File metadata

  • Download URL: llm_inferencer-0.0.20.tar.gz
  • Upload date:
  • Size: 11.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.9.18

File hashes

Hashes for llm_inferencer-0.0.20.tar.gz
Algorithm Hash digest
SHA256 205e2ecb17c5f851b1419de7d4db203cfe3eb7ef829c3f56a0c1483ae54a7f48
MD5 fc116b1a61bcdb7434ccd233e1ac323c
BLAKE2b-256 2642bd877e8b12f969b50b7dd0f8ff71514e928cb3a3de77dcad6577b992a05d

See more details on using hashes here.

File details

Details for the file llm_inferencer-0.0.20-py3-none-any.whl.

File metadata

File hashes

Hashes for llm_inferencer-0.0.20-py3-none-any.whl
Algorithm Hash digest
SHA256 99945b557717da1341a92d7e80585b72b91509685a741564cb2d32118cd143e1
MD5 b26c340060fa125e78bafb63d34b5a58
BLAKE2b-256 563d5a0c1699cfb1f570f24e34881f764061e60b72452a438348324c88b2df01

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page