LlamaIndex Llms Integration: Huggingface API
Integration with Hugging Face's Inference API for generating text.
For more information on Hugging Face's Inference API, visit Hugging Face's Inference API documentation.
Installation
pip install llama-index-llms-huggingface-api
Usage
from llama_index.llms.huggingface_api import HuggingFaceInferenceAPI
llm = HuggingFaceInferenceAPI(
model_name="openai-community/gpt2",
temperature=0.7,
max_tokens=100,
token="<your-token>", # Optional
provider="hf-inference", # Optional
)
response = llm.complete("Hello, how are you?")
1 maintainer
Metadata
1 maintainer
Release files for llama-index-llms-huggingface-api 0.8.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| llama_index_llms_huggingface_api-0.8.0.tar.gz | 7.7 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| llama_index_llms_huggingface_api-0.8.0-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 15.2 kB
Release files / llama_index_llms_huggingface_api-0.8.0.tar.gz
| Download URL | llama_index_llms_huggingface_api-0.8.0.tar.gz |
|---|---|
| Size | 7.7 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
3726caaf4fe3dd688b5f9fd64e504fdd9b3b76f3b15e5565385c6459068b259b
|
|
BLAKE2b-256 checksum How to use checksums |
1fc6b70e80dfb3bf24939ec1d44289196538e22b5acb520bdf8b4034b8946020
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.12.7 {"installer":{"name":"uv","version":"0.12.7","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / llama_index_llms_huggingface_api-0.8.0-py3-none-any.whl
| Download URL | llama_index_llms_huggingface_api-0.8.0-py3-none-any.whl |
|---|---|
| Size | 7.5 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
92cb03f58b94717f2ae5079d903fe00c4b3c1278cf049be303061bd79432271b
|
|
BLAKE2b-256 checksum How to use checksums |
72fa25dead919656782307a50c96d7871319d3cbca5f9a336df2e49fb71fde2b
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.12.7 {"installer":{"name":"uv","version":"0.12.7","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
