LlamaIndex Llms Integration: Huggingface API

Integration with Hugging Face's Inference API for generating text.

For more information on Hugging Face's Inference API, visit Hugging Face's Inference API documentation.

Installation

pip install llama-index-llms-huggingface-api

Usage

from llama_index.llms.huggingface_api import HuggingFaceInferenceAPI

llm = HuggingFaceInferenceAPI(
    model_name="openai-community/gpt2",
    temperature=0.7,
    max_tokens=100,
    token="<your-token>",  # Optional
)

response = llm.complete("Hello, how are you?")

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

llama_index_llms_huggingface_api-0.3.1.tar.gz (4.4 kB view details)

Uploaded Jan 6, 2025 Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

The dropdown lists show the available interpreters, ABIs, and platforms. Enable javascript to be able to filter the list of wheel files.

llama_index_llms_huggingface_api-0.3.1-py3-none-any.whl (4.8 kB view details)

Uploaded Jan 6, 2025 Python 3

File details

Details for the file llama_index_llms_huggingface_api-0.3.1.tar.gz.

File metadata

Download URL: llama_index_llms_huggingface_api-0.3.1.tar.gz
Upload date: Jan 6, 2025
Size: 4.4 kB
Tags: Source
Uploaded using Trusted Publishing? No
Uploaded via: poetry/1.8.3 CPython/3.12.3 Linux/6.8.0-1017-azure

File hashes

Hashes for llama_index_llms_huggingface_api-0.3.1.tar.gz
Algorithm	Hash digest
SHA256	`6531c8fe5405574ae997f5066085a8830cb60299cb5b93a8cf6e84f7d3e1c9fc`
MD5	`e7435274111896742e564d0594019373`
BLAKE2b-256	`35333edf8d33eb2a72f254d4aee81ec55c296245085faef1dcb37e6c2673ea2c`

See more details on using hashes here.

File details

Details for the file llama_index_llms_huggingface_api-0.3.1-py3-none-any.whl.

File metadata

Download URL: llama_index_llms_huggingface_api-0.3.1-py3-none-any.whl
Upload date: Jan 6, 2025
Size: 4.8 kB
Tags: Python 3
Uploaded using Trusted Publishing? No
Uploaded via: poetry/1.8.3 CPython/3.12.3 Linux/6.8.0-1017-azure

File hashes

Hashes for llama_index_llms_huggingface_api-0.3.1-py3-none-any.whl
Algorithm	Hash digest
SHA256	`6528900a4d59d594e489f58f34c3356b447b4d4ad58820d192ab5b9e951d5398`
MD5	`34d4787deb30e5a7248b841674bcdb06`
BLAKE2b-256	`0549c826ace3fd2241ce5ab7f5ee22c420bc948915410ecaf6013644460d19c8`