inference-gateway 0.1.1

A Python SDK for Inference Gateway

Inference Gateway Python SDK

An SDK written in Python for the Inference Gateway.

• Inference Gateway Python SDK
  • Installation
  • Usage
    • Creating a Client
    • Listing Models
    • Generating Content
  • License

Installation

pip install inference-gateway-python-sdk

Usage

Creating a Client

if __name__ == "__main__":
    client = InferenceGatewayClient("http://localhost:8080")

    models = client.list_models()
    print("Available models:", models)

    response = client.generate_content("providerName", "modelName", "your prompt here")
    print("Generated content:", response["Response"]["Content"])

Listing Models

To list available models, use the list_models method:

models = client.list_models()
print("Available models:", models)

Generating Content

To generate content using a model, use the generate_content method:

response = client.generate_content("providerName", "modelName", "your prompt here")
print("Generated content:", response["Response"]["Content"])

License

This SDK is distributed under the MIT License, see LICENSE for more information.