irouter 0.1.0

Easy access to 100s of LLMs with a few lines of code (using Openrouter).

irouter

Access 100s of LLMs with 2 lines of code.

Installation

1. Install irouter from PyPI:

pip install irouter

2. Create an account on OpenRouter and generate an API key.

3a. (recommended!) Set the OpenRouter API key as an environment variable:

export OPENROUTER_API_KEY=your_api_key

In this way you can use irouter objects like Call and Chat without have to pass an API key.

from irouter import Call
c = Call(model="moonshotai/kimi-k2:free")

3b. Alternatively, pass api_key to irouter objects like Call and Chat.

from irouter import Call
c = Call(model="moonshotai/kimi-k2:free", api_key="your_api_key")

Usage

Call

Call is the simplest interface to call one or more LLMs.

Single LLM

from irouter import Call
c = Call(model="moonshotai/kimi-k2:free")
c("Who are you?")
# "I'm Kimi, your AI friend from Moonshot AI. I'm here to chat, answer your questions, and help you out whenever you need it."

Multiple LLMs

from irouter import Call
c = Call(model=["moonshotai/kimi-k2:free", "google/gemini-2.0-flash-exp:free"])
c("Who are you?")
# {'moonshotai/kimi-k2:free': "I'm Kimi, your AI friend from Moonshot AI. I'm here to chat, answer your questions, and help you out whenever you need it.",
#  'google/gemini-2.0-flash-exp:free': 'I am a large language model, trained by Google.\n'}

For more information on Call, check out the call.ipynb notebook in the nbs folder.

If you would like to track message history and token usage, use Chat.

Chat

Chat is an easy way to interface with one or more LLMs, while tracking message history and token usage.

Single LLM

from irouter import Chat
c = Chat(model="moonshotai/kimi-k2:free")
c("Who are you?")
print(c.history) # {'moonshotai/kimi-k2:free': [...]}
print(c.usage) # {'moonshotai/kimi-k2:free': {'prompt_tokens': 8, 'completion_tokens': 8, 'total_tokens': 16}}

Multiple LLMs

from irouter import Chat
c = Chat(model=["moonshotai/kimi-k2:free", "google/gemini-2.0-flash-exp:free"])
c("Who are you?")
print(c.history) # {'moonshotai/kimi-k2:free': [...], 'google/gemini-2.0-flash-exp:free': [...]}
print(c.usage) # {'moonshotai/kimi-k2:free': {'prompt_tokens': 8, 'completion_tokens': 8, 'total_tokens': 16}, 'google/gemini-2.0-flash-exp:free': {'prompt_tokens': 8, 'completion_tokens': 10, 'total_tokens': 18}}

For more information on Chat, check out the chat.ipynb notebook in the nbs folder.

Misc

get_all_models

You can easily get all 300+ models available with irouter using get_all_models.

from irouter.base import get_all_models
get_all_models()
# ['llm_provider1/model1', ... 'llm_providerx/modelx']

Credits

This project is built on top of the OpenRouter API infrastructure, which provides access to LLMs through a unified interface.

This project is inspired by Answer.AI's projects like cosette and claudette.

irouter generalizes this idea to support 100s of LLMs, which includes OpenAI and Anthropic models and more, thanks to OpenRouter's infrastructure.