llm-taxi

Installation

pip install llm-taxi

Usage

Use as a library

import asyncio

from llm_taxi.conversation import Message, Role
from llm_taxi.factory import embedding, llm


async def main():
    # Non-streaming response
    client = llm(model="openai:gpt-3.5-turbo")
    messages = [
        Message(role=Role.User, content="What is the capital of France?"),
    ]

    response = await client.response(messages)
    print(response)

    # Streaming response
    client = llm(model="mistral:mistral-small")
    messages = [
        Message(role=Role.User, content="Tell me a joke."),
    ]
    response = await client.streaming_response(messages)
    async for chunk in response:
        print(chunk, end="", flush=True)
    print()

    # Embed text
    embedder = embedding("openai:text-embedding-ada-002")
    embeddings = await embedder.embed_text("Hello, world!")
    print(embeddings[:10])

    # Embed texts
    embedder = embedding("mistral:mistral-embed")
    embeddings = await embedder.embed_texts(["Hello, world!"])
    print(embeddings[0][:10])



if __name__ == "__main__":
    asyncio.run(main())

Common parameters

temperature
max_tokens
top_k
top_p
stop
seed
presence_penalty
frequency_penalty
response_format
tools
tool_choice

Command line interface

llm-taxi --model openai:gpt-3.5-turbo-16k

See all supported arguments

llm-taxi --help

Supported Providers

Provider	LLM	Embedding
Anthropic	✅
DashScope	✅
DeepInfra	✅
DeepSeek	✅
Google	✅	✅
Groq	✅
Mistral	✅	✅
OpenAI	✅	✅
OpenRouter	✅
Perplexity	✅
Together	✅
BigModel	✅

Metadata

Release files for llm-taxi 0.7.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for llm-taxi 0.7.0
File	Size	Uploaded	Provenance
llm_taxi-0.7.0.tar.gz	1.1 MB	Oct 23, 2024	Without provenance	Details

Built distribution (wheel)

Table of built distributions (wheels) for llm-taxi 0.7.0
File	Interpreter	ABI	Platform	Reset
llm_taxi-0.7.0-py3-none-any.whl 24.9 kB Oct 23, 2024 Without provenance	Python 3	none	any	Details

Total release size: 1.1 MB

Release files / llm_taxi-0.7.0.tar.gz

Download URL	llm_taxi-0.7.0.tar.gz
Size	1.1 MB
Tags	Source
SHA-256 checksum How to use checksums	`3e4b5ae7600e75001df93e4fe2f6119ab49f4b354f08e126d7c2b752dce3ac4d`
BLAKE2b-256 checksum How to use checksums	`49210f1fc7b925b835f47f28ac571e58f69483a22c50c75cc235f171a1b013c3`
Upload date	Oct 23, 2024
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/5.1.1 CPython/3.12.6`

Release files / llm_taxi-0.7.0-py3-none-any.whl

Download URL	llm_taxi-0.7.0-py3-none-any.whl
Size	24.9 kB
Tags	Python 3
SHA-256 checksum How to use checksums	`e9cd5fc10dc02cef7328b2e39af21e08b6c7cd50da622499be985398d00e9b1d`
BLAKE2b-256 checksum How to use checksums	`eaadc797860d3cc82135019bd7d7cd9b62e53a40fc4ee44d9ed0a20f4cb4502a`
Upload date	Oct 23, 2024
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/5.1.1 CPython/3.12.6`

Security for llm-taxi 0.7.0

Report project as malware

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.