OpenInference Together AI Instrumentation

pypi

Python auto-instrumentation library for the Together AI Python client.

Chat completion calls made with the together client (Together and AsyncTogether) are traced and exported as OpenInference LLM spans, capturing the input messages, output messages, invocation parameters, tool calls, streaming output, and token counts.

These traces are fully OpenTelemetry compatible and can be sent to an OpenTelemetry collector for viewing, such as Arize Phoenix or Arize AX.

Supported Features

  • Synchronous and asynchronous chat completions (Together and AsyncTogether)
  • Streaming (stream=True): the span stays open until the stream is consumed, and the accumulated output, tool calls, and token counts are recorded from the streamed chunks
  • Tool calls, captured on both requests and responses
  • Suppressing tracing via suppress_tracing()
  • Context attribute propagation (using_session, using_user, using_attributes, metadata, tags)
  • Sensitive-data masking via TraceConfig (e.g. hide_inputs)

Requires together >= 2.0.0.

Installation

pip install openinference-instrumentation-together

PyPI package: openinference-instrumentation-together

Quickstart

pip install openinference-instrumentation-together together arize-phoenix opentelemetry-sdk opentelemetry-exporter-otlp

Start Phoenix as a collector (default http://localhost:6006), then:

from openinference.instrumentation.together import TogetherInstrumentor
from opentelemetry.exporter.otlp.proto.http.trace_exporter import OTLPSpanExporter
from opentelemetry.sdk.trace import TracerProvider
from opentelemetry.sdk.trace.export import SimpleSpanProcessor

endpoint = "http://127.0.0.1:6006/v1/traces"
tracer_provider = TracerProvider()
tracer_provider.add_span_processor(SimpleSpanProcessor(OTLPSpanExporter(endpoint)))

TogetherInstrumentor().instrument(tracer_provider=tracer_provider)

Run a chat completion. Set the TOGETHER_API_KEY environment variable with your key.

from together import Together

client = Together()
response = client.chat.completions.create(
    model="meta-llama/Llama-3.3-70B-Instruct-Turbo",
    messages=[{"role": "user", "content": "Why is the sky blue?"}],
)
print(response.choices[0].message.content)

Streaming works the same way — the span is finished when the stream is exhausted:

stream = client.chat.completions.create(
    model="meta-llama/Llama-3.3-70B-Instruct-Turbo",
    messages=[{"role": "user", "content": "Write a haiku about observability."}],
    stream=True,
)
for chunk in stream:
    if chunk.choices and chunk.choices[0].delta.content:
        print(chunk.choices[0].delta.content, end="", flush=True)

Runnable examples — including async usage, streaming with a reasoning model, and tool calls — are in the examples/ directory.

More Info

Project links

Data verified by PyPI on Aug 18, 2026
Data provided by the project maintainers, verified at the time the release was uploaded to PyPI.

Key dates

PyPI data
Data sourced directly from PyPI's database.
  • Released:
Latest release

1 maintainer

PyPI data
Data sourced directly from PyPI's database.
Avatar for arizeai from gravatar.com arizeai

Credits

Author: OpenInference Authors

GitHub Statistics

Data verified by PyPI on Aug 18, 2026
The GitHub source repository was provided by the project maintainers and verified by PyPI at the time of upload. Stars, forks, and open issues/PRs are derived from that repository and have not been independently verified.

License expression

Apache-2.0
View SPDX License List

Requires

Python <3.15, >=3.10

Provides Extra

instruments

Classifiers

Report project as malware

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

openinference_instrumentation_together-0.1.3.tar.gz (13.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

openinference_instrumentation_together-0.1.3-py3-none-any.whl (17.9 kB view details)

Uploaded Python 3

File details

Details for the file openinference_instrumentation_together-0.1.3.tar.gz.

File metadata

File hashes

Hashes for openinference_instrumentation_together-0.1.3.tar.gz
Algorithm Hash digest
SHA256 210bdf024f908b9f48bed3f5b761f5734918eaa9ad3b5e8fd1caff3ef9fb984a
MD5 30bd884fa39f0b2e355819c9e7480c2c
BLAKE2b-256 5d4550f1216175636863d80c6d798c07c8519215a9c14b790b298578b3524b8c

See more details on using hashes here.

Provenance

The following attestation bundles were made for openinference_instrumentation_together-0.1.3.tar.gz:

Publisher: publish.yaml on Arize-ai/openinference

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file openinference_instrumentation_together-0.1.3-py3-none-any.whl.

File metadata

File hashes

Hashes for openinference_instrumentation_together-0.1.3-py3-none-any.whl
Algorithm Hash digest
SHA256 85afc870e74240a0d7655fec797bc4eb42e530f9316c735082d7edf2e9147ce2
MD5 57c5193ef4105cf5bb9a141331f9e7d4
BLAKE2b-256 4b1304dbaffab7464a9ff9c2c1fe460d0cc555847ed9f680fee810b6f018f041

See more details on using hashes here.

Provenance

The following attestation bundles were made for openinference_instrumentation_together-0.1.3-py3-none-any.whl:

Publisher: publish.yaml on Arize-ai/openinference

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page