Skip to main content

OpenTelemetry transformers instrumentation

Project description

OpenTelemetry HuggingFace Transformers Instrumentation

This library allows tracing texte generation calls sent with the official HuggingFace Transformers library.

Installation

pip install opentelemetry-instrumentation-transformers

Example usage

from opentelemetry.instrumentation.transformers import TransformersInstrumentor

TransformersInstrumentor().instrument()

Privacy

By default, this instrumentation logs prompts, completions, and embeddings to span attributes. This gives you a clear visibility into how your LLM application is working, and can make it easy to debug and evaluate the quality of the outputs.

However, you may want to disable this logging for privacy reasons, as they may contain highly sensitive data from your users. You may also simply want to reduce the size of your traces.

To disable logging, set the TRACELOOP_TRACE_CONTENT environment variable to false.

TRACELOOP_TRACE_CONTENT=false

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

Built Distribution

File details

Details for the file opentelemetry_instrumentation_transformers-0.33.12.tar.gz.

File metadata

File hashes

Hashes for opentelemetry_instrumentation_transformers-0.33.12.tar.gz
Algorithm Hash digest
SHA256 d7b9c0d4bd71b834a79c2522455799feb7e76148e1dd371408e9907e847e8d6a
MD5 2b140c66837008ebc98f54c4e2717476
BLAKE2b-256 3f25f73bfae73a466b0ee206168a0ec2212db694132f0af75ff7bf8d7da74488

See more details on using hashes here.

Provenance

The following attestation bundles were made for opentelemetry_instrumentation_transformers-0.33.12.tar.gz:

Publisher: release.yml on traceloop/openllmetry

Attestations:

File details

Details for the file opentelemetry_instrumentation_transformers-0.33.12-py3-none-any.whl.

File metadata

File hashes

Hashes for opentelemetry_instrumentation_transformers-0.33.12-py3-none-any.whl
Algorithm Hash digest
SHA256 14c3f3831a892ae38f8bb85240c195ed95e8fa996f60930e2e4f00bb73073036
MD5 0fe0d03283aa852c94e0982cb1343af4
BLAKE2b-256 12ef4305bdf6af7161c2b38d5341b25bb2a0817f8ba40bf370bb6eeb131a223c

See more details on using hashes here.

Provenance

The following attestation bundles were made for opentelemetry_instrumentation_transformers-0.33.12-py3-none-any.whl:

Publisher: release.yml on traceloop/openllmetry

Attestations:

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page