OpenInference crewAI Instrumentation

Python auto-instrumentation library for LLM agents implemented with CrewAI

Crews are fully OpenTelemetry-compatible and can be sent to an OpenTelemetry collector for monitoring, such as arize-phoenix.

Installation

pip install openinference-instrumentation-crewai

Quickstart

This quickstart shows you how to instrument your guardrailed LLM application

Install required packages.

pip install crewai crewai-tools  arize-phoenix opentelemetry-sdk opentelemetry-exporter-otlp

Start Phoenix in the background as a collector. By default, it listens on http://localhost:6006. You can visit the app via a browser at the same address. (Phoenix does not send data over the internet. It only operates locally on your machine.)

python -m phoenix.server.main serve

Set up CrewAIInstrumentor to trace your crew and send the traces to Phoenix at the endpoint defined below.

from opentelemetry import trace
from opentelemetry.sdk.trace import TracerProvider
from opentelemetry.sdk.trace.export import BatchSpanProcessor

from openinference.instrumentation.crewai import CrewAIInstrumentor
from openinference.instrumentation.langchain import LangChainInstrumentor
from opentelemetry.exporter.otlp.proto.http.trace_exporter import OTLPSpanExporter
from opentelemetry.sdk.trace.export import ConsoleSpanExporter, SimpleSpanProcessor

endpoint = "http://127.0.0.1:6006/v1/traces"
trace_provider = TracerProvider()
trace_provider.add_span_processor(SimpleSpanProcessor(OTLPSpanExporter(endpoint)))

CrewAIInstrumentor().instrument(tracer_provider=trace_provider)
LangChainInstrumentor().instrument(tracer_provider=trace_provider)

Set up a simple crew to do research

import os
from crewai import Agent, Task, Crew, Process
from crewai_tools import SerperDevTool

os.environ["OPENAI_API_KEY"] = "YOUR_OPENAI_API_KEY"
os.environ["SERPER_API_KEY"] = "YOUR_SERPER_API_KEY" 
search_tool = SerperDevTool()

# Define your agents with roles and goals
researcher = Agent(
  role='Senior Research Analyst',
  goal='Uncover cutting-edge developments in AI and data science',
  backstory="""You work at a leading tech think tank.
  Your expertise lies in identifying emerging trends.
  You have a knack for dissecting complex data and presenting actionable insights.""",
  verbose=True,
  allow_delegation=False,
  # You can pass an optional llm attribute specifying what model you wanna use.
  # llm=ChatOpenAI(model_name="gpt-3.5", temperature=0.7),
  tools=[search_tool]
)
writer = Agent(
  role='Tech Content Strategist',
  goal='Craft compelling content on tech advancements',
  backstory="""You are a renowned Content Strategist, known for your insightful and engaging articles.
  You transform complex concepts into compelling narratives.""",
  verbose=True,
  allow_delegation=True
)

# Create tasks for your agents
task1 = Task(
  description="""Conduct a comprehensive analysis of the latest advancements in AI in 2024.
  Identify key trends, breakthrough technologies, and potential industry impacts.""",
  expected_output="Full analysis report in bullet points",
  agent=researcher
)

task2 = Task(
  description="""Using the insights provided, develop an engaging blog
  post that highlights the most significant AI advancements.
  Your post should be informative yet accessible, catering to a tech-savvy audience.
  Make it sound cool, avoid complex words so it doesn't sound like AI.""",
  expected_output="Full blog post of at least 4 paragraphs",
  agent=writer
)

# Instantiate your crew with a sequential process
crew = Crew(
  agents=[researcher, writer],
  tasks=[task1, task2],
  verbose=2, # You can set it to 1 or 2 to different logging levels
  process = Process.sequential
)

# Get your crew to work!
result = crew.kickoff()

print("######################")
print(result)

More Info

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

openinference_instrumentation_crewai-0.1.1.tar.gz (9.8 kB view details)

Uploaded Aug 7, 2024 Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

The dropdown lists show the available interpreters, ABIs, and platforms. Enable javascript to be able to filter the list of wheel files.

openinference_instrumentation_crewai-0.1.1-py3-none-any.whl (11.1 kB view details)

Uploaded Aug 7, 2024 Python 3

File details

Details for the file openinference_instrumentation_crewai-0.1.1.tar.gz.

File metadata

Download URL: openinference_instrumentation_crewai-0.1.1.tar.gz
Upload date: Aug 7, 2024
Size: 9.8 kB
Tags: Source
Uploaded using Trusted Publishing? No
Uploaded via: twine/5.1.1 CPython/3.12.4

File hashes

Hashes for openinference_instrumentation_crewai-0.1.1.tar.gz
Algorithm	Hash digest
SHA256	`61f4c7eadc8bd7966e11c5bfadadf8cc92abdeeb21af54e8df1ee04c62149bce`
MD5	`433ce51431c7ee717b9fab46097c9487`
BLAKE2b-256	`1301528671f05a173f619a64d7b240c9e978a4c41c45489ad3636d6c83bdfb73`

See more details on using hashes here.

File details

Details for the file openinference_instrumentation_crewai-0.1.1-py3-none-any.whl.

File metadata

Download URL: openinference_instrumentation_crewai-0.1.1-py3-none-any.whl
Upload date: Aug 7, 2024
Size: 11.1 kB
Tags: Python 3
Uploaded using Trusted Publishing? No
Uploaded via: twine/5.1.1 CPython/3.12.4

File hashes

Hashes for openinference_instrumentation_crewai-0.1.1-py3-none-any.whl
Algorithm	Hash digest
SHA256	`d07fed86fa88e5d483f45adc0d740be8305fce29457208135fa72de54e2645d7`
MD5	`5889905d8acc221a343e5a4bcc529ae8`
BLAKE2b-256	`0804cfae93419de8061bc7b990f5584a540eb735ce1a18896bce9b1203c38f7c`