pipeline-node-agents 0.1.5

A lightweight Python framework for building modular AI pipelines with function nodes and agent nodes.

Pipeline Node Agents

A lightweight Python framework for building modular AI pipelines with function nodes and agent nodes. Designed to work well with lightweight local LLMs by giving you full control over context and task complexity at each step.

Usage Guide

Requirements

• OS: Ubuntu 20.04 or later
• RAM: 8 GB minimum (16 GB recommended)
• Disk: 10 GB free space
• curl (any recent version)
• Python 3.11 - 3.13

1) Setup Ollama

• Install Ollama (if not already installed):

  curl -fsSL https://ollama.com/install.sh | sh
  

• Run Ollama in a separate terminal:

  ollama serve
  

• Install LLM (default: llama3.2:latest):

  ollama pull llama3.2:latest
  

• Make sure the required LLM is installed using command:

  ollama list
  

Expected output:

NAME                ID              SIZE     MODIFIED
llama3.2:latest     9f1c3d6a5b8e    2.0 GB   1 minute ago

2) Install Package

• (Optional, but recommended) create python virtual environment:

  python3 -m venv .venv && source .venv/bin/activate
  

• Install package:

  pip install pipeline-node-agents
  

3) Verify Installation

from pipeline_node_agents import greet

print(greet())

Expected output:

Hello, World! Pipeline Node Agents <version> is working.

4) Run Pipelines

Option 1: With defined model and logger (recommended)

from crewai import LLM
from pipeline_node_agents import init_pipeline_logger, get_logger, TripPlannerPipeline

init_pipeline_logger(pipeline_name="trip_planner_pipeline", project_root=".")
logger = get_logger(__name__)

# Default model is llama3.2, change if needed
ollama_llm = LLM(model="ollama/llama3.2", base_url="http://localhost:11434")

pipeline = TripPlannerPipeline(ollama_llm=ollama_llm, logger=logger)
pipeline.run()

Option 2: Without logger

from pipeline_node_agents import TripPlannerPipeline

# Default model is llama3.2
pipeline = TripPlannerPipeline()
pipeline.run()

Available tools configuration

As default, agent nodes work as pure LLMs (without tools). You can allow them to search for information by themselves.

Note: Usage of tools is not recommended for light-weight LLMs (<8 billion hyperparameters).

To enable tools for specific agents in TripPlannerPipeline:

1. Enable tools for local expert agent only:

   pipeline = TripPlannerPipeline(local_expert_tools_enabled=True)
   

2. Enable tools for travel concierge agent only:

   pipeline = TripPlannerPipeline(travel_concierge_tools_enabled=True)
   

3. Enable tools for both agents:

   pipeline = TripPlannerPipeline(local_expert_tools_enabled=True, travel_concierge_tools_enabled=True)
   

Available pipelines

The following pipelines are included as examples:

• ConditioningPipeline: Randomly chooses whether to go to a park or cinema, and suggests either a film or a park in Vienna.

• InputCheckerPipeline: Takes text as input and returns true if the text is a list of populated places (cities). Can be run as a loop, returning to the input step as long as the input is invalid: pipeline.run(loop=True)

• RandomMeanPipeline: Simple pipeline without LLM usage that generates random numbers and calculates their mean.

• RandomMeanPipelineCrewAI: Generates random numbers and summarizes them using an LLM.

• SearchAndSummarizePipeline: Searches for the best country for business using DuckDuckGo and summarizes results using an LLM, returning the best country for business.

• TripPlannerPipeline: Takes a list of cities and trip dates as input, chooses the city based on weather conditions, and creates a full 7-day trip itinerary for the provided dates.

To run one of them, replace "TripPlannerPipeline" in the code example with a class from the list above.

Example with SearchAndSummarizePipeline:

from pipeline_node_agents import SearchAndSummarizePipeline
pipeline = SearchAndSummarizePipeline()
pipeline.run()

Maintenance Guide

For detailed maintenance instructions, including how to create nodes, build pipelines, and extend the framework, please refer to the Maintenance Guide.