EviSense

EviSense is a Python library developed as a part of BrainKB project designed to extract evidence and rationales for specific terms within documents, including scientific publications. It enables efficient retrieval of relevant information from various sources, supporting multiple LLM providers and concurrent processing.

Features

• Extract evidence and rationale from PDF documents, raw text, and directories
• Support for multiple LLM providers, including Ollama and OpenRouter and multiple models
• Flexible term search – retrieve insights for single or multiple terms efficiently

Installation

pip install evisense

Usage

Input Types

1. PDF Files:

# Using absolute path
evisense-cli extract-evidence --config config.yml --source /full/path/to/paper.pdf --terms "Neuron"

# Using relative path (relative to current directory)
evisense-cli extract-evidence --config config.yml --source documents/paper.pdf --terms "Neuron"

2. Multiple Terms:

# Using JSON array
evisense-cli extract-evidence --config config.yml --source paper.pdf --terms '["Astrocyte","Ependymal"]'

# Using comma-separated values
evisense-cli extract-evidence --config config.yml --source paper.pdf --terms "Astrocyte,Ependymal"

3. Directory of PDFs:

evisense-cli extract-evidence --config config.yml --source path/to/papers/ --terms "Neuron"

4. Raw Text Input:

# Short text
evisense-cli extract-evidence --config config.yml --source "This is a neuroscience text..." --terms "Neuron"

Configuration Options

• provider: (Optional) Specifies which provider to use ("all" or specific provider name)
• default: Default provider to use in these scenarios:
  1. When no provider is specified
  2. When the specified provider fails to initialize
  3. When authentication fails (e.g., invalid/missing API keys)
  4. When all selected providers return errors
• For each provider:
  • base_url: API endpoint
  • api_key: Authentication key (if required)
  • models: List of models to use
  • default_model: Default model if no specific models listed

Example Configuration

llm:
  provider: "openrouter"  # Try OpenRouter first
  default: "ollama"      # Use Ollama if OpenRouter auth fails
  
  openrouter:
    api_key: "your-key"  # If this key is invalid...
    base_url: "https://openrouter.ai/api/v1"
    models:
      - "gpt-4"
  
  ollama:               # ...system will fall back to Ollama
    base_url: "http://localhost:11434"
    default_model: "deepseek-r1:14b"

Development

Setup

git clone https://github.com/yourusername/EviSense.git
cd EviSense
pip install -e ".[dev]"

Testing

License

MIT License