searchforge 0.1.0

A lightweight search engine for Python applications

# SearchForge

A lightweight full-text search engine built in Python.

SearchForge provides fast document indexing, ranking, fuzzy search, autocomplete, highlighting, filtering and persistent storage.

## Features

- Full-text search
- Inverted index based indexing
- TF-IDF and BM25 ranking
- Tokenization and normalization
- Stop word removal
- Fuzzy search
- Autocomplete suggestions
- Metadata filtering
- Highlighted search results
- Persistent document storage
- Persistent index storage
- Search analytics
- Command line interface (CLI)

## Installation

Clone the repository:

```bash
git clone <repository-url>
cd searchforge

Install:

pip install -e .

CLI Usage

Add a document:

searchforge add sample.txt

Search:

searchforge search "python"

View analytics:

searchforge stats

Check version:

searchforge --version

Python Usage

from searchforge import SearchEngine


engine = SearchEngine()


engine.add_document(
    1,
    "Python Django Developer"
)


results = engine.search(
    "python"
)


for result in results:
    print(result.document_id, result.score)

Architecture

SearchForge

├── Tokenizer
├── Normalizer
├── Stop Words
├── Inverted Index
├── Query Processor
├── Ranking Engine
│      ├── TF-IDF
│      └── BM25
├── Storage
├── CLI
└── Analytics

Development

Run tests:

pytest

License

MIT License