The ultimate context builder for LLM applications - multi-source gathering (web, papers, GitHub) with optional semantic search
Project description
🚀 CrazyContext
The ultimate context builder for LLM applications
Multi-source context gathering (web, papers, GitHub) with optional semantic search integration.
✨ Features
- 🌐 Multi-Source Gathering - Web, academic papers, GitHub repos, local files
- 🔍 Flexible Search - Keyword, fuzzy, or semantic (with Deep-Searcher)
- 📚 GitHub Integration - Search repos, download code, extract context
- 📄 Format Flexibility - HTML, Markdown, PDF, plain text
- 💾 Smart Caching - Download once, query forever
- 🎯 Profile System - Pre-optimized for research, coding, legal, etc.
- 🤖 LLM-Ready - Direct output for any LLM (no framework lock-in)
- 🔌 Optional Semantic Search - Integrate with Deep-Searcher when needed
🚀 Quick Start
Installation
# Core installation
pip install crazycontext
# With optional features
pip install crazycontext[fuzzy] # Fuzzy search
pip install crazycontext[pdf] # PDF support
pip install crazycontext[github] # GitHub integration
pip install crazycontext[deepsearcher] # Semantic search
pip install crazycontext[all] # Everything
Basic Usage
from crazycontext import CrazyContext
# Initialize
cc = CrazyContext()
# Gather context from multiple sources
context = cc.from_topic(
"machine learning",
sources=["web", "papers", "github"],
max_results=20
)
# Format for LLM
prompt = context.build(format="llm_prompt")
print(prompt)
📖 Examples
Download Documentation
# Download and convert to Markdown
cc.from_urls([
"https://docs.python.org/3/tutorial/",
"https://pytorch.org/tutorials/"
])
# Search downloaded content
results = cc.search("neural networks", search_type="keyword")
Academic Papers
# Fetch papers from arXiv, Semantic Scholar
context = cc.from_topic(
"transformer attention mechanisms",
sources=["papers"],
max_results=10
)
GitHub Repositories
# Search and download GitHub repos
context = cc.from_topic(
"pytorch neural networks",
sources=["github"],
github_options={
"language": "python",
"min_stars": 500
}
)
Semantic Search (Optional)
from crazycontext.bridges import CrazyContextLoader
# Initialize with Deep-Searcher integration
loader = CrazyContextLoader()
# Gather with CrazyContext, search with Deep-Searcher
loader.load_from_crazycontext(
topic="AI",
sources=["web", "papers", "github"]
)
# Semantic query (uses FREE Gemini embeddings!)
answer = loader.query("What is deep learning?")
print(answer['answer'])
🎯 Use Cases
- Research - Gather papers, web articles, and code examples
- Documentation - Download and search technical docs
- Coding Assistants - GitHub code examples + documentation
- Knowledge Bases - Multi-source context for RAG systems
- Content Creation - Research and fact-checking
📚 Documentation
🎯 Start Here
- Getting Started Guide - Installation, quick start, basic concepts
- Examples - Real-world use cases
- CLI Guide - Command-line interface
📖 Reference
- API Reference - Complete API documentation
- Best Practices - Guidelines and recommendations
- llm.txt - LLM-optimized reference for AI assistants
📋 Full Documentation
- Documentation Index - Complete documentation overview
🗺️ Architecture & Design
- Unification Plan - Architecture & design
- Quick Reference - API cheatsheet
- GitHub Integration - GitHub features
- Deep-Searcher Bridge - Semantic search
🔧 Development
# Clone repository
git clone https://github.com/crazycontext/crazycontext.git
cd crazycontext
# Install in development mode
pip install -e .[dev]
# Run tests
pytest
# Format code
black crazycontext/
🤝 Contributing
Contributions are welcome! Please read our Contributing Guide first.
📄 License
Apache 2.0 - see LICENSE file for details.
🌟 Features Comparison
| Feature | CrazyContext Alone | + Deep-Searcher Bridge |
|---|---|---|
| Multi-source gather | ✅ | ✅ |
| Keyword search | ✅ | ✅ |
| Fuzzy search | ✅ | ✅ |
| Semantic search | ❌ | ✅ |
| GitHub integration | ✅ | ✅ |
| Cost | Free | ~$0.001-0.01/query |
| Setup | Simple | Moderate |
💡 Why CrazyContext?
- Simple - Works out of the box, no complex setup
- Flexible - Use standalone or with semantic search
- Cost-effective - Free core, optional paid features
- No lock-in - Works with any LLM framework
- Production-ready - Battle-tested, well-documented
Built with ❤️ for the LLM community
Making context building crazy simple! 🎯
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file crazycontext-0.1.1.tar.gz.
File metadata
- Download URL: crazycontext-0.1.1.tar.gz
- Upload date:
- Size: 80.5 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: uv/0.9.6
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
4ea5cfdbaddce43f2476261899f58a503759ac3c1fb8adda7f6422103f997540
|
|
| MD5 |
1f0f37d2aa7f9df82f95db3109f48a91
|
|
| BLAKE2b-256 |
200342a8109c9630554ba28d8d52130de7deb964f7e1a74ea298b14812a97dd9
|
File details
Details for the file crazycontext-0.1.1-py3-none-any.whl.
File metadata
- Download URL: crazycontext-0.1.1-py3-none-any.whl
- Upload date:
- Size: 53.8 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: uv/0.9.6
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
8a72c504406cad6acfb608d1b1576ae4b8a269806c58746b2806203147d0571f
|
|
| MD5 |
5c8bfd6029daf1777784d9d7ba729ab3
|
|
| BLAKE2b-256 |
94ef9a8586eea1492fe3d37fde7c58936040a94b0c89dc2db44e25ae98fbe60f
|