A powerful web content fetcher and processor
Project description
ParserLite: Lightweight Web Search & Text Processing 🚀
A lightweight, efficient library for web search, text parsing, and semantic analysis using the WordLlama language model.
🌟 Features
- 🔍 Multiple search engine support (Google, Bing)
- 📝 Efficient text parsing and cleaning
- 🧠 Integration with WordLlama for semantic analysis
- ⚡ Fast and lightweight implementation
- 🎨 Optional search animation support
- 📊 Configurable result ranking
📦 Installation
pip install parselite searchlite wordllama
🚀 Quick Start
GoogleSearch+AI
from visionlite import vision
results = vision("What is quantum computing?")
print(results)
BingSearch+AI
from visionlite import visionbing
results = visionbing("What is quantum computing?")
print(results)
📖 Usage Examples
Basic Search with Google
def vision(query, k=1, max_urls=5, animation=False):
# Search, parse, and rank results
results = llm.topk(
query,
llm.split("".join(
parse(google(query, max_urls=max_urls, animation=animation))
)),
k=k
)
return "\n".join(results)
# Example usage
quantum_info = vision("quantum computing applications", k=3, max_urls=10)
Search with Bing
def visionbing(query, k=1, max_urls=5, animation=False):
# Search using Bing, parse, and rank results
results = llm.topk(
query,
llm.split("".join(
parse(bing(query, max_urls=max_urls, animation=animation))
)),
k=k
)
return "\n".join(results)
# Example usage
ai_results = visionbing("artificial intelligence trends", k=5)
🔧 Configuration
Search Parameters
query
: Search query stringk
: Number of top results to return (default: 1)max_urls
: Maximum number of URLs to process (default: 5)animation
: Enable/disable search animation (default: False)
🤝 Contributing
Contributions are welcome! Here's how you can help:
- Fork the repository
- Create your feature branch (
git checkout -b feature/AmazingFeature
) - Commit your changes (
git commit -m 'Add some AmazingFeature'
) - Push to the branch (
git push origin feature/AmazingFeature
) - Open a Pull Request
📝 License
This project is licensed under the MIT License - see the LICENSE file for details.
🙏 Acknowledgments
- WordLlama team for the language model
- Contributors and maintainers
- Open source community
🔮 Future Plans
- Add support for more search engines
- Implement caching mechanism
- Improve parsing accuracy
- Add multilingual support
- Create GUI interface
⭐ Star History
📊 Performance
Operation | Time (ms) | Memory (MB) |
---|---|---|
Search | 150-300 | 20-30 |
Parse | 50-100 | 10-15 |
Rank | 100-200 | 15-25 |
🔥 Showcase
Projects using ParserLite:
- Research Assistant Bot
- Content Aggregator
- Semantic Search Engine
- Data Mining Tool
Made with ❤️ by [Your Name]
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
ailite-0.5.0.tar.gz
(30.2 kB
view details)
Built Distribution
ailite-0.5.0-py3-none-any.whl
(36.3 kB
view details)
File details
Details for the file ailite-0.5.0.tar.gz
.
File metadata
- Download URL: ailite-0.5.0.tar.gz
- Upload date:
- Size: 30.2 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.8.0 colorama/0.4.4 importlib-metadata/4.6.4 keyring/23.5.0 pkginfo/1.8.2 readme-renderer/34.0 requests-toolbelt/0.9.1 requests/2.25.1 rfc3986/1.5.0 tqdm/4.57.0 urllib3/1.26.5 CPython/3.10.12
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | bcc269bf9c5e42eff3dab07ae67dc20e5d7e0ba7eea04088e1b6d5614fab1b12 |
|
MD5 | 1b40263bcf9383f3553f3bf3b9d108ae |
|
BLAKE2b-256 | 6ac398063eed012c610eb072549065caa5148b6f218d9f29528737b13eaae594 |
File details
Details for the file ailite-0.5.0-py3-none-any.whl
.
File metadata
- Download URL: ailite-0.5.0-py3-none-any.whl
- Upload date:
- Size: 36.3 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.8.0 colorama/0.4.4 importlib-metadata/4.6.4 keyring/23.5.0 pkginfo/1.8.2 readme-renderer/34.0 requests-toolbelt/0.9.1 requests/2.25.1 rfc3986/1.5.0 tqdm/4.57.0 urllib3/1.26.5 CPython/3.10.12
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 39f32f598b9c2404650f59c1b3f8cf605d3e54e0e1a36c0e358d4a091fcf0bfe |
|
MD5 | 428670a2c9b15172673ed71421576da7 |
|
BLAKE2b-256 | ffcacc06327f42276a5d43683b8db5d6fe2af09acacf0a93a06321a01d2b5542 |