A powerful web content fetcher and processor
Project description
ParserLite: Lightweight Web Search & Text Processing 🚀
A lightweight, efficient library for web search, text parsing, and semantic analysis using the WordLlama language model.
🌟 Features
- 🔍 Multiple search engine support (Google, Bing)
- 📝 Efficient text parsing and cleaning
- 🧠 Integration with WordLlama for semantic analysis
- ⚡ Fast and lightweight implementation
- 🎨 Optional search animation support
- 📊 Configurable result ranking
📦 Installation
pip install parselite searchlite wordllama
🚀 Quick Start
GoogleSearch+AI
from visionlite import vision
results = vision("What is quantum computing?")
print(results)
BingSearch+AI
from visionlite import visionbing
results = visionbing("What is quantum computing?")
print(results)
📖 Usage Examples
Basic Search with Google
def vision(query, k=1, max_urls=5, animation=False):
# Search, parse, and rank results
results = llm.topk(
query,
llm.split("".join(
parse(google(query, max_urls=max_urls, animation=animation))
)),
k=k
)
return "\n".join(results)
# Example usage
quantum_info = vision("quantum computing applications", k=3, max_urls=10)
Search with Bing
def visionbing(query, k=1, max_urls=5, animation=False):
# Search using Bing, parse, and rank results
results = llm.topk(
query,
llm.split("".join(
parse(bing(query, max_urls=max_urls, animation=animation))
)),
k=k
)
return "\n".join(results)
# Example usage
ai_results = visionbing("artificial intelligence trends", k=5)
🔧 Configuration
Search Parameters
query
: Search query stringk
: Number of top results to return (default: 1)max_urls
: Maximum number of URLs to process (default: 5)animation
: Enable/disable search animation (default: False)
🤝 Contributing
Contributions are welcome! Here's how you can help:
- Fork the repository
- Create your feature branch (
git checkout -b feature/AmazingFeature
) - Commit your changes (
git commit -m 'Add some AmazingFeature'
) - Push to the branch (
git push origin feature/AmazingFeature
) - Open a Pull Request
📝 License
This project is licensed under the MIT License - see the LICENSE file for details.
🙏 Acknowledgments
- WordLlama team for the language model
- Contributors and maintainers
- Open source community
🔮 Future Plans
- Add support for more search engines
- Implement caching mechanism
- Improve parsing accuracy
- Add multilingual support
- Create GUI interface
⭐ Star History
📊 Performance
Operation | Time (ms) | Memory (MB) |
---|---|---|
Search | 150-300 | 20-30 |
Parse | 50-100 | 10-15 |
Rank | 100-200 | 15-25 |
🔥 Showcase
Projects using ParserLite:
- Research Assistant Bot
- Content Aggregator
- Semantic Search Engine
- Data Mining Tool
Made with ❤️ by [Your Name]
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
ailite-0.6.0.tar.gz
(30.3 kB
view details)
Built Distribution
ailite-0.6.0-py3-none-any.whl
(36.5 kB
view details)
File details
Details for the file ailite-0.6.0.tar.gz
.
File metadata
- Download URL: ailite-0.6.0.tar.gz
- Upload date:
- Size: 30.3 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.8.0 colorama/0.4.4 importlib-metadata/4.6.4 keyring/23.5.0 pkginfo/1.8.2 readme-renderer/34.0 requests-toolbelt/0.9.1 requests/2.25.1 rfc3986/1.5.0 tqdm/4.57.0 urllib3/1.26.5 CPython/3.10.12
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | cdd148337bdf0d065a071a4855b9f3f4b8cb47e12f316fc7da6fb5a6993c5aa1 |
|
MD5 | 05749d86228ac94eb2a3f8763dd86f6a |
|
BLAKE2b-256 | f284c615b3f0ce760a3a4c22db140556ece81b70bf58edeef83c881f6eb2d8c5 |
File details
Details for the file ailite-0.6.0-py3-none-any.whl
.
File metadata
- Download URL: ailite-0.6.0-py3-none-any.whl
- Upload date:
- Size: 36.5 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.8.0 colorama/0.4.4 importlib-metadata/4.6.4 keyring/23.5.0 pkginfo/1.8.2 readme-renderer/34.0 requests-toolbelt/0.9.1 requests/2.25.1 rfc3986/1.5.0 tqdm/4.57.0 urllib3/1.26.5 CPython/3.10.12
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8dd96fee9f6d185c51ad85153e7394cb508b422f0b739bb9431616e007d97e82 |
|
MD5 | 15214150259404d51f1c78b65f06a616 |
|
BLAKE2b-256 | dc10013856045a9570421e8755319fd4bb5db3bc4d1490fc29b7f12affd8d4da |