Skip to main content

A powerful web content fetcher and processor

Project description

ParserLite: Lightweight Web Search & Text Processing 🚀

License: MIT Python 3.8+ Downloads

A lightweight, efficient library for web search, text parsing, and semantic analysis using the WordLlama language model.

🌟 Features

  • 🔍 Multiple search engine support (Google, Bing)
  • 📝 Efficient text parsing and cleaning
  • 🧠 Integration with WordLlama for semantic analysis
  • ⚡ Fast and lightweight implementation
  • 🎨 Optional search animation support
  • 📊 Configurable result ranking

📦 Installation

pip install parselite searchlite wordllama

🚀 Quick Start

GoogleSearch+AI

from visionlite import vision
results = vision("What is quantum computing?")
print(results)

BingSearch+AI

from visionlite import visionbing
results = visionbing("What is quantum computing?")
print(results)

📖 Usage Examples

Basic Search with Google

def vision(query, k=1, max_urls=5, animation=False):
    # Search, parse, and rank results
    results = llm.topk(
        query,
        llm.split("".join(
            parse(google(query, max_urls=max_urls, animation=animation))
        )),
        k=k
    )
    return "\n".join(results)

# Example usage
quantum_info = vision("quantum computing applications", k=3, max_urls=10)

Search with Bing

def visionbing(query, k=1, max_urls=5, animation=False):
    # Search using Bing, parse, and rank results
    results = llm.topk(
        query,
        llm.split("".join(
            parse(bing(query, max_urls=max_urls, animation=animation))
        )),
        k=k
    )
    return "\n".join(results)

# Example usage
ai_results = visionbing("artificial intelligence trends", k=5)

🔧 Configuration

Search Parameters

  • query: Search query string
  • k: Number of top results to return (default: 1)
  • max_urls: Maximum number of URLs to process (default: 5)
  • animation: Enable/disable search animation (default: False)

🤝 Contributing

Contributions are welcome! Here's how you can help:

  1. Fork the repository
  2. Create your feature branch (git checkout -b feature/AmazingFeature)
  3. Commit your changes (git commit -m 'Add some AmazingFeature')
  4. Push to the branch (git push origin feature/AmazingFeature)
  5. Open a Pull Request

📝 License

This project is licensed under the MIT License - see the LICENSE file for details.

🙏 Acknowledgments

  • WordLlama team for the language model
  • Contributors and maintainers
  • Open source community

🔮 Future Plans

  • Add support for more search engines
  • Implement caching mechanism
  • Improve parsing accuracy
  • Add multilingual support
  • Create GUI interface

⭐ Star History

Star History Chart

📊 Performance

Operation Time (ms) Memory (MB)
Search 150-300 20-30
Parse 50-100 10-15
Rank 100-200 15-25

🔥 Showcase

Projects using ParserLite:

  • Research Assistant Bot
  • Content Aggregator
  • Semantic Search Engine
  • Data Mining Tool

Made with ❤️ by [Your Name]

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

visionlite-0.1.1.tar.gz (3.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

visionlite-0.1.1-py3-none-any.whl (3.6 kB view details)

Uploaded Python 3

File details

Details for the file visionlite-0.1.1.tar.gz.

File metadata

  • Download URL: visionlite-0.1.1.tar.gz
  • Upload date:
  • Size: 3.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.11.0rc1

File hashes

Hashes for visionlite-0.1.1.tar.gz
Algorithm Hash digest
SHA256 b0307ede4a6c95479d8925b9b9646d1d86111231bd355c4a42a94804887b7fa1
MD5 eee1a6ff75808f28959ab8bd00f55431
BLAKE2b-256 9c3e9a1974fabde90a5361c1e44bbfdea07a0861a5879ef1bcbbb1a2a8cc2f26

See more details on using hashes here.

File details

Details for the file visionlite-0.1.1-py3-none-any.whl.

File metadata

  • Download URL: visionlite-0.1.1-py3-none-any.whl
  • Upload date:
  • Size: 3.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.11.0rc1

File hashes

Hashes for visionlite-0.1.1-py3-none-any.whl
Algorithm Hash digest
SHA256 da1f4c60045dc257b6a8594f75118aae79b0e2d74934a647a1643f5cd82913f9
MD5 ef973f15d7cb7c81122c171ea3e229fe
BLAKE2b-256 27a921bd84830df6be5d10f1df7f33f82a8f13224e526195f83ad0824d942467

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page