Skip to main content

A powerful web content fetcher and processor

Project description

ParserLite: Lightweight Web Search & Text Processing 🚀

License: MIT Python 3.8+ Downloads

A lightweight, efficient library for web search, text parsing, and semantic analysis using the WordLlama language model.

🌟 Features

  • 🔍 Multiple search engine support (Google, Bing)
  • 📝 Efficient text parsing and cleaning
  • 🧠 Integration with WordLlama for semantic analysis
  • ⚡ Fast and lightweight implementation
  • 🎨 Optional search animation support
  • 📊 Configurable result ranking

📦 Installation

pip install parselite searchlite wordllama

🚀 Quick Start

GoogleSearch+AI

from visionlite import vision
results = vision("What is quantum computing?")
print(results)

BingSearch+AI

from visionlite import visionbing
results = visionbing("What is quantum computing?")
print(results)

📖 Usage Examples

Basic Search with Google

def vision(query, k=1, max_urls=5, animation=False):
    # Search, parse, and rank results
    results = llm.topk(
        query,
        llm.split("".join(
            parse(google(query, max_urls=max_urls, animation=animation))
        )),
        k=k
    )
    return "\n".join(results)

# Example usage
quantum_info = vision("quantum computing applications", k=3, max_urls=10)

Search with Bing

def visionbing(query, k=1, max_urls=5, animation=False):
    # Search using Bing, parse, and rank results
    results = llm.topk(
        query,
        llm.split("".join(
            parse(bing(query, max_urls=max_urls, animation=animation))
        )),
        k=k
    )
    return "\n".join(results)

# Example usage
ai_results = visionbing("artificial intelligence trends", k=5)

🔧 Configuration

Search Parameters

  • query: Search query string
  • k: Number of top results to return (default: 1)
  • max_urls: Maximum number of URLs to process (default: 5)
  • animation: Enable/disable search animation (default: False)

🤝 Contributing

Contributions are welcome! Here's how you can help:

  1. Fork the repository
  2. Create your feature branch (git checkout -b feature/AmazingFeature)
  3. Commit your changes (git commit -m 'Add some AmazingFeature')
  4. Push to the branch (git push origin feature/AmazingFeature)
  5. Open a Pull Request

📝 License

This project is licensed under the MIT License - see the LICENSE file for details.

🙏 Acknowledgments

  • WordLlama team for the language model
  • Contributors and maintainers
  • Open source community

🔮 Future Plans

  • Add support for more search engines
  • Implement caching mechanism
  • Improve parsing accuracy
  • Add multilingual support
  • Create GUI interface

⭐ Star History

Star History Chart

📊 Performance

Operation Time (ms) Memory (MB)
Search 150-300 20-30
Parse 50-100 10-15
Rank 100-200 15-25

🔥 Showcase

Projects using ParserLite:

  • Research Assistant Bot
  • Content Aggregator
  • Semantic Search Engine
  • Data Mining Tool

Made with ❤️ by [Your Name]

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ailite-0.6.0.tar.gz (30.3 kB view details)

Uploaded Source

Built Distribution

ailite-0.6.0-py3-none-any.whl (36.5 kB view details)

Uploaded Python 3

File details

Details for the file ailite-0.6.0.tar.gz.

File metadata

  • Download URL: ailite-0.6.0.tar.gz
  • Upload date:
  • Size: 30.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.8.0 colorama/0.4.4 importlib-metadata/4.6.4 keyring/23.5.0 pkginfo/1.8.2 readme-renderer/34.0 requests-toolbelt/0.9.1 requests/2.25.1 rfc3986/1.5.0 tqdm/4.57.0 urllib3/1.26.5 CPython/3.10.12

File hashes

Hashes for ailite-0.6.0.tar.gz
Algorithm Hash digest
SHA256 cdd148337bdf0d065a071a4855b9f3f4b8cb47e12f316fc7da6fb5a6993c5aa1
MD5 05749d86228ac94eb2a3f8763dd86f6a
BLAKE2b-256 f284c615b3f0ce760a3a4c22db140556ece81b70bf58edeef83c881f6eb2d8c5

See more details on using hashes here.

File details

Details for the file ailite-0.6.0-py3-none-any.whl.

File metadata

  • Download URL: ailite-0.6.0-py3-none-any.whl
  • Upload date:
  • Size: 36.5 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.8.0 colorama/0.4.4 importlib-metadata/4.6.4 keyring/23.5.0 pkginfo/1.8.2 readme-renderer/34.0 requests-toolbelt/0.9.1 requests/2.25.1 rfc3986/1.5.0 tqdm/4.57.0 urllib3/1.26.5 CPython/3.10.12

File hashes

Hashes for ailite-0.6.0-py3-none-any.whl
Algorithm Hash digest
SHA256 8dd96fee9f6d185c51ad85153e7394cb508b422f0b739bb9431616e007d97e82
MD5 15214150259404d51f1c78b65f06a616
BLAKE2b-256 dc10013856045a9570421e8755319fd4bb5db3bc4d1490fc29b7f12affd8d4da

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page