Skip to main content

A unified wrapper for search engines like Serper, DuckDuckGo, etc.

Project description

OSINT Search Engine Wrapper

A lightweight, async wrapper around multiple search engine APIs (Serper/Google, DuckDuckGo, Bing). This package provides a unified, opinionated interface for running OSINT text and image searches.

Features

  • Async-first: Built on httpx and aiohttp for high-performance concurrent searching.
  • Multiple Engines:
    • Google (via Serper API)
    • DuckDuckGo (No API key required)
    • Bing (via Playwright/Headless Browser)
  • Standardized Results: Returns clean, consistent JSON-like dictionaries across all engines.

Installation

Install the package directly from PyPI:

pip install osint-search-engine-pkg

## Quick start

1. Setup API Keys
For Google (Serper), you need an API key. DuckDuckGo and Bing do not require keys.

```powershell
$env:GOOGLE_SERPER_API_KEY = "your_api_key_here"
export GOOGLE_SERPER_API_KEY="your_serper_api_key"
  1. Usage Example Here is how to search using all three engines asynchronously:
import asyncio
from search_wrapper import GoogleSearchFromSerper, DuckDuckGoSearch, BingSearch

async def main():
    # --- 1. Google Search (Requires API Key) ---
    # You can pass the key explicitly or rely on the env variable
    async with GoogleSearchFromSerper() as google:
        results = await google.search("OSINT tools python")
        print(f"Google found {len(results.get('data', []))} results")

    # --- 2. DuckDuckGo (No Key Needed) ---
    async with DuckDuckGoSearch() as ddg:
        results = await ddg.search("latest cybersecurity news")
        print(f"DuckDuckGo found {len(results.get('data', []))} results")

    # --- 3. Bing (Headless Browser) ---
    # use headless=False to see the browser action
    async with BingSearch(headless=True) as bing:
        results = await bing.search("site:linkedin.com python developer")
        print(f"Bing found {len(results.get('data', []))} results")

if __name__ == "__main__":
    asyncio.run(main())

Development notes

If you want to contribute or modify the source code:

  1. Clone the repository.
  2. Install in editable mode:
pip install -e
  1. Run tests using pytest (if available) or run the example scripts in tests/.

Contributing

Pull requests are welcome. For major changes, please open an issue first to discuss what you would like to change.


How to Update It (Step-by-Step)

Since you have already published to PyPI, you must bump the version number if you want the new README to appear on the PyPI website. PyPI only updates the description when a new version is uploaded.

1. Update the Version Open pyproject.toml and increase the version (e.g., from 0.1.4 to 0.1.5).

2. Commit the Changes Run these commands in your terminal:

# Add the modified README and pyproject.toml
git add README.md pyproject.toml

# Commit changes
git commit -m "Update README and bump version to 0.1.2"

# Push to Bitbucket
git push origin master

---

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

osint_search_engine_pkg-0.1.4.tar.gz (7.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

osint_search_engine_pkg-0.1.4-py3-none-any.whl (8.4 kB view details)

Uploaded Python 3

File details

Details for the file osint_search_engine_pkg-0.1.4.tar.gz.

File metadata

  • Download URL: osint_search_engine_pkg-0.1.4.tar.gz
  • Upload date:
  • Size: 7.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.14

File hashes

Hashes for osint_search_engine_pkg-0.1.4.tar.gz
Algorithm Hash digest
SHA256 a41548647aadb4f28d109595bf422eede157a56fb061a721fd3f48c88d047069
MD5 a01d573fe2ec87af525ce16464a66667
BLAKE2b-256 10fb94c0b336011ff961f00f720bc491f9d7f0dc01936aeceb730b9bcceab7b1

See more details on using hashes here.

File details

Details for the file osint_search_engine_pkg-0.1.4-py3-none-any.whl.

File metadata

File hashes

Hashes for osint_search_engine_pkg-0.1.4-py3-none-any.whl
Algorithm Hash digest
SHA256 d41e90039b68c06c8bfc8ddc4ddae330cf56c20aedaa8e89b63190dc6dc82d58
MD5 a1bf74321026aca0102cb3bc4a54c100
BLAKE2b-256 cf9c854ef63f25186f4f4bc9aefc020eb6045acc2733a92af1ae9f308b4b6161

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page