bing-results-scraper 0.5.0

Bing Search Scraper - A Python library for retrieving search results from Bing

Bing Search Scraper

Overview

Easily scrape Bing search results using Python. This library leverages requests for making HTTP requests and BeautifulSoup for parsing HTML content. It offers both synchronous and asynchronous functionality for efficient retrieval of results.

Installation

Install via pip:

pip install bing-results-scraper

Usage

Synchronous Usage:

from bing_results_scraper import BingScraper

# Create a scraper instance
bing = BingScraper() #headers=Optional(default header will be used), max_retries=Optional(default: 3), num_results=Optional(default: 10)

# Fetch results for a single query
results = bing.get_results(q='Query')

# Access the results
print(results['organic_results'])

Asynchronous Usage:

from bing_results_scraper import AsyncBingScraper

# Create an asynchronous scraper instance
async_bing = AsyncBingScraper()#headers=Optional, max_retries=Optional(default: 3), num_results=Optional(default: 10), error_sleep=Optional(default: 1), hits_at_a_time=Optional(default: 30)

# Fetch results for multiple queries
queries = ['Query 1', 'Query 2', 'Query 3']
results = async_bing.get_results(queries)

# Access the results for each query
for result in results:
    print(result['organic_results'])

Features

• Synchronous and asynchronous scraping options
• Customizable headers
• Automatic query URL encoding
• Response status handling
• Retries for failed requests
• Parsed organic result data extraction
• Clear output structure

Contributing

Contributions are welcome! Please follow the standard fork-and-pull request workflow on GitHub.

Author

Renukumar R

• LinkedIn: https://www.linkedin.com/in/renukumar-r/
• GitHub: https://github.com/Renukumar-R