Skip to main content

Bing Search Scraper - A Python library for retrieving search results from Bing

Project description

Bing Search Scraper

Overview

Easily scrape Bing search results using Python. This library leverages requests for making HTTP requests and BeautifulSoup for parsing HTML content. It offers both synchronous and asynchronous functionality for efficient retrieval of results.

Installation

Install via pip:

pip install bing-results-scraper

Usage

Synchronous Usage:

from bing_results_scraper import BingScraper

# Create a scraper instance
bing = BingScraper(headers=Optional, max_retries=Optional(default: 3), num_results=Optional(default: 10))

# Fetch results for a single query
results = bing.get_results(q='Query')

# Access the results
print(results['organic_results'])

Asynchronous Usage:

from bing_results_scraper import AsyncBingScraper

# Create an asynchronous scraper instance
async_bing = AsyncBingScraper(headers=Optional, max_retries=Optional(default: 3), num_results=Optional(default: 10))

# Fetch results for multiple queries
queries = ['Query 1', 'Query 2', 'Query 3']
results = async_bing.get_results(queries)

# Access the results for each query
for result in results:
    print(result['organic_results'])

Features

  • Synchronous and asynchronous scraping options
  • Customizable headers
  • Automatic query URL encoding
  • Response status handling
  • Retries for failed requests
  • Parsed organic result data extraction
  • Clear output structure

Contributing

Contributions are welcome! Please follow the standard fork-and-pull request workflow on GitHub.

Author

Renukumar R

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

bing-results-scraper-0.3.1.tar.gz (5.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

bing_results_scraper-0.3.1-py3-none-any.whl (6.7 kB view details)

Uploaded Python 3

File details

Details for the file bing-results-scraper-0.3.1.tar.gz.

File metadata

  • Download URL: bing-results-scraper-0.3.1.tar.gz
  • Upload date:
  • Size: 5.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.10.9

File hashes

Hashes for bing-results-scraper-0.3.1.tar.gz
Algorithm Hash digest
SHA256 29b6c1c6eacd2a9dd6d8816df75ad8b0dd21555a0d2b99dc3e759fd66372525e
MD5 e605e201c51c98c95cc2a360849d4e4d
BLAKE2b-256 3b642c4e3589503b8e7db1856c002b075400c89d2d0d60765ba1a5d1b5e1bb9e

See more details on using hashes here.

File details

Details for the file bing_results_scraper-0.3.1-py3-none-any.whl.

File metadata

File hashes

Hashes for bing_results_scraper-0.3.1-py3-none-any.whl
Algorithm Hash digest
SHA256 d6f038db2423d1eeebabe5339c6de94e134bc55710a1c3175fa4eb16f4b1766b
MD5 43013f73b3eee98f760d1334ebe0306f
BLAKE2b-256 c2a12a04171361eded0821f534819e0ddec757dd3e00372db4be39a015337527

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page