Skip to main content

The BingScraper is python3 package having function to extract the text and images content on search engine `bing.com`.

Project description



# Bing Scraper

The bingscraper is python3 package which extracts the text and images content on search engine bing.com.

It helps the user in a way that he/she will be getting only meaningful results and images for their search query. It does not download the ad content and hence saving data for the user.

The script working in background requests for a search term and creates directory (if not made previously) in the root directory of the script where all the content of the related particular search is stored. This script will be downloading the hypertext and hyperlink to that text and saving it to a .txt file within the directory made by itself. This directory saves the text content as well as the images downloaded using the script.

## Requirements 1. Modules:

  1. requests: For requesting content through two HTTPS Methods: GET and POST. Used GET Method.

  2. BeautifulSoup: For creating JSON like dictionary using HTML Parser. Package uses bs4.

  3. os: For checking and making directories.

  4. PIL.Image: Pillow Module. For extracting image content.

  5. io.ByteIO: For saving the extracted image using the PIL.Image.

  1. Internet Connection: Continuous high speed internet connection is required for the proper function of the python package as it continuously creates the copy of the images into the local machine.

  2. Python: Version 3.5.6 or above. This package is written in python 3.5.6

## Installation

For python installation:

pip install bingscraper or python -m pip install bingscraper

For Anaconda installation:

conda install bingscraper

## How to use

Install the above modules. Successful import of bingscraper depends only after the above imports.

Sample code in python:

import bingscraper as bs

search = str(input())

bs.scrape(search)

Function scrape() takes an string argument and does the scraping work.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

bingscraper-1.0.tar.gz (2.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

bingscraper-1.0-py3-none-any.whl (4.8 kB view details)

Uploaded Python 3

File details

Details for the file bingscraper-1.0.tar.gz.

File metadata

  • Download URL: bingscraper-1.0.tar.gz
  • Upload date:
  • Size: 2.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No

File hashes

Hashes for bingscraper-1.0.tar.gz
Algorithm Hash digest
SHA256 08ed422559974bf05ede4bc3c9fdc647e994c90be18a8f5318e7c56fc4312cd8
MD5 afaac4f2c24fc6b71c10df6c8ceabf35
BLAKE2b-256 76ab3f2a888e4d8209f0c4e34599ed6c00ab81ce5510fb32a9d5d848d353a24e

See more details on using hashes here.

File details

Details for the file bingscraper-1.0-py3-none-any.whl.

File metadata

File hashes

Hashes for bingscraper-1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 ca1aacb21f010792b992c25187ce793170c3fdfa1c9eaac7723d4353c6ed1cf3
MD5 7f63bc907b185e22c212cedebd7f5596
BLAKE2b-256 66485c617215d2ce6a7469f2032f70f1ea061b616d5dd627fed7bd23763b94fe

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page