Skip to main content

A web scraping library and API for Google Maps

Project description

Google-Maps-Scrapper

This Python script utilizes the Playwright library to perform web scraping and data extraction from Google Maps. It is particularly designed for obtaining information about businesses, including their name, address, website, phone number, reviews, and more.

Table of Contents

Prerequisite

  • This code requires a python version below 3.10
  • Any version of python beyond 3.9 may cause issues and may not work properly

Key Features

  • Data Scraping: The script scrapes data from Google Maps listings, extracting valuable information about businesses, such as their name, address, website, and contact details.

  • Review Analysis: It extracts review counts and average ratings, providing insights into businesses' online reputation.

  • Business Type Detection: The script identifies whether a business offers in-store shopping, in-store pickup, or delivery services.

  • Operating Hours: It extracts information about the business's operating hours.

  • Introduction Extraction: The script also scrapes introductory information about the businesses when available.

  • Data Cleansing: It cleanses and organizes the scraped data, removing redundant or unnecessary columns.

  • CSV Export: The cleaned data is exported to a CSV file for further analysis or integration with other tools.

Installation

  1. Clone this repository:

    git clone git@github.com-personal:dilawaizkhan08/Google_Maps_Scraper.git
    
  2. Navigate to the project directory:

    cd Google_Maps-Scrapper
    
    1. Set up a virtual environment (optional but recommended):
    python3 -m venv venv
    source venv/bin/activate  # On Windows use `venv\Scripts\activate`
    
  3. Install the required Python packages:

    pip install -r requirements.txt
    

How to Use:

To use this script, follow these steps:

  1. Run the script with Python:

     python main.py 
    
  2. The script will launch a browser, perform the search, and start scraping information. It will display the progress and save the results to a CSV file called result.csv.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

hexaa_business_scraper-0.1.3.tar.gz (3.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

hexaa_business_scraper-0.1.3-py3-none-any.whl (3.5 kB view details)

Uploaded Python 3

File details

Details for the file hexaa_business_scraper-0.1.3.tar.gz.

File metadata

  • Download URL: hexaa_business_scraper-0.1.3.tar.gz
  • Upload date:
  • Size: 3.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.12.2

File hashes

Hashes for hexaa_business_scraper-0.1.3.tar.gz
Algorithm Hash digest
SHA256 5b16ab15fe86fcada8a1ee8ed76a21806d87827846c872cd81a1093e2dab096c
MD5 bc83539dff9bbc36bafd63eb628cb830
BLAKE2b-256 e7951f1f4d16ccd215761f24a22be1a3e6734f5e002dc6db4624eda0b9238853

See more details on using hashes here.

File details

Details for the file hexaa_business_scraper-0.1.3-py3-none-any.whl.

File metadata

File hashes

Hashes for hexaa_business_scraper-0.1.3-py3-none-any.whl
Algorithm Hash digest
SHA256 49cfc351d8b4e5d18b4b78b71a4780a846d7fe26a22deae900a8db54083b60c9
MD5 3264969bf0b65a7d9b950e0c9bd2dda3
BLAKE2b-256 ca127ad49aa8f2883be9e39dc30d3fd6d85e1a8759c2179c514c65d08bbfb14c

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page