Skip to main content

A web scraping library and API for Google Maps

Project description

Google-Maps-Scrapper

This Python script utilizes the Playwright library to perform web scraping and data extraction from Google Maps. It is particularly designed for obtaining information about businesses, including their name, address, website, phone number, reviews, and more.

Table of Contents

Prerequisite

  • This code requires a python version below 3.10
  • Any version of python beyond 3.9 may cause issues and may not work properly

Key Features

  • Data Scraping: The script scrapes data from Google Maps listings, extracting valuable information about businesses, such as their name, address, website, and contact details.

  • Review Analysis: It extracts review counts and average ratings, providing insights into businesses' online reputation.

  • Business Type Detection: The script identifies whether a business offers in-store shopping, in-store pickup, or delivery services.

  • Operating Hours: It extracts information about the business's operating hours.

  • Introduction Extraction: The script also scrapes introductory information about the businesses when available.

  • Data Cleansing: It cleanses and organizes the scraped data, removing redundant or unnecessary columns.

  • CSV Export: The cleaned data is exported to a CSV file for further analysis or integration with other tools.

Installation

  1. Clone this repository:

    git clone git@github.com-personal:dilawaizkhan08/Google_Maps_Scraper.git
    
  2. Navigate to the project directory:

    cd Google_Maps-Scrapper
    
    1. Set up a virtual environment (optional but recommended):
    python3 -m venv venv
    source venv/bin/activate  # On Windows use `venv\Scripts\activate`
    
  3. Install the required Python packages:

    pip install -r requirements.txt
    

How to Use:

To use this script, follow these steps:

  1. Run the script with Python:

     python main.py 
    
  2. The script will launch a browser, perform the search, and start scraping information. It will display the progress and save the results to a CSV file called result.csv.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

hexaa_business_scraper-0.1.1.tar.gz (3.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

hexaa_business_scraper-0.1.1-py3-none-any.whl (3.5 kB view details)

Uploaded Python 3

File details

Details for the file hexaa_business_scraper-0.1.1.tar.gz.

File metadata

  • Download URL: hexaa_business_scraper-0.1.1.tar.gz
  • Upload date:
  • Size: 3.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.12.2

File hashes

Hashes for hexaa_business_scraper-0.1.1.tar.gz
Algorithm Hash digest
SHA256 35ab1df049830eee46a3faee2927394197adb9967b5107e58736132f61302e43
MD5 c13314e4d5a642b412ffaa33a19b2787
BLAKE2b-256 4df42dfcd74627edb7a3a3e511d7979f61983fcaf01e83c6511e23bd8a26579a

See more details on using hashes here.

File details

Details for the file hexaa_business_scraper-0.1.1-py3-none-any.whl.

File metadata

File hashes

Hashes for hexaa_business_scraper-0.1.1-py3-none-any.whl
Algorithm Hash digest
SHA256 abb76e3f98b3c12e1588fb977b83ad69fefe335845d84aba0ba608c69e12b786
MD5 b8c318014d8b1b021013a3a9fbb68e46
BLAKE2b-256 91c4436ce21283c022a00ec485dc58d189f89b6300e40426ea82c5189c05a3bd

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page