A web scraping library and API for Google Maps
Project description
Google-Maps-Scrapper
This Python script utilizes the Playwright library to perform web scraping and data extraction from Google Maps. It is particularly designed for obtaining information about businesses, including their name, address, website, phone number, reviews, and more.
Table of Contents
Prerequisite
- This code requires a python version below 3.10
- Any version of python beyond 3.9 may cause issues and may not work properly
Key Features
-
Data Scraping: The script scrapes data from Google Maps listings, extracting valuable information about businesses, such as their name, address, website, and contact details.
-
Review Analysis: It extracts review counts and average ratings, providing insights into businesses' online reputation.
-
Business Type Detection: The script identifies whether a business offers in-store shopping, in-store pickup, or delivery services.
-
Operating Hours: It extracts information about the business's operating hours.
-
Introduction Extraction: The script also scrapes introductory information about the businesses when available.
-
Data Cleansing: It cleanses and organizes the scraped data, removing redundant or unnecessary columns.
-
CSV Export: The cleaned data is exported to a CSV file for further analysis or integration with other tools.
Installation
-
Clone this repository:
git clone git@github.com-personal:dilawaizkhan08/Google_Maps_Scraper.git
-
Navigate to the project directory:
cd Google_Maps-Scrapper
-
- Set up a virtual environment (optional but recommended):
python3 -m venv venv source venv/bin/activate # On Windows use `venv\Scripts\activate`
-
Install the required Python packages:
pip install -r requirements.txt
How to Use:
To use this script, follow these steps:
-
Run the script with Python:
python main.py
-
The script will launch a browser, perform the search, and start scraping information. It will display the progress and save the results to a CSV file called result.csv.
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file hexaa_business_scraper-0.1.2.tar.gz.
File metadata
- Download URL: hexaa_business_scraper-0.1.2.tar.gz
- Upload date:
- Size: 3.2 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.1.1 CPython/3.12.2
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
89e03a9b72b0a7c486be63efb0d727cf1b08b2a0c6a513f427d62467348f056f
|
|
| MD5 |
d4ea1baf4f85a7628031019552ee3d75
|
|
| BLAKE2b-256 |
36a408a16cdf8386ba368ae1d542e075804d6cd2a25ce7a40a67150fc4168c16
|
File details
Details for the file hexaa_business_scraper-0.1.2-py3-none-any.whl.
File metadata
- Download URL: hexaa_business_scraper-0.1.2-py3-none-any.whl
- Upload date:
- Size: 3.5 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.1.1 CPython/3.12.2
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
fafc7189ab16257d0e6bd8438fdbd7832d35dd0398920e4373ecf1c6d4d685b3
|
|
| MD5 |
39fedb48ae5a18bf093176e726454d00
|
|
| BLAKE2b-256 |
bd0311ba31df4a86ce2d238fb7b4fc737b220451791255afdaa240f94b27fcbb
|