Skip to main content

A web scraping API that allows users to easily extract data from any website by simply providing the URL. The API utilizes advanced parsing and data storage techniques to ensure accurate and efficient data extraction. The package is easy to install and use, making it perfect for data scientists, researchers, and developers looking to quickly and easily access web data.

Project description

WebScraperAPI

A web scraping API that allows users to easily extract data from any website by simply providing the URL. The API utilizes advanced parsing and data storage techniques to ensure accurate and efficient data extraction. The package is easy to install and use, making it perfect for data scientists, researchers, and developers looking to quickly and easily access web data.

Installation

To install the package, use pip:

pip install WebScraperAPI

Usage

You can use the package by importing it in your code and using the scrape function.

from WebScraperAPI.scraper import Scraper
from WebScraperAPI.parser import Parser
from WebScraperAPI.data_storage import DataStorage

url = 'https://example.com'

# Scrape the data from the website
scraper_obj = Scraper(url)
data = scraper_obj.get_html()

if data:
    # Parse the data
    parser_obj = Parser(data)
    parsed_data = parser_obj.parse_data()

    # Save the data to a CSV file
    file_name = 'example_output.csv'
    data_storage_obj = DataStorage(parsed_data, file_name)
    data_storage_obj.save_data()
else:
    print("An error occurred while scraping the website")

Dependencies

beautifulsoup4
requests

Contributing

If you want to contribute to this project, please fork the repository and make a pull request.

License

This project is licensed under the MIT License.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

WebScraperAPI-1.0.4.tar.gz (3.5 kB view details)

Uploaded Source

File details

Details for the file WebScraperAPI-1.0.4.tar.gz.

File metadata

  • Download URL: WebScraperAPI-1.0.4.tar.gz
  • Upload date:
  • Size: 3.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.11.1

File hashes

Hashes for WebScraperAPI-1.0.4.tar.gz
Algorithm Hash digest
SHA256 9b2c471144af4060ad3acc40097d12ecd7e5eda190eb8ccc637d49c153eac7a5
MD5 737f33d8d6158aeecf50a67f4527e394
BLAKE2b-256 df9ac56f4e07fff93906a1228cb6026ae0acd87ffc82ef52510322edfc2ffaa7

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page