PyScrap Tool

Features

• Command-Line Interface (CLI): Easily scrape data directly from the terminal using command-line arguments.
• Custom HTML Tag Scraping: Specify which HTML tag to scrape from the webpage, allowing for flexible data extraction.
• Data Output: Print scraped data to the console and save it to a CSV file for further analysis.
• Versioning: Check the version of the tool using command-line options.

Installation

Option 1: Install from PyPI

To install pyscrap-tool directly from PyPI:

pip install pyscrap-tool

Option 2: Build from Source

For those who prefer to build it themselves:

1. Clone the repository and navigate to the project directory:

   git clone https://github.com/h471x/web_scraper.git
   cd web_scraper
   

2. Build the package:

   python setup.py sdist bdist_wheel
   

3. Install the package:

   pip install dist/*.whl
   

Usage

Once the package is installed, you can use the pyscrap command from the terminal. The script accepts the following command-line arguments:

• URL:

  • -l or --link: Specify the URL of the webpage to scrape.

• HTML Tag:

  • -t or --tag: Specify the HTML tag to scrape (e.g., article, div).

• Version:

  • -v or --version: Display the version of the tool.

Example Usage

1. Basic Scrape:

   pyscrap -l https://example.com -t article
   

2. Display Version:

   pyscrap -v
   

3. Help Option: For help with command-line options, use:

   pyscrap -h
   

Development

To modify or extend the functionality, ensure you have the required dependencies installed. You can add new features to the CLI as needed.

Contributing

Feel free to fork this repository, open issues, or submit pull requests with improvements or bug fixes. Your contributions help make the PyScrap Tool better!