scraply 1.0.2

A Python package to scrape and clone websites.

Scraply

Scraply is a Python package designed to scrape websites, extract all internal URLs, and clone pages by saving them as HTML files. You can use it through the command line interface or import it as a library in your Python scripts.

Features

• Scrape all internal URLs from a given website.
• Clone and save HTML content from all URLs or a specific URL.

Installation

Using pip

To install Scraply, use the following command:

pip install scraply

Usage

Scraping All URLs from a Website

import time
from scraply import scrape_urls

# URL to scrape
url = 'https://example.com'

# Scraping all URLs from the website
start_time = time.time()
urls = scrape_urls(url)

# Print the scraped URLs
for url in urls:
    print(url)

end_time = time.time()
print(f"Total scraping time: {end_time - start_time:.2f} seconds")

Cloning All Pages

from scraply import clone_page

# Clone each URL from a list
urls = ['https://example.com/privacy', 'https://example.com/about']

for url in urls:
    clone_page(url)

Cloning a Single Specific Page

from scraply import clone_page

# Clone a single page
clone_page('https://example.com/privacy')

License

This project is licensed under the MIT License.

Contributing

Feel free to fork, contribute, or open issues on the GitHub repository.

Author

Developed by Fidal.
Email: [e-mail] GitHub: mr-fidal