Skip to main content

Basic website cloner written in Python

Project description

Basic website cloner

Description:

  • This script is a basic website cloner that downloads all the files from a website and saves them in a folder.
  • It works by scraping all the links on the page, save them locally, and replace them with the local path.

Installation

From pypi.

pip3 install wclone

From source

git clone https://github.com/Simatwa/website-clone.git
cd website-cloner
bash install.sh

Usage

$ wclone <url>

More info:

  • In order to use the tor network, you need to download the tor package and start the tor service.

For further info run $ wclone --help

 usage: wclone [-h] [-v] [-tp PROXY]
              [-o FOLDER] [-w PATH]
              [--use-tor]
              host

Basic website cloner written in Python

positional arguments:                  host         URL pointing to a
               website               
options:
  -h, --help   show this help
               message and exit
  -v, ---version
               show program's
               version number and
               exit
  -tp PROXY, --tor-proxy PROXY
               Proxy server url
               without schema -
               localhost:9050
  -o FOLDER, --output FOLDER
               Folder for saving
               contents - host
  -w PATH, --workspace PATH
               Directory for saving
               contents - /data/dat
               a/com.termux/files/h
               ome/temp
  --use-tor    Use tor proxy -
               False

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

wclone-1.0.2.tar.gz (5.8 kB view hashes)

Uploaded Source

Built Distribution

wclone-1.0.2-py3-none-any.whl (6.2 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page