Basic website cloner

Description:

This script is a basic website cloner that downloads all the files from a website and saves them in a folder.
It works by scraping all the links on the page, save them locally, and replace them with the local path.

Installation

From pypi.

pip3 install wclone

From source

git clone https://github.com/Simatwa/website-clone.git
cd website-cloner
bash install.sh

Usage

$ wclone <url>

More info:

In order to use the tor network, you need to download the tor package and start the tor service.

For further info run $ wclone --help

 usage: wclone [-h] [-v] [-tp PROXY]
              [-o FOLDER] [-w PATH]
              [--use-tor]
              host

Basic website cloner written in Python

positional arguments:                  host         URL pointing to a
               website               
options:
  -h, --help   show this help
               message and exit
  -v, ---version
               show program's
               version number and
               exit
  -tp PROXY, --tor-proxy PROXY
               Proxy server url
               without schema -
               localhost:9050
  -o FOLDER, --output FOLDER
               Folder for saving
               contents - host
  -w PATH, --workspace PATH
               Directory for saving
               contents - /data/dat
               a/com.termux/files/h
               ome/temp
  --use-tor    Use tor proxy -
               False

Release files for wclone 1.0.2

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for wclone 1.0.2
File	Size	Uploaded
wclone-1.0.2.tar.gz	5.8 kB	Jun 10, 2023	Details

Built distribution (wheel)

Table of built distributions (wheels) for wclone 1.0.2
File	Interpreter	ABI	Platform	Reset
wclone-1.0.2-py3-none-any.whl 6.2 kB Jun 10, 2023	Python 3	none	any	Details

Total release size: 11.9 kB

Release files / wclone-1.0.2.tar.gz

Download URL	wclone-1.0.2.tar.gz
Size	5.8 kB
Tags	Source
SHA-256 checksum How to use checksums	`564155f95670a3c442515afc2563857dae37632f80668d06cafe9a8d009fdaa4`
BLAKE2b-256 checksum How to use checksums	`ab5643f8b5b3b4cc68d74d044db64f6c2e2f282ccae243b45d9bbce0f8ce0f8f`
Upload date	Jun 10, 2023
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/4.0.2 CPython/3.9.17`

Release files / wclone-1.0.2-py3-none-any.whl

Download URL	wclone-1.0.2-py3-none-any.whl
Size	6.2 kB
Tags	Python 3
SHA-256 checksum How to use checksums	`91cad2a6acee9af3eef27b4e781719267af5da9110b1cb60e7d4ef729c8fbd36`
BLAKE2b-256 checksum How to use checksums	`2fa6bba2a20fc3901f7a5c535513db7fde35b36c9e4e01bbc2261b386b2cb188`
Upload date	Jun 10, 2023
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/4.0.2 CPython/3.9.17`