Basic website cloner written in Python
Project description
Basic website cloner
Description:
- This script is a basic website cloner that downloads all the files from a website and saves them in a folder.
- It works by scraping all the links on the page, save them locally, and replace them with the local path.
Installation
From pypi.
pip3 install wclone
From source
git clone https://github.com/Simatwa/website-clone.git
cd website-cloner
bash install.sh
Usage
$ wclone <url>
More info:
- In order to use the tor network, you need to download the tor package and start the tor service.
For further info run $ wclone --help
For further info run $ wclone --help
usage: wclone [-h] [-v] [-tp PROXY]
[-o FOLDER] [-w PATH]
[--use-tor]
host
Basic website cloner written in Python
positional arguments: host URL pointing to a
website
options:
-h, --help show this help
message and exit
-v, ---version
show program's
version number and
exit
-tp PROXY, --tor-proxy PROXY
Proxy server url
without schema -
localhost:9050
-o FOLDER, --output FOLDER
Folder for saving
contents - host
-w PATH, --workspace PATH
Directory for saving
contents - /data/dat
a/com.termux/files/h
ome/temp
--use-tor Use tor proxy -
False
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
wclone-1.0.2.tar.gz
(5.8 kB
view details)
Built Distribution
File details
Details for the file wclone-1.0.2.tar.gz
.
File metadata
- Download URL: wclone-1.0.2.tar.gz
- Upload date:
- Size: 5.8 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.9.17
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 564155f95670a3c442515afc2563857dae37632f80668d06cafe9a8d009fdaa4 |
|
MD5 | 3fcee3d5598335e83bbd0c7a88838292 |
|
BLAKE2b-256 | ab5643f8b5b3b4cc68d74d044db64f6c2e2f282ccae243b45d9bbce0f8ce0f8f |
File details
Details for the file wclone-1.0.2-py3-none-any.whl
.
File metadata
- Download URL: wclone-1.0.2-py3-none-any.whl
- Upload date:
- Size: 6.2 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.9.17
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 91cad2a6acee9af3eef27b4e781719267af5da9110b1cb60e7d4ef729c8fbd36 |
|
MD5 | 9d6ed65c9f8bcd1eac04e2519eaa98cd |
|
BLAKE2b-256 | 2fa6bba2a20fc3901f7a5c535513db7fde35b36c9e4e01bbc2261b386b2cb188 |