Skip to main content

Basic website cloner written in Python

Project description

Basic website cloner

Description:

  • This script is a basic website cloner that downloads all the files from a website and saves them in a folder.
  • It works by scraping all the links on the page, save them locally, and replace them with the local path.

Installation

From pypi.

pip3 install wclone

From source

git clone https://github.com/Simatwa/website-clone.git
cd website-cloner
bash install.sh

Usage

$ wclone <url>

More info:

  • In order to use the tor network, you need to download the tor package and start the tor service.

For further info run $ wclone --help

 usage: wclone [-h] [-v] [-tp PROXY]
              [-o FOLDER] [-w PATH]
              [--use-tor]
              host

Basic website cloner written in Python

positional arguments:                  host         URL pointing to a
               website               
options:
  -h, --help   show this help
               message and exit
  -v, ---version
               show program's
               version number and
               exit
  -tp PROXY, --tor-proxy PROXY
               Proxy server url
               without schema -
               localhost:9050
  -o FOLDER, --output FOLDER
               Folder for saving
               contents - host
  -w PATH, --workspace PATH
               Directory for saving
               contents - /data/dat
               a/com.termux/files/h
               ome/temp
  --use-tor    Use tor proxy -
               False

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

wclone-1.0.2.tar.gz (5.8 kB view details)

Uploaded Source

Built Distribution

wclone-1.0.2-py3-none-any.whl (6.2 kB view details)

Uploaded Python 3

File details

Details for the file wclone-1.0.2.tar.gz.

File metadata

  • Download URL: wclone-1.0.2.tar.gz
  • Upload date:
  • Size: 5.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.9.17

File hashes

Hashes for wclone-1.0.2.tar.gz
Algorithm Hash digest
SHA256 564155f95670a3c442515afc2563857dae37632f80668d06cafe9a8d009fdaa4
MD5 3fcee3d5598335e83bbd0c7a88838292
BLAKE2b-256 ab5643f8b5b3b4cc68d74d044db64f6c2e2f282ccae243b45d9bbce0f8ce0f8f

See more details on using hashes here.

File details

Details for the file wclone-1.0.2-py3-none-any.whl.

File metadata

  • Download URL: wclone-1.0.2-py3-none-any.whl
  • Upload date:
  • Size: 6.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.9.17

File hashes

Hashes for wclone-1.0.2-py3-none-any.whl
Algorithm Hash digest
SHA256 91cad2a6acee9af3eef27b4e781719267af5da9110b1cb60e7d4ef729c8fbd36
MD5 9d6ed65c9f8bcd1eac04e2519eaa98cd
BLAKE2b-256 2fa6bba2a20fc3901f7a5c535513db7fde35b36c9e4e01bbc2261b386b2cb188

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page