Installation
$ pip install spiderfetch
$ spiderfetchUsage
Fetching
Fetch all urls matching 2008.*.ogg from a page:
$ spiderfetch http://www.fosdem.org/2008/media/video 2008.*oggTo dump the urls to a file instead of fetching:
$ spiderfetch http://www.fosdem.org/2008/media/video 2008.*ogg --dump > urlsSpidering
Spider a site to depth 3 while pausing 2 seconds between fetches. The urls that will be considered when spidering must match .*:
$ spiderfetch --host http://en.wikipedia.org --depth 3 --pause 2 '.*'1 maintainer
Metadata
1 maintainer
Release files for spiderfetch 0.4.9
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| spiderfetch-0.4.9.tar.gz | 18.0 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| spiderfetch-0.4.9-py2.py3-none-any.whl | Python 2, Python 3 | none | any | Details |
Total release size: 41.9 kB
Release files / spiderfetch-0.4.9.tar.gz
| Download URL | spiderfetch-0.4.9.tar.gz |
|---|---|
| Size | 18.0 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
6598628fcd573d24279530abcf5ad1a142b4eba462f869fbcd8360b0640f0560
|
|
BLAKE2b-256 checksum How to use checksums |
6052a6b6b7dd217c5290d47cfc2279f2a80fbd6f7f9d2b60afa1268b2edbd8ff
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
Release files / spiderfetch-0.4.9-py2.py3-none-any.whl
| Download URL | spiderfetch-0.4.9-py2.py3-none-any.whl |
|---|---|
| Size | 24.0 kB |
| Tags | Python 2 Python 3 |
|
SHA-256 checksum How to use checksums |
a8d26d909299edfe00064ecc4263e86834637b0ce447a0202bdbadd79cd065c5
|
|
BLAKE2b-256 checksum How to use checksums |
8f910194d07bd954e067019153d07dc9a7a0160331ea793aac6a2168765fe32f
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
