Digs
Making easier the text crawling tasks over websites with depth levels.
Installation
pip install digs
or
pip install --upgrade digs
Usage
Common use will be extract the text from a website, the following call from terminal is the way to do that:
digs http://thewebsite.com
Also, you can add the option –depth=LEVEL to perform over the root domain (website) a crawling with the specific depth:
digs http://thewebsite.com --depth=3
Be careful, with high levels, the tree asociated to those crawlings grows exponentially in size.
And last but not the least, you can turn on a graphical interface (if you have installed PySide) with the following call from terminals:
digs -i
It will be look something like this:
About requirements
Look at requirements in the file: :
requirements.txt
digs was written by Jonathan S. Prieto C..
Changelog
0.1.6 (2015-08-18)
fixed bugs relate with lxml dependencies and linkGrabber imports
Add extra_require, PySide if you want to run the graphical interface
0.1.5 (2015-07-12)
After the pull-request to linkGrabber package, it has include in the requirements.
Some improvements for GUI
0.1.4 (2015-07-07)
MANIFEST.in add for some OS that they need it.
The gui already show the INFO level for debugging by default
0.1.0 (2015-07-06)
First release on PyPI.
1 maintainer
Metadata
1 maintainer
Release files for digs 0.1.7
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | |
|---|---|---|---|---|
| digs-0.1.7.tar.gz | 12.8 kB | Without provenance | Details |
Release files / digs-0.1.7.tar.gz
| Download URL | digs-0.1.7.tar.gz |
|---|---|
| Size | 12.8 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
c54a0439f257ccabcbf7b90ecf0022db1d18f1b750949bca443278438c49de71
|
|
BLAKE2b-256 checksum How to use checksums |
2d17cb6525204a4917eeff45d48e6f32c3d8a4f118296bf155dc42dd588f3333
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
Security for digs 0.1.7
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
