digs 0.1.7

Installation

pip install digs

or

pip install --upgrade digs

Usage

Common use will be extract the text from a website, the following call from terminal is the way to do that:

digs http://thewebsite.com

Also, you can add the option –depth=LEVEL to perform over the root domain (website) a crawling with the specific depth:

digs http://thewebsite.com --depth=3

Be careful, with high levels, the tree asociated to those crawlings grows exponentially in size.

And last but not the least, you can turn on a graphical interface (if you have installed PySide) with the following call from terminals:

digs -i

It will be look something like this:

About requirements

Look at requirements in the file: :

requirements.txt

digs was written by Jonathan S. Prieto C..

0.1.6 (2015-08-18)

• fixed bugs relate with lxml dependencies and linkGrabber imports

• Add extra_require, PySide if you want to run the graphical interface

0.1.5 (2015-07-12)

• After the pull-request to linkGrabber package, it has include in the requirements.

• Some improvements for GUI

0.1.4 (2015-07-07)

• MANIFEST.in add for some OS that they need it.

• The gui already show the INFO level for debugging by default

0.1.0 (2015-07-06)

• First release on PyPI.