digs 0.1.1

For those who need to extract text to some depth over a website. Scraping Tasks

Digs

Just making easy the text crawling task over websites.

Usage

You want to extract all text data from a url website to your current directory:

digs http://thewebsite.com

You can add the option –depth=LEVEL to perform over the root domain (website) a search to get all the text data:

digs http://thewebsite.com --depth=3

Be careful, with a high level, the tree search grows exponentially.

Also, you can use the graphical interface (if you have installed PySide):

digs -i

You should something like this:

Installation

pip install digs

Requirements

requirements.txt

digs was written by Jonathan S. Prieto C..