SpiderBOY 1.0.0

A tipical crawler, returns a list of urls

# Copyright (C) 2011 Diego Pardilla Mata
#
# This file is part of SpiderBOY.
#
# SpiderBOY is free software: you can redistribute it and/or modify
# it under the terms of the GNU General Public License as published by
# the Free Software Foundation, either version 3 of the License, or
# (at your option) any later version.
#
# This program is distributed in the hope that it will be useful,
# but WITHOUT ANY WARRANTY; without even the implied warranty of
# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
# GNU General Public License for more details.
#
# You should have received a copy of the GNU General Public License
# along with this program. If not, see <http://www.gnu.org/licenses/>.

This is the SpiderBoy crawler.

It has (among others) the following major features

Search URL's from another URL and with a depth indicated

Installation:

See INSTALL file for information on how to install SpiderBOY

Starting SpiderBOY:

run from the command line: `spiderboy.py [-h] [-n NUMBER_OF_LEVELS] [url]'
run `spiderboy.py -h' for more startup options

More information:

http://code.sidelab.es/projects/diegopardilla/wiki

Written by:

see AUTHORS for more information

Reporting Bugs:

Please report bugs to our mailing list or our bugtracker:
[e-mail]
[e-mail]
http://code.sidelab.es/projects/diegopardilla/issues/new

Contacting us:

http://packages.python.org/SpiderBOY (homepage)
[e-mail] (mUniKeS)
[e-mail] (Diego Pardilla)