Skip to main content

SPyDI: Simple Python Distributed Indexing

Project description

SPyDI Is a powerful engine to create distributed full text indexing systems

and distributed search engines. It supports harvesting, crawling (pull mehtods), and push methods (via a Web interface or SPyRO Web services). It supports boolean and vector Information retrieval models. It has few dependencies, and comes with its own HTTP server and HTML embedded pages language (called pyew and wey pages), and session manager. It can use the SMTP of the Python library. It supports replacing the default modules with some better modules (Apache, exim, etc).

Release notes: Better exception handler in distributors Bug fixes in the distributors

Many bugfixes in UI of search and uindex pages More and better support for distributed queries in the UI

Some minor (rare exceptions) bugfixes in spydex.py Addition of word expansion to the vectorizer Query resolver now searches for keywords without query terms Improvement of other methods

common.py is now used to put some common functions and procedures to UI interfaces (typically searching)

Addition of mimes to make a simple and fast mime handling

repository pyew page now sent the mime type

Repository bug fixes

And more bug fixes and enhancements

Project details


Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page