Skip to main content

Dispatch TiddlyWeb jobs using beanstalkd

Project description

A TiddlyWeb plugin to dispatch tiddlers to asynchronous job queues.

This plugin uses beanstalkd to provide an in memory queing system
holding queues to external processes which will do something with
the information in the queue. The general goal is to allow processing
of tiddlers asynchronously: For example to do indexing, send mail,
etc.

The general model goes as follows:

* In init() of the plugin two things happen:
** a Store HOOK for tiddler put and delete is registered, that hooke has
one job: put a message in the default queue of beanstalkd
** N+1 external process are either forked or if launched by some other
mechanism, registered. The '1' processs listens on the default
queue and writes the tiddler ID into a queue named after each of
the N external processes (e.g. a tube named 'index')

* Each of the process listening on non-default tubes, processes
the tiddler, and then deletes it from the queue.

This is _highly_ experimental. You will need to be able to compile
beanstalkd in order to use this.

External requirements are:

client: http://github.com/earl/beanstalkc
server: http://github.com/kr/beanstalkd

Copyright 2010, Chris Dent <cdent@peermore.com>
BSD License

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Filename, size & hash SHA256 hash help File type Python version Upload date
tiddlywebplugins.dispatcher-0.9.tar.gz (5.0 kB) Copy SHA256 hash SHA256 Source None

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN SignalFx SignalFx Supporter DigiCert DigiCert EV certificate StatusPage StatusPage Status page