Skip to main content
Help us improve Python packaging – donate today!

General purpose Python framework for writing highly scalable applications

Project Description

General purpose Python framework for writing highly scalable applications.

About

A typical application consists of several modules. Each module has its own process, stores a pidfile in ‘tmp/pids’, and has a logfile in ‘logs’.

A RPC protocol is implemented on top of zeromq in order to allow for inter-module communication. Modules have an auto-adjustable number of workers in order to cope with a high number of requests. These rpc requests will block until that module becomes available. Read more about zeromq at http://zguide.zeromq.org/

Each module consists of several gevent greenlets. A basic module will already contain a few greenlets that handle incoming rpc requests. You can spawn additional greenlets for your own needs. Read more about gevent at http://www.gevent.org/

Tasks

You can manage and debug your modules using built-in tasks. Type ‘cake’ at a bash prompt when inside your project to see available tasks and what they do. You can also define your own taks.

Commands

To create a new project:

$ pyscale new <name>

To generate a new module:

$ pyscale generate <name>

To start, stop, debug, view logs and more check out available cake tasks:

$ cake
$ cake start
$ cake stop
$ cake status
$ cake log
$ cake console

Usage

To execute an rpc request on another module:

self.sock('modname').method(*args, **kwargs)

You can also use properties, and chain requests:

self.sock('modname').prop.method()

You can also issue requests on all available modules:

self.multisock('*').method()

To spawn another greenlet in a module either use the ‘job’ decorator or:

self.jobs.spawn(func)

To debug your application use logs and the console.

Requirements

System Dependencies:
  • zeromq
  • atd
Python Dependencies:
  • pyzmq
  • gevent
  • gevent_zeromq
  • cake
  • argparse
  • jinja2
  • nose

Release history Release notifications

This version
History Node

0.1.1

History Node

0.1

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Filename, size & hash SHA256 hash help File type Python version Upload date
pyscale-0.1.1.tar.gz (16.3 kB) Copy SHA256 hash SHA256 Source None Feb 9, 2012

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging CloudAMQP CloudAMQP RabbitMQ AWS AWS Cloud computing Fastly Fastly CDN DigiCert DigiCert EV certificate StatusPage StatusPage Status page