Skip to main content

Utilities for gevent.

There’re several gevent.Greenlet subclasses:

  • Processlet – maximizing multi-core use in gevent environment.

  • Transparentlet – keeping exc_info rather than printing exception.

And etc.:

  • ObjectPool – pooling objects. (e.g. connection pool)

See the next examples.

Examples

Processlet for bcrypt

bcrypt is a library to hash password. That the hashing is very heavy CPU-bound task. You can’t guarantee concurrency with only gevent. Use Processlet instead:

import bcrypt
import gevent
from lets import Processlet

# bcrypt.hashpw is very heavy cpu-bound task.  it can spend a few seconds.
def hash_password(password, salt=bcrypt.gensalt()):
    return bcrypt.hashpw(str(password), salt)

def tictoc(delay=0.1):
    while True:
        print '.'
        gevent.sleep(delay)

passwords = ['alfa', 'bravo', 'charlie', 'delta', 'echo', 'foxtrot',
             'golf', 'hotel', 'india', 'juliett', 'kilo', 'lima', 'mike',
             'november', 'oscar', 'papa', 'quebec', 'romeo', 'sierra',
             'tango', 'uniform', 'victor', 'whiskey', 'xray', 'yankee',
             'zulu']

# start tictoc
gevent.spawn(tictoc)

# Greenlet, tictoc pauses for a few seconds
greenlet = gevent.spawn(hash_password, passwords[0])
password_hash_0 = greenlet.get()

# Processlet, tictoc never pauses
processlet_1 = Processlet.spawn(hash_password, passwords[1])
processlet_2 = Processlet.spawn(hash_password, passwords[2])
password_hash_1 = processlet_1.get()
password_hash_2 = processlet_2.get()

You can also limit the number of child processes with ProcessPool:

import multiprocessing
from lets import ProcessPool

pool_size = max(multiprocessing.cpu_count() - 1, 1)
pool = ProcessPool(pool_size)
password_hashes = pool.map(hash_password, passwords)

Memcached connection pool

Greenlet-safe connection pool can be easily implemented by ObjectPool:

import memcache
from lets import ObjectPool

mc_pool = ObjectPool(10, memcache.Client, [('localhost', 11211)])

def save(key, val):
    with mc_pool.reserve() as mc:
        mc.set(key, val)

for x, password_hash in enumerate(password_hashes):
    gevent.spawn(save, 'password_hashes[%d]' % x, password_hash)

gevent.wait()

Metadata

Release files for lets 0.1.6

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for lets 0.1.6
File Size Uploaded
lets-0.1.6.tar.gz 12.9 kB Details

Release files / lets-0.1.6.tar.gz

Download URL lets-0.1.6.tar.gz
Size 12.9 kB
Tags Source
SHA-256 checksum
How to use checksums
eb8eb75e2c1360dea8d2edab41722107b266738a69f8d3d067204b3e4378657e
BLAKE2b-256 checksum
How to use checksums
926a4a60459bbda076ee1d032b5760ca94d1d6055e856bdd886e06faba023cb6
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No

Release history Release notifications | RSS feed

This release

0.1.6 This release

1 release file

0.1.5

1 release file

0.1.4

1 release file

0.1.3

1 release file

0.1.2

1 release file

0.1.1

1 release file

0.1.0

1 release file

0.0.28

1 release file

0.0.27

1 release file

0.0.26

1 release file

0.0.25

1 release file

0.0.24

1 release file

0.0.23

1 release file

0.0.22

1 release file

0.0.21

1 release file

0.0.20

1 release file

0.0.19

1 release file

0.0.18

1 release file

0.0.17

1 release file

0.0.16

1 release file

0.0.15

1 release file

0.0.14

1 release file

0.0.13

1 release file

0.0.12

1 release file

0.0.11

1 release file

0.0.10

1 release file

0.0.9

1 release file

0.0.8

1 release file

0.0.7

1 release file

0.0.6

1 release file

0.0.5

1 release file

0.0.4

1 release file

0.0.3

1 release file

0.0.2

1 release file

0.0.1

1 release file

0.0.0

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page