This is a pre-production deployment of Warehouse, however changes made here WILL affect the production instance of PyPI.
Latest Version Dependencies status unknown Test status unknown Test coverage unknown
Project Description

Overview

filequeue is a Python library that provides a thread-safe queue which is a subclass of Queue.Queue from the stdlib.

filequeue.FileQueue will overflow into a compressed file if the number of items exceeds maxsize, instead of blocking or raising Full like the regular Queue.Queue.

There is also filequeue.PriorityFileQueue and filequeue.LifoFileQueue implementations.

Note filequeue.FileQueue and filequeue.LifoFileQueue will only behave the same as Queue.Queue and Queue.LifoQueue respectively if they are initialised with maxsize=0 (the default). See __init__ docstring for details (help(FileQueue))

Note filequeue.PriorityFileQueue won’t currently work exactly the same as a straight out replacement for Queue.PriorityQueue. The interface is very slightly different (extra optional kw argument on put and __init__), although it will work it won’t behave the same. It might still be useful to people though and hopefully I’ll be able to address this in a future version.

Requirements:

  • Python 2.5+ or Python 3.x

Why?

The motivation came from wanting to queue a lot of work, without consuming lots of memory.

The interface of filequeue.FileQueue matches that of Queue.Queue (or queue.Queue in python 3.x). With the idea being that most people will use Queue.Queue, and can swap in a filequeue.FileQueue only if the memory usage becomes an issue. (Same applies for filequeue.LifoFileQueue)

Licence

Made available as-is under the BSD Licence.

Issues

Any issues please post on the github page.

Changelog

0.3.1 (2013-01-10)

  • Added unittests for LifoFileQueue from Queue.

0.3.0 (2013-01-10)

  • Added LifoFileQueue implementation that returns the most recently added items first.
  • Reverted the file type from gzip to a regular file for the time being.

0.2.3 (2012-11-27)

  • Fix for PriorityFileQueue where it wasn’t returning items in the correct order according to the priority.
  • Added import * into __init__.py to make the namespace a bit nicer.
  • Added the unit tests from stdlibs Queue (quickly edited out the full checks and LifoQueue tests).

0.2.2 (2012-11-27)

  • Initial public release.
Release History

Release History

0.3.1

This version

History Node

TODO: Figure out how to actually get changelog content.

Changelog content for this version goes here.

Donec et mollis dolor. Praesent et diam eget libero egestas mattis sit amet vitae augue. Nam tincidunt congue enim, ut porta lorem lacinia consectetur. Donec ut libero sed arcu vehicula ultricies a non tortor. Lorem ipsum dolor sit amet, consectetur adipiscing elit.

Show More

0.3.0

History Node

TODO: Figure out how to actually get changelog content.

Changelog content for this version goes here.

Donec et mollis dolor. Praesent et diam eget libero egestas mattis sit amet vitae augue. Nam tincidunt congue enim, ut porta lorem lacinia consectetur. Donec ut libero sed arcu vehicula ultricies a non tortor. Lorem ipsum dolor sit amet, consectetur adipiscing elit.

Show More

0.2.3

History Node

TODO: Figure out how to actually get changelog content.

Changelog content for this version goes here.

Donec et mollis dolor. Praesent et diam eget libero egestas mattis sit amet vitae augue. Nam tincidunt congue enim, ut porta lorem lacinia consectetur. Donec ut libero sed arcu vehicula ultricies a non tortor. Lorem ipsum dolor sit amet, consectetur adipiscing elit.

Show More

0.2.2

History Node

TODO: Figure out how to actually get changelog content.

Changelog content for this version goes here.

Donec et mollis dolor. Praesent et diam eget libero egestas mattis sit amet vitae augue. Nam tincidunt congue enim, ut porta lorem lacinia consectetur. Donec ut libero sed arcu vehicula ultricies a non tortor. Lorem ipsum dolor sit amet, consectetur adipiscing elit.

Show More

Download Files

Download Files

TODO: Brief introduction on what you do with files - including link to relevant help section.

File Name & Checksum SHA256 Checksum Help Version File Type Upload Date
filequeue-0.3.1.tar.gz (4.8 kB) Copy SHA256 Checksum SHA256 Source Jan 10, 2013

Supported By

WebFaction WebFaction Technical Writing Elastic Elastic Search Pingdom Pingdom Monitoring Dyn Dyn DNS HPE HPE Development Sentry Sentry Error Logging CloudAMQP CloudAMQP RabbitMQ Heroku Heroku PaaS Kabu Creative Kabu Creative UX & Design Fastly Fastly CDN DigiCert DigiCert EV Certificate Rackspace Rackspace Cloud Servers DreamHost DreamHost Log Hosting