Chunk large querysetsinto small chunks, and iterate over them without killing your RAM.
Project description
Chunk large querysetsinto small chunks, and iterate over them without killing your RAM.
Usage:
from chunkator import chunkator for item in chunkator(LargeModel.objects.all(), 200): do_something(item)
This tool is intended to work on Django querysets. Your model must define a pk field (this is done by default, but sometimes it can be overridden) and this pk has to be unique. django-chunkator has been tested with Postgresql and SQLite, using regular PKs and UUIDs as primary keys.
You can also use values():
from chunkator import chunkator for item in chunkator(LargeModel.objects.values('pk', 'name'), 200): do_something(item)
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
django-chunkator-0.0.4.tar.gz
(2.9 kB
view hashes)