A library for incremental, in-memory map-reduces
Project description
The Scenic Overlook library contains datastructures for incremental map-reduces.
These datastructures are implemented as trees, and store at each node, intermediate values of the reduce. This means that when you slice or combine structures, the new output of the maps/reduces can be efficiently computed. (by reusing old outputs from unchanged parts of the tree)
Typical usage looks like this:
#!/usr/bin/env python from scenicoverlook import viewablelist space_concat = lambda x, y: x + ' ' + y l = viewablelist(['the', 'quick', 'brown', 'fox']) print l.reduce(space_concat) # This yields 'the quick stealthy brown fox', reusing cached intermediate # substrings from the earlier call like 'the quick' and 'brown fox': print (l[:2] + ['stealthy'] + l[2:]).reduce(space_concat)
See the pydocs for more examples:
https://github.com/pschanely/ScenicOverlook/blob/master/scenicoverlook/__init__.py
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distributions
No source distribution files available for this release.See tutorial on generating distribution archives.
Built Distribution
File details
Details for the file ScenicOverlook-0.3.0-py2.py3-none-any.whl
.
File metadata
- Download URL: ScenicOverlook-0.3.0-py2.py3-none-any.whl
- Upload date:
- Size: 13.5 kB
- Tags: Python 2, Python 3
- Uploaded using Trusted Publishing? No
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | b7cea53ac310a5f7113080c690bf0f2f59e2d7b55672a7baadfb81f1ae1b8ebc |
|
MD5 | f2325e8532bfb7d4c6d3a2029f8c95ed |
|
BLAKE2b-256 | 4289f2b1fa4e543419081b4a4c19d56dd7fec87c37102824b84f4f51c917348f |