Skip to main content

A library for incremental, in-memory map-reduces

Project description

The Scenic Overlook library contains datastructures for incremental map-reduces.

These datastructures are implemented as trees, and store at each node, intermediate values of the reduce. This means that when you slice or combine structures, the new output of the maps/reduces can be efficiently computed. (by reusing old outputs from unchanged parts of the tree)

Typical usage looks like this:

#!/usr/bin/env python

from scenicoverlook import viewablelist

space_concat = lambda x, y: x + ' ' + y
l = viewablelist(['the', 'quick', 'brown', 'fox'])
print l.reduce(space_concat)

# This yields 'the quick stealthy brown fox', reusing cached intermediate
# substrings from the earlier call like 'the quick' and 'brown fox':

print (l[:2] + ['stealthy'] + l[2:]).reduce(space_concat)

See the pydocs for more examples:

https://github.com/pschanely/ScenicOverlook/blob/master/scenicoverlook/__init__.py

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distribution

ScenicOverlook-0.3.0-py2.py3-none-any.whl (13.5 kB view details)

Uploaded Python 2 Python 3

File details

Details for the file ScenicOverlook-0.3.0-py2.py3-none-any.whl.

File metadata

File hashes

Hashes for ScenicOverlook-0.3.0-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 b7cea53ac310a5f7113080c690bf0f2f59e2d7b55672a7baadfb81f1ae1b8ebc
MD5 f2325e8532bfb7d4c6d3a2029f8c95ed
BLAKE2b-256 4289f2b1fa4e543419081b4a4c19d56dd7fec87c37102824b84f4f51c917348f

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page