"A simple multi-processing based MapReduce framework"
Project description
A Multi-processing based single-host MapReduce Framework
This is a simple mapreduce framework.
Sample program
from mapreduce import *
def mapper_2(item):
return (item +5)*23 - 1
def reducer_2(accumulated, item):
return accumulated + item
def is_prime(n):
for i in range(2,ceil(sqrt(n))):
if n%i == 0:
return False
return True
if __name__ == "__main__":
N = 150000
print('* map & reduce ')
mr = MapReducer().mapper(mapper_2).reducer(reducer_2,0)
result=mr(range(N))
print(' MR Result :', result)
n=sum([(n +5)*23 - 1 for n in range(N)])
print(' Validation:',n)
History
0.5.0
process speed optimized
0.1.0
First release
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for mapreduce_py-0.5.0.post1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ce505e8b787b3bd425a1b283d625a36478c2b77082bf9bd9f81830cae0ebbe7e |
|
MD5 | 175a8fb98c7779652c31e836abc0676b |
|
BLAKE2b-256 | 37fc926aa965217d686afe34e4f8e61979bb6514936c769f6cc2b49df4f3051a |