Hadopy - Easy parallel map-reduce command line tool
If you want to map reduce parallel but hadoop is overkill, with Hadopy you can run map reduce in python.
Installing
To get Hadopy, either install from PyPi:
$ pip install hadopy
or clone this github project and install:
$ pip install .
Usage
Hadopy was programmed with ease-of-use in mind. To run it use one of the following command:
Linux / MacOS
$ cat example.txt | hadopy --mapper "python mapper.py" --reducer "python reducer.py"
Windows
$ type example.txt | hadopy --mapper "python mapper.py" --reducer "python reducer.py"
For more information use
$ hadopy --help
1 maintainer
Metadata
1 maintainer
Release files for hadopy 0.1.8
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| hadopy-0.1.8.tar.gz | 15.8 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| hadopy-0.1.8-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 31.2 kB
Release files / hadopy-0.1.8.tar.gz
| Download URL | hadopy-0.1.8.tar.gz |
|---|---|
| Size | 15.8 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
226d5280802374a8f1902e202f13c9ff90c9fe0d5179e7fe83eeed83be154398
|
|
BLAKE2b-256 checksum How to use checksums |
c30622623bf88ebe451003b1ebc950d3b2fa7cf70d158c32cb961d9005fdafba
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.4.1 importlib_metadata/4.0.1 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.60.0 CPython/3.9.4
|
Release files / hadopy-0.1.8-py3-none-any.whl
| Download URL | hadopy-0.1.8-py3-none-any.whl |
|---|---|
| Size | 15.4 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
655bb50d69dddf7aee5d42130023b7950dfe9bf77bdbf56135cf40faf8212db4
|
|
BLAKE2b-256 checksum How to use checksums |
2ec72783db33bd7f2a20e0052c50e1f34328d4c3a8f6652e2d1f2caf0f20677f
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.4.1 importlib_metadata/4.0.1 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.60.0 CPython/3.9.4
|
