hiko 0.0.6

Execute functions in parallel using Dask & other useful stuff

hiko

Seamlessly run simple functions in parallel using Dask and other useful tools

Instalation

To install newest version from PYPI:

pip install hiko

Sample Usecases

Dask

from hiko.dask import daskify

@daskify()
def squared(x):
  return x ** 2

squared_output = squared([i for i in range(10)])

It is also possible to provide cluster address if Dask is running on multiple machines. For example:

@daskify("111.111.111.1:8797")
def squared(x):
  return x ** 2

time

Little utility to provide execution time using decorator

from hiko.time import timeify

@timeify(True)
def squared(x):
  return x ** 2

# if True is provided, then execution time returned alongside the result
result, execution_time = squared(5)

IDEAS

1. Data Query / Data Injection
2. Standard Dask Functions
3. Automated documentation
4. Write more tests

Modules

hiko time

• data
• dask decorators
  • functions
• spark decorators
  • functions
• data
• pipelines