Skip to main content

Execute functions in parallel using Dask & other useful stuff

Project description

hiko

made-with-python Maintenance codecov

Seamlessly run simple functions in parallel using Dask and other useful tools

Instalation

To install newest version from PYPI:

pip install hiko

Sample Usecases

Dask

from hiko.dask import daskify

@daskify()
def squared(x):
  return x ** 2

squared_output = squared([i for i in range(10)])

It is also possible to provide cluster address if Dask is running on multiple machines. For example:

@daskify("111.111.111.1:8797")
def squared(x):
  return x ** 2

time

Little utility to provide execution time using decorator

from hiko.time import timeify

@timeify(True)
def squared(x):
  return x ** 2

# if True is provided, then execution time returned alongside the result
result, execution_time = squared(5)

IDEAS

  1. Data Query / Data Injection
  2. Standard Dask Functions
  3. Automated documentation
  4. Write more tests

Modules

hiko time

  • data
  • dask decorators
    • functions
  • spark decorators
    • functions
  • data
  • pipelines

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for hiko, version 0.0.6
Filename, size File type Python version Upload date Hashes
Filename, size hiko-0.0.6-py3-none-any.whl (4.4 kB) File type Wheel Python version py3 Upload date Hashes View

Supported by

AWS AWS Cloud computing Datadog Datadog Monitoring DigiCert DigiCert EV certificate Facebook / Instagram Facebook / Instagram PSF Sponsor Fastly Fastly CDN Google Google Object Storage and Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Salesforce Salesforce PSF Sponsor Sentry Sentry Error logging StatusPage StatusPage Status page