Skip to main content

Execute functions in parallel using Dask & other useful stuff

Project description

hiko

made-with-python Maintenance codecov

Seamlessly run simple functions in parallel using Dask and other useful tools

Instalation

To install newest version from PYPI:

pip install hiko

Sample Usecases

Dask

from hiko.dask import daskify

@daskify()
def squared(x):
  return x ** 2

squared_output = squared([i for i in range(10)])

It is also possible to provide cluster address if Dask is running on multiple machines. For example:

@daskify("111.111.111.1:8797")
def squared(x):
  return x ** 2

time

Little utility to provide execution time using decorator

from hiko.time import timeify

@timeify(True)
def squared(x):
  return x ** 2

# if True is provided, then execution time returned alongside the result
result, execution_time = squared(5)

IDEAS

  1. Data Query / Data Injection
  2. Standard Dask Functions
  3. Automated documentation
  4. Write more tests

Modules

hiko time

  • data
  • dask decorators
    • functions
  • spark decorators
    • functions
  • data
  • pipelines

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release. See tutorial on generating distribution archives.

Built Distribution

hiko-0.0.6-py3-none-any.whl (4.4 kB view hashes)

Uploaded py3

Supported by

AWS AWS Cloud computing Datadog Datadog Monitoring Facebook / Instagram Facebook / Instagram PSF Sponsor Fastly Fastly CDN Google Google Object Storage and Download Analytics Huawei Huawei PSF Sponsor Microsoft Microsoft PSF Sponsor NVIDIA NVIDIA PSF Sponsor Pingdom Pingdom Monitoring Salesforce Salesforce PSF Sponsor Sentry Sentry Error logging StatusPage StatusPage Status page