eexp_engine_utils
Helper utilities for the ExtremeXP Experimentation Engine that automatically adapt to different execution environments (Kubeflow, ProActive, Local).
Overview
This package provides a transparent proxy that automatically routes function calls to the appropriate implementation based on your execution environment. No more manual environment checking or conditional imports!
Installation
pip install eexp_engine_utils
Quick Start
from eexp_engine_utils import utils
# Load a dataset
data = utils.load_dataset(variables, resultMap, "input_data")
# Process your data
processed_data = your_processing_function(data)
# Save the result
utils.save_dataset(variables, resultMap, "output_data", processed_data)
That's it! The utils proxy automatically detects your execution environment and routes calls to the correct implementation.
Available Functions
Dataset Management
load_dataset(variables, resultMap, key)- Load a single datasetload_datasets(variables, resultMap, key)- Load multiple datasetssave_dataset(variables, resultMap, key, value)- Save a single datasetsave_datasets(variables, resultMap, key, values, file_names)- Save multiple datasets
Helpers
get_experiment_results(variables)- Get experiment resultsload_dataset_by_path(file_path)- Load from specific pathload_pickled_dataset_by_path(file_path)- Load pickled data
Requirements
- Python >= 3.8
- requests >= 2.25.0
- fsspec >= 2021.0.0
- s3fs >= 2021.0.0
- minio >= 7.0.0
License
Apache License 2.0
Links
1 maintainer
Metadata
1 maintainer
Release files for eexp-engine-utils 1.0.3
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| eexp_engine_utils-1.0.3.tar.gz | 19.5 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| eexp_engine_utils-1.0.3-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 43.2 kB
Release files / eexp_engine_utils-1.0.3.tar.gz
| Download URL | eexp_engine_utils-1.0.3.tar.gz |
|---|---|
| Size | 19.5 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
933fbce378a91e1c6b0670235883ef2ed6a54df41f0a6a38d1846ded4b703fd0
|
|
BLAKE2b-256 checksum How to use checksums |
bd765b4b436072d3f390ee828b4ee20be38d28da4ae42004043656f2e7e0e7ef
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.12.9
|
Release files / eexp_engine_utils-1.0.3-py3-none-any.whl
| Download URL | eexp_engine_utils-1.0.3-py3-none-any.whl |
|---|---|
| Size | 23.7 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
8e8e79a48f2b4d0825aebc79b7cb8e31957331906fe84a3d5053575b1d58c987
|
|
BLAKE2b-256 checksum How to use checksums |
09fb8e7e1420d9cc865162dc0d8fd3e333ff843e391e170353c56576ea4cf283
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.12.9
|
