SLAMA: LightAutoML on Spark
SLAMA is a version of LightAutoML library modified to run in distributed mode with Apache Spark framework.
It requires:
- Python 3.9
- PySpark 3.2+ (installed as a dependency)
- Synapse ML library (It will be downloaded by Spark automatically)
Currently, only tabular Preset is supported. See demo with spark-based tabular automl preset in examples/spark/tabular-preset-automl.py. For further information check docs in the root of the project containing dedicated SLAMA section.
License
This project is licensed under the Apache License, Version 2.0. See LICENSE file for more details.
Installation
First of all you need to install git and poetry.
# Load LAMA source code
git clone https://github.com/fonhorst/LightAutoML_Spark.git
cd LightAutoML/
# !!!Choose only one item!!!
# 1. Global installation: Don't create virtual environment
poetry config virtualenvs.create false --local
# 2. Recommended: Create virtual environment inside your project directory
poetry config virtualenvs.in-project true
# For more information read poetry docs
# Install LAMA
poetry lock
poetry install
2 maintainers
Release files for sparklightautoml 0.5.2
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| sparklightautoml-0.5.2-py3-none-any.whl | Python 3 | none | any | Details |
Release files / sparklightautoml-0.5.2-py3-none-any.whl
| Download URL | sparklightautoml-0.5.2-py3-none-any.whl |
|---|---|
| Size | 160.0 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
9394fdba8660dc70f30cb1fd63350fb20679761e48b23b0bd3cd0d902e4ac545
|
|
BLAKE2b-256 checksum How to use checksums |
c66ac4d1d8fa0d15fb35b88516eb7bd23bf55a3e2344cbb1b31f9b45aba32039
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
poetry/1.1.13 CPython/3.8.10 Linux/5.4.0-200-generic
|
