Skip to main content

Automated Machine Learning Pipeline Generation

Project description

ngAutonML

ngAutonML

The ngAutonML project is an Automated Machine Learning solution intended to make it much easier to find good solutions to common machine learning problems, or to aid in prototyping a more complex solution. It aims to be simple to use for the bulk of machine learning problems, but maintains a high level of customizability for those situations that require more specific setups by more experiences machine learning professionals.

This project is the result of research performed as part of the D3M project run by DARPA. It is a reimplementation of many concepts used in that project, and is currently under heavy development.

Installation

It is recommended to create a virtual environment to run ngautonml. To do so with conda, run:

conda create -n env-name python=3.10
conda activate env-name

To install from pypi, use:

pip install ngautonml

ngAutonML is designed to run on Python 3.10 and above.

To install from this repository, use poetry:

pip install poetry
poetry install

If you are a developer, install the dev dependency group as well:

poetry install --with dev

This includes linters that code must be compliant with.

Usage

To use ngAutonML from the command line, you need to provide a problem definition (see below). Run:

python picard.py wrangle -d <path to problem definition>

The problem definition is a JSON file that describes the machine learning problem you wish ngAutonML to tackle. A simple problem definition might look like:

{
    "dataset" : {
        "config" : "memory",
        "params" : {
            "train_data": "train",
            "test_data": "test"
        },
        "column_roles": {
            "target": {
                "name": "target"
            }
        }
    },
    "problem_type" : {
        "data_type": "tabular",
        "task": "binary_classification"
    },
    "metrics" : {
        "accuracy_score": {},
        "roc_auc_score": {}
    }
}

Examples can be found in the examples directory, but in brief the important aspects are the following fields:

  • dataset: The dataset that the algorithms are being run on. There are serveral data loaders that can load data from different sources.
  • problem_type: This uses the subfields of data_type to tell the type of dataset, and the task to determine how the dataset will be handled, such as a classification or forecasting problem.
  • metrics: This field defines the scoring metric(s) that ngAutonML will use to evaluate algorithms.

For more information, see our documentation

Support

Currently all issues should be generated via the GitLab Issue Tracker.

Roadmap

In Development:

  • Support for external models such as Docker Containers or LLM services
  • Code generation for insertion into your own projects or for low-level customization
  • API support

Contributing

If forking and wanting to contribute, please ensure PEP8 Compliance. The current project uses flake8, mypy, and pylint for code compliance, with the exception of setting the maximum line length to 100 characters.

Authors and acknowledgment

The CMU AutonML Development Team:

Piggy Yarroll (programmer/architect)
Andrew Williams (programmer)
Merritt Kowaleski (programmer)
Mujing Wang (programmer)
Carter Weaver (programmer)
Jeishi Chen (data scientist)

License

This project is currently licensed under the Apache 2.0 license.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ngautonml-0.4.4b6.tar.gz (316.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

ngautonml-0.4.4b6-py3-none-any.whl (490.4 kB view details)

Uploaded Python 3

File details

Details for the file ngautonml-0.4.4b6.tar.gz.

File metadata

  • Download URL: ngautonml-0.4.4b6.tar.gz
  • Upload date:
  • Size: 316.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.8.3 CPython/3.9.18 Linux/6.11.0-17-generic

File hashes

Hashes for ngautonml-0.4.4b6.tar.gz
Algorithm Hash digest
SHA256 dbbb43f85748f4b1f632072dd5c33f43e505a76678adec4054eecf4f03bbb7db
MD5 99e75bbcbea6f02873f61b81ec49456d
BLAKE2b-256 a209977ac4732b83e4ea18d234b488f8d7b43caeb6613d694cd7de6e89290821

See more details on using hashes here.

File details

Details for the file ngautonml-0.4.4b6-py3-none-any.whl.

File metadata

  • Download URL: ngautonml-0.4.4b6-py3-none-any.whl
  • Upload date:
  • Size: 490.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.8.3 CPython/3.9.18 Linux/6.11.0-17-generic

File hashes

Hashes for ngautonml-0.4.4b6-py3-none-any.whl
Algorithm Hash digest
SHA256 a1db918bce010c3ce4d3ae9f0f6059ffdca336fa69912c2f0b584cab10ed4609
MD5 4368622d433fc0ffb74953a6ee002f29
BLAKE2b-256 373ed310ed78afcc5c82ebe23c3fdc63e074df97a37b89ca66dc83b7ef547d9b

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page