AutoRes Evaluator

※ 追加で実装して欲しい機能や質問などがあれば以下のissuesから投稿をお願いします

https://github.com/auto-res/autores-evaluator/issues/new

Examples

Prediction by logistic regression on the Titanic dataset
Prediction by CNN on CIFAR10

Architecture

ロゴ1

How to use

Install
- https://pypi.org/project/autoresevaluator/

pip install autoresevaluator

from autoresevaluator import AutoResEvaluator

Setting

# Hyperparameter setting
# Specify "type" and "args" for items to be searched in optuna.
params = {
    'lambda_l1': {'type': 'log_float', 'args': [1e-8, 10.0]},
    'lambda_l2': {'type': 'log_float', 'args': [1e-8, 10.0]},
    'num_leaves': {'type': 'int', 'args': [2, 256]},
    'feature_fraction': {'type': 'float', 'args': [0.4, 1.0]},
    'bagging_fraction': {'type': 'float', 'args': [0.4, 1.0]},
    'verbosity': -1
}

are = AutoResEvaluator(
    # dataset name
    dataset_name='titanic',
    # model file path
    model_path='/content/example.py',
    # parameter
    params=params,
    # Metrics you want to maximize/minimize
    valuation_index='roc_auc',
    # Where to store data
    datasave_path=None
    )

Execution

are.exec()

Output

result.log
- File to output the results
model_error.log
- File to write errors in model files

Metadata

Release files for autoresevaluator 0.1.11

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for autoresevaluator 0.1.11
File	Size	Uploaded
autoresevaluator-0.1.11.tar.gz	9.5 kB	Mar 5, 2024	Details

Built distribution (wheel)

Table of built distributions (wheels) for autoresevaluator 0.1.11
File	Interpreter	ABI	Platform	Reset
autoresevaluator-0.1.11-py3-none-any.whl 13.5 kB Mar 5, 2024	Python 3	none	any	Details

Total release size: 23.0 kB

Release files / autoresevaluator-0.1.11.tar.gz

Download URL	autoresevaluator-0.1.11.tar.gz
Size	9.5 kB
Tags	Source
SHA-256 checksum How to use checksums	`0fcbc48d2464980c3b00c483e9e41dcae9f1ae25ea3feb7a1452c9d2b068d43d`
BLAKE2b-256 checksum How to use checksums	`1d3197d4758fa5de16a3f5d92579b7964013ec16b203ba1550d45e689f785519`
Upload date	Mar 5, 2024
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`poetry/1.5.1 CPython/3.9.18 Darwin/23.2.0`

Release files / autoresevaluator-0.1.11-py3-none-any.whl

Download URL	autoresevaluator-0.1.11-py3-none-any.whl
Size	13.5 kB
Tags	Python 3
SHA-256 checksum How to use checksums	`bab7bcb02634c87117ef2c658db60776cba23636530dd9d4d8bc9ab115a3dd94`
BLAKE2b-256 checksum How to use checksums	`9af5adb340cfab41b6bab2e4430f81a5b363296ef11ff6978de896292d7867bf`
Upload date	Mar 5, 2024
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`poetry/1.5.1 CPython/3.9.18 Darwin/23.2.0`