Skip to main content

Quick start ml experimentation pipelines

Project description

Pylint

faber

what is faber?

faber is a lightweight pipelining tool for machine learning and data projects

why though?

so our pipelines look clean - like the below

from faber import node
from data_science.nodes.quick_ml import *

ml_pipe = [
    node(
        prepare_ml,
        ['df_processed', 'ml_params'],
        ['df_master_train', 'df_master_test'],
    ),
    node(
        train_models,
        ['df_master_train', 'ml_params'],
        ['ml'],
    ),
    node(
        get_best_params,
        ['ml'],
        ['best_params']
    ),
]

and our data is connected externally and defined in a yaml file; meaning if a data location changes only one place is changed . wildcards are also supported with {{}}

df_raw:
    filepath: data/00_raw/df_raw.csv
    read_func: read_csv_pandas
    
df_processed:
    filepath: data/01_master/df_processed_{{run_number}}.csv
    read_func: read_csv_pandas
    write_func: write_csv_pandas
    
output_profile:
    filepath: data/02_insight/output_profile.csv
    read_func: read_csv_pandas
    write_func: write_csv_pandas
    
ml:
    filepath: data/models/ml_object.pickle
    read_func: read_pickle
    write_func: write_pickle
    

install using

git clone https://github.com/pinata-brad/faber.git
cd faber
python3 setup.py sdist bdist_wheel && pip install dist/faber-0.0.3.tar.gz 

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

faber-ml-0.0.6.tar.gz (7.2 kB view details)

Uploaded Source

File details

Details for the file faber-ml-0.0.6.tar.gz.

File metadata

  • Download URL: faber-ml-0.0.6.tar.gz
  • Upload date:
  • Size: 7.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.8.0 pkginfo/1.8.2 readme-renderer/34.0 requests/2.25.1 requests-toolbelt/0.9.1 urllib3/1.26.4 tqdm/4.62.3 importlib-metadata/3.10.0 keyring/23.5.0 rfc3986/2.0.0 colorama/0.4.4 CPython/3.9.5

File hashes

Hashes for faber-ml-0.0.6.tar.gz
Algorithm Hash digest
SHA256 3c719f903c787988f8cdabdbd47d62ed4e200a47b5a5e6168cd0e1d583bd81c7
MD5 ebe61199c8c851964447e257b04cb265
BLAKE2b-256 4e0598bd2373646660ff0bbc56fc045d5b853c461cb11f7a2e35b81adab7419f

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page