Skip to main content

A Deep Learning Pipeline

Project description

dl_pipeline

A general deep learning pipeline (in construction) for kaggle competitions and other projects.

Install

Setup with pip:

pip install dl_pipeline

Clone and editable setup:

git clone https://github.com/mnpinto/dl_pipeline
cd dl_pipeline
pip install -e .

Rainforest Connection Species Audio Detection

#!/bin/bash
arch='densenet121'
model_name='model_0'
sample_rate=32000
n_mels=128
hop_length=640

for fold in 0 1 2 3 4
do
    echo "Training $model for fold $fold"
    kaggle_rainforest2021 --fold $fold --model_name $model_name \
        --model $arch --sample_rate $sample_rate --n_mels $n_mels \
        --hop_length $hop_length --bs 32 --head_ps 0.8 \
        --tile_width 1024 --mixup true >> log.train
done

for tw in 64 128 256
do
    echo "Generate predictions for $model with tile_width of $tw"
    kaggle_rainforest2021 --run_test true --model_name $model_name \
        --model $arch --sample_rate $sample_rate --n_mels $n_mels \
        --hop_length $hop_length --tile_width $tw \
        --save_preds true >> log.predict
done

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dl_pipeline-0.0.1.tar.gz (26.3 kB view details)

Uploaded Source

Built Distribution

dl_pipeline-0.0.1-py3-none-any.whl (28.2 kB view details)

Uploaded Python 3

File details

Details for the file dl_pipeline-0.0.1.tar.gz.

File metadata

  • Download URL: dl_pipeline-0.0.1.tar.gz
  • Upload date:
  • Size: 26.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.6.1 requests/2.25.0 setuptools/49.6.0.post20201009 requests-toolbelt/0.9.1 tqdm/4.51.0 CPython/3.8.0

File hashes

Hashes for dl_pipeline-0.0.1.tar.gz
Algorithm Hash digest
SHA256 7e2b20dc72741bbaab78f331e5a03a17b7565e5cd855c411ce58cdb4517420f6
MD5 30d51468a61df8567fe9488d667ddae0
BLAKE2b-256 12f74e5b839b4f1c7924b293965e2f1708fd27a5ea249d19a8d0bf2f05daf568

See more details on using hashes here.

File details

Details for the file dl_pipeline-0.0.1-py3-none-any.whl.

File metadata

  • Download URL: dl_pipeline-0.0.1-py3-none-any.whl
  • Upload date:
  • Size: 28.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.6.1 requests/2.25.0 setuptools/49.6.0.post20201009 requests-toolbelt/0.9.1 tqdm/4.51.0 CPython/3.8.0

File hashes

Hashes for dl_pipeline-0.0.1-py3-none-any.whl
Algorithm Hash digest
SHA256 58a692eb5494714a74525e489c9947e9b8ecf8cc7934fb531243a28d4b4bf86e
MD5 f65fdb2c34230b77fe2786f96a851e26
BLAKE2b-256 d5c583af922b59d9476227e0b8fc2335f92307b78ad5364b19b4ef3bbe010c43

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page