Skip to main content

# rapidFlow

Project description

rapidFlow

This is a project, that tries to accelerate micro research projects by providing a richer functionality for the already known hpyerparameter optimization library optuna. The code of optuna is not modified, it is incorporated into rapidFlow to provide richer evaluation and easy parallel processing.

Getting Started

Prerequisites

Install

rapidFlow is build upon Pytorch, so make sure you have PyTorch installed.

  1. From Pip Install package with:
    pip install rapidflow

  2. With cloned repository Install package with:
    pip install -e /src

Collaboration

Branche Purpose
main production state
feature a new feautre
hotfix hotfix as there are no bugfixes as everything is created from master

The desired workflow is github flow. Meaning that: * we can deploy from master at any time * nothing gets deployed without a PR and its review * we have no releases or release branches

This way we maintain: * fast responses to features or bugs and continouus delivery * easy workflow * fast developer feedback

more to come!

Pipelines

PR:

  • deplyos into develop and performs integration tests
    • 2 PRs are created at the same time --> their tests and deployment is scheduled over Runners in github or jenkins
    • 1 PR is merged --> if there is a dependency a merge conflict arises, which gets reslved by a new commit in the 2nd PR --> triggers pipeline

TODO:

  • move experiment library to another repo
  • experiments in docker container with gpu? (or singularity)
  • test on multiple gpus
  • testing and propper doku
  • significance testing

Acknowledgments

Feel free to contribute. If you use this repository please cite with:

    @misc{rapidFlow_geb,
    author = {Gebauer, Michael},
    title = {rapidFlow},
    year = {2022},
    publisher = {GitHub},
    journal = {GitHub repository},
    howpublished = {\url{https://github.com/gebauerm/model_storage}},
    }

Author

elysias

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

rapidflow-0.1.8rc0.tar.gz (13.7 kB view details)

Uploaded Source

Built Distribution

rapidflow-0.1.8rc0-py3-none-any.whl (17.2 kB view details)

Uploaded Python 3

File details

Details for the file rapidflow-0.1.8rc0.tar.gz.

File metadata

  • Download URL: rapidflow-0.1.8rc0.tar.gz
  • Upload date:
  • Size: 13.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.9.20

File hashes

Hashes for rapidflow-0.1.8rc0.tar.gz
Algorithm Hash digest
SHA256 7675e0d2dd0e51eb52ff2789c8776388496c221f2aee03de60b1963674b4116d
MD5 eb6fe235e5c03390ca97658c947d5c26
BLAKE2b-256 664aa8937ec09940715cb950aab603aa4d7e6d120bf16c07827edcf71b1c243d

See more details on using hashes here.

File details

Details for the file rapidflow-0.1.8rc0-py3-none-any.whl.

File metadata

  • Download URL: rapidflow-0.1.8rc0-py3-none-any.whl
  • Upload date:
  • Size: 17.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.9.20

File hashes

Hashes for rapidflow-0.1.8rc0-py3-none-any.whl
Algorithm Hash digest
SHA256 4f4745f77c37acf2094701652aca3cc433536383c8ca3c3677978f43c258a1de
MD5 08e741cb9c008ff8ccfb0f736033d74d
BLAKE2b-256 d9deaba2d44342049729b1f44b75d58ef7e2991a643a7d5c6dbe4700894a340e

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page