Skip to main content

A Framework for creating a boilerplate template for ai projects that are ready for MLOps

Project description

pyPhases

A small framework for python projects that are mainly progress based.

The main princible of the framework are Phases.

Architecure

arch

Project

A Project is the composition of phases and the backend.

Phase

A Phase has a main Method and can export data.

Decorators

Compontents

Exporters

Exporter

There is a default PickleExporter and is compatible with primitive types.

register Data

When a phase wants to register data (self.project.registerData("myDataId", myData) within the phase), the data is passed to an exporter. If an exporter is found the data will be passed to alle the storages. They will save the data somewhere (persitent or not).

example:

seq

reading the data

A phase can request data with self.project.getData("myDataId", MyDataType). The Data will be passed sequentially to the storage layer and will pass the data from the first storage that can get it. If no storage can provide the data, the project will search for a phase that exports this data-id and run that specific phase.

example:

get-data

example

This is a example data layer with 3 storages: memory, file, database (not default) data-layer

development

build

python setup.py sdist bdist_wheel

publish

twine upload dist/*

documentation

sphinx-apidoc -o docs/source pyPhases sphinx-build -b html docs/source docs/build

test

python -m unittest discover -v

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pyPhases-1.0.3.tar.gz (22.3 kB view hashes)

Uploaded Source

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page