Serverless DataOps, for AI/ML purposes (Prototype)
Project description
Polyform
Proof of Concept
Polyforms are functions-as-a-service which include DataOps, specifically oriented for running AI systems:
- are designed for native AI functionality
- have an explicit expectation of the shape of data sent to them
- support different sub-forms for variant purposes (such as training, vs intersect)
- support transformation of data in flight, as well as storing back to the data universe
- come with the implicit security of the Data Multiverse
Data Expectations describe the shape of the data as needed, and draw it in on demand.
This code is a combination of a very rough implementation (prototype) to prove the concept, combined with CI/CD automation for ease of use.
It is targeted towards the data science industry, enabling deep learning to be more easily managed as production ready services.
pip3 install 'git+ssh://git@github.com/srevenant/polyform.git@master#egg=polyform'
Run poly
with no args for a breakdown of options
Tutorial coming soon
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
File details
Details for the file polyform-0.2.9.tar.gz
.
File metadata
- Download URL: polyform-0.2.9.tar.gz
- Upload date:
- Size: 1.8 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/1.13.0 pkginfo/1.5.0.1 requests/2.19.1 setuptools/41.0.1 requests-toolbelt/0.9.1 tqdm/4.32.2 CPython/3.7.4
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 41ea99ba6a37b68555ebc17e725ef0f8e4f249b9e9a94e788e869a7f3b33816f |
|
MD5 | de46f59e8c772c8d4a0d6ab6070f1607 |
|
BLAKE2b-256 | 517f2dc7e5350e9bc179efa25048effd3909218b0069a5e09ef78b915e86c3ae |