Skip to main content

Serverless DataOps, for AI/ML purposes (Prototype)

Project description

Polyform

Proof of Concept

Polyforms are functions-as-a-service which include DataOps, specifically oriented for running AI systems:

  • are designed for native AI functionality
  • have an explicit expectation of the shape of data sent to them
  • support different sub-forms for variant purposes (such as training, vs intersect)
  • support transformation of data in flight, as well as storing back to the data universe
  • come with the implicit security of the Data Multiverse

Data Expectations describe the shape of the data as needed, and draw it in on demand.

This code is a combination of a very rough implementation (prototype) to prove the concept, combined with CI/CD automation for ease of use.

It is targeted towards the data science industry, enabling deep learning to be more easily managed as production ready services.

pip3 install 'git+ssh://git@github.com/srevenant/polyform.git@master#egg=polyform'

Run poly with no args for a breakdown of options

Tutorial coming soon

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

polyform-0.2.9.tar.gz (1.8 kB view details)

Uploaded Source

File details

Details for the file polyform-0.2.9.tar.gz.

File metadata

  • Download URL: polyform-0.2.9.tar.gz
  • Upload date:
  • Size: 1.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.13.0 pkginfo/1.5.0.1 requests/2.19.1 setuptools/41.0.1 requests-toolbelt/0.9.1 tqdm/4.32.2 CPython/3.7.4

File hashes

Hashes for polyform-0.2.9.tar.gz
Algorithm Hash digest
SHA256 41ea99ba6a37b68555ebc17e725ef0f8e4f249b9e9a94e788e869a7f3b33816f
MD5 de46f59e8c772c8d4a0d6ab6070f1607
BLAKE2b-256 517f2dc7e5350e9bc179efa25048effd3909218b0069a5e09ef78b915e86c3ae

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page