Skip to main content

SageWorks: An easy to use WorkBench for creating and deploying SageMaker Models

Project description

SageWorksTM

SageWorks: The scientist's workbench powered by AWS® for scalability, flexibility, and security.

SageWorks is a medium granularity framework that manages and aggregates AWS® Services into classes and concepts. When you use SageWorks you think about DataSources, FeatureSets, Models, and Endpoints. Underneath the hood those classes handle all the details around updating and managing a complex set of AWS Services. All the power and none of the pain so that your team can Do Science Faster!

Full SageWorks OverView

SageWorks Architected FrameWork

Getting Started Video Demo

SageWorks Getting Started This video is an informal screen capture + chatting while I'm coding. The video demonstrates creating an entire AWS ML Pipeline, from data ingestion, to feature sets, to models and endpoints.

Why SageWorks?

  • The AWS SageMaker® ecosystem is awesome but has a large number of services with significant complexity
  • SageWorks provides rapid prototyping through easy to use classes and transforms
  • SageWorks provides visibility and transparency into AWS SageMaker® Pipelines
    • What S3 data sources are getting pulled?
    • What Features Store/Group is the Model Using?
    • What's the Provenance of a Model in Model Registry?
    • What SageMaker Endpoints are associated with this model?

Single pane of glass visibility into the AWS Services that underpin the SageWorks Classes. We can see that SageWorks automatically tags and tracks the inputs of all artifacts providing 'data provenance' for all steps in the AWS modeling pipeline.

Screenshot 2023-03-31 at 2 16 36 PM

Clearly illustrated: SageWorks provides intuitive and transparent visibility into the full pipeline of your AWS Sagemaker Deployments.

Installation

pip install sageworks

Gettting Started

SageWorks has a large number of classes and components, the best place to get started is our SageWorks Overview and SageWorks Wiki for developers wanting to try out the Python API.

Video: SageWorks Getting Started shows an informal screen capture + chatting while I'm coding. The video demonstrates creating an entire AWS ML Pipeline, from data ingestion, to feature sets, to models and endpoints.

You can also join us on Discord https://discord.gg/WHAJuz8sw8 for questions and advice on using SageWorks within your organization.

SageWorks Zen``

  • The AWS SageMaker® set of services is vast and complex.
  • SageWorks Classes encapsulate, organize, and manage sets of AWS® Services.
  • Heavy transforms typically use AWS Athena or Apache Spark (AWS Glue/EMR Serverless).
  • Light transforms will typically use Pandas.
  • Heavy and Light transforms both update AWS Artifacts (collections of AWS Services).
  • Quick prototypes are typically built with the light path and then flipped to the heavy path as the system matures and usage grows.

Classes and Concepts

The SageWorks Classes are organized to work in concert with AWS Services. For more details on the current classes and class hierarchies see SageWorks Classes and Concepts.

Contributions

If you'd like to contribute to the SageWorks project, you're more than welcome. All contributions will fall under the existing project license. If you are interested in contributing or have questions please feel free to contact us at sageworks@supercowpowers.com.

SageWorks Alpha Testers Wanted

Our experienced team can provide development and consulting services to help you effectively use Amazon’s Machine Learning services within your organization.

The popularity of cloud based Machine Learning services is booming. The problem many companies face is how that capability gets effectively used and harnessed to drive real business decisions and provide concrete value for their organization.

Using SageWorks will minimizize the time and manpower needed to incorporate AWS ML into your organization. If your company would like to be a SageWorks Alpha Tester, contact us at sageworks@supercowpowers.com.

® Amazon Web Services, AWS, the Powered by AWS logo, are trademarks of Amazon.com, Inc. or its affiliates.

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

sageworks-0.1.3.tar.gz (13.8 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

sageworks-0.1.3-py2.py3-none-any.whl (12.4 MB view details)

Uploaded Python 2Python 3

File details

Details for the file sageworks-0.1.3.tar.gz.

File metadata

  • Download URL: sageworks-0.1.3.tar.gz
  • Upload date:
  • Size: 13.8 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.1 CPython/3.10.6

File hashes

Hashes for sageworks-0.1.3.tar.gz
Algorithm Hash digest
SHA256 482a1d0319bf89a73449560bc444d72f7b53572c082fa325ecd6f7a8b8aa564e
MD5 b9527dc346bb1e83cedeacf65e6ca91b
BLAKE2b-256 987e5419c1a20bf969b7726e780b0f490e3e3650b036edbdaafc762da43c1908

See more details on using hashes here.

File details

Details for the file sageworks-0.1.3-py2.py3-none-any.whl.

File metadata

  • Download URL: sageworks-0.1.3-py2.py3-none-any.whl
  • Upload date:
  • Size: 12.4 MB
  • Tags: Python 2, Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.1 CPython/3.10.6

File hashes

Hashes for sageworks-0.1.3-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 ce8e68b38105b48a66ca051df07e4ea38163c9304a483183734dfaee8f1b1c47
MD5 05bfde008bccce3d8b5750cce2009380
BLAKE2b-256 4d4899c31fe720df8e8795ad10b9c8ae58759e62bf0469f0e2a29efd40f36d19

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page