Skip to main content

CDK Constructs for AWS API Gateway and Amazon SageMaker Endpoint integration.

Project description

aws-apigateway-sagemakerendpoint module

---

Stability: Experimental

All classes are under active development and subject to non-backward compatible changes or removal in any future version. These are not subject to the Semantic Versioning model. This means that while you may use them, you may need to update your source code when upgrading to a newer version of this package.


Reference Documentation: https://docs.aws.amazon.com/solutions/latest/constructs/
Language Package
Python Logo Python aws_solutions_constructs.aws_apigateway_sagemakerendpoint
Typescript Logo Typescript @aws-solutions-constructs/aws-apigateway-sagemakerendpoint
Java Logo Java software.amazon.awsconstructs.services.apigatewaysagemakerendpoint

Overview

This AWS Solutions Construct implements an Amazon API Gateway connected to an Amazon SageMaker endpoint pattern.

Here is a minimal deployable pattern definition in Typescript:

import { ApiGatewayToSageMakerEndpoint, ApiGatewayToSageMakerEndpointProps } from '@aws-solutions-constructs/aws-apigateway-sagemakerendpoint';

// Below is an example VTL (Velocity Template Language) mapping template for mapping the Api GET request to the Sagemaker POST request
const requestTemplate =
`{
    "instances": [
#set( $user_id = $input.params("user_id") )
#set( $items = $input.params("items") )
#foreach( $item in $items.split(",") )
    {"in0": [$user_id], "in1": [$item]}#if( $foreach.hasNext ),#end
    $esc.newline
#end
    ]
}`;

// Replace 'my-endpoint' with your Sagemaker Inference Endpoint
new ApiGatewayToSageMakerEndpoint(this, 'test-apigw-sagemakerendpoint', {
    endpointName: 'my-endpoint',
    resourcePath: '{user_id}',
    requestMappingTemplate: requestTemplate
});

Initializer

new ApiGatewayToSageMakerEndpoint(scope: Construct, id: string, props: ApiGatewayToSageMakerEndpointProps);

Parameters

Pattern Construct Props

Name Type Description
apiGatewayProps? api.RestApiProps Optional user-provided props to override the default props for the API Gateway.
apiGatewayExecutionRole? iam.Role IAM Role used by API Gateway to invoke the SageMaker endpoint. If not specified, a default role is created with access to endpointName.
endpointName string Name of the deployed SageMaker inference endpoint.
resourceName? string Optional resource name where the GET method will be available.
resourcePath string Resource path for the GET method. The variable defined here can be referenced in requestMappingTemplate.
requestMappingTemplate string Mapping template to convert GET requests received on the REST API to POST requests expected by the SageMaker endpoint.
responseMappingTemplate? string Optional mapping template to convert responses received from the SageMaker endpoint.
logGroupProps? logs.LogGroupProps User provided props to override the default props for for the CloudWatchLogs LogGroup.

Pattern Properties

Name Type Description
apiGateway api.RestApi Returns an instance of the API Gateway REST API created by the pattern.
apiGatewayRole iam.Role Returns an instance of the iam.Role created by the construct for API Gateway.
apiGatewayCloudWatchRole iam.Role Returns an instance of the iam.Role created by the construct for API Gateway for CloudWatch access.
apiGatewayLogGroup logs.LogGroup Returns an instance of the LogGroup created by the construct for API Gateway access logging to CloudWatch.

Sample API Usage

Note: Each SageMaker endpoint is unique, and the response from the API will depend on the deployed model. The example given below assumes the sample from this blog post. For a reference on how that'd be implemented, please refer to integ.apigateway-sagemakerendpoint-overwrite.ts.

Method Request Path Query String SageMaker Action Description
GET /321 items=101,131,162 sagemaker:InvokeEndpoint Retrieves the predictions for a specific user and items.

Default settings

Out of the box implementation of the Construct without any override will set the following defaults:

Amazon API Gateway

  • Deploy an edge-optimized API endpoint
  • Enable CloudWatch logging for API Gateway
  • Configure least privilege access IAM role for API Gateway
  • Set the default authorizationType for all API methods to IAM
  • Enable X-Ray Tracing
  • Validate request parameters before passing data to SageMaker

Architecture

Architecture Diagram


© Copyright 2021 Amazon.com, Inc. or its affiliates. All Rights Reserved.

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

File details

Details for the file aws-solutions-constructs.aws-apigateway-sagemakerendpoint-1.90.1.tar.gz.

File metadata

File hashes

Hashes for aws-solutions-constructs.aws-apigateway-sagemakerendpoint-1.90.1.tar.gz
Algorithm Hash digest
SHA256 9280fee13190229fcff93fd4170ddc372d8f5b19eb00fdfbc2b6eeac09186c2d
MD5 476af5acf793cb630c695cb2171ad326
BLAKE2b-256 fddc44bf220a3431419535724ca6d7cd5e04a4cbd3582abe3aa69c7fc4747203

See more details on using hashes here.

File details

Details for the file aws_solutions_constructs.aws_apigateway_sagemakerendpoint-1.90.1-py3-none-any.whl.

File metadata

File hashes

Hashes for aws_solutions_constructs.aws_apigateway_sagemakerendpoint-1.90.1-py3-none-any.whl
Algorithm Hash digest
SHA256 3f3aab82dfc5df5749fc219b3eefe6e558798a2044cf8f602cd2883d8ffb5d00
MD5 3257114bb18a12d54b60fdf7b8e623b1
BLAKE2b-256 397eaf33c164101e0a9403572f2e576b1c0d42284ec5e8e3db12e8297cf1740c

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page