Introduction to Amazon SageMaker Serverless Inference | Concepts & Code examples

Amazon SageMaker Serverless Inference is a model hosting feature that lets you deploy endpoints for inference that automatically starts and scales the compute resources based on traffic. With SageMaker Serverless Inference you don’t have to manage instance types and you only pay for prediction requests and time taken to process those requests. In this video we discuss key concepts, who is it for, how to use it and walkthrough a code example showing how to host a Serverless inference endpoint. Code examples: https://github.com/shashankprasanna/sagemaker-video-examples.git reinvent summary blog post: https://towardsdatascience.com/aws-re-invent-2021-ai-machine-learning-launches-7-things-you-should-know-18c6c06fa982