Create an LLM streaming response API with Lambda Function URLs.
This sample project demonstrates how to use an Lambda Function URL streaming ability and Bedrock runtime
InvokeModelWithResponseStreamCommand to build an LLM response streaming API.This pattern deploys a Lambda Function. Since Bedrock access is limited to certain Regions, user must set BEDROCK_AWS_ACCESS_KEY_ID and BEDROCK_AWS_SECRET_ACCESS_KEY environment variables for the Lambda Function to allow request across Regions.
< Back to all patterns
Clone repo
git clone https://github.com/aws-samples/serverless-patterns/cd serverless-patterns/lambda-streaming-ttfb-write-sam-with-bedrock-streamingDeploy
sam deployTesting
See the GitHub repo for detailed testing instructions.
Cleanup
Delete the stack:
sam delete.Created by:
