Amazon Bedrock Knowledge Base Evaluations

Ingest data into multiple Knowledge Bases and evaluate the performance with your test suite of prompts

This workflow creates multiple Knowledge Bases, performs an ingestion job into a vector database, and runs evaluation jobs for you to assess the effectiveness of your ingestion jobs.
This is done by making use of Step Functions Parallel state to run multiple testing flows in parallel

< Back to all workflows

GitHub icon View this workflow on GitHub


Clone repo

git clone https://github.com/aws-samples/step-functions-workflows-collection/tree/main/bedrock-evaluations-sam/cd step-functions-workflows-collection/bedrock-evaluations-sam

Deploy

sam deploy --guided


Testing

See the GitHub repo for detailed testing instructions.

Cleanup

1. Delete any documents stored in the S3 buckets.
2. Delete the stack: sam delete.

Created by:

Rohan Mehta

Rohan Mehta

Associate Cloud Application Architect at AWS.