[{"data":1,"prerenderedAt":73},["ShallowReactive",2],{"pattern-s3-opensearch-serverless-osis-sam":3,"pattern-group-s3-opensearch-serverless-osis-sam":6},{"id":4,"title":5,"architectureURL":6,"cleanup":7,"contributors":10,"deploy":12,"description":15,"extension":16,"framework":17,"gitHub":18,"highlight":6,"introBox":22,"language":27,"level":28,"meta":29,"patternArch":30,"patternGroup":6,"patternGroupLabel":6,"resources":57,"stem":68,"testing":69,"videoId":6,"__hash__":72},"patterns\u002Fpatterns\u002Fs3-opensearch-serverless-osis-sam.json","Amazon S3 to Amazon OpenSearch Serverless with OpenSearch Ingestion",null,{"text":8},[9],"Empty both S3 buckets, then delete the stack: \u003Ccode>sam delete\u003C\u002Fcode>.",[11],"content\u002Fcontributors\u002Fsudhansu-mohapatra.json",{"text":13},[14],"\u003Ccode>sam deploy --capabilities CAPABILITY_NAMED_IAM --guided\u003C\u002Fcode>","Ingest JSON objects from Amazon S3 into Amazon OpenSearch Serverless using an Amazon OpenSearch Ingestion (OSIS) pipeline.","json","AWS SAM",{"template":19},{"patternPath":20,"templateFile":21},"s3-opensearch-serverless-osis\u002Fsam","template.yaml",{"headline":23,"text":24},"How it works",[25,26],"This pattern indexes JSON Lines files from Amazon S3 into an Amazon OpenSearch Serverless collection with an Amazon OpenSearch Ingestion pipeline. The source bucket sends `s3:ObjectCreated` notifications to an Amazon SQS queue. The pipeline polls the queue, reads each new object, parses every line into a document with `parse_json`, and writes it to the `s3-logs` index. Documents that fail to index go to a separate dead-letter S3 bucket, so they don't trigger the pipeline again. The template needs no application code.","Cost: the pipeline bills for at least 1 Ingestion OCU per hour while it runs, so stop it with `aws osis stop-pipeline` when you're not using it. The collection is in a collection group with a minimum of 0 OCUs, so it scales to zero and stops billing for compute after 10 minutes with no requests. The network policy allows public access for the demo; use a VPC endpoint for production.","Integration","300",{},{"icon1":31,"icon2":36,"icon3":40,"icon4":44,"line1":47,"line2":51,"line3":54},{"x":32,"y":33,"service":34,"label":35},12,45,"s3","Amazon S3\nSource bucket",{"x":37,"y":33,"service":38,"label":39},37,"sqs","Amazon SQS\nQueue",{"x":41,"y":33,"service":42,"label":43},63,"opensearch","Amazon OpenSearch\nIngestion",{"x":45,"y":33,"service":42,"label":46},88,"Amazon OpenSearch\nServerless",{"from":48,"to":49,"label":50},"icon1","icon2","Object\ncreated",{"from":49,"to":52,"label":53},"icon3","Poll",{"from":52,"to":55,"label":56},"icon4","Index",{"bullets":58},[59,62,65],{"text":60,"link":61},"Using an OpenSearch Ingestion pipeline with Amazon S3","https:\u002F\u002Fdocs.aws.amazon.com\u002Fopensearch-service\u002Flatest\u002Fdeveloperguide\u002Fconfigure-client-s3.html",{"text":63,"link":64},"Ingesting data into Amazon OpenSearch Serverless collections","https:\u002F\u002Fdocs.aws.amazon.com\u002Fopensearch-service\u002Flatest\u002Fdeveloperguide\u002Fserverless-clients.html",{"text":66,"link":67},"Amazon OpenSearch Ingestion","https:\u002F\u002Fdocs.aws.amazon.com\u002Fopensearch-service\u002Flatest\u002Fdeveloperguide\u002Fingestion.html","patterns\u002Fs3-opensearch-serverless-osis-sam",{"text":70},[71],"See the GitHub repo for detailed testing instructions.","28URz_xRCmBzT4-u4rpW9NnN-K1USeGg2gSi2obj9PA",1795189154940]