[{"data":1,"prerenderedAt":68},["ShallowReactive",2],{"pattern-kinesis-data-firehose-lambda-sam":3},{"id":4,"title":5,"architectureURL":6,"cleanup":7,"contributors":10,"deploy":12,"description":15,"extension":16,"framework":17,"gitHub":18,"highlight":6,"introBox":23,"language":28,"level":29,"meta":30,"patternArch":31,"resources":55,"s3URL":6,"services":6,"stem":63,"testing":64,"videoId":6,"__hash__":67},"patterns\u002Fpatterns\u002Fkinesis-data-firehose-lambda-sam.json","Amazon Data Firehose Data Transformation with AWS Lambda",null,{"text":8},[9],"Delete the stack: aws cloudformation delete-stack --stack-name STACK_NAME",[11],"content\u002Fcontributors\u002Fmaya-flores.json",{"text":13},[14],"sam deploy --guided","Transform incoming source data and deliver the transformed data to destinations.","json","AWS SAM",{"template":19},{"repoURL":20,"templateURL":21,"projectFolder":21,"templateFile":22},"https:\u002F\u002Fgithub.com\u002Faws-samples\u002Fserverless-patterns\u002Ftree\u002Fmain\u002Ffirehose-transformation-sam","firehose-transformation-sam","template.yaml",{"headline":24,"text":25},"How it works",[26,27],"The purpose of this pattern is to deploy the infrastructure necessary to enable Kinesis Data Firehose data transformation.","Kinesis Data Firehose can invoke a Lambda function to transform incoming source data and deliver the transformed data to destinations. In this architecture, Kinesis Data Firehose then invokes the specified Lambda function asynchronously with each buffered batch using the AWS Lambda synchronous invocation mode. The transformed data is sent from Lambda to Kinesis Data Firehose. Kinesis Data Firehose then sends it to the destination S3 bucket when the specified destination buffering size or buffering interval is reached, whichever happens first.","Node.js","200",{},{"icon1":32,"icon2":37,"icon3":41,"icon4":43,"line1":47,"line2":51,"line3":53},{"x":33,"y":34,"service":35,"label":36},20,50,"kinesis-firehose","Kinesis Data Firehose",{"x":38,"y":34,"service":39,"label":40},40,"lambda","AWS Lambda",{"x":42,"y":34,"service":35,"label":36},60,{"x":44,"y":34,"service":45,"label":46},80,"s3","S3",{"from":48,"to":49,"label":50},"icon1","icon2","",{"from":49,"to":52,"label":50},"icon3",{"from":52,"to":54,"label":50},"icon4",{"bullets":56},[57,60],{"text":58,"link":59},"Amazon Data Firehose Data Transformation","https:\u002F\u002Fdocs.aws.amazon.com\u002Ffirehose\u002Flatest\u002Fdev\u002Fdata-transformation.html",{"text":61,"link":62},"Redact sensitive data from streaming data in near-real time using Amazon Comprehend and Amazon Data Firehose","https:\u002F\u002Faws.amazon.com\u002Fblogs\u002Fmachine-learning\u002Fredact-sensitive-data-from-streaming-data-in-near-real-time-using-amazon-comprehend-and-amazon-kinesis-data-firehose\u002F","patterns\u002Fkinesis-data-firehose-lambda-sam",{"text":65},[66],"See the GitHub repo for detailed testing instructions.","t61bzysT98ozfNv-wfU98Vzp9Az1cedA4zKEtp7RLxk",1778927708920]