[{"data":1,"prerenderedAt":66},["ShallowReactive",2],{"pattern-firehose-transformation-terraform":3},{"id":4,"title":5,"architectureURL":6,"cleanup":7,"contributors":11,"deploy":13,"description":18,"extension":19,"framework":20,"gitHub":21,"highlight":6,"introBox":27,"language":32,"level":33,"meta":34,"patternArch":35,"resources":56,"s3URL":6,"services":6,"stem":61,"testing":62,"videoId":6,"__hash__":65},"patterns\u002Fpatterns\u002Ffirehose-transformation-terraform.json","Amazon Data Firehose Data Transformation with AWS Lambda",null,{"text":8},[9,10],"\u003Ccode>terraform destroy\u003C\u002Fcode>","\u003Ccode>terraform show\u003C\u002Fcode>",[12],"content\u002Fcontributors\u002Fnaresh-rajaram.json",{"text":14},[15,16,17],"terraform init","terraform plan","terraform apply","Transform incoming source data and deliver the transformed data to destinations.","json","Terraform",{"template":22},{"repoURL":23,"templateURL":24,"projectFolder":25,"templateFile":26},"https:\u002F\u002Fgithub.com\u002Faws-samples\u002Fserverless-patterns\u002Ftree\u002Fmain\u002Ffirehose-transformation-terraform","serverless-patterns\u002Ffirehose-transformation-terraform","firehose-transformation-terraform","main.tf",{"headline":28,"text":29},"How it works",[30,31],"The purpose of this pattern is to deploy the infrastructure necessary to enable Amazon Data Firehose data transformation.","Kinesis Data Firehose can invoke a AWS Lambda function to transform incoming source data and deliver the transformed data to destinations. In this architecture, Kinesis Data Firehose invokes the specified Lambda function asynchronously with each buffered batch using the AWS Lambda synchronous invocation mode. The transformed data is sent from Lambda to Kinesis Data Firehose. Kinesis Data Firehose then sends it to the destination Amazon S3 bucket when the specified destination buffering size or buffering interval is reached, whichever happens first.","Python","200",{},{"icon1":36,"icon2":41,"icon3":46,"line1":49,"line2":53},{"x":37,"y":38,"service":39,"label":40},30,20,"kinesis-firehose","Amazon Kinesis Firehose",{"x":42,"y":43,"service":44,"label":45},60,70,"lambda","AWS Lambda",{"x":42,"y":38,"service":47,"label":48},"s3","Amazon S3",{"from":50,"to":51,"label":52},"icon1","icon2","Data Transformation",{"from":50,"to":54,"label":55},"icon3","",{"bullets":57},[58],{"text":59,"link":60},"Amazon Data Firehose Data Transformation","https:\u002F\u002Fdocs.aws.amazon.com\u002Ffirehose\u002Flatest\u002Fdev\u002Fdata-transformation.html","patterns\u002Ffirehose-transformation-terraform",{"text":63},[64],"See the README in the GitHub repo for detailed testing instructions.","G5YPqx1C8_VtwxBz2GHWlagTpxKmblYFAznuqf9_gvY",1778927708760]