[{"data":1,"prerenderedAt":154},["ShallowReactive",2],{"content-svc-lambda-guides-serverless-stream-processing-with-lambda-msk-lambda-auth-options":3},{"markdown":4,"frontMatterAttributes":5,"bodyRaw":8,"menu":9,"menuType":147,"isCollapseableMenu":12,"nextDocItem":89,"previousDocItem":78,"contributorPaths":148,"contentName":153,"slug":88,"readingTime":67},"\u003Cp>There are multiple options for connecting Lambda functions to MSK clusters. The following resources can help with setting up the Lambda function to connect with different authentication mechanisms:\u003C\u002Fp>\n\u003Col>\n\u003Cli>Unauthenticated access\u003C\u002Fli>\n\u003Cli>SASL\u002FSCRAM authentication\u003C\u002Fli>\n\u003Cli>IAM role-based authentication\u003C\u002Fli>\n\u003Cli>Mutual TLS authentication\u003C\u002Fli>\n\u003C\u002Fol>\n\u003Cp>To learn more about Kafka authentication options with Lambda, follow the Kafka Lambda learning \u003Ca href=\"https:\u002F\u002Fserverlessland.com\u002Fcontent\u002Fguides\u002Flambda-kafka\u002Fintroduction\">guide\u003C\u002Fa>.\u003C\u002Fp>\n",{"title":6,"order":7},"Authentication options for Lambda consumers",56,"There are multiple options for connecting Lambda functions to MSK clusters. The following resources can help with setting up the Lambda function to connect with different authentication mechanisms:\n\n1. Unauthenticated access\n2. SASL\u002FSCRAM authentication\n3. IAM role-based authentication\n4. Mutual TLS authentication\n\nTo learn more about Kafka authentication options with Lambda, follow the Kafka Lambda learning [guide](https:\u002F\u002Fserverlessland.com\u002Fcontent\u002Fguides\u002Flambda-kafka\u002Fintroduction).\n",[10,41,96],{"title":11,"collapsible":12,"isCollapsed":13,"content":14},"Introduction",false,true,[15,21,31],{"title":11,"order":16,"time":17,"path":18,"id":19,"link":20},1,"2 min","1-introduction","1-introduction.md","\u002Fcontent\u002Fservice\u002Flambda\u002Fguides\u002Fserverless-stream-processing-with-lambda\u002F1-introduction",{"title":22,"order":23,"callout":24,"time":17,"path":28,"id":29,"link":30},"Getting started with streaming data",2,{"title":25,"description":26,"link":27},"Watch the video","This video will help you get started with Amazon Kinesis Data Streams, a massively scalable, durable, and low-cost streaming data service that enables you to continuously capture gigabytes of data per second from hundreds of thousands of sources, such as website clickstreams, database event streams, financial transactions, social media feeds, IT logs, and location-tracking events.","https:\u002F\u002Fwww.youtube.com\u002Fwatch?v=1I1DcJvmd4w","2-getting-started","2-getting-started.md","\u002Fcontent\u002Fservice\u002Flambda\u002Fguides\u002Fserverless-stream-processing-with-lambda\u002F2-getting-started",{"title":32,"order":33,"callout":34,"time":17,"path":38,"id":39,"link":40},"Event source mapping for Lambda",3,{"title":35,"description":36,"link":37},"Read the docs","Refer to the AWS Lambda documentation for detailed explanations of Lambda event source mappings","https:\u002F\u002Fdocs.aws.amazon.com\u002Flambda\u002Flatest\u002Fdg\u002Finvocation-eventsourcemapping.html","3-event-source-mapping","3-event-source-mapping.md","\u002Fcontent\u002Fservice\u002Flambda\u002Fguides\u002Fserverless-stream-processing-with-lambda\u002F3-event-source-mapping",{"title":42,"collapsible":12,"isCollapsed":12,"content":43},"Streaming processing with MSK",[44,63,71,78,85,89],{"title":45,"order":46,"youtubeVideoID":47,"resources":48,"callout":56,"time":17,"path":60,"id":61,"link":62},"MSK as event source for Lambda",51,"JKvIypfEiok",[49,53],{"link":50,"type":51,"text":52},"https:\u002F\u002Faws.amazon.com\u002Flambda\u002F","Text","AWS Lambda",{"link":54,"type":51,"text":55},"https:\u002F\u002Faws.amazon.com\u002Fserverless\u002F","Serverless on AWS",{"title":57,"description":58,"link":59},"Follow the Kafka with Lambda learning guide","Refer to the deep dive learning guide for using Kafka with Lambda","https:\u002F\u002Fserverlessland.com\u002Fcontent\u002Fguides\u002Flambda-kafka\u002Fintroduction","msk-stream-processing","msk-stream-processing.md","\u002Fcontent\u002Fservice\u002Flambda\u002Fguides\u002Fserverless-stream-processing-with-lambda\u002Fmsk-stream-processing",{"title":64,"order":65,"callout":66,"time":67,"path":68,"id":69,"link":70},"Deep dive into Lambda ESM for MSK",50,{"title":57,"description":58,"link":59},"1 min","msk-esm-deep-dive","msk-esm-deep-dive.md","\u002Fcontent\u002Fservice\u002Flambda\u002Fguides\u002Fserverless-stream-processing-with-lambda\u002Fmsk-esm-deep-dive",{"title":72,"order":73,"callout":74,"time":17,"path":75,"id":76,"link":77},"Ordered processing of messages",52,{"title":57,"description":58,"link":59},"msk-ordered-processing","msk-ordered-processing.md","\u002Fcontent\u002Fservice\u002Flambda\u002Fguides\u002Fserverless-stream-processing-with-lambda\u002Fmsk-ordered-processing",{"title":79,"order":80,"callout":81,"time":67,"path":82,"id":83,"link":84},"Scaling of consumers",54,{"title":57,"description":58,"link":59},"msk-scaling-consumers","msk-scaling-consumers.md","\u002Fcontent\u002Fservice\u002Flambda\u002Fguides\u002Fserverless-stream-processing-with-lambda\u002Fmsk-scaling-consumers",{"title":6,"order":7,"time":67,"path":86,"id":87,"link":88},"msk-lambda-auth-options","msk-lambda-auth-options.md","\u002Fcontent\u002Fservice\u002Flambda\u002Fguides\u002Fserverless-stream-processing-with-lambda\u002Fmsk-lambda-auth-options",{"title":90,"order":91,"callout":92,"time":67,"path":93,"id":94,"link":95},"Error handling in Lambda functions",58,{"title":57,"description":58,"link":59},"msk-lambda-error-handling","msk-lambda-error-handling.md","\u002Fcontent\u002Fservice\u002Flambda\u002Fguides\u002Fserverless-stream-processing-with-lambda\u002Fmsk-lambda-error-handling",{"title":97,"collapsible":12,"isCollapsed":13,"content":98},"Streaming processing with KDS",[99,108,120,131,139],{"title":100,"weight":101,"learningGoals":102,"time":104,"path":105,"id":106,"link":107},"Kinesis Data Streams (KDS) - Key Concepts and Terminologies",60,[103],"Learn key concepts and terminologies of Amazon KDS","4 min","4-1-KDS-key-concepts-terms","4-1-KDS-key-concepts-terms.md","\u002Fcontent\u002Fservice\u002Flambda\u002Fguides\u002Fserverless-stream-processing-with-lambda\u002F4-1-KDS-key-concepts-terms",{"title":109,"weight":110,"learningGoals":111,"resources":113,"time":116,"path":117,"id":118,"link":119},"Amazon Kinesis Data Streams - Integration with AWS Lambda",62,[112],"Amazon KDS integration with AWS Lambda for Serverless stream processing",[114,115],"https:\u002F\u002Fdocs.aws.amazon.com\u002Flambda\u002Flatest\u002Fdg\u002Finvocation-eventsourcemapping.html#invocation-eventsourcemapping-batching","https:\u002F\u002Faws.amazon.com\u002Fblogs\u002Fcompute\u002Fnew-aws-lambda-scaling-controls-for-kinesis-and-dynamodb-event-sources\u002F","5 min","4-2-KDS-lambda-intg","4-2-KDS-lambda-intg.md","\u002Fcontent\u002Fservice\u002Flambda\u002Fguides\u002Fserverless-stream-processing-with-lambda\u002F4-2-KDS-lambda-intg",{"title":121,"weight":122,"learningGoals":123,"resources":125,"time":127,"path":128,"id":129,"link":130},"Amazon KDS - Error handling with Lambda ESM",64,[124],"How to handle errors when configuring Amazon KDS as Lambda ESM",[126],"https:\u002F\u002Fdocs.aws.amazon.com\u002Flambda\u002Flatest\u002Fdg\u002Fwith-kinesis.html","3 min","4-3-KDS-lambda-error-handling","4-3-KDS-lambda-error-handling.md","\u002Fcontent\u002Fservice\u002Flambda\u002Fguides\u002Fserverless-stream-processing-with-lambda\u002F4-3-KDS-lambda-error-handling",{"title":132,"weight":133,"learningGoals":134,"time":116,"path":136,"id":137,"link":138},"Kinesis Data Streams Scaling- Key Concepts and Terminologies",66,[135],"Learn key concepts and terminologies of Amazon KDS Scaling","4-4-KDS-scaling","4-4-KDS-scaling.md","\u002Fcontent\u002Fservice\u002Flambda\u002Fguides\u002Fserverless-stream-processing-with-lambda\u002F4-4-KDS-scaling",{"title":140,"weight":141,"learningGoals":142,"time":116,"path":144,"id":145,"link":146},"Kinesis Data Streams Monitoring",68,[143],"Learn Amazon KDS & Lambda monitoring methodologies","4-5-KDS-monitoring","4-5-KDS-monitoring.md","\u002Fcontent\u002Fservice\u002Flambda\u002Fguides\u002Fserverless-stream-processing-with-lambda\u002F4-5-KDS-monitoring","LIST",[149,150,151,152],"content\u002Fcontributors\u002Fmithun-mallick.json","content\u002Fcontributors\u002Fkevin-schwarz.json","content\u002Fcontributors\u002Fnaren-sithambaram.json","content\u002Fcontributors\u002Fprasanna-s-krishnan.json","Serverless Stream Processing with Lambda",1792578874605]