Webinar: Get Hands-On With ServerlessRegister now
Serverless Land
  • Services
  • Services
    AWS LambdaAmazon API GatewayAmazon EventBridgeAmazon EventBridge PipesAmazon EventBridge SchedulerAmazon S3Amazon SQSAWS Step Functions
  • Learn
  • Learn
    Getting Started with AWS LambdaLearning GuidesWorkshopsLive Workshops & EventsBlogsVideosOffice Hours LivestreamServerless OperationsTesting Applications
  • Example code
  • Example code
    Patterns CollectionTesting PatternsWorkflows CollectionCode SnippetsSample applications
  • EDA
  • EDA
    Introduction to event-driven architectures (EDA)EDA guideEDA visualizationsEventBridge visualizationsWho is building serverless EDA?AWS services to build EDA applicationsDocument your EDA
Using AWS Lambda to process Apache Kafka streamsResources1 min

Streaming

  • Building serverless applications with streaming data
  • Best practices for right-sizing your Apache Kafka clusters to optimize performance and cost
  • Serverless Streaming Architectures and Best Practices
  • Confluent: Trigger AWS Lambda Functions Directly from an Apache Kafka Topic
  • Confluent: Kafka Connect

Self-managed Kafka

  • Using Lambda with self-managed Apache Kafka
  • Using self-hosted Apache Kafka as an event source for AWS Lambda

Amazon MSK

  • Using Lambda with Amazon MSK
  • Using Amazon MSK as an event source for AWS Lambda
  • Creating a serverless Apache Kafka publisher using AWS Lambda
  • Amazon MSK Labs Workshop
  • Amazon Managed Streaming for Apache Kafka Documentation
  • AWS Lambda native support for Avro and Protobuf formatted Apache Kafka events
  • Java Lambda Avro Kafka Event Sample Code
  • Provisioned Mode for Kafka Event Source Mappings with AWS Lambda

Networking

  • Setting up AWS Lambda with an Apache Kafka cluster within a VPC
  • Connecting outbound networking to resources in a VPC
  • How do I troubleshoot Lambda triggers that poll from MSK and self-managed Kafka clusters?
  • What are VPC endpoints?
  • MSK Cross VPC connectivity

Created by:

Julian Wood
Julian WoodJulian is a developer advocate at AWS who loves helping developers learn how serverless and AI technologies can transform the way they build and run applications in the cloud.

PreviousTroubleshooting
Lessons:9
  • 1 - Introducing streaming
    4 min
  • 2 - Using Kafka to build your streaming application
    6 min
  • 3 - Using Lambda to consume records from Kafka
    4 min
  • 4 - Configuring Kafka and Lambda
    9 min
  • 5 - Processing Kafka streams using the Lambda ESM
    9 min
  • 6 - Scaling and throughput
    5 min
  • 7 - Monitoring and observability
    2 min
  • 8 - Troubleshooting
    3 min
  • 9 - Resources
    1 min

Privacy | Site Terms | Cookie Preferences | © Copyright 2026 Amazon.com, Inc. or its affiliates. All rights reserved.