Webinar: Get Hands-On With Serverless
Register now
×
Services
Services
AWS Lambda
Amazon API Gateway
Amazon EventBridge
Amazon EventBridge Pipes
Amazon EventBridge Scheduler
Amazon S3
Amazon SQS
AWS Step Functions
Learn
Learn
Getting Started with AWS Lambda
Learning Guides
Workshops
Live Workshops & Events
Blogs
Videos
Office Hours Livestream
Serverless Operations
Testing Applications
Example code
Example code
Patterns Collection
Testing Patterns
Workflows Collection
Code Snippets
Sample applications
EDA
EDA
Introduction to event-driven architectures (EDA)
EDA guide
EDA visualizations
EventBridge visualizations
Who is building serverless EDA?
AWS services to build EDA applications
Document your EDA
Search
Using AWS Lambda to process Apache Kafka streams
Resources
1 min
Streaming
Building serverless applications with streaming data
Best practices for right-sizing your Apache Kafka clusters to optimize performance and cost
Serverless Streaming Architectures and Best Practices
Confluent: Trigger AWS Lambda Functions Directly from an Apache Kafka Topic
Confluent: Kafka Connect
Self-managed Kafka
Using Lambda with self-managed Apache Kafka
Using self-hosted Apache Kafka as an event source for AWS Lambda
Amazon MSK
Using Lambda with Amazon MSK
Using Amazon MSK as an event source for AWS Lambda
Creating a serverless Apache Kafka publisher using AWS Lambda
Amazon MSK Labs Workshop
Amazon Managed Streaming for Apache Kafka Documentation
AWS Lambda native support for Avro and Protobuf formatted Apache Kafka events
Java Lambda Avro Kafka Event Sample Code
Provisioned Mode for Kafka Event Source Mappings with AWS Lambda
Networking
Setting up AWS Lambda with an Apache Kafka cluster within a VPC
Connecting outbound networking to resources in a VPC
How do I troubleshoot Lambda triggers that poll from MSK and self-managed Kafka clusters?
What are VPC endpoints?
MSK Cross VPC connectivity
Created by:
Julian Wood
Julian is a developer advocate at AWS who loves helping developers learn how serverless and AI technologies can transform the way they build and run applications in the cloud.
Previous
Troubleshooting
Lessons:
9
1 - Introducing streaming
4 min
2 - Using Kafka to build your streaming application
6 min
3 - Using Lambda to consume records from Kafka
4 min
4 - Configuring Kafka and Lambda
9 min
5 - Processing Kafka streams using the Lambda ESM
9 min
6 - Scaling and throughput
5 min
7 - Monitoring and observability
2 min
8 - Troubleshooting
3 min
9 - Resources
1 min