Complete Guide to Apache Kafka for Beginners
With Stephane Maarek
Liked by 783 users
Duration: 8h 13m
Skill level: Beginner
Released: 5/10/2023
Course details
Kafka is the leading open-source, enterprise-scale data streaming technology. It helps you move your data where you need it, in real time, reducing the headaches that come with integrations between multiple source and target systems. This training course helps you get started with all the fundamental Kafka operations, explore the Kafka CLI and APIs, and perform key tasks like building your own producers and consumers. Learn how to start a personal Kafka cluster on Mac, Windows, or Linux; master fundamental concepts including topics, partitions, brokers, producers, and consumers; and start writing, storing, and reading data with producers, topics, and consumers. Instructor Stephane Maarek includes practical use cases and examples, such as consuming data from sources like Wikipedia and Elasticsearch, that feature real-world architecture and production deployments. Stephane finishes the course with a look at some advanced topics, like log cleanup policies and Large messages in Kafka.
Skills you’ll gain
Earn a sharable certificate
Share what you’ve learned, and be a standout professional in your desired industry with a certificate showcasing your knowledge gained from the course.
Learning
LinkedIn Learning
Certificate of Completion
-
Showcase on your LinkedIn profile under “Licenses and Certificate” section
-
Download or print out as PDF to share with others
-
Share as image online to demonstrate your skill
Meet the instructor
Learner reviews
4.8 out of 5
The overall rating is calculated using the average of submitted ratings. Ratings and reviews can only be submitted when non-anonymous learners complete at least 40% of the course. This helps us avoid fake reviews and spam.
-
Akash Patel
Akash Patel
Java Developer excelling in software development with a Master's degree
Contents
-
-
Topics, partitions, and offsets6m 10s
-
(Locked)
Producers and message keys7m 24s
-
(Locked)
Consumers and deserialization4m 1s
-
(Locked)
Consumer groups and consumer offsets7m 4s
-
(Locked)
Brokers and topics4m 28s
-
(Locked)
Topic replication5m 30s
-
(Locked)
Producer acknowledgments and topic durability2m 9s
-
(Locked)
ZooKeeper5m 14s
-
Kafka KRaft: Removing ZooKeeper1m 58s
-
(Locked)
Theory roundup1m 33s
-
-
-
Important: Starting Kafka and lectures order4m 22s
-
(Locked)
Starting Kafka with Conduktor: Multi-platform2m 46s
-
(Locked)
macOS X: Download and set up Kafka in PATH6m 37s
-
(Locked)
macOS X: Start ZooKeeper and Kafka3m 49s
-
(Locked)
macOS X: Using brew4m 8s
-
(Locked)
Linux: Download and set up Kafka in PATH7m 32s
-
(Locked)
Linux: Start ZooKeeper and Kafka3m 45s
-
(Locked)
Windows WSL2: Download Kafka and PATH setup8m 3s
-
(Locked)
Windows WSL2: Start ZooKeeper and Kafka3m 20s
-
(Locked)
Windows WSL2: How to fix problems5m 27s
-
(Locked)
Windows non-WSL2: Start ZooKeeper and Kafka8m 31s
-
-
-
(Locked)
Kafka SDK list1m 14s
-
(Locked)
Creating a Kafka project8m 37s
-
(Locked)
Java producer12m 4s
-
(Locked)
Java producer callbacks10m 9s
-
Java producer with keys4m 56s
-
(Locked)
Java consumer12m 15s
-
(Locked)
Java consumer: Graceful shutdown6m 49s
-
(Locked)
Java consumer inside consumer group4m 50s
-
(Locked)
Java consumer incremental cooperative rebalance and static group membership7m 13s
-
(Locked)
Java consumer incremental cooperative rebalance: Practice3m 56s
-
(Locked)
Java consumer auto offset commit behavior3m 1s
-
(Locked)
Programming: Advanced tutorials1m 36s
-
(Locked)
-
-
(Locked)
Wikimedia producer project setup6m 25s
-
(Locked)
Wikimedia producer implementation11m 54s
-
(Locked)
Wikimedia producer run2m 40s
-
Wikimedia producer: Producer config intros45s
-
(Locked)
Producer acknowledgments deep dive8m 48s
-
(Locked)
Producer retries3m 3s
-
(Locked)
Idempotent producer2m 52s
-
(Locked)
Safe Kafka producer settings1m 59s
-
(Locked)
Wikimedia producer safe producer implementation4m 3s
-
(Locked)
Kafka message compression4m 47s
-
(Locked)
linger.ms and batch.size producer settings3m 23s
-
(Locked)
Wikimedia producer high-throughput implementation3m 16s
-
(Locked)
Producer default partitioner and sticky partitioner4m 18s
-
(Locked)
[Advanced] max.block.ms and buffer.memory2m 39s
-
(Locked)
-
-
(Locked)
OpenSearch consumer: Project overview52s
-
(Locked)
OpenSearch consumer: Project setup3m 32s
-
(Locked)
Setting up OpenSearch on Docker2m 38s
-
(Locked)
Setting up OpenSearch on the Cloud1m 57s
-
OpenSearch 1014m 26s
-
(Locked)
OpenSearch consumer implementation: Part 17m 26s
-
(Locked)
OpenSearch consumer implementation: Part 29m 34s
-
(Locked)
Consumer delivery semantics3m 16s
-
(Locked)
OpenSearch consumer implementation: Part 3 idempotence5m 29s
-
(Locked)
Consumer offsets commit strategies4m 38s
-
(Locked)
OpenSearch consumer implementation: Part 4 delivery semantics4m 52s
-
(Locked)
OpenSearch consumer implementation: Part 5 batching data4m 20s
-
(Locked)
Consumer offset reset behavior2m 6s
-
(Locked)
OpenSearch consumer implementation: Part 6 replaying data2m 57s
-
(Locked)
Consumer internal threads5m
-
(Locked)
Consumer replica fetching: Rack awareness2m 50s
-
(Locked)
-
-
(Locked)
Kafka extended APIs: Overview1m 23s
-
(Locked)
Kafka Connect introduction2m 32s
-
(Locked)
Kafka Connect Wikimedia and Elasticsearch hands-on10m 50s
-
(Locked)
Kafka Streams introduction1m 52s
-
(Locked)
Kafka Streams hands-on4m 25s
-
(Locked)
Kafka Schema Registry introduction4m 28s
-
(Locked)
Kafka Schema Registry hands-on6m 54s
-
(Locked)
Which Kafka API should you use?1m 27s
-
(Locked)
-
-
(Locked)
Choosing partition count and replication factor5m 21s
-
(Locked)
Kafka topics naming convention1m 31s
-
(Locked)
Case study: MovieFlix5m 10s
-
(Locked)
Case study: GetTaxi4m 18s
-
(Locked)
Case study: MySocialMedia5m 32s
-
(Locked)
Case study: MyBank3m 41s
-
(Locked)
Case study: Big data ingestion1m 36s
-
(Locked)
Case study: Logging and metrics aggregation1m 8s
-
(Locked)
-
-
(Locked)
Changing a topic configuration4m 35s
-
(Locked)
Segment and indexes4m 4s
-
(Locked)
Log cleanup policies2m 53s
-
(Locked)
Log cleanup delete2m 27s
-
(Locked)
Log compaction theory4m 52s
-
(Locked)
Log compaction practice4m 49s
-
(Locked)
Unclean leader election1m 43s
-
(Locked)
Large messages in Kafka2m 49s
-
(Locked)
What’s included
- Practice while you learn 1 exercise file
- Test your knowledge 11 quizzes
- Learn on the go Access on tablet and phone