Course Outline

Overview of Distributed Messaging Systems

  • Use Cases
  • Alternatives to Kafka

Kafka API

  • Producer API
  • High Level Consumer API
  • Simple Consumer API
  • Kafka Hadoop Consumer API

Configuration

  • New Producer
  • Broker
  • Consumer and Producer Configuration

Design

  • Motivation
  • Persistence
  • Efficiency
  • The Producer
  • The Consumer
  • Message Delivery Semantics
  • Replication

Implementation

  • API Design
  • Network Layer
  • Messages
  • Message format
  • Log
  • Distribution

Basic Kafka Operations

  • Adding and removing topics
  • Modifying topics
  • Graceful shutdown
  • Balancing leadership
  • Checking consumer position
  • Mirroring data between clusters
  • Expanding your cluster
  • Decommissioning brokers
  • Increasing replication factor

Other

  • Datacenters
  • Important Server Configs
  • Important Client Configs
  • Production Server Configs
  • Monitoring
  • ZooKeeper

 

 

Requirements

Basic system administration skills, understanding of any object oriented programming language.

  14 Hours
 

Testimonials

Related Courses

Apache Kafka Connect

  7 hours

Building Data Pipelines with Apache Kafka

  7 hours

Kafka for Administrators

  21 hours

Security for Apache Kafka

  7 hours

Big Data Streaming for Developers

  14 hours

Building Kafka Solutions with Confluent

  14 hours

A Practical Introduction to Stream Processing

  21 hours

Apache Kafka for Python Programmers

  7 hours

Stream Processing with Kafka Streams

  7 hours

Samza for Stream Processing

  14 hours

Confluent KSQL

  7 hours

SMACK Stack for Data Science

  14 hours

Spark Streaming with Python and Kafka

  7 hours

Microservices with Spring Cloud and Kafka

  21 hours