Get in Touch
 Duration 16 hours

Course Outline

Module 1: Overview of Confluent Apache Kafka Architecture and Cluster Configuration

  • Understanding Apache Kafka and the Confluent Platform
  • Core concepts: Kafka brokers, producers, consumers, and topics
  • Confluent's role in data streaming and messaging workflows
  • Confluent extensions: REST Proxy, Schema Registry, and Control Center
  • Cluster architecture: Brokers, partitions, and replication

Module 2: Configuring the Zookeeper Quorum

  • Introduction to Zookeeper
  • The function of Zookeeper within a Kafka cluster
  • Determining Zookeeper quorum size
  • Configuring Zookeeper
  • Setting up SSH on servers
  • Practical Exercise: Configuring Zookeeper (as a team and as a service)
  • Utilizing the Zookeeper Command Line Interface (CLI)
  • Practical Exercise: Establishing the Zookeeper quorum
  • Zookeeper's internal file system structure
  • Performance considerations for Zookeeper
  • Demonstration: Managing Zookeeper tools and Zoonavigator

Module 3: Configuring the Kafka Cluster

  • Foundations of Kafka
  • Kafka configuration parameters
  • Practical Exercise: Configuring Kafka on a single broker
  • Practical Exercise: Running Kafka commands
  • Practical Exercise: Setting up a multi-broker Kafka cluster
  • Practical Exercise: Testing the Kafka cluster
  • Verification of cluster connectivity
  • Configuring Advertised.listeners: A critical setting
  • Topic configuration
  • Establishing message ingestion and delivery within topics
  • Practical Exercise: Demonstrating Kafka resilience
  • Kafka performance: I/O, network, RAM, CPU, and OS impact
  • Additional factors influencing Kafka performance
  • Practical Exercise: Modifying broker configurations

Module 4: Advanced Kafka Configuration

  • Configuring Landoop Kafka Topics UI, Confluent REST Proxy, and Confluent Schema Registry
  • Messaging via CLI, Java, and Spring Framework
  • Monitoring with Confluent Control Center, Elasticsearch, and other tools
  • Managing log files and offsets
  • High availability and disaster recovery planning
  • Achieving high availability through replication
  • Performance tuning for producers and consumers
  • Developing disaster recovery strategies
  • Controlling failover and data recovery
  • Setting up Connectors
  • Implementing Kafka Connect
  • Enhancing Kafka security features

Summary and Recommended Next Steps

Requirements

  • Proficiency with Linux-based operating systems and command-line utilities
  • Understanding of core distributed systems principles
  • Knowledge of fundamental networking and system configuration

Target Audience

  • DevOps and SRE teams overseeing Kafka deployments
  • System administrators managing Confluent and Zookeeper environments
  • Kafka developers and architects focused on scalable system design

Testimonials (2)

Upcoming Courses

Related Categories