Get in Touch
 Duration 16 hours

Course Outline

Module 1: Overview of Confluent Apache Kafka Architecture and Cluster Setup

  • Understanding Apache Kafka and the Confluent Platform
  • Core concepts: brokers, producers, consumers, and topics
  • The function of Kafka in data streaming and messaging workflows
  • Confluent-specific additions: REST Proxy, Schema Registry, and Control Center
  • Kafka cluster structure: brokers, partitions, and replication

Module 2: Configuring Zookeeper Quorums

  • Introduction to Zookeeper
  • The function of Zookeeper within a Kafka cluster
  • Determining Zookeeper quorum size
  • Zookeeper configuration basics
  • Setting up SSH on server infrastructure
  • Practical Exercise: Configuring Zookeeper (team and service modes)
  • Navigating the Zookeeper Command Line Interface (CLI)
  • Practical Exercise: Establishing Zookeeper quorums
  • Exploring Zookeeper's internal file system
  • Performance considerations for Zookeeper
  • Demonstration: Using Zookeeper management tools and Zoonavigator

Module 3: Configuring Kafka Clusters

  • Fundamentals of Kafka
  • Essential Kafka configuration settings
  • Practical Exercise: Configuring Kafka on a single broker
  • Practical Exercise: Running Kafka commands
  • Practical Exercise: Establishing a multi-broker Kafka cluster
  • Practical Exercise: Testing Kafka cluster integrity
  • Verifying connectivity to your Kafka cluster
  • Configuring Advertised.listeners: critical settings
  • Topic configuration details
  • Setting up message ingestion and delivery through topics
  • Practical Exercise: Demonstrating Kafka's resilience
  • Kafka performance analysis: I/O, network, RAM, CPU, and OS factors
  • Additional performance factors affecting Kafka
  • Practical Exercise: Modifying broker configurations

Module 4: Advanced Kafka Configuration

  • Configuring Landoop Kafka Topics UI, Confluent REST Proxy, and Schema Registry
  • Messaging via CLI, Java, and Spring Framework
  • Monitoring tools and metrics (Confluent Control Center, Elasticsearch, etc.)
  • Managing log files and offsets
  • High availability and disaster recovery planning
  • Achieving high availability through replication
  • Tuning producer and consumer performance
  • Disaster recovery strategies
  • Failover control and data restoration techniques
  • Configuring connectors
  • Implementing Kafka Connect
  • Integrating Kafka security features

Summary and Recommended Next Steps

Requirements

  • Proficiency with Linux-based operating systems and command-line interfaces
  • Working knowledge of distributed systems principles
  • Foundational understanding of networking protocols and system configuration

Target Audience

  • DevOps and SRE teams overseeing Kafka deployments
  • System administrators managing Confluent and Zookeeper infrastructure
  • Kafka developers and architects focused on building scalable systems

Testimonials (2)

Upcoming Courses

Related Categories