Apache Kafka Connect Training Course
Kafka Connect serves as an API designed for transferring large volumes of data between Apache Kafka and other systems.
This instructor-led live training, available either online or onsite, targets developers who want to integrate Apache Kafka with existing databases and applications for purposes such as data processing and analysis.
Upon completion of this training, participants will be capable of:
- Utilizing Kafka Connect to ingest substantial amounts of data from databases into Kafka topics.
- Ingesting log data generated by application servers into Kafka topics.
- Enabling collected data for stream processing.
- Exporting data from Kafka topics to secondary systems for storage and analysis.
Course Format
- Interactive lectures and discussions.
- Extensive exercises and practical sessions.
- Hands-on implementation in a live-lab environment.
Customization Options
- To request a customized training session for this course, please contact us to arrange it.
Course Outline
Introduction
Overview of the Apache Kafka Ecosystem (Zookeeper, Streams, Connect, etc.)
The Components of a Kafka Connect Cluster
Installing and Running Apache Kafka
Configuring the Connectors
Ingesting Database Data into Apache Kafka
Applying Transformations
Ingesting Data from a Web Server Log
Validating the Connection
Managing Connections with the REST API
Ingesting Real-time Data from the Web
Case Study: Reading and Transforming Data from Twitter
Processing and Analyzing Data with Kafka Streams
Deploying Kafka Connect
Writing Your Own Connector
Defining Dynamic Input/Output Streams
Monitoring and Managing Kafka Connect in Production
Troubleshooting
Summary and Conclusion
Requirements
- Experience with Apache Kafka.
- Proficiency in Java programming.
Target Audience
- Developers
Need help picking the right course?
Apache Kafka Connect Training Course - Enquiry
Testimonials (2)
Possibility to perform independent exercises in the training environment.
Tomasz - PKO Zycie Towarzystwo Ubezpieczen S.A.
Course - Kafka for Administrators
The trainer tried to make the most complicated topics , explain it in simpler way
Calvin Raj Antony - SICPA SA
Course - Administration of Kafka Message Queue
Upcoming Courses
Related Courses
Administration of Confluent Apache Kafka
21 HoursConfluent Apache Kafka is a distributed event streaming platform engineered for high-throughput, fault-tolerant data pipelines and real-time analytics.
This instructor-led live training, available either online or onsite, targets intermediate-level system administrators and DevOps professionals who wish to install, configure, monitor, and troubleshoot Confluent Apache Kafka clusters.
By the end of this training, participants will be able to:
- Understand the components and architecture of Confluent Kafka.
- Deploy and manage Kafka brokers, Zookeeper quorums, and key services.
- Configure advanced features including security, replication, and performance tuning.
- Use management tools to monitor and maintain Kafka clusters.
Format of the Course
- Interactive lecture and discussion.
- Lots of exercises and practice.
- Hands-on implementation in a live-lab environment.
Course Customization Options
- To request a customized training for this course, please contact us to arrange.
Big Data Streaming for Developers
14 HoursMaster the implementation of comprehensive big data streaming scenarios. Gain expertise in real-time data preparation and upkeep utilizing Informatica, Edge, Kafka, and Spark. This program encompasses software versions 10.2.1 and newer.
Confluent Apache Kafka: Cluster Operations and Configuration
16 HoursConfluent Apache Kafka is an enterprise-grade distributed event streaming platform built on Apache Kafka. It supports high-throughput, fault-tolerant data pipelines and real-time streaming applications.
This instructor-led, live training (online or onsite) is aimed at intermediate-level engineers and administrators who wish to deploy, configure, and optimize Confluent Kafka clusters in production environments.
By the end of this training, participants will be able to:
- Install, configure, and operate Confluent Kafka clusters with multiple brokers.
- Design high-availability setups using Zookeeper and replication techniques.
- Tune performance, monitor metrics, and apply recovery strategies.
- Secure, scale, and integrate Kafka with enterprise environments.
Format of the Course
- Interactive lecture and discussion.
- Lots of exercises and practice.
- Hands-on implementation in a live-lab environment.
Course Customization Options
- To request a customized training for this course, please contact us to arrange.
Building Kafka Solutions with Confluent
14 HoursThis instructor-led live training, available both online and onsite, is designed for engineers looking to leverage Confluent—a distribution of Kafka—to construct and manage a real-time data processing platform for their applications.
Upon completing this training, participants will be able to:
- Install and configure the Confluent Platform.
- Utilize Confluent’s management tools and services to simplify Kafka operations.
- Store and process incoming stream data effectively.
- Optimize and manage Kafka clusters.
- Implement security measures for data streams.
Course Format
- Interactive lectures and discussions.
- Extensive exercises and practice sessions.
- Hands-on implementation within a live-lab environment.
Customization Options
- This course is based on the open-source version of Confluent: Confluent Open Source.
- To request customized training for this course, please contact us to arrange.
Building Data Pipelines with Apache Kafka
7 HoursApache Kafka serves as a distributed streaming platform and has become the industry standard for developing data pipelines. It addresses a wide array of data processing scenarios, functioning as a message queue, distributed log, stream processor, and more.
The course begins by exploring the theoretical foundations of data pipelines, followed by an in-depth look at Kafka's core concepts. Participants will also examine key components such as Kafka Streams and Kafka Connect.
A Practical Introduction to Stream Processing
21 HoursIn this instructor-led, live training in the UAE (onsite or remote), participants will learn how to set up and integrate various Stream Processing frameworks with existing big data storage systems, related software applications, and microservices.
By the end of this training, participants will be able to:
- Install and configure different Stream Processing frameworks, such as Spark Streaming and Kafka Streaming.
- Understand and select the most suitable framework for specific tasks.
- Process data continuously, concurrently, and on a record-by-record basis.
- Integrate Stream Processing solutions with existing databases, data warehouses, data lakes, and more.
- Integrate the most appropriate stream processing library with enterprise applications and microservices.
Distributed Messaging with Apache Kafka
14 HoursThis course is designed for enterprise architects, software developers, system administrators, and professionals seeking to master high-throughput distributed messaging systems. While the curriculum covers a broad range of topics, it can be customized to focus on specific areas, such as system administration, to better align with your particular requirements.
Kafka for Administrators
21 HoursThis instructor-led, live training in the UAE (online or onsite) is aimed at beginner-level / intermediate-level / advanced-level system administrators and operations engineers who wish to use Apache Kafka to deploy, secure, monitor, and troubleshoot Kafka clusters.
By the end of this training, participants will be able to: explain Kafka architecture and KRaft mode, operate and secure Kafka clusters, monitor performance and reliability, and resolve common production issues.
Apache Kafka for Developers
21 HoursThis instructor-led live training in the UAE (online or onsite) is designed for intermediate developers interested in creating big data applications with Apache Kafka.
By the end of this training, participants will be able to:
- Build Kafka producers and consumers to transmit and retrieve data from Kafka.
- Connect Kafka with external systems via Kafka Connect.
- Develop streaming applications using Kafka Streams and ksqlDB.
- Link a Kafka client application to Confluent Cloud for cloud-hosted Kafka deployments.
- Acquire practical skills through hands-on exercises and real-world scenarios.
Apache Kafka for Python Programmers
7 HoursThis instructor-led, live training in the UAE (online or onsite) is aimed at data engineers, data scientists, and programmers who wish to use Apache Kafka features in data streaming with Python.
By the end of this training, participants will be able to use Apache Kafka to monitor and manage conditions in continuous data streams using Python programming.
Kafka Fundamentals for Java Developers
14 HoursThis instructor-led, live training in the UAE (online or on-site) is designed for intermediate-level Java developers who want to integrate Apache Kafka into their applications for reliable, scalable, and high-throughput messaging.
Upon completing this training, participants will be able to:
- Comprehend the architecture and core components of Kafka.
- Set up and configure a Kafka cluster.
- Produce and consume messages using Java.
- Implement Kafka Streams for real-time data processing.
- Ensure fault tolerance and scalability in Kafka applications.
Administration of Kafka Message Queue
14 HoursThis instructor-led live training in the UAE (online or on-site) is designed for intermediate-level system administrators looking to leverage Kafka's message queuing features effectively.
By the conclusion of this training, participants will be able to:
- Comprehend Kafka's message queuing capabilities and architecture.
- Configure Kafka topics specifically for message queuing scenarios.
- Produce and consume messages using Kafka.
- Monitor and manage Kafka as a message queue.
Security for Apache Kafka
7 HoursThis instructor-led live training in the UAE (online or on-site) is designed for software testers who wish to implement network security measures into an Apache Kafka application.
By the end of this training, participants will be able to:
- Deploy Apache Kafka onto a cloud-based server.
- Implement SSL encryption to prevent attacks.
- Add ACL authentication to track and control user access.
- Ensure credible clients have access to Kafka clusters with SSL and SASL authentication.
Apache Kafka and Spring Boot
7 HoursThis instructor-led, live training in the UAE (online or onsite) targets intermediate developers eager to master Kafka's core concepts and integrate it with Spring Boot.
Upon completing this training, participants will be able to:
- Comprehend Kafka and its underlying architecture.
- Install, configure, and establish a basic Kafka environment.
- Integrate Kafka with Spring Boot.
Stream Processing with Kafka Streams
7 HoursKafka Streams is a client-side library designed for building applications and microservices that interact with the Apache Kafka messaging system. Historically, data processing between producers and consumers in Apache Kafka relied on external tools like Apache Spark or Apache Storm. However, by utilizing the Kafka Streams API within an application, data can be processed directly within the Kafka environment, eliminating the need to transfer data to a separate cluster for computation.
In this instructor-led live training, participants will learn how to integrate Kafka Streams into sample Java applications that exchange data with Apache Kafka for real-time stream processing.
Upon completion of this training, participants will be able to:
- Grasp the features and advantages of Kafka Streams compared to other stream processing frameworks
- Process stream data directly within a Kafka cluster
- Develop Java or Scala applications or microservices that integrate with Kafka and Kafka Streams
- Write concise code to transform input Kafka topics into output Kafka topics
- Build, package, and deploy the application
Audience
- Developers
Format of the course
- A blend of lectures, discussions, exercises, and extensive hands-on practice
Notes
- To request a customized training for this course, please contact us to arrange