Course Outline
Module 1: Streaming Overview
- Key differences between batch and streaming
- Streaming Data Management use cases
- Streaming architecture
- Kappa architecture
- End-to-end Streaming Data Management
- Types of Streaming data
- Benefits of Streaming
Module 2: Edge Data Streaming (EDS) Overview
- EDS architecture
- EDS key features
- EDS Data flow process
- EDS UI
- Create an EDS Service
- Create a data flow
- Deploy a data flow
- Monitor the data flow
- Lab1: Create Edge Data Streaming Service
- Lab2: Create and Deploy a Data Flow
Module 3: Big Data Streaming Overview
- Big Data Streaming overview
- Stream Data Processing with Spark streaming
- BDS component architecture
- BDS key features
Module 4: Kafka Overview
- Kafka Concepts
- Kafka core APIs
- Topics in Kafka
- Kafka models
- Kafka Use cases
- Lab: Create a Kafka connection
Module 5: Streaming Mappings
- Sources in a Streaming Mapping
- Targets in Streaming Mapping
- Lookup sources
- Kafka Data Object Properties
- Lab: Create a Mapping with Kafka Source and HDFS Target
- Lab: Create a Mapping with Kafka Source and Kafka Target
- BDS Transformations
- Lab: Enhance Mapping Using Filter and Expression Transformations
- Lab: Enhance Mapping Using Window and Aggregator Transformations
- Lab: Enhance Mapping Using Sorter and Rank Transformations
Module 6: Monitoring Logs and Troubleshooting
- Spark Monitoring
- Viewing Logs
- Troubleshooting
- Lab: Monitor an EDS Data Flow
- Lab: Monitor a BDS Mapping
Module 7: Performance Tuning and Best Practices
- Tune performance of Spark jobs
- List some best practices while working with streaming data
Module 8: End-to-End Use Case
- Use Case
- EDS and BDS – Final Goal
- Lab: Convert Unstructured Streaming Data into Structured Data
- Lab: Ingest Data from EDS to BDS and Execute a Mapping in BDS
Testimonials
The instructor gives his time in explaining the topics and we see a lot in detail in question of installation of the necessary software to have kafka corriendp
Juan Manuel Del Alto - Hewlett Packard Centro de Servicios Globales S de RL
Informative and had correct level of detail I believe.
Asif Akhtar
I really was benefit from the easy to follow.
Zach Henke
The exercises, and especially when they didn't work (obviously my fault but fault finding is part of the job).
Peter Hendriks
I mostly liked the knowledge of the Trainer.
Christian Langer
I genuinely liked the detail explanations, well prepared document.
Allen Jeong
I was benefit from the practical advice (for Kafka configuration and management).
OLAmobile
I was benefit from the practical examples, trainer new what he is talking about.
Rumos
The trainer really knows Kafka very well, and has a lot of production experience in the matter.
Matej Puntra
The training was steered in the direction what the team wanted. The trainer is too good with vast experience in handling concepts like capability, performance, development and deployment standards and very swift in the training in addressing queries from different levels like regarding code, design, architecture and best practices etc.
Sarita Velagapudi - Welcome Real-time (ASPAC) Pte Ltd
Concepts, the way it presented, very communicative, very helpful, wide knowledge.
Sreenivasulu Narasingu - Welcome Real-time (ASPAC) Pte Ltd
I mostly enjoyed the amount of topics covered.
Ipreo
Be able to talk easily with the trainer.
- VSC Technologies
The coach's approach, the way of transferring knowledge.
- Ośrodek Przetwarzania Informacji-Państwowy Instytut Badawczy
way of conducting, practical exercises
darek lesiak - Ośrodek Przetwarzania Informacji-Państwowy Instytut Badawczy
subject
- Ośrodek Przetwarzania Informacji-Państwowy Instytut Badawczy
interactivity, contact with the trainer and its objectivity
- Ośrodek Przetwarzania Informacji-Pańswowy Instytut Badawczy
Good contact with listeners, considerable knowledge of the trainer.
- Ośrodek Przetwarzania Informacji-Pańswowy Instytut Badawczy
Interesting examples of exercises
- Ośrodek Przetwarzania Informacji-Pańswowy Instytut Badawczy
Interesting exercises, presenting the architecture and operation of Apache Kafka on diagrams.
Damian Niesteruk - Ośrodek Przetwarzania Informacji-Pańswowy Instytut Badawczy
Knowledge is an undoubted advantage of the lecturer.
- Ośrodek Przetwarzania Informacji-Pańswowy Instytut Badawczy
Recalling/reviewing keypoints of the topics discussed.
Paolo Angelo Gaton - SMS Global Technologies Inc.
-
Roxane Santiago - SMS Global Technologies Inc.
The lab exercises. Applying the theory from the first day in subsequent days.
- Dell
The trainer was passionate and well-known what he said I appreciate his help and answers all our questions and suggested cases.
The course was excellent. Our trainer Andreas was very prepared and answered all the questions that we asked. Also he helped us when we have troubles and explained in details when needed. The best course that i have ever been part of.
Bozhidar Marinov - Пейсейф България ЕООД
The lecturer regularly checked up on us and showed us how we can deal with some commonly seen issues when working with these tools.
Пейсейф България ЕООД
The trainer was very knowledgeable about the topic.
Zhivko Stanishev - Пейсейф България ЕООД
That every topic was an extension of the previous. The trainer was very nice and helpful.
Pavel Ignatov - Пейсейф България ЕООД
It was a great overview of the landscape of the technologies involved, allowing me to find the place in it of all pieces I have tried and many other I have previously missed on microservices. Andreas put them in the context of the real use and showed their role and why they are used that way. The course is a solid basis for elaboration and studying the details in that context and I find it very valuable. The organization of the course is with prepared in advance projects to download, change in the exercises, make them run and build the next exercises upon them. This helped me to participate, understand and connect the matter presented. The selected contents of the course was well thought and presented in a conscious and understandable way.
Пейсейф България ЕООД
I liked his pace for training, it was optimum.
Edwards Mukasa - AFRINIC Ltd.
The trainer had such extensive knowledge and experience that he was able to answer every question asked in the field of training. All you had to do was ask them.
Powszechny Zakład Ubezpieczeń Spółka Akcyjna
good theory to exercise ratio, nice ability to interest listeners during the theory
Powszechny Zakład Ubezpieczeń Spółka Akcyjna
the preparation of virtual environments for participants to use and perform hands on learning.
marcus lim
Summary for the day, using white board to explain things step by step and the personal use cases that we are tasked to do.
Chee Meng Lee - CSIT
Explanations, demonstrations and exercises
CSIT
The documents
Jing Li - 思科系统(中国)研发有限公司杭州分公司
teamwork
思科系统(中国)研发有限公司杭州分公司
Some practices
思科系统(中国)研发有限公司杭州分公司
The trainer was passionate and well-known what he said I appreciate his help and answers all our questions and suggested cases.