Course Outline


  • Stream processing vs batch processing
  • Analytics-focused stream processing

Overview Frameworks and Programming Languages

  • Spark Streaming (Scala)
  • Kafka Streaming (Java)
  • Flink
  • Storm
  • Comparison of Features and Strengths of Each Framework

Overview of Data Sources

  • Live data as a series of events over time
  • Historical data sources

Deployment Options

  • In the cloud (AWS, etc.)
  • On premise (private cloud, etc.)

Getting Started

  • Setting up the Development Environment
  • Installing and Configuring
  • Assessing Your Data Analysis Needs

Operating a Streaming Framework

  • Integrating the Streaming Framework with Big Data Tools
  • Event Stream Processing (ESP) vs Complex Event Processing (CEP)
  • Transforming the Input Data
  • Inspecting the Output Data
  • Integrating the Stream Processing Framework with Existing Applications and Microservices


Summary and Conclusion


  • Programming experience in any language
  • An understanding of Big Data concepts (Hadoop, etc.)
  21 Hours


Related Courses

Spark Streaming with Python and Kafka

  7 hours

Confluent KSQL

  7 hours

Apache Ignite for Developers

  14 hours

Unified Batch and Stream Processing with Apache Beam

  14 hours

Apache Apex: Processing Big Data-in-Motion

  21 hours

Apache Storm

  28 hours

Apache NiFi for Administrators

  21 hours

Apache NiFi for Developers

  7 hours

Apache Flink Fundamentals

  28 hours

Python and Spark for Big Data (PySpark)

  21 hours

Introduction to Graph Computing

  28 hours

Apache Spark MLlib

  35 hours

Artificial Intelligence - the most applied stuff - Data Analysis + Distributed AI + NLP

  21 hours

Samza for Stream Processing

  14 hours

Tigon: Real-time Streaming for the Real World

  14 hours