Course Outline

Introduction

Overview of Apache Airflow Features and Architecture

Setting up Apache Airflow

Navigating the Apache Airflow UI

Using the CLI

Reading Big Data Sets

Working with DAGs

Monitoring Apache Airflow

Customizing Apache Airflow

Securing Apache Airflow

Scaling Apache Airflow

Best Practices

Troubleshooting

Summary and Conclusion

Requirements

  • Experience with machine learning, devops, or data engineering.

Audience

  • Data scientists
  • DevOps or infrastructure engineers
  • Software developers
  21 Hours
 

Need help picking the right course?
Call us +971 4871 6715

Testimonials

the scope of material

Maciej Jonczyk

systematizing knowledge in the field of ML

Orange Polska

I really was benefit from the willingness of the trainer to share more.

Balaram Chandra Paul

I generally was benefit from the presentation of technologies.

Continental AG / Abteilung: CF IT Finance

Overall the Content was good.

Sameer Rohadia

Michael the trainer is very knowledgeable and skillful about the subject of Big Data and R. He is very flexible and quickly customize the training meeting clients' need. He is also very capable to solve technical and subject matter problems on the go. Fantastic and professional training!.

Xiaoyuan Geng - Ottawa Research and Development Center, Science Technology Branch, Agriculture and Agri-Food Canada

I really enjoyed the introduction of new packages.

Ottawa Research and Development Center, Science Technology Branch, Agriculture and Agri-Food Canada

The tutor, Mr. Michael An, interacted with the audience very well, the instruction was clear. The tutor also go extent to add more information based on the requests from the students during the training.

Ottawa Research and Development Center, Science Technology Branch, Agriculture and Agri-Food Canada

The subject matter and the pace were perfect.

Tim - Ottawa Research and Development Center, Science Technology Branch, Agriculture and Agri-Food Canada

The example and training material were sufficient and made it easy to understand what you are doing.

Teboho Makenete

Richard's training style kept it interesting, the real world examples used helped to drive the concepts home.

Jamie Martin-Royle - NBrown Group

The content, as I found it very interesting and think it would help me in my final year at University.

Krishan Mistry - NBrown Group

I generally liked the fernando's knowledge.

Valentin de Dianous - Informatique ProContact INC.

The broad coverage of the subjects

- Roche

Intensity, Training materials and expertise, Clarity, Excellent communication with Alessandra

Marija Hornis Dmitrovic - Marija Hornis

R programming

Osden Jokonya - University of the Western Cape

Practical exercises

JOEL CHIGADA - University of the Western Cape

Related Courses

Big Data Analytics for Telecom Regulators

 14 hours

To meet compliance of the regulators, CSPs (Communication service providers) can tap into Big Data Analytics which not only help them to meet compliance but within the scope of same project they can increase customer satisfaction and thus

Big Data Architect

 35 hours

Day 1 - provides a high-level overview of essential Big Data topic areas. The module is divided into a series of sections, each of which is accompanied by a hands-on exercise. Day 2 - explores a range of topics that relate analysis practices and

Big Data and its Management Process

 14 hours

Objective : This training course aims at helping attendees understand why Big Data is changing our lives and how it is altering the way businesses see us as consumers. Indeed, users of big data in businesses find that big data unleashes a

Big Data - Data Science

 14 hours

This classroom based training session will explore Big Data. Delegates will have computer based examples and case study exercises to undertake with relevant big data tools

Vespa: Serving Large-Scale Data in Real-Time

 14 hours

Vespa is an open-source big data processing and serving engine created by Yahoo.  It is used to respond to user queries, make recommendations, and provide personalized content and advertisements in real-time. This instructor-led, live

Big Data Business Intelligence for Govt. Agencies

 35 hours

Advances in technologies and the increasing amount of information are transforming how business is conducted in many industries, including government. Government data generation and digital archiving rates are on the rise due to the rapid growth of

Big Data Business Intelligence for Criminal Intelligence Analysis

 35 hours

Advances in technologies and the increasing amount of information are transforming how law enforcement is conducted. The challenges that Big Data pose are nearly as daunting as Big Data's promise. Storing data efficiently is one of these

From Data to Decision with Big Data and Predictive Analytics

 21 hours

Audience If you try to make sense out of the data you have access to or want to analyse unstructured data available on the net (like Twitter, Linked in, etc...) this course is for you. It is mostly aimed at decision makers and people who need to

Programming with Big Data in R

 21 hours

Big Data is a term that refers to solutions destined for storing and processing large data sets. Developed by Google initially, these Big Data solutions have evolved and inspired other similar projects, many of which are available as open-source. R

Big Data Storage Solution - NoSQL

 14 hours

When traditional storage technologies don't handle the amount of data you need to store there are hundereds of alternatives. This course try to guide the participants what are alternatives for storing and analyzing Big Data and what are theirs

A Practical Introduction to Data Analysis and Big Data

 35 hours

Participants who complete this instructor-led, live training will gain a practical, real-world understanding of Big Data and its related technologies, methodologies and tools. Participants will have the opportunity to put this knowledge into

SQL For Data Science and Data Analysis

 14 hours

  This instructor-led, live training (online or onsite) is aimed at software developers, managers, and business analyst who wish to use big data systems to store and retrieve large amounts of data. By the end of this training,

Big Data & Database Systems Fundamentals

 14 hours

The course is part of the Data Scientist skill set (Domain: Data and Technology).

Data Science for Big Data Analytics

 35 hours

Big data is data sets that are so voluminous and complex that traditional data processing application software are inadequate to deal with them. Big data challenges include capturing data, data storage, data analysis, search, sharing, transfer,

Machine Learning and Big Data

 7 hours

This instructor-led, live training (online or onsite) is aimed at technical persons who wish to learn how to implement a machine learning strategy while maximizing the use of big data. By the end of this training, participants