Course Outline
Introduction
Sqoop and Flume Overview
- What is Sqoop?
- What is Flume?
- Sqoop and Flume features
Preparing the Development Environment
- Installing and configuring Apache Sqoop
- Installing and configuring Apache Flume
Apache Flume
- Creating an agent
- Using spool sources, file channels, and logger sinks
- Working with events
- Accessing data sources
Apache Sqoop
- Importing MySQL to HDFS and Hive
- Using Sqoop jobs
Data Ingestion Pipelines
- Building pipelines
- Fetching data
- Ingesting data to HDFS
Summary and Conclusion
Requirements
- Experience with SQL
Audience
- Software Engineers
Testimonials (5)
A lot of practical examples, different ways to approach the same problem, and sometimes not so obvious tricks how to improve the current solution
Rafał - Nordea
Course - Apache Spark MLlib
how the trainor shows his knowledge in the subject he's teachign
john ernesto ii fernandez - Philippine AXA Life Insurance Corporation
Course - Data Vault: Building a Scalable Data Warehouse
During the exercises, James explained me every step whereever I was getting stuck in more detail. I was completely new to NIFI. He explained the actual purpose of NIFI, even the basics such as open source. He covered every concept of Nifi starting from Beginner Level to Developer Level.
Firdous Hashim Ali - MOD A BLOCK
Course - Apache NiFi for Administrators
That I had it in the first place.
Peter Scales - CACI Ltd
Course - Apache NiFi for Developers
practice tasks