Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Course Outline
Section 1: Introduction to Hadoop
- History and core concepts of Hadoop
- Ecosystem overview
- Distributions
- High-level architecture
- Common Hadoop myths
- Challenges associated with Hadoop
- Hardware and software requirements
- Lab: First look at Hadoop
Section 2: HDFS
- Design and architecture
- Core concepts (horizontal scaling, replication, data locality, rack awareness)
- Daemons: NameNode, Secondary NameNode, DataNode
- Communication and heartbeats
- Data integrity mechanisms
- Read and write paths
- NameNode High Availability (HA) and Federation
- Labs: Interacting with HDFS
Section 3: Map Reduce
- Concepts and architecture
- Daemons (MRV1): JobTracker and TaskTracker
- Processing phases: driver, mapper, shuffle/sort, reducer
- MapReduce Version 1 and Version 2 (YARN)
- Internals of MapReduce
- Introduction to Java MapReduce programming
- Labs: Running a sample MapReduce program
Section 4: Pig
- Pig versus Java MapReduce
- Pig job flow
- Pig Latin language
- ETL processes with Pig
- Transformations and joins
- User-defined functions (UDF)
- Labs: Writing Pig scripts for data analysis
Section 5: Hive
- Architecture and design
- Data types
- SQL support within Hive
- Creating Hive tables and executing queries
- Partitions
- Joins
- Text processing
- Labs: Various exercises on processing data with Hive
Section 6: HBase
- Concepts and architecture
- HBase versus RDBMS versus Cassandra
- HBase Java API
- Time-series data handling in HBase
- Schema design
- Labs: Interacting with HBase via shell; programming with HBase Java API; Schema design exercise
Requirements
- Proficiency in the Java programming language (as most coding exercises are conducted in Java)
- Comfort with the Linux environment (including navigating the command line and editing files using vi or nano)
Lab environment
Zero Installation Required: There is no need to install Hadoop software on your personal machine. A fully functional Hadoop cluster will be provided for student use.
Participants will need the following:
- An SSH client (Linux and Mac systems come with built-in SSH clients; PuTTY is recommended for Windows users)
- A web browser to access the cluster (Firefox is recommended)
28 Hours
Testimonials (1)
Hands on exercises. Class should have been 5 days, but the 3 days helped to clear up a lot of questions that I had from working with NiFi already
