Course Outline


Understanding Big Data

Overview of Spark

Overview of Python

Overview of PySpark

  • Distributing Data Using Resilient Distributed Datasets Framework
  • Distributing Computation Using Spark API Operators

Setting Up Python with Spark

Setting Up PySpark

Using Amazon Web Services (AWS) EC2 Instances for Spark

Setting Up Databricks

Setting Up the AWS EMR Cluster

Learning the Basics of Python Programming

  • Getting Started with Python
  • Using the Jupyter Notebook
  • Using Variables and Simple Data Types
  • Working with Lists
  • Using if Statements
  • Using User Inputs
  • Working with while Loops
  • Implementing Functions
  • Working with Classes
  • Working with Files and Exceptions
  • Working with Projects, Data, and APIs

Learning the Basics of Spark DataFrame

  • Getting Started with Spark DataFrames
  • Implementing Basic Operations with Spark
  • Using Groupby and Aggregate Operations
  • Working with Timestamps and Dates

Working on a Spark DataFrame Project Exercise

Understanding Machine Learning with MLlib

Working with MLlib, Spark, and Python for Machine Learning

Understanding Regressions

  • Learning Linear Regression Theory
  • Implementing a Regression Evaluation Code
  • Working on a Sample Linear Regression Exercise
  • Learning Logistic Regression Theory
  • Implementing a Logistic Regression Code
  • Working on a Sample Logistic Regression Exercise

Understanding Random Forests and Decision Trees

  • Learning Tree Methods Theory
  • Implementing Decision Trees and Random Forest Codes
  • Working on a Sample Random Forest Classification Exercise

Working with K-means Clustering

  • Understanding K-means Clustering Theory
  • Implementing a K-means Clustering Code
  • Working on a Sample Clustering Exercise

Working with Recommender Systems

Implementing Natural Language Processing

  • Understanding Natural Language Processing (NLP)
  • Overview of NLP Tools
  • Working on a Sample NLP Exercise

Streaming with Spark on Python

  • Overview Streaming with Spark
  • Sample Spark Streaming Exercise

Closing Remarks


  • General programming skills


  • Developers
  • IT Professionals
  • Data Scientists
  21 Hours


Related Courses

Data Analysis with Python, Pandas, and Numpy

  14 hours

Machine Learning with Python and Pandas

  14 hours

Accelerating Python Pandas Workflows with Modin

  14 hours

Scaling Data Analysis with Python and Dask

  14 hours

Developing APIs with Python and FastAPI

  14 hours

FARM (FastAPI, React, and MongoDB) Full Stack Development

  14 hours

Scientific Computing with Python SciPy

  7 hours

Game Development with PyGame

  7 hours

Web application development with Flask

  14 hours

Build REST APIs with Python and Flask

  14 hours

Advanced Flask

  14 hours

GUI Programming with Python and Tkinter

  14 hours

Kivy: Building Android Apps with Python

  7 hours

GUI Programming with Python and PyQt

  21 hours

Web Development with Web2Py

  28 hours