Autoplay
Autocomplete
Previous Lesson
Complete and Continue
Taming Big Data with Spark Streaming and Scala - Hands On!
Getting Started
Tip: Apply for a Twitter Developer Account now
Introduction, and Getting Set Up (13:20)
Stream Live Tweets with Spark Streaming! (14:27)
A Crash Course in Scala
Scala Basics: Part 1 (24:27)
Flow Control in Scala (9:28)
Functions in Scala (9:08)
Data Structures in Scala (22:28)
Spark Streaming Concepts
Introduction to Spark (7:06)
The Resilient Distributed Dataset (RDD) (10:40)
RDD's in Action: Simple Word Count Application (8:02)
Introduction to Spark Streaming (6:32)
Revisiting the PrintTweets Application (7:31)
Windowing: Aggregating Data over Longer Time Spans (5:00)
Fault Tolerance in Spark Streaming (6:06)
Spark Streaming Examples with Twitter
Saving Tweets to Disk (13:24)
Tracking the Average Tweet Length (10:17)
Tracking the Most Popular Hashtags (15:52)
Spark Streaming Examples with Clickstream / Apache Access Log Data
Tracking the Top URL's Requested (14:19)
Alarming on Log Errors (13:09)
Integrating Spark Streaming with SparkSQL (15:37)
Intro to Structured Streaming in Spark 2 (8:27)
[Activity] Analyzing Apache Log files with Structured Streaming (11:32)
Integrating with Other Systems
Integrating with Apache Kafka (12:20)
Integrating with Apache Flume (8:51)
Integrating with Amazon Kinesis (4:46)
Writing Custom Data Receivers (5:53)
Integrating with Cassandra (7:35)
Advanced Spark Streaming Examples
Stateful Information in Spark Streams (14:22)
Streaming K-Means Clustering (15:40)
Streaming Linear Regression (12:19)
Spark Streaming in Production
[Activity] Packaging and running Spark code in production (9:39)
Packaging your Code with SBT (11:45)
Running on a Real Hadoop Cluster with EMR (15:48)
Troubleshooting and Tuning Spark Jobs (12:35)
You Made It!
Learning More (3:44)
Stream Live Tweets with Spark Streaming!
Download
PrintTweets.scala
Download
twitter.txt
Download
Utilities.scala
Complete and Continue