Data Engineering Solution Preview | StackSkills

Autoplay
Autocomplete

Previous Lesson Complete and Continue

Complete Ruby Programmer

Introduction

Introduction to Programming (1:55)
The Role of Programming In the Modern World (1:38)
Importance of Programming Skills for All Professionals (2:03)
Preview of Final Student Enrollment App (2:11)
Web Scraping Automation Project Preview (1:17)
Data Engineering Project Preview (1:12)
Programming Intro Recap
Installation of Ruby on MacOS (6:37)
Installation of Ruby on Windows (1:09)
Installation of Ruby on Linux (1:26)
Troubleshooting and Looking for Answers Online (5:30)
Introduction to Code Editors (2:27)
Installing Atom (1:44)
Review of Concepts and Setup

Programming in Ruby

Introduction to the Terminal (1:34)
Introduction to the Terminal Quiz
Getting Around in the Terminal (1:35)
Getting Around in the Terminal Quiz
Creating and Changing Directories (1:59)
Creating and Changing Directories Quiz
Creating and Editing Files from the Command Line (2:42)
Terminal Review
Where to Find the Code
The First Ruby File - "Hello World" (1:27)
Hello World Quiz
Running Ruby Files from the Command Line (1:18)
Running Ruby Files Quiz
Printing Output Quiz
Printing Output - puts/print/p (3:30)
Code Commenting (3:35)
Code Commenting Quiz
Introduction to IRB (2:37)
Atom and Terminal Setup (5:58)
Basics Review
Codealong Exercise - Name and Food (2:02)
Assignment - Print Your Own Age (3:45)

Strings and Numbers

Introduction to Variables and Why We Use Them (2:27)
Variables Quiz 1
Variables - Changing Values (4:03)
Variables Quiz 2
Variables - Changing Values Continued (3:44)
Variables Quiz 3
Getting Input from the Terminal (3:57)
Input from Terminal Quiz
Introduction to Strings (3:27)
Strings Quiz 1
String Interpolation (2:55)
Strings Quiz 2
Changing a String (4:17)
Strings Quiz 3
String Concatenation (4:15)
Strings Quiz 4
Manipulating Strings (6:28)
Strings Quiz 5
Introduction to Comparisons (5:31)
Comparisons Quiz 1
Logic Comparisons (5:52)
Comparisons Quiz 2
Numeric Comparisons (3:19)
Comparisons Quiz 3
Introduction to Branching Logic - If (4:29)
Logic Quiz 1
Branching Logic - Else (4:57)
Logic Quiz 2
Branching Logic - Elsif (3:52)
Logic Quiz 3
Branching Logic - Case (4:30)
Logic Quiz 4
Finding Text in a String (6:02)
Finding Text Quiz 1
Finding Text - Index (7:20)
Variables and Strings Review
Introduction to Numbers - Integers and Floats (2:32)
Numbers Quiz 1
Numeric Operations -Integers (2:37)
Numbers Quiz 2
Numeric Operations - Floats (3:04)
Numbers Quiz 3
Castings Strings to Integers (3:32)
Casting Quiz 1
Casting Strings to Floats (4:22)
Casting Quiz 2
Getting Numbers from Input (3:26)
Getting Numbers Quiz
Random Numbers (5:59)
Random Numbers Quiz
Combining Numbers with Strings (8:11)
Numbers Review
Codealong Exercise - Introduction (1:00)
Codealong Exercise - Guess the Number Game (13:46)
Assignment - Build a User Input Validator (1:30)

Methods and Data Structures

Changing the Terminal Prompt (3:48)
Introduction to Methods (4:54)
Methods Quiz
Method Arguments (2:49)
Optional Arguments and Default Values (3:32)
Methods Quiz 2
The Different Styles of If (5:02)
Method Returns (5:49)
Method Returns Quiz
Calling One Method from Another (5:05)
Method Review
Introduction to the Concept of Data Structures (3:03)
Introduction to Arrays (4:45)
Arrays Quiz
Array Creation (6:24)
Array Manipulation (3:33)
Arrays Quiz 2
Arrays - Push & Pop (2:59)
Retrieving Data from Arrays (3:22)
Retrieving Data from Arrays - Continued (5:43)
Arrays Review
Introduction to Hashes (1:48)
Keys, Values (8:56)
Hashes Quiz 1
Symbols (5:05)
Retrieving Data from Hashes (1:52)
Hashes Quiz 2
Retrieving Data from Hashes - Continued (4:12)
Hash Manipulation (5:17)
Hashes Review
Introduction to Loops (2:46)
While Loops (2:59)
While Loops with User Input (3:05)
While Loops Quiz
Breaking Out of Loops (3:14)
Codealong Exercise - Introduction (7:33)
Codealong Exercise - Contacts Directory (0:49)
Assignment - Build a Credentials Collection (1:08)
Optional - Introduction to Algorithms and Sorting (1:02)
Demo of Bubble Sort and complexity analysis (5:39)
Optional - Implementing an Array Sort (15:00)

Deep Dive into Iteration and Blocks

Loops - Using Next (4:17)
Until Loops (2:31)
Loops as Modifiers (2:02)
For Loops (3:20)
Loops Review
Introduction to Iteration (3:53)
Introduction to Blocks (5:49)
Iterating Over a Range (4:04)
Iterating Using Steps (2:01)
Ruby Enumerable (1:56)
Enumerators in Ruby (4:48)
Hash Iteration (2:42)
Operations Inside Iteration (5:38)
Arrays - Map, Select, and Reject (9:19)
Hashes - Map, Select, and Reject (4:01)
Introduction to Recursion (10:11)
Iteration and Enumeration Review
Codealong Exercise - Introduction (0:46)
Codealong Exercice - Filters on Product Catalog (13:07)
Assignment - Find Students by Name or Age (0:48)

Working with Files

Files in Ruby (2:27)
Opening a File (2:00)
File Modes (3:40)
Reading the Contents of a File (1:46)
Reading a File Line by Line (3:37)
Closing Files (2:17)
Writing to an Existing File (3:43)
Writing to a New File (1:52)
File Basics Review
Writing User Input to Files (3:13)
Introduction to CSV Files (2:30)
Working with CSV Files (10:34)
Check If a File Exists (4:19)
Working with Directories (6:15)
Opening Other Ruby Files (3:39)
Require Local Ruby Files (4:27)
File Operations Review
Codealong Exercise - Introduction (1:00)
Codealong Exercise - Collecting Todo Notes (4:32)
Assignment - Write Student Information to CSV (0:49)

Object Oriented Programming

Introduction to Classes (8:31)
Introduction to Objects (3:08)
Instantiating Objects (7:28)
Displaying Objects (3:32)
Comparing Objects (6:57)
Duck-Typing in Ruby (5:06)
Methods on Objects (6:17)
Inheritance (5:50)
Overriding Methods (8:08)
Object Basics Review
Attributes - Getting and Setting (8:13)
Class Methods (6:17)
Modules (9:28)
Requiring Modules (6:13)
Composition vs Inheritance (15:05)
Advanced Objects Review
Codealong Exercise - Introduction (0:41)
Codealong Exercise - Calculate Area of Different Shapes (8:33)
Assignment - Create a Student Object (1:07)
Optional - Introduction to Binrary Trees (6:07)
Optional - Implementing a Binary Tree (23:23)

Object Mapping

Model Classes (2:35)
Domain Modeling (3:02)
Validator Methods (3:50)
Serialization (1:56)
Converting an Object to CSV (3:04)
Object Mapping Review
CRUD (1:17)
Writing Objects to File (4:12)
Generating Unique IDs and Filenames (5:42)
Reading Objects from File (9:29)
Updating Objects in File (10:28)
Deleting Objects in Files (5:09)
Validations and Review (6:31)
CRUD Review
Codealong Exercise - Intro (1:01)
Codealong Exercise - Corporate Directory in CSV (11:07)
Assignment - Use Student Object to Write to File (0:51)

Web Scraping Automation with Ruby

Using Programming for Daily Life Tasks (0:53)
Problem Description - Car Shopping (1:10)
Solution Preview (1:04)
Program Setup (1:32)
Resources for This Section
Introduction to Gems (5:21)
Getting the Content from the Website (2:48)
Parsing Response HTML (5:00)
Using the CSS Selector (5:03)
Gems Review
Pretty Printing Ruby Objects (4:07)
Extracting Data (5:24)
Extracting Data - Continued (5:15)
Saving to JSON File (8:34)
JSON Formatting (4:43)
Converting Price to a Number (4:57)
Filtering Data (4:59)
Data Extraction and Filtering Review
Optional - Using Bundler (5:35)
Optional - Deep Dive into Ruby Gems (7:24)

Data Engineering with Ruby

Data Engineering Solution Preview (0:51)
Working With Access Logs (3:23)
Reading the Log File (3:19)
Parsing the Log File (5:15)
Extracting User Data (3:21)
Determining Browsers (5:29)
Access Logs Review
Extracting Email (10:18)
Cross Referencing Users (2:54)
Cross Referencing Users Continued (5:43)
Users Data Structure (8:01)
File Name Patterns (7:44)
Data Engineering Review

Final Project

Final Project Overview (3:18)
Final Project Requirements
Thank You!!! (0:37)

Appendix

Acknowledgements

Data Engineering Solution Preview

https://www.dataquest.io/blog/what-is-a-data-engineer/

Complete and Continue

Lesson Content Locked

Your session expired. Please sign in again to continue.

Log In