Spark 3 & Big Data Essentials with Scala | Rock the JVM

  • Course provided by Udemy
  • Study type: Online
  • Starts: Anytime
  • Price: See latest price on Udemy
Udemy

Course Description

UPDATED FOR SPARK 3.0

In this course, we will learn how to write big data applications with Apache Spark 3 and Scala. You'll write 2000+ lines of Spark code yourself, with guidance, and you will become a rockstar.

This course is for Scala programmers who are getting started with Apache Spark and big data. The course is not for advanced Spark engineers.

Why Spark in Scala:

  • it's blazing fast for big data

  • its demand has exploded

  • it's a highly marketable skill

  • it's well maintained, with dozens of high-quality extensions

  • it's a foundation for a data scientist

I like to get to the point and get things done. This course

  1. deconstructs all concepts into the critical pieces you need

  2. selects the most important ideas and separates them into what's simple but critical and what's powerful

  3. sequences ideas in a way that "clicks" and makes sense throughout the process of learning

  4. applies everything in live code

The end benefits are still much greater:

  • a completely new mental model around data processing

  • significantly more marketable resume

  • more enjoyable work - Spark is fun!

This course is for established programmers with experience with Scala and with functional programming at the level of the Rock the JVM Scala beginners course. I already assume a solid understanding of general programming fundamentals.

This course is NOT for you if

  • you've never written Scala code before

  • you don't have some essential parallel programming background (e.g. what's a process/a thread)

The course is comprehensive, but you'll always see me get straight to the point. So make sure you have a good level of focus and commitment to become a badass programmer.

I believe both theory and practice are important. That's why you'll get lectures with code examples, real life code demos and assignments, plus additional resources, instructions, exercises and solutions. At the end of the course, you'll have written thousands of lines of Spark.

I've seen that my students are most successful - and my best students work at Google-class companies - when they're guided, but not being told what to do. I have exercises waiting for you, where I offer my (opinionated) guidance but otherwise freedom to experiment and improve upon your code.

Definitely not least, my students are most successful when they have fun along the way!

So join me in this course and let's rock the JVM!

Who this course is for:

  • Future data scientists
  • Programmers getting into the field of Big Data
  • Engineers wanting to learn Spark in Scala, its native language

Instructor

Software Engineer & Best-Selling Instructor
  • 4.7 Instructor Rating
  • 20,950 Reviews
  • 63,734 Students
  • 11 Courses

I'm a software engineer with a passion for teaching. Big fan of Scala and the JVM.

I have a Master's Degree in Computer Science and I wrote my Bachelor and Master theses on Quantum Computation. Before starting to learn programming, I won medals at international Physics competitions.

For 7+ years, I've taught a variety of Computer Science topics to 30000+ of students at various levels. I've held Hour of Code for 7 year-olds, I've taught university students who now work at Google and Facebook, I've held live trainings for software engineering teams at Adobe and Apple, and I'm now so excited to share what I know with a wider community online.

Expected Outcomes

  1. apply Spark big data principles practice Spark DataFrames operations with 100+ examples and exercises practice type-safe data processing with Spark Datasets work with low-level Spark APIs with RDDs use Spark SQL for data processing migrate data from various data sources, including databases Curated for the Udemy Business collection Course content 6 sections • 25 lectures • 7h 17m total length Expand all sections Welcome 4 lectures • 48min Welcome! Preview 11:31 How to Make the Best out of This Course Preview 02:32 Scala Recap Preview 25:05 Spark First Principles Preview 09:06 Spark Structured API: DataFrames 10 lectures • 3hr 7min DataFrames Basics Preview 23:09 DataFrames Basics: Exercises 08:16 How DataFrames Work 06:22 Data Sources 13:24 Data Sources, Part 2 + Exercises 27:43 DataFrames Columns & Expressions 24:33 Columns & Expressions: Exercise 17:12 DataFrame Aggregations 28:13 DataFrame Joins 20:23 DataFrame Joins: Exercise 17:27 Spark Types and Datasets 5 lectures • 1hr 47min Working with Common Spark Data Types 28:31 Working with Complex Spark Data Types 21:17 Managing Nulls in Data 17:14 Type-Safe Data Processing: Datasets 24:17 Datasets, Part 2 + Exercise 15:40 Spark SQL 3 lectures • 51min Spark as a "Database" with Spark SQL Shell 13:39 Spark SQL 17:11 Spark SQL: Exercises 19:53 Low-Level Spark 2 lectures • 44min RDDs 17:05 RDDs, Part 2 + Exercise 26:48 Epilogue 1 lecture • 1min You Rock! 00:30 Requirements Scala fundamentals, at the level of the Rock the JVM beginners course Scala advanced - implicits Description UPDATED FOR SPARK 3.0 In this course, we will learn how to write big data applications with Apache Spark 3 and Scala. You'll write 2000+ lines of Spark code yourself, with guidance, and you will become a rockstar. This course is for Scala programmers who are getting started with Apache Spark and big data. The course is not for advanced Spark engineers. Why Spark in Scala: it's blazing fast for big data its demand has exploded it's a highly marketable skill it's well maintained , with dozens of high-quality extensions it's a foundation for a data scientist I like to get to the point and get things done. This course deconstructs all concepts into the critical pieces you need selects the most important ideas and separates them into what's simple but critical and what's powerful sequences ideas in a way that "clicks" and makes sense throughout the process of learning applies everything in live code The end benefits are still much greater: a completely new mental model around data processing significantly more marketable resume more enjoyable work - Spark is fun! This course is for established programmers with experience with Scala and with functional programming at the level of the Rock the JVM Scala beginners course. I already assume a solid understanding of general programming fundamentals. This course is NOT for you if you've never written Scala code before you don't have some essential parallel programming background (e.g. what's a process/a thread) The course is comprehensive, but you'll always see me get straight to the point. So make sure you have a good level of focus and commitment to become a badass programmer. I believe both theory and practice are important. That's why you'll get lectures with code examples, real life code demos and assignments, plus additional resources, instructions, exercises and solutions. At the end of the course, you'll have written thousands of lines of Spark. I've seen that my students are most successful - and my best students work at Google-class companies - when they're guided, but not being told what to do. I have exercises waiting for you, where I offer my (opinionated) guidance but otherwise freedom to experiment and improve upon your code. Definitely not least, my students are most successful when they have fun along the way! So join me in this course and let's rock the JVM! Who this course is for: Future data scientists Programmers getting into the field of Big Data Engineers wanting to learn Spark in Scala, its native language Show more Show less Featured review Obaid Salikeen 65 courses 15 reviews Rating: 5.0 out of 5 a year ago Best Spark course on Udemy hands down, I took the best seller Spark course previously but that was no way near this course, This house gives an in-depth, by-example approach to learning. I just love it. Show more Show less Instructor Daniel Ciocîrlan Software Engineer & Best-Selling Instructor 4.7 Instructor Rating 20,950 Reviews 63,734 Students 11 Courses I'm a software engineer with a passion for teaching. Big fan of Scala and the JVM. I have a Master's Degree in Computer Science and I wrote my Bachelor and Master theses on Quantum Computation. Before starting to learn programming, I won medals at international Physics competitions. For 7+ years, I've taught a variety of Computer Science topics to 30000+ of students at various levels. I've held Hour of Code for 7 year-olds, I've taught university students who now work at Google and Facebook, I've held live trainings for software engineering teams at Adobe and Apple, and I'm now so excited to share what I know with a wider community online. Show more Show less Udemy Business Teach on Udemy Get the app About us Contact us Careers Blog Help and Support Affiliate Impressum Kontakt Terms Privacy policy Cookie settings Sitemap © 2021 Udemy, Inc. window.handleCSSToggleButtonClick = function (event) { var target = event.currentTarget; var cssToggleId = target && target.dataset && target.dataset.cssToggleId; var input = cssToggleId && document.getElementById(cssToggleId); if (input) { if (input.dataset.type === 'checkbox') { input.dataset.checked = input.dataset.checked ? '' : 'checked'; } else { input.dataset.checked = input.dataset.allowToggle && input.dataset.checked ? '' : 'checked'; var radios = document.querySelectorAll('[name="' + input.dataset.name + '"]'); for (var i = 0; i (function(){window['__CF$cv$params']={r:'67774cc8ed8c4090',m:'9b36b9472d7dab3d4849cec6090adc3fbcc542af-1627739471-1800-AfVAl/XQgdthQw61lKm8NLu2ap5NcnpQHX20KsVT0KDg3d05SbSKBx0WCHmMl2aBzhnHwHPaNctwSiomOhw+5JeKyZvKSHqwVKZcAVg2sD1lF8I7b2D5I9IqDoT8KdleaajN9NgFlTelaXX6Prt250U=',s:[0xa235d01cea,0xa0711495a4],}})();
  2. practice Spark DataFrames operations with 100+ examples and exercises practice type-safe data processing with Spark Datasets work with low-level Spark APIs with RDDs use Spark SQL for data processing migrate data from various data sources, including databases Curated for the Udemy Business collection Course content 6 sections • 25 lectures • 7h 17m total length Expand all sections Welcome 4 lectures • 48min Welcome! Preview 11:31 How to Make the Best out of This Course Preview 02:32 Scala Recap Preview 25:05 Spark First Principles Preview 09:06 Spark Structured API: DataFrames 10 lectures • 3hr 7min DataFrames Basics Preview 23:09 DataFrames Basics: Exercises 08:16 How DataFrames Work 06:22 Data Sources 13:24 Data Sources, Part 2 + Exercises 27:43 DataFrames Columns & Expressions 24:33 Columns & Expressions: Exercise 17:12 DataFrame Aggregations 28:13 DataFrame Joins 20:23 DataFrame Joins: Exercise 17:27 Spark Types and Datasets 5 lectures • 1hr 47min Working with Common Spark Data Types 28:31 Working with Complex Spark Data Types 21:17 Managing Nulls in Data 17:14 Type-Safe Data Processing: Datasets 24:17 Datasets, Part 2 + Exercise 15:40 Spark SQL 3 lectures • 51min Spark as a "Database" with Spark SQL Shell 13:39 Spark SQL 17:11 Spark SQL: Exercises 19:53 Low-Level Spark 2 lectures • 44min RDDs 17:05 RDDs, Part 2 + Exercise 26:48 Epilogue 1 lecture • 1min You Rock! 00:30 Requirements Scala fundamentals, at the level of the Rock the JVM beginners course Scala advanced - implicits Description UPDATED FOR SPARK 3.0 In this course, we will learn how to write big data applications with Apache Spark 3 and Scala. You'll write 2000+ lines of Spark code yourself, with guidance, and you will become a rockstar. This course is for Scala programmers who are getting started with Apache Spark and big data. The course is not for advanced Spark engineers. Why Spark in Scala: it's blazing fast for big data its demand has exploded it's a highly marketable skill it's well maintained , with dozens of high-quality extensions it's a foundation for a data scientist I like to get to the point and get things done. This course deconstructs all concepts into the critical pieces you need selects the most important ideas and separates them into what's simple but critical and what's powerful sequences ideas in a way that "clicks" and makes sense throughout the process of learning applies everything in live code The end benefits are still much greater: a completely new mental model around data processing significantly more marketable resume more enjoyable work - Spark is fun! This course is for established programmers with experience with Scala and with functional programming at the level of the Rock the JVM Scala beginners course. I already assume a solid understanding of general programming fundamentals. This course is NOT for you if you've never written Scala code before you don't have some essential parallel programming background (e.g. what's a process/a thread) The course is comprehensive, but you'll always see me get straight to the point. So make sure you have a good level of focus and commitment to become a badass programmer. I believe both theory and practice are important. That's why you'll get lectures with code examples, real life code demos and assignments, plus additional resources, instructions, exercises and solutions. At the end of the course, you'll have written thousands of lines of Spark. I've seen that my students are most successful - and my best students work at Google-class companies - when they're guided, but not being told what to do. I have exercises waiting for you, where I offer my (opinionated) guidance but otherwise freedom to experiment and improve upon your code. Definitely not least, my students are most successful when they have fun along the way! So join me in this course and let's rock the JVM! Who this course is for: Future data scientists Programmers getting into the field of Big Data Engineers wanting to learn Spark in Scala, its native language Show more Show less Featured review Obaid Salikeen 65 courses 15 reviews Rating: 5.0 out of 5 a year ago Best Spark course on Udemy hands down, I took the best seller Spark course previously but that was no way near this course, This house gives an in-depth, by-example approach to learning. I just love it. Show more Show less Instructor Daniel Ciocîrlan Software Engineer & Best-Selling Instructor 4.7 Instructor Rating 20,950 Reviews 63,734 Students 11 Courses I'm a software engineer with a passion for teaching. Big fan of Scala and the JVM. I have a Master's Degree in Computer Science and I wrote my Bachelor and Master theses on Quantum Computation. Before starting to learn programming, I won medals at international Physics competitions. For 7+ years, I've taught a variety of Computer Science topics to 30000+ of students at various levels. I've held Hour of Code for 7 year-olds, I've taught university students who now work at Google and Facebook, I've held live trainings for software engineering teams at Adobe and Apple, and I'm now so excited to share what I know with a wider community online. Show more Show less Udemy Business Teach on Udemy Get the app About us Contact us Careers Blog Help and Support Affiliate Impressum Kontakt Terms Privacy policy Cookie settings Sitemap © 2021 Udemy, Inc. window.handleCSSToggleButtonClick = function (event) { var target = event.currentTarget; var cssToggleId = target && target.dataset && target.dataset.cssToggleId; var input = cssToggleId && document.getElementById(cssToggleId); if (input) { if (input.dataset.type === 'checkbox') { input.dataset.checked = input.dataset.checked ? '' : 'checked'; } else { input.dataset.checked = input.dataset.allowToggle && input.dataset.checked ? '' : 'checked'; var radios = document.querySelectorAll('[name="' + input.dataset.name + '"]'); for (var i = 0; i (function(){window['__CF$cv$params']={r:'67774cc8ed8c4090',m:'9b36b9472d7dab3d4849cec6090adc3fbcc542af-1627739471-1800-AfVAl/XQgdthQw61lKm8NLu2ap5NcnpQHX20KsVT0KDg3d05SbSKBx0WCHmMl2aBzhnHwHPaNctwSiomOhw+5JeKyZvKSHqwVKZcAVg2sD1lF8I7b2D5I9IqDoT8KdleaajN9NgFlTelaXX6Prt250U=',s:[0xa235d01cea,0xa0711495a4],}})();
  3. practice type-safe data processing with Spark Datasets work with low-level Spark APIs with RDDs use Spark SQL for data processing migrate data from various data sources, including databases Curated for the Udemy Business collection Course content 6 sections • 25 lectures • 7h 17m total length Expand all sections Welcome 4 lectures • 48min Welcome! Preview 11:31 How to Make the Best out of This Course Preview 02:32 Scala Recap Preview 25:05 Spark First Principles Preview 09:06 Spark Structured API: DataFrames 10 lectures • 3hr 7min DataFrames Basics Preview 23:09 DataFrames Basics: Exercises 08:16 How DataFrames Work 06:22 Data Sources 13:24 Data Sources, Part 2 + Exercises 27:43 DataFrames Columns & Expressions 24:33 Columns & Expressions: Exercise 17:12 DataFrame Aggregations 28:13 DataFrame Joins 20:23 DataFrame Joins: Exercise 17:27 Spark Types and Datasets 5 lectures • 1hr 47min Working with Common Spark Data Types 28:31 Working with Complex Spark Data Types 21:17 Managing Nulls in Data 17:14 Type-Safe Data Processing: Datasets 24:17 Datasets, Part 2 + Exercise 15:40 Spark SQL 3 lectures • 51min Spark as a "Database" with Spark SQL Shell 13:39 Spark SQL 17:11 Spark SQL: Exercises 19:53 Low-Level Spark 2 lectures • 44min RDDs 17:05 RDDs, Part 2 + Exercise 26:48 Epilogue 1 lecture • 1min You Rock! 00:30 Requirements Scala fundamentals, at the level of the Rock the JVM beginners course Scala advanced - implicits Description UPDATED FOR SPARK 3.0 In this course, we will learn how to write big data applications with Apache Spark 3 and Scala. You'll write 2000+ lines of Spark code yourself, with guidance, and you will become a rockstar. This course is for Scala programmers who are getting started with Apache Spark and big data. The course is not for advanced Spark engineers. Why Spark in Scala: it's blazing fast for big data its demand has exploded it's a highly marketable skill it's well maintained , with dozens of high-quality extensions it's a foundation for a data scientist I like to get to the point and get things done. This course deconstructs all concepts into the critical pieces you need selects the most important ideas and separates them into what's simple but critical and what's powerful sequences ideas in a way that "clicks" and makes sense throughout the process of learning applies everything in live code The end benefits are still much greater: a completely new mental model around data processing significantly more marketable resume more enjoyable work - Spark is fun! This course is for established programmers with experience with Scala and with functional programming at the level of the Rock the JVM Scala beginners course. I already assume a solid understanding of general programming fundamentals. This course is NOT for you if you've never written Scala code before you don't have some essential parallel programming background (e.g. what's a process/a thread) The course is comprehensive, but you'll always see me get straight to the point. So make sure you have a good level of focus and commitment to become a badass programmer. I believe both theory and practice are important. That's why you'll get lectures with code examples, real life code demos and assignments, plus additional resources, instructions, exercises and solutions. At the end of the course, you'll have written thousands of lines of Spark. I've seen that my students are most successful - and my best students work at Google-class companies - when they're guided, but not being told what to do. I have exercises waiting for you, where I offer my (opinionated) guidance but otherwise freedom to experiment and improve upon your code. Definitely not least, my students are most successful when they have fun along the way! So join me in this course and let's rock the JVM! Who this course is for: Future data scientists Programmers getting into the field of Big Data Engineers wanting to learn Spark in Scala, its native language Show more Show less Featured review Obaid Salikeen 65 courses 15 reviews Rating: 5.0 out of 5 a year ago Best Spark course on Udemy hands down, I took the best seller Spark course previously but that was no way near this course, This house gives an in-depth, by-example approach to learning. I just love it. Show more Show less Instructor Daniel Ciocîrlan Software Engineer & Best-Selling Instructor 4.7 Instructor Rating 20,950 Reviews 63,734 Students 11 Courses I'm a software engineer with a passion for teaching. Big fan of Scala and the JVM. I have a Master's Degree in Computer Science and I wrote my Bachelor and Master theses on Quantum Computation. Before starting to learn programming, I won medals at international Physics competitions. For 7+ years, I've taught a variety of Computer Science topics to 30000+ of students at various levels. I've held Hour of Code for 7 year-olds, I've taught university students who now work at Google and Facebook, I've held live trainings for software engineering teams at Adobe and Apple, and I'm now so excited to share what I know with a wider community online. Show more Show less Udemy Business Teach on Udemy Get the app About us Contact us Careers Blog Help and Support Affiliate Impressum Kontakt Terms Privacy policy Cookie settings Sitemap © 2021 Udemy, Inc. window.handleCSSToggleButtonClick = function (event) { var target = event.currentTarget; var cssToggleId = target && target.dataset && target.dataset.cssToggleId; var input = cssToggleId && document.getElementById(cssToggleId); if (input) { if (input.dataset.type === 'checkbox') { input.dataset.checked = input.dataset.checked ? '' : 'checked'; } else { input.dataset.checked = input.dataset.allowToggle && input.dataset.checked ? '' : 'checked'; var radios = document.querySelectorAll('[name="' + input.dataset.name + '"]'); for (var i = 0; i (function(){window['__CF$cv$params']={r:'67774cc8ed8c4090',m:'9b36b9472d7dab3d4849cec6090adc3fbcc542af-1627739471-1800-AfVAl/XQgdthQw61lKm8NLu2ap5NcnpQHX20KsVT0KDg3d05SbSKBx0WCHmMl2aBzhnHwHPaNctwSiomOhw+5JeKyZvKSHqwVKZcAVg2sD1lF8I7b2D5I9IqDoT8KdleaajN9NgFlTelaXX6Prt250U=',s:[0xa235d01cea,0xa0711495a4],}})();
  4. work with low-level Spark APIs with RDDs use Spark SQL for data processing migrate data from various data sources, including databases Curated for the Udemy Business collection Course content 6 sections • 25 lectures • 7h 17m total length Expand all sections Welcome 4 lectures • 48min Welcome! Preview 11:31 How to Make the Best out of This Course Preview 02:32 Scala Recap Preview 25:05 Spark First Principles Preview 09:06 Spark Structured API: DataFrames 10 lectures • 3hr 7min DataFrames Basics Preview 23:09 DataFrames Basics: Exercises 08:16 How DataFrames Work 06:22 Data Sources 13:24 Data Sources, Part 2 + Exercises 27:43 DataFrames Columns & Expressions 24:33 Columns & Expressions: Exercise 17:12 DataFrame Aggregations 28:13 DataFrame Joins 20:23 DataFrame Joins: Exercise 17:27 Spark Types and Datasets 5 lectures • 1hr 47min Working with Common Spark Data Types 28:31 Working with Complex Spark Data Types 21:17 Managing Nulls in Data 17:14 Type-Safe Data Processing: Datasets 24:17 Datasets, Part 2 + Exercise 15:40 Spark SQL 3 lectures • 51min Spark as a "Database" with Spark SQL Shell 13:39 Spark SQL 17:11 Spark SQL: Exercises 19:53 Low-Level Spark 2 lectures • 44min RDDs 17:05 RDDs, Part 2 + Exercise 26:48 Epilogue 1 lecture • 1min You Rock! 00:30 Requirements Scala fundamentals, at the level of the Rock the JVM beginners course Scala advanced - implicits Description UPDATED FOR SPARK 3.0 In this course, we will learn how to write big data applications with Apache Spark 3 and Scala. You'll write 2000+ lines of Spark code yourself, with guidance, and you will become a rockstar. This course is for Scala programmers who are getting started with Apache Spark and big data. The course is not for advanced Spark engineers. Why Spark in Scala: it's blazing fast for big data its demand has exploded it's a highly marketable skill it's well maintained , with dozens of high-quality extensions it's a foundation for a data scientist I like to get to the point and get things done. This course deconstructs all concepts into the critical pieces you need selects the most important ideas and separates them into what's simple but critical and what's powerful sequences ideas in a way that "clicks" and makes sense throughout the process of learning applies everything in live code The end benefits are still much greater: a completely new mental model around data processing significantly more marketable resume more enjoyable work - Spark is fun! This course is for established programmers with experience with Scala and with functional programming at the level of the Rock the JVM Scala beginners course. I already assume a solid understanding of general programming fundamentals. This course is NOT for you if you've never written Scala code before you don't have some essential parallel programming background (e.g. what's a process/a thread) The course is comprehensive, but you'll always see me get straight to the point. So make sure you have a good level of focus and commitment to become a badass programmer. I believe both theory and practice are important. That's why you'll get lectures with code examples, real life code demos and assignments, plus additional resources, instructions, exercises and solutions. At the end of the course, you'll have written thousands of lines of Spark. I've seen that my students are most successful - and my best students work at Google-class companies - when they're guided, but not being told what to do. I have exercises waiting for you, where I offer my (opinionated) guidance but otherwise freedom to experiment and improve upon your code. Definitely not least, my students are most successful when they have fun along the way! So join me in this course and let's rock the JVM! Who this course is for: Future data scientists Programmers getting into the field of Big Data Engineers wanting to learn Spark in Scala, its native language Show more Show less Featured review Obaid Salikeen 65 courses 15 reviews Rating: 5.0 out of 5 a year ago Best Spark course on Udemy hands down, I took the best seller Spark course previously but that was no way near this course, This house gives an in-depth, by-example approach to learning. I just love it. Show more Show less Instructor Daniel Ciocîrlan Software Engineer & Best-Selling Instructor 4.7 Instructor Rating 20,950 Reviews 63,734 Students 11 Courses I'm a software engineer with a passion for teaching. Big fan of Scala and the JVM. I have a Master's Degree in Computer Science and I wrote my Bachelor and Master theses on Quantum Computation. Before starting to learn programming, I won medals at international Physics competitions. For 7+ years, I've taught a variety of Computer Science topics to 30000+ of students at various levels. I've held Hour of Code for 7 year-olds, I've taught university students who now work at Google and Facebook, I've held live trainings for software engineering teams at Adobe and Apple, and I'm now so excited to share what I know with a wider community online. Show more Show less Udemy Business Teach on Udemy Get the app About us Contact us Careers Blog Help and Support Affiliate Impressum Kontakt Terms Privacy policy Cookie settings Sitemap © 2021 Udemy, Inc. window.handleCSSToggleButtonClick = function (event) { var target = event.currentTarget; var cssToggleId = target && target.dataset && target.dataset.cssToggleId; var input = cssToggleId && document.getElementById(cssToggleId); if (input) { if (input.dataset.type === 'checkbox') { input.dataset.checked = input.dataset.checked ? '' : 'checked'; } else { input.dataset.checked = input.dataset.allowToggle && input.dataset.checked ? '' : 'checked'; var radios = document.querySelectorAll('[name="' + input.dataset.name + '"]'); for (var i = 0; i (function(){window['__CF$cv$params']={r:'67774cc8ed8c4090',m:'9b36b9472d7dab3d4849cec6090adc3fbcc542af-1627739471-1800-AfVAl/XQgdthQw61lKm8NLu2ap5NcnpQHX20KsVT0KDg3d05SbSKBx0WCHmMl2aBzhnHwHPaNctwSiomOhw+5JeKyZvKSHqwVKZcAVg2sD1lF8I7b2D5I9IqDoT8KdleaajN9NgFlTelaXX6Prt250U=',s:[0xa235d01cea,0xa0711495a4],}})();
  5. use Spark SQL for data processing migrate data from various data sources, including databases Curated for the Udemy Business collection Course content 6 sections • 25 lectures • 7h 17m total length Expand all sections Welcome 4 lectures • 48min Welcome! Preview 11:31 How to Make the Best out of This Course Preview 02:32 Scala Recap Preview 25:05 Spark First Principles Preview 09:06 Spark Structured API: DataFrames 10 lectures • 3hr 7min DataFrames Basics Preview 23:09 DataFrames Basics: Exercises 08:16 How DataFrames Work 06:22 Data Sources 13:24 Data Sources, Part 2 + Exercises 27:43 DataFrames Columns & Expressions 24:33 Columns & Expressions: Exercise 17:12 DataFrame Aggregations 28:13 DataFrame Joins 20:23 DataFrame Joins: Exercise 17:27 Spark Types and Datasets 5 lectures • 1hr 47min Working with Common Spark Data Types 28:31 Working with Complex Spark Data Types 21:17 Managing Nulls in Data 17:14 Type-Safe Data Processing: Datasets 24:17 Datasets, Part 2 + Exercise 15:40 Spark SQL 3 lectures • 51min Spark as a "Database" with Spark SQL Shell 13:39 Spark SQL 17:11 Spark SQL: Exercises 19:53 Low-Level Spark 2 lectures • 44min RDDs 17:05 RDDs, Part 2 + Exercise 26:48 Epilogue 1 lecture • 1min You Rock! 00:30 Requirements Scala fundamentals, at the level of the Rock the JVM beginners course Scala advanced - implicits Description UPDATED FOR SPARK 3.0 In this course, we will learn how to write big data applications with Apache Spark 3 and Scala. You'll write 2000+ lines of Spark code yourself, with guidance, and you will become a rockstar. This course is for Scala programmers who are getting started with Apache Spark and big data. The course is not for advanced Spark engineers. Why Spark in Scala: it's blazing fast for big data its demand has exploded it's a highly marketable skill it's well maintained , with dozens of high-quality extensions it's a foundation for a data scientist I like to get to the point and get things done. This course deconstructs all concepts into the critical pieces you need selects the most important ideas and separates them into what's simple but critical and what's powerful sequences ideas in a way that "clicks" and makes sense throughout the process of learning applies everything in live code The end benefits are still much greater: a completely new mental model around data processing significantly more marketable resume more enjoyable work - Spark is fun! This course is for established programmers with experience with Scala and with functional programming at the level of the Rock the JVM Scala beginners course. I already assume a solid understanding of general programming fundamentals. This course is NOT for you if you've never written Scala code before you don't have some essential parallel programming background (e.g. what's a process/a thread) The course is comprehensive, but you'll always see me get straight to the point. So make sure you have a good level of focus and commitment to become a badass programmer. I believe both theory and practice are important. That's why you'll get lectures with code examples, real life code demos and assignments, plus additional resources, instructions, exercises and solutions. At the end of the course, you'll have written thousands of lines of Spark. I've seen that my students are most successful - and my best students work at Google-class companies - when they're guided, but not being told what to do. I have exercises waiting for you, where I offer my (opinionated) guidance but otherwise freedom to experiment and improve upon your code. Definitely not least, my students are most successful when they have fun along the way! So join me in this course and let's rock the JVM! Who this course is for: Future data scientists Programmers getting into the field of Big Data Engineers wanting to learn Spark in Scala, its native language Show more Show less Featured review Obaid Salikeen 65 courses 15 reviews Rating: 5.0 out of 5 a year ago Best Spark course on Udemy hands down, I took the best seller Spark course previously but that was no way near this course, This house gives an in-depth, by-example approach to learning. I just love it. Show more Show less Instructor Daniel Ciocîrlan Software Engineer & Best-Selling Instructor 4.7 Instructor Rating 20,950 Reviews 63,734 Students 11 Courses I'm a software engineer with a passion for teaching. Big fan of Scala and the JVM. I have a Master's Degree in Computer Science and I wrote my Bachelor and Master theses on Quantum Computation. Before starting to learn programming, I won medals at international Physics competitions. For 7+ years, I've taught a variety of Computer Science topics to 30000+ of students at various levels. I've held Hour of Code for 7 year-olds, I've taught university students who now work at Google and Facebook, I've held live trainings for software engineering teams at Adobe and Apple, and I'm now so excited to share what I know with a wider community online. Show more Show less Udemy Business Teach on Udemy Get the app About us Contact us Careers Blog Help and Support Affiliate Impressum Kontakt Terms Privacy policy Cookie settings Sitemap © 2021 Udemy, Inc. window.handleCSSToggleButtonClick = function (event) { var target = event.currentTarget; var cssToggleId = target && target.dataset && target.dataset.cssToggleId; var input = cssToggleId && document.getElementById(cssToggleId); if (input) { if (input.dataset.type === 'checkbox') { input.dataset.checked = input.dataset.checked ? '' : 'checked'; } else { input.dataset.checked = input.dataset.allowToggle && input.dataset.checked ? '' : 'checked'; var radios = document.querySelectorAll('[name="' + input.dataset.name + '"]'); for (var i = 0; i (function(){window['__CF$cv$params']={r:'67774cc8ed8c4090',m:'9b36b9472d7dab3d4849cec6090adc3fbcc542af-1627739471-1800-AfVAl/XQgdthQw61lKm8NLu2ap5NcnpQHX20KsVT0KDg3d05SbSKBx0WCHmMl2aBzhnHwHPaNctwSiomOhw+5JeKyZvKSHqwVKZcAVg2sD1lF8I7b2D5I9IqDoT8KdleaajN9NgFlTelaXX6Prt250U=',s:[0xa235d01cea,0xa0711495a4],}})();
  6. migrate data from various data sources, including databases Curated for the Udemy Business collection Course content 6 sections • 25 lectures • 7h 17m total length Expand all sections Welcome 4 lectures • 48min Welcome! Preview 11:31 How to Make the Best out of This Course Preview 02:32 Scala Recap Preview 25:05 Spark First Principles Preview 09:06 Spark Structured API: DataFrames 10 lectures • 3hr 7min DataFrames Basics Preview 23:09 DataFrames Basics: Exercises 08:16 How DataFrames Work 06:22 Data Sources 13:24 Data Sources, Part 2 + Exercises 27:43 DataFrames Columns & Expressions 24:33 Columns & Expressions: Exercise 17:12 DataFrame Aggregations 28:13 DataFrame Joins 20:23 DataFrame Joins: Exercise 17:27 Spark Types and Datasets 5 lectures • 1hr 47min Working with Common Spark Data Types 28:31 Working with Complex Spark Data Types 21:17 Managing Nulls in Data 17:14 Type-Safe Data Processing: Datasets 24:17 Datasets, Part 2 + Exercise 15:40 Spark SQL 3 lectures • 51min Spark as a "Database" with Spark SQL Shell 13:39 Spark SQL 17:11 Spark SQL: Exercises 19:53 Low-Level Spark 2 lectures • 44min RDDs 17:05 RDDs, Part 2 + Exercise 26:48 Epilogue 1 lecture • 1min You Rock! 00:30 Requirements Scala fundamentals, at the level of the Rock the JVM beginners course Scala advanced - implicits Description UPDATED FOR SPARK 3.0 In this course, we will learn how to write big data applications with Apache Spark 3 and Scala. You'll write 2000+ lines of Spark code yourself, with guidance, and you will become a rockstar. This course is for Scala programmers who are getting started with Apache Spark and big data. The course is not for advanced Spark engineers. Why Spark in Scala: it's blazing fast for big data its demand has exploded it's a highly marketable skill it's well maintained , with dozens of high-quality extensions it's a foundation for a data scientist I like to get to the point and get things done. This course deconstructs all concepts into the critical pieces you need selects the most important ideas and separates them into what's simple but critical and what's powerful sequences ideas in a way that "clicks" and makes sense throughout the process of learning applies everything in live code The end benefits are still much greater: a completely new mental model around data processing significantly more marketable resume more enjoyable work - Spark is fun! This course is for established programmers with experience with Scala and with functional programming at the level of the Rock the JVM Scala beginners course. I already assume a solid understanding of general programming fundamentals. This course is NOT for you if you've never written Scala code before you don't have some essential parallel programming background (e.g. what's a process/a thread) The course is comprehensive, but you'll always see me get straight to the point. So make sure you have a good level of focus and commitment to become a badass programmer. I believe both theory and practice are important. That's why you'll get lectures with code examples, real life code demos and assignments, plus additional resources, instructions, exercises and solutions. At the end of the course, you'll have written thousands of lines of Spark. I've seen that my students are most successful - and my best students work at Google-class companies - when they're guided, but not being told what to do. I have exercises waiting for you, where I offer my (opinionated) guidance but otherwise freedom to experiment and improve upon your code. Definitely not least, my students are most successful when they have fun along the way! So join me in this course and let's rock the JVM! Who this course is for: Future data scientists Programmers getting into the field of Big Data Engineers wanting to learn Spark in Scala, its native language Show more Show less Featured review Obaid Salikeen 65 courses 15 reviews Rating: 5.0 out of 5 a year ago Best Spark course on Udemy hands down, I took the best seller Spark course previously but that was no way near this course, This house gives an in-depth, by-example approach to learning. I just love it. Show more Show less Instructor Daniel Ciocîrlan Software Engineer & Best-Selling Instructor 4.7 Instructor Rating 20,950 Reviews 63,734 Students 11 Courses I'm a software engineer with a passion for teaching. Big fan of Scala and the JVM. I have a Master's Degree in Computer Science and I wrote my Bachelor and Master theses on Quantum Computation. Before starting to learn programming, I won medals at international Physics competitions. For 7+ years, I've taught a variety of Computer Science topics to 30000+ of students at various levels. I've held Hour of Code for 7 year-olds, I've taught university students who now work at Google and Facebook, I've held live trainings for software engineering teams at Adobe and Apple, and I'm now so excited to share what I know with a wider community online. Show more Show less Udemy Business Teach on Udemy Get the app About us Contact us Careers Blog Help and Support Affiliate Impressum Kontakt Terms Privacy policy Cookie settings Sitemap © 2021 Udemy, Inc. window.handleCSSToggleButtonClick = function (event) { var target = event.currentTarget; var cssToggleId = target && target.dataset && target.dataset.cssToggleId; var input = cssToggleId && document.getElementById(cssToggleId); if (input) { if (input.dataset.type === 'checkbox') { input.dataset.checked = input.dataset.checked ? '' : 'checked'; } else { input.dataset.checked = input.dataset.allowToggle && input.dataset.checked ? '' : 'checked'; var radios = document.querySelectorAll('[name="' + input.dataset.name + '"]'); for (var i = 0; i (function(){window['__CF$cv$params']={r:'67774cc8ed8c4090',m:'9b36b9472d7dab3d4849cec6090adc3fbcc542af-1627739471-1800-AfVAl/XQgdthQw61lKm8NLu2ap5NcnpQHX20KsVT0KDg3d05SbSKBx0WCHmMl2aBzhnHwHPaNctwSiomOhw+5JeKyZvKSHqwVKZcAVg2sD1lF8I7b2D5I9IqDoT8KdleaajN9NgFlTelaXX6Prt250U=',s:[0xa235d01cea,0xa0711495a4],}})();