What's up with Spark(1/5) - Spark Architecture | Azure Data Lake


Extraordinary Robot
News Feed
In this episode of What's up with___? Andrew Moll meets with Alejandro Guerrero Gonzalez and Joel Zambrano, Engineers on the HDInsight team, and learns all about the interworkings of Apache Spark. The team relies on your knowledge of traditional Hadoop, giving an overview of the major changes when developing on Spark. The video takes you through what is an RDD, how the Spark master and driver work together, and how we interact with the cluster once it's provisioned. You'll want to start here if you are just getting your feet wet with Spark! The spark documentation can be found here and HDInsight specific docs are here!

Continue reading...

This website is not affiliated, owned, or endorsed by Microsoft Corporation. It is a member of the Microsoft Partner Program.