From the course: Azure Spark Databricks Essential Training
Unlock the full course today
Join today to access over 24,100 courses taught by industry experts.
Review Databricks Azure cluster setup
From the course: Azure Spark Databricks Essential Training
Review Databricks Azure cluster setup
- [Instructor] In this section, we're going to work with an active cluster and you're reminded that there are three parts to this process. We have Databricks, which manages the Spark's distributed compute and then we have Azure, which hosts and controls the compute and the storage. The account setup has a number of steps and I've done most of these in advance so we'll review the setup, getting to the point where we set up an actual cluster. The steps that I've done is I've taken a business email and I've set up an Azure account as then, as an Azure user. I have set up an premium Databricks account. It's important to note that to use a demo account to explore your own Azure Databricks cluster, before creating your cluster, you're going to need to go to your Azure profile and change your subscription to pay-as-you-go. If we think a little bit more about the Databricks Azure architecture, we'll see the control planes represented in this diagram. You can see that that Azure uses the…
Practice while you learn with exercise files
Download the files the instructor uses to teach the course. Follow along and learn by watching, listening and practicing.
Contents
-
-
-
-
(Locked)
Review Databricks Azure cluster setup3m 39s
-
(Locked)
Use a Python notebook with dashboards6m 1s
-
(Locked)
Use an R notebook4m
-
(Locked)
Use a Scala notebook for visualization6m 37s
-
(Locked)
Use a notebook with scikit-learn11m 29s
-
(Locked)
Use a Spark Streaming notebook8m 53s
-
Use an external Scala library: variant-spark10m 26s
-
(Locked)
-
-
-
-