From the course: End-to-End Real-World Data Engineering Project with Databricks
Unlock this course with a free trial
Join today to access over 24,100 courses taught by industry experts.
Create the Bronze layer database
From the course: End-to-End Real-World Data Engineering Project with Databricks
Create the Bronze layer database
- [Instructor] Let's create a notebook. In that notebook, we are going to create our Bronze layer database. Give the name to the notebook, (keyboard clacks) Bronze_layer_DB_creation. (keyboard clacks) Now, to run any notebook, we need to have the cluster. So before moving on to this, let's quickly start the cluster so that it gets started while we write our code. So click on Compute. Create compute, and as we are using it for our testing purpose, you can choose a single node cluster as well, and you can start a compute cluster. Now, let's go back to our recent notebook that is Bronze_layer_DB_creation, meanwhile cluster is getting started. Let's create our Bronze layer database. Now, how to create that Bronze layer database? You can write a code saying spark.sql, and you can say, ("create database bronze_layer"). Let me correct the spelling, ("create database bronze_layer"). Now, this will going to create the database, but, sometimes, if you rerun this command again, this will going…
Practice while you learn with exercise files
Download the files the instructor uses to teach the course. Follow along and learn by watching, listening and practicing.
Contents
-
-
-
-
-
(Locked)
Create the Bronze layer database4m 55s
-
(Locked)
Create a Databricks notebook to load a CSV file to the customer delta table13m 59s
-
(Locked)
Create a Databricks notebook to load a JSON file to the product delta table5m 42s
-
(Locked)
Create a Databricks notebook to load a Parquet file to the order delta table8m 4s
-
(Locked)
-
-
-
-