aka.

ms/Ignite23BRK221H
Make your data AI ready with
Microsoft Fabric and Azure Databricks
Piethein Strengholt Sarath Sasidharan
Chief Data Officer Senior Program Manager
Netherlands Fabric CAT
Data is the fuel that powers AI
The 2023 Data and AI landscape
“Unify,
I am the Chief Information Officer and don’t
want to be the Chief Integration Officer.
Help me unleash AI in my data estate.”

Every CIO, Every Enterprise

 Microsoft Fabric
Data analytics for the era of AI

From To

One component Unified stack

Single database All the data
Gen AI wired in Gen AI built in
 Microsoft Fabric
Data analytics for the era of AI

Complete Empower
Lake Centric AI
Analytics Every
and Open Powered
Platform Business User
 Microsoft Fabric
The unified data platform for the era of AI

Data Synapse Data Synapse Data Synapse Data Synapse Real Data
Power BI
Factory Engineering Science Warehousing Time Analytics Activator

AI

OneLake

Purview

Unified Unified Unified Unified

architecture experience governance business model
 General availability

Microsoft Fabric
aka.ms/IgniteFabric2023
 Microsoft Fabric
Data analytics for the era of AI

Complete Lake Centric Empower AI

Analytics and Open Every Business Powered
Platform User

Everything, unified OneLake Familiar and intuitive Copilot accelerated

SaaS-ified One copy Built into Microsoft 365 Gen AI on your data

Secured and governed Open at every tier Insight to action AI-driven insights
 Microsoft Fabric
The unified data platform for the era of AI

Data Synapse Data Synapse Data Synapse Data Synapse Real Data
Power BI
Factory Engineering Science Warehousing Time Analytics Activator

AI

OneLake

Purview

Unified Unified Unified Unified

architecture experience governance business model
Persona
optimized
experiences
Demo
 Microsoft Fabric
Data analytics for the era of AI

Complete Lake Centric Empower AI

Analytics and Open Every Business Powered
Platform User

Everything, unified OneLake Familiar and intuitive Copilot accelerated

SaaS-ified One copy Built into Microsoft 365 Gen AI on your data

Secured and governed Open at every tier Insight to action AI-driven insights
OneLake for all Data
“The OneDrive for Data”

A single SaaS lake for the whole

Data Synapse Data Synapse Data Synapse Data Synapse Real Data
organization
Power BI
Factory Engineering Science Warehouse Time Analytics Activator
Provisioned automatically with the tenant

All workloads automatically store their

data in the OneLake workspace folders

All the data is organized in an intuitive

hierarchical namespace

The data in OneLake is automatically

OneLake indexed for discovery, MIP labels, lineage,
PII scans, sharing, governance and
compliance
Intelligent data foundation
One Copy for all computes
Real separation of compute and storage

All the compute engines store their data

automatically in OneLake

Data Synapse Data Synapse Data Synapse Data Synapse Real Data
Power BI The data is stored in a single common format
Factory Engineering Science Warehouse Time Analytics Activator

Delta – Parquet, an open standards format,

is the storage format for all tabular data in
Analytics vNext

Spark T-SQL
Serverless KQL
Analysis
Compute Services Once data is stored in the lake, it is directly
accessible by all the engines without needing
any import/export

All the compute engines have been fully

optimized to work with Delta Parquet as their
Customers Service Business
360
Finance
Telemetry KPIs
native format

Delta – Delta – Delta – Delta – Shared universal security model is enforced

Parquet Parquet Parquet Parquet
Format Format Format Format across all the engines
Unifying data in OneLake
Shortcuts

Sharing data in OneLake is as easy as

sharing files in OneDrive, removing the
needs for data duplication
Data Synapse Data Synapse Data Synapse Data Synapse Real Data
Power BI
Factory Engineering Science Warehouse Time Analytics Activator
With shortcuts, data throughout OneLake
can be composed together without any
data movement

Shortcuts also allow instant linking of

Customers
360
Finance
Service
Telemetry
Business
KPIs data already existing in Azure and in
OneLake other clouds, without any data duplication
and movement, making OneLake the first
multi-cloud data lake

With support for industry standard APIs,

OneLake data can be directly accessed by
Azure Storage Amazon AWS S3 Google Storage Dataverse
any application or service
 Announcing

Mirroring in
Microsoft Fabric
aka.ms/IgniteFabric2023
Unifying data in OneLake
Frictionless Mirroring of External Databases

Data Synapse Data Synapse Data Synapse Data Synapse Real Data
Power BI
Factory Engineering Science Warehouse Time Analytics Activator

OneLake

Azure Amazon Google

Better together through OneLake
Open and Governed Lakehouse

All Fabric engines have been

redesigned and optimized for
delta/parquet as their storage format
for tabular data

Azure Databricks can directly read/write

data from any Fabric data item stored
in OneLake through external link.

Existing non-Unity Catalog managed

data in ADLS gen2 storage can be a
Microsoft Fabric Azure Databricks shortcut into OneLake.

Works with all Fabric engines including

Power BI with direct lake mode.
Lakehouse architecture – ADLS as Gold Layer
https://learn.microsoft.com/en-us/fabric/onelake/create-adls-shortcut

Process Process Microsoft

Fabric
(SaaS)
Ingest
Copy data using Azure Azure
Data Factory Databricks Databricks

Power BI
Operational
systems

ADLS as Bronze ADLS as Silver ADLS as Gold

Typically, raw and Typically, cleansed Ready for Serve
different file formats and standardized file consumption Provide
formats shortcuts Synapse
Blob
Data
landing Science
zone

Orchestrate using Azure Data Factory

Lakehouse architecture – OneLake as Gold Layer
https://learn.microsoft.com/en-us/fabric/onelake/onelake-azure-databricks

Process Process Microsoft

Fabric
(SaaS)
Ingest
Copy data using Azure Azure
Data Factory Databricks Databricks

Power BI
Operational
systems Tables

ADLS as Bronze ADLS as Silver Onelake as Gold

Typically, raw and Typically, cleansed Ready for
different file formats and standardized file consumption
formats Synapse
Blob
Data
landing Science
zone

Orchestrate using Azure Data Factory

 Microsoft Fabric
Data analytics for the era of AI

Complete Lake Centric Empower AI

Analytics and Open Every Business Powered
Platform User

Everything, unified OneLake Familiar and intuitive Copilot accelerated

SaaS-ified One copy Built into Microsoft 365 Gen AI on your data

Secured and governed Open at every tier Insight to action AI-driven insights
 Microsoft Fabric
Data analytics for the era of AI

Complete Lake Centric Empower AI

Analytics and Open Every Business Powered
Platform User

Everything, unified OneLake Familiar and intuitive Copilot accelerated

SaaS-ified One copy Built into Microsoft 365 Gen AI on your data

Secured and governed Open at every tier Insight to action AI-driven insights
 Announcing

Copilot in
Microsoft Fabric
aka.ms/IgniteFabric2023
 Next steps

Register for the

Attend Fabric Try Microsoft Microsoft
sessions Fabric Fabric Community
Conference
aka.ms/IgniteData2023 aka.ms/try-Fabric aka.ms/FabricConference
 Weekly Fabric Releases
Rapid pace of innovation

Aug 2023 Sept 2023 Oct 2023

Explore the Fabric Roadmap
Rapid pace of innovation

Jul 2023 Aug 2023 Sep 2023

aka.ms/FabricRoadmap
Azure. Limitless innovation.