Scribd Logo
Upload

Welcome to Scribd!

  • 35 views

    Chapter 1

    Uploaded by

    rizwan asghar
    A data warehouse is a computer system designed to store and analyze large amounts of data for an organization. It gathers data from different areas, integrates and stores the data, and makes it available for analysis. Organizations implement data warehouses to support business intelligence activity, enable effective organizational analysis and decision-making, and find ways to innovate based on insights from their data.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd

    Chapter 1

    Uploaded by

    rizwan asghar
    35 views28 pages
    A data warehouse is a computer system designed to store and analyze large amounts of data for an organization. It gathers data from different areas, integrates and stores the data, and makes it available for analysis. Organizations implement data warehouses to support business intelligence activity, enable effective organizational analysis and decision-making, and find ways to innovate based on insights from their data.

    Original Title

    chapter1

    Copyright

    © © All Rights Reserved

    Available Formats

    PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    A data warehouse is a computer system designed to store and analyze large amounts of data for an organization. It gathers data from different areas, integrates and stores the data, and makes it available for analysis. Organizations implement data warehouses to support business intelligence activity, enable effective organizational analysis and decision-making, and find ways to innovate based on insights from their data.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Download as pdf or txt
    35 views28 pages

    Chapter 1

    Uploaded by

    rizwan asghar
    A data warehouse is a computer system designed to store and analyze large amounts of data for an organization. It gathers data from different areas, integrates and stores the data, and makes it available for analysis. Organizations implement data warehouses to support business intelligence activity, enable effective organizational analysis and decision-making, and find ways to innovate based on insights from their data.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Download as pdf or txt
    of 28

    What is a data

    warehouse?
    I N T R O D U C T I O N T O D ATA WA R E H O U S I N G

    Aaren Stubberfield
    Data Scientist
    What you will learn
    What is a data warehouse
    Warehouse architectures and properties

    Data warehouse data modeling

    Data prep and cleaning

    INTRODUCTION TO DATA WAREHOUSING


    What is a data warehouse?
    A computer system designed to store and analyze large amounts of data for an
    organization.

    INTRODUCTION TO DATA WAREHOUSING


    What does a data warehouse do?
    Gathers data from different areas of an
    organization

    Integrates and stores the data

    Make it available for analysis

    1 Photos from Pexel by Nataliya Vaitkevich and Tiger Lily

    INTRODUCTION TO DATA WAREHOUSING


    Why is a data warehouse valuable?
    Organizations implement data warehouses in order to:*

    Support business intelligence activity

    Enable effective organizational analysis and decision-making


    Find ways to innovate based on insights from their data

    1 Data Management Book Of Knowledge 2nd Edition

    INTRODUCTION TO DATA WAREHOUSING


    Meet Bravo!
    Hypothetical publicly traded company
    Sells home office furniture

    1 Photo from Pexel by Pixabay

    INTRODUCTION TO DATA WAREHOUSING


    Common scenarios
    Product sales forecasting
    Governance and regulation adherence

    Insight and growth

    INTRODUCTION TO DATA WAREHOUSING


    Summary
    What is a data warehouse? Why is a data warehouse valuable?

    A computer system designed to store and Support business intelligence activity


    analyze large amounts of data for an
    Enable effective analysis and decision-
    organization.
    making

    Foster data-driven innovation

    What does a data warehouse do?

    Gathers data from different areas

    Integrates and stores the data

    Make it available for analysis

    INTRODUCTION TO DATA WAREHOUSING


    Let's practice!
    I N T R O D U C T I O N T O D ATA WA R E H O U S I N G
    What's the
    difference between
    data warehouses
    and data lakes?
    I N T R O D U C T I O N T O D ATA WA R E H O U S I N G

    Aaren Stubberfield
    Data Scientist
    Database
    Structured data in rows and columns
    Transactional databases store transactions

    INTRODUCTION TO DATA WAREHOUSING


    Data warehouse
    Gather data, integrate, and make available
    for analysis

    Many input data sources

    Stores structured data

    Complex to change
    Upstream and downstream effects must
    be considered

    Typically >100 GB in size

    INTRODUCTION TO DATA WAREHOUSING


    Why the data warehouse?
    How quickly the query will run on a large
    amount of data

    Avoid slowing down transactional database

    INTRODUCTION TO DATA WAREHOUSING


    Data marts
    A relational database for analysis
    Data is focused on one subject area

    Few input data sources

    Typically <100 GB in size

    INTRODUCTION TO DATA WAREHOUSING


    Data lake
    Entire organization store of data
    Contains data from many departments

    Many data input sources

    Typically >100 GB in size

    Stores structured and unstructured data


    Examples: video, audio, and documents

    INTRODUCTION TO DATA WAREHOUSING


    Data lake
    Less complex to make changes
    Fewer upstream and downstream effects
    to consider

    Purpose to store data may not be known


    Less organized

    INTRODUCTION TO DATA WAREHOUSING


    Summary
    Feature Data Warehouse Data Mart Data Lake
    Structured &
    Data structure Structured Structured Unstructured
    Complexity to change Complex Complex Less complex
    Purpose of data Known Known May not be known
    Coverage of Covers only
    Covers many Covers many
    departments one
    Many source
    Data sources Few sources Many source systems
    systems
    Typical size >100 GB <100 GB >100 GB

    INTRODUCTION TO DATA WAREHOUSING


    Let's practice!
    I N T R O D U C T I O N T O D ATA WA R E H O U S I N G
    Data warehouses
    support
    organizational
    analysis
    I N T R O D U C T I O N T O D ATA WA R E H O U S I N G

    Aaren Stubberfield
    Data Scientist
    High-level life cycle

    INTRODUCTION TO DATA WAREHOUSING


    Planning - business requirements
    1. Business Requirements:
    Understanding the organizational needs

    Personas:
    Analyst & Data Scientist - collect
    requirements

    INTRODUCTION TO DATA WAREHOUSING


    Planning - data modeling
    1. Data Modeling:
    Planning and organizing on integrating
    data

    Personas:
    Data Engineer & Database Admins -
    design data pipeline

    Analyst & Data Scientist - data


    business knowledge

    INTRODUCTION TO DATA WAREHOUSING


    Implementation - ETL Design & Development
    1. ETL Design:
    Implement data pipelines and ETL
    process

    Personas:
    Data Engineer & Database Admins -
    implement data pipeline

    INTRODUCTION TO DATA WAREHOUSING


    Implementation - BI Application Development
    1. BI Application Development:
    Setup business intelligence (BI) tools

    Personas:
    Analyst & Data Scientist - consult on
    BI tool setup

    INTRODUCTION TO DATA WAREHOUSING


    Support / Maintenance - Maintenance
    1. Maintenance:
    Make any needed modifications

    Personas:
    Data Engineer - modify as needed

    INTRODUCTION TO DATA WAREHOUSING


    Support / Maintenance - Test & Deploy
    1. Test & Deploy:
    Testing

    Personas:
    Analyst & Data Scientist - consult on
    BI tool setup

    Data Engineers - deploy the data


    warehouse

    INTRODUCTION TO DATA WAREHOUSING


    Persona matrix
    Data Data Database
    Life cycle step Analysts Scientist Engineers Administrators
    Business Requirements X X
    Data Modeling X X X X
    ETL Design &
    X X
    Development
    BI Application
    Development X X

    Maintenance X
    Test & Deploy X X X

    INTRODUCTION TO DATA WAREHOUSING


    Let's practice!
    I N T R O D U C T I O N T O D ATA WA R E H O U S I N G

    You might also like