Implement Data Engineering Solutions Using Microsoft Fabric
(4 days)
Course Description
This course covers methods and practices for implementing and managing enterprise-scale data analytics solutions using Microsoft Fabric. Students will learn how to use Fabric dataflows, pipelines, and notebooks to develop analytics assets such as semantic models, data warehouses, and lakehouses. This course is designed for experienced data professionals skilled at data preparation, modeling, analysis, and visualization, such as the PL-300: Power BI Data Analyst certification.
Learning Objectives
-
Ingest and transform data using Dataflows Gen2 in Microsoft Fabric.
-
Build and monitor data pipelines for seamless orchestration.
-
Capture, analyze, and visualize real-time event data with Eventstreams.
-
Create lakehouses and query data with Spark and SQL.
-
Implement medallion architecture for efficient data organization.
-
Secure data access and manage permissions within Microsoft Fabric.
-
Develop real-time dashboards for actionable insights.
-
Automate deployments with CI/CD and monitor activities using Monitoring Hub.
Who Should Attend
The primary audience for this course is data professionals with experience in data modeling and analytics. DP-600 is designed for professionals who want to use Microsoft Fabric to create and deploy enterprise-scale data analytics solutions. Learners should have prior experience with one of the following programming languages: Structured Query Language (SQL), Kusto Query Language (KQL), or Data Analysis Expressions (DAX).
Prerequisites
- Familiarity with Microsoft Fabric: Getting started with Fabric
- Familiarity with Data Orchestration
Course Outline
Module 1: Ingest data with Microsoft Fabric
- Ingest Data with Dataflows Gen2 in Microsoft Fabric
- Understand Dataflows Gen2 in Microsoft Fabric
- Explore Dataflows Gen2 in Microsoft Fabric
- Integrate Dataflows Gen2 and Pipelines in Microsoft Fabric
- Exercise – Create and use a Dataflow Gen2 in Microsoft Fabric
- Orchestrate processes and data movement with Microsoft Fabric
- Understand pipelines
- Use the Copy Data activity
- Use pipeline templates
- Run and monitor pipelines
- Exercise – Ingest data with a pipeline
- Use Apache Spark in Microsoft Fabric
- Work with real-time data in an Eventhouse in Microsoft Fabric
- Get started with an Eventhouse
- Use KQL effectively
- Materialized views and stored functions
- Exercise – Work with data in an Eventhouse
Module 2: Implement a Lakehouse with Microsoft Fabric
- Introduction to end-to-end analytics using Microsoft Fabric
- Explore end-to-end analytics with Microsoft Fabric, Explore data teams and Microsoft Fabric, Enable and use Microsoft Fabric, Get started with lakehouses in Microsoft Fabric
- Explore the Microsoft Fabric lakehouse, Work with Microsoft Fabric lakehouses, Explore and transform data in a lakehouse
- Exercise – Create a Microsoft Fabric lakehouse
- Use Apache Spark in Microsoft Fabric, Prepare to use Apache Spark, Run Spark code, Work with data in a Spark dataframe. Work with data using Spark SQL, Visualize data in a Spark notebook
- Exercise – Analyze data with Apache Spark
- Work with Delta Lake tables in Microsoft Fabric, Understand Delta Lake, Create delta tables, Optimize delta tables, Work with delta tables in Spark, Use delta tables with streaming data
- Exercise – Use delta tables in Apache Spark
- Ingest Data with Dataflows Gen2 in Microsoft Fabric, Understand Dataflows Gen2 in Microsoft Fabric, Explore Dataflows Gen2 in Microsoft Fabric, Integrate Dataflows Gen2 and Pipelines in Microsoft Fabric
- Exercise – Create and use a Dataflow Gen2 in Microsoft Fabric
- Orchestrate processes and data movement with Microsoft Fabric
- Exercise – Ingest data with a pipeline
- Organize a Fabric lakehouse using medallion architecture design, Describe medallion architecture, Implement a medallion architecture in Fabric
- Query and report on data in your Fabric lakehouse, Considerations for managing your lakehouse
- Exercise – Organize your Fabric lakehouse using a medallion architecture
Module 3: Implement RealTime Intelligence with Microsoft Fabric
- Get started with Real-Time Intelligence in Microsoft Fabric
- Use Eventstream in Microsoft Fabric
- Work with real-time data in an Eventhouse in Microsoft Fabric
- Get started with an Eventhouse
- Use KQL effectively
- Materialized views and stored functions
- Exercise – Work with data in an Eventhouse
- Create Real-Time Dashboards with Microsoft Fabric
- Get started with real-time dashboards
- Organize and filter dashboard data
- Dashboard management and optimization
- Exercise – Get started with real-time dashboards
- Use Activator in Microsoft Fabric
- Configure Activator for your data
- Create rules in Activator
- Configure actions in Activator
- Exercise – Use Activator in Fabric
Module 4: Implement a data warehouse with Microsoft Fabric
- Explore end-to-end analytics with Microsoft Fabric
- Explore data teams and Microsoft Fabric
- Enable and use Microsoft Fabric
- Get started with data warehouses in Microsoft Fabric
- Query and transform data
- Prepare data for analysis and reporting
- Secure and monitor your data warehouse
- Exercise – Analyze data in a data warehouse
- Explore data load strategies
- Use data pipelines to load a warehouse, Load data using T-SQL, Load and transform data with Dataflow Gen2
- Exercise – Load data into a warehouse in Microsoft Fabric
- Query a data warehouse in Microsoft Fabric, Query data, Use the SQL query editor, Explore the visual query editor
- Exercise – Query a data warehouse in Microsoft Fabric
- Monitor a Microsoft Fabric data warehouse, Monitor capacity metrics, Monitor current activity, Monitor queries
- Exercise – Monitor a data warehouse in Microsoft Fabric
- Secure a Microsoft Fabric data warehouse
- Explore dynamic data masking
- Implement row-level security
- Implement column-level security
- Configure SQL granular permissions using T-SQL
- Exercise – Secure a warehouse in Microsoft Fabric
Module 5: Manage a Microsoft Fabric environment
- Implement continuous integration and continuous delivery (CI/CD) in Microsoft Fabric
- Understand Continuous Integration and Continuous Delivery (CI/CD)
- Implement version control and Git integration
- Implement deployment pipelines
- Automate CI/CD using Fabric APIs
- Exercise – Implement deployment pipelines in Microsoft Fabric
- Monitor activities in Microsoft Fabric
- Secure data access in Microsoft Fabric
- Administer a Microsoft Fabric environment
