DP-3011: Implementing a Data Analytics Solution with Azure Databricks

Course: DP-3011: Implementing a Data Analytics Solution with Azure Databricks

Learn how to take full advantage of Apache Spark and the powerful clusters running on the Azure Databricks platform to execute large data engineering workloads in the cloud.

DP-3011 Training Objectives

• Configure a development environment in Azure Machine Learning
• Prepare data for model training
• Create and configure a model training script as a command job
• Manage artifacts using MLflow
• Deploy a model for real-time consumption

DP-3011 Course Content Implementing a Data Analytics Solution with Azure Databricks

Module 1: Explore Azure Databricks

• Introduction to Azure Databricks
• Identifying Azure Databricks workloads
• Describing key concepts
• Data governance using Unity Catalog and Microsoft Purview
• Exercise: Explore Azure Databricks

Module 2: Do data analysis with Azure Databricks

• Introduction
• Ingesting data with Azure Databricks
• Data exploration tools in Azure Databricks
• Analyzing data using DataFrame APIs
• Exercise: Data exploration with Azure Databricks

Module 3: Using Apache Spark in Azure Databricks

• Introduction
• Discover Spark
• Creating a Spark cluster
• Using Spark in notebooks
• Using Spark to work with data files
• Data visualization
• Exercise: Using Spark in Azure Databricks

Module 4: Data Management with Delta Lake

• Introduction
• Getting Started with Delta Lake
• Managing ACID transactions
• Implementing schema enforcement
• Data versioning and time travel in Delta Lake
• Data integrity with Delta Lake
• Exercise: Using Delta Lake in Azure Databricks

Module 5: Building data pipelines with Delta Live Tables

• Introduction
• Exploring Delta Live Tables
• Data ingestion and integration
• Real-time processing
• Exercise: Building a data pipeline with Delta Live Tables

Module 6: Implementing workloads with Azure Databricks Workflows

• Introduction
• What are Azure Databricks Workflows?
• Describing key components of Azure Databricks Workflows
• Exploring the benefits of Azure Databricks Workflows
• Implementing workloads using Azure Databricks Workflows
• Exercise: Creating an Azure Databricks Workflow

Prerequisites

No prerequisites

Language

• Course: English / Spanish
• Labs: English / Spanish