DP-3011: Implementing a Data Analytics Solution with Azure Databricks

Course: DP-3011: Implementing a Data Analytics Solution with Azure Databricks

Learn how to take full advantage of Apache Spark and the powerful clusters running on the Azure Databricks platform to run large data engineering workloads in the cloud.

Objectives of the DP-3011 training

• Setting up a development environment in Azure Machine Learning
• Prepare data for model training
• Create and configure a model training script as a command job
• Manage artifacts using MLflow
• Implement a model for real-time consumption

Course content DP-3011 Implementing a Data Analytics solution with Azure Databricks

Module 1: Explore Azure Databricks

• Introduction to Azure Databricks
• Identifying Azure Databricks workloads
• Description of key concepts
• Data governance using Unity Catalog and Microsoft Purview
• Exercise: Explore Azure Databricks

Module 2: Perform data analysis with Azure Databricks

• Introduction
• Data ingestion with Azure Databricks
• Data exploration tools in Azure Databricks
• Data analysis using DataFrame APIs
• Exercise: Data exploration with Azure Databricks

Module 3: Using Apache Spark in Azure Databricks

• Introduction
• Discover Spark
• Creating a Spark cluster
• Using Spark in notebooks
• Using Spark to work with data files
• Data visualization
• Exercise: Using Spark in Azure Databricks
  

Module 4: Data Management with Delta Lake

• Introduction
• First steps with Delta Lake
• ACID transaction management
• Implementation of compliance schemes
• Data version control and time travel and navigation in Delta Lake
• Data integrity with Delta Lake
• Exercise: Using Delta Lake in Azure Databricks

Module 5: Building Data Pipelines with Delta Live Tables

• Introduction
• Delta Live Tables Exploration
• Data ingestion and integration
• Real-time processing
• Exercise: Creating a data pipeline with Delta Live Tables

Module 6: Implementing workloads with Azure Databricks workflows

• Introduction
• What are Azure Databricks workflows?
• Description of the key components of Azure Databricks workflows
• Exploring the advantages of Azure Databricks workflows
• Deploying workloads using Azure Databricks workflows
• Exercise: Creating an Azure Databricks workflow

Prerequisites

It has no prerequisites

Language

• Course: English / Spanish
• Labs: English / Spanish