Data Transformation with Spark SQL in Databricks

中级技能水平

更新时间 2026年5月

Build end-to-end data pipelines - from cleaning and aggregation to streaming and orchestration.

课程描述

Ready to handle real-world data at scale? This course teaches you to transform large datasets using Spark SQL and PySpark in Databricks. Learn to shape and clean data, run aggregations with optimized joins, and apply window functions for advanced analytics. You'll also set up file-based streaming with fault-tolerant checkpoints and persist results as Delta tables. By the end, you'll be orchestrating multi-step production pipelines with Databricks Workflows and Lakeflow Declarative Pipelines.

先决条件

Introduction to Databricks SQL Introduction to PySpark

Loading and Shaping Data

In this chapter, you'll learn how to work with Databricks notebooks, load CSV data into Spark DataFrames, and shape data using PySpark and SQL.

课程描述

获得成就证明

加入超过.css-nklxlk{color:var(--wf-brand--main, #03EF62);}19百万学习者，今天就开始Data Transformation with Spark SQL in Databricks！

创建你的免费账户

通过 DataCamp for Mobile 提升您的数据技能

加入超过19百万学习者，今天就开始Data Transformation with Spark SQL in Databricks！