Inginer de date profesionist în Python

Discover modern data architecture's key components, from ingestion and serving to governance and orchestration.

Învață elementele esențiale ale VM-urilor, containerelor, Docker și Kubernetes. Înțelege diferențele pentru a începe!

Acest curs prezintă dbt pentru modelarea datelor, transformări, testare și crearea documentației.

Descoperă conceptele fundamentale ale programării orientate pe obiecte (OOP), construind clase și obiecte personalizate!

Conquer NoSQL and supercharge data workflows. Learn Snowflake to work with big data, Postgres JSON for handling document data, and Redis for key-value data.

In this Introduction to DevOps, you’ll master the DevOps basics and learn the key concepts, tools, and techniques to improve productivity.

Master Python testing: Learn methods, create checks, and ensure error-free code with pytest and unittest.

Sharpen your debugging skills to enhance sales data accuracy.

Descoperă Docker și importanța lui în setul de instrumente al profesionistului în date. Află despre containerele Docker, imaginile și altele.

Stăpânește PySpark pentru a gestiona big data cu ușurință—învață să procesezi, interoghezi și optimizezi seturi de date uriașe pentru analize puternice!

This chapter introduces the exciting world of Big Data, as well as the various concepts and different frameworks for processing Big Data. You will understand why Apache Spark is considered the best framework for BigData.

The main abstraction Spark provides is a resilient distributed dataset (RDD), which is the fundamental and backbone data type of this engine. This chapter introduces RDDs and shows how RDDs can be created and executed using RDD Transformations and Actions.

In this chapter, you'll learn about Spark SQL which is a Spark module for structured data processing. It provides a programming abstraction called DataFrames and can also act as a distributed SQL query engine. This chapter shows how Spark SQL allows you to use DataFrames in Python.

Step into a data engineer's shoes and master data cleaning with PySpark on an e-commerce orders dataset!

In this chapter, we learn how to download data files from web servers via the command line. In the process, we also learn about documentation manuals, option flags, and multi-file processing.

In the last chapter, we bridge the connection between command line and other data science languages and learn how they can work together. Using Python as a case study, we learn to execute Python on the command line, to install dependencies using the package manager pip, and to build an entire model pipeline using the command line.

Learn about the difference between batching and streaming, scaling streaming systems, and real-world applications.

Master Apache Kafka! From core concepts to advanced architecture, learn to create, manage, and troubleshoot Kafka for real-world data streaming challenges!

In this course, you will learn the fundamentals of Kubernetes and deploy and orchestrate containers using Manifests and kubectl instructions.

Understand how data engineering can impact your business.