Accéder au contenu principal

Building Scalable Data Pipelines

Ciro Greco, CEO and Co-founder at Bauplan, teaches you how to design and build scalable data pipelines from the ground up.
20 août 2025
View slides

Reliable data pipelines are the backbone of every data-driven organization—but building them to scale is easier said than done. From scheduling and versioning to deploying in production, it takes more than just writing scripts to create pipelines that are robust, maintainable, and ready for growth.

In this code-along, Ciro Greco, CEO and Co-founder at Bauplan, teaches you how to design and build scalable data pipelines from the ground up. You’ll start with simple pipeline components, learn how to manage them over time, and explore the technologies that support production-ready workflows. This session is ideal for data and AI practitioners looking to sharpen their engineering skills.

Key Takeaways:

  • Learn how to build and manage scalable, production-grade data pipelines.
  • Discover tools and techniques for scheduling, versioning, and orchestration.
  • Understand the core tech stack for modern data pipeline development.

Session Resources (including repo + set-up info) + Slides

Sujets
Apparenté

blog

How to Build Adaptive Data Pipelines for Future-Proof Analytics

Leverage data warehousing techniques combined with business logic to build a scalable and sustainable approach to data analytics.

Sanjana Putchala

10 min

blog

Building a Scalable Data Strategy with IPTOP: Infrastructure, People, Tools, Organization, and Processes

Scaling a data strategy successfully is no small feat. Follow our methodology to lay a strong data foundation and scale an enterprise data program.
Adel Nehme's photo

Adel Nehme

7 min

Didacticiel

Building an ETL Pipeline with Airflow

Master the basics of extracting, transforming, and loading data with Apache Airflow.
Jake Roach's photo

Jake Roach

Didacticiel

Building Data Pipelines in Snowflake: A Beginner-Friendly Guide

Start from scratch and build end-to-end data pipelines in Snowflake by following this guide. We will cover the basics of building automated and efficient Snowflake pipelines.
Tim Lu's photo

Tim Lu

Didacticiel

Mastering the Databricks API: Working with Data Pipelines at Scale

Learn to use the Databricks REST API for job automation, cluster management, and integrations. Master best practices for security, performance, and scalability.
Allan Ouko's photo

Allan Ouko

Didacticiel

An Introduction to Data Pipelines for Aspiring Data Professionals

This tutorial covers the basics of data pipelines and terminology for aspiring data professionals, including pipeline uses, common technology, and tips for pipeline building.
Amberle McKee's photo

Amberle McKee

Voir plusVoir plus