Building Scalable Data Pipelines
Key Takeaways:- Learn how to build and manage scalable, production-grade data pipelines.
- Discover tools and techniques for scheduling, versioning, and orchestration.
- Understand the core tech stack for modern data pipeline development.
Description
Reliable data pipelines are the backbone of every data-driven organization—but building them to scale is easier said than done. From scheduling and versioning to deploying in production, it takes more than just writing scripts to create pipelines that are robust, maintainable, and ready for growth.
In this code-along, Ciro Greco, a CEO and Co-founder at Bauplan, will teach you how to design and build scalable data pipelines from the ground up. You’ll start with simple pipeline components, learn how to manage them over time, and explore the technologies that support production-ready workflows. This session is ideal for data and AI practitioners looking to sharpen their engineering skills.
- an IDE (VS Code, Pycharm, Cursor, your preference)
Presenter Bio
Ciro is building the data pipeline platform Bauplan. He's an AI and data engineering executive on a mission to simplify creating data pipelines. Previously was VP of AI at AI search platform Coveo. He landed there after his previous startup, Tooso, was acquired.