Skip to main content
HomeCode-alongsData Engineering

Creating Data Pipelines with Airflow

Join Mike, an experienced data engineering consultant, as he guides you through the fundamentals of data pipelines with Airflow and Python.
Jun 2024
View Slides

Apache Airflow is an essential tool for managing complex software workflows, ensuring data quality, and facilitating scalable data operations. Whether you're just starting out or aiming to refine your existing skills, this session will enhance your ability to orchestrate robust data pipelines efficiently.

Join Mike, an experienced data engineering consultant, as he guides you through the fundamentals of data pipelines with Airflow and Python. In this interactive session, you will learn how to design, execute, and monitor data pipelines that can handle both batch and real-time data processing. Mike will demonstrate practical examples, share best practices, and provide insights on optimizing your data workflows

Key Takeaways:

  • Understand how data pipelines can be used to improve the robustness and quality of data workflows.
  • Learn how to get started creating data pipelines with Apache Airflow.
  • Learn how to monitor the performance of data pipelines.

Check out additional Data Engineering and Airflow resources! 

Topics
Related

tutorial

Building an ETL Pipeline with Airflow

Master the basics of extracting, transforming, and loading data with Apache Airflow.
Jake Roach's photo

Jake Roach

15 min

tutorial

Getting Started with Apache Airflow

Learn the basics of bringing your data pipelines to production, with Apache Airflow. Install and configure Airflow, then write your first DAG with this interactive tutorial.
Jake Roach's photo

Jake Roach

10 min

tutorial

An Introduction to Data Pipelines for Aspiring Data Professionals

This tutorial covers the basics of data pipelines and terminology for aspiring data professionals, including pipeline uses, common technology, and tips for pipeline building.
Amberle McKee's photo

Amberle McKee

22 min

tutorial

Building and Deploying Machine Learning Pipelines

Discover everything you need to know about Kubeflow and explore how to build and deploy Machine Learning Pipelines
Moez Ali 's photo

Moez Ali

16 min

tutorial

Machine Learning, Pipelines, Deployment and MLOps Tutorial

Learn basic MLOps and end-to-end development and deployment of ML pipelines.
Moez Ali's photo

Moez Ali

19 min

code-along

Getting Started with Data Pipelines for ETL

In this session, you'll learn fundamental concepts of data pipelines, like what they are and when to use them, then you'll get hands-on experience building a simple pipeline using Python.
Jake Roach's photo

Jake Roach

See MoreSee More