Open-Source-Contribution

How Large Open-Source Projects Build Efficient CI: Apache Airflow as a Case Study

13 mins

A deep dive into Airflow’s CI: Docker for reproducible environments, Breeze to unify local and CI workflows, and Selective Checks to run only the tests that matter.

Deep Dive into Apache Airflow's Dag Processing Mechanism

8 mins

Blog En Open-Source-Contribution Data-Engineering

This article provides an in-depth exploration of Airflow 2’s Dag Processing mechanism and summarizes best practices related to Dag Processing.

External Event Driven Scheduling in Airflow

8 mins

Blog En Open-Source-Contribution Data-Engineering

Exploring the AIP-82 External Event Driven Scheduling proposal in Airflow 3, the implementation details and use cases of the Common Message Queue, and how to enable real-time event-driven workflow scheduling in Airflow.

Becoming an Apache Airflow Committer from 0

14 mins

Blog En Open-Source-Contribution

How a Complete Beginner in Data Engineering Became an Apache Airflow Committer in 5 Months with 70+ PRs and 300 Hours of Contributions

Contributing to Apache Airflow from 0

7 mins

Blog En Open-Source-Contribution

How a beginner with no prior Data Engineering experience managed to contribute over 50 PRs in just 3 months

↑