Zhe-You Liu's Developer Blog

What Apache CommunityOverCode Asia 2025 Revealed About Open Source and Data Infrastructure in Asia

jasonliu@apache.org (Jason(Zhe-You) Liu) — Thu, 28 May 2026 11:51:30 +0800

China’s localized data stack, streaming-first infrastructure, enterprise investment in open source, open governance, and lessons for Taiwan’s tech communities.

How Large Open-Source Projects Build Efficient CI: Apache Airflow as a Case Study

jasonliu@apache.org (Jason(Zhe-You) Liu) — Tue, 13 Jan 2026 11:46:19 +0800

A deep dive into Airflow’s CI: Docker for reproducible environments, Breeze to unify local and CI workflows, and Selective Checks to run only the tests that matter.

PGMQ-SQLAlchemy 0.2.0 Release: Support ACID Transactions and FastAPI Integration

jasonliu@apache.org (Jason(Zhe-You) Liu) — Tue, 06 Jan 2026 00:00:00 +0800

PGMQ-SQLAlchemy 0.2.0 introduces support for ACID transactions, enabling developers to handle business logic and message queue operations within the same transaction, ensuring consistency and reliability of data and messages.

LFX Mentorship: CNCF - Krkn: Chaos scenario rollback feature (2025 Term 2)

jasonliu@apache.org (Jason(Zhe-You) Liu) — Sun, 31 Aug 2025 14:21:21 +0800

Sharing my experience designing and implementing the chaos scenario rollback feature for the CNCF Krkn project during the LFX Mentorship, including technical solutions, collaboration with the Red Hat Chaos Engineering team, and insights from the application and participation process.

Deep Dive into Apache Airflow's Dag Processing Mechanism

jasonliu@apache.org (Jason(Zhe-You) Liu) — Sun, 20 Jul 2025 10:39:02 +0800

This article provides an in-depth exploration of Airflow 2’s Dag Processing mechanism and summarizes best practices related to Dag Processing.

External Event Driven Scheduling in Airflow

jasonliu@apache.org (Jason(Zhe-You) Liu) — Fri, 27 Jun 2025 11:43:57 +0800

Exploring the AIP-82 External Event Driven Scheduling proposal in Airflow 3, the implementation details and use cases of the Common Message Queue, and how to enable real-time event-driven workflow scheduling in Airflow.

Apache Airflow 101

jasonliu@apache.org (Jason(Zhe-You) Liu) — Sat, 17 May 2025 15:18:17 +0800

What is Apache Airflow? What problems does it solve? Understand its common use cases, architecture, and limitations.

Becoming an Apache Airflow Committer from 0

jasonliu@apache.org (Jason(Zhe-You) Liu) — Sat, 15 Mar 2025 00:33:28 +0800

How a Complete Beginner in Data Engineering Became an Apache Airflow Committer in 5 Months with 70+ PRs and 300 Hours of Contributions

Contributing to Apache Airflow from 0

jasonliu@apache.org (Jason(Zhe-You) Liu) — Sun, 02 Mar 2025 16:48:00 +0800

How a beginner with no prior Data Engineering experience managed to contribute over 50 PRs in just 3 months

Push-based CLI Workflow on MacOS

jasonliu@apache.org (Jason(Zhe-You) Liu) — Fri, 28 Feb 2025 23:56:05 +0800

How to reduce context switching in CLI workflows on Mac through push-based notifications

What is an Embedded Database? A brief introduction to RocksDB

jasonliu@apache.org (Jason(Zhe-You) Liu) — Wed, 12 Feb 2025 00:57:41 +0800

A brief introduction to Embedded Database and concept of RocksDB

Life Is Short Use 'uv'

jasonliu@apache.org (Jason(Zhe-You) Liu) — Tue, 24 Dec 2024 15:56:36 +0800

How to use uv to manage Python packages and projects

2024 Appier Summer Internship Reflection

jasonliu@apache.org (Jason(Zhe-You) Liu) — Tue, 01 Oct 2024 21:21:01 +0800

Reflection on my backend summer internship in the Data Platform department at Appier

2024 Dcard Backend Intern Assignment

jasonliu@apache.org (Jason(Zhe-You) Liu) — Sat, 21 Sep 2024 21:52:52 +0800

2024 Dcard Backend Intern Assignment

2024 TSMC Summer Intern Interview

jasonliu@apache.org (Jason(Zhe-You) Liu) — Fri, 20 Sep 2024 10:48:57 +0800

2024 TSMC Summer Intern Interview

2024 Dcard Summer Intern Interview

jasonliu@apache.org (Jason(Zhe-You) Liu) — Fri, 20 Sep 2024 10:48:53 +0800

2024 Dcard Summer Intern Interview

2024 Appier Summer Intern Interview

jasonliu@apache.org (Jason(Zhe-You) Liu) — Fri, 20 Sep 2024 10:48:47 +0800

2024 Appier Summer Intern Interview

2024 Software Summer Intern Interview

jasonliu@apache.org (Jason(Zhe-You) Liu) — Thu, 19 Sep 2024 14:20:45 +0800

2024 Software Summer Intern Interview - Appier / Dcard / TSMC

Resolve `psycopg2` Install Error on MacOS

jasonliu@apache.org (Jason(Zhe-You) Liu) — Fri, 13 Sep 2024 15:48:30 +0800

Resolve psycopg2 Install Error on MacOS

Why Choose PGMQ? Implementing ACID Transactional Message Queues in PostgreSQL

jasonliu@apache.org (Jason(Zhe-You) Liu) — Wed, 03 Jul 2024 21:46:28 +0800

When your architecture only involves Postgres, why introduce an additional MQ? This article explores the advantages of PGMQ for lightweight asynchronous tasks, teaches you how to deploy it quickly with Docker, and integrates it into Python projects.

Hugo Functions: Get Slice From Specific Range

jasonliu@apache.org (Jason(Zhe-You) Liu) — Sat, 22 Jun 2024 22:06:42 +0800

How to get a slice from a specific range in Hugo?

Redis Persistence: RDB and AOF

jasonliu@apache.org (Jason(Zhe-You) Liu) — Tue, 18 Jun 2024 23:10:43 +0800

Detailed explanation of Redis persistence settings: RDB and AOF. Pros and cons of RDB and AOF. Detailed implementation with Redis source code.

How to use Transaction in SqlAlchemy

jasonliu@apache.org (Jason(Zhe-You) Liu) — Sun, 16 Jun 2024 22:12:17 +0800

How to transaction in SqlAlchemy

Python: Read File(BinaryIO) Multiple Time

jasonliu@apache.org (Jason(Zhe-You) Liu) — Fri, 14 Jun 2024 23:43:15 +0800

Read file (BinaryIO) multiple time in Python. Solution to prevent empty content in the second read.

PgBouncer: Lightweight Postgres Connection Pool

jasonliu@apache.org (Jason(Zhe-You) Liu) — Sun, 09 Jun 2024 11:36:24 +0800

Solving Django backend DB connection overload with PgBouncer

Cloudflare Tunnel

jasonliu@apache.org (Jason(Zhe-You) Liu) — Tue, 28 May 2024 17:27:04 +0800

Setup Cloudflare Tunnel for NAT, an alternative to Ngrok

Tmux Cheat Sheet

jasonliu@apache.org (Jason(Zhe-You) Liu) — Tue, 28 May 2024 16:44:08 +0800

Common tmux commands Cheat Sheet

FastAPI: Mock S3 with Moto

jasonliu@apache.org (Jason(Zhe-You) Liu) — Tue, 28 May 2024 15:47:01 +0800

FastAPI Testing: Mock AWS S3 Boto3 With Moto

k8s: Extract Configmap or Secret to Env File

jasonliu@apache.org (Jason(Zhe-You) Liu) — Tue, 28 May 2024 14:39:15 +0800

Kubernetes Cheat Sheet: Extract ConfigMap or Secret to .env file

NCKU CSIE Freshman First Semester

jasonliu@apache.org (Jason(Zhe-You) Liu) — Fri, 23 Jun 2023 15:32:12 +0800

What did I do in the first semester of freshman year?