articles
Deep dives into data engineering, distributed systems, and backend architecture.
GC pressure is the most misdiagnosed failure in Spark, and the one most often ‘fixed’ by adding heap, which usually makes it worse. Here is where to look in the UI and the logs, how to tell it apart from data …
A short tour of what this site is, the problems I write about, and how to get the most out of the cheatsheets.
Most Spark tuning guides teach it backwards. Here’s the data-first approach that production engineers actually use, with visual flows and concrete math.
GC Pressure in Spark: How to Find It, Read It, and Actually Fix It
Oct 12, 2026 · New Article
Welcome to the Field Notes
Oct 11, 2026 · New Article
The Real Math Behind PySpark Resource Sizing
Oct 11, 2026 · New Article
The Ultimate SQL Cheatsheet
Oct 11, 2026 · Cheatsheet Updated
Apache Airflow
Oct 11, 2026 · Cheatsheet Updated