Subscribe
Sign in
Home
🧑💻 Become a DE
🔍 Deep Dive
⭐ Tech Stack
🚀 Growth
🗃️ Archive
❓ About
Latest
Top
Discussions
How Delta UniForm works
Learn how Delta UniForm enables read and write interoperability from Delta tables to Iceberg and Hudi formats.
Mar 7
•
Junaid Effendi
4
1
February 2026
Coinbase Data Tech Stack
See what Coinbase use in the backend to handle big data that processes billions of data every day for their 120 million plus users.
Feb 7
12
2
January 2026
Inside Data Engineering with Hasan Geren
Follow Hasan Geren as he explores the landscape of data engineering, offering insights, tackling challenges, and highlighting emerging industry trends.
Jan 10
•
Junaid Effendi
and
Hasan Geren
12
2
2
December 2025
Solving Spark’s Small File Problem for 100x Faster Reads
Understand the Spark common small file problem, learn how to solve in the modern open table formats through offline and online optimizations.
Dec 6, 2025
•
Junaid Effendi
17
2
3
November 2025
Shopify Data Tech Stack
Explore what tech stack is used at Shopify to process 284 million peak requests per minute generating $11+ billions in sales.
Nov 8, 2025
•
Junaid Effendi
10
4
2
October 2025
Inside Data Engineering with Erfan Hesami
Join Erfan Hesami as he shares his experience in the world of data engineering, offering insights, exploring challenges, and highlighting emerging…
Oct 11, 2025
•
Junaid Effendi
and
Erfan Hesami
13
3
September 2025
How Delta Lake Works
Understand how Delta Lake handles reads and writes using the transaction log, ensuring ACID guarantees through snapshot isolation and optimistic…
Sep 6, 2025
•
Junaid Effendi
18
4
1
August 2025
Spotify Data Tech Stack
Learn how Spotify ingests 1.4T+ events daily on GCP via 38K+ data pipelines, leveraging BigQuery, Dataflow, and Flyte to power ~5K dashboards and scale…
Aug 16, 2025
•
Junaid Effendi
22
2
July 2025
Inside Data Engineering with Julien Hurault
Consultant Julien Hurault takes you inside the world of data engineering, sharing practical insights, real-world challenges, and his perspective on…
Jul 26, 2025
•
Junaid Effendi
and
Julien Hurault
20
2
1
Benchmarking Spark - Open Source vs EMRs
Diving into four approaches from Spark Operator to EMR (EKS, EC2, and Serverless), sharing benchmarking results and key insights to help you choose the…
Jul 5, 2025
•
Junaid Effendi
5
2
2
June 2025
Snapchat Data Tech Stack
Learn how Snapchat ingests ~2 trillions of events per day using Google Cloud Platform.
Jun 7, 2025
•
Junaid Effendi
26
2
May 2025
Inside Data Engineering with Daniel Beach
Veteran data engineer Daniel Beach takes you inside the world of data engineering, sharing hard-earned insights, day-to-day challenges, and what’s on…
May 24, 2025
•
Junaid Effendi
and
Daniel Beach
16
3
This site requires JavaScript to run correctly. Please
turn on JavaScript
or unblock scripts