Subscribe
Sign in
Home
š§āš» Become a DE
š Deep Dive
ā Tech Stack
š Growth
šļø Archive
ā About
How Delta UniFormĀ works
Learn how Delta UniForm enables read and write interoperability from Delta tables to Iceberg and Hudi formats.
Mar 7
Ā
ā¢
Ā
Junaid Effendi
4
1
Latest
Top
Discussions
Coinbase Data Tech Stack
See what Coinbase use in the backend to handle big data that processes billions of data every day for their 120 million plus users.
Feb 7
12
2
Inside Data Engineering with Hasan Geren
Follow Hasan Geren as he explores the landscape of data engineering, offering insights, tackling challenges, and highlighting emerging industry trends.
Jan 10
Ā
ā¢
Ā
Junaid Effendi
Ā andĀ
Hasan Geren
12
2
2
Solving Sparkās Small File Problem for 100x Faster Reads
Understand the Spark common small file problem, learn how to solve in the modern open table formats through offline and online optimizations.
Dec 6, 2025
Ā
ā¢
Ā
Junaid Effendi
17
2
3
Shopify Data Tech Stack
Explore what tech stack is used at Shopify to process 284 million peak requests per minute generating $11+ billions in sales.
Nov 8, 2025
Ā
ā¢
Ā
Junaid Effendi
10
4
2
Inside Data Engineering with Erfan Hesami
Join Erfan Hesami as he shares his experience in the world of data engineering, offering insights, exploring challenges, and highlighting emergingā¦
Oct 11, 2025
Ā
ā¢
Ā
Junaid Effendi
Ā andĀ
Erfan Hesami
13
3
How Delta Lake Works
Understand how Delta Lake handles reads and writes using the transaction log, ensuring ACID guarantees through snapshot isolation and optimisticā¦
Sep 6, 2025
Ā
ā¢
Ā
Junaid Effendi
18
4
1
Spotify Data Tech Stack
Learn how Spotify ingests 1.4T+ events daily on GCP via 38K+ data pipelines, leveraging BigQuery, Dataflow, and Flyte to power ~5K dashboards and scaleā¦
Aug 16, 2025
Ā
ā¢
Ā
Junaid Effendi
22
2
See all
Junaid Effendi | Sharing knowledge for Engineers
Covering tech, career, data, growth experiences from my journey.
Subscribe
Recommendations
View all 13
VuTrinh.
Vu Trinh
Data Gibberish
Yordan Ivanov
DataExpert.io Newsletter
Zach Wilson
Engineering At Scale
Animesh Gaitonde
Leadership Letters
Akash Mukherjee
Junaid Effendi | Sharing knowledge for Engineers
Subscribe
About
Archive
Recommendations
Sitemap
This site requires JavaScript to run correctly. Please
turn on JavaScript
or unblock scripts
