Archive - Junaid Effendi | Sharing knowledge for Engineers

Snapchat Data Tech Stack

Learn how Snapchat ingests ~2 trillions of events per day using Google Cloud Platform.

Jun 7 •

May 2025

Inside Data Engineering with Daniel Beach

Veteran data engineer Daniel Beach takes you inside the world of data engineering, sharing hard-earned insights, day-to-day challenges, and what’s on…

May 24 •

and

Data Governance in Lakehouse Using Open Source Tools

Discover how to build a complete data governance ecosystem in a Lakehouse architecture using leading open-source tools. Explore access control, metadata…

May 10 •

April 2025

DoorDash Data Tech Stack

Learn about the Data Tech Stack used by DoorDash to process hundreds of Terabytes of data every day.

Apr 26 •

Inside Data Engineering with Vu Trinh

Join Vu Trinh as he navigates the world of data engineering, sharing insights, challenges, and emerging industry trends.

Apr 5 •

and

March 2025

Securely Share and Automate File Transfers with AWS Transfer Family & Terraform

Learn to deploy a secure, automated SFTP server with AWS Transfer Family & Terraform. Set up restricted users, enforce SSH & MFA, and leverage workflows…

Mar 22 •

Meta Data Tech Stack

Learn what data tech stack Meta leverages to process and store massive amount of data every day in their data centers.

Mar 8 •

February 2025

Inside Data Engineering with Yordan Ivanov

Join Yordan Ivanov as he demystifies data engineering, clarifying misconceptions about the role.

Feb 26 •

and

7 Ways to Share Knowledge for Continuous Learning

This article outlines seven effective approaches to sharing knowledge, helping you become a better engineer and a team player while fostering continuous…

Feb 15 •

Six Effective Ways to Reduce Compute Costs

Lets look into the top six ways that can help reducing your compute costs on AWS.

Feb 1 •

January 2025

How I was able to get promoted while constant reorganization

This engineer went from Mid to Senior while constant changes across the org!

Published on Engineering Leadership • Jan 27

Pinterest Data Tech Stack

Read how Pinterest leverages multiple data technologies for exabyte scale data lake.

Jan 18 •

#nojs-banner { position: fixed; bottom: 0; left: 0; padding: 16px 16px 16px 32px; width: 100%; box-sizing: border-box; background: red; color: white; font-family: -apple-system, "Segoe UI", Roboto, Helvetica, Arial, sans-serif, "Apple Color Emoji", "Segoe UI Emoji", "Segoe UI Symbol"; font-size: 13px; line-height: 13px; } #nojs-banner a { color: inherit; text-decoration: underline; } This site requires JavaScript to run correctly. Please turn on JavaScript or unblock scripts