data_weekly's profile picture. Weekly Data Engineering Newsletter. Subscribe to http://www.dataengineeringweekly.com | Wanna talk about Data engineering? Book Me here http://calendly.com/apackkildurai

Data Engineering Weekly

@data_weekly

Weekly Data Engineering Newsletter. Subscribe to http://www.dataengineeringweekly.com | Wanna talk about Data engineering? Book Me here http://calendly.com/apackkildurai

This is the most personal essay that I have written in Data Engineering Weekly. I shared a few key moments in my life and how fortunate I was to meet mentors along my professional journey, which shaped my career. dataengineeringweekly.com/p/thinking-lik…


🚀 Data Vault vs. Dimensional Modeling vs. Medallion Architecture — When viewed through a modern enterprise data lens, these techniques interlock. I break down how in Part 2 of my “Revisiting the Medallion Architecture” series. dataengineeringweekly.com/p/revisiting-m…


As a data engineer, you can't treat zero-party (consent) and third-party (inferred) data the same way. This distinction is critical for building systems that are scalable, private, and trustworthy. Here’s my guide: dataengineeringweekly.com/p/engineering-…


The 238th edition of Data Engineering Weekly is available, featuring exciting Data & AI articles. Read more: dataengineeringweekly.com/p/data-enginee…

data_weekly's tweet image. The 238th edition of Data Engineering Weekly is available, featuring exciting Data & AI articles.

Read more: 
dataengineeringweekly.com/p/data-enginee…

For years, I've been a skeptic of the Medallion Architecture naming convention. However, despite my initial reservations about the naming, I have come to appreciate the value of a bounded definition. I've shared my thoughts on Medallion Architecture. dataengineeringweekly.com/p/revisiting-m…


The 234th edition is out with the latest trends and thoughts in Data Engineering.

data_weekly's tweet image. The 234th edition is out with the latest trends and thoughts in Data Engineering.

I just apologized to my Claude Code. It truly deserves sympathy—stuck untangling a Jackson dependency issue that no AI should ever have to endure. Some battles are timeless, and Jackson always finds a way to remind us.


The 233rd edition of Data Engineering Weekly is out. dataengineeringweekly.com/p/data-enginee…

data_weekly's tweet image. The 233rd edition of Data Engineering Weekly is out.
dataengineeringweekly.com/p/data-enginee…

Data Engineering Weekly reposted

Dimensional Modeling or data vault, which one is better? Property graph vs RDF, which one is best for metadata? All these techniques are defined for human-in-the-loop. The goal of a DW is to provide accurate metrics in a timely fashion. Do we still model the data for humans?

ananthdurai's tweet image. Dimensional Modeling or data vault, which one is better? Property graph vs RDF, which one is best for metadata? All these techniques are defined for human-in-the-loop. The goal of a DW is to provide accurate metrics in a timely fashion. Do we still model the data for humans?

🎙️ New DEW pod: Bauplan CTO Jacopo Tagliabue on function-native pipelines, immutable versioning, Arrow-powered speed, and why vertical > horizontal for most 10–100 GB jobs. Apple:podcasts.apple.com/us/podcast/ins… Spotify:open.spotify.com/episode/5xebhI… Substack:dataengineeringweekly.com/p/insights-fro…


Data Engineering Weekly reposted

The 230th edition of Data Engineering Weekly is out!! Read more dataengineeringweekly.com/p/data-enginee…

ananthdurai's tweet image. The 230th edition of Data Engineering Weekly is out!! Read more
dataengineeringweekly.com/p/data-enginee…

Data Engineering Weekly reposted

What do you think of a system of agents? What would be the impact of the system of agents system design in Data Engineering? dataengineeringweekly.com/p/data-enginee…


Loading...

Something went wrong.


Something went wrong.