#dataengineering ผลการค้นหา
Finally deployed the new data pipeline. Named it ‘HOPE.’ Because every run starts with optimism and ends with debugging. Here’s to clean data, stable flows, and fewer 2 AM validations. #DataEngineering #ETL #TechHumor
#DataEngineering Best Practices — Architect robust and cost-effective data solutions in the cloud era: amzn.to/3BkZ6df v/ @PacktDataML 𝓚𝓮𝔂 𝓕𝓮𝓪𝓽𝓾𝓻𝓮𝓼: 🟠 Architect and engineer optimized data solutions in the cloud with best practices for performance and…
While men Sleep … At least when the NEPs allow me to 😂😂😂… I’m grinding. I’m doing everything within my power to turn my story… I cannot fail oh #Datafam #Dataengineering
Day 36/180 Started exploring more on Kafka Producer side.. Need to do better with my time management skills😅 #DataEngineering #apachekafka
#DataEngineering with Scala and Spark — Build streaming & batch pipelines to process massive amounts of data: amzn.to/3wdmEhy v/ @PacktDataML 𝒦𝑒𝓎 𝐹𝑒𝒶𝓉𝓊𝓇𝑒𝓈: 🔴Transform data into a clean and trusted source of information for your organization using Scala…
Just dropped my Airflow + PostgreSQL ETL pipeline Modular DAGs, CLI validation, and reproducible workflows — all built from scratch. Check it out 👇 github.com/mainamuragev/a… @LuxDevHQ @HarunMbaabu #DataEngineering
Columnar DB + JSON already sounds impossible… Yet @ClickHouseDB hits ~9,000× Postgres and ~2,500× Mongo, with columnar benefits intact (vectorized exec, compression, data skipping) #DataEngineering #ClickHouse
The simpler the semantic model, the simpler everything else becomes. It must be number one, even if just for reports. This is why most are building lakehouses to drive and communicate information. #dataengineering #datamodeling youtube.com/watch?v=sC1B5s…
🚀 Master Apache Spark with these Top 10 commands every Data Engineer needs! 📊 buff.ly/El2cebY #ApacheSpark #BigData #DataEngineering #Programming #Python #100DaysOfCode
We did a thing: three amazing data engineers and I answered the 10 most-asked questions on r/dataengineering. These genuine insights help you understand the current state of #dataengineering. Obviously, I'm biased since I pulled together the questions & answered them myself.
Data folks, don’t rush to scale. First, just make it work. Get that data flowing end-to-end. Then, make it right. Clean up, add checks, make it solid. Only after that, make it scale. #Data #DataEngineering
Maximize Snowflake performance & slash query time⚡ Even a 1-second delay = ~2.11% lower conversions 📉 ✅ Faster queries ✅ Lower compute cost ✅ Smarter data pipelines ✅ Agile analytics Full Snowflake tuning guide ⬇️ bit.ly/43QK8Xc #Snowflake #DataEngineering
🚀 Discover the top Data Engineering tools enterprises are adopting globally! 📊 buff.ly/jnnNs33 #DataEngineering #BigData #ApacheSpark #DataScience #Python #AI #100DaysOfCode
Register to the Subsurface #DataLakehouse Conference in NYC on November 13 #DataEngineering Register dremio.com/subsurface
🚀 Is your data warehouse slowing down dashboards & decisions? Before rebuilding, try targeted optimization. 👉 9 key strategies to cut costs & boost speed: schema, ETL, queries, compute & more. Read the guide ➡️ bit.ly/4qzcFdS #DataWarehouse #DataEngineering
Your AI's on a Junk Food Diet: Let's Fix Its Data Nutrition Data Quality, DataOps, and Large Language Models hubs.ly/Q03S5btJ0 #dataengineering #dataquality #opensource #dataobservability #dataops
Register for Subsurface NYC November 13th (Free) Talks on Agentic AI, Apache Iceberg, Apache Polaris, Apache Arrow, Data Lakehouses and much more! Details in Comments #DataLakehouse #DataEngineering #AgenticAI
Quality Assurance is transforming into Data Quality Engineering — a shift that places data at the center of reliable AI and data-driven systems. 🔗 Read the full article by Federico Silva in the link below #DataQuality #QualityAssurance #DataEngineering
I’m excited to have contributed both as an organizer and a panelist at the first ever Data Engineering Community @data_dec meetup. #DataEngineering #DECMeetUp2025 #DECLagosMeetUp2025 #BigData #CommunityBuilding #DataEngineerCommunity
Finally deployed the new data pipeline. Named it ‘HOPE.’ Because every run starts with optimism and ends with debugging. Here’s to clean data, stable flows, and fewer 2 AM validations. #DataEngineering #ETL #TechHumor
⚡New blog out! #Spark Streaming vs Structured Streaming — The Evolution of Real-Time Data in Apache Spark🚀From micro-batches to continuous processing — see how Spark unified batch & streaming into one API. 🔗thedataforge.medium.com/spark-streamin… #StructuredStreaming #DataEngineering #BigData
🚀 Master Apache Spark with these Top 10 commands every Data Engineer needs! 📊 buff.ly/El2cebY #ApacheSpark #BigData #DataEngineering #Programming #Python #100DaysOfCode
🚀 Dados estão para IA assim como combustível está para foguetes. Sem dados limpos e bem estruturados, até o melhor modelo vira fumaça. Antes de perseguir o próximo hype, aprenda a engenharia de dados na veia. #DataEngineering #IA #TechTips ☕📊
The result is a distributed yet governed ecosystem that accelerates digital initiatives, reduces rework, and ensures sustainable scale without technical silos. Learn more at rtctek.com/data-engineeri… #rtctek #dataengineering #datamesh #dataproducts #clouddata #dataarchitecture
Day 1 of my #SQL journey 🚀 I’m learning SQL as my first step toward becoming a Data Engineer. What I learned today: What a database is Types of databases (Relational & NoSQL) Installed SQL Server & SSMS Let’s see where this data path leads 💪 #DataEngineering #LearnInPublic
This tool from SpiceNet isn’t just another “data tool”—it’s a game-changer for anyone who needs fast,here: spicenet.io/blogs/spice-fl… curious to hear what pain points Spice Flow could solve for you. #DataEngineering #MachineLearning #DataInfrastructure #SpiceNet #SpiceFlow
This tool from SpiceNet isn’t just another “data tool”—it’s a game-changer for anyone who needs fast, here:spicenet.io/blogs/spice-fl… curious to hear what pain points Spice Flowcouldsolveforyou.#DataEngineering #MachineLearning #DataInfrastructure #SpiceNet #SpiceFlow
Financial data engineering isn't just ETL — it's turning chaotic market feeds into alpha. Real-time pipelines >>> batch jobs. Who's with me? #FinDataEng #DataEngineering
Your AI is only as good as the pipeline feeding it. If your data flow is messy, inconsistent, or slow, your insights will be too. Modern data pipelines do more than move data: they clean, enrich, and transform it in real-time. #DataEngineering #AI #CloudArchitecture #CloudData
Data chaos ends here. With Datawoz, your entire data flow — from ingestion to export — runs like clockwork. ⚡ Ingest → Process → Verify → Automate → Export One platform. Zero friction. Full control. #DataEngineering #ETL #Automation
🚀 Getting Started with Apache Spark A complete beginner’s guide to mastering Big Data processing and Spark fundamentals 💡 👉 Read now: buff.ly/5E81BAF #ApacheSpark #BigData #DataEngineering #Hadoop #TechTips #Coding #MachineLearning
🚀 Engenharia de dados não é só pipeline e SQL. É entender o negócio, escolher a arquitetura certa e garantir dados confiáveis para IA entregar valor real. Se seus modelos falham, olhe antes para sua base. 🧱 #DataEngineering #AI #TechInsights #BI #DataScience
弊社、20年の歴史があり、膨大なデータをこれからどう活用していくか、事業と開発がタッグになって模索してます！積極採用中です！ / Tableau「DATA Saber」が考える初心者向けSnowflake勉強法 - SEN PRODUCT BLOG productblog.sencorp.co.jp/entry/2025/11/… #Snowflake #DataEngineering #DataAnalysisTools
さわ（@data_and_cat ）さんが執筆したブログが公開されました！ ぜひご覧くださいませ✨ Tableau「DATA Saber」が考える初心者向けSnowflake勉強法 - SEN PRODUCT BLOG productblog.sencorp.co.jp/entry/2025/11/… #Snowflake #DataEngineering #DataAnalysisTools
SQL is not just a query language — It’s the foundation of every data job. Master SQL, and you master data. #SQL #DataAnalytics #DataEngineering #TechSkills
#DataEngineering #BigData #Spark Built a tool that analyzes Spark/Kafka errors with AI. Data engineers - want to test it and give feedback? DM me for link.
🚀 Engenharia de dados + IA não é só sobre tecnologia, é sobre entender pessoas e transformar dados em decisões que impactam vidas. O segredo? Menos hype, mais contexto. Quer exemplos reais? Vamos debater! 💡 #DataEngineering #IA #TechComPropósito #FuturoDosDados
Your AI's on a Junk Food Diet: Let's Fix Its Data Nutrition Data Quality, DataOps, and Large Language Models hubs.ly/Q03S5btJ0 #dataengineering #dataquality #opensource #dataobservability #dataops
Finally deployed the new data pipeline. Named it ‘HOPE.’ Because every run starts with optimism and ends with debugging. Here’s to clean data, stable flows, and fewer 2 AM validations. #DataEngineering #ETL #TechHumor
Just open-sourced my ELT pipeline template! Perfect for anyone learning modern data engineering or needing a quick CSV → Snowflake solution Built with dlt + Python. Stars ⭐ appreciated! github.com/bellonbits/Sal… #OpenSource #dataengineering
While men Sleep … At least when the NEPs allow me to 😂😂😂… I’m grinding. I’m doing everything within my power to turn my story… I cannot fail oh #Datafam #Dataengineering
The goal is to be too good to be ignored… While men sleep 🙇♂️🙇♂️ 2:00 AM check in. Who’s up?? #Datafam #DataEngineeringStudy #Dataengineering
Day 36/180 Started exploring more on Kafka Producer side.. Need to do better with my time management skills😅 #DataEngineering #apachekafka
Data folks, don’t rush to scale. First, just make it work. Get that data flowing end-to-end. Then, make it right. Clean up, add checks, make it solid. Only after that, make it scale. #Data #DataEngineering
In 2025, data engineers need a mix of classic & emerging skills: Python & Scala, Apache Spark & Kafka, SQL & NoSQL, AI-powered tools like GitHub Copilot, and Large Language Models (LLMs) for automation. #DataEngineering #AI it.exchange/blog/5-essenti…
#DataEngineering Best Practices — Architect robust and cost-effective data solutions in the cloud era: amzn.to/3BkZ6df v/ @PacktDataML 𝓚𝓮𝔂 𝓕𝓮𝓪𝓽𝓾𝓻𝓮𝓼: 🟠 Architect and engineer optimized data solutions in the cloud with best practices for performance and…
🚀 Discover the top Data Engineering tools enterprises are adopting globally! 📊 buff.ly/jnnNs33 #DataEngineering #BigData #ApacheSpark #DataScience #Python #AI #100DaysOfCode
Curiosity led me to explore the role of LLMs in data engineering and it turns out they’re revolutionizing pipelines! Check out the full story here: betheldaniel332.medium.com/how-llms-are-r… What’s your take on LLMs in data stacks?#DataEngineering #LLMs #AI
Transformations are the real heart of the data stack - and dbt made us finally treat them that way. The golden age of dbt isn't about tooling - it's about trust. Link to the full blog post: luminousmen.substack.com/p/the-golden-a… #dataengineering #bigdata
#DataEngineering with Google Cloud Platform #GCP — A Guide to leveling up as a #DataEngineer by building a scalable data platform with Google Cloud: amzn.to/4ecMUtM [2nd Edition] v/ @PacktDataML ————— #DataAnalytics #Analytics #CDO #CTO #AI #ML #MLOps #DataScience
![KirkDBorne's tweet image. #DataEngineering with Google Cloud Platform #GCP — A Guide to leveling up as a #DataEngineer by building a scalable data platform with Google Cloud: amzn.to/4ecMUtM [2nd Edition] v/ @PacktDataML
—————
#DataAnalytics #Analytics #CDO #CTO #AI #ML #MLOps #DataScience](https://pbs.twimg.com/media/G3RnizZXAAAh17C.jpg)
Monday's #DataEngineering CI/CD workshop #MicrosoftFabric: so much interest we ran out of credentials for unregistered attendees 🔥Watching teams go from "CI/CD seems complicated" to building working fabric-cli pipelines in one session = why hands-on workshops work.
Quality Assurance is transforming into Data Quality Engineering — a shift that places data at the center of reliable AI and data-driven systems. 🔗 Read the full article by Federico Silva in the link below #DataQuality #QualityAssurance #DataEngineering
You had me at “unlimited API calls” Try it for free now 👉 ipinfo.io/lite #IPdata #DevTools #DataEngineering
#DataEngineering with Scala and Spark — Build streaming & batch pipelines to process massive amounts of data: amzn.to/3wdmEhy v/ @PacktDataML 𝒦𝑒𝓎 𝐹𝑒𝒶𝓉𝓊𝓇𝑒𝓈: 🔴Transform data into a clean and trusted source of information for your organization using Scala…
I’m excited to have contributed both as an organizer and a panelist at the first ever Data Engineering Community @data_dec meetup. #DataEngineering #DECMeetUp2025 #DECLagosMeetUp2025 #BigData #CommunityBuilding #DataEngineerCommunity
Achieve the best #pricePerformance for your #DataEngineering workloads in #microsoftFabric by enabling #NativeEngine @JustynaLucznik #bestSparkOnAzure #NativeEngine #fabconEU
Does Oracle get emotionally attached before splitting strings apart? Source: devhubby.com/thread/how-to-… #SQL #DataEngineering #Programming #OraclePLSQL #explore #oracle
Something went wrong.
Something went wrong.
United States Trends
- 1. $PUFF N/A
- 2. Good Friday 44.9K posts
- 3. $apdn $0.20 applied dna N/A
- 4. $SENS $0.70 Senseonics CGM N/A
- 5. $LMT $450.50 Lockheed F-35 N/A
- 6. #FridayVibes 3,317 posts
- 7. Happy Friyay N/A
- 8. #FridayFeeling 2,030 posts
- 9. #PitchYaGame N/A
- 10. Publix 1,158 posts
- 11. RED Friday 2,772 posts
- 12. #FursuitFriday 8,592 posts
- 13. Finally Friday 3,596 posts
- 14. yeonjun 302K posts
- 15. #CARTMANCOIN 2,017 posts
- 16. Blockchain 203K posts
- 17. Elise Stefanik 2,596 posts
- 18. John Wayne 1,325 posts
- 19. Kehlani 13.9K posts
- 20. Out The Window 11.3K posts