#dataengineering resultados de búsqueda

You fix a sync issue, close the ticket, and then see it pop up again three weeks later in a diff. system. Most infrastructure treats each problem as a one-off. Syntes learns the pattern and applies the fix across your systems. Short demo: hubs.li/Q03VgYJ50 #DataEngineering

SyntesAi's tweet image. You fix a sync issue, close the ticket, and then see it pop up again three weeks later in a diff. system. Most infrastructure treats each problem as a one-off. Syntes learns the pattern and applies the fix across your systems. Short demo: hubs.li/Q03VgYJ50
#DataEngineering

Maximize Snowflake performance & slash query time⚡ Even a 1-second delay = ~2.11% lower conversions 📉 ✅ Faster queries ✅ Lower compute cost ✅ Smarter data pipelines ✅ Agile analytics Full Snowflake tuning guide ⬇️ bit.ly/43QK8Xc #Snowflake #DataEngineering

AegisSoftTech's tweet image. Maximize Snowflake performance & slash query time⚡

Even a 1-second delay = ~2.11% lower conversions 📉

✅ Faster queries
✅ Lower compute cost
✅ Smarter data pipelines
✅ Agile analytics

Full Snowflake tuning guide ⬇️
bit.ly/43QK8Xc

#Snowflake #DataEngineering

Ever wondered how Netflix or Amazon handle millions of events every second, all in real time? The secret is event streams, smart processing, and rock solid data pipelines. Here’s a simple breakdown for devs. #DataEngineering #SystemDesign #bigdata

VirendraCodes's tweet image. Ever wondered how Netflix or Amazon handle millions of events every second, all in real time?
The secret is event streams, smart processing, and rock solid data pipelines.
Here’s a simple breakdown for devs.
#DataEngineering #SystemDesign #bigdata

Data engineering in Databricks, then Fabric for lake houses and reporting? It depends on your company, but a consolidation effort is happening to move main data systems to the cloud. #DataEngineering #Cloud youtube.com/watch?v=0XgHB0…


🌊 The Rise of Data Lakehouses Discover how Apache Spark is transforming Big Data, bridging data lakes & warehouses, & shaping the future of analytics🚀 👉 Read more: buff.ly/DLcpBmK #BigData #ApacheSpark #DataEngineering #Analytics #Hadoop #MachineLearning #TechTrends

bigdata_engnr's tweet image. 🌊 The Rise of Data Lakehouses
Discover how Apache Spark is transforming Big Data, bridging data lakes & warehouses, &  shaping the future of analytics🚀

👉 Read more: buff.ly/DLcpBmK

#BigData #ApacheSpark #DataEngineering #Analytics #Hadoop #MachineLearning #TechTrends

1/ Let’s talk about Data Lakes and why they’re very important for AI. As a solutions architect, I’ve seen how the right data setup helps AI work better. Here’s a simple thread explaining it! 👇 #DataLakes #AI #DataEngineering

swapnilpopat's tweet image. 1/ Let’s talk about Data Lakes and why they’re very important for AI. As a solutions architect, I’ve seen how the right data setup helps AI work better. Here’s a simple thread explaining it! 👇 #DataLakes #AI #DataEngineering

🚀 Launching Supermetal — data replication that just works. Sync databases to warehouses in real-time or batch — no Kafka, no JVM, no Debezium. Built in Rust & Apache Arrow. Try it → trial.supermetal.io Launch post → supermetal.io/blog/launch #dataengineering #rustlang


#DataEngineering Best Practices — Architect robust and cost-effective data solutions in the cloud era: amzn.to/3BkZ6df v/ @PacktDataML 𝓚𝓮𝔂 𝓕𝓮𝓪𝓽𝓾𝓻𝓮𝓼: 🟠 Architect and engineer optimized data solutions in the cloud with best practices for performance and…

KirkDBorne's tweet image. #DataEngineering Best Practices — Architect robust and cost-effective data solutions in the cloud era: amzn.to/3BkZ6df v/ @PacktDataML

𝓚𝓮𝔂 𝓕𝓮𝓪𝓽𝓾𝓻𝓮𝓼:
🟠 Architect and engineer optimized data solutions in the cloud with best practices for performance and…

𝐃𝐚𝐭𝐚 𝐄𝐧𝐠𝐢𝐧𝐞𝐞𝐫𝐢𝐧𝐠 𝐯𝐬 𝐃𝐚𝐭𝐚 𝐒𝐜𝐢𝐞𝐧𝐜𝐞: 𝐇𝐨𝐰 𝐓𝐡𝐞𝐲 𝐈𝐧𝐭𝐞𝐫𝐫𝐞𝐥𝐚𝐭𝐞 𝐚𝐧𝐝 𝐃𝐢𝐟𝐟𝐞𝐫 Data engineers build the system. Data scientists find the story. Together, they turn data into direction. Read how they connect: #DataEngineering

analyticsinme's tweet image. 𝐃𝐚𝐭𝐚 𝐄𝐧𝐠𝐢𝐧𝐞𝐞𝐫𝐢𝐧𝐠 𝐯𝐬 𝐃𝐚𝐭𝐚 𝐒𝐜𝐢𝐞𝐧𝐜𝐞: 𝐇𝐨𝐰 𝐓𝐡𝐞𝐲 𝐈𝐧𝐭𝐞𝐫𝐫𝐞𝐥𝐚𝐭𝐞 𝐚𝐧𝐝 𝐃𝐢𝐟𝐟𝐞𝐫

Data engineers build the system. Data scientists find the story. Together, they turn data into direction. Read how they connect: 

#DataEngineering…

What's stopping you from reading the #dataengineering newsletter and the latest blog posts like this? These are my RSS feeds in the terminal on the left, and the feeds (queries), their URLs, and configs on the right.

sspaeti's tweet image. What's stopping you from reading the #dataengineering newsletter and the latest blog posts like this?

These are my RSS feeds in the terminal on the left, and the feeds (queries), their URLs, and configs on the right.

Data drives decisions. Efficiency powers progress. At #PyHo2025, @ce_akainettey explains how modern organizations harness data to engineer smarter, faster, and more impactful outcomes. Because efficiency isn’t accidental - it’s engineered. 🐍 #DataEngineering

PythonHo's tweet image. Data drives decisions. Efficiency powers progress.

At #PyHo2025, @ce_akainettey explains how modern organizations harness data to engineer smarter, faster, and more impactful outcomes.

Because efficiency isn’t accidental - it’s engineered. 🐍

#DataEngineering
PythonHo's tweet image. Data drives decisions. Efficiency powers progress.

At #PyHo2025, @ce_akainettey explains how modern organizations harness data to engineer smarter, faster, and more impactful outcomes.

Because efficiency isn’t accidental - it’s engineered. 🐍

#DataEngineering
PythonHo's tweet image. Data drives decisions. Efficiency powers progress.

At #PyHo2025, @ce_akainettey explains how modern organizations harness data to engineer smarter, faster, and more impactful outcomes.

Because efficiency isn’t accidental - it’s engineered. 🐍

#DataEngineering

If you’re not tracking these 3 metrics, your data pipelines might be lying to you 👀 ⚙️ Uptime % ⚙️ Throughput ⚙️ Data Quality Errors Measure it. Monitor it. Master it. #DataEngineering #TechCommunity #CILAcademy


Give a listen ... to the DataOps Data Quality TestGen Jingle 🎼🎵🎹🎶🎷 #dataengineering #dataquality #opensource


New video: Extract structured data from messy PDFs & documents using @databricks ai_parse_document() 🎥 ✨ Unstructured → Structured data 🤖 Powered by Foundation Model APIs 📄 No more manual extraction 👉 Watch the video (link in comments) #Databricks #AI #DataEngineering

mesudarshan's tweet image. New video: Extract structured data from messy PDFs & documents using @databricks ai_parse_document() 🎥

✨ Unstructured → Structured data
🤖 Powered by Foundation Model APIs
📄 No more manual extraction

👉 Watch the video (link in comments)

#Databricks #AI #DataEngineering

Eventhouse Endpoint lets you trigger downstream systems as soon as data lands. No more artificial delays from scheduling. React instantly as your data becomes available. #Lakehouse #DataEngineering youtube.com/watch?v=mLBPt5…


🚀 Discover the top Data Engineering tools enterprises are adopting globally! 📊 buff.ly/jnnNs33 #DataEngineering #BigData #ApacheSpark #DataScience #Python #AI #100DaysOfCode

bigdata_engnr's tweet image. 🚀 Discover the top Data Engineering tools enterprises are adopting globally! 📊 

buff.ly/jnnNs33 

#DataEngineering #BigData #ApacheSpark #DataScience #Python #AI #100DaysOfCode

Data Engineering that powers your business. ShilshaTech turns raw data into actionable insights with scalable pipelines and cloud-ready architecture. Smarter data. Stronger decisions. #DataEngineering #DataPipelines #CloudData #Analytics #AIReady #ShilshaTech

shilshatech's tweet image. Data Engineering that powers your business.

ShilshaTech turns raw data into actionable insights with scalable pipelines and cloud-ready architecture.
Smarter data. Stronger decisions.

#DataEngineering #DataPipelines #CloudData #Analytics #AIReady #ShilshaTech

BTC hit an all-time low yesterday, with a ~27% Drawdown in the last 90 days. made this dashboard pulling data via API (python) -> BigQuery -> Transformation, modeling - analysis (dbt) -> LookerStudio #BTC #datafam #dataengineering #CryptoMarket #CryptoTrading

RhaymanWaytt's tweet image. BTC hit an all-time low yesterday, with a ~27% Drawdown in the last 90 days.   made this dashboard pulling data via API (python) -> BigQuery -> Transformation, modeling - analysis (dbt) -> LookerStudio #BTC #datafam #dataengineering #CryptoMarket #CryptoTrading

Lección de hoy: Dejar de ser perfeccionista. Quería armar el proyecto perfecto, pero entiendo que es mejor empezar con algo y HACER. ✅ Resultado: Conexión lista. 🔜 Mañana: Limpieza y Transformación. Seguime para ver cómo avanza 👊 #DataEngineering #Python #UTN


You fix a sync issue, close the ticket, and then see it pop up again three weeks later in a diff. system. Most infrastructure treats each problem as a one-off. Syntes learns the pattern and applies the fix across your systems. Short demo: hubs.li/Q03VgYJ50 #DataEngineering

SyntesAi's tweet image. You fix a sync issue, close the ticket, and then see it pop up again three weeks later in a diff. system. Most infrastructure treats each problem as a one-off. Syntes learns the pattern and applies the fix across your systems. Short demo: hubs.li/Q03VgYJ50
#DataEngineering

Day 33 of Learning Data Engineering Today I learnt about Spark storage levels: Memory_only – keeps data in RAM. Memory_only_SER – RAM but serialized. Memory_and_Disk – spill extras to disk. *_SER – same but serialized. DISK_ONLY – store everything on disk. #DataEngineering #data


Data engineering in Databricks, then Fabric for lake houses and reporting? It depends on your company, but a consolidation effort is happening to move main data systems to the cloud. #DataEngineering #Cloud youtube.com/watch?v=0XgHB0…


Ready to take your #DataEngineering skills to the next level? At #BoozAllen, we're seeking innovative minds with Palantir experience to advance #DefenseTech. Join us to collaborate on impactful projects and drive real change. boozallen.co/43okrgH boozallen.co/44maUqJ


Day 6 of my SQL journey DML: DELETE vs TRUNCATE → Always use WHERE with DELETE → TRUNCATE clears the whole table & is faster Filtering with: → AND, OR, NOT → BETWEEN (inclusive range) SQL is starting to feel very logical #SQL #DataEngineering #LearnInPublic


🔥 Ran into a tiny SQL detail today that actually matters. Primary Key vs Unique Key Primary Key: unique, not NULL, only one. Unique Key: unique, can be NULL, multiple allowed. Small difference. Big impact. #SQL #DataEngineering #Learning


¿Vector DB para 32k embeddings? Probablemente estés pagando infra que no necesitas. Parquet + Polars = 1.48ms de búsqueda. Sin Docker. Sin config. Punto de quiebre: ~100k vectores. Para mas info, follow en LinkedIn: linkedin.com/in/soyomarvald… 🎯 #DataEngineering #MLOps


Input Data = Output Quality. Dev Log: Working on the _load_data() function. Simple file, huge reminder: Failed backtesting starts with Dirty Data. If you don't trust your data, you can't trust your trades. Clean it first. #DataEngineering #Quant #Python

BlockVantageAI's tweet image. Input Data = Output Quality.
Dev Log: Working on the _load_data() function.
Simple file, huge reminder: Failed backtesting starts with Dirty Data.
If you don't trust your data, you can't trust your trades. Clean it first.
#DataEngineering #Quant #Python

So what does this look like in practice? Here are the 3 approaches I keep coming back to in Databricks #Databricks #DataEngineering #SCD #DataBricksBasics #DataCleaning

databricksdaily's tweet image. So what does this look like in practice? Here are the 3 approaches I keep coming back to in Databricks 

#Databricks #DataEngineering #SCD #DataBricksBasics #DataCleaning

Ever had a source system change an ID halfway through a project and break all your joins? Happened to me last month… and it reminded me why surrogate keys are a lifesaver in Databricks. They give you one simple thing: a stable ID you can trust, no matter how chaotic the…



The goal is to be too good to be ignored… While men sleep 🙇‍♂️🙇‍♂️ 2:00 AM check in. Who’s up?? #Datafam #DataEngineeringStudy #Dataengineering

iam_daniiell's tweet image. The goal is to be too good to be ignored…

While men sleep 🙇‍♂️🙇‍♂️

2:00 AM check in. Who’s up??

#Datafam #DataEngineeringStudy  #Dataengineering
iam_daniiell's tweet image. The goal is to be too good to be ignored…

While men sleep 🙇‍♂️🙇‍♂️

2:00 AM check in. Who’s up??

#Datafam #DataEngineeringStudy  #Dataengineering
iam_daniiell's tweet image. The goal is to be too good to be ignored…

While men sleep 🙇‍♂️🙇‍♂️

2:00 AM check in. Who’s up??

#Datafam #DataEngineeringStudy  #Dataengineering
iam_daniiell's tweet image. The goal is to be too good to be ignored…

While men sleep 🙇‍♂️🙇‍♂️

2:00 AM check in. Who’s up??

#Datafam #DataEngineeringStudy  #Dataengineering

Ever wondered how Netflix or Amazon handle millions of events every second, all in real time? The secret is event streams, smart processing, and rock solid data pipelines. Here’s a simple breakdown for devs. #DataEngineering #SystemDesign #bigdata

VirendraCodes's tweet image. Ever wondered how Netflix or Amazon handle millions of events every second, all in real time?
The secret is event streams, smart processing, and rock solid data pipelines.
Here’s a simple breakdown for devs.
#DataEngineering #SystemDesign #bigdata

🚀 Is your data warehouse slowing down dashboards & decisions? Before rebuilding, try targeted optimization. 👉 9 key strategies to cut costs & boost speed: schema, ETL, queries, compute & more. Read the guide ➡️ bit.ly/4qzcFdS #DataWarehouse #DataEngineering

AegisSoftTech's tweet image. 🚀 Is your data warehouse slowing down dashboards & decisions?

Before rebuilding, try targeted optimization.

👉 9 key strategies to cut costs & boost speed: schema, ETL, queries, compute & more.

Read the guide ➡️ bit.ly/4qzcFdS

#DataWarehouse #DataEngineering

Maximize Snowflake performance & slash query time⚡ Even a 1-second delay = ~2.11% lower conversions 📉 ✅ Faster queries ✅ Lower compute cost ✅ Smarter data pipelines ✅ Agile analytics Full Snowflake tuning guide ⬇️ bit.ly/43QK8Xc #Snowflake #DataEngineering

AegisSoftTech's tweet image. Maximize Snowflake performance & slash query time⚡

Even a 1-second delay = ~2.11% lower conversions 📉

✅ Faster queries
✅ Lower compute cost
✅ Smarter data pipelines
✅ Agile analytics

Full Snowflake tuning guide ⬇️
bit.ly/43QK8Xc

#Snowflake #DataEngineering

While men Sleep … At least when the NEPs allow me to 😂😂😂… I’m grinding. I’m doing everything within my power to turn my story… I cannot fail oh #Datafam #Dataengineering

iam_daniiell's tweet image. While men Sleep …

At least when the NEPs allow me to 😂😂😂…

I’m grinding. I’m doing everything within my power to turn my story…

I cannot fail oh 

#Datafam #Dataengineering

You fix a sync issue, close the ticket, and then see it pop up again three weeks later in a diff. system. Most infrastructure treats each problem as a one-off. Syntes learns the pattern and applies the fix across your systems. Short demo: hubs.li/Q03VgYJ50 #DataEngineering

SyntesAi's tweet image. You fix a sync issue, close the ticket, and then see it pop up again three weeks later in a diff. system. Most infrastructure treats each problem as a one-off. Syntes learns the pattern and applies the fix across your systems. Short demo: hubs.li/Q03VgYJ50
#DataEngineering

#DataEngineering Best Practices — Architect robust and cost-effective data solutions in the cloud era: amzn.to/3BkZ6df v/ @PacktDataML 𝓚𝓮𝔂 𝓕𝓮𝓪𝓽𝓾𝓻𝓮𝓼: 🟠 Architect and engineer optimized data solutions in the cloud with best practices for performance and…

KirkDBorne's tweet image. #DataEngineering Best Practices — Architect robust and cost-effective data solutions in the cloud era: amzn.to/3BkZ6df v/ @PacktDataML

𝓚𝓮𝔂 𝓕𝓮𝓪𝓽𝓾𝓻𝓮𝓼:
🟠 Architect and engineer optimized data solutions in the cloud with best practices for performance and…

𝐃𝐚𝐭𝐚 𝐄𝐧𝐠𝐢𝐧𝐞𝐞𝐫𝐢𝐧𝐠 𝐯𝐬 𝐃𝐚𝐭𝐚 𝐒𝐜𝐢𝐞𝐧𝐜𝐞: 𝐇𝐨𝐰 𝐓𝐡𝐞𝐲 𝐈𝐧𝐭𝐞𝐫𝐫𝐞𝐥𝐚𝐭𝐞 𝐚𝐧𝐝 𝐃𝐢𝐟𝐟𝐞𝐫 Data engineers build the system. Data scientists find the story. Together, they turn data into direction. Read how they connect: #DataEngineering

analyticsinme's tweet image. 𝐃𝐚𝐭𝐚 𝐄𝐧𝐠𝐢𝐧𝐞𝐞𝐫𝐢𝐧𝐠 𝐯𝐬 𝐃𝐚𝐭𝐚 𝐒𝐜𝐢𝐞𝐧𝐜𝐞: 𝐇𝐨𝐰 𝐓𝐡𝐞𝐲 𝐈𝐧𝐭𝐞𝐫𝐫𝐞𝐥𝐚𝐭𝐞 𝐚𝐧𝐝 𝐃𝐢𝐟𝐟𝐞𝐫

Data engineers build the system. Data scientists find the story. Together, they turn data into direction. Read how they connect: 

#DataEngineering…

We did a thing: three amazing data engineers and I answered the 10 most-asked questions on r/dataengineering. These genuine insights help you understand the current state of #dataengineering. Obviously, I'm biased since I pulled together the questions & answered them myself.

sspaeti's tweet image. We did a thing: three amazing data engineers and I answered the 10 most-asked questions on r/dataengineering.

These genuine insights help you understand the current state of #dataengineering. Obviously, I'm biased since I pulled together the questions & answered them myself.

🌊 The Rise of Data Lakehouses Discover how Apache Spark is transforming Big Data, bridging data lakes & warehouses, & shaping the future of analytics🚀 👉 Read more: buff.ly/DLcpBmK #BigData #ApacheSpark #DataEngineering #Analytics #Hadoop #MachineLearning #TechTrends

bigdata_engnr's tweet image. 🌊 The Rise of Data Lakehouses
Discover how Apache Spark is transforming Big Data, bridging data lakes & warehouses, &  shaping the future of analytics🚀

👉 Read more: buff.ly/DLcpBmK

#BigData #ApacheSpark #DataEngineering #Analytics #Hadoop #MachineLearning #TechTrends

1/ Let’s talk about Data Lakes and why they’re very important for AI. As a solutions architect, I’ve seen how the right data setup helps AI work better. Here’s a simple thread explaining it! 👇 #DataLakes #AI #DataEngineering

swapnilpopat's tweet image. 1/ Let’s talk about Data Lakes and why they’re very important for AI. As a solutions architect, I’ve seen how the right data setup helps AI work better. Here’s a simple thread explaining it! 👇 #DataLakes #AI #DataEngineering

🚀 Discover the top Data Engineering tools enterprises are adopting globally! 📊 buff.ly/jnnNs33 #DataEngineering #BigData #ApacheSpark #DataScience #Python #AI #100DaysOfCode

bigdata_engnr's tweet image. 🚀 Discover the top Data Engineering tools enterprises are adopting globally! 📊 

buff.ly/jnnNs33 

#DataEngineering #BigData #ApacheSpark #DataScience #Python #AI #100DaysOfCode

AI Data Engineer On Board 🤖 We design, build & maintain data pipelines that power ML & analytics. 💡 Scalable. Reliable. Efficient. Learn more 👉 [career.elits.com] #AI #DataEngineering #MachineLearning #Analytics #ELITS

ElitsCanada's tweet image. AI Data Engineer On Board 🤖
We design, build & maintain data pipelines that power ML & analytics.
💡 Scalable. Reliable. Efficient.
Learn more 👉 [career.elits.com]
#AI #DataEngineering #MachineLearning #Analytics #ELITS

We didn’t just run faster — we finished every query they couldn’t. Kinetica > ClickHouse. GPU acceleration. Real-time analytics. Proven. #DataEngineering #GPU #RealTime #Kinetica

KineticaHQ's tweet image. We didn’t just run faster — we finished every query they couldn’t.

Kinetica > ClickHouse.

GPU acceleration. Real-time analytics. Proven.

#DataEngineering #GPU #RealTime #Kinetica

Data drives decisions. Efficiency powers progress. At #PyHo2025, @ce_akainettey explains how modern organizations harness data to engineer smarter, faster, and more impactful outcomes. Because efficiency isn’t accidental - it’s engineered. 🐍 #DataEngineering

PythonHo's tweet image. Data drives decisions. Efficiency powers progress.

At #PyHo2025, @ce_akainettey explains how modern organizations harness data to engineer smarter, faster, and more impactful outcomes.

Because efficiency isn’t accidental - it’s engineered. 🐍

#DataEngineering
PythonHo's tweet image. Data drives decisions. Efficiency powers progress.

At #PyHo2025, @ce_akainettey explains how modern organizations harness data to engineer smarter, faster, and more impactful outcomes.

Because efficiency isn’t accidental - it’s engineered. 🐍

#DataEngineering
PythonHo's tweet image. Data drives decisions. Efficiency powers progress.

At #PyHo2025, @ce_akainettey explains how modern organizations harness data to engineer smarter, faster, and more impactful outcomes.

Because efficiency isn’t accidental - it’s engineered. 🐍

#DataEngineering

I’m excited to have contributed both as an organizer and a panelist at the first ever Data Engineering Community @data_dec meetup. #DataEngineering #DECMeetUp2025 #DECLagosMeetUp2025 #BigData #CommunityBuilding #DataEngineerCommunity

qudus_ayoola_'s tweet image. I’m excited to have contributed both as an organizer and a panelist at the first ever Data Engineering Community @data_dec meetup.

#DataEngineering #DECMeetUp2025 #DECLagosMeetUp2025 #BigData #CommunityBuilding #DataEngineerCommunity
qudus_ayoola_'s tweet image. I’m excited to have contributed both as an organizer and a panelist at the first ever Data Engineering Community @data_dec meetup.

#DataEngineering #DECMeetUp2025 #DECLagosMeetUp2025 #BigData #CommunityBuilding #DataEngineerCommunity
qudus_ayoola_'s tweet image. I’m excited to have contributed both as an organizer and a panelist at the first ever Data Engineering Community @data_dec meetup.

#DataEngineering #DECMeetUp2025 #DECLagosMeetUp2025 #BigData #CommunityBuilding #DataEngineerCommunity

Loading...

Something went wrong.


Something went wrong.


United States Trends