#dataengineering 搜索结果
#DataEngineering Best Practices — Architect robust and cost-effective data solutions in the cloud era: amzn.to/3BkZ6df v/ @PacktDataML 𝓚𝓮𝔂 𝓕𝓮𝓪𝓽𝓾𝓻𝓮𝓼: 🟠 Architect and engineer optimized data solutions in the cloud with best practices for performance and…
Maximize Snowflake performance & slash query time⚡ Even a 1-second delay = ~2.11% lower conversions 📉 ✅ Faster queries ✅ Lower compute cost ✅ Smarter data pipelines ✅ Agile analytics Full Snowflake tuning guide ⬇️ bit.ly/43QK8Xc #Snowflake #DataEngineering
1/ Let’s talk about Data Lakes and why they’re very important for AI. As a solutions architect, I’ve seen how the right data setup helps AI work better. Here’s a simple thread explaining it! 👇 #DataLakes #AI #DataEngineering
𝐃𝐚𝐭𝐚 𝐄𝐧𝐠𝐢𝐧𝐞𝐞𝐫𝐢𝐧𝐠 𝐯𝐬 𝐃𝐚𝐭𝐚 𝐒𝐜𝐢𝐞𝐧𝐜𝐞: 𝐇𝐨𝐰 𝐓𝐡𝐞𝐲 𝐈𝐧𝐭𝐞𝐫𝐫𝐞𝐥𝐚𝐭𝐞 𝐚𝐧𝐝 𝐃𝐢𝐟𝐟𝐞𝐫 Data engineers build the system. Data scientists find the story. Together, they turn data into direction. Read how they connect: #DataEngineering…
🚀 Launching Supermetal — data replication that just works. Sync databases to warehouses in real-time or batch — no Kafka, no JVM, no Debezium. Built in Rust & Apache Arrow. Try it → trial.supermetal.io Launch post → supermetal.io/blog/launch #dataengineering #rustlang
Ever wondered how Netflix or Amazon handle millions of events every second, all in real time? The secret is event streams, smart processing, and rock solid data pipelines. Here’s a simple breakdown for devs. #DataEngineering #SystemDesign #bigdata
🌊 The Rise of Data Lakehouses Discover how Apache Spark is transforming Big Data, bridging data lakes & warehouses, & shaping the future of analytics🚀 👉 Read more: buff.ly/DLcpBmK #BigData #ApacheSpark #DataEngineering #Analytics #Hadoop #MachineLearning #TechTrends
Data drives decisions. Efficiency powers progress. At #PyHo2025, @ce_akainettey explains how modern organizations harness data to engineer smarter, faster, and more impactful outcomes. Because efficiency isn’t accidental - it’s engineered. 🐍 #DataEngineering
Boost your data engineering career in 2025! Discover the top certifications for data engineers and expert tips to ace them. Check out the guide: buff.ly/amUP0p2 #DataEngineering #CareerGrowth
⚡ Apache Spark SQL: Write Efficient Queries for Big Data Learn tips & best practices to speed up your Spark SQL jobs and optimize Big Data processing 🚀 👉 Read here: buff.ly/imSIQY1 #ApacheSpark #BigData #DataEngineering #Hadoop #SQL #Programming #TechTips
#DataEngineering Best Practices — Architect robust and cost-effective data solutions in the cloud era: amzn.to/3BkZ6df v/ @PacktDataML 𝓚𝓮𝔂 𝓕𝓮𝓪𝓽𝓾𝓻𝓮𝓼: 🟠 Architect and engineer optimized data solutions in the cloud with best practices for performance and…
Why is dbt So Popular? medium.com/@vutrinh274/wh… + Practical #DataEngineering guide to building a #cloud-based, pragmatic, and dependable data platform with #SQL and dbt: amzn.to/3KgVI4f —————— #DataScience #Analytics #BI #CDO #CTO
You fix a sync issue, close the ticket, and then see it pop up again three weeks later in a diff. system. Most infrastructure treats each problem as a one-off. Syntes learns the pattern and applies the fix across your systems. Short demo: hubs.li/Q03VgYJ50 #DataEngineering
#DataEngineering with #ApacheSpark! #BigData #Analytics #DataScience #AI #MachineLearning #IoT #IIoT #Python #RStats #TensorFlow #Java #JavaScript #ReactJS #CloudComputing #Serverless #DataScientist #Linux #Books #Programming #Coding #100DaysofCode geni.us/ApacheSparkSca…
AI Data Engineer On Board 🤖 We design, build & maintain data pipelines that power ML & analytics. 💡 Scalable. Reliable. Efficient. Learn more 👉 [career.elits.com] #AI #DataEngineering #MachineLearning #Analytics #ELITS
![ElitsCanada's tweet image. AI Data Engineer On Board 🤖
We design, build & maintain data pipelines that power ML & analytics.
💡 Scalable. Reliable. Efficient.
Learn more 👉 [career.elits.com]
#AI #DataEngineering #MachineLearning #Analytics #ELITS](https://pbs.twimg.com/media/G3u4HBQWQAE7vTI.jpg)
🚀 Discover the top Data Engineering tools enterprises are adopting globally! 📊 buff.ly/jnnNs33 #DataEngineering #BigData #ApacheSpark #DataScience #Python #AI #100DaysOfCode
i’ve been off the timeline for a bit. been grinding and learning. today it paid off 💪 i just completed my first Data Engineering project: a beginner-friendly ETL pipeline for sales data → PostgreSQL. repo: github.com/adoora-analyti… #learninginpublic #python #dataengineering
Bad partition keys = 🔥 hot spots! Your distributed DB will crawl. Expect 300%+ latency spikes. Align keys with access patterns for massive perf gains. Don't skip this! 🚀 #DataEngineering #DistributedSystems #Scalability
Tip práctico: Antes de enviar a API: 1. Usa tokenizer.encode() para contar tokens reales 2. Multiplica palabras × 1.33 (estimación inglés) 3. Añade 20% buffer para seguridad 4. Visualiza en OpenAI Playground Te ahorrás sorpresas en el bill. #LLMs #DataEngineering #AI
Day 34 of Learning Data Engineering Today I learnt about partition pruning and how it improves Spark performance by skipping unnecessary partitions and reading only those relevant to the query. This reduces the amount of data Spark has to scan. #DataEngineering #SPARK #Python
Ready to take your #DataEngineering skills to the next level? At #BoozAllen, we're seeking innovative minds with Palantir experience to advance #DefenseTech. Join us to collaborate on impactful projects and drive real change. boozallen.co/43okrgH boozallen.co/4olwTFK
📷📷With Skyvia’s new #Qualtrics connector, you can seamlessly transfer survey responses, contact lists, and segments to your data warehouse. 📷 Get started → docs.skyvia.com/connectors/clo… #DataEngineering #DataSync #NoCode #WorkflowAutomation
Need advanced filtering in Spark SQL? ⚡️ Use RLIKE! It unlocks the power of Regex for complex pattern matching, going way beyond standard wildcards. Example: WHERE code RLIKE '^[A-Z]{3}-[0-9]+' #DataEngineering #ApacheSpark #SQL
New #dataengineering project just dropped. As always, I am collecting what is potentially the most up-to-date list of really valuable open-source data engineering projects. Check it out: ssp.sh/brain/open-sou…
This next article tackles the challenge of getting multi-cloud cost insights with a simple presetup framework that is extensible with dlt. The project contains incremental import pipelines, models them in metrics, showcases them as unified dashboards. ssp.sh/blog/cost-anal…
Data vanished in Apache Druid after ingestion? It might just be overshadowed. Learn how segment versioning works + how to restore older segments: deep.bi/blog/managing-… #ApacheDruid #DataEngineering #StreamingData #RealTimeAnalytics
Databricks users - transform your SCD1/SCD2 pipelines with Delta Lake, AUTO CDC, and Snapshot CDC for faster, cleaner, and fully automated data flows. Read the full technical guide → zurl.co/Xi0Z1 #Databricks #DeltaLake #DataEngineering #CDC #SimbusTech #Simbuzz
Maximize Microsoft Fabric with WhereScape automation! 🚀 95% less coding, fast deployment, and seamless integration! 📄 Explore: ow.ly/Nahi50Xp6W6 #MicrosoftFabric #DataEngineering #Automation #MetadataDriven
Galaxy I Technologies is looking for Senior Data Engineer in Atlanta, GA (onsite) Apply Now: lnkd.in/gmqBQ7cS. #galaxyitech #dataengineering #datascience #machinelearning #bigdata #dataanalytics #artificialintelligence #data #bigdataanalytics #sql #dataanalysis
🚀 Quer aumentar a eficiência do seu pipeline de dados? Aplique técnicas simples de DataOps: automação, monitoramento contínuo e colaboração entre times. Não é só sobre tecnologia, é sobre cultura! 📊💡 #DataEngineering #DataOps #IA #TechLeadership
We turn your data into powerful insights. From pipelines to BI dashboards, get a clear view of what your numbers really mean. . . 🌐 pearlorganisation.com 📞 Contact Us : +91 7983680599 , +1(408) 647-4277 . . #PearlOrganisationReviews #dataengineering #dataanalytics
La llegada de la criptografía post-cuántica no es una moda, ni una amenaza lejana. Es una evolución necesaria para asegurar la continuidad de los sistemas y proteger la confianza digital en los próximos años. #Ciberseguridad #PostQuantum #DataEngineering #ArquitecturaDeDatos…
El lado del mal - Cuánto del tráfico en Internet funciona con Post-Quantum Cryptography elladodelmal.com/2025/11/cuanto… #PQC #PostQuantum #Criptografía #cifrado #Radar #Cloudflare @CloudflareRadar
DataFrames give you the power of SQL + Python and the scale of distributed computing. #dataengineering #sql #python #dataframe
⚡ Apache Spark SQL: Write Efficient Queries for Big Data Learn tips & best practices to speed up your Spark SQL jobs and optimize Big Data processing 🚀 👉 Read here: buff.ly/imSIQY1 #ApacheSpark #BigData #DataEngineering #Hadoop #SQL #Programming #TechTips
🚀 Design patterns in Data Engineering | 360DigiTMG🚀 📅 Date: 21st November 2025 🕓 Time: 4:00 PM IST 📝 Register Now by clicking the link below 👇 360digitmg.zoom.us/webinar/regist… #DataEngineering #DesignPatterns #DataPipelines #BigData #ETL #DataArchitecture #DataOps #360DigiTMG #AI
The goal is to be too good to be ignored… While men sleep 🙇♂️🙇♂️ 2:00 AM check in. Who’s up?? #Datafam #DataEngineeringStudy #Dataengineering
#DataEngineering Best Practices — Architect robust and cost-effective data solutions in the cloud era: amzn.to/3BkZ6df v/ @PacktDataML 𝓚𝓮𝔂 𝓕𝓮𝓪𝓽𝓾𝓻𝓮𝓼: 🟠 Architect and engineer optimized data solutions in the cloud with best practices for performance and…
1/ Let’s talk about Data Lakes and why they’re very important for AI. As a solutions architect, I’ve seen how the right data setup helps AI work better. Here’s a simple thread explaining it! 👇 #DataLakes #AI #DataEngineering
Maximize Snowflake performance & slash query time⚡ Even a 1-second delay = ~2.11% lower conversions 📉 ✅ Faster queries ✅ Lower compute cost ✅ Smarter data pipelines ✅ Agile analytics Full Snowflake tuning guide ⬇️ bit.ly/43QK8Xc #Snowflake #DataEngineering
🚀 Is your data warehouse slowing down dashboards & decisions? Before rebuilding, try targeted optimization. 👉 9 key strategies to cut costs & boost speed: schema, ETL, queries, compute & more. Read the guide ➡️ bit.ly/4qzcFdS #DataWarehouse #DataEngineering
While men Sleep … At least when the NEPs allow me to 😂😂😂… I’m grinding. I’m doing everything within my power to turn my story… I cannot fail oh #Datafam #Dataengineering
AI Data Engineer On Board 🤖 We design, build & maintain data pipelines that power ML & analytics. 💡 Scalable. Reliable. Efficient. Learn more 👉 [career.elits.com] #AI #DataEngineering #MachineLearning #Analytics #ELITS
𝐃𝐚𝐭𝐚 𝐄𝐧𝐠𝐢𝐧𝐞𝐞𝐫𝐢𝐧𝐠 𝐯𝐬 𝐃𝐚𝐭𝐚 𝐒𝐜𝐢𝐞𝐧𝐜𝐞: 𝐇𝐨𝐰 𝐓𝐡𝐞𝐲 𝐈𝐧𝐭𝐞𝐫𝐫𝐞𝐥𝐚𝐭𝐞 𝐚𝐧𝐝 𝐃𝐢𝐟𝐟𝐞𝐫 Data engineers build the system. Data scientists find the story. Together, they turn data into direction. Read how they connect: #DataEngineering…
We did a thing: three amazing data engineers and I answered the 10 most-asked questions on r/dataengineering. These genuine insights help you understand the current state of #dataengineering. Obviously, I'm biased since I pulled together the questions & answered them myself.
Ever wondered how Netflix or Amazon handle millions of events every second, all in real time? The secret is event streams, smart processing, and rock solid data pipelines. Here’s a simple breakdown for devs. #DataEngineering #SystemDesign #bigdata
You fix a sync issue, close the ticket, and then see it pop up again three weeks later in a diff. system. Most infrastructure treats each problem as a one-off. Syntes learns the pattern and applies the fix across your systems. Short demo: hubs.li/Q03VgYJ50 #DataEngineering
Transformations are the real heart of the data stack - and dbt made us finally treat them that way. The golden age of dbt isn't about tooling - it's about trust. Link to the full blog post: luminousmen.substack.com/p/the-golden-a… #dataengineering #bigdata
What's stopping you from reading the #dataengineering newsletter and the latest blog posts like this? These are my RSS feeds in the terminal on the left, and the feeds (queries), their URLs, and configs on the right.
Boost your data engineering career in 2025! Discover the top certifications for data engineers and expert tips to ace them. Check out the guide: buff.ly/amUP0p2 #DataEngineering #CareerGrowth
🚀 Discover the top Data Engineering tools enterprises are adopting globally! 📊 buff.ly/jnnNs33 #DataEngineering #BigData #ApacheSpark #DataScience #Python #AI #100DaysOfCode
🏗️ Build a modern data warehouse! Learn steps, architecture, and automation. 👉 Read more: ow.ly/33zF50Xm5iA #DataWarehouse #DataAutomation #DataEngineering #DataArchitecture #ELT #MetadataDriven #DataVault #CloudData #DigitalTransformation #WhereScape
I’m excited to have contributed both as an organizer and a panelist at the first ever Data Engineering Community @data_dec meetup. #DataEngineering #DECMeetUp2025 #DECLagosMeetUp2025 #BigData #CommunityBuilding #DataEngineerCommunity
Something went wrong.
Something went wrong.
United States Trends
- 1. Ukraine 521K posts
- 2. #KayJewelers N/A
- 3. #Veloragpt N/A
- 4. Putin 177K posts
- 5. #pilotstwtselfieday 1,033 posts
- 6. Geraldo 2,793 posts
- 7. #FursuitFriday 13.9K posts
- 8. Anthony Joshua 4,468 posts
- 9. Le Cowboy N/A
- 10. Start Cade N/A
- 11. NOTAM 4,132 posts
- 12. #FanCashDropPromotion 4,190 posts
- 13. Trump and Mamdani 12.4K posts
- 14. Chris DeMarco N/A
- 15. Zelensky 112K posts
- 16. Kenyon 2,221 posts
- 17. NATO 66.8K posts
- 18. Happy Thanksgiving 3,540 posts
- 19. Mark Kelly 77.4K posts
- 20. Carlton 4,644 posts