#dataengineering Suchergebnisse
The goal is to be too good to be ignored… While men sleep 🙇♂️🙇♂️ 2:00 AM check in. Who’s up?? #Datafam #DataEngineeringStudy #Dataengineering
#DataEngineering Best Practices — Architect robust and cost-effective data solutions in the cloud era: amzn.to/3BkZ6df v/ @PacktDataML 𝓚𝓮𝔂 𝓕𝓮𝓪𝓽𝓾𝓻𝓮𝓼: 🟠 Architect and engineer optimized data solutions in the cloud with best practices for performance and…
Consolidations in the #dataengineering market are happening fast. Tools from the MDS get unified into unified data platforms. The latest: - Fivetran → dbt - Fivetran → SQLMesh - Soda → nannyML - Snowflake → Crunchy Data - Databricks → Neon - Fivetran → Census - dbt → SDF
#DataEngineering with Google Cloud Platform #GCP — A Guide to leveling up as a #DataEngineer by building a scalable data platform with Google Cloud: amzn.to/4ecMUtM [2nd Edition] v/ @PacktDataML ————— #DataAnalytics #Analytics #CDO #CTO #AI #ML #MLOps #DataScience
While men Sleep … At least when the NEPs allow me to 😂😂😂… I’m grinding. I’m doing everything within my power to turn my story… I cannot fail oh #Datafam #Dataengineering
The simpler the semantic model, the simpler everything else becomes. It must be number one, even if just for reports. This is why most are building lakehouses to drive and communicate information. #dataengineering #datamodeling youtube.com/watch?v=sC1B5s…
#DataEngineering with Scala and Spark — Build streaming & batch pipelines to process massive amounts of data: amzn.to/3wdmEhy v/ @PacktDataML 𝒦𝑒𝓎 𝐹𝑒𝒶𝓉𝓊𝓇𝑒𝓈: 🔴Transform data into a clean and trusted source of information for your organization using Scala…
Columnar DB + JSON already sounds impossible… Yet @ClickHouseDB hits ~9,000× Postgres and ~2,500× Mongo, with columnar benefits intact (vectorized exec, compression, data skipping) #DataEngineering #ClickHouse
💂♀️🛡️👀 Process Guardianship: The Most Valuable Data Engineering Work You're Probably Not Doing #dataengineering #dataquality #dataops hubs.ly/Q03Q1xWP0
I’m excited to have contributed both as an organizer and a panelist at the first ever Data Engineering Community @data_dec meetup. #DataEngineering #DECMeetUp2025 #DECLagosMeetUp2025 #BigData #CommunityBuilding #DataEngineerCommunity
💂♀️🛡️👀 Process Guardianship: The Most Valuable Data Engineering Work You're Probably Not Doing #dataengineering #dataquality #dataops hubs.ly/Q03MNrcg0
Day 9 of learning Data Engineering Decided to start my first guided project which is an end to end ETL pipeline for weather data analysis. What I did today was to create a GitHub repo, clone the repo on my local device and also got the API key for openweather #dataengineering
From Databricks Lakehouse to FastAPI microservices— Here’s how we design data products that: 📊 Scale ESG reporting ⚡ Cut delivery times by 70% 🔒 Stay secure & compliant Frontline insights 👉 goodfirms.co/blog/scaling-d… #GoodFirms #Databricks #DataEngineering #ScalableTech
#DataEngineering with Scala and Spark — Build streaming & batch pipelines to process massive amounts of data: amzn.to/3wdmEhy v/ @PacktDataML 𝒦𝑒𝓎 𝐹𝑒𝒶𝓉𝓊𝓇𝑒𝓈: 🔴Transform data into a clean and trusted source of information for your organization using Scala…
Data drives decisions. Efficiency powers progress. At #PyHo2025, @ce_akainettey explains how modern organizations harness data to engineer smarter, faster, and more impactful outcomes. Because efficiency isn’t accidental - it’s engineered. 🐍 #DataEngineering
Why is dbt So Popular? medium.com/@vutrinh274/wh… + Practical #DataEngineering guide to building a #cloud-based, pragmatic, and dependable data platform with #SQL and dbt: amzn.to/3KgVI4f —— #DataScience #Analytics #BI #CDO #CTO
Day 13 of learning Data Engineering Today I fixed the bug I faced previously and then I completed the loading section of the ETL pipeline which involved loading the weather data into an SQL database(I used MySQL db). #python #datafam #dataengineering #SQL
The data world is evolving — and Snowflake is leading the revolution with its Cloud-Native Platform, Separation of Storage & Compute, and Performance. 🌐 : skillmove.in #Snowflake #DataEngineering #CloudComputing #GenerativeAI #SkillMove #DataWarehouse #AITraining
Data requirements are substantial. Need dual-resolution support: 1-minute bars for training, 1-second bars for precision drawdown tracking. Apex rules demand sub-minute accuracy. #DataEngineering #QuantTrading
Watch the On-Demand Webinar: Rebel With A Data Test: The Solo Data Quality Leader’s Playbook hubs.ly/Q03Q4fCy0 #dataengineering #dataquality #opensource #dataobservability #dataops
Watch the On-Demand Webinar: Rebel With A Data Test: The Solo Data Quality Leader’s Playbook hubs.ly/Q03Q4b3r0 #dataengineering #dataquality #opensource #dataobservability #dataops
Watch the On-Demand Webinar: Rebel With A Data Test: The Solo Data Quality Leader’s Playbook hubs.ly/Q03Q4cZb0 #dataengineering #dataquality #opensource #dataobservability #dataops
Grouping by unique IDs (like user_id, transaction_id) explodes the number of tasks & shuffle data. Instead, pre-aggregate or bucketize data before grouping on such keys. #Databricks #Spark #DataEngineering #Performance
If you reuse a filtered or joined DataFrame multiple times, don’t recompute it. Cache it once and reuse it. Prevents multiple scans on the same data = faster pipelines #Databricks #Spark #DataEngineering #Performance
Counting unique values on massive datasets? countDistinct() can eat memory switch to the approximate version for huge scale. It’s based on HyperLogLog small accuracy tradeoff, huge performance win. #Databricks #Spark #DataEngineering #Performance
Why do some Spark aggregations fly ⚡ while others crawl? Here are 4 underrated performance tips for Databricks + Spark that can easily 2–3× your groupBy speed explained simply 👇 #Databricks #Spark #DataEngineering #Performance
It’s been a while since I last wrote a blog post — so I’m starting a new series: Orchestrating Streams! Episode 1 is out:⚡ medium.com/@fhussonnois/o… #ApacheKafka #Kestra #DataEngineering #OpenSource
Engenharia de dados não é só coletar dados, é criar o alicerce do futuro da IA. Se os dados forem lixo, o modelo vira óbvio. Por isso, pipelines robustos são como café forte: essenciais para despertar insights valiosos ☕🚀 #DataEngineering #IA #TechTalk
Build your career with Snowflake in 2025–2026 the demand for cloud data experts is skyrocketing! 🚀 Master data warehousing, ETL, and analytics to stay ahead in the data-driven era. Click🔗:snowflakemasters.in #Snowflake #DataEngineering #CloudCareer #SnowflakeTraining
I've built a Core Insights dashboard for #Kafka Streams! 📊 This Prometheus-based Grafana dashboard brings together the metrics that actually matter. One view to spot issues before they become incidents. #dataengineering buff.ly/KpYxjTu
SQL is older than most programming languages. Yet every new data tool still runs on it. Some tech ages, SQL compounds. #SQL #DataEngineering
Good morning fams: I am happy to share my first capstone project: learndataengineering.com/courses/149061…. That walks me through end to end of building a data pipeline. #DataEngineering.
From devops to DE, good choice? #dataengineering reddit.com/r/dataengineer…
Rant: Managing expectations #dataengineering reddit.com/r/dataengineer…
Is Partitioning data in Data Lake still the best practice? #dataengineering reddit.com/r/dataengineer…
Extracts, embeds, and stores multimodal PDF elements — text with SentenceTransformers and images with CLIP — in vector database for unified semantic search. - hackernoon.com/how-to-extract… #ai #dataengineering
The goal is to be too good to be ignored… While men sleep 🙇♂️🙇♂️ 2:00 AM check in. Who’s up?? #Datafam #DataEngineeringStudy #Dataengineering
While men Sleep … At least when the NEPs allow me to 😂😂😂… I’m grinding. I’m doing everything within my power to turn my story… I cannot fail oh #Datafam #Dataengineering
In 2025, data engineers need a mix of classic & emerging skills: Python & Scala, Apache Spark & Kafka, SQL & NoSQL, AI-powered tools like GitHub Copilot, and Large Language Models (LLMs) for automation. #DataEngineering #AI it.exchange/blog/5-essenti…
I’m excited to have contributed both as an organizer and a panelist at the first ever Data Engineering Community @data_dec meetup. #DataEngineering #DECMeetUp2025 #DECLagosMeetUp2025 #BigData #CommunityBuilding #DataEngineerCommunity
Monday's #DataEngineering CI/CD workshop #MicrosoftFabric: so much interest we ran out of credentials for unregistered attendees 🔥Watching teams go from "CI/CD seems complicated" to building working fabric-cli pipelines in one session = why hands-on workshops work.
Why is dbt So Popular? medium.com/@vutrinh274/wh… + Practical #DataEngineering guide to building a #cloud-based, pragmatic, and dependable data platform with #SQL and dbt: amzn.to/3KgVI4f —— #DataScience #Analytics #BI #CDO #CTO
#DataEngineering Best Practices — Architect robust and cost-effective data solutions in the cloud era: amzn.to/3BkZ6df v/ @PacktDataML 𝓚𝓮𝔂 𝓕𝓮𝓪𝓽𝓾𝓻𝓮𝓼: 🟠 Architect and engineer optimized data solutions in the cloud with best practices for performance and…
💂♀️🛡️👀 Process Guardianship: The Most Valuable Data Engineering Work You're Probably Not Doing #dataengineering #dataquality #dataops hubs.ly/Q03MNrcg0
From Databricks Lakehouse to FastAPI microservices— Here’s how we design data products that: 📊 Scale ESG reporting ⚡ Cut delivery times by 70% 🔒 Stay secure & compliant Frontline insights 👉 goodfirms.co/blog/scaling-d… #GoodFirms #Databricks #DataEngineering #ScalableTech
Curiosity led me to explore the role of LLMs in data engineering and it turns out they’re revolutionizing pipelines! Check out the full story here: betheldaniel332.medium.com/how-llms-are-r… What’s your take on LLMs in data stacks?#DataEngineering #LLMs #AI
Ready to launch your data engineering career? Join Kocha’s 4-week Data Engineering Launchpad starting Sept 17! Gain market-ready skills & prep for the Databricks exam. 🌍💻 👉 kocha.dev #DataEngineering #Databricks #TechTraining #CareerGrowth
#DataEngineering with Scala and Spark — Build streaming & batch pipelines to process massive amounts of data: amzn.to/3wdmEhy v/ @PacktDataML 𝒦𝑒𝓎 𝐹𝑒𝒶𝓉𝓊𝓇𝑒𝓈: 🔴Transform data into a clean and trusted source of information for your organization using Scala…
#DataEngineering with Google Cloud Platform #GCP — A Guide to leveling up as a #DataEngineer by building a scalable data platform with Google Cloud: amzn.to/4ecMUtM [2nd Edition] v/ @PacktDataML ————— #DataAnalytics #Analytics #CDO #CTO #AI #ML #MLOps #DataScience
Specify your intent and let the system choose the best #pricePerformance configuration for your #dataEngineering workloads on #microsoftFabric with #ResourceProfiles @JustynaLucznik #FabCon2025 #fabconEU2025
Does Oracle get emotionally attached before splitting strings apart? Source: devhubby.com/thread/how-to-… #SQL #DataEngineering #Programming #OraclePLSQL #explore #oracle
Achieve the best #pricePerformance for your #DataEngineering workloads in #microsoftFabric by enabling #NativeEngine @JustynaLucznik #bestSparkOnAzure #NativeEngine #fabconEU
Something went wrong.
Something went wrong.
United States Trends
- 1. #MondayMotivation 26K posts
- 2. Good Monday 29.6K posts
- 3. Victory Monday N/A
- 4. Category 5 15.7K posts
- 5. Jamaica 61.8K posts
- 6. #MondayMorning N/A
- 7. Austin Reaves 50.3K posts
- 8. Hurricane Melissa 38.6K posts
- 9. Tomlin 13.2K posts
- 10. #breachlan2 3,637 posts
- 11. Zayne 26K posts
- 12. Derry 22.2K posts
- 13. Talus Labs 17.7K posts
- 14. South China Sea 17.7K posts
- 15. Pretty P 4,608 posts
- 16. Javier Milei 176K posts
- 17. GameStop 53.4K posts
- 18. Dolly 12.9K posts
- 19. #BaddiesAfricaReunion 11.4K posts
- 20. #GoPackGo 11.2K posts