#sparksql نتائج البحث
🚀 Elevate your Big Data game with advanced SQL queries! 📊 Explore use cases & examples: buff.ly/W5imSys #BigData #SQL #ApacheSpark #DataAnalytics #Programming #100DaysOfCode
🧹 Master data cleaning & transformation with SQL and Apache Spark! 📊 Dive into this complete guide with Scala examples: buff.ly/Bl4NN0g #BigData #ApacheSpark #SQL #Scala #DataEngineering #100DaysOfCode
💡 Why SQL is the Lingua Franca of Data SQL is so important that even in Python, there’s SQL. ✅ Well… even in pandas there’s SQL. ✅ Even in PySpark, there’s SQL. Pandas borrowed its core logic: SELECT, WHERE, GROUP BY, JOIN and turned it into functions and methods.…
Why Big Data Platforms Return to SQL？The better alternative is unknown to most of them for now. But Few Know a Better Alternative Exists. SPL, designed specifically for big data, keeps SQL’s strengths while fixing its flaws.😀👇 dev.to/esproc_spl/why…
🚀 Need help with PySpark tasks? Get expert PySpark Job Support, PySpark Proxy Job Support, and PySpark Job Support Online for ETL, Spark SQL, Databricks & big data pipelines. DM today! 🔗tinyurl.com/pysparkjobsupp… #PySpark #BigData #SparkSQL #DataEngineering
D69 DataFrames > RDDs for 95% of workloads. But RDDs make you understand Spark. Both matter. #ApacheSpark #BigData #SparkSQL #DataEngineering #ETL #PySpark #DataScience #MachineLearning #CloudComputing #Databricks #DistributedComputing
D52 Spark’s Catalyst Optimizer = SQL on steroids🧠 Rewrites queries→minimizes shuffles→maximizes performance. Invisible magic under the hood. #ApacheSpark #BigData #SparkSQL #DataEngineering #Databricks #ETL #DataPipeline #PerformanceOptimization #DataEngineer #PySpark #Cloud
D45 Spark SQL magic🪄 You can write: df.createOrReplaceTempView("sales") then run pure SQL: SELECT region, SUM(revenue) FROM sales GROUP BY region #SparkSQL #ApacheSpark #BigData #ETL #DataEngineering #Kafka #Streaming #BigData #DataEngineering #PySpark #DataScience #DataPipeline
Day 46 of my #buildinginpublic journey into Data Engineering Learned how to combine SQL + PySpark for large-scale analytics Created RDDs Ran SQL queries on DataFrames Performed complex aggregations Used broadcasting for optimization of joins #PySpark #SparkSQL #BigData
Use regex in Spark SQL for super-powerful string processing! With the RLIKE or REGEXP_EXTRACT functions, you can: Validate formats (e.g., emails, dates). Extract specific data (e.g., codes, values). Filter complex rows. Example: WHERE column RLIKE 'pattern' #SparkSQL
QUALIFY clause in Spark SQL filters the results of window functions (like RANK(), ROW_NUMBER()) without requiring subqueries. It acts like a HAVING clause specifically for window functions,simplifying your queries.QUALIFY RANK() = 1 to get the first record in each group.#SparkSQL
8年前连城大佬把玩SparkSQL的项目 liancheng/spear，克隆后发现sbt版本太老无法构建 😅通过 @cursor_ai 10分钟就把问题解决了！顺手提了个MR：github.com/liancheng/spea… ✅ sbt 0.13.12 → 1.11.6 + JDK 11支持 ✅ 添加了CI/CD pipeline ✅ 集成了代码质量检查 AI辅助开发真的香！ #Scala #SparkSQL #AI
🔍 Databricks 結合チューニングのポイント 🔍 Join最適化で処理高速化＆コスト削減！ 🚀 note.com/mellow_launch/… #Databricks #DeltaLake #SparkSQL #DataEngineering #データエンジニア #ETL #スキュー対策
note.com
Databricks 結合/スキュー対策 & ブロードキャスト戦略｜Mellow Launch
──ヒントの“結合”をもう一段掘る Databricks──ゼロから触ってわかった！Databricks非公式ガイド: クラウド時代の分析プラットフォームDataBlicks体験記 (データエンジニア入門シリーズ) amzn.to 980円 (2025年09月24日 06:41時点 詳しくはこちら) Amazon.co.jpで購入する ユースケース Databricksにおけるデータ処理の中...
#ApacheIceberg + #SparkSQL = a solid foundation for building #ML systems that work reliably in production. Time travel, schema evolution & ACID transactions address fundamental data management challenges that have plagued ML infrastructure for years. 🔍 bit.ly/46kCCpQ
💸 Spark SQL costs out of control? Run your dbt transformations for 50% less, with 2–3× better efficiency. No rewrites required. Join Amy Chen (@dbt_labs) & @KyleJWeller (Onehouse) next week to see how. 👉 onehouse.ai/webinar/dbt-on… #dbt #SparkSQL #ETL #DataEngineering
at @yourcreatebase, i was working with large unclaimed music royalty records — to consolidate publisher objects: mapping rights admin relationships to shares, writers, and iswc codes — to make our royalty payout pipeline faster and more accurate #SparkSQL #PySpark #AWS #S3
🧵7/10 Results from TPC-H style workloads: - Joins: 84–95% faster - Filters: 30–50% faster - Aggregations: 20–40% less shuffle All changes are semantically safe. Success rate: 95%+ #SparkSQL #QueryOptimization
#ApacheIceberg + #SparkSQL = a solid foundation for building #ML systems that work reliably in production. Time travel, schema evolution & ACID transactions address fundamental data management challenges that have plagued ML infrastructure for years. 🔍 bit.ly/46kCCpQ
Something went wrong.
Something went wrong.
United States Trends
- 1. FINALLY DID IT 622K posts
- 2. The JUP 180K posts
- 3. Susie Wiles 16K posts
- 4. Vanity Fair 5,393 posts
- 5. Good Tuesday 43.7K posts
- 6. #csm223 N/A
- 7. #tuesdayvibe 3,225 posts
- 8. #HeAProDriver 25.1K posts
- 9. Boston Tea Party 1,651 posts
- 10. Unemployment 36.2K posts
- 11. #PersonOfTheYearAwards2025 1.33M posts
- 12. 4.6% in November 3,400 posts
- 13. Taco Tuesday 13.2K posts
- 14. Sheed N/A
- 15. The BBC 133K posts
- 16. Jane Austen 6,880 posts
- 17. Brad Johnson N/A
- 18. Happy Taco 10.2K posts
- 19. Topstep 1,795 posts
- 20. Rodman 2,146 posts