Apache Wayang
@apachewayang
Apache Wayang is the API of AI, cross-platform data processing to train large models. Star / fork us on GitHub: https://github.com/apache/incubator-wayang
You might like
Apache Wayang isn’t just limited to FedML and Data Federation; it also enhances our taste and lifestyle. Solving real world data science problems! youtube.com/watch?v=4f24QS…
youtube.com
YouTube
Whisky Clustering with Apache Projects: Groovy, Commons Math, Ignite,...
@apachewayang 1.0.0 build successful! The backbone for AI, decentralized data processing to access data in silos a dev can't reach typically.
@apachewayang v. 1.0.0 successfully compiled. The backbone for ASI / AGI infrastructure, devs can now reach data which is typically not in reach, like protected silos, and execute processing at the source, in-situ. FedAI is coming soon!
LLM's struggle to show their business benefit. Why? Data access. AI needs the right data, in a suitable format at the right time. Read how @apachewayang helps to solve that: wayang.apache.org/blog/wayang-fe…
wayang.apache.org
Wayang and the Federated AI | Apache Wayang (incubating)
AI systems and applications are widely used nowadays, from assisting grammar spellings to
Our newest blogpost, written by Wayang developer Juri Petersen, explains how python works with Apache Wayang, and how we enable JSON conform UDF within a wayangPlan. #data #opensource #apachewayang wayang.apache.org/blog/wayang-py…
wayang.apache.org
Pywayang - Apache Wayang's Python API | Apache Wayang (incubating)
In the vast landscape of data processing, efficiency and flexibility are
Read part 1 of the blog series, written by Dr. Mirko Kämpf from ecolytiq, about implementing a cross-organization decentralized data processing scenario. #apachewayang #kafka #data wayang.apache.org/blog/kafka-mee…
wayang.apache.org
Apache Kafka meets Wayang - Part 1 | Apache Wayang (incubating)
Intro
EarthObservation / ESA / Copernicus: AGORA plugin (Apache Wayang): meetingorganizer.copernicus.org/EGU23/EGU23-17…
Integrate AI with IoT, the federated way: youtube.com/watch?v=dOnsEf… #iot #spark #bigdata
youtube.com
YouTube
Apache Wayang: Bringing Big Data to the IoT - Jorge-Arnulfo Quiane-...
We updated our website -> wayang.apache.org <-. More documentation, much more easier to contribute and add PRs.
wayang.apache.org
Apache Wayang (incubating) | Apache Wayang (incubating)
@{siteConfig.tagline}
Apache Wayang now enables AI/ML training and inference in Spark for federated learning at the enterprise level. The team just merged PR388: github.com/apache/incubat…
github.com
Add three ML operators which map to SparkML by joker-star-l · Pull Request #388 · apache/incubato...
For clustering task: KMeansOperator For classification task: DecisionTreeClassificationOperator For regression task: LinearRegressionOperator
We merged 380: #380 Added a new plugin to support different jdbc platforms and multiple instances of same DBMS. Wayang now adds support for multiple spark and jdbc context in one wayangPlan(). github.com/apache/incubat…
ML4ALL implementation merged, it's the code to our reseach paper, now merged and fully operable. github.com/apache/incubat…
Now you can run kmeans natively on sparkML! This improvement speeds ML operations massively up. Additionally, with wayang you can have multiple _different_ spark version in one plan, that makes wayang really powerful for cross-spark ML. github.com/apache/incubat…
Apache Wayang: A Unified Data Analytics Framework - research paper now released with Sigmod Record => sigmodrecord.org/publications/s…
Wayang AgoraEO Plugin: The Framework for Scalable EO Workflows "We recently proposed AgoraEO, a decentralized, open, and unified ecosystem, where users can find EO elements, compose cross-platform EO pipelines, and execute them efficiently. ui.adsabs.harvard.edu/abs/2023EGUGA.…
#CommunityOverCode NA, our flagship event, is only TWO MONTHS away! Join us in Halifax 🇨🇦 for four days of sessions, with tracks focusing on Search, Big Data, Streaming, IoT, Community, Fintech, and more. 🎟️ Register now! bit.ly/3D9fKK7
#DynamicPartitioning in Apache Doris It means to automatically create and delete data partitions based on the user-specified rules. You can enable it upon data creation and specify the partition TTL (time to live) in the statement. #database #DataScience #Analytics #SQL
Apache Wayang enables cross platform data processing, star it via: github.com/apache/incubat… #dataprocessing #bigdata #analytics #hybridcloud #developers via @apachewayang
Wayang can now support simple and basic SPJ queries for decoupled JDBC sources and CSV data sources. github.com/apache/incubat…
Since the latest JDK21ea supports virtual threads as standard (not preview), I updated the Groovy/GPars meets virtual threads blog post: groovy.apache.org/blog/gpars-mee… Why not give it a try! #groovylang @ApacheGroovy @mittie @vaclav_pech
United States Trends
- 1. Epstein 692K posts
- 2. Steam Machine 34.1K posts
- 3. Bradley Beal 3,010 posts
- 4. Valve 23.8K posts
- 5. Boebert 23.4K posts
- 6. Virginia Giuffre 39.3K posts
- 7. Xbox 60.1K posts
- 8. Anthony Joshua 1,834 posts
- 9. Scott Boras N/A
- 10. #BLACKROCK_NXXT N/A
- 11. GabeCube 2,215 posts
- 12. Rosalina 64.5K posts
- 13. Clinton 99.9K posts
- 14. Mel Tucker N/A
- 15. H-1B 94.6K posts
- 16. Zverev 3,059 posts
- 17. Jordan Humphrey N/A
- 18. AJ Brown 8,532 posts
- 19. #NASDAQ_NXXT N/A
- 20. Michael Wolff 17K posts
Something went wrong.
Something went wrong.