robinfeh's profile picture. software architect / consultant / co-founder of acosom🇨🇭🇺🇦 - #kafka #eventsourcing #DDD #CQRS #bigdata #streamprocessing #distributedsystems

Rob F.

@robinfeh

software architect / consultant / co-founder of acosom🇨🇭🇺🇦 - #kafka #eventsourcing #DDD #CQRS #bigdata #streamprocessing #distributedsystems

Pinned

🧵 WORKSHOP 📚 Getting into @apachekafka isn't that easy. It's a powerful and vast ecosystem. We have compiled a workshop that brings you up to speed. We compiled over 35 blog articles, 3 books and migration as well as production experiences into this workshop.

Nehmen Sie an unserem #ApacheKafkaWorkshop teil, in dem reale Anwendungsfälle mit #ApacheKafka untersucht werden. Erfahren Sie jetzt, wie Sie mit #Kafka in Unternehmensanwendungen digitale Echtzeit-Erlebnisse konzipieren können.

AcosomGmbh's tweet image. Nehmen Sie an unserem #ApacheKafkaWorkshop teil, in dem reale Anwendungsfälle mit #ApacheKafka untersucht werden. Erfahren Sie jetzt, wie Sie mit #Kafka in Unternehmensanwendungen digitale Echtzeit-Erlebnisse konzipieren können.


Rob F. reposted

🐿️ #ApacheFlink 2️⃣.0️⃣ is here 🚀 📝 flink.apache.org/2025/03/24/apa… 📦 flink.apache.org/downloads/

hpgrahsl's tweet image. 🐿️ #ApacheFlink 2️⃣.0️⃣ is here 🚀

📝 flink.apache.org/2025/03/24/apa…

📦 flink.apache.org/downloads/

Rob F. reposted

Details of a proprietary vectorised engine from Alibaba for #ApacheFlink called Flash. It includes two new state storage engines under the name ForStDB ("For Streaming DB") It's written in C++ and they claim 10x performance improvements. mp-weixin-qq-com.translate.goog/s/7KY6Uf-TYrKI…

rmoff's tweet image. Details of a proprietary vectorised engine from Alibaba for #ApacheFlink called Flash. It includes two new state storage engines under the name ForStDB ("For Streaming DB")

It's written in C++ and they claim 10x performance improvements.

mp-weixin-qq-com.translate.goog/s/7KY6Uf-TYrKI…
rmoff's tweet image. Details of a proprietary vectorised engine from Alibaba for #ApacheFlink called Flash. It includes two new state storage engines under the name ForStDB ("For Streaming DB")

It's written in C++ and they claim 10x performance improvements.

mp-weixin-qq-com.translate.goog/s/7KY6Uf-TYrKI…

Rob F. reposted

Is it end of the road for RocksDB in stream processing? Disaggregated state is the clearly superior architecture, with @responsive_apps investing heavily in SlateDB while Flink 2.0 has forked RocksDB.


Rob F. reposted

Just published: Towards Jaeger v2 💥💥💥 Moar OpenTelemetry! link.medium.com/FjwWVjI2wLb


Rob F. reposted

Here's a list of all the #ApacheFlink talks at #kafkasummit London next week: 🔗rmoff.net/2024/03/15/apa… #ksl24 #FlinkAtKSL

rmoff's tweet image. Here's a list of all the #ApacheFlink talks at #kafkasummit London next week: 

🔗rmoff.net/2024/03/15/apa…

#ksl24 #FlinkAtKSL

#kafkasummit London #ksl24 is next week! And this time the squirrels are coming 🐿️. There's a whole track in Breakout Room 2 dedicated to #ApacheFlink 🙌 #FlinkAtKSL

rmoff's tweet image. #kafkasummit London #ksl24 is next week! 
And this time the squirrels are coming 🐿️. 

There's a whole track in Breakout Room 2 dedicated to #ApacheFlink 🙌 #FlinkAtKSL


Rob F. reposted

Check out the redpanda s3 fifo impl github.com/redpanda-data/…

It is great to lead the transition from LRU caches to FIFO-based caches! A lot of interest in our new cache eviction algorithm, SIEVE sievecache.com. It hits the top of HN twice within a week. This happened after S3-FIFO s3fifo.com hit the top last month.



A pretty neat project that combines #Flink (SQL) and #GraphQL and creates a microservice for you that does stream processing and provides a GraphQL-API for it too: datasqrl.com nice one @MBroecheler

datasqrl.com

Clean Data For AI | DataSQRL

Clean Data For AI | DataSQRL


Oh that's news!

🎉 Almost missed another fantastic @MongoDB announcement today... #Atlas #StreamProcessing Can't wait to try this via early access program 🤓 mongodb.com/blog/post/intr…

hpgrahsl's tweet image. 🎉 Almost missed another fantastic @MongoDB announcement today... #Atlas #StreamProcessing

Can't wait to try this via early access program 🤓

mongodb.com/blog/post/intr…
hpgrahsl's tweet image. 🎉 Almost missed another fantastic @MongoDB announcement today... #Atlas #StreamProcessing

Can't wait to try this via early access program 🤓

mongodb.com/blog/post/intr…


Rob F. reposted

I don't talk much about this - I obtained one of the first FDA approvals in ML + radiology and it informs much of how I think about AI systems and their impact on the world. If you're a pure technologist, you should read the following: There's so much to unpack for both why…

This must be said and repeated. Yes, Geoff was totally wrong to predict a drop in radiologist positions. We knew that it was wrong when he said it. We have data now.



Rob F. reposted

Queues for Kafka is the hottest new feature being discussed right now! "KIP-932: Queues for Kafka" was announced just 7 days ago. But what is it? First - let’s define a queue. A traditional queue system is one where either: 🔹- many consumers read from the same queue…


#Redpanda vs. #Kafka the war is on! some good insights: news.ycombinator.com/item?id=359497… TLDR; the comparisons made are probably not fair...


Redpanda is not faster than Kafka...well that is pretty interesting news! Thank you @vanlightly for the time spent on this!

Redpanda bring out benchmark after benchmark claiming performance superiority over Apache Kafka. I decided to run my own tests to see if any of it was true. jack-vanlightly.com/blog/2023/5/15…



🚀 New in our Kafka 101 series: Real-Time Data Visualization! Stream process data from #Kafka using #Flink and ingest them to #ApacheDruid and create real-time dashboards with #ApacheSuperset. Link: bit.ly/3dQC2a👈 Kudos to Théodore Curtil! Follow for more! 📊

robinfeh's tweet image. 🚀 New in our Kafka 101 series: Real-Time Data Visualization!  Stream process data from #Kafka using #Flink and ingest them to #ApacheDruid and create real-time dashboards with #ApacheSuperset.  

Link: bit.ly/3dQC2a👈

Kudos to Théodore Curtil!  
Follow for more! 📊

When to use stream processing vs. streaming databaes:

Got asked how stream processing platforms (e.g. Apache Flink, Kafka Streams, Spark Structured Streaming) compare to streaming databases (e.g. RisingWave, Materialize, PranaDB). There's some overlap and similarities, but also differences. Here's some aspects which may help 1/10



🚀 Check out the valuable talk by Armando Ferrara! Learn about insertion speeds when using UUIDv4 vs. UUIDv7, and don't forget to learn about DB-internals when choosing a DB such as the default clustered index in innoDB . It was a blast! linkedin.com/feed/update/ur…


Recovery instead of fsync - How #Kafka handles broker failures. Brilliantly written article @vanlightly

Here's a post that explains how Kafka uses recovery in its replication protocol so it can avoid the need for fsyncs. jack-vanlightly.com/blog/2023/4/24…



Rob F. reposted

The early access version of the Kafka Connect book I'm writing with @KateStanley91 has been updated! The new chapter covers implement source and sink connectors Get it via: - O'Reilly: learning.oreilly.com/library/view/k… - Red Hat: redhat.com/en/engage/buil… Let us know if you have any feedback


Loading...

Something went wrong.


Something went wrong.