MatthiasJSax's profile picture. Software Engineer @ConfluentInc | GM of @KafkaStreams | @TheASF Member, Committer & PMC member (@ApacheKafka, @ApacheFlink, @ApacheStorm)

Matthias J. Sax 🦦

@MatthiasJSax

Software Engineer @ConfluentInc | GM of @KafkaStreams | @TheASF Member, Committer & PMC member (@ApacheKafka, @ApacheFlink, @ApacheStorm)

Matthias J. Sax 🦦 أعاد

Just published my #KafkaStreams news summary! 🔥 Highlights: 4.1.1 bug-fix release, upcoming DLQ feature for Kafka Streams, new Streams UI in Confluent Cloud, Current sessions, & more. kafkastreamsfieldguide.com/articles/kafka… #ApacheKafka


Matthias J. Sax 🦦 أعاد

We are happy to share that the Apache Kafka 4.1.1 bug-fix release is now available! It contains a critical memory-leak fix for #KafkaStreams and many other fixes. For details see kafka.apache.org/blog#apache_ka… Thanks to 32 contributors and Lianet Magrans as our RM.


#ApacheKafka did grow up over the years, and conference talks changed accordingly... -- If you like to nerd out, "The Kafka Protocol Destructed" talk by Mateo Rojas from LittleHorse is a refreshing change back to the roots! current.confluent.io/post-conferenc…


Matthias J. Sax 🦦 أعاد

I am now actively looking for new roles. (Available to interview for the next two weeks or in January) Anyone solving cool and complex technical problems and is looking for seasoned (15+ years) backend engineer who can: - Learn quickly - Solve big hairy problems - Lead company…


Repeat after me: Kafka TX timeout is not a producer liveness check, but a guard against head of line blocking for read-committed consumers.


Including “Strengthening Kafka Streams Operations and Observability” — If you are using #KafkaStreams on Confluent Cloud you should check out the announcement.

Want to build a reliable AI application? 🤖 Make sure trustworthy streaming data is at its core. From Confluent Intelligence to a line-up of Tableflow upgrades, find out how our powerful new additions to the world’s data streaming platform can help you do just that:…



#KafkaStreams is at the core of Metronome. "There is some talks we've given[...] on what it looks like to run KS at scale." -- "We are storing TBs of state in RocksDB." A very advanced deployment requiring careful engineering. But the library approach shines! Check it out.

In this episode of Life Is But A Stream, Joseph Morais (@thedatagiant) talks with Cosmo Wolfe, CTO at @getmetronome, about how Confluent’s data streaming platform powers real-time billing and monetization at scale. From second-level latency to sub-second fraud detection, this…



Also congrats to our friends from @Michelin Excited to see their DLQ feature for #KafkaStreams being included in the upcoming #ApacheKafka 4.2.0 release. #Current #DataStreamingAwards current.confluent.io/data-streaming…


Matthias J. Sax 🦦 أعاد

If you find yourself in SF next week, @almoggavra is talking about SlateDB at the SF Systems Meetup on Wednesday!

criccomini's tweet image. If you find yourself in SF next week, @almoggavra is talking about SlateDB at the SF Systems Meetup on Wednesday!

Matthias J. Sax 🦦 أعاد

Almog Gavra will show how Imprint handles merging/projecting records 10x faster than existing formats and offers a new way of reasoning about schemas in the world of data pipelines at @P99CONF on October 22-23. Save your spot > ow.ly/ts3o50WXGl3 #ScyllaDB #P99CONF


Hard agree! — But I would not limit it to infrastructure / distributed systems engineering…

It is impossible to call yourself an experienced infrastructure/distributed systems engineer if you have consistently switched jobs every two years. You become a rockstar engineer by building complex infrastructure, operating them at scale, migrating users, fixing issues and…



Matthias J. Sax 🦦 أعاد

🧵RocksDB Universal Compaction Scale Limit In Universal Compaction, you can end up with a single SST file that contains your whole DB (100+ GB)...but in level compaction you control the SST file size with a target_file_size and target_file_size_multiplier (acrosss levels)


Matthias J. Sax 🦦 أعاد

I'm speaking at Current at the end of the month!

bbejeck's tweet image. I'm speaking at Current at the end of the month!

Happy to share, that we did release an update to our @kafkastreams UI in @confluentcloud We are now showing more detailed information about instances, threads, running/rebalancing state, and JMX metrics. Check it out and let us know what you think! confluent.io/blog/monitor-k…


Matthias J. Sax 🦦 أعاد

We are excited to announce the Apache Kafka 4.0.1 bug-fix release, containing over 40 fixes! Thanks to 53 contributors and your RM @christo_lolov. For more details, checkout the announcement: kafka.apache.org/blog#apache_ka…


Loading...

Something went wrong.


Something went wrong.