Pascal Seitz
@pascal_seitz
Rust Software/Search Engine Engineer @Quickwit_Inc Creator of lz4_flex https://github.com/pseitz/lz4_flex
قد يعجبك
Binance built a 100PB log service with Quickwit, indexing logs at 1.6PB/day Their engineers migrated petabyte-scale Elasticsearch clusters to Quickwit, cutting compute costs by 5x & storage costs by 20x Very proud of our collaboration ❤️. Read more => quickwit.io/blog/quickwit-…
Ever stumbled upon a performance quirk that left you puzzled? 🤔 @pascal_seitz from @Quickwit_Inc did: just allocating unused memory led to a 2x performance boost! 📈 Be ready to dive into the intricate process behind this unexpected perf. gain! 🦀 quickwit.io/blog/performan…
quickwit.io
When allocating unused memory boosts performance by 2x
Term aggregations are one of the key aggregations in our search engine quickwit.
Super proud to work with @zackkanter, @ShortJared, and @stedi engineers to power their multi-tenant log search with Quickwit Lambdas. "It scales from zero cost at rest to practically infinite volume." ❤️❤️❤️ Thank you for choosing @Quickwit_Inc !
tantivy 0.22 has been released tantivy 0.22 is backward-compatible to tantivy 0.21 and contains: - Top Hits Aggregation - Term Aggregation on Bool, Date and Ip Addresses - Performance Improvements on Search and Indexing - Stability Fixes quickwit.io/blog/tantivy-0…
Remember my little puzzle? Here is a blog post explaining the puzzle, its relationship with the usual Top-K algorithm average case complexity, and a better lesser known alternative. quickwit.io/blog/top-k-com…
quickwit.io
A math puzzle and a better algorithm for top-k
A math brain teaser
We are thrilled to announce Quickwit 0.8, which marks a leap forward in scalability, efficiency, and performance 🦀🏇 Quickwit is now running in production at petabytes scale 🔥: - Indexing at 1PB/day, or 13GiB/s - Searching 40 PB of logs - And more! ➡️ quickwit.io/blog/quickwit-…
quickwit.io
Quickwit 0.8: Indexing and Search at Petabyte Scale
Quickwit 0.8 brings indexing and search at an unprecedented scale, indexing at 1PB/day and searching through 50 PB is a reality.
Just got some crazy numbers shared by a Quickwit user. They indexed 40PB of logs into Quickwit, 5x10¹³ log entries, 7.5 PB on S3. And they send this kind message as well ❤️ "Right now, we are in a bull market, and the logs have increased a lot. Luckily Quickwit works very…
💃🏼New blog post about Quickwit's serverless search performance on AWS Lambda & S3 🏇 On the menu: - Latency on search/analytics queries - Impact of Lambda size (1GB to 8GB) - Impact of caching layers - Beautiful charts to illustrate our findings 😍 => quickwit.io/blog/quickwit-…
We have just landed Quickwit’s serverless search based on Amazon Lambda and S3 \o/ You can now scale search to 0, no fixed costs. In comparison, OpenSearch Serverless starts at $700/month. Overall, we estimate the costs to be 50x to 100x cheaper than CloudWatch. And…
I'm very excited to announce the release of Quickwit 0.7, which brings better Elasticsearch API compatibility, better integration with @grafana and @JaegerTracing, and 30% performance gains, This is also a major release as we have witnessed massive performance gains and cost…
💃🏼 Quickwit 0.6 released!🕺🏼 is released! It packs an 𝗘𝗹𝗮𝘀𝘁𝗶𝗰𝘀𝗲𝗮𝗿𝗰𝗵 𝗰𝗼𝗺𝗽𝗮𝘁𝗶𝗯𝗹𝗲 𝗔𝗣𝗜 and a 𝗚𝗿𝗮𝗳𝗮𝗻𝗮 plugin! See more here ⬇️ quickwit.io/blog/quickwit-…
Does @Quickwit already scale? Yes! Thanks for asking! Here is a screenshot @FrancoisMassot just shared. 40 x c5ad.2xlarge nodes = 1.5GB/s of indexing throughput (~$150/month per node) Data is ingested from @apachekafka and the index is stored on @awscloud 's S3
Quickwit hits 0.4: distributed indexing with Kafka, k8s-native, and more! quickwit.io/blog/quickwit-…
🌟Quickwit just reached 2000 stars! The journey to this milestone has been hard, but it wouldn’t be possible without the amazing community that we have today. Thank you everyone. github.com/quickwit-oss/q… #search #selfhosted #rustlang #devops #tech #AWS #analytics #developer
🔎Search through logs and set filters right from UI…like the one here on “severity:ERROR”. 🤿Narrow it down further with date range, fields, etc. #search #selfhosted #rustlang #devops #tech #AWS #analytics #dev #solr #developer
Have you heard of Heaptrack? Check out an amazing blog post by @pascal_seitz on how to investigate memory consumption of your Rust program and how he optimized #memory usage in #Quickwit! quickwit.io/blog/memory-in… #optimize #software #datasets #rustlang
Tantivy 0.17 is out quickwit.io/blog/tantivy-0… via @Quickwit_inc
Quickwit 0.2 has been released! Bringing search to @apachekafka and @ClickHouseDB quickwit.io/blog/quickwit-…
Finally moved tantivy's projects to quickwit-inc repository. github.com/quickwit-inc/
Codec support for fast fields landed in tantivy. This enables different compression strategies depending on the data set. Adding a new codec is straightforward and outlined here github.com/tantivy-search… github.com/tantivy-search… #rustlang #tantivy #lucene #quickwit
United States الاتجاهات
- 1. #Fivepillarstoken 1,457 posts
- 2. Cyber Monday 35K posts
- 3. #IDontWantToOverreactBUT N/A
- 4. #MondayMotivation 8,175 posts
- 5. TOP CALL 10.6K posts
- 6. Alina Habba 12.9K posts
- 7. Good Monday 39.6K posts
- 8. #GivingTuesday 2,015 posts
- 9. Mainz Biomed N/A
- 10. Check Analyze N/A
- 11. Token Signal 2,803 posts
- 12. Victory Monday 1,246 posts
- 13. Market Focus 2,426 posts
- 14. #JungkookxRollingStone 26.3K posts
- 15. New Month 408K posts
- 16. JUST ANNOUNCED 18.2K posts
- 17. Clarie 2,872 posts
- 18. White House Christmas 9,407 posts
- 19. Shopify 3,315 posts
- 20. Brian Walshe N/A
Something went wrong.
Something went wrong.