MatX
@MatXComputing
MatX designs hardware tailored for the world’s best AI models: We dedicate every transistor to maximizing performance for large models. Join us: http://matx.com
Introducing MatX: we design hardware tailored for LLMs, to deliver an order of magnitude more computing power so AI labs can make their models an order of magnitude smarter. Our hardware would make it possible to train GPT-4 and run ChatGPT, but on the budget of a small startup.…
I'll be in Toronto and Waterloo over the next week, I'd love to chat and tell you a bit more about what we're doing at MatX (and say hi); please feel free to reach out!
Excited to say I joined @MatXComputing late last year! The team is exceptionally thoughtful and the problems are both difficult and fun: from µarch, compilers, and models, to the systems we are building.
MatX hardware will maximize intelligence per dollar for the world’s largest models. We are a team of 50+ and growing quickly. If you are passionate about building the best chips for LLMs, consider joining us. matx.com/jobs
matx.com
Jobs | MatX
MatX designs hardware tailored for the world's best AI models: we dedicate every transistor to maximizing performance for large models.
MatX is designing chips and systems to 10x the computing power for the world’s largest AI workloads. Today, we are pleased to announce the closing of a >$100M Series A funding round led by @sparkcapital, with participation from @JaneStreetGroup, @danielgross and @natfriedman,…
1. Breakdown of DeepSeek V3 efficiency vs Llama 3: - Better: 11x fewer FLOPs per token, thanks to MoE [37B vs 405B activated params] - Better: 2x faster numerics [fp8 vs bf16 training] - Worse: 0.5x flops utilization [16% vs 33% end-to-end MFU*] - Neutral: similar hardware…
NEW ODD LOTS: Two Veteran Chip Designers Have A Plan To Take On Nvidia @tracyalloway and I talked to @reinerpope and @MikeGunter_, both formerly of Alphabet, about their new company MatX that's aiming to build the ultimate semiconductor just for LLMs bloomberg.com/news/articles/…
I really enjoyed talking about the process and business of semiconductor design with @tracyalloway and @TheStalwart on the Odd Lots podcast. Joe and Tracy were wonderful hosts: They put me at ease and guided the conversation with the lightest of touch. We talked about what doing…
NEW ODD LOTS: Two Veteran Chip Designers Have A Plan To Take On Nvidia @tracyalloway and I talked to @reinerpope and @MikeGunter_, both formerly of Alphabet, about their new company MatX that's aiming to build the ultimate semiconductor just for LLMs bloomberg.com/news/articles/…
MatX will be at MLSys. Come join us at our After Hours in Santa Clara to talk about chips, compilers, partitioning, and optimizing ML models for future hardware. Many of us will be there, including me and @mikegunter_. Tuesday May 14th at 4pm, see matx.com/meetmatx.
We’re releasing seqax, a research-focused LLM codebase that is simple, explicit, and performs well on up to ~100 GPUs/TPUs. Everything you need to edit, from the math, to parallelism, to memory footprint, is all there in 500 lines of JAX code. 🧵 github.com/MatX-inc/seqax
very interesting observation re: aggregation / disaggregation dynamics for startups: "Inside of Google, there were lots of people who wanted changes to the chips for all sorts of things, and it was difficult to focus just on LLMs"
Pleased to be investing in MatX, building AI chips with breakthrough capability: bloomberg.com/news/articles/…
Given exponential increase in training costs, compute multipliers might become the most coveted secrets on earth. Some of those will be in torch.nn; many will be in silicon.
Pleased to be investing in MatX, building AI chips with breakthrough capability: bloomberg.com/news/articles/…
United States Trends
- 1. #DWTS 32.9K posts
- 2. #DWCS 5,723 posts
- 3. #WWENXT 15.3K posts
- 4. Robert 103K posts
- 5. Carrie Ann 3,831 posts
- 6. Haji Wright N/A
- 7. #RHOSLC 3,636 posts
- 8. Elaine 55.6K posts
- 9. #USMNT 1,155 posts
- 10. Roldan 2,046 posts
- 11. Whitney 14.6K posts
- 12. Young Republicans 50.4K posts
- 13. Max Muncy 3,436 posts
- 14. Dylan 32K posts
- 15. Yamamoto 8,947 posts
- 16. Yelich 1,463 posts
- 17. Politico 263K posts
- 18. Mr. Feeny N/A
- 19. Pulisic 1,276 posts
- 20. Danielle 9,544 posts
Something went wrong.
Something went wrong.