Dylan Mitic
@DylanMitic
growing @groqinc | ops czar @chapman_ceo + Econ & CS | Opinions are my own
A few weeks ago, I had the chance to sit down with some of my fellow interns at @GroqInc to share what our internships have been like so far. It was awesome hearing about the different projects, challenges, and takeaways each of us has had while working here. Here’s the lineup:…
With ARC-AGI evals and over 350 benchmarks now available, there’s no reason not to put your models to the test.
OPENBENCH 0.5.0 IS HERE It’s our biggest release yet - We added 350+ new evals, added ARC-AGI support, a plugin system for external benchmarks, provider routing, coding harnesses you can mix and match, tool‑calling evals, and more. Details in thread 🧵
Compute demand is growing roughly 4.5× per year, while chip efficiency (per Moore’s Law) only doubles every two years. Each new generation of models, from AlexNet to GPT-4 and Gemini Ultra, requires orders of magnitude more compute, which is outpacing hardware and energy scaling…
This is BEYOND insane: AI compute demand is now growing at over 2 TIMES the rate of Moore’s Law, creating a massive shortage. Just to meet current demand, $500 billion must be invested in data centers PER YEAR until 2030. What does this mean? Let us explain. (a thread)
Oh sorry! Didn't see you there! I was too busy looking at Groq on the big screen at the @OpenAI DevDay
I’ve been getting a lot of messages “Dylan, you’ve only posted once in two days, are you ok? Are you alive? Are you still AGI pilled?” Yes to all of the above. I’m just sick in the middle of midterms week.
There’s no worse then feeling a cold coming on right before a busy week when you literally can’t be sick.
Nobody knows, but every time this happens, I get a pay cut.
AMD just announced a partnership with OpenAI right after signing one with Nvidia. That tells you everything you need to know about where the industry is heading. No one wants to rely on a single infrastructure provider. Working at Groq, I get the question all the time: “What…
It is crucial that every founder/CEO understand Cosgrove’s Law. An inability to aura farm will lead to the inability to raise rounds, acquire customers, and turn the Mag 7 into the Mag 8. My challenge to all CEOs of major tech companies: wake up tomorrow morning and ask your…
COSGROVE’S LAW: Always Be Aura Farming Aura is upstream of social, political, and financial capital. Everything, at its root, is dependent on social interaction, and aura dominates social interaction. Raising a round? Trying to recruit? Get your aura up first.
I give you permission to take a 2 hour break from the 9-9-7 to listen to bluegrass for free in Golden Gate Park
Todays stats: - 2 cups of coffee - 3 good ideas, 2 bad ones - 8 emails responded to - 1 yerb - 1/2 can of @LucyNicotine - 9 hours of sleep
Why not both? 10x more energy means nothing if inference stays inefficient. And 10x better efficiency won’t matter if we can’t feed the power demand.
This is the crux of the issue! We either need to increase our energy capacity, or make AI inference much more energy-efficient.
This is why at @GroqInc token/joule is so important to us.
It's not about GPUs anymore; it's all about POWER. A comment from a $GOOGL employee working on datacenters: Getting GPUs and TPUs is not a bottleneck. "Power, lack of available power, reliable power has become the biggest bottleneck for us." on @AlphaSenseInc
Just ended my 30 minute interview 25 minutes early. Chat am I cooked?
What do ppl think about ending interviews early, if you already know it's not a fit? Rude or respectful of their time?
United States เทรนด์
- 1. Cowboys 52.3K posts
- 2. Panthers 50.5K posts
- 3. Ravens 55.3K posts
- 4. Dolphins 39.7K posts
- 5. Drake Maye 15.7K posts
- 6. Colts 47.9K posts
- 7. #KeepPounding 3,991 posts
- 8. Eberflus 4,770 posts
- 9. Chargers 44.8K posts
- 10. James Franklin 44.9K posts
- 11. Pickens 15K posts
- 12. Rico Dowdle 4,882 posts
- 13. Penn State 61.1K posts
- 14. Steelers 52.6K posts
- 15. Jets 101K posts
- 16. Diggs 8,076 posts
- 17. Herbert 11.5K posts
- 18. Saints 55.5K posts
- 19. #Browns 3,403 posts
- 20. Pats 8,841 posts
Something went wrong.
Something went wrong.