Raju Penmatsa
@iam_rajuptvs
ML Research Engineer @ Hitachi R&D || life long learner || ΠΑΘΕΙ ΜΑΘΟΣ
You might like
It's such an honor, thanks a lot.#Intel Hackathon has been a really life-changing experience.
Great reflection from @iam_rajuptvs and @I_ankursingh. The next generation is inspiring!
so kicked off a baseline training run! currently using 8xL40s, so not the fastest (no nvlink for intra-node). Lets see how it goes.. Currently seeing ~13.1 MFU.
Thank you so much!! just feels like this came at the right time, was just starting to think of doing some pretraining runs after @TheZachMueller 's scratch-to-scale course. (inspired from zach's optimization of MOE). Will probably be on this after work today! Super pumped!
So now that K-Scale Labs has shipped a whole two humanoids in the USA, they are now the #1 USA consumer humanoid Company by units shipped. Incredible.
Thank you so much!! just feels like this came at the right time, was just starting to think of doing some pretraining runs after @TheZachMueller 's scratch-to-scale course. (inspired from zach's optimization of MOE). Will probably be on this after work today! Super pumped!
Excited to release new repo: nanochat! (it's among the most unhinged I've written). Unlike my earlier similar repo nanoGPT which only covered pretraining, nanochat is a minimal, from scratch, full-stack training/inference pipeline of a simple ChatGPT clone in a single,…
I run on one crazy intuition; I can learn anything, I will do it. Even if I have no idea
inspiring stuff!!
btw i’m hiring engineers in nyc (and offering relocation for those beyond) if you want to make powerful technology accessible, if you want to enable more people to bet on themselves, if you admire alexander, engelbart, kay, or papert, if these ideas👇 get you amped, let’s talk
i handed in my resignation letter last friday and decided to leave big tech a lot of you know me as the Amazon MLE guy but i've decided that right now is not the time to be in big tech given that i'm still young and have so much more that I want to learn and build big tech is…
until the work is finished, don’t talk about it. telling others your goals gives you a fake sense of achievement. do the work quietly. let results speak for you.
I spent a day optimizing a small MoE (0.5B param Qwen3 style) training loop as far as it could go, so you don't have to. 61+ hours to Chinchilla down to ~13. Come learn my tricks (oh btw it's free)
At the beginning, it doesn’t matter if your volume of daily work is too small to achieve your long-term goals in the timeframe you want. Eventually, as you build up a habit and your mind and body adapt to whatever it is you’re doing, it will feel easier to ramp up the volume of…
You think the reason why you aren't locked in, making fast progress towards your goals, is because you lack the mental toughness to push yourself that hard. But you're wrong. That's not your problem. The reason why the ball isn't rolling fast is that you refuse to begin getting…
You can change your entire bloodline the moment you realize: what you do next always matters more than what you did last.
"I will do it when I have more time" is how years disappear. Do it now.
love is attention: the transformer taught us something profound: attention is all you need. but maybe we knew this all along, just in a different language. when an LLM processes text, it doesn't read sequentially like we intuitively think. it attends – it looks at every token…
Early career advice: Work harder than you think you can. First, because the more you work, the more context you get, the faster you catch up to speed. Second, because the harder you work the more you increase your capacity to work hard. Just like in cross country, the more miles…
United States Trends
- 1. Austin Reaves 61.2K posts
- 2. #Talus_Labs N/A
- 3. #LakeShow 3,455 posts
- 4. $KITKAT 13.2K posts
- 5. jungkook 569K posts
- 6. Trey Yesavage 40.6K posts
- 7. #PokemonTCGPocket 2,832 posts
- 8. Jake LaRavia 7,581 posts
- 9. Happy Birthday Kat N/A
- 10. Jeremy Lin 1,163 posts
- 11. #LoveIsBlind 4,953 posts
- 12. #MakeOffer 22.4K posts
- 13. Walt 6,617 posts
- 14. Jungwoo 128K posts
- 15. doyoung 91.3K posts
- 16. Rudy 9,399 posts
- 17. Kacie 2,025 posts
- 18. Dodgers in 7 1,739 posts
- 19. Kenny Smith N/A
- 20. Linsanity N/A
Something went wrong.
Something went wrong.