你可能會喜歡
We are looking for a post-training lead at @datologyai we have gpus, you can make them go brrrr

Give it a year or two and we will have nanoagent. Then nanoagent speed run. Then nanoASI and so on.
Excited to release new repo: nanochat! (it's among the most unhinged I've written). Unlike my earlier similar repo nanoGPT which only covered pretraining, nanochat is a minimal, from scratch, full-stack training/inference pipeline of a simple ChatGPT clone in a single,…

Here’s a scaling law that matters more: every two years the gap to frontier closes by a factor of 2x
Excited to release new repo: nanochat! (it's among the most unhinged I've written). Unlike my earlier similar repo nanoGPT which only covered pretraining, nanochat is a minimal, from scratch, full-stack training/inference pipeline of a simple ChatGPT clone in a single,…

I’m fairly convinced the first rabbit in a hat trick was an accident



Talk from Wenting Zhao of Qwen on their plans during COLM. Seems like 1 word is the plan still: scaling training up! Let’s go.

Doing some on the ground research on power (football) analysis
Was watching the Georgia game and noticed @dwarkesh_sp, Host of @dwarkeshpodcast was literally on TV 🤯🤯🤯🤯🤯
One day, @code_star will swap profile pics with @willccbb and the world will tremble.
One thing I wonder is, these GPUs are going to remain incredibly powerful and the next generation or two of GPUs are going to be rolled at scales we have never really seen before. Now obviously electricity isn't free, but if we find ourselves with much cheaper electricity in…
Quit hoggin'em all
One thing I wonder is, these GPUs are going to remain incredibly powerful and the next generation or two of GPUs are going to be rolled at scales we have never really seen before. Now obviously electricity isn't free, but if we find ourselves with much cheaper electricity in…
So in like 5 ish years ... what is going to happen to all the H100s ... landfill?
Has something changed … for the better on the algorithm? Definitely noticing more engagement and longer lived tweets. Is nature healing?

just sf tech party things: 3 floors of djs Sam Altman pics on the wall Coworking room (fully packed) Merch trucks (Not pictured) a girl dressed up as an astronaut Props to @BellaNazzari for the very walm welcome to the city 🥂




Lies
I don’t care what fashion designers say, grown men cannot actually wear corduroy pants embroidered with little dogs to work.

<smol> is the way to go
So in like 5 ish years ... what is going to happen to all the H100s ... landfill?
going viral on link*din feels unnatural! but you know what, OpenMed loves to be everywhere! 😈

It’s a great day to watch some football and some loss curves go down


If gradstudents knew what actually worked in training SOTA LLMs they would be so mad
United States 趨勢
- 1. phil 75.2K posts
- 2. phan 74.1K posts
- 3. Columbus 218K posts
- 4. President Trump 1.26M posts
- 5. Kincaid 1,478 posts
- 6. Doug Eddings N/A
- 7. Middle East 319K posts
- 8. Springer 11.1K posts
- 9. Falcons 13.1K posts
- 10. Gilbert 9,560 posts
- 11. Mike McCoy N/A
- 12. Yesavage 3,198 posts
- 13. Martin Sheen 1,317 posts
- 14. Thanksgiving 60K posts
- 15. Monday Night Football 6,544 posts
- 16. John Oliver 9,072 posts
- 17. Macron 243K posts
- 18. Ray Ray 94.7K posts
- 19. Native Americans 20.4K posts
- 20. Indigenous 133K posts
你可能會喜歡
-
Abhi Venigalla
@ml_hardware -
Tri Dao
@tri_dao -
Jonathan Frankle
@jefrankle -
Sam Havens
@sam_havens -
Jan Leike
@janleike -
Matthew Leavitt
@leavittron -
Sharon Y. Li
@SharonYixuanLi -
Ofir Press
@OfirPress -
Vitaliy Chiley
@vitaliychiley -
Mihir Patel
@mvpatel2000 -
Michael Carbin
@mcarbin -
Tom Goldstein
@tomgoldsteincs -
labml.ai
@labmlai -
Mostafa Dehghani
@m__dehghani -
rohan anil
@_arohan_
Something went wrong.
Something went wrong.