Felix Nguyen
@felixcantcode
generating values for stakeholders, internet plumber, http://mu2mi.com, blog: https://felixng.me opinions are of my own
Announcing: New @Steam Hardware, coming in 2026: Steam Controller Steam Machine Steam Frame Watch our jazzy announcement video and wishlist now: steampowered.com/hardware
Shopify teams are using AI to announce their internal tools is one of the most delightful side effects of the AI age. This one is too fun not to share
the real RL algo youtu.be/PcWnQ7fYzwI?si…
youtube.com
YouTube
I taught an octopus piano (It took 6 months)
pewds is learning programming. what's your excuse? youtube.com/watch?v=qw4fDU…
youtube.com
YouTube
STOP. Using AI Right now
Training LLMs end to end is hard. Very excited to share our new blog (book?) that cover the full pipeline: pre-training, post-training and infra. 200+ pages of what worked, what didn’t, and how to make it run reliably huggingface.co/spaces/Hugging…
Please steal my AI research ideas. This is a list of research questions and concrete experiments I would love to see done, but don't have bandwidth to get to. If you are looking to break into AI research (e.g. as an undergraduate, or a software engineer in industry), these are…
New blog post: The bug that taught me more about PyTorch than years of using it started with a simple training loss plateau... ended up digging through optimizer states, memory layouts, kernel dispatch, and finally understanding how PyTorch works!
Our latest post explores on-policy distillation, a training approach that unites the error-correcting relevance of RL with the reward density of SFT. When training it for math reasoning and as an internal chat assistant, we find that on-policy distillation can outperform other…
one of the often overlooked factors behind deepseek’s success lies in how the team built their distributed infrastructure from the ground up (despite severe gpu constraints!). their custom communication library hfreduce replaced nccl and delivered substantially higher bandwidth…
You know how if you spend the whole day sitting on the couch watching TV, you get kind of restless yet somehow also too tired to get off your butt? Like you're tired *of* doing nothing, yet you're also tired *from* doing nothing? You know what I'm talking about, the state of…
Some patterns on how iterators in Rust play well with the borrow checker - Iterator-friendly APIs, Borrow splitting and reborrowing .. Iterators prefer borrows Iterators often yield references to avoid allocation: Keep using an iterator after borrowing it Use `by_ref()` to…
I have fine-tuned over 100 different LLMs/VLMs for various use cases over the last 1–2 years, and here is my framework whenever I pick a new project or problem statement: 1. Benchmark/Evals Any problem you are solving for should have an evaluation set that you can easily…
What should I name this plugin?
can this be an extension in vscode, it just freezes your vscode randomly and plays phonk
Last night I taught nanochat d32 how to count 'r' in strawberry (or similar variations). I thought this would be a good/fun example of how to add capabilities to nanochat and I wrote up a full guide here: github.com/karpathy/nanoc… This is done via a new synthetic task…
full workflow with training & converting to hf tokenizers: github.com/thepowerfuldee…
Of ~200 books I've read, the few that stayed with me over time and I find myself often thinking back to or referring to, in ~random order: All short stories by Ted Chiang, especially Exhalation, Division By Zero, Understand, The Story of Your Life, Liking What You See, The…
United States Tendances
- 1. Justin Fields 9,404 posts
- 2. #FinallyOverIt 1,669 posts
- 3. Jets 67.3K posts
- 4. Patriots 145K posts
- 5. Drake Maye 19.4K posts
- 6. Jalen Johnson 6,002 posts
- 7. Henderson 21.5K posts
- 8. Summer Walker 10.3K posts
- 9. Judge 187K posts
- 10. AD Mitchell 2,307 posts
- 11. 5sos 17.4K posts
- 12. Pats 14.2K posts
- 13. #criticalrolespoilers 2,474 posts
- 14. Diggs 10.4K posts
- 15. Cal Raleigh 7,561 posts
- 16. Santana 13.7K posts
- 17. 1-800 Heartbreak N/A
- 18. #GreysAnatomy 2,099 posts
- 19. #zzzSpecialProgram 1,040 posts
- 20. #TNFonPrime 3,403 posts
Something went wrong.
Something went wrong.