felixcantcode's profile picture. generating values for stakeholders, internet plumber, http://mu2mi.com, blog: https://felixng.me

opinions are of my own

Felix Nguyen

@felixcantcode

generating values for stakeholders, internet plumber, http://mu2mi.com, blog: https://felixng.me opinions are of my own

Felix Nguyen 已轉發

nanochat now has a primordial identity and can talk a bit about itself and its capabilities (e.g. it knows it's nanochat d32 that cost $800, that it was built by me, that it can't speak languages other than English too well and why, etc.). This kind of customization is all done…

I fixed it :) deployed live now. This was done by doing a round of synthetic data generation to collect a 1000 multi-turn conversations (given a bunch of information including the readme of the nanochat project), and then mixing that into midtraining and SFT. fun!

karpathy's tweet image. I fixed it :) deployed live now. This was done by doing a round of synthetic data generation to collect a 1000 multi-turn conversations (given a bunch of information including the readme of the nanochat project), and then mixing that into midtraining and SFT. fun!


Felix Nguyen 已轉發

In Rust, how the borrow-checker shapes your API inputs and outputs .. The general design principle is to choose signatures that minimize ownership churn while keeping call sites clean and safe. Accepting input • Borrow when you only read: `fn parse(src: &str)` • Borrow…

debasishg's tweet image. In Rust, how the borrow-checker shapes your API inputs and outputs ..

The general design principle is to choose signatures that minimize ownership churn while keeping call sites clean and safe.

Accepting input

• Borrow when you only read: `fn parse(src: &str)`
• Borrow…
debasishg's tweet image. In Rust, how the borrow-checker shapes your API inputs and outputs ..

The general design principle is to choose signatures that minimize ownership churn while keeping call sites clean and safe.

Accepting input

• Borrow when you only read: `fn parse(src: &str)`
• Borrow…

Felix Nguyen 已轉發

NVIDIA over USB4 on MacBook is ready to try! * ADT-UT3G dock + any 30/40/50 series GPU * Disable SIP * Install driver `extra/usbgpu/tbgpu` * Install NVK compiler `brew install tinymesa` * Test with: `DEBUG=2 NV_NAK=1 NV=1 python3 test/test_tiny.py TestTiny.test_plus`

__tinygrad__'s tweet image. NVIDIA over USB4 on MacBook is ready to try!

* ADT-UT3G dock + any 30/40/50 series GPU
* Disable SIP
* Install driver `extra/usbgpu/tbgpu`
* Install NVK compiler `brew install tinymesa`
* Test with:
`DEBUG=2 NV_NAK=1 NV=1 python3 test/test_tiny.py TestTiny.test_plus`

Felix Nguyen 已轉發

Sharding. Database sharding is one of the common techniques to scale a database horizontally. You split the db into small parts called shards and distribute them across machines. Shards are typically in the few hundreds or even thousands (for extremely large databases). Usually…


Felix Nguyen 已轉發

(1/2) i felt like no one actually teaches you a good framework for how to read (ML) papers well + fast, so i wrote this 5-minute read tldr: because so many papers suck, here's how to go through them quickly and revisit the good ones

masonwang025's tweet image. (1/2) i felt like no one actually teaches you a good framework for how to read (ML) papers well + fast, so i wrote this 5-minute read

tldr: because so many papers suck, here's how to go through them quickly and revisit the good ones

Felix Nguyen 已轉發

I just published the full guide to building forms with the Field component: - TanStack Form & React Hook Form - Zod validation and displaying errors - Practical examples we’ll actually use - Inputs, Radios, Fieldset, Arrays & more Check it out. Link below.


Felix Nguyen 已轉發

in the lectures below, i hold your hand through low-level LLM systems engineering. it includes everything up to TODAY! 1) pytorch tensors 2) large matmul on cpu vs gpu 3) JAX (and why xAI uses it instead of pytorch) 4) raw cuda kernels and global threading indexing 5) triton…


Felix Nguyen 已轉發

Tomorrow

dwarkesh_sp's tweet image. Tomorrow

Felix Nguyen 已轉發

Real time brainrot labeling powered by fal 😼


Felix Nguyen 已轉發

Excited to release new repo: nanochat! (it's among the most unhinged I've written). Unlike my earlier similar repo nanoGPT which only covered pretraining, nanochat is a minimal, from scratch, full-stack training/inference pipeline of a simple ChatGPT clone in a single,…

karpathy's tweet image. Excited to release new repo: nanochat!
(it's among the most unhinged I've written).

Unlike my earlier similar repo nanoGPT which only covered pretraining, nanochat is a minimal, from scratch, full-stack training/inference pipeline of a simple ChatGPT clone in a single,…

Felix Nguyen 已轉發

My book simplifies Go internals as much as possible, so it's very easy to understand. If you still don't get it, it's Go's fault 🙈

func25's tweet image. My book simplifies Go internals as much as possible, so it's very easy to understand. If you still don't get it, it's Go's fault 🙈

Felix Nguyen 已轉發

I started at @thinkymachines today Looking forward to a lot of thoughtful work and thrilled to be contributing to their mission of advancing collective science

ekzhang1's tweet image. I started at @thinkymachines today

Looking forward to a lot of thoughtful work and thrilled to be contributing to their mission of advancing collective science

Felix Nguyen 已轉發

My favourite addition to prompts is: "Be extremely concise. Sacrifice grammar for the sake of concision." MUCH easier to scan, less reading overhead, cheaper to output. Before and after:

mattpocockuk's tweet image. My favourite addition to prompts is:

"Be extremely concise. Sacrifice grammar for the sake of concision."

MUCH easier to scan, less reading overhead, cheaper to output.

Before and after:
mattpocockuk's tweet image. My favourite addition to prompts is:

"Be extremely concise. Sacrifice grammar for the sake of concision."

MUCH easier to scan, less reading overhead, cheaper to output.

Before and after:

Felix Nguyen 已轉發

As an experiment I built a Mac trackpad multi-touch input visualizer. Saw someone mentioning that Unity has support for this. TBH this has been known for 16+ years now. It's basically an undocumented C API, which can be easily accessed via CGO. These API are not accessible via…


is cable management NP-complete 🤔?


why isn't there lightweight, dev-friendly otel alternative written in rust yet?


Felix Nguyen 已轉發

raising VC -> for their slop startup?

gobinoob_'s tweet image. raising VC -> for their slop startup?

United States 趨勢

Loading...

Something went wrong.


Something went wrong.