modularformsboy
@modularformsboy
sun's always shining somewhere: circle the globe with HVDC | also find me at @[email protected]
You might like
Emery Berger at it again charm and humor making really cool tools: "Accelerating Software Development: The LLM (R)evolution" youtube.com/watch?v=dk3y3o…
youtube.com
YouTube
ATC '25 and OSDI '25 -Joint Keynote Address: Accelerating Software...
Terry Tao uses a conversation with an AI to work through the disproof of a new conjecture mathstodon.xyz/@tao/115306424…
“The Shape of Math To Come” (with apologies to Ornette Coleman for the title…) This thread contains slides from (a version of) my talk at last week’s CMSA conference at Harvard, discussing a vision for what research mathematics may look like in the age we now seem to be…
The 3rd edition of my book Deep Learning with Python is being printed right now, and will be in bookstores within 2 weeks. You can order it now from Amazon or from Manning. This time, we're also releasing the whole thing as a 100% free website. I don't care if it reduces book…
Apologies that I haven't written anything since joining Thinking Machines but I hope this blog post on a topic very near and dear to my heart (reproducible floating point numerics in LLM inference) will make up for it!
Today Thinking Machines Lab is launching our research blog, Connectionism. Our first blog post is “Defeating Nondeterminism in LLM Inference” We believe that science is better when shared. Connectionism will cover topics as varied as our research is: from kernel numerics to…
Wait for it. NASA animation. It’s not coincidence, it’s climate change.
To use the Montreal subway, you tap a paper ticket against the turnstile and it opens. But how does it work? And how can the ticket be so cheap that it's disposable? I opened up the tiny NFC chip inside to find out more... 1/15
It’s so crazy how far above record levels the North Atlantic is (the entire Atlantic too actually). This is the sea surface temperature departure from average each March since 1940.
A word of thanks to my supporters and everyone who took the time to verify my claims.
I just made llamafile 1.3x - 5x faster than llama.cpp on CPU for many prompt / image evaluation use cases and hardware. justine.lol/matmul/
Blackwell GPU will have 8TB/s of memory bandwidth? yes please!
100 in February
🌡️100°F/37.8°C recorded today in Killeen (Fort Hood/Gray AAF), TX 🇺🇸! That's only 3°F/1.6°C below the #USA February record. Many monthly records broken in #Nebraska (80°F Omaha), #Iowa (78°F Des Moines), #Minnesota (65°F Minneapolis), etc. #TXwx
amazon.com/dp/B0CRNX9N6W alright team go make me the new michael crichton except also with lots of joyce references
Here are some Apple Silicon stats for llama.cpp You can use these numbers to estimate the performance that you would get on your Mac for typical bs=1 cases github.com/ggerganov/llam…
![ggerganov's tweet card. Summary LLaMA 7B BW [GB/s] GPU Cores F16 PP [t/s] F16 TG [t/s] Q8_0 PP [t/s] Q8_0 TG [t/s] Q4_0 PP [t/s] Q4_0 TG [t/s] ✅ M1 1 68 7 108.21 7.92 107.81 14.19 ✅ M1 1 68 8 117.25 7.91 117.96 14.15 ✅ M1...](https://pbs.twimg.com/card_img/1977297111365410816/dnLrFH_b?format=jpg&name=orig)
Jason was one of my favorite collaborators and he has dropped a new paper
🚨 New paper! 🚨 We introduce System 2 Attention (S2A). - Soft attention in Transformers is susceptible to irrelevant/biased info - S2A uses LLM reasoning to generate what to attend to Improves factuality & objectivity, decreases sycophancy. arxiv.org/abs/2311.11829 🧵(1/5)
Before/after images of the Rio do Sul, Santa Catarina, Brazil recent severe flooding using Google Earth's satellite imagery and Jader Tomazi's aerial picture. Just terrible.
looking to invest in motivated, industrious young people working on carbon sequestration and sustainable development? my college friend's business partner is closing his first round of debt financing: invest.honeycombcredit.com/campaigns/bomv…
"Satellite observations of one of the world's biggest ecological experiments on the island of Borneo have revealed that replanting logged forests with diverse mixtures of seedlings can significantly accelerate their recovery." phys.org/news/2023-09-r…
United States Trends
- 1. Good Wednesday 24.4K posts
- 2. #LoveYourW2025 159K posts
- 3. #wednesdaymotivation 5,332 posts
- 4. #VxWKOREA 41.3K posts
- 5. Hump Day 9,780 posts
- 6. Markey N/A
- 7. And the Word 75K posts
- 8. #WednesdayWisdom N/A
- 9. #GenV 3,863 posts
- 10. St. Teresa of Avila 1,952 posts
- 11. Happy Hump 5,992 posts
- 12. Raila Odinga 170K posts
- 13. LEE KNOW FOR HARPERS BAZAAR 6,531 posts
- 14. Tami 5,037 posts
- 15. Young Republicans 93.7K posts
- 16. George Floyd 37.5K posts
- 17. Baba 131K posts
- 18. cate 4,706 posts
- 19. Big Mac 11.5K posts
- 20. Yamamoto 52.2K posts
Something went wrong.
Something went wrong.