i miss working on projects like these... we are working on something interesting @cloudysoftwares that will hopefully incentivise more projects like these on the timeline :')
i'm working on an open-source repo that teaches people llm inference optimisations. rn the fastest files on the repo are at 6.5-7k tps, as compared to vllm's 10k for the same batch size. i added a c++ implementation today. feel free to try it out (wip): github.com/naklecha/llm-i…
i’m all in on @cloudysoftwares. i’ve got some really exciting stuff coming out soon & i’m not saying this lightly - we are just getting started. and as always, i’m genuinely so grateful for all the support i’ve received in the last few months, love y’all. it’s game time!!!
United States 趨勢
- 1. LeBron 45.1K posts
- 2. Cowboys 52.4K posts
- 3. Lions 64.8K posts
- 4. Ferguson 8,257 posts
- 5. Goff 6,635 posts
- 6. #OnePride 6,160 posts
- 7. Sixers 9,357 posts
- 8. #LakeShow 2,074 posts
- 9. #DALvsDET 3,627 posts
- 10. Austin Reaves 6,298 posts
- 11. Gibbs 9,749 posts
- 12. #MissVenezuela2025 8,905 posts
- 13. Shang Tsung 5,742 posts
- 14. Jack Campbell 3,057 posts
- 15. Schotty 1,104 posts
- 16. Turpin 1,633 posts
- 17. Maxey 6,290 posts
- 18. Pat Spencer 2,800 posts
- 19. Brandon Aubrey 3,403 posts
- 20. Warriors 45.2K posts
Something went wrong.
Something went wrong.