Cloudy Softwares
@cloudysoftwares
Compute infrastructure for training AI models at scale.
i miss working on projects like these... we are working on something interesting @cloudysoftwares that will hopefully incentivise more projects like these on the timeline :')
i'm working on an open-source repo that teaches people llm inference optimisations. rn the fastest files on the repo are at 6.5-7k tps, as compared to vllm's 10k for the same batch size. i added a c++ implementation today. feel free to try it out (wip): github.com/naklecha/llm-i…
i’m all in on @cloudysoftwares. i’ve got some really exciting stuff coming out soon & i’m not saying this lightly - we are just getting started. and as always, i’m genuinely so grateful for all the support i’ve received in the last few months, love y’all. it’s game time!!!
United States الاتجاهات
- 1. Good Thursday 29.3K posts
- 2. #thursdayvibes 1,797 posts
- 3. Merry Christmas 67.3K posts
- 4. #JASPER_TouchMV 221K posts
- 5. DataHaven 11.5K posts
- 6. Happy Friday Eve N/A
- 7. JASPER COMEBACK TOUCH 144K posts
- 8. #NationalCookieDay N/A
- 9. #ThursdayThoughts 1,373 posts
- 10. #PutThatInYourPipe N/A
- 11. Hilux 7,882 posts
- 12. Toyota 28.3K posts
- 13. Omar 184K posts
- 14. Earl Campbell 2,363 posts
- 15. Happy Birthday Dan 1,733 posts
- 16. Halle Berry 4,140 posts
- 17. Steve Cropper 8,619 posts
- 18. Nazi Germany 8,096 posts
- 19. Walked 74.9K posts
- 20. Warren Moon 1,781 posts
Something went wrong.
Something went wrong.