cloudysoftwares's profile picture. Compute infrastructure for training AI models at scale.

Cloudy Softwares

@cloudysoftwares

Compute infrastructure for training AI models at scale.

Cloudy Softwares reposted

i miss working on projects like these... we are working on something interesting @cloudysoftwares that will hopefully incentivise more projects like these on the timeline :')

i'm working on an open-source repo that teaches people llm inference optimisations. rn the fastest files on the repo are at 6.5-7k tps, as compared to vllm's 10k for the same batch size. i added a c++ implementation today. feel free to try it out (wip): github.com/naklecha/llm-i…

naklecha's tweet image. i'm working on an open-source repo that teaches people llm inference optimisations. rn the fastest files on the repo are at 6.5-7k tps, as compared to vllm's 10k for the same batch size. i added a c++ implementation today. feel free to try it out (wip):
github.com/naklecha/llm-i…


Cloudy Softwares reposted

i’m all in on @cloudysoftwares. i’ve got some really exciting stuff coming out soon & i’m not saying this lightly - we are just getting started. and as always, i’m genuinely so grateful for all the support i’ve received in the last few months, love y’all. it’s game time!!!


United States Trends

Loading...

Something went wrong.


Something went wrong.