RonanTech's profile picture. Interested in AI, Machine Learning and all things Tech.

Tweets are my own. RT is not endoresment.

Ronan Naughton

@RonanTech

Interested in AI, Machine Learning and all things Tech. Tweets are my own. RT is not endoresment.

Developers: Welcome to a new era of portable performant on-device AI with Arm Lumex and SME2. • 5x Performance 🚀 • 3x Efficiency🔋 SME2 Unlocks edge AI use cases such as Translation, Speech Recognition, Screen Description, SLMs and many more. @Alipay #Vivo #KleidiAI

🆕 Meet Arm Lumex, our most advanced CSS platform for flagship smartphones and next-gen PCs. Uniting SME2-enabled CPUs with new GPUs and system IP, it delivers up to 5x faster AI performance, fueling smarter, quicker experiences on billions of devices: okt.to/Uc3koJ



Ronan Naughton reposted

🚘 Arm Kleidi has arrived in automotive! Designed to deliver performance optimizations for AI inference workloads running on Arm CPUs, it's driving faster response times & accelerating time-to-market across new applications for software-defined vehicles: okt.to/vbrP9V

Arm's tweet image. 🚘 Arm Kleidi has arrived in automotive!

Designed to deliver performance optimizations for AI inference workloads running on Arm CPUs, it's driving faster response times & accelerating time-to-market across new applications for software-defined vehicles: okt.to/vbrP9V

Arm #KleidiAI and Alibaba MNN have teamed up to accelerate multimodal workloads on Arm-based phones. This unlocks enhanced multimodal AI experiences and faster response times - as shown at #MWC25: newsroom.arm.com/blog/arm-kleid…


Text-to-audio AI is now possible entirely on smartphones on the CPU thanks to @Arm and @Stability AI. Type a description, and generate the perfect audio in seconds, with yet more performance optimizations planned for the future. Get the details:  newsroom.arm.com/blog/stability…


Just 3 more sleeps to #MWC25 We will be showcasing why @Arm is the home of AI on mobile: ● New collaborations with leading AI partners 🤝 ● Innovative mobile demos using the latest AI models 📱 ● More KleidiAI integrations into the most popular AI frameworks 🧩


#KleidiCV takes its place in mobile with #OpenCV 4.11 integration. 🤝 Developers... check out the speedups 🚀

We’ve worked with OpenCV on the first ever KleidiCV integration! 🎉    With 4x performance uplifts on OpenCV 4.11, in Android KleidiCV is enabling faster responses across key computer vision tasks on mobile with no extra developer effort.    Get the details:…

Arm's tweet image. We’ve worked with OpenCV on the first ever KleidiCV integration! 🎉 
 
With 4x performance uplifts on OpenCV 4.11, in Android KleidiCV is enabling faster responses across key computer vision tasks on mobile with no extra developer effort. 
 
Get the details:…


Ronan Naughton reposted

I think running llms on the CPU is actually a really good way to look at year-over-year performance gains on a CPU So here is @Snapdragon 8 gen 2, 8 gen 3, and 8 Elite running R1 Distill Qwen 1.5B in the PocketPal AI benchmark 8G2: 14.18 t/s 8G3: 24.62 t/s 8 Elite: 33.58 t/s

mweinbach's tweet image. I think running llms on the CPU is actually a really good way to look at year-over-year performance gains on a CPU 

So here is @Snapdragon 8 gen 2, 8 gen 3, and 8 Elite running R1 Distill Qwen 1.5B in the PocketPal AI benchmark

8G2: 14.18 t/s
8G3: 24.62 t/s
8 Elite: 33.58 t/s

Ronan Naughton reposted

Jensen just unveiled the new NVIDIA Jetson Orin Nano Super, optimized for on-device AI processing in robots, boasting 70 trillion operations (INT8) per second, 102GB/s memory bandwidth, 25 watts power consumption, and a price of $249.


A nice video from @garyexplains explaining the benefits of AI on CPU and showcasing LLAMA 3.2 1B running on a mobile device 📱. Check it out ⬇️ youtube.com/@GaryExplains


📰 AI News of the day! ➡️ @AIatMeta release quantized LLAMA 3.2 models ➡️ Accelerated by Arm's #KleidiAI library 🤔 Find out more: community.arm.com/arm-community-… A big thank you to the entire Executorch team at AI at Meta for this great collaboration. 🙏


LLAMA3.2 1B provides exceptional performance #onArm Multimodal models will unlock new use cases for mobile users. #Executorch and #KleidiAi will bring performance of these models to the next level. 🚀 Find out more: newsroom.arm.com/news/ai-infere…


Today is the day ➡ #PyTorchConf! I will be there with @Arm. Please reach out to me if you'd like to connect and hear about some of the GenAI solutions we are developing #onArm. hubs.la/Q02LCtFZ0 @PyTorch


We're taking gen AI to the next level with 3 🆕practical demos running entirely on the Armv9 CPU on your smartphone. 1️⃣ Group chat summarization 2️⃣ Voice note summarization 3️⃣ Real-time voice assistant This just scratches the surface of what's possible: newsroom.arm.com/blog/generativ…


Pushing the boundaries on what is possible with AI based video generation!

OpenAI Sora new showcase video is out on YT, This is created by Singaporean artist Niceaunties.



Ronan Naughton reposted

OpenAI Sora new showcase video is out on YT, This is created by Singaporean artist Niceaunties.


United States Trends

Loading...

Something went wrong.


Something went wrong.