#edgellm search results
Home-lab gap: Mac Studio has the bandwidth but no CUDA; DGX Spark has CUDA but not the bandwidth. Both have big unified memory for inference, but 7–14B fine-tuning is still bandwidth-bound. We need Studio-class bandwidth plus CUDA in one box. #SmallLLM #EdgeLLM #LoRA #QLoRA…
Your end-users have questions. #EdgeLLM has answers. And if it doesn't? It's the easiest update you'll do this week. Find out more at #DellTechWorld.
🎯 Deploying LLMs at the edge? Forget 175B parameters. Try 7B, quantized to 4-bit, pruned, sparsified… And maybe—just maybe—it fits on your server closet. #EdgeLLM #ModelOptimization
Meet us at Theatre C, 12:30 PM today at #DellTechWorld to learn more about our #edgellm solution. We can't wait to share with you how we can help you protect your data, reduce expenses, improve customer experience and more! Stop by the @ruckusnetworks booth after to chat!
with phi-3-medium achieving 78% on MMLU and 8.9 on MT-bench. Phi-3m is an enhanced version of phi-2, emphasizing robustness, security, and conversational formats. #EdgeLLM
Your phone’s Neural Engine is about to run an LLM that fixes meetings, texts the doctor, and works offline. Siri+ is almost here. 🤯📲 #SiriPlus #EdgeLLM #AppleAI medium.com/p/top-10-micro…
Cloud-based LLMs are powerful tools, but they come with some massive drawbacks when attempting to use them with proprietary datasets. Concerns about privacy, cost, and the dynamic nature of data are considerable Our new #EdgeLLM solution has those covered. rgnets.com/_assets/The%20…
Home-lab gap: Mac Studio has the bandwidth but no CUDA; DGX Spark has CUDA but not the bandwidth. Both have big unified memory for inference, but 7–14B fine-tuning is still bandwidth-bound. We need Studio-class bandwidth plus CUDA in one box. #SmallLLM #EdgeLLM #LoRA #QLoRA…
Your phone’s Neural Engine is about to run an LLM that fixes meetings, texts the doctor, and works offline. Siri+ is almost here. 🤯📲 #SiriPlus #EdgeLLM #AppleAI medium.com/p/top-10-micro…
🎯 Deploying LLMs at the edge? Forget 175B parameters. Try 7B, quantized to 4-bit, pruned, sparsified… And maybe—just maybe—it fits on your server closet. #EdgeLLM #ModelOptimization
Cloud-based LLMs are powerful tools, but they come with some massive drawbacks when attempting to use them with proprietary datasets. Concerns about privacy, cost, and the dynamic nature of data are considerable Our new #EdgeLLM solution has those covered. rgnets.com/_assets/The%20…
Meet us at Theatre C, 12:30 PM today at #DellTechWorld to learn more about our #edgellm solution. We can't wait to share with you how we can help you protect your data, reduce expenses, improve customer experience and more! Stop by the @ruckusnetworks booth after to chat!
Your end-users have questions. #EdgeLLM has answers. And if it doesn't? It's the easiest update you'll do this week. Find out more at #DellTechWorld.
.@Arm has launched the Ethos-U85, a bigger brother to the U55 and U65, intended to bring LLM acceleration (albeit for tiny LLMs, ~1B) to IoT devices. More on Ethos-U85's third gen architecture and new features in the article: #edgellm #llm #ai #edgeai eetimes.com/arm-brings-tra…
with phi-3-medium achieving 78% on MMLU and 8.9 on MT-bench. Phi-3m is an enhanced version of phi-2, emphasizing robustness, security, and conversational formats. #EdgeLLM
Home-lab gap: Mac Studio has the bandwidth but no CUDA; DGX Spark has CUDA but not the bandwidth. Both have big unified memory for inference, but 7–14B fine-tuning is still bandwidth-bound. We need Studio-class bandwidth plus CUDA in one box. #SmallLLM #EdgeLLM #LoRA #QLoRA…
Meet us at Theatre C, 12:30 PM today at #DellTechWorld to learn more about our #edgellm solution. We can't wait to share with you how we can help you protect your data, reduce expenses, improve customer experience and more! Stop by the @ruckusnetworks booth after to chat!
Something went wrong.
Something went wrong.
United States Trends
- 1. Veterans Day 382K posts
- 2. Woody 13.2K posts
- 3. #stateofplay 7,233 posts
- 4. Toy Story 5 18.2K posts
- 5. Tangle and Whisper 1,293 posts
- 6. Nico 143K posts
- 7. Luka 84.6K posts
- 8. Gambit 42.9K posts
- 9. Travis Hunter 3,959 posts
- 10. Payne 12.3K posts
- 11. SBMM 1,517 posts
- 12. Tish 5,467 posts
- 13. Square Enix 5,231 posts
- 14. Mavs 33K posts
- 15. Sabonis 3,891 posts
- 16. Vets 33.9K posts
- 17. Wike 124K posts
- 18. De Minaur 2,669 posts
- 19. Antifa 192K posts
- 20. Jonatan Palacios 2,352 posts