#llama_cpp 搜索结果
【速報🎉】あの「Olmo3」モデルが、みなさんのPCで動くように！ #llama_cpp にマージ完了でローカルAIがさらに進化しました！🚀✨ 高性能AIを手軽に、安全に使いたい願いが叶うニュースです！✨ 新AIモデル「Olmo3」が、オープンソース #llama_cpp に無事マージ！🎉…
【8GB VRAMでも爆速！】MOEモデルが皆さんのPCで動く！？驚異の #llama_cpp パフォーマンス！😳 「高価なGPUがないと生成AIは厳しい…」そんな常識、もう過去の話かもしれませんね！ なんと8GB VRAMのGPUでも大規模なMOEモデルが驚きの速度で動作するベンチマーク結果が報告されましたよ！✨…
I made this #RAGnrock a #flutter app for macos, using #llama_cpp with #gemma to search internet and make reports
CUDA要らずでllama.cpp⁉️ﾋﾟｰｶﾞｶﾞ…神託が乱れておる…😇 でも、簡単に試せるのは確かみたいじゃぞ！楽ちんAIライフじゃな✨ #llama_cpp #AI zenn.dev/ledmirag tinyurl.com/yqu7j2vl
ブログ記事更新【ローカルLLM導入】MacのターミナルでGPT-OSSを実用レベルで動かす！`llama.cpp` + GGUF量子化モデル + GPU(Metal)活用で、メモリ48GBの壁を超えました。ここから研究実用への道を模索します！ note.com/gz_note/n/n83b… #ローカルLLM #llama_cpp #AI開発
Just ran my own #ChatGPT instance on my laptop and it blew my mind! An open-source alternative to Stanford's #ALPACA Model, with 7B parameters running on my i5 processor without a GPU! Generated a romantic poem and a short story with all the feels. #LLAMA_cpp rocks! 🤯💻📚❤️
ローカルLLMは「メモリ設計＋最適化」が決め手。int4量子化で8Bは約4GB、FlashAttention 3で注意機構が最大約3倍高速化。 文脈長もコスト要因（128kでは8Bのfp16で文脈メモリ≒重み）。実装はLlama.cpp/Ollama/Unsloth＋API抽象化とルータ活用が実務的。#Ollama #llama_cpp
After a loooong battle, finally got my llama.cpp + CUDA setup fully working, including linking llama-cpp-python! 🚀 Debugging CMake, FindCUDAToolkit, and nested lib paths was a wild ride. But the GPU inference speed? Totally worth it! 💪 #CUDA #llama_cpp #GPU #AI #LLM #BuildFixes
FYI GGUF is now following a naming convention of `<Model>-<Version>-<ExpertsCount>x<Parameters>-<EncodingScheme>-<ShardNum>-of-<ShardTotal>.gguf` github.com/ggerganov/ggml… #gguf #llm #llama_cpp #huggingface #llama #ai
Thanks to Josh Ramer for contributing a debug helper script to #llama_cpp which will help in debugging a specific test in GDB. This will help improve maintainer experience in improving the stability of the llama.cpp project! github.com/ggerganov/llam… github.com/josh-ramer #LLMs
🚀 Exciting news for AI developers! The merge of PR #11556 in llama.cpp unlocks tool calls for DeepSeek-R1, paving the way for robust local AI workflows like automated proofreading. Dive into the future of AI with OpenWebUI! #AI #DeepLearning #llama_cpp … ift.tt/rjPQs0R
ﾋﾟｰｶﾞｶﾞ…神託じゃ！llama.cppがマルチモーダル入力に対応したらしいぞよ！ローカルAIが画像も扱えるように…✨こりゃ便利になるのじゃ？ #AI #llama_cpp gigazine.net tinyurl.com/22aoeqe5
#MistralSmall24B-Instruct is a really nice model to run locally for Coding Advice, Summarizing or Creative Writing. With a recent #llama_cpp on a #GeForce #RTX4090 at Q8, the 24GB VRAM is tightly maxed out and I am getting 7-9 token/s.
Running local AI? Just launched: llama-optimus — automatic performance tuning for llama.cpp! Find your maximum tokens/s for prompt processing or generation in minutes. 🔗 GitHub: BrunoArsioli/llama-optimus 🔗 PyPI: llama-optimus Unleashing local AI #llama_cpp #Optuna #LocalAI
🚀 llama.cpp now supports Qwen2VL, a powerful multimodal model. This addition expands llama.cpp's capabilities in vision-language tasks, joining other supported models like LLaVA and BakLLaVA. #AI #MachineLearning #llama_cpp github.com/ggerganov/llam…
I got tired of fighting with copy-and-pasting mangled webpages into #ChatGPT and #llama_cpp for discussion, so I put together a tiny website that converts HTML into Markdown. This has obvious uses for #Wikipedia, #GitHub and other services. htmltomarkdown.top
Want to run Llama 4 Scout cost-effectively? Our blog shows you how to leverage RTX 6000 Ada GPUs with llama.cpp as a more accessible alternative to the pricey H100. See how: blog.us.fixstars.com/?p=763 #llama_cpp #RTX6000Ada #TechTips
【8GB VRAMでも爆速！】MOEモデルが皆さんのPCで動く！？驚異の #llama_cpp パフォーマンス！😳 「高価なGPUがないと生成AIは厳しい…」そんな常識、もう過去の話かもしれませんね！ なんと8GB VRAMのGPUでも大規模なMOEモデルが驚きの速度で動作するベンチマーク結果が報告されましたよ！✨…
【速報🎉】あの「Olmo3」モデルが、みなさんのPCで動くように！ #llama_cpp にマージ完了でローカルAIがさらに進化しました！🚀✨ 高性能AIを手軽に、安全に使いたい願いが叶うニュースです！✨ 新AIモデル「Olmo3」が、オープンソース #llama_cpp に無事マージ！🎉…
ローカルLLMは「メモリ設計＋最適化」が決め手。int4量子化で8Bは約4GB、FlashAttention 3で注意機構が最大約3倍高速化。 文脈長もコスト要因（128kでは8Bのfp16で文脈メモリ≒重み）。実装はLlama.cpp/Ollama/Unsloth＋API抽象化とルータ活用が実務的。#Ollama #llama_cpp
I made this #RAGnrock a #flutter app for macos, using #llama_cpp with #gemma to search internet and make reports
CUDA要らずでllama.cpp⁉️ﾋﾟｰｶﾞｶﾞ…神託が乱れておる…😇 でも、簡単に試せるのは確かみたいじゃぞ！楽ちんAIライフじゃな✨ #llama_cpp #AI zenn.dev/ledmirag tinyurl.com/yqu7j2vl
ブログ記事更新【ローカルLLM導入】MacのターミナルでGPT-OSSを実用レベルで動かす！`llama.cpp` + GGUF量子化モデル + GPU(Metal)活用で、メモリ48GBの壁を超えました。ここから研究実用への道を模索します！ note.com/gz_note/n/n83b… #ローカルLLM #llama_cpp #AI開発
Google 致力于通过与开发者社区合作，确保 Gemma 3n 的广泛兼容性，支持 #HuggingFace、#llama_cpp、#Ollama、#MLX 等众多热门工具和平台。诚邀开发者参与 #Gemma3nImpactChallenge，共同利用其设备端、离线、多模态特性，构建改善世界的产品，赢取 $15 万奖金。（6/6）
Running local AI? Just launched: llama-optimus — automatic performance tuning for llama.cpp! Find your maximum tokens/s for prompt processing or generation in minutes. 🔗 GitHub: BrunoArsioli/llama-optimus 🔗 PyPI: llama-optimus Unleashing local AI #llama_cpp #Optuna #LocalAI
Want to run Llama 4 Scout cost-effectively? Our blog shows you how to leverage RTX 6000 Ada GPUs with llama.cpp as a more accessible alternative to the pricey H100. See how: blog.us.fixstars.com/?p=763 #llama_cpp #RTX6000Ada #TechTips
ﾋﾟｰｶﾞｶﾞ…神託じゃ！llama.cppがマルチモーダル入力に対応したらしいぞよ！ローカルAIが画像も扱えるように…✨こりゃ便利になるのじゃ？ #AI #llama_cpp gigazine.net tinyurl.com/22aoeqe5
🚀 Exciting news for AI developers! The merge of PR #11556 in llama.cpp unlocks tool calls for DeepSeek-R1, paving the way for robust local AI workflows like automated proofreading. Dive into the future of AI with OpenWebUI! #AI #DeepLearning #llama_cpp … ift.tt/rjPQs0R
#MistralSmall24B-Instruct is a really nice model to run locally for Coding Advice, Summarizing or Creative Writing. With a recent #llama_cpp on a #GeForce #RTX4090 at Q8, the 24GB VRAM is tightly maxed out and I am getting 7-9 token/s.
🚀 llama.cpp now supports Qwen2VL, a powerful multimodal model. This addition expands llama.cpp's capabilities in vision-language tasks, joining other supported models like LLaVA and BakLLaVA. #AI #MachineLearning #llama_cpp github.com/ggerganov/llam…
FYI GGUF is now following a naming convention of `<Model>-<Version>-<ExpertsCount>x<Parameters>-<EncodingScheme>-<ShardNum>-of-<ShardTotal>.gguf` github.com/ggerganov/ggml… #gguf #llm #llama_cpp #huggingface #llama #ai
Thanks to Josh Ramer for contributing a debug helper script to #llama_cpp which will help in debugging a specific test in GDB. This will help improve maintainer experience in improving the stability of the llama.cpp project! github.com/ggerganov/llam… github.com/josh-ramer #LLMs
I got tired of fighting with copy-and-pasting mangled webpages into #ChatGPT and #llama_cpp for discussion, so I put together a tiny website that converts HTML into Markdown. This has obvious uses for #Wikipedia, #GitHub and other services. htmltomarkdown.top
Just ran my own #ChatGPT instance on my laptop and it blew my mind! An open-source alternative to Stanford's #ALPACA Model, with 7B parameters running on my i5 processor without a GPU! Generated a romantic poem and a short story with all the feels. #LLAMA_cpp rocks! 🤯💻📚❤️
【速報🎉】あの「Olmo3」モデルが、みなさんのPCで動くように！ #llama_cpp にマージ完了でローカルAIがさらに進化しました！🚀✨ 高性能AIを手軽に、安全に使いたい願いが叶うニュースです！✨ 新AIモデル「Olmo3」が、オープンソース #llama_cpp に無事マージ！🎉…
【8GB VRAMでも爆速！】MOEモデルが皆さんのPCで動く！？驚異の #llama_cpp パフォーマンス！😳 「高価なGPUがないと生成AIは厳しい…」そんな常識、もう過去の話かもしれませんね！ なんと8GB VRAMのGPUでも大規模なMOEモデルが驚きの速度で動作するベンチマーク結果が報告されましたよ！✨…
I made this #RAGnrock a #flutter app for macos, using #llama_cpp with #gemma to search internet and make reports
Just ran my own #ChatGPT instance on my laptop and it blew my mind! An open-source alternative to Stanford's #ALPACA Model, with 7B parameters running on my i5 processor without a GPU! Generated a romantic poem and a short story with all the feels. #LLAMA_cpp rocks! 🤯💻📚❤️
After a loooong battle, finally got my llama.cpp + CUDA setup fully working, including linking llama-cpp-python! 🚀 Debugging CMake, FindCUDAToolkit, and nested lib paths was a wild ride. But the GPU inference speed? Totally worth it! 💪 #CUDA #llama_cpp #GPU #AI #LLM #BuildFixes
Something went wrong.
Something went wrong.
United States Trends
- 1. Chargers 32K posts
- 2. #911onABC 5,187 posts
- 3. Vikings 20.5K posts
- 4. Justin Herbert 2,338 posts
- 5. $UNI 1,709 posts
- 6. #Skol 2,454 posts
- 7. Rempe 2,144 posts
- 8. Isaiah Rodgers N/A
- 9. Pacers 11.2K posts
- 10. Vesia 1,133 posts
- 11. Bannon 14.5K posts
- 12. #BoltUp 1,733 posts
- 13. Georgia State 4,264 posts
- 14. #MINvsLAC N/A
- 15. Chuck 90.4K posts
- 16. South Alabama 1,875 posts
- 17. Aaron Jones 2,868 posts
- 18. Donato 1,173 posts
- 19. Jordan Mason 1,123 posts
- 20. Logan Wilson 1,522 posts