Axolotl AI

@axolotl_ai

Axolotl is the premier open source LLM fine tuning framework. find us on discord https://discord.gg/cq8QGrh9mC or email us at [email protected]

San Francisco, CA

axolotl.ai

Se unió en Diciembre de 2023

99Posts 2KSeguidores 55Siguiendo

Fijado

Axolotl AI

@axolotl_ai

8 ago

We're thrilled to announce Axolotl v0.12.0. We're ramping up our distributed training featureset with ND parallel multi-node training, and FP8 support. We've also added fine-tuning for gpt-oss, FSDP support for TiledMLP, and many more exciting features. 1/5

axolotl_ai's tweet image. We're thrilled to announce Axolotl v0.12.0. We're ramping up our distributed training featureset with ND parallel multi-node training, and FP8 support. We've also added fine-tuning for gpt-oss, FSDP support for TiledMLP, and many more exciting features.
1/5

Axolotl AI reposteó

Baseten

@basetenco

19 ago

Want to fine-tune gpt-oss-120b? We teamed up with Axolotl to launch a new recipe to run fine-tuning out of the box — multi-node training, one-line deployments from the CLI, and built-in observability included.

basetenco's tweet image. Want to fine-tune gpt-oss-120b?

We teamed up with Axolotl to launch a new recipe to run fine-tuning out of the box — multi-node training, one-line deployments from the CLI, and built-in observability included.

Axolotl AI reposteó

Matej Sirovatka

@m_sirovatka

8 ago

Finally, we also release a blogpost 📖, explaining these strategies in a comprehensive manner, comparing them to each another and explaining how they combine. This also comes with amazing visualisations and tips on when to you use which combination! huggingface.co/blog/accelerat… 4/5

Accelerate ND-Parallel: A guide to Efficient Multi-GPU Training

Fuente: huggingface.co

Axolotl AI reposteó

Matej Sirovatka

@m_sirovatka

8 ago

We have cooked some something nice with @axolotl_ai for 🤗 accelerate v1.10. Have you ever wanted to train a large model, but couldn't setup your env? Current multi-gpu frameworks are hard to install, the configuration has like 100 options. Here comes ParallelismConfig 🚀 1/5 🧵

m_sirovatka's tweet image. We have cooked some something nice with @axolotl_ai for 🤗 accelerate v1.10.
Have you ever wanted to train a large model, but couldn't setup your env? Current multi-gpu frameworks are hard to install, the configuration has like 100 options. Here comes ParallelismConfig 🚀 1/5 🧵

Axolotl AI reposteó

Red Hat AI

@RedHat_AI

18 jun

🚨 Introducing the Axolotl-LLM Compressor integration, designed to make fine-tuning sparse models easier and more efficient than ever! Now you can fine-tune sparse models for specific data while preserving their sparse structure and recovering any accuracy lost during pruning.…

RedHat_AI's tweet image. 🚨 Introducing the Axolotl-LLM Compressor integration, designed to make fine-tuning sparse models easier and more efficient than ever! Now you can fine-tune sparse models for specific data while preserving their sparse structure and recovering any accuracy lost during pruning.…

Axolotl AI reposteó

Thomas Capelle

@capetorch

15 jun

Training qwe3 with qwen2.5 template works just fine. Way easier to make everything work, and just one line change in @axolotl_ai

capetorch's tweet image. Training qwe3 with qwen2.5 template works just fine. Way easier to make everything work, and just one line change in @axolotl_ai

Axolotl AI reposteó

Koyeb

@gokoyeb

11 jun

Looking to fine-tune models? Meet @axolotl_ai 💚 an open-source tool that simplifies the entire fine-tuning pipeline. Learn how to get started with our tutorial covering how to fine-tune Llama 3 🦙 koyeb.com/tutorials/usin…

gokoyeb's tweet card. Learn how to fine-tune Llama 3 using Axolotl. This hands-on guide covers setup, configuration with YAML, LoRA/QLoRA methods, and fine-tuning with serverless GPUs.

Using Axolotl to Fine-Tune Llama 3 on Koyeb Serverless GPUs - Koyeb

Fuente: koyeb.com

Axolotl AI

@axolotl_ai

11 jun

Hacker house was in full force last week for @aiDotEngineer with events with @runpod_io plus collab with @googlecloud... sailing with team + @capetorch visits @SHACK15sf ... ⛵️🔥 😊