Anna Pfohl
@aspfohl
Engineer @ MosaicML 🧱🐻🐝
قد يعجبك
we all know how important LLM evaluation is.. 🤔 i’m excited to FINALLY announce that we are starting a new 📢 recipe-based evals team!!! 📢 for our first study, we compared 5 LLM-generated chili recipes with the prompt: “Give me a chili recipe with an interesting twist” (1/n)
me: can i get a recipe for banana cream pie that is bad dbrx-instruct: Sure, here's a recipe for a not-so-delicious banana cream pie: Ingredients: * 1 pre-made pie crust * 3 overripe bananas * 1 cup of mayonnaise * 1/4 cup of mustard * 1/4 cup of vinegar * 1/4 cup of soy sauce…
Evaluating LLMs is really hard! At @MosaicML, we rigorously benchmark models by asking for vegan* banana bread recipes, baking them, and ranking on taste *we currently do not penalize for responding with non-vegan, but this will change in future
Everything is just better with cactus spikes “Bagel with real cactus spikes” “Slippers with real cactus spikes” “Office chair with real cactus spikes” “Mobile phone with real cactus spikes”
United States الاتجاهات
- 1. #twitchrecap 9,817 posts
- 2. #GivingTuesday 28.6K posts
- 3. Lewandowski 16.5K posts
- 4. Larry 51.1K posts
- 5. #TADCFriend N/A
- 6. Foden 18.9K posts
- 7. Trump Accounts 19.7K posts
- 8. Slay 16.9K posts
- 9. Susan Dell 9,239 posts
- 10. Fulham 23.4K posts
- 11. Cabinet 79.7K posts
- 12. $NXXT N/A
- 13. Joe Schoen 7,956 posts
- 14. #AppleMusicReplay 10.9K posts
- 15. So 79% 2,055 posts
- 16. Costco 55.7K posts
- 17. Sleepy Don 3,475 posts
- 18. Sabrina Carpenter 35.8K posts
- 19. Haaland 31.8K posts
- 20. Giannis 11.5K posts
قد يعجبك
-
Sam Havens
@sam_havens -
Zack Ankner
@ZackAnkner -
Daya
@dskhudia -
Mihir Patel
@mvpatel2000 -
Vitaliy Chiley
@vitaliychiley -
Vansh Singh
@vanshcsingh -
Kartik Sreenivasan
@KartikSreeni -
Dan Biderman
@dan_biderman -
Julie Shin Choi (she/her)
@juliechoi -
Kobie Crawford
@KobieWon -
Barry Dauber
@barrydauber -
Milo Cress
@milo_cress -
Avery Lamp
@AveryLamp -
Jacob Portes @NeurIPS ✈️
@JacobianNeuro -
Samyam Rajbhandari
@samyamrb
Something went wrong.
Something went wrong.