Generation Evaluation & Metrics Workshop
@gem_workshop
Official Handle of the 💎 Generation Evaluation & Metrics (GEM) workshop (ACL 2021, EMNLP 2022, EMNLP 2023)
Excited🤩for the 3rd GEM Workshop EMNLP 2023! Here's the schedule for Dec 6! (in Singapore🇸🇬time) 9-10:30 Opening Remarks + 6 12min talks 10:30-11🧋Coffee Break 11-12:30🪧Poster Sess 1 12:30-14🍕Break 14-15:30 7 12min talks 15:30-16🧋Covfefe Break :P 16-17:30🪧Poster Sess 2 👇🏻
📢Please help us to spread the word: the GEM human evaluation team is launching a new multilingual shared task on data-to-text generation and summarization. More information at gem-benchmark.com/shared_task. We are looking forward to receiving your submissions! #NLProc #NLP
Finally, @ShuhaibMehri will present his work on instruction tuning for automatic evaluation of generative tasks (arxiv.org/abs/2310.20072) at the GEM workshop on Wed, Dec 6 at 11am SGT. He is applying to grad schools, talk to him if you're recruiting :) 7/7
On my way to @emnlpmeeting soon! Join me at @gem_workshop in Leo 2, 2:30pm on Dec 6 for a presentation about this paper. Thrilled to also contribute as a panelist in @WiNLPWorkshop on "Tackling Misinformation in Generative AI", 11:00am-12:00 in Leo 1 on Dec 6. See you there!
🚨New Preprint: "Generative language models exhibit social identity biases" Did you know LLMs mirror human-like biases, showing human-levels of ingroup solidarity & outgroup hostility? A thread: 📄 arxiv.org/abs/2310.15819 1/7
1⃣ Stop by my poster presentation at the @gem_workshop on Dec 6 at 11:00am-12:30pm if you're interested in evaluating summarization for non-news data and how discourse structures can support applications like summarization across text types aclanthology.org/2023.findings-…
We have three papers led that will be presented at #EMNLP2023 and #GEMWorkshop centered around readability assessment and language model evaluation ✍️📢 Work done by @josephimperial_ and @harish See you in Singapore! 🌃🇸🇬
Excited🤩for the 3rd GEM Workshop EMNLP 2023! Here's the schedule for Dec 6! (in Singapore🇸🇬time) 9-10:30 Opening Remarks + 6 12min talks 10:30-11🧋Coffee Break 11-12:30🪧Poster Sess 1 12:30-14🍕Break 14-15:30 7 12min talks 15:30-16🧋Covfefe Break :P 16-17:30🪧Poster Sess 2 👇🏻
Excited to present our recent work at the GEM 💎Workshop, EMNLP 2023: “Elo Uncovered: Robustness and Best Practices in Language Model Evaluation” w/ @eddotman, @beyzaermis, @sarahookr, @mziizm 📃: arxiv.org/abs/2311.17295
At #EMNLP right now? Check out the GEM💎workshop. A lot of good prompt-based stuff 👇🧵 gem-benchmark.com/workshop
📢'LLMs as SocioTechnical Systems' accepted@TheBigPicture Workshop #EMNLP2023 aclanthology.org/2023.bigpictur… Through previous studies, the paper discusses 5 common ML traps that LLMs fall into proposing ways to address points of LLM failure by gauging from a socio-technical lens.
GEM logistics update: The venue has internet issues and we cannot get a stable zoom connection. If you are scheduled to give a talk in the early session and have the ability to go this afternoon instead let us know and we will reshuffle things. We are continuing to try to join.
Might be slightly last minute, but I’m thrilled to announce that I will also be giving a talk on our paper in the @gem_workshop this afternoon! 🤩 The session will start at 2pm, in room Leo 2, but it will also be co-hosted through zoom. Drop by and say hi! 😁
Off to Singapore 🇸🇬 for #EMNLP2023 !✈️ Here’s a brief snippet of our paper, revealing that ChatGPT naturally depicts Kelly to be a warm person, whereas describing Joseph to be a role model !🤯 Interested in hearing the full story? Check out my poster in Session 6, on 12/10! 🤩
Check out our poster "Robust Tooling and New Resources for Large Language Model Evaluation via Catwalk" at the @gem_workshop (11am - 12.30pm, Dec 6). Visit my collaborators from @allen_ai there too!
Heading to #EMNLP2023 today! Would love to catch up with old friends and meet new folks excited about interpretability, generation, and understanding LM internals 🔧 📜 - My collaborators at @allen_ai are presenting our poster on LM eval at the @gem_workshop at 11am today!
Today and Now!!! Checkout the fantastic talks and posters lined up at #GEM at #EMNLP2023. If you are interested in generation and evaluating it, come join us in room *Leo* for the exciting schedule today 🤩🤩 #NLProc
Excited🤩for the 3rd GEM Workshop EMNLP 2023! Here's the schedule for Dec 6! (in Singapore🇸🇬time) 9-10:30 Opening Remarks + 6 12min talks 10:30-11🧋Coffee Break 11-12:30🪧Poster Sess 1 12:30-14🍕Break 14-15:30 7 12min talks 15:30-16🧋Covfefe Break :P 16-17:30🪧Poster Sess 2 👇🏻
GEM workshop logistics: we are in LEO 2. Up two escalators and a bit of a walk. We have a rocket chat channel #gem-workshop we will monitor for questions. See you soon!
Checkout the schedule for the GEM workshop below and the awesome posters lined up! 👇 December 6 -> 9 am Singapore time!
Excited🤩for the 3rd GEM Workshop EMNLP 2023! Here's the schedule for Dec 6! (in Singapore🇸🇬time) 9-10:30 Opening Remarks + 6 12min talks 10:30-11🧋Coffee Break 11-12:30🪧Poster Sess 1 12:30-14🍕Break 14-15:30 7 12min talks 15:30-16🧋Covfefe Break :P 16-17:30🪧Poster Sess 2 👇🏻
Looking forward to the GEM workshop at EMNLP ( @gem_workshop) where 45 papers on evaluation, generation and metrics were accepted this year! As AC I only saw 6 of them so far, and all the accepted ones presented interesting approaches and valuable contributions - don't miss!
United States Trends
- 1. #StrangerThings5 250K posts
- 2. Thanksgiving 676K posts
- 3. BYERS 57.1K posts
- 4. robin 92.6K posts
- 5. Reed Sheppard 5,936 posts
- 6. Afghan 288K posts
- 7. holly 64.6K posts
- 8. Podz 4,520 posts
- 9. Dustin 89.9K posts
- 10. Vecna 59K posts
- 11. National Guard 663K posts
- 12. Jonathan 75.3K posts
- 13. hopper 16K posts
- 14. Erica 17.6K posts
- 15. Lucas 83.4K posts
- 16. Nancy 68.6K posts
- 17. Gonzaga 8,519 posts
- 18. Joyce 32.2K posts
- 19. noah schnapp 8,991 posts
- 20. Tini 9,616 posts
Something went wrong.
Something went wrong.