Eval4NLP
@eval4nlp
Workshop on Evaluation and Comparison of NLP Systems, co-located with #AACL2025.
You might like
📢📢 This year Eval4NLP is co-located with #aacl2025. Our CFP is now out: eval4nlp.github.io/2025/cfp.html Paper submission deadline: September 29, 2025. Direct submission via OpenReview. ARR commitment deadline: October 27, 2025 Notification of acceptance: November 3, 2025
Two more days left to apply 👇👇 x.com/NLLG_lab/statu…
📢📢👇New job openings. Topic: social bias detection+analysis with LLMs across time (1950-now) & languages. There are 2 Post-Doc/PhD positions, supervised by @egere14 (@utn_nuremberg)+Simone Ponzetto (@dwsunima). Fully funded, up to 3 yrs. More infos: nl2g.github.io/positions
📢📢📢The NLLG lab has three new open fully funded PhD positions: 1⃣ - Next Generation LLMs 2⃣ - NLP for Science 3⃣ - Multimodal evaluation metrics Deadlines: End of October ℹ️More information: nl2g.github.io/positions
📢📢👉👉@chrleiter presenting his work on how explainability can improve evaluation metrics for MT and summarization tomorrow at #eacl2024
Excited to present our paper "BMX: Boosting Natural Language Generation Metrics with Explainability" at #EACL2024! Join us in Virtual Poster Session B on 20.03.2024 at 2 p.m. as we unveil how explanations can enhance NLG evaluation metrics.
Eval4NLP23 has concluded. We thank everyone + congratulate our shared task winners on inducing high-quality metrics for MT+summ. using prompting and efficient models: "HIT-MI&T Lab" (even beating GEMBA + COMET🚀) & "DSBA". Shared task overview paper: arxiv.org/pdf/2310.19792…
Our accepted papers and program are now online: eval4nlp.github.io/2023/program.h… eval4nlp.github.io/2023/accepted-… Moreover, we're excited to have @alexfabbri4 as invited speaker on the topic of "Re-Evaluating Summarization Evaluation in the Era of LLMs" See u tomorrow 9am (UTC+8), online only!
📢📢To accommodate the recent ARR author response period, Eval4NLP @aaclmeeting extends the deadline for pre-reviewed papers until September 30th. Pre-reviewed papers must include: the paper along with its original reviews and scores. More details: eval4nlp.github.io
Round #2 of DALLE images, using requests from y'all. Here's two animals mixed together into a new species.
DALLE-3 is the best product I've seen since GPT-4, super easy to just get sucked in for hours generating images. No need for prompting since GPT-4 does it for you. Let me know if you have requests for prompts below. Here are some examples of what it can do:
📢📢 Don't forget: Pre-reviewed papers can be submitted to Eval4NLP @aaclmeeting until September 25 via Openreview Just include the paper and your meta-reviews along with reviews and all the scores. eval4nlp.github.io
Due to popular demand, the Eval4NLP workshop @ @aaclmeeting submission deadline has been moved to September 1. We look forward to your submissions! 📣📣 More infos: eval4nlp.github.io
📢📢Brief reminder that Eval4NLP submission deadline is this **Friday, 25.08.2023** Focus: Evaluation with/of LLMs, all other evaluation aspects also very welcome 2nd call4papers: aclweb.org/portal/content… Webpage: eval4nlp.github.io/2023/index.html Venue: @aaclmeeting (Bali 🏖️)
Shared task on explainable evaluation metrics: The development phase is running, but participation is still easily possible, there's also no necessity to train systems to take part. #nlproc #machinelearning Find out more @nlp_evaluation: eval4nlp.github.io/2023/shared-ta…
📢📢📢 We have released the description of Eval4NLP's shared task on "Prompting LLMs as Explainable Evaluation Metrics" (for MT & summarization). Dev phase: Aug. 7 Test phase: Sep. 18 System Submission Deadline: Sep. 23 More details: eval4nlp.github.io/2023/shared-ta… 🚀🚀🚀
📢📢📢 The Eval4NLP workshop will take place this year at AACL 2023. Special focus: Evaluation of/with LLMs. Including a shared task on Prompting LLMs as Explainable Metrics. 📢📢📢 Direct submission deadline: 25.08. Webpage: eval4nlp.github.io/2023/index.html CFP: eval4nlp.github.io/2023/cfp.html
Eval4NLP is happening tomorrow, starting at 10:30 UTC. Our combined program with @sum_eval includes some great paper presentations and invited talks from @peyrardmax and @rktamplayo. See you there tomorrow! eval4nlp.github.io/2022/program.h…
The list of accepted papers is now on our website! eval4nlp.github.io/2022/accepted-… Congratulations to all of the authors, and we look forward to your presentations on November 20. FYI, registration for AACL is now open! aacl2022.org/Registration
This year, Eval4NLP is accepting submissions of papers with reviews from other venues (see the CFP for more details eval4nlp.github.io/2022/cfp.html#…). Submit your paper and reviews here openreview.net/group?id=aclwe… by September 21, AOE!
The deadline to submit to Eval4NLP has been extended to August 15! We will also be accepting papers with reviews from AACL in addition to ARR, both due September 21! eval4nlp.github.io/2022/cfp.html
I got three fully funded PhD positions in new BMBF project "Metrics4NLG". Topic: Evaluation for Text Generation (and text generation itself). Very cool interdisciplinary project :-). If you're interested or know anyone interested, drop me a line ([email protected]).
The invitation to review for Eval4NLP 2022 was just sent out. If you would like to review (or know someone who does) but didn't get an email, get in contact with us! [email protected]
United States Trends
- 1. Gameday 31.8K posts
- 2. Sesko 46.4K posts
- 3. #SaturdayVibes 4,897 posts
- 4. Ugarte 16.1K posts
- 5. De Ligt 26.1K posts
- 6. Texas Tech 7,979 posts
- 7. #Caturday 5,072 posts
- 8. Good Saturday 33.7K posts
- 9. Richarlison 21.6K posts
- 10. Trump Stadium 2,081 posts
- 11. Amorim 66.1K posts
- 12. Calen Bullock N/A
- 13. Cunha 25.4K posts
- 14. Insurance 193K posts
- 15. #TOTMUN 18.2K posts
- 16. Casemiro 24.3K posts
- 17. Goretzka 1,865 posts
- 18. Luis Diaz 23.2K posts
- 19. Odobert 4,890 posts
- 20. Dalot 12.7K posts
You might like
-
AACL 2025
@aaclmeeting -
EMNLP 2025
@emnlpmeeting -
thamar |
@thamar_solorio -
UW NLP
@uwnlp -
Maarten Sap (he/him)
@MaartenSap -
Desmond Elliott
@delliott -
Wei Xu
@cocoweixu -
ACL Anthology
@aclanthology -
NAACL
@naacl -
CopeNLU
@CopeNLU -
MilaNLP
@MilaNLProc -
Violet Peng
@VioletNPeng -
Andre Martins
@andre_t_martins -
UNC AI
@unc_ai_group -
Swabha Swayamdipta
@swabhz
Something went wrong.
Something went wrong.