Inseq
@InseqLib
Open-Source Interpretability for Generative Language Models 🔎 🐛
قد يعجبك
Hello world! 🐛
After a year of restless development, I'm finally happy to announce Inseq, a new tool to democratize post-hoc interpretability of sequence generation models 🐛 github.com/inseq-team/ins… #nlproc #xai Some highlights 👇 1/
Model Internals-based RAG Evaluation (MIRAGE) 🌴 is accepted to #EMNLP2024 Main! ➡️ To celebrate, here's our new MIRAGE demo combining @InseqLib and Transformers-specific LRP: huggingface.co/spaces/gsarti/…. Reach out if you want to catch up in Miami! 🤗🏖️
huggingface.co
MIRAGE - a Hugging Face Space by gsarti
MIRAGE - a Hugging Face Space by gsarti
[1/8] Struggling with verifying the trustworthiness of RAG outputs? Check our latest work where we utilize *model internals* as a powerful and faithful tool for attributing answers to retrieved docs! (w/ @gsarti_ @AriannaBisazza @raquel_dmg) 📄: arxiv.org/abs/2406.13663 #NLProc
![Jirui_Qi's tweet image. [1/8] Struggling with verifying the trustworthiness of RAG outputs? Check our latest work where we utilize *model internals* as a powerful and faithful tool for attributing answers to retrieved docs! (w/ @gsarti_ @AriannaBisazza @raquel_dmg)
📄: arxiv.org/abs/2406.13663
#NLProc](https://pbs.twimg.com/media/GQnSi2wXsAADZ2Z.jpg)
Very hyped for the new beautiful viz that just landed in the @InseqLib main branch! 🔥 This will empower users to explore attribution tensors more flexibly and intuitively. h/t to @_ddjohnson for his awesome work on the treescope toolkit powering this release!
Thanks to the new treescope integration, @InseqLib now supports interactive visualizations for multidimensional attributions (show_granular), token highlights (show_tokens) and improved viz for attribute_context CLI! 🚀 Install main, will appear in v0.7 x.com/_ddjohnson/sta…
Thanks to the new treescope integration, @InseqLib now supports interactive visualizations for multidimensional attributions (show_granular), token highlights (show_tokens) and improved viz for attribute_context CLI! 🚀 Install main, will appear in v0.7 x.com/_ddjohnson/sta…
By popular demand, the Treescope pretty-printer from the Penzai neural net library can now be installed separately, and supports both JAX and PyTorch! And that's not all: Penzai itself now has less boilerplate and includes more pretrained Transformer models!
🎓 We're thrilled to host Gabriele Sarti (@gsarti_) in our PhD seminar series tomorrow, July 16th, from 12:00-13:00 in Oe67 BU 101! Join us for his talk on interpreting context usage in generative language models, featuring the Inseq toolkit and PECoRe framework. 🕛Don't miss it!
The 🐑 PECoRe / 🌴 MIRAGE demo on @huggingface Spaces is powered by our new attribute-context CLI command released in v0.6, and allows to export the code to reproduce your results locally with 🐛 Inseq. Check it out ➡️ hf.co/spaces/gsarti/…
⚠️ Citations from prompting or NLI seem plausible, but may not faithfully reflect LLM reasoning. 🏝️ MIRAGE detects context dependence in generations via model internals, producing granular and faithful RAG citations. 🚀 Demo: huggingface.co/spaces/gsarti/… Fun collab w/ @Jirui_Qi,…
huggingface.co
PECoRe - a Hugging Face Space by gsarti
PECoRe - a Hugging Face Space by gsarti
Today, we had the first seminar of our #XAI course! @gsarti_ presented the @InseqLib to interpret LMs and the PECORE framework to identify & attribute context dependence in LMs! 🚀🌟 Thank you, it was so interesting! 🤗 Great start to our series! gsarti.com/talk/polito-in…
[1/4] Introducing “A Primer on the Inner Workings of Transformer-based Language Models”, a comprehensive survey on interpretability methods and the findings into the functioning of language models they have led to. ArXiv: arxiv.org/pdf/2405.00208
![javifer_96's tweet image. [1/4] Introducing “A Primer on the Inner Workings of Transformer-based Language Models”, a comprehensive survey on interpretability methods and the findings into the functioning of language models they have led to.
ArXiv: arxiv.org/pdf/2405.00208](https://pbs.twimg.com/media/GMpDM85WcAELzoF.jpg)
Today @InseqLib hit 300 ⭐️ on Github! A huge thank you to all our awesome users ❤️ Onwards to the next 300! 🤺
@InseqLib v0.6 is out now on PyPI! 🔥 New CLI command for context attribution (@gsarti_), new perturbation-based methods by @hmohebbi75 & @casszzx and optimizations incl. multi-gpu support! ⚡️ Huge shoutout to our contributors! ❤️ Release notes ⬇️ github.com/inseq-team/ins…
Want to learn how to detect and attribute context usage in LMs using @InseqLib? This @Gradio demo using our CLI can teach you how! 🐛
The official 🐑 PECoRe 🐑 demo to detect and attribute context dependence in LM generations is now available on @huggingface Spaces! 🚀 Includes code examples, a usage guide, useful presets for various dec-only & enc-dec models, and more! Check it out ⬇️ huggingface.co/spaces/gsarti/…
huggingface.co
PECoRe - a Hugging Face Space by gsarti
PECoRe - a Hugging Face Space by gsarti
🐑 PECoRe repository is now public (github.com/gsarti/pecore) and all model/datasets are available on @huggingface (huggingface.co/collections/gs…)! 🐑Interested in using PECoRe on your models? Have a look at the @InseqLib implementation (`inseq attribute-context`)!
[1/8] Our new work (w/ @AriannaBisazza @gchrupala @MalvinaNissim) is finally out! 🎉 We introduce PECoRe, an interpretability framework using model internals to identify & attribute context dependence in language models. 📄Paper: arxiv.org/abs/2310.01188 #NLProc #neuralempty
![gsarti_'s tweet image. [1/8] Our new work (w/ @AriannaBisazza @gchrupala @MalvinaNissim) is finally out! 🎉
We introduce PECoRe, an interpretability framework using model internals to identify & attribute context dependence in language models.
📄Paper: arxiv.org/abs/2310.01188
#NLProc #neuralempty](https://pbs.twimg.com/media/F7lQGhnWsAEfWCX.jpg)
Excited to present my recent work on @InseqLib and the #ICLR2024 PECoRe interpretability framework for the @SheffieldNLP group this afternoon! Many thanks @casszzx for inviting me! 🤗 🐛 Inseq: github.com/inseq-team/ins… 🐑🐑 PECoRe: openreview.net/forum?id=XTHfN…
Wow!! This is great news🥳 Thanks @InseqLib! I’m excited to try it out!
Value Zeroing, a faithful approach for analyzing context mixing in Transformers, is now available on @InseqLib main branch for all @huggingface text generation models! 🔀 🔍Paper introducing VZ: aclanthology.org/2023.eacl-main… 🐛VZ in Inseq: tinyurl.com/inseq-vz
After two years with Poetry, Inseq just moved to @astral_sh's new blazing fast package manager uv! Our CI installation step is now ~80% faster! 🔥 Congrats to @charliermarsh and the team on the release, and godspeed for the cargo-like experience you are planning to build!
United States الاتجاهات
- 1. Chris Paul 11.3K posts
- 2. Clippers 19.4K posts
- 3. Good Wednesday 23K posts
- 4. FELIX LV VISIONARY SEOUL 18.5K posts
- 5. #FELIXxLouisVuitton 21.8K posts
- 6. Pat Spencer 2,793 posts
- 7. jungkook 246K posts
- 8. rUSD N/A
- 9. Kerr 5,734 posts
- 10. Lawrence Frank N/A
- 11. Podz 3,394 posts
- 12. #ALLOCATION 255K posts
- 13. TOP CALL 9,665 posts
- 14. Shai 16.3K posts
- 15. Hield 1,624 posts
- 16. #JUPITER 152K posts
- 17. Jimmy Butler 2,692 posts
- 18. The BIGGЕST 274K posts
- 19. Seth Curry 5,279 posts
- 20. Carter Hart 4,278 posts
قد يعجبك
-
Gabriele Sarti
@gsarti_ -
Arianna Bisazza #EMNLP 🇨🇳
@AriannaBisazza -
AILC_NLP
@AILC_NLP -
BeatriceSavoldi
@BeatriceSavoldi -
EVALITA
@EVALITAcampaign -
Ahmet Üstün @NeurIPS ✈️
@ahmetustun89 -
Javier Ferrando
@javifer_96 -
Michael Hanna@NeurIPS2025
@michaelwhanna -
Marco Gaido
@mgaido91 -
Hosein Mohebbi
@hmohebbi75 -
Nils Feldhus
@nfelnlp -
Alessio Miaschi
@AlessioMiaschi -
Huiyuan Lai
@HuiyuanLai -
Marco Guerini
@m_guerini -
Lukas Edman
@LukasNLP
Something went wrong.
Something went wrong.