Phillip Rust
@rust_phillip
Research Scientist @AIatMeta (FAIR) • PhD @coastalcph
You might like
Happy to share our paper on language modelling with pixels has been accepted to ICLR‘23 (notable-top-5% / oral) 🎉. Big thanks and congrats to Team-PIXEL @jonasflotz @ebugliarello @esalesk @mdlhx @delliott and looking forward to presenting in Kigali! 🌍 #ICLR2023
Tired of tokenizers/subwords? Check out PIXEL, a new language model that processes written text as images📸 “Language Modelling with Pixels” 📄 arxiv.org/abs/2207.06991 🧑💻github.com/xplip/pixel 🤖huggingface.co/Team-PIXEL/pix… by @rust_phillip @jonasflotz me @esalesk @mdlhx @delliott
Tough week! I also got impacted less than 3 months after joining. Ironically, I just landed some new RL infra features the day before. Life moves on. My past work spans RL, PEFT, Quantization, and Multimodal LLMs. If your team is working on these areas, I’d love to connect.
Meta has gone crazy on the squid game! Many new PhD NGs are deactivated today (I am also impacted🥲 happy to chat)
Humans see text — but LLMs don’t. I wrote a short blog post exploring how models can perceive text visually rather than tokenize it: 🔗 csu-jpg.github.io/Blog/people_se… From PIXEL, CLIPPO, VisInContext, VIST to DeepSeek-OCR, this is a quick story of how vision-centric modeling is…
I will be presenting this work in-person at ACL🇹🇭 this week. Drop by if you'd like to chat! Oral: Today (Monday) 16:30 Poster: Tuesday (Tomorrow) 10:30 - 12:00
Introducing “Towards Privacy-Aware Sign Language Translation at Scale” We leverage self-supervised pretraining on anonymized videos, achieving SOTA ASL-to-English translation performance while mitigating risks arising from biometric data. 📄: arxiv.org/abs/2402.09611 🧵(1/9)
New preprint "Improving Language Understanding from Screenshots" w/ @zwcolin @AdithyaNLP @danqi_chen. We improve language understanding abilities of screenshot LMs, an emerging family of models that processes everything (including text) via visual inputs arxiv.org/abs/2402.14073
In PHD: Pixel-Based Language Modeling of Historical Documents with @NadavBorenstein @rust_phillip and @IAugenstein, we apply pixel language models to processing historical document and to more standard NLP classification tasks too. See it in Poster Session 6 on Sunday 10th.
In Text Rendering Strategies for Pixel Language Models with @jonasflotz @rust_phillip and @esalesk, we design new text renderers for visual language processing to improve performance or to squeeze the model down to just 22M parameters. See it in Poster Session 2 on Friday 8th.
Introducing SeamlessM4T, the first all-in-one, multilingual multimodal translation model. This single model can perform tasks across speech-to-text, speech-to-speech, text-to-text translation & speech recognition for up to 100 languages depending on the task. Details ⬇️
📢 I am hiring a postdoc to join our project on pixel-based natural language processing. The position is based in Copenhagen 🇩🇰 for 18 months. Applications are due by March 29 employment.ku.dk/faculty/?show=…. Informal inquiries are welcome.
Thrilled to receive a grant from @VILLUMFONDEN to carry out blue-skies research on tokenization-free NLP veluxfoundations.dk/en/about/proje… I will hire Ph.Ds and Postdocs to build up the group so feel free to reach out. We're starting off with a paper at #ICLR2023 openreview.net/forum?id=FkSp8…
Thrilled to receive a grant from @VILLUMFONDEN to carry out blue-skies research on tokenization-free NLP veluxfoundations.dk/en/about/proje… I will hire Ph.Ds and Postdocs to build up the group so feel free to reach out. We're starting off with a paper at #ICLR2023 openreview.net/forum?id=FkSp8…
United States Trends
- 1. #AEWDynamite 18.1K posts
- 2. #Survivor49 3,118 posts
- 3. Donovan Mitchell 3,650 posts
- 4. #CMAawards 4,344 posts
- 5. #AEWCollision 6,081 posts
- 6. UConn 7,476 posts
- 7. #SistasOnBET 1,656 posts
- 8. Nick Allen 1,880 posts
- 9. Dubon 3,116 posts
- 10. Cavs 8,215 posts
- 11. Arizona 31.1K posts
- 12. Aaron Holiday N/A
- 13. Rockets 15.9K posts
- 14. Derik Queen 1,443 posts
- 15. Mobley 4,189 posts
- 16. Bristow N/A
- 17. FEMA 51.1K posts
- 18. Marquette 2,129 posts
- 19. Sengun 5,873 posts
- 20. Jaden Bradley N/A
You might like
-
Desmond Elliott
@delliott -
UW NLP
@uwnlp -
Emanuele Bugliarello
@ebugliarello -
CopeNLU
@CopeNLU -
Andre Martins
@andre_t_martins -
Yova Kementchedjhieva
@YovaKem_v2 -
Yanai Elazar
@yanaiela -
Rerun
@rerundotio -
Weijia Shi
@WeijiaShi2 -
Edoardo Ponti
@PontiEdoardo -
Karolina Stanczak
@karstanczak -
Anette Frank
@AnetteMFrank -
Tianyu Gao
@gaotianyu1350 -
Kris Cao
@kroscoo -
Miryam de Lhoneux/ @mdlhx.bsky.social
@mdlhx
Something went wrong.
Something went wrong.