Shaokai Ye
@shaokaiyeah
Machine learning researcher @ Apple
คุณอาจชื่นชอบ
Insightful! I have been thinking about "thinking in video" too
Some further thoughts on the idea of "thinking with images": 1) zero-shot tool use is limited -- you can’t just call an object detector to do visual search. That’s why approaches like VisProg/ViperGPT/Visual-sketchpad will not generalize or scale well. 2) visual search needs to…
I am on the job market! Contact me if you are interested in building multi-modal agentic systems that understand behaviors!
✨ Introducing a new #SOTA action recognition large multimodal language model: #LLaVAction! Understanding human behavior requires recognizing actions—a challenging task given the complexity of behavior. Large multimodal language models (#MLLMs) offer a promising path forward,…
So sweet to see them standing together
Automating the Search for Artificial Life with Foundation Models Presents ASAL, the first use of vision-language models in Artificial Life, discovering diverse, novel simulations across substrates proj: pub.sakana.ai/asal/ abs: arxiv.org/abs/2412.17799
🚀 DLC AI Residents call for 2025! This year, we are doing something a little different to support even more underrepresented individuals 🥰 We are having in-person workshops again 🙌, & we are taking the 2025 AI Residency on the Road! 🛤️ App open now! deeplabcutairesidency.org
🚨adversarial robustness is becoming even more critical as AI systems are deployed in the real-world, but how can we detect outliers (adversarials) without having trained on them 👀? In our new preprint, we introduce AROS💍: It leverages neural ODEs and Lyapunov stability…
Really cool!
✨🥰 check out our article - and cover 🤩- about Decoding the Brain in @CellCellPress cell.com/cell/fulltext/… We review the mathematics, current approaches, and muse about the future… #BCI #neuraldecoding #neuroAI Thanks to my awesome co-authors Adriana Perez Rotondo,…
Come check this really cool paper if you are at ECCV!
I'm thrilled to present our paper "Elucidating the Hierarchical Nature of Behavior with Masked Autoencoders" at #ECCV24! 🎉 We focus on self-supervised learning for action segmentation to uncover the hierarchical structure of behavior. Paper: ecva.net/papers/eccv_20… 👇🧵
How does sensorimotor (S1/M1) cortex support adaptive motor control? Come find out in our latest preprint, which spans the development of a full adult forelimb model + physics simulations, neural-modeling for control, complex 🐭behavior 🕹️, large-scale imaging, and of course…
DLC Residency 2024 Recap! 🎓💜 🎉Check out the awesome video from DLC Community Manager, @TheVetFuturist, and the 2024 Residents! youtu.be/lyJ2NDKng3g?si…
youtube.com
YouTube
DeepLabCut AI Residency 2024! 🎓💜
I rewatch this once a month for motivation
🎉 introducing the 2024 AI Residents!!! We welcome @StuckertAnna @mrc_canela and @dikra_masrour 👏 Read about them on the blog: deeplabcut.medium.com/exploring-the-…
deeplabcut.medium.com
Exploring the Future🔭: Meet the Visionary Minds of the DeepLabCut AI Summer Residency 2024🎓✨
The DeepLabCut AI Residency just started last week, marking the beginning of an incredible journey🚂. The Residency is a prestigious…
🎉 Happy to have contributed a bit to this with my PhD student @shaokaiyeah, where we use @DeepLabCut #SuperAnimal foundation model for pose to do fully end-to-end unsupervised behavioral analysis with #keypointMoSeq. Huge congrats to first author Caleb Weinreb, and Scott…
Keypoint-MoSeq from the @Datta_lab is an unsupervised behavior segmentation algorithm that extracts behavioral modules from keypoint tracking data acquired with diverse algorithms, as demonstrated on data from mice, rats and fruit flies. (1/2)
the pace of progress blows my mind
AI music videos are so hot right now 🔥
United States เทรนด์
- 1. Halloween 5.3M posts
- 2. Mookie 8,970 posts
- 3. Gausman 6,831 posts
- 4. #SmackDown 13.8K posts
- 5. #DoorDashTradeorTreat 2,562 posts
- 6. Drummond 3,153 posts
- 7. #OPLive N/A
- 8. #sweepstakes 3,672 posts
- 9. Ted Noffey 1,121 posts
- 10. Ilja 2,813 posts
- 11. Syracuse 3,488 posts
- 12. Trick or Treat 458K posts
- 13. #iahsfb N/A
- 14. Nathan Frazer N/A
- 15. End of 1 21.6K posts
- 16. Game 6 48.2K posts
- 17. End 1Q N/A
- 18. End of the 1st 2,882 posts
- 19. Reese 6,591 posts
- 20. Ciampa N/A
Something went wrong.
Something went wrong.