#deeperlearningblog zoekresultaten

Geen resultaten voor "#deeperlearningblog"

Shun Li

4 aug.

Check out the #DeeperLearningBlog that summarizes key findings of our recent preprint on sign switching synapses! (with my speculations on its connections with AI 🤖)

Kempner Institute at Harvard University

@KempnerInst

4 aug.

New in the #DeeperLearningBlog: @shunnnli describes the discovery of a type of synapse that switches between more excitatory and more inhibitory in an experience-dependent manner. bit.ly/40OYYw4 #neuroscience #dopamine #RL @blsabatini

KempnerInst's tweet card. Synaptic plasticity rules in the brain are normally thought of as changing synaptic weights but not signs, unlike artificial neural networks. We show that a type of synapse in the […]

ANN-like Synapses in the Brain Mediate Online Reinforcement Learning - Kempner Institute

Bron: kempnerinstitute.harvard.edu

Kempner Institute at Harvard University

@KempnerInst

4 aug.

ANN-like Synapses in the Brain Mediate Online Reinforcement Learning - Kempner Institute

Bron: kempnerinstitute.harvard.edu

Kempner Institute at Harvard University

@KempnerInst

30 jul.

New in the #DeeperLearningBlog: @GaoZhaolin and collaborators including the #KempnerInstitute's Kianté Brantley presents a powerful new #RL algorithm tailored for reasoning tasks with #LLMs that updates using only one generation per prompt. bit.ly/44US1Mt @xkianteb #AI

KempnerInst's tweet card. Recent LLM advances show the effectiveness of RL with rule-based rewards, but methods like GRPO and PPO are costly due to critics or multiple generations per prompt. We propose a […]

Accelerating RL for LLM Reasoning with Optimal Advantage Regression - Kempner Institute

Bron: kempnerinstitute.harvard.edu

Kempner Institute at Harvard University

@KempnerInst

28 jul.

New in the #DeeperLearningBlog: the #KempnerInstitute's @maryiletey presents work recently published in PNAS that offers generalizable insights into in-context learning (ICL) in an analytically-solvable model architecture. bit.ly/4lPK15p #AI @PNASNews (1/2)

KempnerInst's tweet card. Attention-based architectures are a powerful force in modern AI. In particular, the emergence of in-context learning enables these models to perform tasks far beyond the original next-token predict...

Solvable Model of In-Context Learning Using Linear Attention - Kempner Institute

Bron: kempnerinstitute.harvard.edu

Kempner Institute at Harvard University

@KempnerInst

22 jul.

New in the #DeeperLearningBlog: #KempnerInstitute research fellow @t_andy_keller introduces the first flow equivariant neural networks, which reflect motion symmetries, greatly enhancing generalization and sequence modeling. bit.ly/451fQ48 #AI #NeuroAI

KempnerInst's tweet card. Sequence transformations, like visual motion, dominate the world around us, but are poorly handled by current models. We introduce the first flow equivariant models that respect these motion symmet...

Flow Equivariant Recurrent Neural Networks - Kempner Institute

Bron: kempnerinstitute.harvard.edu

Kempner Institute at Harvard University

@KempnerInst

18 jul.

New in the #DeeperLearningBlog: #KempnerInstitute researchers @WangBinxu and @johnjvastola explain their work uncovering the linear Gaussian structure in diffusion models and the potential to use it to enhance performance. bit.ly/4lCauDv #AI #DiffusionModels

Kempner Institute at Harvard University

@KempnerInst

14 jul.

New in the #DeeperLearningBlog: Researchers from the #KempnerInstitute, @Cornell and @CMU_Robotics introduce a new method for improving offline RL by scaling-up test-time compute. kempnerinstitute.harvard.edu/research/deepe… #AI #RL (1/2)

KempnerInst's tweet card. This research introduces a novel approach to scaling reinforcement learning (RL) during training and inference. Inspired by the recent work on LLM test-time scaling, we demonstrate how greater...

Scaling Offline Reinforcement Learning at Test Time - Kempner Institute

Bron: kempnerinstitute.harvard.edu

Kempner Institute at Harvard University

@KempnerInst

27 jun.

New in the #DeeperLearningBlog: Kempner researchers Nikhil Anand (@nikhil_anand91) and Chloe Su (@Huangyu58589918) discuss new work on how numerical precision can impact the accuracy and stability of #LLMs. kempnerinstitute.harvard.edu/research/deepe… #AI (1/2)

KempnerInst's tweet card. This research uncovers consistent training instabilities when using new, highly efficient low-precision formats, which has implications for the development of next-generation AI. By pinpointing the...

Characterization and Mitigation of Training Instabilities in Microscaling Formats - Kempner...

Bron: kempnerinstitute.harvard.edu

Geen resultaten voor "#deeperlearningblog"

Something went wrong.

United States Trends

1. Bills 118K posts
2. Josh Allen 8,468 posts
3. Dolphins 22.7K posts
4. Jaxson Dart 7,562 posts
5. Ravens 26.9K posts
6. Jonathan Taylor 21.9K posts
7. Bryce 11.3K posts
8. Henderson 9,079 posts
9. Falcons 32.1K posts
10. Browns 25.2K posts
11. Justin Fields 2,484 posts
12. Vikings 23K posts
13. Colts 54.2K posts
14. Diggs 7,994 posts
15. Joe Brady 2,383 posts
16. #Bears 4,255 posts
17. Drake Maye 8,158 posts
18. #NYGiants 2,812 posts
19. Jefferson 6,923 posts
20. Kyle Williams 5,817 posts