sudsingh's profile picture. Senior Leadership Science Recruiter @ Amazon

Sid Singh

@sudsingh

Senior Leadership Science Recruiter @ Amazon

Sid Singh reposted

The Maximal Update Parameterization (µP) allows LR transfer from small to large models, saving costly tuning. But why is independent weight decay (IWD) essential for it to work? We find µP stabilizes early training (like an LR warmup), but IWD takes over in the long term! 🧵

AtliKosson's tweet image. The Maximal Update Parameterization (µP) allows LR transfer from small to large models, saving costly tuning. But why is independent weight decay (IWD) essential for it to work?

We find µP stabilizes early training (like an LR warmup), but IWD takes over in the long term! 🧵

Sid Singh reposted

Our robotics team will be at ICRA next week in Atlanta! Having started a new research team at Amazon building robot foundation models, we're hiring across all levels, full-time or intern, and across both SW and Research roles. Ping me at [email protected] and let's have a chat!


There is perhaps no better demonstration of the folly of human conceits than this distant image of our tiny world. To me, it underscores our responsibility to deal more kindly with one another and to preserve and cherish the pale blue dot, the only home w…lnkd.in/gwRi6tN6


“Recruiting is more than just finding a candidate; it’s about understanding their aspirations and guiding them towards their dreams.” #recruiting #CandidateAspirations #candidateexperience


United in Enthusiasm and Growth | Our team's collective energy is fueled by the power of learning, growth and Inclusivity. Together, we embrace challenges, inspire one another, and foster a culture of Inclusion & Collaboration. With each team-learning ses…lnkd.in/gkACDQHy


I’m happy to share that I’ve obtained a new certification: Mentoring Training from Chronus! #mentoring lnkd.in/gS6DysDd


Loading...

Something went wrong.


Something went wrong.