noahconst's profile picture. Research Scientist @GoogleDeepMind

Noah Constant

@noahconst

Research Scientist @GoogleDeepMind

固定されたツイート

Made a walkthrough vid for Magenta RealTime “Audio Injection”! The notebook takes ~10m to spin up, but totally worth it for the surreal experience 🎤💻🎧⁉️


Noah Constant さんがリポスト

Everyone talks about real-time AI for speech but sleeps on it for music Real-time is nice to have for conversations, but essential for co-jamming

Realtime interactive generative models FTW! Announcing a new 🌊 of details and features for Magenta RealTime, the open weights live music AI model from GDM! * Live Jamming with audio input 🎤🎸🎵 * Personalize your own models 🔧 * Tech report 📜 Links below in the 🧵...



Noah Constant さんがリポスト

Hours and hours of fun and inspiration. Tiny excerpt: youtube.com/shorts/53gmT8z…

irolnick's tweet card. Jamming with Magenta Realtime in Ebm

youtube.com

YouTube

Jamming with Magenta Realtime in Ebm


Noah Constant さんがリポスト

🔊 Easy to lose hours to live jamming w/ Magenta RT. Feels like a glimpse at something magical Try it yourself! Some setup involved (we're working on improving that!) but worth it: g.co/magenta/rt-aud…


Noah Constant さんがリポスト

In 2018, we wrote a paper titled "the challenge of realistic music generation". A few years ago, this challenge was essentially solved: it is now a thing that exists🤯 Realtime is the next frontier, it opens up so many more possibilities. There's a tech report + open weights!🙏

Realtime interactive generative models FTW! Announcing a new 🌊 of details and features for Magenta RealTime, the open weights live music AI model from GDM! * Live Jamming with audio input 🎤🎸🎵 * Personalize your own models 🔧 * Tech report 📜 Links below in the 🧵...



Noah Constant さんがリポスト

I’m happy to have donated my voice to this incredible new open model and instrument! It is a new, active, approach to spawning music, made for real time jamming and exploration. More like a sampler than a jukebox, you can fine tune it on your own sounds and soon run it locally!

We've worked with @hollyherndon and @matdryhurst to finetune Magenta RT on Holly's vocals and the result is a really cool model that keeps the base model's ability to respond to wide-ranging controls while infusing outputs with the unique sonic qualities of the finetuning domain



Noah Constant さんがリポスト

We've worked with @hollyherndon and @matdryhurst to finetune Magenta RT on Holly's vocals and the result is a really cool model that keeps the base model's ability to respond to wide-ranging controls while infusing outputs with the unique sonic qualities of the finetuning domain

We're thrilled to have worked with Holly Herndon to train a model finetuned on her vocal style to share with all of you. Playing with Holly’s model, you can use additional controls to get vocalizations that contour the music or "color" the instruments with a timbre that…



Noah Constant さんがリポスト

Realtime interactive generative models FTW! Announcing a new 🌊 of details and features for Magenta RealTime, the open weights live music AI model from GDM! * Live Jamming with audio input 🎤🎸🎵 * Personalize your own models 🔧 * Tech report 📜 Links below in the 🧵...


Noah Constant さんがリポスト

New VST/AU Plugin! 🚨 Play with Lyria RealTime directly from inside your favorite DAW with “The Infinite Crate” 🎧🎶 Like other Lyria RT demos, you can mix together text prompts and other controls to steer the model in real-time. But now with a VST plugin you can feed audio…


Noah Constant さんがリポスト

We’ve just released Magenta RealTime, an open-weights live music model that lets you craft sounds in real time by exploring the latent space through text and audio! 🤗 Model: huggingface.co/google/magenta…… 🧑‍💻Code: github.com/magenta/magent… 📝Blog post: magenta.withgoogle.com/magenta-realti…

Excited to announce 🎵Magenta RealTime, the first open weights music generation model capable of real-time audio generation with real-time control. 👋 **Try Magenta RT on Colab TPUs**: colab.research.google.com/github/magenta… 👀 Blog post: g.co/magenta/rt 🧵 below



Noah Constant さんがリポスト

🎸🥁🎹🎵 New open weights music model from Magenta for real-time generation. Excited to see what cool instruments you all can make with it 🙂

Excited to announce 🎵Magenta RealTime, the first open weights music generation model capable of real-time audio generation with real-time control. 👋 **Try Magenta RT on Colab TPUs**: colab.research.google.com/github/magenta… 👀 Blog post: g.co/magenta/rt 🧵 below



Noah Constant さんがリポスト

Introducing Magenta RealTime, our open weights live music model! Like Lyria RealTime, this model provides the user continuous control of the musical flow 🌊. We will be sharing some of our favorite ways to extend these models over the next few weeks. Can't wait to see what you…

Excited to announce 🎵Magenta RealTime, the first open weights music generation model capable of real-time audio generation with real-time control. 👋 **Try Magenta RT on Colab TPUs**: colab.research.google.com/github/magenta… 👀 Blog post: g.co/magenta/rt 🧵 below



Noah Constant さんがリポスト

Excited to announce 🎵Magenta RealTime, the first open weights music generation model capable of real-time audio generation with real-time control. 👋 **Try Magenta RT on Colab TPUs**: colab.research.google.com/github/magenta… 👀 Blog post: g.co/magenta/rt 🧵 below


Noah Constant さんがリポスト

On the occasion of returning to Magenta's roots at @sonarplusd, we're dusting off the blog to share news and insights about what we're working on at @GoogleDeepMind on the Lyria Team. g.co/magenta/lyria-… Our latest post is about the Lyria RealTime API, providing access to…


Noah Constant さんがリポスト

Pleasantly surprised with how easy/fun it is to "vibe code" new musical experiences in AI Studio. I'm not much of a JS guy, but had Gemini help me make a "Kaoss Pad" emulator using the Lyria RealTime API to explore musical latent spaces in realtime.


Noah Constant さんがリポスト

Excited to release a tool that makes the joy of live music creation more accessible 🎸 “Music FX DJ” is new and improved: g.co/labs/musicfx-dj Featuring a whole suite of new controls, sharing and remix features, and improved audio quality and diversity of outputs, to let you…


Loading...

Something went wrong.


Something went wrong.