AI Bites | YouTube Channel

🤖 GIVEAWAY TIME! We are giving away a one-page LangChain Cheatsheet! ⚡ It will really make you productive if you are building with LangChain! It's something we always refer to when we build LLM pipelines. To get it: 1️⃣ Follow us (@ai_bites) 2️⃣ Like ❤️ + Repost 🔁 this post…

We just published Building Multi-Agent Systems with LangGraph — A Comprehensive Guide medium.com/p/building-mul… #AI #agenticAI #GenerativeAI #agents #AIイラスト

The field of video generation is undergoing a paradigm shift - from generating realistic and appealing visuals to constructing world models that can simulate interactive and navigable environments. These models are not just visual tools; they serve as testbeds for training and…

DreamLand, a novel frontend visualization framework designed to enable real-time, multimodal interaction with 4D (spatiotemporal) scenes. While recent advances in vision and language models have enabled rich 3D content generation, existing WebGL-based systems remain limited in…

UniVA: Universal Video Agent! Describe a universe, a campaign, a pet, or a long-form story! UniVA will plan, compose and produce the video for you. Paper Title: UniVA: Universal Video Agent towards Open-Source Next-Generation Video Project: univa.online Link:…

FlowFeat distills optical flow networks into pixel-level task-agnostic representations. FlowFeat provides versatile pixel-level features. Using motion-driven embedding statistics, it achieves high spatial precision and temporal consistency Paper Title: FlowFeat: Pixel-Dense…

PercHead reconstructs 3D heads from a single input image and enables disentangled 3D editing using semantic maps combined with image or text-based style inputs. Paper Title: PercHead: Perceptual Head Model for Single-Image 3D Head Reconstruction Project: antoniooroz.github.io/PercHead/…

DenseMarks — a new learned representation for human heads, enabling high-quality dense correspondences. A Vision Transformer network predicts a 3D embedding for each pixel, corresponding to a location in a 3D canonical unit cube. The network is trained using pairwise point…

FreeArt3D is a training-free framework that generates articulated 3D objects from a few images by leveraging a pre-trained 3D diffusion model for static objects. It jointly optimizes geometry, texture, and kinematics, achieving high-fidelity results across diverse categories…

Genie Envisioner (GE), a unified world foundation platform for robotic manipulation that integrates policy learning, evaluation, and simulation within a single video-generative framework. At its core, GE-Base is a large-scale, instruction-conditioned video diffusion model that…

Pixel-Perfect Depth, a monocular depth estimation model with pixel-space diffusion transformers. Compared to existing discriminative and generative models, its estimated depth maps can produce high-quality, flying-pixel-free point clouds, without any post-processing. Paper…

VFXMaster, the first unified, reference-based framework for Visual effects video generation. It recasts effect generation as an in-context learning task, enabling it to reproduce diverse dynamic effects from a reference video onto target content. In addition, it demonstrates…

U-CAN, an Unsupervised framework for point cloud denoising with Consistency-Aware Noise2Noise matching. Specifically, it leverages a neural network to infer a multi-step denoising path for each point of a shape or scene with a noise to noise matching schema. Paper Title: U-CAN:…

VividCam, a training paradigm that enables diffusion models to learn complex camera motions from synthetic videos, releasing the reliance on collecting realistic training videos. VividCam incorporates multiple disentanglement strategies that isolates camera motion learning from…

This survey paper systematically categorize efficient Vision-Language-Action (VLA) models into three core pillars: (1) Efficient Model Design, encompassing efficient architectures and model compression techniques; (2) Efficient Training, covering efficient pre-training and…

Anywhere3D-Bench, a holistic 3D visual grounding benchmark consisting of 2.8k referring expression-3D bounding box pairs spanning four different grounding levels: human-activity areas, unoccupied space beyond objects, objects in the scene, and fine-grained object parts. Paper…

Given a pair of equirectangular images captured by two vertically stacked omnidirectional cameras, DFI-OmniStereo integrates a large-scale pre-trained monocular relative depth foundation model into an iterative stereo matching approach. This method improves depth estimation…

RapVerse investigates the extent to which scaling autoregressive multimodal transformers across language, audio, and motion can enhance the coherent and realistic generation of vocals and whole-body human motions. Paper Title: RapVerse: Coherent Vocals and Whole-Body Motions…

Generative View Stitching enables collision-free camera-guided video generation for predefined trajectories, and presents a non-autoregressive alternative to video length extrapolation. Given a pretrained DFoT video model with an 8-frame context window and a predefined camera…

Latent Sketchpad, a framework that equips MLLMs with an internal visual scratchpad. The internal visual representations of MLLMs have traditionally been confined to perceptual understanding. We repurpose them to support generative visual thought without compromising reasoning…