More information please check: arxiv.org/abs/2312.00785 and yutongbai.com/lvm.html

our new system trains humanoid robots using data from cell phone videos, enabling skills such as climbing stairs and sitting on chairs in a single policy (w/ @redstone_hong @junyi42 @davidrmcall)

Please see the website for more details. synNsync🪩is joint work with my awesome ✨co-authors✨: @LeaMue27 @jathushan @geopavlakos @shiryginosar @akanazawa @JitendraMalikCV Website🖥️: von31.github.io/synNsync/ Data💾: github.com/Von31/swing_dance… Arxiv📜: arxiv.org/abs/2409.04440 🧵6/6

I’ve dreamt of creating a tool that could animate anyone with any motion from just ONE image… and now it’s a reality! 🎉 Super excited to introduce updated 3DHM: Synthesizing Moving People with 3D Control. 🕺💃3DHM can generate human videos from a single real or synthetic human image. #Animation #GenAI #AI #3DHM ✨ The magic of 3D control? Turning 2D pixels into lifelike, animated humans. 🎥 Check out our demo (and Merry Christmas)! piped.video/watch?v=obABCBP-… Paper: arxiv.org/abs/2401.10889 Github: github.com/Boyiliee/3DHM Webpage: boyiliee.github.io/3DHM.gith… Proudly working with the great @JunmingChenleo, @jathushan, @YGandelsman, Alyosha Efros and @JitendraMalikCV😃 Kindly note: This video is intended solely for research purposes and is not authorized for commercial use.

Achieving bimanual dexterity with RL + Sim2Real! toruowo.github.io/bimanual-t… TLDR - We train two robot hands to twist bottle lids using deep RL followed by sim-to-real. A single policy trained with simple simulated bottles can generalize to drastically different real-world objects.

🤖 What if a humanoid robot could make a hamburger from raw ingredients—all the way to your plate? 🔥 Excited to announce ViTacFormer: our new pipeline for next-level dexterous manipulation with active vision + high-resolution touch. 🎯 For the first time ever, we demonstrate ~2.5 minutes of continuous, autonomous control—combining active vision, high-res touch, and high-DoF robot hands SharpaWave — to complete complex, real-world tasks. Code is fully released; check out our: Homepage: roboverseorg.github.io/ViTac… Paper link: arxiv.org/abs/2506.15953 Github: github.com/RoboVerseOrg/ViTa…

Lots of memorable quotes from @JitendraMalikCV at CoRL, the most significant one of course is: “I believe that Physical Intelligence is essential to AI” :) I did warn you Jitendra that out of context quotes are fair game. Some liberties taken wrt capitalization.

Super excited to announce our new work: Synthesizing Moving People with 3D Control (3DHM)💡 Why is 3DHM unique? With 3D Control, 3DHM can animate a 𝗿𝗮𝗻𝗱𝗼𝗺 human photo with 𝗮𝗻𝘆 poses in a 𝟯𝟲𝟬-𝗱𝗲𝗴𝗿𝗲𝗲 camera view and 𝗮𝗻𝘆 camera azimuths from 𝗮𝗻𝘆 video!

I’ve dreamt of creating a tool that could animate anyone with any motion from just ONE image… and now it’s a reality! 🎉 Super excited to introduce updated 3DHM: Synthesizing Moving People with 3D Control. 🕺💃3DHM can generate human videos from a single real or synthetic human image. #Animation #GenAI #AI #3DHM ✨ The magic of 3D control? Turning 2D pixels into lifelike, animated humans. 🎥 Check out our demo (and Merry Christmas)! piped.video/watch?v=obABCBP-… Paper: arxiv.org/abs/2401.10889 Github: github.com/Boyiliee/3DHM Webpage: boyiliee.github.io/3DHM.gith… Proudly working with the great @JunmingChenleo, @jathushan, @YGandelsman, Alyosha Efros and @JitendraMalikCV😃 Kindly note: This video is intended solely for research purposes and is not authorized for commercial use.