Michael J. Black

InteractVLM: 3D Interaction Reasoning from 2D Foundational Models
interactvlm.is.tue.mpg.de

InterDyn: Controllable Interactive Dynamics with Video Diffusion Models
interdyn.is.tue.mpg.de

Reconstructing Animals and the Wild
raw.is.tue.mpg.de

Workshop paper:

Generative Zoo
genzoo.is.tue.mpg.de

ChatGarment: Garment Estimation, Generation and Editing via Large Language Models
chatgarment.github.io

ChatHuman: Chatting about 3D Humans with Tools
chathuman.github.io

PICO: Reconstructing 3D People In Contact with Objects
pico.is.tue.mpg.de

Here are all the CVPR projects that I’m part of in one thread.

Conference papers:

PromptHMR: Promptable Human Mesh Recovery
yufu-wang.github.io/phmr-page/

DiffLocks: Generating 3D Hair from a Single Image using Diffusion Models
radualexandru.github.io/difflocks/

Final drop in our #CVPR2025 video series: PICO 🤝📦

Watch how we reconstruct realistic human-object interaction from just one image—with dense contact and mesh fitting!

👋 Visit our booth 1333 at CVPR.

🔗 Paper link in the thread.

#3DBody #AI #SMPL

My dream has been to take a photo of a person and extract the 2D sewing pattern of their clothing and then turn it into a 3D garment. ChatGarment does exactly this plus it lets you edit the garment, or create a completely new one, using text prompts. chatgarment.github.io At CVPR2025!

To estimate 3D humans from video in world coordinates we add side information to prompt the process. Prompts include bounding boxes, face detections, segmentation masks, and text descriptions. It's currently the most accurate video-based method out there. See us at CVPR2025.

Check out DiffLocks, appearing at #CVPR2025. From a single image, we estimate about 100K hair strands that you can then physically simulate. We use a dataset of 40K synthetic hair images with ground truth strands. It's all available for research purposes.

Yay, @cvprconference.bsky.social, we’re in! 🎉#CVPR2025

5 papers accepted, 5 going live 🚀

Catch PromptHMR, DiffLocks, ChatHuman, ChatGarment & PICO at Booth 1333, June 11–15.

Details about the papers in the thread! 👇

#3DBody #SMPL #GenerativeAI #MachineLearning

🔥 Heading to the #ICRA2025?

Join us on May 23, 2pm (Room 316) for MoCapade: markerless motion capture from any video!

Powered by PromptHMR (CVPR 2025). No suits, no markers—just motion. 🕺💻

#AI #3DMotion #SMPL #Robotics #ICRA #Meshcapade

Improved foot-ground contact coming soon to MoCapade3.0.

🎬 Join Meshcapade at FMX!

See how to turn video or text into ready-to-use 3D motion—no suits or markers needed.

Workshop: May 8, 10:00 AM.

Perfect for animation, VFX & game dev!

📍 Info: fmx.de/en/program/p...

#FMX2025 #3DMotion

St4RTrack: Simultaneous 4D Reconstruction and Tracking in the World

Haiwen Feng, @junyi42.bsky.social, @qianqianwang.bsky.social, Yufei Ye, Pengcheng Yu, @michael-j-black.bsky.social, Trevor Darrell, @akanazawa.bsky.social

DUSt3R-like framework

arxiv.org/abs/2504.13152

YouTube video by Meshcapade Meshcapade: From zero to game-ready assets in seconds (GDC 2025 Presentation)

Missed us at GDC?
Watch Part 1 of our talk here 👉 youtu.be/0jCTiQMutow

🚶 Motion capture with MoCapade
🎮 Import directly into Unreal Engine
🎭 Retarget to any character
👀 Bonus: sneak peek at 3D hair & realtime single-cam mocap

🕴️ No suits. 📍 No markers. 🤳 Just one camera.

Thanks for the pointer!

The AI tariff?

Will there be an AI tariff? TL;DR: The societies that will "win" the AI race will not be those that develop the technology first. It will be those that are best able to manage the long-term social disruption AI will cause.
perceiving-systems.blog/en/news/what...
on Medium
medium.com/@black_51980...

One shot. One town. Endless dancing. 🕺💃🎶

This one-take Unreal animation uses Meshcapade to bring every character to life. No mocap suits, just seamless motion from start to finish.

Stylized, cinematic, and full of vibes; exactly how digital animation should feel 📹✨

#3DAnimation #MarkerlessMocap

The arXiv paper for PRIMAL is now online. It's a data-driven, interactive avatar, that can be controlled by varied commands, runs in a game engine, and is responsive to perturbations (without physics simulation). arxiv.org/abs/2503.17544

YouTube video by Yan Zhang PRIMAL: Physically Reactive and Interactive Motor Model for Avatar Learning

👨‍🎤 Ever seen an Interactive Generative avatar running inside @unrealengine.bsky.social?

Check out our latest work, PRIMAL, in collaboration with Max Planck Institute for Intelligent Systems & Stanford University - live demo at @officialgdc.bsky.social! 🎮

www.youtube.com/watch?v=-Gcp...

🎉🎉🎉 Happy to announce that the code for our paper Gaussian Garments is now public!

Link: github.com/eth-ait/Gaus...

Gaussian Garments uses a combination of 3D meshes and Gaussian splatting to reconstruct photorealistic simulation-ready digital garments from multi-view videos. 🧵

YouTube video by Michael Black CameraHMR: Aligning People with Perspective (3DV 2025)

The CameraHMR video is now on Youtube. This is currently the most accurate single-image method for estimating 3D human shape and pose. The paper will be presented at 3DV. The code and data are all on-line here: camerahmr.is.tue.mpg.de
youtu.be/v3WzpjXpknc

🎮 Motion Generation in Unreal, made SMPL.

Experience real-time reactive behavior—characters adapt instantly to your input. With controllable generative 3D motion, every move is unique. Real-time motion blending keeps it smooth.

🚀 See it at Booth C1821!

#3DAnimation #MotionGeneration #GameDev #GDC

And it just keeps coming from @meshcapade.com -- next up, real-time markerless motion capture from a single camera. Check it out at #GDC2025. Yes, the founders will be there to dance for you (as in this video) but it's more fun to try it yourself!

Faces, Expressions, Hair—Brought to Life with Meshcapade.

From facial animation to 3D hair, creating digital humans has never been easier.

See it at #GDC2025! Visit Booth C1821 and experience motion, detail, expression.

#UnrealEngine #3DAnimation #MotionCapture #FacialAnimation #genAI #Meshcapade

I'll be at #GDC2025 so if you are there and want to meet, you can probably find me at the @meshcapade.com booth.

YouTube video by DER SPIEGEL KI-Innovation: Hat Deutschland Antworten auf ChatGPT, DeepSeek & Co.? – Shortcut | DER SPIEGEL

Meshcapade was just featured again in DER SPIEGEL and their Spiegel-Shortcut podcast! 🎙️✨

The podcast highlights the diversity of ideas shaping the future - something we’re very proud to part of!

▶️ Watch on Youtube: www.youtube.com/watch?v=gN0X...

Turning videos into 3D humans has never been easier or more accurate. MoCapade 3.0 improves everything over 2.0 while adding 3D camera tracking (and output) and multi-person capture. Try out the new state-of-the-art. Of course, there's more to come.

YouTube video by Meshcapade MoCapade 3.0: Meshcapade's markerless mocap is live 🥳 🎉

MoCapade 3.0 goes LIVE today 🥳 🎉

👯 Multi-person capture
🎥 3D camera motion
🙌 Detailed hands & gestures
⏫ New GLB, MP4 and SMPL export formats

All from a single camera. Any camera! 📹 🤳 📸
Ready, set, CAPTURE! 🏂

youtu.be/jizULlZTAR8

Thanks, but this version of CameraHMR estimates SMPL and not SMPL-X. The default in SMPL is flat hands. So we can't really take credit for this! For a commercial version with SMPL-X hands, try out meshcapade.me

"AI is like electricity: the decisive factor is not who invented it, but who knows how to use it best." ⚡

YouTube video by alerender Mocap Suit - Mocap Video - TEST (subtitles)

Such a great comparison video showing what's possible with @meshcapade.com using a single video compared to using a mocap suit.

From 3D artist, Alejandro de Pasquale.

www.youtube.com/watch?v=ess6...