Rokoko

Cameras can only track what they can see 👀 Put your hand inside your shirt, and any camera-based motion capture system loses it instantly. Reach into a bag, same story. That's not a corner case. For robotics data collection and teleoperation, hands are constantly in and out of sight. In this video, our creative director Sam puts that to the test. Hand inside a shirt. Hands inside a backpack, pulling things out. In both cases, the Smartgloves II + Coil Pro tracks every finger, in perfect global position, the entire time. Sensor-based gloves alone can't do this either, as they'll typically drift over time or have no global position reference at all. So how does it work? There are actually three layers working together: 1. Coil Pro sits in the room and generates an EMF field spanning ~10 meters in each direction. This gives the hands an absolute position reference in global space. 2. Local Coil (in the hub on the palm), a smaller EMF field just around the hand, ensuring perfect relative positioning between fingers. 3. IMUs on each finger, inertial sensors that deliver the stability, smoothness, and high framerates needed for clean data. The result: full finger detail, absolute global position, no cameras, no drift. Regardless of what's physically in the way. 🧤

Running Rokoko Smart Glove 2 test with ComfyUI 🤙🏿 #dellproprecision #nvidia #delltech #rokoko #comfyui Cindy Olivo Logan Lawler

One key challenge with our Coil Pro platform has been balancing the absolute global positioning from the Coil Pro and Smartgloves with the relative positioning from the Smartsuit Pro. Yesterday, that changed 💥 Our latest Rokoko Studio release includes a major upgrade to how these systems work together, resulting in significantly improved performance. You now get the benefits of absolute positioning without compromising the core capture quality of the Smartsuit. This is one of the improvements we know many users have been waiting for, and it’s incredibly satisfying to finally ship it. Great work, team Rokoko ✨ Here’s a short clip from Sam's release video. Full video in the comments 👇

A little BTS as to how Pete Elsewhere was animated. It helps to explain how you created things before people start online yelling at you for falsely using AI (It's mocap and 3D animation just to be clear) Here's proof that it was in fact me acting and performing as Pete. Because I'm exploring quick workflows to generate animated content, I went back to motion capture technology from Rokoko studios, including the Smart Suit pro II, smart gloves and iPhone facial capture app. As well as a clip microphone to capture audio in real-time. The one thing I would probably change is a head mount for the facial capture. There was minimal cleanup in post, just a few hands clipping and missed facial data. I hope this clears things up, or maybe it raises more questions. Like, why is he naked? What books are on those shelves? Why aren't you ashamed of yourself? All questions in the comments please!

Working on productions like Stranger Things, Avatar, and Game of Thrones, VFX powerhouse Brad Tobler has spent years thinking deeply about what actually makes digital performances feel believable. Large movements are easy. It’s the tiny, subtle nuances that define the performance. Micro-adjustments, imperfections, subtle hand and finger movements that audiences instantly notice when they’re missing, even if they can’t explain why. Brad recently released a fantastic video exploring exactly that idea, recreating iconic cinematic moments using Rokoko's new Smartgloves II and Coil Pro. The video has already passed 300K views on YouTube, and if you’re interested in VFX, animation, mocap, or digital storytelling, it’s absolutely worth a watch (link in comments). Here’s a small teaser clip 👋🤘

MOCAP + AI is an overpowered combo! I've been testing the new Rokoko Smartgloves II and they have an incredibly robust solve. I definitely want to start using these with my Vicon optical MOCAP system. Full YouTube process video: https://lnkd.in/ejKQuJ9Z

Over the past year, robotics has become a major focus area for us at Rokoko. The combination of our Coil Pro with our new Smartgloves II is meeting the moment in a unique way, and the many years of R&D and investments in that platform are really paying off. Humanoid robotics is an emerging field, and everyone is experimenting and learning. Luckily for us, we have some of the world's leading robotics companies right in our backyard - more specifically in the beautiful city of Odense ☀️🇩🇰 Yesterday, we attended the NextGen Live conference, arranged by Odense Robotics 🤖 After a full day of inspiring presentations from Nicolas Heess of Google DeepMind, Deepu Talla from NVIDIA, Denmark's own Anders Billesø Beck from Universal Robots and many more, we had a blast demoing our tools, alongside a dancing Unitree Robotics humanoid and a beer-pouring Universal Robots arm 🍻 Thanks so much for inviting us and bringing such an amazing lineup to Denmark, Rasmus, Thomas and many more 🌟