Coming Soon!
Mediapipe Skeleton + Joint rotations and FK retargeting system capable of recording mocap from mediapipe and Body Track and Kinect v2 (and more) as BVH for easy retargeting in Blender, UE, Unity, Maya etc or retargeting live directly in Touchdesigner.
Mediapipe Joint rotations will be released for free on github while the universal retargeting system will be available on patreon. Supported retargeting includes: Meshcapade, Mixamo, UE Mannequin, Auto Rigger Pro, Rigify, Rokoko, Mesh to motion, BVH, Human IK, Vrm and more. You will be able to record mocap as Bvh motion clips or stream directly through UDP, OSC, to whichever 3d software you use that supports these same protocols.
-Solves quaternions to euler degrees for both 2d and 3d tracking methods in Touchdesigner using python WITHOUT using Numpy, SciPy or ThreeJS solvers. -Solves orientation differences between Mediapipe, other webcam based mocap solutions and all known skeletal rigs in local space.
-Solves missing mediapipe spine, neck and root.
-Solves Head rotation without using face landmark tracking.
-Simple fingers from hand rotations when hand tracking is not engaged.
-Custom Blendshapes integration into Takes network of any character fbx that has them.
Future updates will include support for
-Multi camera Tracking
-Improved stability when tracking drops
-Yolo integration
-ML5 integration
-Open Pose integration
-Vive trackers support
-Rokoko Suit, Perception Neuron support
-Other Optitrack and lidar tracking solutions
Works with all versions of TD from 2023-2026.
@touchdesigner
#touchdesigner #mocap #mediapipe #bodytrack #mixamo #meshcapade #python #retargeting #animation
