Hey! In this tutorial, we'll go over the new free open-sourced MediaPipe plugin for TouchDesigner that's GPU accelerated and works on Mac and PC with no instillation. The plugin supports face, hand, pose and object tracking with multi-person face detection, object detection, and image segmentation / background removal.
Link to the GitHub to download the Plugin: https://github.com/torinmb/mediapipe-touchdesigner
Dom Scott's website: https://art.domscott.ca/home
Link to Torin's Patreon: https://patreon.com/blankensmithing
Link to the body tracking alternative: https://www.youtube.com/watch?v=83StND-y4fY
Link to OBS for using video with MediaPipe on Mac: https://obsproject.com/
Link to SpoutCam for using video on PC: https://github.com/leadedge/SpoutCam/releases
0:00 Intro and Overview
1:44 Project Setup
5:43 Face Landmark Detection
9:37 Hand Tracking + Gesture Recognition
13:49 Pose Tracking
16:37 Object Tracking
18:05 Multi Person Face Detection
19:21 Image Classification
20:56 Image Segmentation / Background Removal
23:58 On Mac Pipe Video into MediaPipe with OBS
26:26 On PC Pipe Video into MediaPipe with SpoutCam
28:30 Outro