MediaPipe in TouchDesigner

What it does #

A GPU-accelerated, self-contained MediaPipe plugin for TouchDesigner that runs on Mac and PC with no installation. It covers face detection and landmarks, hand tracking and gestures, pose, object detection, image segmentation and classification.

The main MediaPipe component runs the models in a built-in browser and outputs a DAT per task plus a TOP with the video and overlays. Companion components show how to use each model's data.

Getting it #

Download release.zip, always the latest release, and open the example .toe; the components are in its toxes folder. When you drag MediaPipe.tox into your own project, turn on Enable External .tox, or your .toe grows by the size of the models.