Sony’s FR7 camera tracking comes to TouchDesigner

The story

Why it matters: Keeping CG locked to a moving camera normally takes a separate tracking system. The FR7 reports its own position and lens settings, so the camera and one printed marker are enough.

How it works:

• The FR7 streams its position, rotation, focal length, focus and iris as OpenTrackIO, SMPTE’s free, open tracking protocol.
• Two new TouchDesigner operators receive that stream and calibrate the camera to the room from a single marker.
• The CG camera then pans, tilts and zooms with the real one.

How we got here:

• April: our first workshop and implementation, in the studio, with Sony engineers Ryunosuke Yokoya and Yuki Asukabe and Jarrett Smith of Derivative. The demos included the tracked camera driving AI models live.
• July: Sony showed the work at SIGGRAPH 2026.
• This fall: Sony showed it again at IBC 2026 in Amsterdam.
• October: the team came back to review the next stage before release.

What’s next: The toolkit, TDOpenTrackIO, is released officially in a few weeks. At NAB in April we’ll demo OpenPose body tracking with the tracked FR7, in a new and much better scene.

Go deeper: OpenTrackIO · TouchDesigner