Advanced Kinect Rendering in TouchDesigner | Instancing, PBR, Depth Refinement, Shadows, and More

Project file and depth refinement component available on Patreon: https://www.patreon.com/posts/toe-adv...

This tutorial is a deep dive into rendering Kinect data in TouchDesigner. It covers:
isolating the subject
basic instancing
improved orthographic instancing
direct rendering (new technique using a GLSL material fragment shader)
real-time depth map refinement
adding shadows with hybrid rendering

It contains all the main tips and tricks I've learned from working with Kinect throughout the past 6+ years. Hope you find it helpful! You can check out @prismatic.visuals on Instagram to see more of my work.

Links I mentioned:
Interactive Immersive Kinect tutorial:    • Custom Depth Map from Kinect & RealSense P...  
Paketa12 normal map tox: https://derivative.ca/community-post/...
Shadertoy: https://www.shadertoy.com/
GLSL material documentation: https://docs.derivative.ca/Write_a_GL...
Polyhaven HDRIs: https://polyhaven.com/hdris
Lucas Morgan linear vs sRGB article: https://forum.derivative.ca/t/linear-...
Learn OpenGL shadow mapping: https://learnopengl.com/Advanced-Ligh...
Exsstas render buffers tutorial:    • Creative shading with render buffers - part 1  

Contents:
0:00 - intro
0:40 - outline
1:56 - isolating the subject
8:49 - basic instancing
10:52 - improved instancing
19:10 - direct rendering setup
26:21 - direct rendering implementation
32:03 - adding reflections
34:59 - depth refinement
41:34 - shadows
49:01 - outro