Ruofei Du

Welcome to ruofei's reality! Ruofei Du serves as the Interactive Perception & Graphics Lead at Google AR and works on creating novel interactive technologies for virtual and augmented reality. Ruofei holds a Ph.D. in Computer Science from University of Maryland, College Park, advised by Prof. Varshney. Their research covers a wide range of topics in VR and AR, including depth-based interaction (DepthLab), mixed-reality social platforms (Geollery and Social Street View), 4D video-based rendering (Montage4D and VideoFields), foveated rendering (KFR and EFR), and deep learning in graphics (SketchySceneColorization). I am passionate about inventing interactive technologies with computer graphics, 3D vision, and HCI.

[CHI 2024] ChatDirector: Enhancing Video Conferencing with 3D Portraits, Shared Scene & Transitions

[CHI 2023 Talk] Rapsai: Accelerating Machine Learning Prototyping Via Visual Programming

[CHI2023 Talk] Visual Captions: Augmenting Verbal Communication With On-the-fly Visuals

[CHI 2023] Rapsai: Accelerating Machine Learning Prototyping of Multimedia Applications

[CHI 2023 PreTalk] Rapsai: Accelerating Machine Learning Prototyping of Multimedia Applications

[CHI 2023] Rapsai: Accelerating Machine Learning Prototyping of Multimedia Applications

[CHI 2022 Interactivity] Opportunistic Interfaces for Augmented Reality (Ad hoc UI preview)

[2013] B.S. Thesis: Video based Fatigue Detection

[CG&A] Saliency Computation for Virtual Cinematography in 360° Videos

DepthLab: Real-Time 3D Interaction With Depth Maps for Mobile Augmented Reality (UIST 2020)

[TVCG Honorable Mention] A Log-Rectilinear Transformation for Foveated 360-degree Video Streaming

[UIST 2020 Talk] DepthLab: Real-Time 3D Interaction With Depth Maps for Mobile Augmented Reality

[UIST'20 5min Talk] DepthLab: Real-Time 3D Interaction With Depth Maps for Mobile Augmented Reality

A Pilot Study of Spherical Harmonics for Saliency Computation and Navigation in 360° Videos

Project Geollery.com: Reconstructing a Live Mirrored World with Geotagged Social Media (Web3D 2019)

LUCSS: Language-based User-customized Colourization of Scene Sketches

Geollery: A Mixed Reality Social Media Metaverse (ACM CHI 2019)

梦的底片 - by 上海交通大学摄影协会

Shanghai Jiao Tong University 120 Anniversary Movie (English vocal & subtitles) 7min Version