Yudong Guo

I am a Ph.D. student in school of Mathematical Sciences at USTC, supervised by Prof. Juyong Zhang. Before that, I received bachelor degree in Statistics in 2015 from University of Science and Technology of China (USTC). From fall 2016 to spring 2017, I was a research assistant in the MultiMedia Lab at Nanyang Technological University under supervision of Prof. Jianfei Cai and Prof. Jianmin Zheng. My research interests include 3D vision and digital human.

Email  /  Google Scholar  /  Github

AD-NeRF: Audio Driven Neural Radiance Fields for Talking Head Synthesis
Yudong Guo, Keyu Chen, Sen Liang, Yongjin Liu, Hujun Bao, Juyong Zhang
arXiv , 2021
project page / paper / video

We address the talking head problem with the aid of neural scene representation networks. The feature of audio is fed into a conditional implicit function to generate a dynamic neural radiance field for high-fidelity talking-head video synthesis.

3D Face From X: Learning Face Shape from Diverse Sources
Yudong Guo, Lin Cai, Juyong Zhang
IEEE Transactions on Image Processing (TIP) , 2021
paper / video

We present a method to jointly learn a 3D face parametric model and 3D face reconstruction from diverse sources including scanned 3D faces, in-the-wild facial images and RGB-D images captured with an iPhone X.

Real-Time Face View Correction for Front-Facing Cameras
Yudong Guo, Juyong Zhang, Yihua Chen, Hongrui Cai, Zhangjin Huang, Bailin Deng
Computational Visual Media , 2021
paper / video

We takes the video stream from a single RGB camera as input, and generates a video stream that emulates the view from a virtual camera at a designated location.

StereoPIFu: Depth Aware Clothed Human Digitization via Stereo Vision
Yang Hong, Juyong Zhang, Boyi Jiang, Yudong Guo, Ligang Liu, Hujun Bao
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) , 2021
paper (comming soon) / code (comming soon) / video

We propose StereoPIFu, which integrates the geometric constraints of stereo vision with implicit function representation of PIFu, to recover the 3D shape of the clothed human.

Landmark Detection and 3D Face Reconstruction for Caricature using a Nonlinear Parametric Model
Hongrui Cai, Yudong Guo, Zhuang Peng, Juyong Zhang
Graphical Models , 2021
paper / code

We propose the first automatic method for landmark detection and 3D face reconstruction for caricature by a 3D approach.

Lightweight Photometric Stereo for Facial Details Recovery
Xueying Wang, Yudong Guo, Bailin Deng, Juyong Zhang
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) , 2020
paper / code

We present a lightweight strategy that only requires sparse inputs or even a single image to recover high-fidelity face shapes with images captured under near-field lights.

CNN-based Real-time Dense Face Reconstruction with Inverse-rendered Photo-realistic Face Images
Yudong Guo, Juyong Zhang, Jianfei Cai, Boyi Jiang, Jianmin Zheng
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) , 2018
paper / video / dataset

This paper presents a novel face data generation method to train the 3DFaceNet for real-time dense face reconstruction from a monocular RGB video.

Wonderful template from Jon Barron.