Yudong Guo

I am an assistant professor at University of Science and Technology of China (USTC). I got my Ph.D. degree from USTC in 2021, supervised by Prof. Juyong Zhang. Before that, I received bachelor degree in Statistics in 2015 from USTC. From fall 2016 to spring 2017, I was a research assistant in the MultiMedia Lab at Nanyang Technological University under supervision of Prof. Jianfei Cai and Prof. Jianmin Zheng. My research interests include 3D vision and digital human.

Email  /  Google Scholar  /  Github

photo
One Shot, One Talk: Whole-body Talking Avatar from a Single Image
Jun Xiang, Yudong Guo, Leipeng Hu, Boyang Guo, Yancheng Yuan, Juyong Zhang
Arxiv, 2024
project page / paper / code (comming soon)

We adopt a 3DGS-Mesh coupled representation with pre-trained human video diffusion models for one-shot vivid talking avatars.

PICA: Physics-Integrated Clothed Avatar
Bo Peng, Yunfan Tao, Haoyu Zhan, Yudong Guo, Juyong Zhang
Arxiv, 2024
project page / paper / code (comming soon)

We integrate a neural physics simulation engine with the 3DGS avatar for realistic clothed body animation.

Portrait Video Editing Empowered by Multimodal Generative Priors
Xuan Gao, Haiyao Xiao, Chenglai Zhong, Shimin Hu, Yudong Guo, Juyong Zhang
SIGGRAPH Asia Conference Proceedings, 2024
project page / paper / code

We combine FlashAvatar with multimodal generative models to achieve consistent portrait video editing.

FlashAvatar: High-fidelity Head Avatar with Efficient Gaussian Embedding
Jun Xiang, Xuan Gao, Yudong Guo, Juyong Zhang
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2024
project page / paper / code

We attach 3DGS on mesh UV space to achieve 300FPS head avatar rendering.

TotalSelfScan: Learning Full-body Avatars from Self-Portrait Videos of Faces, Hands, and Bodies
Junting Dong*, Qi Fang*, Yudong Guo, Sida Peng, Qing Shuai, Hujun Bao, Xiaowei Zhou
NeurIPS, 2022
project page / paper / code

Reconstructing Personalized Semantic Facial NeRF Models From Monocular Video
Xuan Gao, Chenglai Zhong, Jun Xiang, Yang Hong, Yudong Guo, Juyong Zhang
SIGGRAPH Asia (Journal Track) , 2022
project page / paper / code
Prior-Guided Multi-View 3D Head Reconstruction
Xueying Wang, Yudong Guo, Zhongqi Yang, Juyong Zhang
IEEE Transactions on Multimedia (TMM) , 2021
paper

We utilize prior-guided implicit neural rendering to reconstruct the 3D head model.

AD-NeRF: Audio Driven Neural Radiance Fields for Talking Head Synthesis
Yudong Guo, Keyu Chen, Sen Liang, Yongjin Liu, Hujun Bao, Juyong Zhang
IEEE International Conference on Computer Vision (ICCV) , 2021
project page / paper / code / video

We address the talking head problem with the aid of dynamic neural radiance fields.

3D Face From X: Learning Face Shape from Diverse Sources
Yudong Guo, Lin Cai, Juyong Zhang
IEEE Transactions on Image Processing (TIP) , 2021
paper / video

We present a method to jointly learn a 3D face parametric model and 3D face reconstruction from diverse sources.

Real-Time Face View Correction for Front-Facing Cameras
Yudong Guo, Juyong Zhang, Yihua Chen, Hongrui Cai, Zhangjin Huang, Bailin Deng
Computational Visual Media , 2021
paper / video

Given the video stream from a single camera, we generate a stream that emulates the view from a virtual camera at a designated location.

StereoPIFu: Depth Aware Clothed Human Digitization via Stereo Vision
Yang Hong, Juyong Zhang, Boyi Jiang, Yudong Guo, Ligang Liu, Hujun Bao
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) , 2021
project page / paper / code

StereoPIFu integrates the geometric constraints of stereo vision with implicit representation to recover the 3D shape of the clothed human.

Landmark Detection and 3D Face Reconstruction for Caricature using a Nonlinear Parametric Model
Hongrui Cai, Yudong Guo, Zhuang Peng, Juyong Zhang
Graphical Models , 2021
paper / code

We propose the first automatic method for landmark detection and 3D face reconstruction for caricature by a 3D approach.

Lightweight Photometric Stereo for Facial Details Recovery
Xueying Wang, Yudong Guo, Bailin Deng, Juyong Zhang
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) , 2020
paper / code

We present a framework to recover high-fidelity face shapes from one-to-three images captured under near lights.

CNN-based Real-time Dense Face Reconstruction with Inverse-rendered Photo-realistic Face Images
Yudong Guo, Juyong Zhang, Jianfei Cai, Boyi Jiang, Jianmin Zheng
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) , 2018
paper / video / dataset

We present a novel face data generation method to train the 3DFaceNet for real-time dense face reconstruction from a monocular RGB video.



Wonderful template from Jon Barron.