One Shot, One Talk: Whole-body Talking Avatar from a Single Image
Jun Xiang , Yudong Guo , Leipeng Hu, Boyang Guo, Yancheng Yuan , Juyong Zhang
Arxiv , 2024
project page /
paper /
code (comming soon)
We adopt a 3DGS-Mesh coupled representation with pre-trained human video diffusion models for one-shot vivid talking avatars.
PICA: Physics-Integrated Clothed Avatar
Bo Peng, Yunfan Tao, Haoyu Zhan, Yudong Guo , Juyong Zhang
Arxiv , 2024
project page /
paper /
code (comming soon)
We integrate a neural physics simulation engine with the 3DGS avatar for realistic clothed body animation.
Portrait Video Editing Empowered by Multimodal Generative Priors
Xuan Gao , Haiyao Xiao, Chenglai Zhong, Shimin Hu, Yudong Guo , Juyong Zhang
SIGGRAPH Asia Conference Proceedings , 2024
project page /
paper /
code
We combine FlashAvatar with multimodal generative models to achieve consistent portrait video editing.
FlashAvatar: High-fidelity Head Avatar with Efficient Gaussian Embedding
Jun Xiang, Xuan Gao, Yudong Guo , Juyong Zhang
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) , 2024
project page /
paper /
code
We attach 3DGS on mesh UV space to achieve 300FPS head avatar rendering.
Your browser does not support the video tag.
TotalSelfScan: Learning Full-body Avatars from Self-Portrait Videos of Faces, Hands, and Bodies
Junting Dong* ,
Qi Fang* ,
Yudong Guo ,
Sida Peng ,
Qing Shuai ,
Hujun Bao ,
Xiaowei Zhou
NeurIPS , 2022
project page /
paper /
code
Reconstructing Personalized Semantic Facial NeRF Models From Monocular Video
Xuan Gao, Chenglai Zhong, Jun Xiang, Yang Hong , Yudong Guo , Juyong Zhang
SIGGRAPH Asia (Journal Track) , 2022
project page /
paper /
code
Prior-Guided Multi-View 3D Head Reconstruction
Xueying Wang, Yudong Guo , Zhongqi Yang, Juyong Zhang
IEEE Transactions on Multimedia (TMM) , 2021
paper
We utilize prior-guided implicit neural rendering to reconstruct the 3D head model.
AD-NeRF: Audio Driven Neural Radiance Fields for Talking Head Synthesis
Yudong Guo , Keyu Chen, Sen Liang, Yongjin Liu , Hujun Bao , Juyong Zhang
IEEE International Conference on Computer Vision (ICCV) , 2021
project page /
paper /
code /
video
We address the talking head problem with the aid of dynamic neural radiance fields.
3D Face From X: Learning Face Shape from Diverse Sources
Yudong Guo , Lin Cai, Juyong Zhang
IEEE Transactions on Image Processing (TIP) , 2021
paper /
video
We present a method to jointly learn a 3D face parametric model and 3D face reconstruction from diverse sources.
Real-Time Face View Correction for Front-Facing Cameras
Yudong Guo , Juyong Zhang , Yihua Chen,
Hongrui Cai , Zhangjin Huang , Bailin Deng
Computational Visual Media , 2021
paper /
video
Given the video stream from a single camera, we generate a stream that emulates the view from a virtual camera at a designated location.
StereoPIFu: Depth Aware Clothed Human Digitization via Stereo Vision
Yang Hong , Juyong
Zhang , Boyi Jiang, Yudong
Guo , Ligang Liu , Hujun Bao
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) , 2021
project page /
paper /
code
StereoPIFu integrates the geometric constraints of stereo vision with implicit representation to recover the 3D shape of the clothed human.
Landmark Detection and 3D Face Reconstruction for Caricature using a Nonlinear Parametric Model
Hongrui Cai , Yudong Guo , Zhuang Peng, Juyong
Zhang
Graphical Models , 2021
paper /
code
We propose the first automatic method for landmark detection and 3D face reconstruction for caricature by a 3D approach.
Lightweight Photometric Stereo for Facial Details Recovery
Xueying Wang, Yudong Guo , Bailin Deng , Juyong
Zhang
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) , 2020
paper /
code
We present a framework to recover high-fidelity face shapes from one-to-three images captured under near lights.
CNN-based Real-time Dense Face Reconstruction with Inverse-rendered Photo-realistic Face Images
Yudong Guo , Juyong Zhang , Jianfei Cai , Boyi Jiang, Jianmin Zheng
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) , 2018
paper /
video /
dataset
We present a novel face data generation method to train the 3DFaceNet for real-time dense face reconstruction from a monocular RGB video.