Shu-Yu Chen

chenshuyu AT ict dot ac dot cn


I am Shu-Yu Chen, a associate professor at  Institute of Computing Technology, Chinese Academy of Sciences. I received my PHD degree from Institute of Computing Technology, Chinese Academy of Sciences of Prof. Lin Gao and Prof. Shihong Xia.

My current research interests include computer graphics, computer vision and deep learning.


Research


 

 

 

 

 

 

 

 

 

 

 

 

Real-time 3D-aware Portrait Video Relighting
Ziqi Cai, Kaiwen Jiang, Shu-Yu Chen, Yu-Kun Lai, Hongbo Fu, Boxin Shi, Lin Gao
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2024
Project

StrokeFaceNeRF: Stroke-based Facial Appearance Editing in Neural Radiance Field
Xiao-Juan Li, Dingxi Zhang, Shu-Yu Chen, Feng-Lin Liu
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) , 2024

Multi-Level Patch Transformer for Style Transfer with Single Reference Image
Yue He#, Lan Chen#, Yu-Jie Yuan, Shu-Yu Chen, Lin Gao
The 12th international conference on Computational Visual Media (CVM 2024)

Text2Face: Text-based Face Generation with Geometry and Appearance Control
Zhaoyang Zhang, Junliang Chen, Hongbo Fu, Jianjun Zhao, Shu-Yu Chen, Lin Gao
International Conference on Computational Visual Media 2023 (Recommended to IEEE Transactions on Visualization and Computer Graphics (IEEE TVCG))
Paper |  Video ( YouTube  Bilibili)

DeepFaceReshaping: Interactive Deep Face Reshaping via Landmark Manipulation
Shu-Yu Chen, Yue-Ren Jiang, Hongbo Fu, Xinyang Han, Zitao Liu, Rong Li, Lin Gao
International Conference on Computational Visual Media 2023 (Recommended to Computational Visual Media Journal)
Paper |  Video ( YouTube  Bilibili)

Identity-aware and Shape-aware Propagation of Face Editing in Videos
Yue-Ren Jiang#, Shu-Yu Chen#, Hongbo Fu, Lin Gao
IEEE Transactions on Visualization and Computer Graphics (IEEE TVCG), To Appear
Paper |  Project |  Paper

Keyframe Control of Music-driven 3D Dance Generation
Zhipeng Yang#, Yu-Hui Wen#, Shu-Yu Chen, Xiao Liu, Yuan Gao, Yong-Jin Liu, Lin Gao, Hongbo Fu
IEEE Transactions on Visualization and Computer Graphics (IEEE TVCG), To Appear
Paper |  Video ( YouTube  Bilibili)

LC-NeRF: Local Controllable Face Generation in Neural Radiance Field
Wen-Yang Zhou, Lu Yuan, Shu-Yu Chen, Lin Gao, Shi-Min Hu
IEEE Transactions on Visualization and Computer Graphics (IEEE TVCG), To Appear

NeRFFaceLighting: Implicit and Disentangled Face Lighting Representation Leveraging Generative Prior in Neural Radiance Fields
Kaiwen Jiang, Shu-Yu Chen, Hongbo Fu, Lin Gao
ACM Transactions on Graphics, 2023
Paper |  Project |  Video ( YouTube  Bilibili)

SketchFaceNeRF: Sketch-based Facial Generation and Editing in Neural Radiance Fields
Lin Gao, Feng-Lin Liu, Shu-Yu Chen, Kaiwen Jiang, Chunpeng Li, Yu-Kun Lai, Hongbo Fu
ACM Transactions on Graphics (ACM SIGGRAPH 2023), 2023, 42(4), 159:1--159:17
Project |  Video |  Online System

NeRFFaceEditing: Disentangled Face Editing in Neural Radiance Fields
Kaiwen Jiang, Shu-Yu Chen, Feng-Lin Liu, Hongbo Fu, Lin Gao
ACM SIGGRAPH Asia 2022 (Conference Track)
Project |  Video 

DeepVideoFaceEditing: Sketch-based Deep Editing of Face Videos
Feng-Lin Liu, Shu-Yu Chen, Yu-Kun Lai, Chun-Peng Li, Yue-Ren Jiang, Hongbo Fu, Lin Gao
ACM Transactions on Graphics (ACM SIGGRAPH North America 2022), 2022, 41(4), 167:1-167:16
Project |  Bibtex



3D Face Reconstruction and Gaze Tracking in the HMD for Virtual Interaction
Shu-Yu Chen, Yu-Kun Lai, Shihong Xia, Paul L. Rosin, Lin Gao
IEEE Transactions on Multimedia, To Appear, 2022

DrawingInStyles: Portrait Image Generation and Editing with Spatially Conditioned StyleGAN
Wanchao Su, Hui Ye, Shu-Yu Chen, Lin Gao, Hongbo Fu
IEEE Transactions on Visualization and Computer Graphics (IEEE TVCG), 2022
Paper



A review of image and video colorization: From analogies to deep learning
Shu-Yu Chen, Jia-Qi Zhang, You-You Zhao, Paul L. Rosin, Yu-Kun Lai, Lin Gao
Visual Informatics, To Appear, 2022

Active Colorization for Cartoon Line Drawing
Shu-Yu Chen#, Jia-Qi Zhang#, Lin Gao, Yue He, Shihong Xia, Min Shi, Fang-Lue Zhang
IEEE Transactions on Visualization and Computer Graphics (IEEE TVCG), 28(2), 1198-1208
YouTube |  Video

Deep Line Art Video Colorization with a Few References
Min Shi, Jia-Qi Zhang, Shu-Yu Chen, Lin Gao, Yu-Kun Lai, Fang-Lue Zhang
IEEE Transactions on Visualization and Computer Graphics (IEEE TVCG), To Appear, 2022
Paper |  Video ( YouTube  Bilibili) |  Bibtex

DeepFaceEditing: Deep Face Generation and Editing with Disentangled Geometry and Appearance Control
Shu-Yu Chen#, Feng-Lin Liu#, Yu-Kun Lai, Paul Rosin, Chun-Peng Li, Hongbo Fu, Lin Gao
ACM Transactions on Graphics (SIGGRAPH 2021), 2021, 40(4), 90:1-90:15
Paper |  Project |  Video |  Fast Forward |  Bibtex

DeepFaceDrawing: Deep Generation of Face Images from Sketches
Shu-Yu Chen#, Wanchao Su#, Lin Gao, Shihong Xia, Hongbo Fu
ACM Transactions on Graphics (SIGGRAPH 2020), 2020, 39(4), 72:1-72:16
Paper |  Project |  Video |  Fast Forward |  Online System Cover |  Bibtex

Real-Time 3D Face Reconstruction And Gaze Tracking For Virtual Reality
Shu-Yu Chen, Lin Gao*, Yu-Kun Lai, Paul L. Rosin, Shihong Xia
IEEE Conference on Virtual Reality(IEEE VR 2018)
Paper |  Video

Rigidity Controllable As-Rigid-As-Possible Shape Deformation
Shu-Yu Chen, Lin Gao*, Yu-Kun Lai, Shihong Xia
Graphical Models 2017
Paper

Data-Driven Shape Interpolation and Morphing Editing
Lin Gao*, Shu-Yu Chen, Yu-Kun Lai, Shihong Xia
Computer Graphics Forum 2017
Paper |  Video

Efficient and Flexible Deformation Representation for Data-Driven Surface Modeling
Lin Gao*, Yu-Kun Lai, Dun Liang, Shu-Yu Chen, Shihong Xia
ACM Transactions on Graphics(SIGGRAPH 2016)
Paper |  Video




Education


University of Chinese Academy of Science
Computer Graphics
PHD's Degree
September 2015 - January 2021

Cardiff University, Wales, UK
Short Term Study
November 2018
December 2017

Zhengzhou University
Computer Science and Technology
Bachelor's Degree
September 2011 - July 2015

Zhengzhou University
Administrative management
Minor Program
September 2012 - July 2015



Honors and Awards







129 Pageviews
Mar. 01st - Mar. 29th