Chaoyue Song 宋超越

I am a PhD student at the School of Computer Science and Engineering, Nanyang Technological University, supervised by Prof. Guosheng Lin and Dr. Fayao Liu. Previously, I received my Bachelor’s Degree at Shanghai Jiao Tong University, supervised by Prof. Bingbing Ni. I was fortunate to have an internship at TikTok in 2024, working with Dr. Jiashi Feng and Dr. Jianfeng Zhang.

My research interests lie in computer vision and machine learning, with a current focus on 3D vision (reconstruction, animation, and generation) and generative AI. If you want to know more about me, please feel free to contact me.

Email  /  Google Scholar /  Github /  Twitter



Research



High Quality Human Image Animation using Regional Supervision and Motion Blur Condition
Zhongcong Xu*, Chaoyue Song*, Guoxian Song*, Jianfeng Zhang, Jun Hao Liew, Hongyi Xu, You Xie, Linjie Luo, Guosheng Lin, Jiashi Feng, and Mike Zheng Shou
arXiv, 2024
arXiv


REACTO: Reconstructing Articulated Objects from a Single Video
Chaoyue Song, Jiacheng Wei, Chuan-Sheng Foo, Guosheng Lin, and Fayao Liu
CVPR, 2024
Project / Code / arXiv / Video


Sync4D: Video Guided Controllable Dynamics for Physics-Based 4D Generation
Zhoujie Fu*, Jiacheng Wei*, Wenhao Shen, Chaoyue Song, Xiaofeng Yang, Fayao Liu, Xuelei Yang, and Guosheng Lin
arXiv, 2024
Project / arXiv


MoDA: Modeling Deformable 3D Objects from Casual Videos
Chaoyue Song, Jiacheng Wei, Tianyi Chen, Yiwen Chen, Chuan-Sheng Foo, Fayao Liu, and Guosheng Lin
arXiv, 2023
Project / Code / arXiv / Video


Unsupervised 3D Pose Transfer with Cross Consistency and Dual Reconstruction
Chaoyue Song, Jiacheng Wei, Ruibo Li, Fayao Liu, and Guosheng Lin
TPAMI, 2023
Project / Code / arXiv


3D Pose Transfer with Correspondence Learning and Mesh Refinement
Chaoyue Song, Jiacheng Wei, Ruibo Li, Fayao Liu, and Guosheng Lin
NeurIPS, 2021
Project / Code / arXiv / Video / Video (in Chinese)


CartoonRenderer: An Instance-based Multi-Style Cartoon Image Translator
Yugang Chen, Muchun Chen, Chaoyue Song, and Bingbing Ni
MMM, 2020


Facial Image Deformation Based on Landmark Detection
Chaoyue Song, Yugang Chen, Shulai Zhang, and Bingbing Ni
Technique report, 2019

Project


Dense QR Decoder Based on TensorFlow Lite
National Undergraduate IOT Design Contest in China: First Prize in Finals (Top 35 of the 2000 teams), 2019
Video
We developed an APP which can decodes plenty of QR codes at the same time.

Awards

  • Singapore International Graduate Award (SINGA), 2022
  • Outstanding Graduate of Shanghai, 2020
  • National Undergraduate IOT Design Contest in China: First Prize in Final Contest (Top 35 of the 2000 teams), 2019
  • Outstanding Scholarship of Shanghai Jiao Tong University, 2017, 2018, 2019
  • Excellent Student Cadre of Shanghai Jiao Tong University, 2018
Visitors


Template borrowed from this awesome website.