E-mail

Scholar

Github @haoyuc

Wechat @haoyuc98

Haoyu Chen

PhD student @ HKUST(GZ)

I received a Bachelor degree in Computer Science and Engineering at The Chinese University of Hong Kong, Shenzhen (CUHKSZ) in 2021.

I am a Ph.D. student at the Hong Kong University of Science and Technology (Guangzhou) advised by Prof. Lei Zhu and Prof. Ping Tan.

Mainly intrest in computer vision, especially in Low-level Vision, Image Processing, Multi-Modal Models and Generative Models.

News

• 2024-02: Two papers to appear in NeurIPS 2024.
• 2024-07: One paper to appear in ECCV 2024.
• 2024-02: Two papers to appear in CVPR 2024.
• 2023-07: Three papers to appear in ACM MM 2023.
• 2023-07: One first author paper to appear in ICCV 2023.
• 2023-04: One paper to appear in ICML 2023.
• 2023-02: One first author paper to appear in CVPR 2023.
• 2022-09: I am now a Ph.D. student at HKUSTGZ.

Education

The Hong Kong University of Science and Technology (Guangzhou)
Ph.D. student, 2022 ~ present.

The Chinese University of Hong Kong, Shenzhen
B.Eng., Major in Computer Science and Engineering, Sep 2017 - Jul 2021.

Publications

   Multi-Modal Models and Generative Models

	NeurIPS, 2024 RestoreAgent: Autonomous Image Restoration Agent via Multimodal Large Language Models Haoyu Chen, Wenbo Li, Jinjin Gu, Jingjing Ren, Sixiang Chen, Tian Ye, Renjing Pei, Kaiwen Zhou, Fenglong Song, Lei Zhu [Website] [arxiv]
	NeurIPS, 2024 UltraPixel: Advancing Ultra-High-Resolution Image Synthesis to New Peaks Jingjing Ren*, Wenbo Li*, Haoyu Chen, Renjing Pei, Bin Shao, Yong Guo, Long Peng, Lei Zhu [Website] [arxiv] [Code]
	arXiv, 2023 Towards Flexible, Scalable, and Adaptive Multi-Modal Conditioned Face Synthesis Jingjing Ren, Cheng Xu, Haoyu Chen, Xinran Qin, Chongyi Li, Lei Zhu [Website] [arxiv]

   Generalizable Image Restoration

	CVPR, 2024 Low-Res Leads the Way: Improving Generalization for Super-Resolution by Self-Supervised Learning Haoyu Chen, Wenbo Li, Jinjin Gu, Jingjing Ren, Haoze Sun, Xueyi Zou, Youliang Yan, Zhensong Zhang, Lei Zhu [Website] [arxiv]
	CVPR, 2023 Masked Image Training for Generalizable Deep Image Denoising Haoyu Chen*, Jinjin Gu*, Yihao Liu, Salma Abdel Magid, Chao Dong, Qiong Wang, Hanspeter Pfister, Lei Zhu [arxiv] [Code]
	CVPR, 2024 CoSeR: Bridging Image and Language for Cognitive Super-Resolution Haoze Sun, Wenbo Li, Jianzhuang Liu, Haoyu Chen, Renjing Pei, Xueyi Zou, Youliang Yan, Yujiu Yang [Website] [arxiv]
	ICML, 2023 Crafting Training Degradation Distribution for the Accuracy-Generalization Trade-off in Real-World Super-Resolution Ruofan Zhang, Jinjin Gu, Haoyu Chen, Chao Dong, Yulun Zhang, Wenming Yang [arxiv] [Code]
	arXiv, 2021 Attention in Attention Network for Image Super-Resolution Haoyu Chen, Jinjin Gu, Zhi Zhang [arxiv] [Code]
	ECCV, 2020 PIPAL: a Large-Scale Image Quality Assessment Dataset for Perceptual Image Restoration Jinjin Gu, Haoming Cai, Haoyu Chen, Xiaoxin Ye, Jimmy S.Ren, Chao Dong [Website] [arxiv] [Code] [Benchmark] [CVPR 2022 NTIRE Challenge] [Youtube] [Bilibili]

   Adverse Weather Restoration

	ICCV, 2023 Snow Removal in Video: A New Dataset and A Novel Method Haoyu Chen, Jingjing Ren, Jinjin Gu, Hongtao Wu, Xuequan Lu, Haoming Cai, Lei Zhu [arxiv] [Code] [Dataset]
	IJCV, 2024 Triplane-Smoothed Video Dehazing with CLIP-Enhanced Generalization Jingjing Ren, Haoyu Chen, Tian Ye, Hongtao Wu, Lei Zhu [paper]
	ECCV, 2024 Semi-Supervised Video Desnowing Network via Temporal Decoupling Experts and Distribution-Driven Contrastive Regularization Hongtao Wu, Yijun Yang, Angelica Aviles-Rivero, Jingjing Ren, Sixiang Chen, Haoyu Chen, Lei Zhu
	ACM MM, 2023 Mask-Guided Progressive Network for Joint Raindrop and Rain Streak Removal in Videos Hongtao Wu, Yijun Yang, Haoyu Chen, Jingjing Ren, Lei Zhu [paper]
	ACM MM, 2023 Uncertainty-Driven Dynamic Degradation Perceiving and Background Modeling for Efficient Single Image Desnowing Sixiang Chen*, Tian Ye*, Chenghao Xue, Haoyu Chen, Yun Liu, Erkang Chen, Lei Zhu [paper]
	ACM MM, 2023 Cross-scale Prototype Learning Transformer for Image Snow Removal Sixiang Chen*, Tian Ye*, Yun Liu, Jinbin Bai, Haoyu Chen, Yunlong Lin, Jun Shi, Erkang Chen [paper]

   Other

arXiv, 2018 Super-resolution perception for industrial sensor data Jinjin Gu, Haoyu Chen, Guolong Liu, Gaoqi Liang, Xinlei Wang, Junhua Zhao [arxiv]

3 CVPR    1 ICCV    2 ECCV    1 ICML    3 ACM MM    4 arXiv

Experience

Xiaobing.AI
2021.6 ~ 2022.2. Research Intern. Mentor: Dr. Baoyuan, Wang

Amazon Web Services Shanghai AI Lab
2020.5 ~ 2020.11. Software Develop Engineer Intern. Mentor: Zhi Zhang

Academic Service & Awards

Competition Awards

Program Committee / Reviewer

Hobbies & Interests

Outdoor

Travelling

Tennis

Music