Selected Publications
Check out full publication list at my Google Scholar profile.
EvolveDirector: Approaching Advanced Text-to-Image Generation with Large Vision-Language Models
The Thirty-eighth Annual Conference on Neural Information Processing Systems, 2024
Rui Zhao, Hangjie Yuan, Yujie Wei, Shiwei Zhang, Yuchao Gu, Lingmin Ran, Xiang Wang, Jay Wu, David Zhang, Yingya Zhang, Mike Zheng Shou.
[arXiv][Hugging Face]
[Github 
MotionDirector: Motion Customization of Text-to-Video Diffusion Models
Proceedings of the European Conference on Computer Vision, 2024
Rui Zhao, Yuchao Gu, Jay Zhangjie Wu, David Junhao Zhang, Jiawei Liu, Weijia Wu, Jussi Keppo, Mike Zheng Shou
[Project Page][arXiv]
[Github 
🎙️ Oral Presentation, Acceptance Rate: 2.3%.
🤗 Featured in Hugging Face “Spaces of the Week 🔥” trending list.
📃 Featured in “Top 40 most cited papers of ECCV 2024” list by AIR-SUN.
Show-1: Marrying Pixel and Latent Diffusion Models for Text-to-Video Generation
International Journal of Computer Vision, 2024
David Junhao Zhang†, Jay Zhangjie Wu†, Jia-Wei Liu†, Rui Zhao, Lingmin Ran, Yuchao Gu, Difei Gao, Mike Zheng Shou (†equal contribution)
[Project Page][arXiv]
[Github 
Zero-Shot Text-to-Parameter Translation for Game Character Auto-Creation
The IEEE Conference on Computer Vision and Pattern Recognition, 2023
Rui Zhao, Wei Li, Zhipeng Hu, Lincheng Li, Zhengxia Zou, Zhenwei Shi, and Changjie Fan
[PDF]
Media coverage: [NewScientist] Character creator AI puts Barack Obama – or anyone – in a video game || [游戏日报] 网易伏羲“文字捏脸”方向论文入选CVPR会议，称已应用于《逆水寒手游》 || CVPR 2023 | 网易伏羲5篇论文入选 包含文字捏脸等业内首创工作 || [AUTOMATON] Researchers report technological breakthroughs in using AI to “make characters by asking with words”. (in Japanese, for English version, please refer to reprint 1 and reprint 2) || [Nazology] "Character creation support AI" that creates the ideal face specified in the sentence is now available! .
Castle in the Sky: Dynamic Sky Replacement and Harmonization in Videos
IEEE Transactions on Image Processing, 2022
Zhengxia Zou, Rui Zhao, Tianyang Shi, Shuang Qiu, and Zhenwei Shi
[PDF][Project Page]
[Github 
Featured apps: Weights & Biases, a ML developer tool with 100,000+ practitioners.
Media coverage:
[TNW] This open-source AI tool can make your video spectacular with sky replacement effects ||
[Better Programming] The Top 10 Trending ML Projects of 2020.
High-resolution remote sensing image captioning based on structured attention
IEEE Transactions on Geoscience and Remote Sensing, 2021
Rui Zhao, Zhenwei Shi, and Zhengxia Zou
[PDF]
🏆️ ESI Highly Cited Paper*
* received enough citations to place in the top 1% of the academic field of Geosciences based on publication year. [Clarivate]
Text to Remote Sensing Image Generation With Structured Generative Adversarial Networks
IEEE Geoscience and Remote Sensing Letters, 2022
Rui Zhao, Zhenwei Shi
[PDF]
