Jian Chen
I am a Senior Foundational AI Researcher at Dolby Laboratories in the Advanced Technology Group, where I focus on multimodal AI research aimed at enabling immersive digital experiences and ensuring data integrity and security.
I also continue to collaborate actively with academic partners on the application and optimization of multimodal-LLMs and ML algorithms.
Education
- Ph.D. in Computer Science, University at Buffalo, 2018 Fall - 2025 Spring
- M.S. in Electrical Engineering, Drexel University, 2015 Fall - 2017 Spring
- B.S. in Applied Mathematics, Hunan University, 2011 Fall - 2015 Spring
Experience
- Dolby Laboratories, Senior Foundational Audio AI Researcher, 06/2025
- Adobe, Intern Research Scientist/Engineer, 05/2024 - 11/2024
- Mohamed bin Zayed University of Artificial Intelligence, Research Assistant, 10/2023 - 02/2024
- Jacobs School of Medicine and Biomedical Sciences at UB, Research Assistant, 09/2018 - 09/2021
Research
Selected Publications
Jian Chen, Ruiyi Zhang, Yufan Zhou, Tong Yu, Franck Dernoncourt, Jiuxiang Gu, Ryan A. Rossi, Changyou Chen, Tong Sun, “SV-RAG: LoRA-Contextualizing Adaptation of MLLMs for Long Document Understanding”, ICLR 2025
Jiayu Qin, Jian Chen, Rohan Sharma, Jingchen Sun, Changyou Chen “A probability contrastive learning framework for 3D molecular representation learning”, NeurIPS 2024
Jian Chen, Ruiyi Zhang, Yufan Zhou, Jennifer Healey, Jiuxiang Gu, Changyou Chen, “TextLap: Customizing Language Models for Text-to-Layout Planning”, EMNLP 2024
Ruiyi Zhang, Yanzhe Zhang, Jian Chen, Yufan Zhou, Jiuxiang Gu, Changyou Chen, Tong Sun, “TRINS: Towards Multimodal Language Models that Can Read”, CVPR 2024
Jian Chen, Ruiyi Zhang, Yufan Zhou, Rajiv Jain, Zhiqiang Xu, Ryan Rossi, Changyou Chen, “Towards Aligned Layout Generation via Diffusion Model with Aesthetic Constraints”, ICLR 2024
Jian Chen, Ruiyi Zhang, Tong Yu, Rohan Sharma, Zhiqiang Xu, Tong Sun, Changyou Chen, “Label-Retrieval-Augmented Diffusion Models for Learning from Noisy Labels”, NeurIPS 2023
Jian Chen , “Timed hazard networks: Incorporating temporal difference for oncogenetic analysis”. PLOS ONE, 18(3):e0283004, 2023
Selected Preprint:
Jian Chen, Wenye Ma, Penghang Liu, Wei Wang, Tengwei Song, Ming Li, Chenguang Wang, Ruiyi Zhang, Changyou Chen, “MusiXQA: Advancing Visual Music Understanding in Multimodal Large Language Models”, arXiv 2025
Jian Chen, Ruiyi Zhang, Yufan Zhou, Ryan Rossi, Jiuxiang Gu, Changyou Chen, “MMR: Evaluating Reading Ability of Large Multimodal Models”, arXiv 2024
Ruiyi Zhang, Yufan Zhou, Jian Chen, Jiuxiang Gu, Changyou Chen, Tong Sun, “LLaVA-Read: Enhancing Reading Ability of Multimodal Language Models”, arXiv 2024
Reviewer Service
- 2025: ICLR (Notable Reviewer), ACL, ICCV, ICML, CVPR, NeurIPS
- 2024: ICML, TMLR, TETCI, PLOS ONE
Awards:
Best Graduation Thesis: “Low-rank tensor optimization for video image recovery.” Hunan University, 2015
Music
I play guitar and do music arrangement as a hobby. And, I have a Youtube Channel:
Licenses & certifications
- Certificate, Songwriting: Writing the Music, Berklee Online, 2025 May