LEGATO 2: Toward Multimodal Sheet Music Recognition and Understanding
NeurIPS · 2026 (* equal contribution)
PhD Student · University of Washington
I'm a PhD student at the University of Washington’s Paul G. Allen School of Computer Science & Engineering, where I'm fortunate to be advised by Prof. Noah A. Smith. My research focuses on multimodal learning and evaluation. I’m also interested in interaction models and computer-use agents (CUA). Before joining UW, I studied in the Yao Class at Tsinghua University, where I worked under the guidance of Zhilin Yang and Zhiyuan Liu.
I can’t take credit for all the great work by Guang Yang. You might be looking for:
Our new preprints, HERA and Rubric-Based Optimization for Text-to-Music Generation, are now on arXiv.
LEGATO is cited in OpenAI’s GPT-6 Astra announcement! 🎉
Our new preprint, A Dual Evaluation for Music Transcription, is now on arXiv.
Our new preprint, LEGATO 2: Toward Multimodal Sheet Music Recognition and Understanding, is now on arXiv.
I joined Microsoft for a summer internship!
Our new preprint, Rubato: Transcribing Piano Music with Timestamps, is now on arXiv.
NeurIPS · 2026 (* equal contribution)
ICLR · 2026
arXiv preprint · 2026 (* equal contribution)
COLM 2026 Workshop · Sci-FM
arXiv preprint · 2026 (* equal contribution)
COLM · 2026 (* equal contribution)
NeurIPS · 2026 · Spotlight
arXiv preprint · 2026
ISMIR · 2024
AAAI · 2023
Nature Machine Intelligence · 2023 · Cover Article (* equal contribution)