Welcome to Liyuan Lucas Liu (刘力源)‘s webpage! I am a Senior Researcher at Microsoft Research. My Ph.D. advisor is Prof. Jiawei Han, and my undergraduate advisor is Prof. Linli Xu. My research is about to understand the underlying mechanism of pretraining heuristics.
If you are going to visit Redmond, please let me buy you a bubble tea.
Ph.D. in Computer Science, 2024
University of Illinois at Urbana-Champaign
B.Eng. in Computer Science, 2016
University of Science and Technology of China
The success of large-scale pretraining hinges on intricate engineering heuristics. While the empirical benefits of these heuristics are evident, their underlying mechanisms remain elusive. My research endeavors to demystify the mathematical principles underlying these pretraining heuristics, aiming to illuminate their mechanisms and potentially guide future algorithm developments.
The latest reading group is available at Google Group. The reading lists are:
The latest DMG group meeting notification is available at Google Group.
I’ve served as a PC Member for ACL2020, WWW2020, AAAI2020, IJCAI2020, EMNLP2019, LLD2019, ACL2019, NAACL2019, AAAI2019, and EMNLP2018.