Shudong Liu (刘树东)

Hi! I am currently a PhD student of Computer Science in Department of Computer and Information Science and Faculty of Science and Technology at University of Macau beginning from 2022 Fall, also a member of NLP2CT Lab advised by Prof. Derek F. Wong. Recently, I also work as a research intern at Shanghai AI Lab and Microsoft Research Asia. I am broadly interested in natural language processing and machine learning. Current interests mainly focus on evaluation and post-training of LLMs.

Research Interests

• LLMs Understanding and Evaluation for reasoning ability, uncertainty estimation, social science, multi-model
• LLMs Application and Post-training on synthetic data, self-perception, alignment, retrieval

Recent Publications (* denotes equal contribution)

• Is Your Model Really A Good Math Reasoner? Evaluating Mathematical Reasoning with Checklist.
  Zihao Zhou*, Shudong Liu*, Maizhen Ning, Wei Liu, Jindong Wang, Derek F. Wong, Xiaowei Huang, Qiufeng Wang, Kaizhu Huang.
  In ICLR 2025. [Project]
• CultureVLM: Characterizing and Improving Cultural Understanding of Vision-Language Models for over 100 Countries.
  Shudong Liu, Yiqiao Jin, Cheng Li, Derek F. Wong, Qingsong Wen, Lichao Sun, Haipeng Chen, Xing Xie, Jindong Wang.
  In Preprint 2025.
• Learning from "Silly" Questions Improves Large Language Models, But Only Slightly.
  Tingyuan Zhu, Shudong Liu, Yidong Wang, Derek F. Wong, Han Yu, Takahiro Shinozaki, Jindong Wang.
  In AAAI 2025 Workshop.
• Can LLMs Learn Uncertainty on Their Own? Expressing Uncertainty Effectively in A Self-Training Manner
  Shudong Liu, Zhaocong Li, Xuebo Liu, Runzhe Zhan, Derek F. Wong, Lidia S. Chao, Min Zhang.
  In EMNLP 2024.
• Domain-Aware k-Nearest-Neighbor Knowledge Distillation for Machine Translation.
  Zhexuan Wang*, Shudong Liu*, Xuebo Liu, Miao Zhang, Derek F. Wong, and Min Zhang.
  In ACL 2024 Findings.
• kNN-TL: k-Nearest-Neighbor Transfer Learning for Low-Resource Neural Machine Translation.
  Shudong Liu, Xuebo Liu, Derek F. Wong, Zhaocong Li, Wenxiang Jiao, Lidia S. Chao and Min Zhang.
  In ACL 2023.
• Can LMs Generalize to Future Data? An Empirical Analysis on Text Summarization.
  Chi Seng Cheang, Hou Pong Chan, Derek F. Wong, Xuebo Liu, Zhaocong Li, Yanming Sun, Shudong Liu, Lidia S. Chao.
  In EMNLP 2023.
• A Graph Attention Interactive Refine Framework with Contextual Regularization for Jointing Intent Detection and Slot Filling.
  Zhanbiao Zhu, Peijie Huang, Haojing Huang, Shudong Liu and Leyi Lao.
  In ICASSP 2022.
• Cross-domain Slot Filling with Distinct Slot Entity and Type Prediction.
  Shudong Liu, Peijie Huang, Zhanbiao Zhu, Hualin Zhang and Jianying Tan.
  In NLPCC 2021. (Oral)

Experience

• 2024.05 - 2024.12, Research Intern at Microsoft Research Asia. Mentor: Dr. Jindong Wang.
• 2025.01 - present, Research Intern at Shanghai AI Lab. Team: LLM Center and OpenCompass.

Services

• OpenReview Chair: NLPCC 2024
• PC Member / Reviewer: NeurIPS 2024-2025; ICML 2025; ICLR 2025; AISTATS 2025; ACL Roling Review 2023-2025 (ACL, EMNLP, NAACL); CCL 2023-2024
• Student Volunteer: EMNLP 2024; MT Summit 2023
• Teaching Assistant
  • CISC7021 Applied Natural Language Processing (2022 Fall, 2023 Fall, 2024 Fall)
  • CISC4000 Graduation Project (2023 Spring)
  • CISC7203 Database and Data Mining Technologies (2024 Spring)

Activities

• 2025.01, Be awarded the Stars of Tomorrow at Microsoft Research Asia
• 2024.11, Be recognized as an Outstanding Reviewer at EMNLP 2024
• 2024.02, Given an invited talk Transfer Learning for Low-Resource NMT at University of Toronto (Online)

Education

• Ph.D. student in Computer Science, University of Macau (UM), Macau SAR, China, 2022 - present. Advised by Prof. Derek F. Wong and Prof. Xuebo Liu.
• B.S. in Software Engineering, South China Agricultural University (SCAU), Guangzhou, China, 2018 - 2022. GPA: 91.2/100.