Ningke Li

Ningke Li

šŸ’ƒ

šŸ‘‘ About Me

Hi, Iā€™m a PhD student in TEST Lab at the School of Computing, National University of Singapore, supervised by Prof. Manuel Rigger. I received my master degree in Cybersecurity from Huazhong University of Science and Technology in 2025 under the supervision of Prof. Haoyu Wang and Prof. Kailong Wang. I received my B.E. degree in Information Security from Beijing University of Posts and Telecommunications in 2022. My research interests include AI4Testing and Testing4AI.

Recently I have been diving into the deep ocean of programming languages (focusing on temporal logic and automatic theorem proving). šŸ“ššŸ„°

šŸ„³ News

  • [04 Aug 2025] I become a PhD student at NUS.

  • [22 Jun 2025] I received my master degree at HUST.

  • [13 Jun 2024] Our paper on metamorphic testing about LLM hallucination is accepted by OOPSLA 2024.

  • [01 Nov 2023] I recieve 2023 China National Scholarship.

  • [15 Aug 2023] Our paper on malicious npm/pypi package detection is accepted by ASE 2023 (Industry Challenge Track, full paper).

  • [07 Apr 2023] Our experience paper on label errors and denoising in deep learning-based vulnerability detection is accepted by ISSTA 2023.

  • [17 Jul 2022] Our paper on bug-triggering paths and multi-metrics in deep learning-based vulnerability detection is accepted by TDSC 2022, Vol.8.

  • [30 Jun 2022] I receive my B.E. degree at BUPT.

šŸ“ Publications

(# Equal Contribution, * Corresponding Author)

  • Drowzee: Metamorphic Testing for Fact-conflicting Hallucination Detection in Large Language Models
    Ningke Li#, Yuekang Li#, Yi Liu, Ling Shi, Kailong Wang*, Haoyu Wang.
    Object-Oriented Programming, Systems, Languages & Applications (OOPSLA), 2024.

  • MalWuKong: Towards Fast, Accurate, and Multilingual Detection of Malicious Code Poisoning in OSS Supply Chains
    Ningke Li, Shenao Wang, Mingxi Feng, Kailong Wang, Meizhen Wang, Haoyu Wang*.
    The 38th IEEE/ACM International Conference on Automated Software Engineering (ASE), Industry Challenge Track (full paper), 2023.

  • Understanding and Tackling Label Errors in Deep Learning-based Vulnerability Detection
    Xu Nie#, Ningke Li#, Kailong Wang*, Shangguang Wang, Xiapu Luo, Haoyu Wang*.
    ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA 2023).

  • How About Bug-Triggering Paths? - Understanding and Characterizing Learning-Based Vulnerability Detectors
    Xiao Cheng, Xu Nie, Ningke Li, Haoyu Wang, Zheng Zheng, Yulei Sui*.
    IEEE Transactions on Dependable and Secure Computing (TDSC), 2022, Vol.8.

šŸ† Honors and Awards

  • China National Scholarship, 2023
  • Outstanding Graduates of Beijing, 2022
  • Meritorious Winner of MCM/ICM, 2021
  • First Prize of University Scholarship, 2020
  • China National Scholarship, 2019