Ningke Li

Ningke Li

šŸ’ƒ

šŸ‘‘ About Me

Hi, Iā€™m a master student in SECURITY PRIDE Research Group at Huazhong University of Science and Technology (HUST, School of Cyber Science and Engineering), co-supervised by Prof. Haoyu Wang and Dr. Kailong Wang. I received my B.E. degree in Information Security from Beijing University of Posts and Telecommunications in 2022. My research interests include AI + Program Analysis, OSS Security, and LLM Security.

Recently I have been diving into the deep ocean of programming languages (focusing on temporal logic and automatic theorem proving). šŸ“ššŸ„°

Looking for a PhD position in Europe and Singapore šŸ’–

šŸ„³ News

  • [13 Jun 2024] Our paper on metamorphic testing about LLM hallucination is accepted by OOPSLA 2024.

  • [01 Nov 2023] I recieve 2023 China National Scholarship.

  • [15 Aug 2023] Our paper on malicious npm/pypi package detection is accepted by ASE 2023 (Industry Challenge Track, full paper).

  • [07 Apr 2023] Our experience paper on label errors and denoising in deep learning-based vulnerability detection is accepted by ISSTA 2023.

  • [17 Jul 2022] Our paper on bug-triggering paths and multi-metrics in deep learning-based vulnerability detection is accepted by TDSC 2022, Vol.8.

  • [30 Jun 2022] I receive my B.E. degree at BUPT.

šŸ“ Publications

(# Equal Contribution, * Corresponding Author)

  • Drowzee: Metamorphic Testing for Fact-conflicting Hallucination Detection in Large Language Models
    Ningke Li#, Yuekang Li#, Yi Liu, Ling Shi, Kailong Wang*, Haoyu Wang.
    Object-Oriented Programming, Systems, Languages & Applications (OOPSLA), 2024.

  • MalWuKong: Towards Fast, Accurate, and Multilingual Detection of Malicious Code Poisoning in OSS Supply Chains
    Ningke Li, Shenao Wang, Mingxi Feng, Kailong Wang, Meizhen Wang, Haoyu Wang*.
    The 38th IEEE/ACM International Conference on Automated Software Engineering (ASE), Industry Challenge Track (full paper), 2023.

  • Understanding and Tackling Label Errors in Deep Learning-based Vulnerability Detection
    Xu Nie#, Ningke Li#, Kailong Wang*, Shangguang Wang, Xiapu Luo, Haoyu Wang*.
    ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA 2023).

  • How About Bug-Triggering Paths? - Understanding and Characterizing Learning-Based Vulnerability Detectors
    Xiao Cheng, Xu Nie, Ningke Li, Haoyu Wang, Zheng Zheng, Yulei Sui*.
    IEEE Transactions on Dependable and Secure Computing (TDSC), 2022, Vol.8.

šŸ† Honors and Awards

  • China National Scholarship, 2023
  • Outstanding Graduates of Beijing, 2022
  • Meritorious Winner of MCM/ICM, 2021
  • First Prize of University Scholarship, 2020
  • China National Scholarship, 2019