Evaluating correct-consistency and robustness in code-generating LLMs
Author(s)
Honarvar, Shahin
Type
Conference Paper
Abstract
Ensuring the reliability of large language models (LLMs) for code generation is crucial for their safe integration into software engineering practices, especially in safety-critical domains. Despite advances in LLM tuning, they frequently generate incorrect code, raising concerns about robustness and trustworthiness. This PhD research introduces Turbulence, a novel benchmark and evaluation framework designed to assess both the correct-consistency and robustness of LLMs through a structured coding question neighbourhood approach. By evaluating model performance across sets of semantically related but non-equivalent coding tasks, Turbulence identifies discontinuities in LLM generalisation, revealing patterns of success and failure that standard correctness evaluations often overlook. Applied to 22 instruction-tuned LLMs across Python coding question neighbourhoods, the benchmark highlights significant variability in correctness, including error patterns persisting even under deterministic settings. Future work will extend the question neighbourhood concept to Capture The Flag (CTF) challenges, enabling a deeper analysis of model reasoning capabilities in progressively complex tasks. This extension has attracted interest from the UK AI Safety Institute, which recognises the frame-work's potential for advancing rigorous evaluation methodologies in the context of safe and trusted AI for software engineering.
Date Issued
2025-05-20
Date Acceptance
2025-03-01
Citation
2025 IEEE Conference on Software Testing, Verification and Validation (ICST), 2025, pp.797-800
Publisher
IEEE
Start Page
797
End Page
800
Journal / Book Title
2025 IEEE Conference on Software Testing, Verification and Validation (ICST)
Copyright Statement
Copyright © 2025, IEEE. This is the author’s accepted manuscript made available under a CC-BY licence in accordance with Imperial’s Research Publications Open Access policy (www.imperial.ac.uk/oa-policy)
License URL
Source
2025 IEEE Conference on Software Testing, Verification and Validation (ICST)
Publication Status
Published
Start Date
2025-03-31
Finish Date
2025-04-04
Coverage Spatial
Napoli, Italy