Digitala Vetenskapliga Arkivet

Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Achieving self-healing code with LLMs
Mälardalen University, School of Innovation, Design and Engineering.
2025 (English)Independent thesis Basic level (degree of Bachelor), 10 credits / 15 HE creditsStudent thesis
Abstract [en]

This study investigates LLMs for their potential in achieving self-healing capabilities in code. Ten LLMs were evaluated using a dataset of 76 problems sourced from Leetcode in two programming languages: C++ and Java. The programming problems are categorized into three difficulty levels: easy, medium, and hard. Leetcode classifies the programming problems into different difficulty levels. Each model was given a single attempt to correct the run-time errors, and their effectiveness was measured by their success rate, which calculates their ability to resolve errors and create functioning code. An experiment was conducted LLMs were prompted with Leetcode programming problems and their erroneous solutions, in order to evaluate these LLMs. In light of the findings considerable variations in model performance, with success rates ranging from 30.26% to 94.74%. The unified model approach achieved a moderate success rate of 65.53%. Integrating multiple models within a system can enhance reliability, when addressing coding problems. To ensure the solutions were corrected by the LLMs, manual testing through Leetcode’s hidden test cases provided the necessary evaluation framework. However, this method had disadvantages, such as being time-intensive and the possibility of introducing human error into the fray. The results demonstrate the feasibility of LLMs in achieving self-healing code. Even though current models are promising, some challenges remain, especially in integrating LLMs into software. Without a method to integrate the LLMs into actual software, their potential remains theoretical. Future research in this area should expand the dataset to include more problems and programming languages.

Place, publisher, year, edition, pages
2025. , p. 35
Keywords [en]
Self-healing, LLMs, Autonomic Computing
National Category
Computer and Information Sciences Artificial Intelligence Computer Sciences
Identifiers
URN: urn:nbn:se:mdh:diva-70140OAI: oai:DiVA.org:mdh-70140DiVA, id: diva2:1937597
Subject / course
Computer Science
Presentation
2025-01-31, Lambda, Universitetsplan 1, 722 20, Västerås, 15:00 (English)
Supervisors
Examiners
Available from: 2025-02-14 Created: 2025-02-13 Last updated: 2025-02-14Bibliographically approved

Open Access in DiVA

fulltext(1141 kB)183 downloads
File information
File name FULLTEXT01.pdfFile size 1141 kBChecksum SHA-512
423d56a78c1c2079417b238499e5904ec3c40c3a06f6857462df82e5a5fd8c5489a773b286b1eac5d66506155e1f07a96c78c350557e3bd961b0c6bed57ee1f6
Type fulltextMimetype application/pdf

Search in DiVA

By author/editor
Toma, Johan
By organisation
School of Innovation, Design and Engineering
Computer and Information SciencesArtificial IntelligenceComputer Sciences

Search outside of DiVA

GoogleGoogle Scholar
Total: 183 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

urn-nbn

Altmetric score

urn-nbn
Total: 556 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf