Digitala Vetenskapliga Arkivet

Planned maintenance
A system upgrade is planned for 17/11-2026, at 12:00-13:00. During this time DiVA will be unavailable.
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Comparing the quality of AI-generated feedback to TAs’ feedback in introductory course in programming
KTH, School of Electrical Engineering and Computer Science (EECS).
KTH, School of Electrical Engineering and Computer Science (EECS).
2025 (English)Independent thesis Basic level (degree of Bachelor), 10 credits / 15 HE creditsStudent thesisAlternative title
Jämförelse av kvalitet på AI:s och lärarassistenters återkoppling i en introduktionskurs i programmering (Swedish)
Abstract [en]

This study has explored what comments OpenAI’s model gpt-4.1 makes on the coding assignments belonging to first year computer science students at KTH and compared the comments to feedback given by TAs. The intent was to determine if the AI-generated feedback contained enough correct information to potentially replace TAs. As of this AI-model, although parts of the generated feedback could be helpful to TAs when grading assignments, such as positive comments, gpt-4.1 has been proven to not work well enough to be trusted for independently grading assignments. The generated feedback did not find logical errors in the code that the TAs found, resulting in the AI passing assignments that, according to TAs, needed more work to receive a passing grade. Nevertheless, another later model could possibly be able to give proper feedback on student assignments in the future.

Abstract [sv]

Denna studie har undersökt vilka kommentarer OpenAIs modell gpt-4.1 gör på koduppgifter tillhörande studenter i årskurs 1 av datateknikprogrammet på KTH och jämfört dessa kommentarer med återkoppling från kursassistenter. Målet var att avgöra om AI-genererad återkoppling innehåller tillräckligt stor andel korrekt information för att eventuellt ersätta kursassistenter. Trots att delar av AI-genererade återkopplingen kan vara hjälpsam för assistenters bedömning så är gpt-4.1 inte rustad för att pålitligt bedöma studenters uppgifter själv. Den genererade återkopplingen missar logiska fel i koden som en assistent hade märkt av, vilket leder till att AI:n godkänner studenter vars uppgifter enligt assistenter behöver kompletteras. Dock skulle en annan senare modell eventuellt kunna ge ordentlig återkoppling på studenters uppgifter i framtiden.

Place, publisher, year, edition, pages
2025. , p. 34
Series
TRITA-EECS-EX ; 2025:350
National Category
Computer and Information Sciences
Identifiers
URN: urn:nbn:se:kth:diva-367690OAI: oai:DiVA.org:kth-367690DiVA, id: diva2:1985847
Supervisors
Examiners
Available from: 2025-07-30 Created: 2025-07-28 Last updated: 2025-07-30Bibliographically approved

Open Access in DiVA

fulltext(807 kB)144 downloads
File information
File name FULLTEXT01.pdfFile size 807 kBChecksum SHA-512
7e71dfa1556f87cf26312ef258051a5bb0265e8799972898c3d740140c21b555227d61e8341032a60823f08b4726fe8500e2cad84af005e5e58fa0b6ad10f8b4
Type fulltextMimetype application/pdf

By organisation
School of Electrical Engineering and Computer Science (EECS)
Computer and Information Sciences

Search outside of DiVA

GoogleGoogle Scholar
Total: 147 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

urn-nbn

Altmetric score

urn-nbn
Total: 510 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf