Digitala Vetenskapliga Arkivet

Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Nested Named Entity Recognition for Historical Swedish Texts: Evaluating Task-Specific Models and Large Language Models on the SWENER-1800 Dataset
Uppsala University, Disciplinary Domain of Humanities and Social Sciences, Faculty of Languages, Department of Linguistics and Philology.
2025 (English)Independent thesis Advanced level (degree of Master (Two Years)), 20 credits / 30 HE creditsStudent thesis
Abstract [en]

This thesis investigates the performance of task-specific and general purpose models on the Nested Named Entity Recognition (NNER) task in historical Swedish texts. Using the SWENER-1800 dataset, an annotated corpus that displays the linguistic complexity of 18th- and 19th-century Swedish, the study compares a State-of-the-Art task-specific model (BINDER) against a selection of Large Language Models (GPT4-o, DeepSeek R1, and LLama  3), under zero-shot, few-shot, and fine-tuned conditions where applicable. The analysis evaluates each model's ability to detect nested (and flat) entities  in a low-resource, linguistically specific and diverse setting. Results indicate that that while LLMs offer flexibility and reasonable performance in certain configurations, task-specific architectures like BINDER still outperform them, especially in capturing nested structures and, sometimes, rare entity types. Confusion matrix analysis reveals consistent semantic confusions among similar entity classes and highlights the structural limitations of LLMs in handling (deeply) nested entities. This work reinforces the value of traditional NLP methodologies for domain-specific, structured tasks.

Place, publisher, year, edition, pages
2025. , p. 66
Keywords [en]
Nested Named Entity Recognition (NER) Historical Language Processing SWENER-1800 Dataset Large Language Models (LLMs) Fine-tuning GPT-SW3 Llama-3-8B-Instruct Zero-shot Learning Few-shot Learning
National Category
Natural Language Processing
Identifiers
URN: urn:nbn:se:uu:diva-565008OAI: oai:DiVA.org:uu-565008DiVA, id: diva2:1989012
External cooperation
Riksarkivet
Educational program
Master Programme in Language Technology
Presentation
2025-06-02, 9-3042, Uppsala, 14:15 (English)
Supervisors
Examiners
Available from: 2025-08-14 Created: 2025-08-14 Last updated: 2025-08-14Bibliographically approved

Open Access in DiVA

fulltext(681 kB)253 downloads
File information
File name FULLTEXT01.pdfFile size 681 kBChecksum SHA-512
cb6246c409aa9a525de2a0f75237acb65260c1fd36f684d4c5c522fdd57b85ee30b3f508d4128712c712ed1f0ddcbb5869dbfbfe7d1abfa4c4329c1ab05af33e
Type fulltextMimetype application/pdf

By organisation
Department of Linguistics and Philology
Natural Language Processing

Search outside of DiVA

GoogleGoogle Scholar
Total: 256 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

urn-nbn

Altmetric score

urn-nbn
Total: 490 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf