Searching Like A Historian: Unsupervised Domain Adaptation of BGE-M3 for Historical Swedish Archival Retrieval
2026 (English)Independent thesis Advanced level (degree of Master (Two Years)), 20 credits / 30 HE credits
Student thesis
Abstract [en]
Historical archives contain rich records of legaland administrative life, but semantic search over these collections remains difficult: keyword search fails when historical vocabulary differs from modern queries, and no labeled training data exists for supervised approaches. We address this challenge in the context of 19th-century Swedish archival documents from the Swedish National Archives, where HTR transcription noise and centuries of linguistic drift compound the difficulty further.
The key contribution is an N-to-N synthetic querygeneration strategy, designed around the insightthat queries should reflect how historians actually search: blind searches that span multiple related records, not paraphrases of individual documents. Combined with LoRA fine-tuning and cumulative domain expansion across four document types, the approach achieves consistent improvements acrossall evaluation sets. The results suggest that effective domain adaptation is achievable for this challenging historical retrieval setting, and that data strategy is the critical determinant of success.
Place, publisher, year, edition, pages
2026. , p. 49
Keywords [en]
Information retrieval, Dense Retrieval, Unsupervised Domain Adaptation, Fine-tuning, LoRA, Synthetic Query Generation, Historical Swedish
National Category
Engineering and Technology
Identifiers
URN: urn:nbn:se:uu:diva-594832OAI: oai:DiVA.org:uu-594832DiVA, id: diva2:2089271
External cooperation
Swedish National Archives
Educational program
Master Programme in Language Technology
Presentation
2026-06-04, 16-0054, Thunbergsvägen 3H, Uppsala, 11:15 (English)
Supervisors
Examiners
2026-08-032026-08-022026-08-03Bibliographically approved