Graph-Based Deep Learning for Liver Registration
2024 (English)Independent thesis Advanced level (professional degree), 20 credits / 30 HE credits
Student thesisAlternative title
Grafbaserad djupinlärning för medicinsk bildregistrering (Swedish)
Abstract [en]
Medical image registration (MIR) is the process of aligning images for comparison and analysis. Traditional image registration methods, which rely on optimisation over voxel intensities, are computationally expensive and often struggle in settings with large deformations, such in abdominal scans. In recent years, deep learning (DL) methods have demonstrated improved computational efficiency while offering comparable performance in MIR.
The broader clinical application of the project, of which this thesis forms a part, is planning and evaluation of minimal invasive liver surgery. This thesis investigates the integration of hepatic vessel landmarks within a deep learning-based pipeline for intra-patient liver registration on Computed Tomography (CT) scans. The objective is to incorporate anatomical knowledge into the registration process by generating graph-based representations of the hepatic vessels. Experiments were conducted with three deep learning models: a small Graph Convolutional Network (GCN), Dynamic Graph CNNs (DGCNNs), and PointNet. The models were trained on synthetic datasets.
The resulting registration had a Normalised Cross-Correlation (NCC) of 0.775, which is compared with a traditional registration method called elatsix that had a NCC for the same images of 0.993, where NCC=1.0 corresponds to theoretically optimal registration. Qualitative analysis through visual inspection of the registered images suggests that the inclusion of anatomical information may offer advantages however, the simple pipeline had many shortcomings that needs to be addressed to improve its results. Future use of clinical data would be essential to validate the model's robustness in practical scenarios.
Place, publisher, year, edition, pages
2024. , p. 29
Series
UPTEC F, ISSN 1401-5757 ; 24072
Keywords [en]
Medical Image Registration, Machine Learning, Graph Neural Network
Keywords [sv]
Medicinsk bildregistrering, djupinlärning, grafnätverk
National Category
Medical Imaging
Identifiers
URN: urn:nbn:se:uu:diva-539455OAI: oai:DiVA.org:uu-539455DiVA, id: diva2:1901869
External cooperation
Universität Innsbruck
Educational program
Master Programme in Engineering Physics
Presentation
2024-09-20, Online, 13:15 (English)
Supervisors
Examiners
2024-10-012024-09-302025-02-09Bibliographically approved