Digitala Vetenskapliga Arkivet

Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Deep Learning for Geo-referenced Data: Case Study: Earth Observation
Luleå tekniska universitet, EISLAB.ORCID iD: 0000-0002-5922-7889
2021 (English)Licentiate thesis, comprehensive summary (Other academic)
Abstract [en]

The thesis focuses on machine learning methods for Earth Observation (EO) data, more specifically, remote sensing data acquired by satellites and drones. EO plays a vital role in monitoring the Earth’s surface and modelling climate change to take necessary precautionary measures. Initially, these efforts were dominated by methods relying on handcrafted features and expert knowledge. The recent advances of machine learning methods, however, have also led to successful applications in EO. This thesis explores supervised and unsupervised approaches of Deep Learning (DL) to monitor natural resources of water bodies and forests. 

The first study of this thesis introduces an Unsupervised Curriculum Learning (UCL) method based on widely-used DL models to classify water resources from RGB remote sensing imagery. In traditional settings, human experts labeled images to train the deep models which is costly and time-consuming. UCL, instead, can learn the features progressively in an unsupervised fashion from the data, reducing the exhausting efforts of labeling. Three datasets of varying resolution are used to evaluate UCL and show its effectiveness: SAT-6, EuroSAT, and PakSAT. UCL outperforms the supervised methods in domain adaptation, which demonstrates the effectiveness of the proposed algorithm. 

The subsequent study is an extension of UCL for the multispectral imagery of Australian wildfires. This study has used multispectral Sentinel-2 imagery to create the dataset for the forest fires ravaging Australia in late 2019 and early 2020. 12 out of the 13 spectral bands of Sentinel-2 are concatenated in a way to make them suitable as a three-channel input to the unsupervised architecture. The unsupervised model then classified the patches as either burnt or not burnt. This work attains 87% F1-Score mapping the burnt regions of Australia, demonstrating the effectiveness of the proposed method. 

The main contributions of this work are (i) the creation of two datasets using Sentinel-2 Imagery, PakSAT dataset and Australian Forest Fire dataset; (ii) the introduction of UCL that learns the features progressively without the need of labelled data; and (iii) experimentation on relevant datasets for water body and forest fire classification. 

This work focuses on patch-level classification which could in future be expanded to pixel-based classification. Moreover, the methods proposed in this study can be extended to the multi-class classification of aerial imagery. Further possible future directions include the combination of geo-referenced meteorological and remotely sensed image data to explore proposed methods. Lastly, the proposed method can also be adapted to other domains involving multi-spectral and multi-modal input, such as, historical documents analysis, forgery detection in documents, and Natural Language Processing (NLP) classification tasks.

Place, publisher, year, edition, pages
Luleå: Luleå tekniska universitet , 2021.
Keywords [en]
Artificial Intelligence, Machine Learning, Earth Observation, Computer Vision
National Category
Computer Sciences
Research subject
Machine Learning
Identifiers
URN: urn:nbn:se:mau:diva-75681ISBN: 978-91-7790-958-3 (print)ISBN: 978-91-7790-959-0 (electronic)OAI: oai:DiVA.org:mau-75681DiVA, id: diva2:1955467
Presentation
2021-12-15, C305, Luleå tekniska universitet, Luleå, 10:00 (English)
Opponent
Supervisors
Available from: 2025-05-06 Created: 2025-04-30 Last updated: 2025-05-06Bibliographically approved
List of papers
1. UCL: Unsupervised Curriculum Learning for Water Body Classification from Remote Sensing Imagery
Open this publication in new window or tab >>UCL: Unsupervised Curriculum Learning for Water Body Classification from Remote Sensing Imagery
Show others...
2021 (English)In: International Journal of Applied Earth Observation and Geoinformation, ISSN 1569-8432, E-ISSN 1872-826X, Vol. 105, article id 102568Article in journal (Refereed) Published
Abstract [en]

This paper presents a Convolutional Neural Networks (CNN) based Unsupervised Curriculum Learning approach for the recognition of water bodies to overcome the stated challenges for remote sensing based RGB imagery. The unsupervised nature of the presented algorithm eliminates the need for labelled training data. The problem is cast as a two class clustering problem (water and non-water), while clustering is done on deep features obtained by a pre-trained CNN. After initial clusters have been identified, representative samples from each cluster are chosen by the unsupervised curriculum learning algorithm for fine-tuning the feature extractor. The stated process is repeated iteratively until convergence. Three datasets have been used to evaluate the approach and show its effectiveness on varying scales: (i) SAT-6 dataset comprising high resolution aircraft images, (ii) Sentinel-2 of EuroSAT, comprising remote sensing images with low resolution, and (iii) PakSAT, a new dataset we created for this study. PakSAT is the first Pakistani Sentinel-2 dataset designed to classify water bodies of Pakistan. Extensive experiments on these datasets demonstrate the progressive learning behaviour of UCL and reported promising results of water classification on all three datasets. The obtained accuracies outperform the supervised methods in domain adaptation, demonstrating the effectiveness of the proposed algorithm.

Place, publisher, year, edition, pages
Elsevier, 2021
Keywords
Sentinel-2, Aircraft Imagery, Remote Sensing, Water classification, Deep Learning, Unsupervised Curriculum Learning, Multi-scale Classification
National Category
Computer Sciences
Research subject
Machine Learning
Identifiers
urn:nbn:se:mau:diva-75688 (URN)10.1016/j.jag.2021.102568 (DOI)000716818200002 ()2-s2.0-85121593506 (Scopus ID)
Note

Validerad;2021;Nivå 2;2021-11-08 (johcin);

Full text license: CC BY-NC-ND

Available from: 2025-04-30 Created: 2025-04-30 Last updated: 2025-05-07Bibliographically approved
2. Burnt Forest Estimation from Sentinel-2 Imagery of Australia using Unsupervised Deep Learning
Open this publication in new window or tab >>Burnt Forest Estimation from Sentinel-2 Imagery of Australia using Unsupervised Deep Learning
Show others...
2021 (English)In: Proceedings of the Digital Image Computing: Technqiues and Applications (DICTA), IEEE , 2021, p. 74-81Conference paper, Published paper (Refereed)
Abstract [en]

Massive wildfires not only in Australia, but also worldwide are burning millions of hectares of forests and green land affecting the social, ecological, and economical situation. Widely used indices-based threshold methods like Normalized Burned Ratio (NBR) require a huge amount of data preprocessing and are specific to the data capturing source. State-of-the-art deep learning models, on the other hand, are supervised and require domain experts knowledge for labeling the data in huge quantity. These limitations make the existing models difficult to be adaptable to new variations in the data and capturing sources. In this work, we have proposed an unsupervised deep learning based architecture to map the burnt regions of forests by learning features progressively. The model considers small patches of satellite imagery and classifies them into burnt and not burnt. These small patches are concatenated into binary masks to segment out the burnt region of the forests. The proposed system is composed of two modules: 1) a state-of-the-art deep learning architecture for feature extraction and 2) a clustering algorithm for the generation of pseudo labels to train the deep learning architecture. The proposed method is capable of learning the features progressively in an unsupervised fashion from the data with pseudo labels, reducing the exhausting efforts of data labeling that requires expert knowledge. We have used the realtime data of Sentinel-2 for training the model and mapping the burnt regions. The obtained F1-Score of 0.87 demonstrates the effectiveness of the proposed model.

Place, publisher, year, edition, pages
IEEE, 2021
Keywords
Unsupervised, Deep Learning, Australia, Forest Fire, Wildfire, Sentinel-2, Aerial Imagery
National Category
Computer Sciences
Research subject
Machine Learning
Identifiers
urn:nbn:se:mau:diva-75686 (URN)10.1109/DICTA52665.2021.9647174 (DOI)000824642300010 ()2-s2.0-85124317916 (Scopus ID)978-1-6654-1709-9 (ISBN)
Conference
International Conference on Digital Image Computing: Techniques and Applications (DICTA), Gold Coast, Australia, Novermber 29 - December 1, 2021
Note

ISBN för värdpublikation: 978-1-6654-1709-9 (elektronisk)

Available from: 2025-04-30 Created: 2025-04-30 Last updated: 2025-05-06Bibliographically approved

Open Access in DiVA

fulltext(10445 kB)10 downloads
File information
File name FULLTEXT01.pdfFile size 10445 kBChecksum SHA-512
2a09044b0047355a6e5a8f5db4b914457602d887155eed02f3b1818d6b1eee5f811c074fe636ebf4fd564f1ec5955e590e0e96a43767c4c48ac55212c0575a42
Type fulltextMimetype application/pdf
fulltext(143 kB)10 downloads
File information
File name FULLTEXT02.pdfFile size 143 kBChecksum SHA-512
c32e60f90bda112dc992976b3e0e867970d9a47536e7771df85f4c1316d982b761fc5eed1843074d66936eff1bdc53eb3ae67a74926756d0fa7beaa99549f96e
Type fulltextMimetype application/pdf

Search in DiVA

By author/editor
Abid, Nosheen
Computer Sciences

Search outside of DiVA

GoogleGoogle Scholar
Total: 20 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

isbn
urn-nbn

Altmetric score

isbn
urn-nbn
Total: 100 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf