Digitala Vetenskapliga Arkivet

Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Multi-Sensor Data Fusion for Improved Estimation and Prediction of Physical Quantities
Mid Sweden University, Faculty of Science, Technology and Media, Department of Computer and Electrical Engineering (2023-).ORCID iD: 0000-0002-8776-2985
2025 (English)Doctoral thesis, comprehensive summary (Other academic)
Sustainable development
Hållbar utveckling
Abstract [en]

In recent years, there has been a significant increase in multi-sensor data across various fields, spanning from environmental monitoring and industrial automation to smart agriculture, surveillance systems, healthcare analytics, robotics, remote sensing, smart cities, and beyond. The fundamental drive behind leveraging multimodal data is the amalgamation of complementary information extracted from various sensors, facilitating more comprehensive insights and informed decision-making compared to reliance on a single modality.

The analysis of multi-sensor data presents substantial challenges due to its vastness and the presence of structured, semi-structured, and unstructured data, spanning different modalities with distinct sources, types, and distributions. Data fusion, the integration of information from diverse modalities, becomes crucial in addressing inference problems arising from multi-sensor data. Both analytics-based and learning-based data fusion approaches are widely used, with learning-based approaches, leveraging machine learning and deep learning methods, showing notable effectiveness.

However, the question of "where" and "how" to fuse different modalities remains an open challenge. To explore this, the study focused on three applications as case studies to employ data fusion approaches for estimating and predicting physical quantities. These applications include analysing the correlation between the change in the geometrical dimension of a free-falling molten glass gob and its viscosity using Pearson correlation coefficient as analytical method, predicting fuel consumption of city buses through machine learning methods, and classifying and measuring hazardous gases i.e. hydrogen sulfide (H2S) and methyl mercaptan (CH3SH) using deep learning methods.

Results from these case studies indicate that the choice between traditional, machine learning, or deep learning-based data fusion depends on the specific application, as well as the size and quality of the data. Despite this, advancements in computing power and deep learning technology havemade data more accessible and have enhanced its complementarity. Therefore, a comprehensive review to compare a range of deep learning-based data fusion strategies is conducted. The review provides an examination of various feature extraction methods, as well as an outline and identification of the research fields that stand to derive the greatest benefits from these evolving approaches.

Place, publisher, year, edition, pages
Sundsvall: Mid Sweden University , 2025. , p. 47
Series
Mid Sweden University doctoral thesis, ISSN 1652-893X ; 422
Keywords [en]
Sensor data fusion, Deep learning, Machine learning, Deep learning based data fusion, Smart sensing
National Category
Other Electrical Engineering, Electronic Engineering, Information Engineering
Identifiers
URN: urn:nbn:se:miun:diva-53886ISBN: 978-91-90017-09-8 (print)OAI: oai:DiVA.org:miun-53886DiVA, id: diva2:1941187
Public defence
2025-04-03, C306, Holmgatan 10, Sundsvall, 10:00 (English)
Opponent
Supervisors
Available from: 2025-02-28 Created: 2025-02-27 Last updated: 2025-02-28Bibliographically approved
List of papers
1. Multi-Camera Based Setup for Geometrical Measurement of Free-Falling Molten Glass Gob
Open this publication in new window or tab >>Multi-Camera Based Setup for Geometrical Measurement of Free-Falling Molten Glass Gob
2021 (English)In: Sensors, E-ISSN 1424-8220, Vol. 21, no 4, article id 1041Article in journal (Refereed) Published
Abstract [en]

High temperatures complicate the direct measurements needed for continuous characterization of the properties of molten materials such as glass. However, the assumption that geometrical changes when the molten material is in free-fall can be correlated with material characteristics such as viscosity opens the door to a highly accurate contactless method characterizing small dynamic changes. This paper proposes multi-camera setup to achieve accuracy close to the segmentation error associated with the resolution of the images. The experimental setup presented shows that the geometrical parameters can be characterized dynamically through the whole free-fall process at a frame rate of 600 frames per second. The results achieved show the proposed multi-camera setup is suitable for estimating the length of free-falling molten objects.

National Category
Other Electrical Engineering, Electronic Engineering, Information Engineering
Identifiers
urn:nbn:se:miun:diva-41058 (URN)10.3390/s21041041 (DOI)000624686700001 ()2-s2.0-85100953326 (Scopus ID)
Available from: 2021-02-04 Created: 2021-02-04 Last updated: 2025-02-28Bibliographically approved
2. A Study on the Correlation between Change in the Geometrical Dimension of a Free-Falling Molten Glass Gob and Its Viscosity
Open this publication in new window or tab >>A Study on the Correlation between Change in the Geometrical Dimension of a Free-Falling Molten Glass Gob and Its Viscosity
2022 (English)In: Sensors, E-ISSN 1424-8220, Vol. 22, no 2, p. 661-661Article in journal (Other academic) Published
Abstract [en]

To produce flawless glass containers, continuous monitoring of the glass gob is required. It is essential to ensure production of molten glass gobs with the right shape, temperature, viscosity and weight. At present, manual monitoring is common practice in the glass container industry, which heavily depends on previous experience, operator knowledge and trial and error. This results in inconsistent measurements and consequently loss of production. In this article, a multi-camera based setup is used as a non-invasive real-time monitoring system. We have shown that under certain conditions, such as keeping the glass composition constant, it is possible to do in-line measurement of viscosity using sensor fusion to correlate the rate of geometrical change in the gob and its temperature. The correlation models presented in this article show that there is a strong correlation, i.e., 0.65, between our measurements and the projected viscosity.

Place, publisher, year, edition, pages
MDPI, 2022
Keywords
glass melt, glass gob, glass containers, glass plant, image processing, multi-camera, gob viscosity, sensor fusion
National Category
Other Electrical Engineering, Electronic Engineering, Information Engineering
Identifiers
urn:nbn:se:miun:diva-44061 (URN)10.3390/s22020661 (DOI)000747428400001 ()35062621 (PubMedID)2-s2.0-85122883644 (Scopus ID)
Available from: 2022-01-17 Created: 2022-01-17 Last updated: 2025-02-28Bibliographically approved
3. Selection of optimal parameters to predict fuel consumption of city buses using data fusion
Open this publication in new window or tab >>Selection of optimal parameters to predict fuel consumption of city buses using data fusion
Show others...
2022 (English)In: 2022 IEEE Sensors Applications Symposium (SAS), IEEE, 2022Conference paper, Published paper (Refereed)
Abstract [en]

The study aims to explore the fuel consumption of city buses with data fusion using a dataset with multiple parameters such as travelled distance, weekday, hour of the day, drivers, buses, and routes, that influence the trip fuel consumption. In this study, manipulated parameters such as modified driver, bus and route identification numbers are used together with original parameters to identify the optimal combination of parameters that can be used to enhance the accuracy of the prediction model. Two regression methods, i.e. cubic SVM and artificial neural networks (ANN), are used to demonstrate the performance of the proposed approach. Results shows that a combination of original parameters and processed parameters increases the performance.

Place, publisher, year, edition, pages
IEEE, 2022
Keywords
Fuel consumption, City buses, Urban transport, Machine learning, Cubic SVM, ANN
National Category
Other Electrical Engineering, Electronic Engineering, Information Engineering
Identifiers
urn:nbn:se:miun:diva-46102 (URN)10.1109/SAS54819.2022.9881365 (DOI)000861380600040 ()2-s2.0-85139114820 (Scopus ID)978-1-6654-0981-0 (ISBN)
Conference
2022 IEEE Sensors Applications Symposium (SAS)
Available from: 2022-09-19 Created: 2022-09-19 Last updated: 2025-02-28Bibliographically approved
4. A Deep Learning Approach for Classification and Measurement of Hazardous Gases Using Multi-Sensor Data Fusion
Open this publication in new window or tab >>A Deep Learning Approach for Classification and Measurement of Hazardous Gases Using Multi-Sensor Data Fusion
Show others...
2023 (English)In: 2023 IEEE Sensors Applications Symposium (SAS), IEEE conference proceedings, 2023, article id 10254191Conference paper, Published paper (Refereed)
Abstract [en]

Significant risks to public health and the environment are posed by the release of hazardous gases from industries such as pulp and paper. In this study, the aim was to develop a multi-sensor system with a minimal number of sensors to detect and identify hazardous gases. Training and test data for two gases, hydrogen sulfide and methyl mercaptan, which are known to contribute significantly to odors, were generated in a controlled laboratory environment. The performance of two deep learning models, a 1d-CNN and a stacked LSTM, for data fusion with different sensor configurations was evaluated. The performance of these models was compared with a baseline machine learning model. It was observed that the baseline model was outperformed by the deep learning models and achieved good accuracy with a four-sensor configuration. The potential of a cost-effective multi-sensor system and deep learning models in detecting and identifying hazardous gases is demonstrated by this study, which can be used to collect data from multiple locations and help guide the development of in-situ measurement systems for real-time detection and identification of hazardous gases at industrial sites. The proposed system has important implications for reducing pollution and protecting public health.

Place, publisher, year, edition, pages
IEEE conference proceedings, 2023
Keywords
Gas measurement, Pulp & Paper, Multi-sensor, Data fusion, Machine learning, Deep learning, CNN, 1D-CNN, SVM, LSTM, Gas classification
National Category
Other Electrical Engineering, Electronic Engineering, Information Engineering
Identifiers
urn:nbn:se:miun:diva-49384 (URN)10.1109/SAS58821.2023.10254191 (DOI)001086399500100 ()2-s2.0-85174035432 (Scopus ID)
Conference
2023 IEEE Sensors Applications Symposium (SAS) Ottawa, ON, Canada
Available from: 2023-09-26 Created: 2023-09-26 Last updated: 2025-02-28Bibliographically approved
5. A Comprehensive Review On Deep Learning-Based Data Fusion
Open this publication in new window or tab >>A Comprehensive Review On Deep Learning-Based Data Fusion
2024 (English)In: IEEE Access, E-ISSN 2169-3536, Vol. 12, p. 180093-180124Article in journal (Refereed) Published
Abstract [en]

The rapid progress in sensor technology and computational capabilities has significantly improved real-time data collection, enabling precise monitoring of various phenomena and industrial processes. However, the volume and complexity of heterogeneous data present substantial processing challenges. Traditional data-processing techniques, such as data aggregation, filtering, and statistical analysis, are increasingly supplemented by data fusion methods. These methods can be broadly categorised into traditional analytics-based approaches, like the Kalman Filter and Particle Filter, and learning-based approaches, utilising machine learning and deep learning techniques such as Artificial Neural Networks (ANN) and Convolutional Neural Networks (CNN). These techniques combine data from multiple sources to provide a comprehensive and accurate representation of information, which is critical in number of fields. Despite this, a comprehensive review of learning-based, particularly deep learning-based, data fusion strategies is lacking. This paper presents a thorough review of deep learning-based data fusion methodologies across various fields, examining their evolution over the past five years. It highlights applications in remote sensing, healthcare, industrial fault diagnosis, intelligent transportation, and other domains. The paper categories fusion strategies into early-level, intermediate-level, late-level, and hybrid fusion, emphasising their synergies, challenges, and suitability. It outlines significant advancements, the comparative advantages of deep learning-based methods over traditional approaches, and emerging trends and future directions. To ensure a comprehensive analysis, the review is structured using the ProKnow-C methodology, a rigorous selection process that focuses on relevant literature from recent years.

Place, publisher, year, edition, pages
IEEE, 2024
Keywords
Data fusion, deep learning, early-level fusion, intermediate-level feature fusion, late level decision fusion, hybrid fusion, review.
National Category
Other Electrical Engineering, Electronic Engineering, Information Engineering
Identifiers
urn:nbn:se:miun:diva-53257 (URN)10.1109/ACCESS.2024.3508271 (DOI)2-s2.0-85210926295 (Scopus ID)
Available from: 2024-12-05 Created: 2024-12-05 Last updated: 2025-02-28Bibliographically approved

Open Access in DiVA

fulltext(18704 kB)3289 downloads
File information
File name FULLTEXT01.pdfFile size 18704 kBChecksum SHA-512
f5d6c25140797a2cbf66d05dc0a4d7ed2745d403c520379eb828dd04959eb639b24dc328812c4f8b9091902721b9503e85b22ee5689b148e33353974e2168820
Type fulltextMimetype application/pdf

Search in DiVA

By author/editor
Hussain, Mazhar
By organisation
Department of Computer and Electrical Engineering (2023-)
Other Electrical Engineering, Electronic Engineering, Information Engineering

Search outside of DiVA

GoogleGoogle Scholar
Total: 3289 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

isbn
urn-nbn

Altmetric score

isbn
urn-nbn
Total: 1484 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf