Digitala Vetenskapliga Arkivet

Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Log detection for autonomous forwarding using auto-annotated data from a real-time virtual environment
Luleå University of Technology, Department of Engineering Sciences and Mathematics, Product and Production Development.ORCID iD: 0000-0003-2167-5982
Luleå University of Technology, Department of Engineering Sciences and Mathematics, Product and Production Development.ORCID iD: 0000-0002-9862-828X
Luleå University of Technology, Department of Engineering Sciences and Mathematics, Product and Production Development.ORCID iD: 0000-0002-2342-1647
2024 (English)In: Proceedings of the 21st International and 12th Asia-Pacific Regional Conference of the ISTVS, International Society for Terrain-Vehicle Systems , 2024, article id 8084Conference paper, Published paper (Refereed)
Abstract [en]

An integral part of autonomous forestry is the ability of the vehicles, e.g., forwarders and harvesters, to perceive their environment. At Luleå University of Technology, object detectors have previously been developed, allowing forestry vehicles to detect and position important objects in forestry, such as tree stumps, stones, and logs. These detectors have been developed by training on physical manually annotated data, which is both time-consuming and costly. Training on virtual data allows for significant time- and cost reductions. Since the ground truth in the virtual model is known, the training data can be auto-annotated, allowing for the creation of larger training datasets, at a lower cost. In this work, a virtual environment in Unity is used in co-simulation with a real-time digital twin of a physical forestry vehicle, to generate auto-annotated training data, as captured by an onboard stereo camera. A detailed emulation of the stereo camera is used to achieve realistic results. First, a log detector trained on physical manually annotated data, is evaluated on virtually created data. It is shown that the log detector trained on physical data can detect logs in the virtual environment. Second, new detectors are trained, using different shares of physical and virtual data. It is shown that a detector trained using only virtual data, can learn to detect logs in the physical world. Moreover, virtual pre-training is shown to improve the performance of physically trained and tested detectors, both at low availability of physical training data, and in terms of domain generalization. Furthermore, the real-time capable virtual models also enable future machine learning tasks utilizing different levels of Hardware-in-the-Loop.

Place, publisher, year, edition, pages
International Society for Terrain-Vehicle Systems , 2024. article id 8084
Keywords [en]
Transfer learning, Domain generalization, Virtual training, Auto-annotation, Real-time, Co-simulation, Logging, Tree harvesting, Forwarder, Cut-to-length, CTL
National Category
Computer graphics and computer vision
Research subject
Machine Design
Identifiers
URN: urn:nbn:se:ltu:diva-112034DOI: 10.56884/XD21D6FRScopus ID: 2-s2.0-85219520792OAI: oai:DiVA.org:ltu-112034DiVA, id: diva2:1944953
Conference
21st International and 12th Asia-Pacific Regional Conference of the ISTVS, Yokohama, Japan, October 28-31, 2024
Projects
Sustainable Autonomous Material Handling (SAMHand)
Funder
Interreg AuroraLuleå University of Technology
Note

Funder: Skogstekniska Klustret (The Cluster of Forest Technology);

ISBN for host publication: 978-194211257-0

Available from: 2025-03-17 Created: 2025-03-17 Last updated: 2025-03-25Bibliographically approved

Open Access in DiVA

fulltext(1259 kB)31 downloads
File information
File name FULLTEXT02.pdfFile size 1259 kBChecksum SHA-512
486ec5d15fa6cf33410e359523693854116cc19cf1fa3d6b280025263340752037327bb6f62bec63e415cf9e196b85d5470621c768abc0c415e3b97213a3d5a6
Type fulltextMimetype application/pdf

Other links

Publisher's full textScopus

Search in DiVA

By author/editor
Lehto, MattiasLideskog, HåkanKarlberg, Magnus
By organisation
Product and Production Development
Computer graphics and computer vision

Search outside of DiVA

GoogleGoogle Scholar
Total: 32 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 247 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf