Digitala Vetenskapliga Arkivet

Endre søk
RefereraExporteraLink to record
Permanent link

Direct link
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
Helping robots help us: Using prior information for localization, navigation, and human-robot interaction
Örebro universitet, Institutionen för naturvetenskap och teknik.ORCID-id: 0000-0002-3079-0512
2019 (engelsk)Doktoravhandling, med artikler (Annet vitenskapelig)
Abstract [en]

Maps are often used to provide information and guide people. Emergency maps or floor plans are often displayed on walls and sketch maps can easily be drawn to give directions. However, robots typically assume that no knowledge of the environment is available before exploration even though making use of prior maps could enhance robotic mapping. For example, prior maps can be used to provide map data of places that the robot has not yet seen, to correct errors in robot maps, as well as to transfer information between map representations.

I focus on two types of prior maps representing the walls of an indoor environment: layout maps and sketch maps. I study ways to relate information of sketch or layout maps with an equivalent metric map and study how to use layout maps to improve the robot’s mapping. Compared to metric maps such as sensor-built maps, layout and sketch maps can have local scale errors or miss elements of the environment, which makes matching and aligning such heterogeneous map types a hard problem.

I aim to answer three research questions: how to interpret prior maps by finding meaningful features? How to find correspondences between the features of a prior map and a metric map representing the same environment? How to integrate prior maps in SLAM so that both the prior map and the map built by the robot are improved?

The first contribution of this thesis is an algorithm that can find correspondences between regions of a hand-drawn sketch map and an equivalent metric map and achieves an overall accuracy that is within 10% of that of a human. The second contribution is a method that enables the integration of layout map data in SLAM and corrects errors both in the layout and the sensor map.

These results provide ways to use prior maps with local scale errors and different levels of detail, whether they are close to metric maps, e.g. layout maps, or non-metric maps, e.g. sketch maps. The methods presented in this work were used in field tests with professional fire-fighters for search and rescue applications in low-visibility environments. A novel radar sensor was used to perform SLAM in smoke and, using a layout map as a prior map, users could indicate points of interest to the robot on the layout map, not only during and after exploration, but even before it took place.

sted, utgiver, år, opplag, sider
Örebro: Örebro University , 2019. , s. 83
Serie
Örebro Studies in Technology, ISSN 1650-8580 ; 86
Emneord [en]
graph-based SLAM, prior map, sketch map, emergency map, map matching, graph matching, segmentation, search and rescue
HSV kategori
Identifikatorer
URN: urn:nbn:se:oru:diva-75877ISBN: 978-91-7529-299-1 (tryckt)OAI: oai:DiVA.org:oru-75877DiVA, id: diva2:1345270
Disputas
2019-10-29, Örebro universitet, Teknikhuset, Hörsal T, Fakultetsgatan 1, Örebro, 13:15 (engelsk)
Opponent
Veileder
Tilgjengelig fra: 2019-08-23 Laget: 2019-08-23 Sist oppdatert: 2024-01-03bibliografisk kontrollert
Delarbeid
1. Using sketch-maps for robot navigation: interpretation and matching
Åpne denne publikasjonen i ny fane eller vindu >>Using sketch-maps for robot navigation: interpretation and matching
2016 (engelsk)Inngår i: 2016 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR), New York: Institute of Electrical and Electronics Engineers (IEEE), 2016, s. 252-257Konferansepaper, Publicerat paper (Fagfellevurdert)
Abstract [en]

We present a study on sketch-map interpretationand sketch to robot map matching, where maps have nonuniform scale, different shapes or can be incomplete. For humans, sketch-maps are an intuitive way to communicate navigation information, which makes it interesting to use sketch-maps forhuman robot interaction; e.g., in emergency scenarios.

To interpret the sketch-map, we propose to use a Voronoi diagram that is obtained from the distance image on which a thinning parameter is used to remove spurious branches. The diagram is extracted as a graph and an efficient error-tolerant graph matching algorithm is used to find correspondences, while keeping time and memory complexity low.

A comparison against common algorithms for graph extraction shows that our method leads to twice as many good matches. For simple maps, our method gives 95% good matches even for heavily distorted sketches, and for a more complex real-world map, up to 58%. This paper is a first step toward using unconstrained sketch-maps in robot navigation.

sted, utgiver, år, opplag, sider
New York: Institute of Electrical and Electronics Engineers (IEEE), 2016
Emneord
sketch, sketch-map, human robot interface, HRI, graph matching
HSV kategori
Forskningsprogram
Datavetenskap
Identifikatorer
urn:nbn:se:oru:diva-53826 (URN)10.1109/SSRR.2016.7784307 (DOI)000391310800039 ()2-s2.0-85009754966 (Scopus ID)978-1-5090-4349-1 (ISBN)
Konferanse
14th IEEE International Symposium on Safety, Security and Rescue Robotics (SSRR 2016), EPFL, Lausanne, Switzerland, October 23-27, 2016
Forskningsfinansiär
EU, Horizon 2020, ICT-23-2014 645101 SmokeBot
Tilgjengelig fra: 2016-12-09 Laget: 2016-12-07 Sist oppdatert: 2019-10-02bibliografisk kontrollert
2. A method to segment maps from different modalities using free space layout MAORIS: map of ripples segmentation
Åpne denne publikasjonen i ny fane eller vindu >>A method to segment maps from different modalities using free space layout MAORIS: map of ripples segmentation
2018 (engelsk)Konferansepaper, Publicerat paper (Fagfellevurdert)
Abstract [en]

How to divide floor plans or navigation maps into semantic representations, such as rooms and corridors, is an important research question in fields such as human-robot interaction, place categorization, or semantic mapping. While most works focus on segmenting robot built maps, those are not the only types of map a robot, or its user, can use. We present a method for segmenting maps from different modalities, focusing on robot built maps and hand-drawn sketch maps, and show better results than state of the art for both types.

Our method segments the map by doing a convolution between the distance image of the map and a circular kernel, and grouping pixels of the same value. Segmentation is done by detecting ripple-like patterns where pixel values vary quickly, and merging neighboring regions with similar values.

We identify a flaw in the segmentation evaluation metric used in recent works and propose a metric based on Matthews correlation coefficient (MCC). We compare our results to ground-truth segmentations of maps from a publicly available dataset, on which we obtain a better MCC than the state of the art with 0.98 compared to 0.65 for a recent Voronoi-based segmentation method and 0.70 for the DuDe segmentation method.

We also provide a dataset of sketches of an indoor environment, with two possible sets of ground truth segmentations, on which our method obtains an MCC of 0.56 against 0.28 for the Voronoi-based segmentation method and 0.30 for DuDe.

sted, utgiver, år, opplag, sider
IEEE Computer Society, 2018
Emneord
map segmentation, free space, layout
HSV kategori
Forskningsprogram
Datavetenskap
Identifikatorer
urn:nbn:se:oru:diva-68421 (URN)10.1109/ICRA.2018.8461128 (DOI)000446394503114 ()
Konferanse
IEEE International Conference on Robotics and Automation (ICRA 2018), Brisbane, Australia, May 21-25, 2018
Forskningsfinansiär
EU, Horizon 2020, ICT-23-2014 645101 SmokeBotKnowledge Foundation, 20140220
Tilgjengelig fra: 2018-08-09 Laget: 2018-08-09 Sist oppdatert: 2025-02-09bibliografisk kontrollert
3. URSIM: Unique Regions for Sketch Map Interpretation and Matching
Åpne denne publikasjonen i ny fane eller vindu >>URSIM: Unique Regions for Sketch Map Interpretation and Matching
2019 (engelsk)Inngår i: Robotics, E-ISSN 2218-6581, Vol. 8, nr 2, artikkel-id 43Artikkel i tidsskrift (Fagfellevurdert) Published
Abstract [en]

We present a method for matching sketch maps to a corresponding metric map, with the aim of later using the sketch as an intuitive interface for human-robot interactions. While sketch maps are not metrically accurate and many details, which are deemed unnecessary, are omitted, they represent the topology of the environment well and are typically accurate at key locations. Thus, for sketch map interpretation and matching, one cannot only rely on metric information. Our matching method first finds the most distinguishable, or unique, regions of two maps. The topology of the maps, the positions of the unique regions, and the size of all regions are used to build region descriptors. Finally, a sequential graph matching algorithm uses the region descriptors to find correspondences between regions of the sketch and metric maps. Our method obtained higher accuracy than both a state-of-the-art matching method for inaccurate map matching, and our previous work on the subject. The state of the art was unable to match sketch maps while our method performed only 10% worse than a human expert.

sted, utgiver, år, opplag, sider
MDPI, 2019
Emneord
Map matching, sketch, human-robot interaction, interface, graph matching, segmentation
HSV kategori
Identifikatorer
urn:nbn:se:oru:diva-75741 (URN)10.3390/robotics8020043 (DOI)000475325600020 ()2-s2.0-85069975721 (Scopus ID)
Forskningsfinansiär
Knowledge Foundation, 20140220
Merknad

Funding Agency:

EU  ICT-26-2016 732737

Tilgjengelig fra: 2019-08-13 Laget: 2019-08-13 Sist oppdatert: 2025-02-07bibliografisk kontrollert
4. SLAM auto-complete: completing a robot map using an emergency map
Åpne denne publikasjonen i ny fane eller vindu >>SLAM auto-complete: completing a robot map using an emergency map
2017 (engelsk)Inngår i: 2017 IEEE International Symposium on Safety, Security and Rescue Robotics (SSRR), IEEE conference proceedings, 2017, s. 35-40, artikkel-id 8088137Konferansepaper, Publicerat paper (Fagfellevurdert)
Abstract [en]

In search and rescue missions, time is an important factor; fast navigation and quickly acquiring situation awareness might be matters of life and death. Hence, the use of robots in such scenarios has been restricted by the time needed to explore and build a map. One way to speed up exploration and mapping is to reason about unknown parts of the environment using prior information. While previous research on using external priors for robot mapping mainly focused on accurate maps or aerial images, such data are not always possible to get, especially indoor. We focus on emergency maps as priors for robot mapping since they are easy to get and already extensively used by firemen in rescue missions. However, those maps can be outdated, information might be missing, and the scales of rooms are typically not consistent.

We have developed a formulation of graph-based SLAM that incorporates information from an emergency map. The graph-SLAM is optimized using a combination of robust kernels, fusing the emergency map and the robot map into one map, even when faced with scale inaccuracies and inexact start poses.

We typically have more than 50% of wrong correspondences in the settings studied in this paper, and the method we propose correctly handles them. Experiments in an office environment show that we can handle up to 70% of wrong correspondences and still get the expected result. The robot can navigate and explore while taking into account places it has not yet seen. We demonstrate this in a test scenario and also show that the emergency map is enhanced by adding information not represented such as closed doors or new walls.

sted, utgiver, år, opplag, sider
IEEE conference proceedings, 2017
Emneord
SLAM, robotics, graph, graph SLAM, emergency map, rescue, exploration, auto complete, SLAM, robotics, graph, graph SLAM, plan de secours, sauvetage, exploration, auto complete
HSV kategori
Forskningsprogram
Datavetenskap
Identifikatorer
urn:nbn:se:oru:diva-62057 (URN)10.1109/SSRR.2017.8088137 (DOI)000426991900007 ()2-s2.0-85040221684 (Scopus ID)978-1-5386-3923-8 (ISBN)978-1-5386-3924-5 (ISBN)
Konferanse
15th IEEE International Symposium on Safety, Security and Rescue Robotics (SSRR 2017), ShanghaiTech University, China, October 11-13, 2017
Prosjekter
EU H2020 project SmokeBot (ICT- 23-2014 645101)
Forskningsfinansiär
Knowledge Foundation, 20140220
Merknad

Funding Agency:

EU  ICT-23-2014645101

Tilgjengelig fra: 2017-11-08 Laget: 2017-11-08 Sist oppdatert: 2025-02-07bibliografisk kontrollert
5. The Auto-Complete Graph: Merging and Mutual Correction of Sensor and Prior Maps for SLAM
Åpne denne publikasjonen i ny fane eller vindu >>The Auto-Complete Graph: Merging and Mutual Correction of Sensor and Prior Maps for SLAM
2019 (engelsk)Inngår i: Robotics, E-ISSN 2218-6581, Vol. 8, nr 2, artikkel-id 40Artikkel i tidsskrift (Fagfellevurdert) Published
Abstract [en]

Simultaneous Localization And Mapping (SLAM) usually assumes the robot starts without knowledge of the environment. While prior information, such as emergency maps or layout maps, is often available, integration is not trivial since such maps are often out of date and have uncertainty in local scale. Integration of prior map information is further complicated by sensor noise, drift in the measurements, and incorrect scan registrations in the sensor map. We present the Auto-Complete Graph (ACG), a graph-based SLAM method merging elements of sensor and prior maps into one consistent representation. After optimizing the ACG, the sensor map's errors are corrected thanks to the prior map, while the sensor map corrects the local scale inaccuracies in the prior map. We provide three datasets with associated prior maps: two recorded in campus environments, and one from a fireman training facility. Our method handled up to 40% of noise in odometry, was robust to varying levels of details between the prior and the sensor map, and could correct local scale errors of the prior. In field tests with ACG, users indicated points of interest directly on the prior before exploration. We did not record failures in reaching them.

sted, utgiver, år, opplag, sider
MDPI, 2019
Emneord
SLAM, prior map, emergency map, layout map, graph-based SLAM, navigation, search and rescue
HSV kategori
Identifikatorer
urn:nbn:se:oru:diva-75742 (URN)10.3390/robotics8020040 (DOI)000475325600017 ()2-s2.0-85069926702 (Scopus ID)
Forskningsfinansiär
Knowledge Foundation, 20140220
Merknad

Funding Agency:

EU  ICT-26-2016 732737  ICT-23-2014 645101

Tilgjengelig fra: 2019-08-13 Laget: 2019-08-13 Sist oppdatert: 2025-02-07bibliografisk kontrollert
6. A comparative analysis of radar and lidar sensing for localization and mapping
Åpne denne publikasjonen i ny fane eller vindu >>A comparative analysis of radar and lidar sensing for localization and mapping
2019 (engelsk)Inngår i: 2019 European Conference on Mobile Robots (ECMR), IEEE, 2019Konferansepaper, Publicerat paper (Fagfellevurdert)
Abstract [en]

Lidars and cameras are the sensors most commonly used for Simultaneous Localization And Mapping (SLAM). However, they are not effective in certain scenarios, e.g. when fire and smoke are present in the environment. While radars are much less affected by such conditions, radar and lidar have rarely been compared in terms of the achievable SLAM accuracy. We present a principled comparison of the accuracy of a novel radar sensor against that of a Velodyne lidar, for localization and mapping.

We evaluate the performance of both sensors by calculating the displacement in position and orientation relative to a ground-truth reference positioning system, over three experiments in an indoor lab environment. We use two different SLAM algorithms and found that the mean displacement in position when using the radar sensor was less than 0.037 m, compared to 0.011m for the lidar. We show that while producing slightly less accurate maps than a lidar, the radar can accurately perform SLAM and build a map of the environment, even including details such as corners and small walls.

sted, utgiver, år, opplag, sider
IEEE, 2019
HSV kategori
Identifikatorer
urn:nbn:se:oru:diva-76976 (URN)10.1109/ECMR.2019.8870345 (DOI)000558081900002 ()2-s2.0-85074389854 (Scopus ID)978-1-7281-3605-9 (ISBN)978-1-7281-3606-6 (ISBN)
Konferanse
9th European Conference on Mobile Robots (ECMR 2019), Prague, Czech Republic, September 4-6, 2019
Forskningsfinansiär
Knowledge Foundation, 20140220
Merknad

Funding Agency:

EIT Raw Materials project FIREMII  18011

Tilgjengelig fra: 2019-10-02 Laget: 2019-10-02 Sist oppdatert: 2025-02-07bibliografisk kontrollert

Open Access i DiVA

Cover(723 kB)131 nedlastinger
Filinformasjon
Fil COVER01.pdfFilstørrelse 723 kBChecksum SHA-512
d031d328228d0b2a55cac07fd0289c91f4213699a61bfdbbd0de0564765487d7c4d643dc1bde310de610fee12c85d97f209991bcda838a4e22c3a6cf5c2e04cd
Type coverMimetype application/pdf
Spikblad(120 kB)123 nedlastinger
Filinformasjon
Fil SPIKBLAD01.pdfFilstørrelse 120 kBChecksum SHA-512
374c0ffd3663002e19a183691aa6fe605d126f0bc54d363123face3bd0759447602a32aff8236b7d382793ff76514add3eb3d36c464cbd9c76655c2e6a61b470
Type spikbladMimetype application/pdf
Helping robots help us: Using prior information for localization, navigation, and human-robot interaction(2766 kB)878 nedlastinger
Filinformasjon
Fil FULLTEXT04.pdfFilstørrelse 2766 kBChecksum SHA-512
d623af082acaebdfc0b1bfcbbbad8d8e0f7a235c6a95d66b4289958a7827b4d62cc9f4a9366145558b1970c3365ae66f328a6f2c83c69bd46c18a62c232e141a
Type fulltextMimetype application/pdf

Søk i DiVA

Av forfatter/redaktør
Mielle, Malcolm
Av organisasjonen

Søk utenfor DiVA

GoogleGoogle Scholar
Totalt: 884 nedlastinger
Antall nedlastinger er summen av alle nedlastinger av alle fulltekster. Det kan for eksempel være tidligere versjoner som er ikke lenger tilgjengelige

isbn
urn-nbn

Altmetric

isbn
urn-nbn
Totalt: 1684 treff
RefereraExporteraLink to record
Permanent link

Direct link
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf