Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Finding Your Way from the Bed to the Kitchen: Reenacting and Recombining Sensorimotor Episodes Learned from Human Demonstration
University of Skövde, School of Informatics, Sweden.
University of Skövde, School of Informatics, Sweden.
University of Skövde, School of Informatics, Sweden; Gothenburg University, Sweden.
Linköping University, Department of Computer and Information Science, Human-Centered systems. Linköping University, Faculty of Science & Engineering. University of Skövde, Sweden. (Cognition & Interaction Lab)ORCID iD: 0000-0001-6883-2450
2016 (English)In: Frontiers in Robotics and AI, E-ISSN 2296-9144, Vol. 3, article id 9Article in journal (Refereed) Published
Abstract [en]

Several simulation theories have been proposed as an explanation for how humans and other agents internalize an “inner world” that allows them to simulate interactions with the external real world – prospectively and retrospectively. Such internal simulation of interaction with the environment has been argued to be a key mechanism behind mentalizing and planning. In the present work, we study internal simulations in a robot acting in a simulated human environment. A model of sensory–motor interactions with the environment is generated from human demonstrations and tested on a Robosoft Kompaï robot. The model is used as a controller for the robot, reproducing the demonstrated behavior. Information from several different demonstrations is mixed, allowing the robot to produce novel paths through the environment, toward a goal specified by top-down contextual information. The robot model is also used in a covert mode, where the execution of actions is inhibited and perceptions are generated by a forward model. As a result, the robot generates an internal simulation of the sensory–motor interactions with the environment. Similar to the overt mode, the model is able to reproduce the demonstrated behavior as internal simulations. When experiences from several demonstrations are combined with a top-down goal signal, the system produces internal simulations of novel paths through the environment. These results can be understood as the robot imagining an “inner world” generated from previous experience, allowing it to try out different possible futures without executing actions overtly. We found that the success rate in terms of reaching the specified goal was higher during internal simulation, compared to overt action. These results are linked to a reduction in prediction errors generated during covert action. Despite the fact that the model is quite successful in terms of generating covert behavior toward specified goals, internal simulations display different temporal distributions compared to their overt counterparts. Links to human cognition and specifically mental imagery are discussed.

Place, publisher, year, edition, pages
Frontiers Media S.A., 2016. Vol. 3, article id 9
Keyword [en]
embodied cognition, imagination, internal simulation, learning from demonstration, representation, simulation theory, predictive sequence learning, prospection
National Category
Robotics
Identifiers
URN: urn:nbn:se:liu:diva-142096DOI: 10.3389/frobt.2016.00009OAI: oai:DiVA.org:liu-142096DiVA, id: diva2:1151146
Available from: 2017-10-22 Created: 2017-10-22 Last updated: 2017-11-29Bibliographically approved

Open Access in DiVA

fulltext(14879 kB)7 downloads
File information
File name FULLTEXT01.pdfFile size 14879 kBChecksum SHA-512
fb93e92eb112d6ac8f48c8b37fad776bca178e334fa21b63184851f83f5d3cb4c46c77310192e07cc31ec14a795e63e2fc7b5faf2f9889596e1d8aa0b4dfb92f
Type fulltextMimetype application/pdf

Other links

Publisher's full text

Search in DiVA

By author/editor
Ziemke, Tom
By organisation
Human-Centered systemsFaculty of Science & Engineering
In the same journal
Frontiers in Robotics and AI
Robotics

Search outside of DiVA

GoogleGoogle Scholar
Total: 7 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 52 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf