Digitala Vetenskapliga Arkivet

Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
An Evaluation of the Unity Machine Learning Agents Toolkit in Dense and Sparse Reward Video Game Environments
Uppsala University, Disciplinary Domain of Humanities and Social Sciences, Faculty of Arts, Department of Game Design.
Uppsala University, Disciplinary Domain of Humanities and Social Sciences, Faculty of Arts, Department of Game Design.
2021 (English)Independent thesis Basic level (degree of Bachelor), 10 credits / 15 HE creditsStudent thesis
Abstract [en]

In computer games, one use case for artificial intelligence is used to create interesting problems for the player. To do this new techniques such as reinforcement learning allows game developers to create artificial intelligence agents with human-like or superhuman abilities. The Unity ML-agents toolkit is a plugin that provides game developers with access to reinforcement algorithms without expertise in machine learning. In this paper, we compare reinforcement learning methods and provide empirical training data from two different environments. First, we describe the chosen reinforcement methods and then explain the design of both training environments. We compared the benefits in both dense and sparse rewards environments. The reinforcement learning methods were evaluated by comparing the training speed and cumulative rewards of the agents. The goal was to evaluate how much the combination of extrinsic and intrinsic rewards accelerated the training process in the sparse rewards environment. We hope this study helps game developers utilize reinforcement learning more effectively, saving time during the training process by choosing the most fitting training method for their video game environment. The results show that when training reinforcement agents in sparse rewards environments the agents trained faster with the combination of extrinsic and intrinsic rewards. And when training an agent in a sparse reward environment with only extrinsic rewards the agent failed to learn to complete the task.

Place, publisher, year, edition, pages
2021. , p. 32
Keywords [en]
Unity, ML-Agents, Reinforcement learning, Sparse rewards environment, Artificial Intelligence
National Category
Computer Sciences
Identifiers
URN: urn:nbn:se:uu:diva-444982OAI: oai:DiVA.org:uu-444982DiVA, id: diva2:1563588
Subject / course
Game Design
Educational program
Bachelor's Programme in Game Design and Programming
Supervisors
Examiners
Available from: 2021-07-05 Created: 2021-06-10 Last updated: 2021-07-05Bibliographically approved

Open Access in DiVA

fulltext(1921 kB)3783 downloads
File information
File name FULLTEXT01.pdfFile size 1921 kBChecksum SHA-512
0adbab6d608ab5bfbba3deb5b046e5186296786ea9e73300bdc8a79e95fe8cc5ffa4afdbbb0b9287c95f97ca3c5eca53c0c46063223583fb9fc5646f6fc8d566
Type fulltextMimetype application/pdf

By organisation
Department of Game Design
Computer Sciences

Search outside of DiVA

GoogleGoogle Scholar
Total: 3786 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

urn-nbn

Altmetric score

urn-nbn
Total: 4554 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf