Digitala Vetenskapliga Arkivet

Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
The reinforcement learning method: A feasible and sustainable control strategy for efficient occupant-centred building operation in smart cities
Dalarna University, School of Technology and Business Studies, Microdata Analysis.ORCID iD: 0000-0002-0551-9341
2019 (English)Licentiate thesis, comprehensive summary (Other academic)
Abstract [en]

Over half of the world’s population lives in urban areas, a trend which is expected to only grow as we move further into the future. With this increasing trend in urbanisation, challenges are presented in the form of the management of urban infrastructure systems. As an essential infrastructure of any city, the energy system presents itself as one of the biggest challenges. As cities expand in population and economically, global energy consumption increases and as a result so do greenhouse gas (GHG) emissions. To achieve the 2030 Agenda’s sustainable development goal on energy (SDG 7), renewable energy and energy efficiency have been shown as key strategies for attaining SDG 7. As the largest contributor to climate change, the building sector is responsible for more than half of the global final energy consumption and GHG emissions. As people spend most of their time indoors, the demand for energy is made worse as a result of maintaining the comfort level of the indoor environment. However, the emergence of the smart city and the internet of things (IoT) offers the opportunity for the smart management of buildings. Focusing on the latter strategy towards attaining SDG 7, intelligent building control offers significant potential for saving energy while respecting occupant comfort (OC). Most intelligent control strategies, however, rely on complex mathematical models which require a great deal of expertise to construct thereby costing in time and money. Furthermore, if these are inaccurate then energy is wasted and the comfort of occupants is decreased. Moreover, any change in the physical environment such as retrofits result in obsolete models which must be re-identified to match the new state of the environment. This model-based approach seems unsustainable and so a new model-free alternative is proposed. One such alternative is the reinforcement learning (RL) method. This method provides a beautiful solution to accomplishing the tradeoff between energy efficiency and OC within the smart city and more importantly to achieving SDG 7. To address the feasibility of RL as a sustainable control strategy for efficient occupant-centred building operation, a comprehensive review of RL for controlling OC in buildings as well as a case study implementing RL for improving OC via a window system are presented. The outcomes of each seem to suggest RL as a feasible solution, however, more work is required in the form of addressing current open issues such as cooperative multi-agent RL (MARL) needed for multi-occupant/multi-zonal buildings.

Place, publisher, year, edition, pages
Borlänge: Dalarna University, 2019.
Series
Dalarna Licentiate Theses ; 12
Keywords [en]
Markov decision processes, Reinforcement learning, Control, Building, Indoor comfort, Occupant
National Category
Building Technologies Computer and Information Sciences
Research subject
Research Profiles 2009-2020, Complex Systems – Microdata Analysis
Identifiers
URN: urn:nbn:se:du-30613ISBN: 978-91-88679-03-1 (print)OAI: oai:DiVA.org:du-30613DiVA, id: diva2:1358130
Presentation
2019-11-01, B310, Borlänge, 10:00 (English)
Opponent
Supervisors
Available from: 2019-10-11 Created: 2019-10-07 Last updated: 2023-08-17Bibliographically approved
List of papers
1. A review of reinforcement learning methodologies for controlling occupant comfort in buildings
Open this publication in new window or tab >>A review of reinforcement learning methodologies for controlling occupant comfort in buildings
Show others...
2019 (English)In: Sustainable cities and society, ISSN 2210-6707, Vol. 51, article id 101748Article in journal (Refereed) Published
National Category
Building Technologies
Research subject
Research Profiles 2009-2020, Complex Systems – Microdata Analysis
Identifiers
urn:nbn:se:du-30601 (URN)10.1016/j.scs.2019.101748 (DOI)000493744700053 ()2-s2.0-85070980900 (Scopus ID)
Available from: 2019-08-08 Created: 2019-08-08 Last updated: 2023-02-17Bibliographically approved
2. A novel reinforcement learning method for improving occupant comfort via window opening and closing
Open this publication in new window or tab >>A novel reinforcement learning method for improving occupant comfort via window opening and closing
Show others...
(English)Manuscript (preprint) (Other academic)
National Category
Building Technologies
Research subject
Complex Systems – Microdata Analysis
Identifiers
urn:nbn:se:du-30942 (URN)
Available from: 2019-10-11 Created: 2019-10-11 Last updated: 2019-10-11Bibliographically approved

Open Access in DiVA

fulltext(333 kB)665 downloads
File information
File name FULLTEXT02.pdfFile size 333 kBChecksum SHA-512
505b403b8db557f6aacfe2421553a38e8db3c0b9deb74a972b039a69f1bdc8eb76d68a5f691633d8d505eddd419a4e495674a66457b06109a3f346d3d02fdf86
Type fulltextMimetype application/pdf

Search in DiVA

By author/editor
May, Ross
By organisation
Microdata Analysis
Building TechnologiesComputer and Information Sciences

Search outside of DiVA

GoogleGoogle Scholar
Total: 672 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

isbn
urn-nbn

Altmetric score

isbn
urn-nbn
Total: 2656 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf