Digitala Vetenskapliga Arkivet

Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Enhancing Multi-Agent Deep Reinforcement Learning (MADRL) for Financial Trading: Multi-scale Datasets with TimesNet Approach
Stockholm University, Faculty of Social Sciences, Department of Computer and Systems Sciences.
Stockholm University, Faculty of Social Sciences, Department of Computer and Systems Sciences.
2024 (English)Independent thesis Advanced level (degree of Master (Two Years)), 20 credits / 30 HE creditsStudent thesis
Abstract [en]

Multi-Agent Deep Reinforcement Learning (MADRL) frameworks have increasingly shown profitable algorithmic trading from stock market data. MADRL frameworks are typically simplified with a single final agent acting on the environment, where sub-agents are specialized with distinct reward function with the same stock market data processed on intra-day time intervals, limiting the MADRL framework’s focus on stock price movement. To explore this problem, a new sub-agent with specialized macroeconomic input data processed on varying timescales is incorporated into a MADRL framework with a focus on algorithmic trading improvement performance. This study derives its architecture from the MADRL architecture on the Multi-Agent Double-Deep Q-Network (MADDQN) framework, which uses TimesNet in its sub-agent architecture. A macroeconomic-based sub-agent has been added to the framework. An experimental research strategy was implemented where each sub-agent, a baseline MADRL, and an optimized MADRL framework were statistically tested across eight metrics. The results demonstrate that incorporating a macroeconomic agent can enhance trading performance, improving key metrics such as the Sharpe Ratio, Sortino Ratio, and Cumulative Return. This indicates that macroeconomic data, when integrated into a multi-agent system, improves risk management and trading accuracy, thereby optimizing overall trading outcomes. However, the improvement varies depending on the stocks.

Place, publisher, year, edition, pages
2024.
Keywords [en]
Deep reinforcement learning, Multi-agent reinforcement learning, Algorithmic trading, TimesNet, Mult-scale timeframes, Macroeconomic data
National Category
Computer Sciences
Identifiers
URN: urn:nbn:se:su:diva-242696OAI: oai:DiVA.org:su-242696DiVA, id: diva2:1955587
Available from: 2025-04-30 Created: 2025-04-30

Open Access in DiVA

fulltext(10133 kB)114 downloads
File information
File name FULLTEXT01.pdfFile size 10133 kBChecksum SHA-512
a946f5f0367fe9d02dfe7483b113651f6459f02f8a9d96e2052b1f618da1675533aff84660f919b3f4fc4916e953c7fbd02938e974524991995fe4d221ce5a35
Type fulltextMimetype application/pdf

Search in DiVA

By author/editor
Beck, MichaelPerminas, Augustas
By organisation
Department of Computer and Systems Sciences
Computer Sciences

Search outside of DiVA

GoogleGoogle Scholar
Total: 114 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

urn-nbn

Altmetric score

urn-nbn
Total: 27 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf