Biosignal Sequence Real-time Prediction for Game Users Based on Features Fusion of Local-Global and Time-Frequency Domain
2025 (English)In: IEEE Transactions on Games, ISSN 2475-1502, E-ISSN 2475-1510, Vol. 17, no 3, p. 797-812Article in journal (Refereed) Published
Abstract [en]
Biosignal sequence real-time prediction (BSRP) is essential for predicting the future emotional experience of game users. However, BSRP for game users faces challenges, including poor real-time performance and limited feature fusion dimensions.
To address these issues, we proposed a method for BSRP based on the features fusion of Local-Global and Time-Frequency domain (LGTF) for game users, which integrates real-time capabilities with multi-dimensional features fusion. Specifically, LGTF meets real-time requirements and achieves the features fusion of Local-Global through multi-channel synchronized adaptive convolution. In addition, LGTF implements the features fusion of inter- and intra-band in the frequency domain and the features fusion of time-frequency domain by incorporating the Self-Attention mechanism and Fourier Transform. Furthermore, we conducted comprehensive validation experiments on LGTF using the public dataset.
The results indicate that: 1) In the comparison study, LGTF outperformed other methods, achieving the lowest average MSE and MAE values across different prediction lengths of 0.61 and 0.47, respectively. 2) Ablation studies revealed that the addition of time-frequency domain feature fusion (TF) and local-global feature fusion (LG) both have the positive effect on the prediction performance, reducing the average MSE by 0.11 and 0.09, respectively. 3) Generalization study shows that LGTF exhibits stable performance and generalization across different subjects and shows performance advantages in specific game scenarios. 4) Time performance analysis suggests LGTF has the real-time performance.5) Case study demonstrates that LGTF is practical for predicting game users' future emotions and enhancing their emotional experiences.
Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2025. Vol. 17, no 3, p. 797-812
Keywords [en]
Biosignal sequence prediction, Features fusion, Game users, Local-Global, Time-Frequency domain, Prediction models, Time domain analysis, Biosignals, Emotional experiences, Features fusions, Game user, Generalisation, Real-time prediction, Sequence prediction, Time frequency domain, Frequency domain analysis
National Category
Computer Sciences Signal Processing
Identifiers
URN: urn:nbn:se:bth-27691DOI: 10.1109/TG.2025.3550779ISI: 001575795400013Scopus ID: 2-s2.0-105000213020OAI: oai:DiVA.org:bth-27691DiVA, id: diva2:1950284
Part of project
HINTS - Human-Centered Intelligent Realities
Funder
Knowledge Foundation, 202200682025-04-072025-04-072025-10-03Bibliographically approved