Have a personal or library account? Click to login
Deep Learning Transformer Model for Human Activity Recognition Cover

Abstract

Human Activity Recognition (HAR) leveraging wearable sensors has emerged as a critical research area, with broad applications spanning healthcare, elderly assistance, sports analytics, and human-computer interaction. While traditional approaches using Convolutional Neural Networks (CNN) and Long Short-Term Memory (LSTM) networks have effectively extracted local spatial and sequential temporal features from multi-channel sensor data, recent advancements incorporate Transformer-based architectures featuring attention mechanisms that capture long-range temporal dependencies without recurrence. This paper introduces a novel multivariate Transformer model designed to integrate multiple physiological and kinematic data streams such as: electrocardioagram-ECG, photoplethysmogram-PPG (wrist and finger infrared/red), Galvanic Skin Response (GSR), respiration, body temperature, three-axis acceleration, and gyroscope signals. Distinctively, the designed architecture assigns dedicated encoders to individual streams to effectively handle signal diversity, sampling frequency variations, and latency discrepancies, using multi-head attention and learnable positional encodings. Evaluated across five experimental scenarios (rest, standing, sitting, running, and walking) segmented into uniform 30-seconds windows, the Transformer-based model demonstrated exceptional performance, achieving approximately 99% accuracy, along with near-perfect sensitivity and F1-scores, highlighting its robustness and superior generalization capability.

DOI: https://doi.org/10.2478/bipie-2024-0011 | Journal eISSN: 2537-2726 | Journal ISSN: 1223-8139
Language: English
Page range: 87 - 100
Submitted on: Jun 22, 2025
|
Accepted on: Jul 12, 2025
|
Published on: Feb 21, 2026
In partnership with: Paradigm Publishing Services
Publication frequency: 4 issues per year

© 2026 Ionuţ-Adrian Iftode, Cristian-Ioan Foşalău, published by Gheorghe Asachi Technical University of Iasi
This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License.