TinySEED: a lightweight transformer architecture with channel-attention for DDoS detection
2026 (English)In: SAC '26: Proceedings of the 41st ACM/SIGAPP Symposium on Applied Computing, ACM Digital Library, 2026, p. 395-404Conference paper, Published paper (Refereed)
Abstract [en]
Uncovering stealthy Distributed Denial of Service (DDoS) attacks at the network-edge remains challenging due to increased system complexity and users' access to digital services. Therefore, in this work, we develop TinySEED, a lightweight yet accurate DDoS detection model based on TinyBERT that integrates a channel attention mechanism. TinyBERT is developed via knowledge distillation from BERT, providing a compact backbone that preserves key representational capacity while significantly reducing model size and inference latency. To further enhance discriminative power between DDoS attacks and benign traces, we integrate channel attention, which adaptively re-weights embedding channels (dimensions), enabling the model to capture fine-grained distinctions between benign and malicious flows that are often overlooked by distilled transformers. Extensive DDoS detection experiments across five benchmark datasets demonstrate that TinySEED consistently outperforms conventional machine learning methods, neural architectures, and transformer-based baselines. TinySEED achieves higher detection accuracy on benchmarks while maintaining low inference latency. These findings highlight the effectiveness of combining efficient transformer distillation with channel attention to achieve a practical and robust solution for low-latency DDoS detection in network-edge environments.
Place, publisher, year, edition, pages
ACM Digital Library, 2026. p. 395-404
Keywords [en]
channel attention, cloud-edge network security, DDoS detection, lightweight transformers
National Category
Computer Systems Computer Sciences
Identifiers
URN: urn:nbn:se:umu:diva-256654DOI: 10.1145/3748522.3779832Scopus ID: 2-s2.0-105042991057ISBN: 9798400722943 (electronic)OAI: oai:DiVA.org:umu-256654DiVA, id: diva2:2086453
Conference
41st Annual ACM Symposium on Applied Computing, SAC 2026, Thessaloniki, Greece, March 23-27, 2026
Funder
Wallenberg AI, Autonomous Systems and Software Program (WASP)EU, Horizon Europe, 1010927112026-07-142026-07-142026-07-14Bibliographically approved