Federated Learning Drift Detection: An Empirical Study on the Impact of Concept and Data Drift
2024 (English)In: 2024 2nd International Conference on Federated Learning Technologies and Applications, FLTA 2024 / [ed] Awaysheh F.M., Alawadi S., Alawadi S., Carnevale L., Lloret Mauri J., Alsmirat M., Institute of Electrical and Electronics Engineers (IEEE), 2024, p. 241-250Conference paper, Published paper (Refereed)
Abstract [en]
Federated Learning (FL) has emerged as a transformative paradigm in machine learning, enabling decentralized model training while preserving data privacy across multiple clients. FL addresses critical privacy concerns but introduces challenges related to model drift. Model drift is a phenomenon where the model degrades over time due to changes in the underlying data distribution or the relationships between input features and target variables. This paper proposes a novel drift detection and management methodology within federated environments. Our experimental analysis demonstrates the effectiveness of the proposed drift detection framework. The study systematically evaluates the impact of drift on model performance metrics, including accuracy, F1 score, Cohen’s kappa, and ROC. The findings indicate that even minimal drift in a subset of clients can significantly degrade the global model’s performance, underscoring the importance of robust drift detection. The proposed solution enhances the reliability and accuracy of federated models and addresses the scalability and privacy-preserving requirements inherent in FL environments.
Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2024. p. 241-250
Keywords [en]
Concept Drift, Drift Detection, Federated Learning, Model Drift, Supervised Machine Learning, Adversarial machine learning, Contrastive Learning, Differential privacy, Self-supervised learning, Concept drifts, Decentralized models, Empirical studies, Machine-learning, Model training, Multiple clients, Privacy concerns
National Category
Artificial Intelligence
Identifiers
URN: urn:nbn:se:bth-27501DOI: 10.1109/FLTA63145.2024.10839814Scopus ID: 2-s2.0-85217851839ISBN: 9798350354812 (print)OAI: oai:DiVA.org:bth-27501DiVA, id: diva2:1941277
Conference
2nd IEEE International Conference on Federated Learning Technologies and Applications, FLTA 2024, Hybrid, Valencia, Sept 17-20, 2024
2025-02-282025-02-282025-02-28Bibliographically approved