Towards Robust and Privacy-Preserving Federated Learning: Reinforcement-Guided Unlearning and Multi-Attack Defense Mechanisms

Publication Type:
Thesis
Issue Date:
2025
Full metadata record
Federated Learning (FL) has become an attractive new trend for distributed model training where the data is decentralized and is not required to be uploaded to a central server itself, alleviating the direct privacy issues. However, this decentralized paradigm also gives rise to new security risks such as gradient inversion, poisoning, and inference threats. Meanwhile, with rigorous regulatory requirements and the changing nature of privacy, federated unlearning is a crucial building block, bringing about new issues related to security and efficiency. This thesis explores secure and private defenses of FL against various threat models by combining reinforcement learning-informed defense strategies with statistical machine unlearning. The contributions of this paper are as follows: It proposes a statistical-unlearning-based defense through gradient inversion attacks while also achieving the balance between high model utility and communication efficiency. It reveals potential vulnerabilities in federated unlearning by revealing invisible attacks (i.e., camouflaged poisoning attacks that can still be effective after unlearning operations) and theoretically analyzes the effects of the attacks for the long term. It introduces the first reinforcement learning-based federated unlearning mechanism that can dynamically balance the client contribution, the privacy cost, and the computational efficiency, leading to enhanced robustness to both inference and poisoning. It also introduces a data importance-aware reinforcement learning defense that adaptively victims protection strategies at a sample level and achieves multi-attack robustness against backdoor, model stealing, and membership inference attacks. Both theoretically and empirically, we verify that the proposed approaches achieve better trade-offs between robustness, accuracy, and efficiency over different datasets and adversarial settings than state-of-the-art counterparts. Taken together, this thesis contributes to the understanding of attack defense dynamics on FL and proposes reinforcement-guided unlearning as a principled basis for adaptive, secure, and privacy-compliant decentralized learning.
Please use this identifier to cite or link to this item: