Privacy-preserving consensus-oriented aggregation for federated learning with heterogeneity
Author Identifier (ORCID)
Abstract
Achieving reliable network-wide consensus formation in distributed learning systems becomes increasingly challenging when edge nodes hold skewed data distributions. Federated learning (FL) enables privacy-preserving collaborative model training without sharing raw data, but statistical heterogeneity across nodes significantly degrades convergence and may expose sensitive label statistics to distribution-inference attacks. To address these limitations, this paper presents a new federated consensus-oriented aggregation (FedCOA) strategy, which improves consensus formation of FL under strong heterogeneity, suppresses skew-induced instability while mitigating distribution-level privacy leakage. FedCOA perturbs local label distributions using differential privacy (DP) and computes a noise-robust Index of Data Heterogeneity (IDH), which guides dynamic aggregation, regulates bias propagation, suppresses the influence of skewed updates, and facilitates consensus formation dynamics. We show theoretically that FedCOA reduces the divergence term in the convergence upper bound. Experiments demonstrate up to 80.3%, 75.1%, and 79.2% reductions in communication rounds on MNIST, FashionMNIST, and CIFAR-10, respectively.
Keywords
communication efficiency, data heterogeneity, federated learning, model aggregation
Document Type
Journal Article
Date of Publication
1-1-2026
Publication Title
IEEE Transactions on Network Science and Engineering
Publisher
IEEE
School
School of Engineering
Funding Information
National Natural Science Foundation of China (Grant Number: 42171404 and 62401395) / Shanghai Engineering Research Center for Blockchain Applications and Services (Grant Number: 19DZ2255100) / Fundamental Research Funds for the Central Universities (Grant Number: 22120230441) / Institute of Carbon Neutrality of Tongji University
Copyright
subscription content
Content Type
Metadata only
Recommended Citation
Qu, X., Han, S., Liu, E., Geng, Y., Ni, W., Liu, Y., Guo, R., & Bi, Y. (2026). Privacy-preserving consensus-oriented aggregation for federated learning with heterogeneity. IEEE Transactions on Network Science and Engineering, 13, 10496–10514. https://doi.org/10.1109/TNSE.2026.3710233