Federated Learning with Matched Averaging

Hongyi Wang, Mikhail Yurochkin, Yuekai Sun et al.

2020 · arXiv (Cornell University) · 725 citations

Federated learning allows edge devices to collaboratively learn a shared model while keeping the training data on device, decoupling the ability to do model training from the need to store the data in the cloud. We propose Federated matched averaging (FedMA) algorithm designed for federated learning of modern neural network architectures e.g. convolutional neural networks (CNNs) and LSTMs. FedMA constructs the shared global model in a layer-wise manner by matching and averaging hidden elements (i.e. channels for convolution layers; hidden states for LSTM; neurons for fully connected layers) w…

Read the paper →

Explore this paper's citation graph on Constellation.