检索结果-南通市图书馆

Communication-efficient federated continual learning for distributed learning system with Non-IID data

Science China(Information Sciences) 2023年第2期66卷 94-113页

作者： Zhao ZHANG Yong ZHANG Da GUO Shuang ZHAO Xiaolin ZHU School of Electronic Engineering Beijing University of Posts and Telecommunications Beijing Key Laboratory of Work Safety Intelligent Monitoring Beijing University of Posts and Telecommunication

Due to the privacy preserving capabilities and the low communication costs, federated learning has emerged as an efficient technique for distributed deep learning/machine learning training. However, given the typical heterogeneous data distributions in the realistic scenario, federated learning faces the challenge of performance degradation on non-independent identically distributed(Non-IID) data across clients. Therefore, we propose federated continual learning to improve the performance on Non-IID data by introducing the knowledge of the other local models. Specifically, we propose a novel federated continual learning method called Fed SI, adapting the synaptic intelligence method to the federated learning scenario. Furthermore,in order to reduce the communication overheads, we propose the bidirectional compression and error compensation(BCEC) algorithm to produce the communication-efficient federated continual learning method,called CFedSI. Specifically, the proposed BCEC algorithm compresses both the uplink and the downlink transmission data and utilizes the error compensation locally to ensure training divergence. Experiments show that CFedSI improves the accuracy on Non-IID data by up to 46% with KDDCUP’99 dataset, 23%with CICIDS2017 dataset, 22% with MNIST dataset, and 8% with FashionMNIST dataset, along with the reduced communication overheads.

关键词： distributed learning system federated learning continual learning model compression error compensation

来源：

同方期刊数据库评论

在线全文

同方期刊数据库

学校读者我要写书评

暂无评论

欢迎您,

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

在线全文

请选择保存的检索档案：

请选择收藏分类：

通借通还

欢迎您,

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

在线全文

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：