检索结果-南通市图书馆

Training time minimization for federated edge learning with optimized gradient quantization and bandwidth allocation

在线全文

学校读者我要写书评

暂无评论

Frontiers of Information Technology & Electronic Engineering 2022年第8期23卷 1247-1263页

作者： Peixi LIU Jiamo JIANG Guangxu ZHU Lei CHENG Wei JIANG Wu LUO Ying DU Zhiqin WANG State Key Laboratory of Advanced Optical Communication Systems and Networks Department of ElectronicsPeking UniversityBeijing 100871China China Academy of Information and Communications Technology Beijing 100191China Shenzhen Research Institute of Big Data Shenzhen 518172China College of Information Science and Electronic Engineering Zhejiang UniversityHangzhou 310027China Zhejiang Provincial Key Laboratory of Information Processing Communication and NetworkingHangzhou 310027China

Training a machine learning model with federated edge learning(FEEL)is typically time consuming due to the constrained computation power of edge devices and the limited wireless resources in edge networks.In this study,the training time minimization problem is investigated in a quantized FEEL system,where heterogeneous edge devices send quantized gradients to the edge server via orthogonal channels.In particular,a stochastic quantization scheme is adopted for compression of uploaded gradients,which can reduce the burden of per-round communication but may come at the cost of increasing the number of communication rounds.The training time is modeled by taking into account the communication time,computation time,and the number of communication rounds.Based on the proposed training time model,the intrinsic trade-off between the number of communication rounds and per-round latency is characterized.Specifically,we analyze the convergence behavior of the quantized FEEL in terms of the optimality gap.Furthermore,a joint data-and-model-driven fitting method is proposed to obtain the exact optimality gap,based on which the closed-form expressions for the number of communication rounds and the total training time are obtained.Constrained by the total bandwidth,the training time minimization problem is formulated as a joint quantization level and bandwidth allocation optimization problem.To this end,an algorithm based on alternating optimization is proposed,which alternatively solves the subproblem of quantization optimization through successive convex approximation and the subproblem of bandwidth allocation by bisection search.With different learning tasks and models,the validation of our analysis and the near-optimal performance of the proposed optimization algorithm are demonstrated by the simulation results.

关键词： federated edge learning Quantization optimization Bandwith allocation Training time minimization

Energy-Efficient federated edge learning with Joint Communication and Computation Design

在线全文

学校读者我要写书评

暂无评论

Journal of Communications and Information Networks 2021年第2期6卷 110-124页

作者： Xiaopeng Mo Jie Xu School of Information Engineering Guangdong University of TechnologyGuangzhou 510006China School of Science and Engineering the Chinese University of Hong KongShenzhenShenzhen 518172China

This paper studies a federated edge learning system,in which an edge server coordinates a set of edge devices to train a shared machine learning(ML)model based on their locally distributed data samples.During the distributed training,we exploit the joint communication and computation design for improving the system energy efficiency,in which both the communication resource allocation for global ML-parameters aggregation and the computation resource allocation for locally updating ML-parameters are jointly optimized.In particular,we consider two transmission protocols for edge devices to upload ML-parameters to edge server,based on the non-orthogonal multiple access(NOMA)and time division multiple access(TDMA),respectively.Under both protocols,we minimize the total energy consumption at all edge devices over a particular finite training duration subject to a given training accuracy,by jointly optimizing the transmission power and rates at edge devices for uploading ML-parameters and their central processing unit(CPU)frequencies for local update.We propose efficient algorithms to solve the formulated energy minimization problems by using the techniques from convex optimization.Numerical results show that as compared to other benchmark schemes,our proposed joint communication and computation design significantly can improve the energy efficiency of the federated edge learning system,by properly balancing the energy tradeoff between communication and computation.

关键词： federated edge learning energy efficiency joint communication and computation design resource al location non-orthogonal multiple access(NOMA) optimization.

Adaptive Retransmission Design for Wireless federated edge learning

维普期刊数据库评论

在线全文

维普期刊数据库

学校读者我要写书评

暂无评论

ZTE Communications 2023年第1期21卷 3-14页

作者： XU Xinyi LIU Shengli YU Guanding Zhejiang University Hangzhou 310027China

As a popular distributed machine learning framework,wireless federated edge learning(FEEL)can keep original data local,while uploading model training updates to protect privacy and prevent data silos.However,since wireless channels are usually unreliable,there is no guarantee that the model updates uploaded by local devices are correct,thus greatly degrading the performance of the wireless FEEL.Conventional retransmission schemes designed for wireless systems generally aim to maximize the system throughput or minimize the packet error rate,which is not suitable for the FEEL system.A novel retransmission scheme is proposed for the FEEL system to make a tradeoff between model training accuracy and retransmission latency.In the proposed scheme,a retransmission device selection criterion is first designed based on the channel condition,the number of local data,and the importance of model updates.In addition,we design the air interface signaling under this retransmission scheme to facilitate the implementation of the proposed scheme in practical scenarios.Finally,the effectiveness of the proposed retransmission scheme is validated through simulation experiments.

关键词： federated edge learning retransmission unreliable communication convergence rate retransmission latency

Joint User Selection and Resource Allocation for Fast federated edge learning

在线全文

学校读者我要写书评

暂无评论

ZTE Communications 2020年第2期18卷 20-30页

作者： JIANG Zhihui HE Yinghui YU Guanding College of Information Science and Electronic Engineering Zhejiang UniversityHangzhouZhejiang 310027China

By periodically aggregating local learning updates from edge users, federated edge learning (FEEL) is envisioned as a promising means to reap the benefit of local rich da?ta and protect users'privacy. However, the scarce wireless communication resource greatly limits the number of participated users and is regarded as the main bottleneck which hin?ders the development of FEEL. To tackle this issue, we propose a user selection policy based on data importance for FEEL system. In order to quantify the data importance of each user, we first analyze the relationship between the loss decay and the squared norm of gradi?ent. Then, we formulate a combinatorial optimization problem to maximize the learning effi?ciency by jointly considering user selection and communication resource allocation. By problem transformation and relaxation, the optimal user selection policy and resource alloca?tion are derived, and a polynomial-time optimal algorithm is developed. Finally, we deploy two commonly used deep neural network (DNN) models for simulation. The results validate that our proposed algorithm has strong generalization ability and can attain higher learning efficiency compared with other traditional algorithms.

关键词： data importance federated edge learning learning accuracy learning efficiency resource allocation user selection