Shared Federated Learning Algorithm Based on Knowledge Distillation under Data Imbalance Scenario
在线阅读 下载全文 下载Pdf阅读器
刊名 《现代化工》
作者 Yun Dong,Zhaoli Chen,Xuhua Ai,Yuan Yin, Xixiang Zhang(corresponding author) (1 Information Center,China Southern Power Grid Guangxi Power Grid Co Ltd,Guangxi,China) 英文名 Modern Chemical Industry 年,卷(期) 2024年,第12期
主办单位 环宇科学出版社;华文国际出版社 刊号 ISSN:2661-3670(P)/2661-3689(O) DOI

Shared Federated Learning Algorithm Based on Knowledge Distillation under Data Imbalance Scenario

Traditional FL algorithms have certain security risks when dealing with highly sensitive and unbalanced data, which may lead to model performance degradation or data privacy disclosure.Therefore,to compensate for the shortcomings of traditional FL algorithms,this study introduced Knowledge distillation and LDP privacy protection mechanism to optimize the performance of FL algorithms,and ultimately constructed a privacy protection mechanism based on LDP-KD-FL algorithm.Through experimental analysis,it was found that in the comparison of communication volume,the gradient parameters of different algorithms showed an upward trend with the increase of communication volume.However,compared to the FedAvg algorithm,CentLearn algorithm,and DistLearn algorithm,the LDP-KD-FL algorithm had a slower increase in total communication volume.When the gradient parameter was 5000,the communication volume was still less than 40 KB.In the comparison of server runtime,when the gradient parameter was 2000,the LDP-KD-FL algorithm had a runtime of 152.8 ms.The data showed that when the number of communications was 16,the training accuracy of the LDP-KD-FL algorithm exceeded 80%.When the privacy budget was 0.5,the absolute error of LDP-KD-FL algorithm was 0.12,which was 0.32%,0.23%,and 0.29% lower than the absolute errors of FedAvg,CentLearn,and DistLearn algorithms,respectively.In summary,the LDP-KD-FL algorithm has low communication utility and a faster response in the server.

00852-67508818

营业时间:9;00-11:30 13:30-17:00

地址:总部:香港湾仔骆克道315-321号幸运广场23楼C室;分部:香港九龍新蒲崗太子道東704號新時代工貿商業中心31樓5-11室A03單位

邮箱:gjkzxtg@126.com

客服QQ:3577400288

Copyright 2015-2035 华文科学出版社 版权所有 All Rights Reserved     京ICP备2023009018号-3