| 单粒子翻转对神经网络的影响分析与优化 |
| |
| 作者姓名： | 王慧玲 谢卓辰 梁旭文 |
| |
| 作者单位： | 中国科学院微小卫星创新研究院, 上海 201203;中国科学院大学, 北京 100049 |
| |
| 基金项目： | 上海市青年科技英才扬帆计划项目（17YF1418200）和国家自然科学基金（91738201）资助 |
| |
| 摘 要： | DNN芯片作为星载芯片应用到卫星系统中时会受到太空辐照的影响，其中单粒子翻转对存储单元的干扰会使得存储器单元的参数出现错误，该错误映射到神经网络中会造成神经网络最后的输出结果出现偏差。结合单粒子翻转概率模型，对用于网络推断的神经网络的权值参数进行注错后分析实验结果准确率，从激活函数的非线性特性分析并通过实验验证具有双边抑制效果的函数容错能力更强。进一步在网络卷积层后加入BN层和在训练过程中考虑L2正则化提高网络的容错能力，并通过实验验证其可行性。
|
| 关 键 词： | 单粒子翻转错误概率模型 深度神经网络 激活函数 网络容错 |
| 收稿时间： | 2019-12-23 |
| 修稿时间： | 2020-05-05 |
Analysis and optimization of single event upset on neural network |
| |
| Authors: | WANG Huiling XIE Zhuochen LIANG Xuwen |
| |
| Institution: | Innovation Academy for Microsatellites, Chinese Academy of Sciences, Shanghai 201203, China;University of Chinese Academy of Sciences, Beijing 100049, China |
| |
| Abstract: | When the DNN (deep neural network) chip is used in a satellite system as a space-borne chip, it will be affected by space radiation. The interference of single event upset (SEU) on the storage unit will cause the parameters of the memory unit to be wrong. The error mapping to the neural network will affect the output results. This paper analyzes the accuracy of the network inference which combines the SEU probability model to inject the error on the network weight parameters. From the analysis of the nonlinear characteristics of the activation function and experimental verification, it is found that the activation function with bilateral inhibition is more fault-tolerant. Furthermore, we add the BN layer after the network convolution layer and consider L2 regularization during training to improve the network's fault tolerance, and verify its feasibility through experiments. |
| |
| Keywords: | single event upset error model DNN activation function fault tolerance |
|
| 点击此处可从《》浏览原始摘要信息 |
| 点击此处可从《》下载免费的PDF全文 |
