posted on 2020-06-11, 08:43authored byYide Du, Linglin Jing, Hui FangHui Fang, Haibao Chen, Yimao Cai, Runsheng Wang, Jianfu Zhang, Zhigang Ji
For Resistive RAM (RRAM)-based deep neural
network, Random telegraph noise (RTN) causes accuracy loss
during inference. In this work, we systematically investigated the
impact of RTN on the complex deep neural networks (DNNs) with
different datasets. By using 8 mainstream DNNs and 4 datasets,
we explored the origin that caused the RTN-induced accuracy loss.
Based on the understanding, for the first time, we proposed a new
method to estimate the accuracy loss. The method was verified
with other 10 DNN/dataset combinations that were not used for
establishing the method. Finally, we discussed its potential
adoption for the co-optimization of the DNN architecture and the
RRAM technology, paving ways to RTN-induced accuracy loss
mitigation for future neuromorphic hardware systems.
Funding
National Key R&D Program of China under the grant no. 2019YFB2205000
National Natural Science Foundation of China under the grant no. 61927901
Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.