Study on Memristor-Based 3-D Convolutional Neural Network Adapting to Non-Ideal Effects

Memristor-based neural network (MNN) has made breakthroughs in image classification, but for complex video recognition, the required deep MNN will inevitably be more sensitive to non-ideal effects. In this work, we evaluate a memristor-based 3-D convolutional neural network (CNN) for action recognition and incorporate various non-ideal effects at the circuit and device level. Hardware-friendly schemes such as time division multiplexing (TDM) and updating with increasing thresholds are also described. Furthermore, a strategy combining forward averaging and mapping back is proposed to alleviate the IR drop effect. By setting the intersection conductance as the differential reference, deep MNNs are able to adapt to the updating asymmetry. Under the above adaptive strategies and in situ training, the network achieves an accuracy of 92.9% higher than the software and requires fewer updating pulses.