Long-term and short-term memory networks based on forgetting memristors

The hardware circuit of neural network based on forgetting memristors not only has the characteristics of high computational efficiency and low power consumption, but also has the advantage that a memristor can store the weight of long-term memory and short-term memory. Neural networks based on forgetting memristors can process two different data sets; however, the number of data sets processed is determined by the conversion rate of short-term memory to long-term memory neural network. In this paper, a forgetting memristor model with controllable decay rate is proposed, the short-term memory and long-term memory of the long-term and short-term memory (LSTM) network based on forgetting memristor is proposed, and the conversion speed from short-term memory network to long-term memory network is controllable. In the process of transformation from short-term memory to long-term memory of LSTM network based on forgetting memristor, the decay rate of forgetting memristor can be controlled, and the duration of short-term memory of LSTM network can be set. A reset signal mechanism is proposed so that the state of short-term memory of LSTM network with high recognition rate can be controlled. Based on the proposed controllable decay rate and reset signal, the state of the short-term memory network with high recognition rate can be set, so the LSTM network with two states can realize the recognition of different number of images under different data sets. Finally, two kinds of data sets are tested on the LSTM network based on the forgetting memristor, and the recognition rate is good, which shows the effectiveness of the proposed algorithm.