Abstract
Design of analog modular neuron based on memristor is proposed here. Since neural networks are built by repetition of basic blocks that are called neurons, using modular neurons is essential for the neural network hardware. In this work modularity of the neuron is achieved through distributed neurons structure. Some major challenges in implementation of synaptic operation are weight programmability, weight multiplication by input signal and nonvolatile weight storage. Introduction of memristor bridge synapse addresses all of these challenges. The proposed neuron is a modular neuron based on distributed neuron structure which it uses the benefits of the memristor bridge synapse for synaptic operations. In order to test appropriate operation of the proposed neuron, it is used in a real-world application of neural network. Off-chip method is used to train the neural network. The results show 86.7 % correct classification and about 0.0695 mean square error for 4-5-3 neural network based on proposed modular neuron.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Misra J, Saha I (2010) Artificial neural networks in hardware: a survey of two decades of progress. Neurocomputing 74:239–255
Eberhardt S, Duong T, Thakoor A (1989) Design of parallel hardware neural network systems from custom analog VLSI `building block’ chips. In: Conference on neural networks 1989 IJCNN international joint
Adhikari SP, Yang C, Kim H, Chua LO (2012) Memristor bridge synapse-based neural network and its learning. IEEE Trans Neural Netw Learn Syst 23(9):1426–1435
Rahimi Azghadi M, Iannella N, Al-Sarawi SF, Indiveri G, Abbott G (2014) Spike-based synaptic plasticity in silicon: design, implementation, application, and challenges. In: Proceedings of the IEEE, vol 102(5), pp 717–737
Chua LO (1971) Memristor—the missing circuit element. IEEE Trans Circuit Theory 18(5):507–519
Strukov DB, Snider GS, Stewart DR, Williams RS (2008) The missing memristor found. Nature 453:80–83
Jo SH, Chang T, Ebong I, Bhadviya BB, Mazumder P, Lu W (2010) Nanoscale memristor device as synapse in neuromorphic systems. Nano Lett 10:1297–1301
Lehtonen E, Laiho M (2010) CNN using memristors for neighborhood connections. In: 12th international workshop on cellular nanoscale networks and their applications CNNA 2010, pp 1–4
Laiho M, Lehtonen E (2010) Cellular nanoscale network cell with memristors for local implication logic and synapses. In: Proceedings of 2010 IEEE international symposium on circuits and systems ISCAS, pp 2051–2054
Kim H, Sah MP, Yang C, Roska T, Chua LO (2012) Memristor bridge synapses. Proc IEEE 100(6):2061–2070
Satyanarayana S, Tsividis Y, Graf HP (1989) Analogue neural networks with distributed neurons. Electron Lett 25(5):302
Satyanarayana S, Tsividis YP, Graf HP (1989) A reconfigurable VLSI neural network. In: 1989 Proceedings of international conference on wafer scale integration, vol 27, pp 67–81
Biolek Z, Biolek D, Biolková V (2009) SPICE model of memristor with nonlinear dopant drift. Radioengineering 18:210–214
Joglekar YN, Wolf SJ (2008) The elusive memristor: signatures in basic electrical circuits. Physics 30(4):1–22
Djahanshahi H, Ahmadi M, Jullien GA, Miller WC (1996) A unified synapse-neuron building block for hybrid VLSI neural networks. In: 1996 IEEE international symposium on circuits and systems. Circuits and systems connecting the world. ISCAS 96, vol 3, pp 483–486
Khodabandehloo G, Mirhassani M, Ahmadi M (2012) Analog implementation of a novel resistive-type sigmoidal neurons. IEEE Trans Very Large Scale Integr (VLSI) Syst 20(4):750–754
Blake CL, Merz CJ (1998) UCI machine learning repository. University of California, Irvine, School of Information and Computer Sciences [Online]. http://archive.ics.uci.edu/ml
Draghici S (2000) Neural networks in analog hardware—design and implementation issues. Int J Neural Syst 10:19–42
Aggarwal A, Hamilton B (2012) Training artificial neural networks with memristive synapses: HSPICE-matlab co-simulation. In: 11tneuron”h symposium on neural network applications in electrical engineering, pp 101–106
Linn E, Siemon A, Waser R, Menzel S (2014) Applicability of Well-Established Memristive Models for Simulations of Resistive Switching Devices. IEEE Transactions on Circuits and Systems I 20(4):750–754
Pickett MD, Strukov DB, Borghetti JL, Yang JJ, Snider GS, Stewart DR, Williams RS (2009) Switching dynamics in titanium dioxide memristive devices. J Appl Phys 106(7):074508
Kvatinsky S, Friedman EG, Kolodny A, Weiser UC (2013) TEAM: threshold adaptive memristor model. IEEE Trans Circuits Syst I Regul Papers 60(1):211–221
Kvatinsky S, Talisveyberg K, Fliter D, Friedman EG, Kolodny A, Weiser UC (2012) Models of memristors for SPICE simulations. In: Proceedings of the IEEE convention of electrical and electronics engineers in Israel, pp 1–5
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Shamsi, J., Amirsoleimani, A., Mirzakuchaki, S. et al. Modular neuron comprises of memristor-based synapse. Neural Comput & Applic 28, 1–11 (2017). https://doi.org/10.1007/s00521-015-2047-0
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00521-015-2047-0