Superconducting Bio-Inspired Au-Nanowire-Based Neurons

Abstract

High-performance modeling of neurophysiological processes is an urgent task that requires new approaches to information processing. In this context, two- and three-junction superconducting quantum interferometers with Josephson weak links based on gold nanowires are fabricated and investigated experimentally. The studied cells are proposed for the implementation of bio-inspired neurons—high-performance, energy-efficient, and compact elements of neuromorphic processor. The operation modes of an advanced artificial neuron capable of generating the burst firing activation patterns are explored theoretically. A comparison with the Izhikevich mathematical model of biological neurons is carried out.

1. Introduction

Modeling the processes in the brain of living beings is a complex and urgent task [1,2,3,4,5,6,7,8,9]. One of the main problems in this area is an insufficient number of neurons and synapses in modern Complementary-Metal-Oxide-Semiconductor (CMOS) neuromorphic processors. Their complexity is closely tightened by large power consumption and heat dissipation of the circuits. The best CMOS neuromorphic systems simulate the networks consisting of about 1 million neurons and a quarter of a billion synapses [10,11,12]. However, the most ambitious biological projects state the goals of ${10}^{10}$ neurons and ${10}^{14}$ synapses [13]. The demand for such a high complexity makes important the consideration of novel physical principles for signal transmission and processing.

There are many approaches addressing this issue. Among others, the emerging nonvolatile memory devices [14] are pushing the limits beyond CMOS technology. In particular, ferroelectric memory devices with fast write/read times (of an order of 1 ns) have been recognized as promising neuromorphic elements [15]. They are compatible with CMOS circuits operating at the same voltage level, while consuming several orders of magnitude less energy (of an order of fJ) than CMOS neuron composed of dozens of transistors [16].

The application of superconducting materials [17,18,19] also allows for competing CMOS in the implementation of artificial neurons. Josephson junction switching provides the generation of picosecond-width quantized voltage spike of ∼mV amplitude accompanied by sub-aJ energy dissipation [20,21]. The shape of this spike can be quite close to the one produced in neurophysiological processes [22]. It was shown that an artificial neuron can be implemented using only two Josephson junctions [22,23] (see illustration in Figure 1). This is an order of magnitude less than the number of transistors in CMOS counterparts [16]. At the same time, it is possible to implement the synaptic memory using just single junction with ferromagnetic material [24,25,26,27,28,29,30]. The superconductivity enables ballistic signal transfer along the wires. The voltage spikes can be transmitted with a speed approaching the speed of light over long distances with low crosstalk [31]. Note that the Josephson junctions can be fabricated in any layer of multilayer superconducting circuit [32]. These features are favor for the implementation of complex and energy-efficient 3D neural networks closely mimic biological nerve tissue.

While the superconducting neural networks of various kinds are rapidly developed currently [22,23,24,28,33,34,35,36,37,38,39,40], their complexity is severely limited by the low integration density of superconducting circuits [41,42]. One of the main reasons for this is a comparatively large area (an order of a micron to few tenths of a micron squared) of commonly used superconductor-insulator-superconductor tunnel Josephson junction [32]. Elaboration of nanoscale junctions are highly important for many applications [20,43,44,45,46,47,48,49,50,51,52]. In this work, we develop the nanowire-based Josephson structures for the implementation of superconducting bio-inspired neurons. We further elaborate the superconducting artificial neuron schematic enabling operation modes corresponding to important biological activity missed in previously proposed devices.

2. Results and Discussion

2.1. Preparation of Samples and Experimental Results

The fabricated samples are based on gold nanowires, 60 nm in diameter. The nanowires were grown by metal electrodeposition into porous templates of anodic alumina from cyanide-free Ecomet 04-ZG electrolyte solution at a constant deposition potential of −1.0 V versus Ag/AgCl reference electrode. Different types of superconducting quantum interferometers (SQUIDs) were fabricated using e-beam lithography and magnetron sputtering of superconducting niobium (see Supplementary Materials and Ref. [53] for more details).

We have implemented two types of SQUID cells. The first one is a device with two Josephson weak links, sample A, shown in Figure 2a with a quantization loop area of 5.1 $\mathsf{\mu }$m${}^2$. The other one is a SQUID cell with three Josephson junctions, sample B (Figure 2b), with two loops having quantization areas of 11.3 and 13.8 $\mathsf{\mu }$m${}^2$. We have also implemented a more exotic variant of a two-junction SQUID composed of closely spaced nanowires placed between bulk superconducting electrodes—Sample C (Figure 2c). Here the working area between two wires is about 0.5 $\mathsf{\mu }$m${}^2$.

The sample A serves as a reference device demonstrating operation of conventional SQUID fabricated using the proposed technology. At the same time, the SQUID is a basic cell for previously proposed superconducting bio-inspired neuron [22]. The sample B is a prototype cell of an improved artificial neuron capable of burst firing (or bursting) corresponding to specific activation patterns of biological neurons in the central nervous system and spinal cord, see below. Finally, with the sample C we test an approach for a possible miniaturization of SQUIDs. The area of this device is so small that we see the characteristic Fraunhofer pattern in just a dozen periods of typical oscillations of critical current-magnetic field dependencies.

The current–voltage characteristics of the samples were measured in a dilution refrigerator. They exhibit some asymmetry in their critical current which can be attributed to a frozen magnetic flux (see Supplementary Materials). The shape of the I–V curves becomes hysteretic below 1 K temperature that is likely due to thermal effects caused by the difference between the physical and electronic temperatures [54,55,56]. The critical current of Josephson junctions decreases by about an order with the temperature increase from 20 mK to 2.4 K, see Supplementary Materials.

The sets of I-V curves presented in Figure 2d–f were measured at $T=20$ mK in various perpendicular magnetic fields. The sample A with a maximum critical current, $max\left(I_{CA}\right)$, of 18.5 $\mathsf{\mu }$A, shows regular oscillations of critical current-magnetic field dependence with a period of about $H=2$ Oe (Figure 2d). The symmetry of $I_{CA}\left(H\right)$ curve shape indicates that the critical currents of the SQUID Josephson junctions are close in values. The depth of the critical current modulation can be used for the estimation of the SQUID circuit inductance to be less than ${\mathrm{\Phi }}_0/2\pi I_{CA}$, where ${\mathrm{\Phi }}_0=h/2e$ is the flux quantum (h is Planck’s constant and e is the electron charge). Similar oscillations of $I_{CB}\left(H\right)$ for the sample B is irregular due to more complex geometry of the cell (the maximum critical current is $max\left(I_{CB}\right)=42.5\mathsf{\mu }$A, see Figure 2e). For the sample C, the period of the oscillations is much longer and is approximately 140 Oe. The maximum critical current, $max\left(I_{CC}\right)=14$ $\mathsf{\mu }$A, decays twice in a field of 1000 Oe (Figure 2f).

On the one hand, the experimental data show that the fabricated Josephson junctions possess ∼$\mathsf{\mu }$A critical current and normal state resistance of several Ohms exhibiting no overheating above 1 K temperature. The critical current can be further improved by shrinking the gap between superconducting electrodes. On the other hand, these junctions can be connected in SQUID cells such that even the cell with closely located nanowires provides the typical magnetic flux-voltage characteristics. These results have motivated us to investigate the bio-inspired neurons which can be implemented utilizing nanowire–Josephson–junction SQUID-based cells.

2.2. Bio-Inspired Neuron

A conventional SQUID cell such as sample A can be naturally used for the implementation of the SQUID-based neuron proposed in [22]. However, more useful circuit may be developed using three-Josephson-junction cell corresponding to the sample B, see Figure 3 and Supplementary Materials. This circuit can be analyzed using the resistively shunted junction model with capacitance of Josephson junctions [20,21], while the experimentally studied junctions have vanishing self capacitance, here we include it into consideration to capture all possible operation regimes of the considered neuron circuit. We assume that the critical currents of the junctions $J{J}_1$ and $J{J}_2$ (Figure 3) are equal to $I_{C0}$ and fixed, whereas the critical current of $J{J}_3$, $I_{C3}$, can be varied. Kirchhoff’s equations augmented by the phase-based circuit Equations [57] lead to the following system (see Supplementary Materials):

$$\left\{\begin{array}{c}\ddot{{\varphi }_1}=-\frac{1}{\beta }\left\{i_b+\lambda ({\varphi }_1-{\varphi }_3)+\dot{{\varphi }_1}+sin{\varphi }_1\right\},\hfill \\ \ddot{{\varphi }_2}=\frac{1}{\beta }\left\{i_b+i_{in}\mathrm{\Lambda }-\lambda ({\varphi }_2+{\varphi }_3)-\dot{{\varphi }_2}-sin{\varphi }_2\right\},\hfill \\ \ddot{{\varphi }_3}=\frac{1}{\beta }\left\{\frac{1}{\eta }(i_b+i_{in}\mathrm{\Lambda }+\lambda ({\varphi }_1-{\varphi }_2-2{\varphi }_3))-\dot{{\varphi }_3}-sin{\varphi }_3\right\},\hfill \end{array}\right.$$

(1)

where input current, $i_{in}$, and bias current, $i_b$, are normalized to the reference current $I_{C0}$, whereas $\eta$ is the ratio of $I_{C3}$ to $I_{C0}$. $\mathrm{\Lambda }=\lambda l$, $\lambda ={(l+l_S)}^{-1}$, inductances, l, $l_s$, are normalized to ${\mathrm{\Phi }}_0/2\pi I_{C0}$. ${\varphi }_{1,2,3}$ are Josephson phases of the junctions, dots indicate derivatives (the number of dots means the derivative order) with respect to time, t, normalized to the inverse plasma frequency, $\tau =t{\omega }_p$, ${\omega }_p=\sqrt{2\pi I_{C0}/{\mathrm{\Phi }}_{0}C}$, where C is the junction capacitance. $\beta ={\omega }_{c}RC$ is the Stewart–McCumber parameter, R is the junction resistance in the normal state, and ${\omega }_c=2\pi I_{C0}R/{\mathrm{\Phi }}_0$ is the characteristic frequency.

The circuit dynamics are governed mainly by two parameters at fixed bias current value. They are the normalized critical current of the third junction, $\eta$, determining the neuron firing threshold, and the normalized capacitance of the junctions, $\beta$, responsible for the refractory period.

The first and second Josephson junctions play the role of sodium ($N{a}^{+}$) and potassium ($K^{+}$) ion channels in the neuron membrane [1,58], respectively. The voltage across the cell, $v_{out}$ (see Figure 3b), reflects the following processes during the neuron firing, see the circled numbers on a spike shown in Figure 4a: 1—the neuron is stimulated above the firing threshold, $N{a}^{+}$ channels are opened so that $N{a}^{+}$ begins to enter the cell; 2—$K^{+}$ channels are opened, $K^{+}$ begins to leave the cell; 3—$N{a}^{+}$ channels become refractory, no more $N{a}^{+}$ enters the cell; 4—$K^{+}$ leaves the cell and rapidly repolarizes the membrane; 5—$K^{+}$ channels are closed and $N{a}^{+}$ channels reset; 6—extra $K^{+}$ outside diffuses away.

The proposed neuron is capable of mimic the biological activity corresponding to the modes presented in Figure 4 (see Supplementary Materials for comparison with simulations performed within the framework of the Izhikevich mathematical model of biological neurons):

• Regular mode shows the typical response of a neuron to external stimulation. A short input current pulse of a sufficient amplitude causes single spike, whereafter the system returns to a stable state, see Figure 4a. A long pulse leads to repeated overcoming of the firing threshold. Thus, a series of spikes is observed, Figure 4b. The interspike interval is determined by a neuron refractory period, which, in consequence, is related to the recovery of $N{a}^{+}$ channels.
• Steady state mode (Figure 4c) is characterized by the weak damped output pulses. This is analog of the maintenance of constant internal concentrations of ions in the cell in response to an under threshold stimulation.
• Injury mode (Figure 4d) is characterized by the losses of spikes, or vice versa, the generation of “extra” spikes. This mimics the biophysical abnormality caused by different nervous diseases and neuron injuries.
• Bursting mode (Figure 4e) demonstrates the generation of a series of spikes in response to singe stimulating current pulse. Such behavior may be the result of the complex neuron interaction in the network. However, this can also be a consequence of internal processes in a neuron. In the last case, the reason is the after-depolarization (ADP), a membrane depolarisation at the last stages of repolarisation (circled “4” on the spike shown in Figure 4a) [59,60]. A slow sodium current appears at membrane voltage ∼−50…−70 mV and overcomes outward $K^{+}$ current, causing a membrane voltage to rise again. Such current is resistant to inactivation and may last for long times. The bursting pattern parameters—the spike sequence frequency and its length—are determined by the concentration of ion channels of different kinds, properties of these channels, and ionic concentrations in extracellular space. Though only relatively small cohort of neurons in vivo exhibits a bursting behavior [61,62,63], it plays an important role in synaptic plasticity [64,65], synchronization of big neuron groups [66], detection of frequency features of input stimuli [67], information encoding [68,69], and reliability of synaptic transmission [64,70], which may be crucial for processing of important stimuli [71].
• Figure 4f illustrates the bursting dynamics of biological neuron simulated in the frame of the fractional-order Izhikevich model [72,73] for comparison, see also Supplementary Materials.

The map of the proposed neuron operation modes on the plane of parameters ($\eta$, $\beta$) is shown in Figure 5. The parameters used for simulations presented in Figure 4 are marked by stars.

The non-biological dynamics, which are not observed in vivo under any conditions, take place at small damping in the system (large $\beta$). In the overdamped circuits ($\beta ⟶0$) such as the studied experimental samples, the steady state, regular, and injury modes can be obtained. Small critical current of the third Josephson junction ($\eta \approx 0$) effectively blocks the inflow of the input current into the output junction, $J{J}_2$, redirecting it to the inductance, l, connected to the ground, see Figure 3b. This results in the steady state mode where no spike is produced. An increase in $\eta$ value opens access to the output junction, such that the input current pulse triggers successive switching of the junctions $J{J}_2$, $J{J}_3$, $J{J}_1$. This mimics $N{a}^{+}$ ions inflow succeeded by $K^{+}$ outflow corresponding to the regular mode. At larger $\eta$ values the neuron circuit becomes bistable with one enabling and one inhibiting intracellular current configuration for the output junction switching. In this case, the steady state and injury modes are determined by the initial current configuration in the circuit: inhibiting or enabling (switched to inhibiting after the first spike), respectively.

Unfortunately, the bursting mode clearly requires finite capacitance to maintain periodic switching of the Josephson junctions. This indicates the necessity for complication of the studied cell circuit, e.g., an introduction of the shunting capacitor.

While the regular and steady state mode can be reproduced in the previously proposed bio-inspired neuron [22], the injury and bursting modes appear only in the presented advanced neuron cell.

3. Conclusions

The distinctive features of the superconducting technology are the high frequency operation and high energy efficiency. The possibility of processing of up to ${10}^{10}$ spikes/s by an artificial neuron (versus maximum $\sim 453$ spikes/s in the human brain [74] or 100–200 spikes/s widely spread [75,76]) and power consumption of about 0.1 MW [28] for human brain model pave the way for high performance neurophysiological simulations. We have addressed the low integration density issue of superconducting circuits by the development of technology intended for fabrication of compact SQUIDs utilizing nanowire-based nanobridge Josephson junctions. We have experimentally demonstrated two types of SQUIDs suitable for the implementation of bio-inspired neurons. Numerical simulations show that the proposed three-junction cell is capable of mimic specific biological neuron activity missed in previously presented superconducting artificial neurons. In this mode of operation, regular and irregular spike sequences are generated as activation patterns occurring in vivo in many cases including stereotypical motor programs, neural coding, and neuropathologies. An introduction of capacitance in the cell designs and studying options for signal transfer between the artificial neurons are urgent tasks in the considered research direction.