Drawings
In order to make the above and other objects, features, advantages and embodiments of the present invention more comprehensible, the following description of the accompanying drawings is given:
fig. 1 is a schematic diagram of a type of neural circuit according to some embodiments of the present invention;
fig. 2 is a schematic diagram of a type of neural circuit according to some embodiments of the present invention;
fig. 3 is a schematic diagram of a control circuit according to some embodiments of the present invention;
fig. 4 is a waveform diagram of signals of a type of neural circuit according to some embodiments of the present invention;
fig. 5 is a schematic diagram of a type of neural circuit according to some embodiments of the present invention;
FIG. 6 is a schematic diagram of a switch;
FIG. 7 is a schematic diagram of a switch;
FIG. 8A is a schematic diagram of a switch;
FIG. 8B is a schematic diagram of the structure of the switch of FIG. 8A; and
fig. 9 is a flow chart of a method of operating a neural circuit according to some embodiments of the present invention.
[ notation ] to show
Class 100 … neural circuit
120 … synaptic electrical circuit
130 … anterior neuron circuit
131 … axon drive
140 … post neuron circuit
141 … transistor
142 … transistor
500 … nerve circuit
520 synapse circuit 520 …
Region 701 …
Region 702 …
900 … operation method
PCM … phase change element
D1 … switch
SW2 … switch
G1 … pulse signal generator
G2 … pulse signal generator
PS1 … pulse signal
PS2 … pulse signal
C1 … capacitance
R1 … resistor
GND … ground terminal
Vp … voltage level
Vth… Voltage threshold
COM … comparator
CON … control circuit
FIRE … FIRE Signal
IN … control circuit input terminal
OUT … control circuit output terminal
Vdd … power supply
TD … delay circuit
G3 … pulse signal generator
CS … control signal
Tp … pulse time
Time of T1 … pulse
Time of T … pulse
T/2 … time interval
td … delay time
t1 … time point
t2 … time point
t3 … time point
t4 … time point
SW1 … switch
SWR1 … switch
SWR2 … switch
SWR3 … switch
Operations S910, S920, S930, S940, S950, S960 …
Detailed Description
The term "coupled", as used herein, may also mean "electrically coupled", and the term "connected", as used herein, may also mean "electrically connected". "coupled" and "connected" may also mean that two or more elements co-operate or interact with each other.
Please refer to fig. 1 and fig. 2. Fig. 1 and 2 are schematic diagrams of a neural circuit 100 according to some embodiments of the present invention.
Referring to fig. 1, the neural circuit 100 includes a synaptic circuit (synapse circuit)120, a pre-synaptic neuron circuit 130 (hereinafter referred to as "pre-neuron" 130), and a post-synaptic neuron circuit 140 (hereinafter referred to as "post-neuron" 140). The anterior neuron 130 contains an axon driver (axon driver) 131. The axon drive 131 includes a pulse signal generator G1 and a pulse signal generator G2. The posterior neuron 140 includes a dendrite (dendrite) and is configured to receive a signal. In some embodiments, the axon drive 131 of the anterior neuron 130 sends a spike signal (spike) that is transmitted via the synaptic electrical circuit 120 to the dendrite of the posterior neuron 140 to stimulate the posterior neuron 140. Thus, the effect similar to signal transmission in a neural network system can be achieved.
Synaptic electrical circuit 120 includes phase change element PCM, switch D1, and switch SW 2. The phase change element PCM comprises a phase change material. The phase change material may have different crystalline phases based on the magnitude of the current pulse and/or the duration of the pulse. Different crystalline phases have different physical properties. For example, the crystalline phase or polycrystalline phase has a low resistance value, while the amorphous phase has a high resistance value. Accordingly, information can be stored in the corresponding crystal phase.
Switch D1 is implemented as a diode. The switch SW2 is implemented as a transistor. Specifically, the switch D1 includes a first terminal and a second terminal. The first terminal is an anode terminal and the second terminal is a cathode terminal. The switch D1 has a first terminal coupled to the pulse signal generator G1 for receiving the pulse signal PS 1. The first terminal of the switch SW2 is coupled to the pulse signal generator G2 to receive the pulse signal PS 2. The second terminal of the switch D1 and the second terminal of the switch SW2 are coupled to the first terminal of the phase change element PCM. The second terminal of the phase change element PCM is coupled to the posterior neuron 140. A control terminal of switch SW2 is coupled to the rear neuron 140 to receive the control signal CS from the rear neuron 140.
The rear neuron 140 includes a control circuit CON, a capacitor C1, a resistor R1, a comparator COM, a delay circuit TD, and a pulse signal generator G3. The first terminal of the capacitor C1 and the resistor R1 is coupled to the ground GND. The control circuit CON may control a path of a signal input or output by the rear neuron 140. The comparator COM includes a positive input terminal, a negative input terminal, and an output terminal. The second terminal of the phase change element PCM, the second terminal of the capacitor C1 and the second terminal of the resistor R1 are coupled to the positive input terminal of the comparator COM. The negative input terminal of the comparator COM is used for receiving a voltage threshold value Vth. The output terminal of the comparator COM is coupled to the delay circuit TD. The delay circuit TD is coupled to the pulse signal generator G3. The pulse signal generator G3 is coupled to the control terminal of the switch SW 2.
The capacitance C1 in the posterior neuron 140 is a cell membrane potential that mimics a neuron. There are many kinds of charged ions inside and outside the neuron cell membrane. Due to the difference in the type and charge amount of the charged ions inside and outside the cell membrane, the voltage difference between the inside and outside of the cell membrane (also referred to as membrane potential) (hereinafter, referred to as voltage level Vp) is reflected by the capacitor C1. Neuronal cell membranes have channels that vary in size and control the entry and exit of charged ions. Charged ions inside and outside the cell membrane can pass through these channels to cause a change in the value of the voltage level Vp. The resistor R1 simulates the electrical effect of charged ions traveling back and forth through the channel. The pulse signal sent from the axon (axon) of the anterior neuron is received by the dendrite (dendrite) of the posterior neuron to change the membrane potential (voltage level Vp) of the cell membrane of the posterior neuron, which corresponds to the behavioral effect of the posterior neuron 140, i.e., to charge the capacitor C1. If the pulse signal is strong enough, the film potential (voltage level Vp) on the capacitor C1 exceeds the voltage threshold VthThe posterior neuron 140 then outputs a FIRE signal FIRE. On the contrary, if the pulse signal strength is not large enough, the voltage on the capacitor C1 will rise but not exceed the voltage thresholdValue VthThe posterior neuron 140 does not output the FIRE signal FIRE. In addition, the increased membrane potential (voltage level Vp) is gradually decreased by the leakage of the resistor R1. The behavior of the neuron on the neuron cell is that the posterior neuron instantaneously changes the concentration of charged ions inside and outside the cell membrane due to the excitation signal of the anterior neuron, and then the charged ions are diffused and balanced through the channel on the cell membrane, so that the membrane potential (voltage level Vp) of the cell membrane of the posterior neuron is restored to a balanced value. Accordingly, the behavior of this path, electrically, from the anterior neuron 130 to the capacitance C1 of the posterior neuron 140 is referred to as Leakage Integration and Fire (LIF). The neuronal cell membrane potential (voltage level Vp) is a function of the sum of the leakage products and the excitation (LIF) (Vp ═ f (LIF)).
The excitation signal of a pre-neuron affects the cellular membrane potential of a post-neuron via synapses (comprising axons of the pre-neuron and dendrites of the post-neuron). However, even with the same excitation signal, different anterior neurons have different magnitudes of influence on the cell membrane potential of the posterior neuron. This can be said to be the difference in the magnitude of synaptic weights (W) between the anterior and posterior neurons. Synaptic weights (W) are plastic (or adaptable). The magnitude of the weight change amount (Δ W) is a function of the time difference between the anterior neuron excitation time point (t1) and the posterior neuron excitation time point (t2) (Δ W — F (t2-t 1)). In other words, the magnitude of the synaptic weight change (Δ W) is related to the time difference between the excitation time point t1 and the excitation time point t2, and the synaptic weight W is adaptively adjusted according to the value of the time difference. Therefore, synaptic weight (W) relates to an indicator of causal relationships between neurons. Thus, a characteristic index representing the change of weight (W) of synapse (synapse) due to the relative relationship of the excitation times of the front and back neurons is defined, which is called "Spike timing dependent plasticity" (STDP). The spike-time-dependent plasticity (STDP) of synapses is also indirectly linked to leakage sum and to excitation (LIF). This is because the leak sum and fire (LIF) may determine the firing time point of the posterior neuron (t 2). In some embodiments, the spike-time-dependent plasticity (STDP) of synapses represents the plasticity of synaptic current conductivity. More specifically, in some embodiments, the spike-time plasticity (STDP) of synapses represents the magnitude of synaptic resistance.
Please refer to fig. 3. Fig. 3 is a schematic diagram of a control circuit CON in the posterior neuron 140 according to some embodiments of the present invention. For the example of fig. 3, the control circuit CON includes a control circuit input terminal IN, a control circuit output terminal OUT, a transistor 141, and a transistor 142. The transistors 141 and 142 each include a first terminal (e.g., gate), a second terminal (e.g., source), and a third terminal (e.g., drain). The two transistors 141 and 142 are connected in series. IN a normal state, the transistors 141 and 142 are not turned on, the control circuit input terminal IN is electrically connected to the power supply Vdd, and the control circuit output terminal OUT is IN a Floating state (Floating). When the gate of the transistor 141 receives a pulse voltage/current with a pulse time Tp, the transistor 141 is turned on, and the output terminal OUT of the control circuit outputs the pulse voltage/current with the same pulse time Tp. After the pulse at the input terminal IN of the control circuit is finished, the transistor 141 is turned off, and the output terminal OUT of the control circuit returns to the floating state.
In some embodiments, the transistor 141 is a P-type metal oxide semiconductor field effect transistor (PMOS). The gate and the source of the transistor 141 are electrically connected to a power supply Vdd. The control circuit input IN is electrically connected to the gate of the transistor 141. The transistor 142 is an N-type metal oxide semiconductor field effect transistor (NMOS). The gate and the source of the transistor 142 are electrically connected to the ground GND. The drain of the transistor 141 is connected to the drain of the transistor 142 and to the control circuit output OUT.
Fig. 4 is a waveform diagram of signals of a type of neural circuit according to some embodiments of the present invention.
Please refer to fig. 1 and fig. 4 together. Before the anterior neuron 130 has not yet spiked, the voltage level Vp of the capacitor C1 in the posterior neuron 140 gradually goes to a balance potential through the resistor R1. In some embodiments, the balance potential is a ground potential, but the present invention is not limited thereto. The pulse signal generator G1 in the axon driver 131 sends the pulse signal PS1 at time T1, and the pulse time T1 of the pulse signal PS1 is from time T1 to time T2. At pulse time T1, onOff D1 is on and switch SW2 is off. In some embodiments, the pulse signal PS1 is also referred to as "axon pulse LIF" and has a pulse time of 100 nanoseconds (ns), but the present invention is not limited thereto. The pulse signal PS1 (axon pulse LIF) is input to the path of the neuron 140 via the control circuit CON, and the pulse signal PS1 (axon pulse LIF) charges the second terminal of the capacitor C1 (positive input terminal of the comparator COM) through the phase change element PCM of the synapse circuit 120. If the voltage level Vp of the capacitor C1 is higher than the voltage threshold V of the negative input terminal of the comparator COM before the time point t2 (including the time point t2)thAt this time, the output of the comparator COM immediately sends the FIRE signal FIRE. Accordingly, the magnitude of the PCM resistance can control the charging speed of the capacitor C1.
Next, please refer to fig. 2 and fig. 4 together. At time T2, the pulse signal generator G2 of the axon driver 131 generates a pulse signal PS2, in some embodiments, the pulse signal PS2 is also called "axon pulse STDP", and in some embodiments, the pulse time T of the pulse signal PS2 (axon pulse STDP) is 100 milliseconds (ms), but the invention is not limited thereto. The pulse time T of the pulse signal PS2 (axon pulse STDP) is divided into two time intervals of equal time (T/2) before and after. The pulse of the former time interval (T/2) is gradually decreased from high voltage, the pulse of the latter time interval (T/2) is instantaneously increased by a voltage value (not shown), and then the voltage is gradually increased. After the pulse signal PS1 (axon pulse LIF) ends, the voltage of the capacitor C1 in the posterior neuron 140 gradually discharges back to the equilibrium value of the cell membrane potential via the resistor R1.
The FIRE signal FIRE from the output terminal of the comparator COM passes through the delay circuit TD and the pulse signal generator G3 to output the control signal CS for turning on the switch SW 2. The delay circuit TD adds a delay time TD to the FIRE signal FIRE. In some embodiments, the delay time td is 50 milliseconds (ms). After the delay time td, the control signal CS is output to the gate of the switch SW2 at the time point t3 to turn on the switch SW 2. The control signal CS has a pulse time from a time point t3 to a time point t4, and the control signal CS can turn on the switch SW2 during the pulse time. In some embodiments, time t3 to time t4 is 0.1 milliseconds (ms).
During the time that switch SW2 is on, switch D1 is in an off state. The control circuit CON will conduct current from the voltage source Vdd through the phase change element PCM and the switch SW 2. The magnitude of the voltage difference across the first terminal and the second terminal of the switch SW2 can adjust the magnitude of the current flowing through the switch SW 2.
In some embodiments, the pulse interval of the control signal CS falls in the preceding time interval of the pulse signal PS2 (axon pulse STDP). The voltage differential across switch SW2 is now large. Accordingly, the switch SW2 instantaneously flows a large current. Therefore, the current flowing through the phase change element PCM is large instantaneously, and the PCM is easy to be in an amorphous phase state, so the resistance value is large. In some embodiments, the pulse interval of the control signal CS falls within a time interval following the pulse signal PS2 (axon pulse STDP). The voltage differential across switch SW2 is now small. Accordingly, the switch SW2 momentarily draws a small current. Therefore, the current flowing through the phase change element PCM is small instantaneously, and the PCM is in a crystalline phase or a polycrystalline phase state, so that the resistance value is small. Since the voltage value in the time interval before and after the pulse signal PS2 (axon pulse STDP) is not constant, the voltage difference across both ends of the switch SW2 shows a continuous difference in magnitude, and thus the current flowing through the phase change element PCM also shows a continuous change in magnitude.
Based on the above, the conduction level of the switch SW2 affects the magnitude of the current flowing through the phase change element PCM. The phase of the phase change element PCM changes according to the magnitude of the current flowing through the phase change element PCM, thereby changing the resistance value of the phase change element PCM. The phase of the phase change element PCM may be used to determine the weights of such neural circuit 100. The weights are used to reflect the degree of influence of the anterior neurons on the posterior neurons. For example, the more current neurons stimulate the posterior neurons, the heavier such neural circuit 100 weights.
In some embodiments, the pulse time of the pulse signal PS1 (axon pulse LIF) is 0.1 milliseconds (ms), the pulse time of the pulse signal PS2 (axon pulse STDP) is 100 milliseconds (ms), and the delay time TD of the delay circuit TD is 50 milliseconds (ms). After the delay time td, the control signal CS is output at time t3 just near the middle point of the time interval of the pulse signal PS2 (axon pulse STDP). Therefore, if the control signal CS of the back neuron 140 is caused by the firing of the front neuron 130, the time point of the control signal CS is likely to fall in the later time interval of the pulse signal PS2 (axon pulse STDP), so that the phase change element PCM in the corresponding synaptic circuit 120 is set to a low value, which indicates that the corresponding synaptic circuit 120 has better conductivity, i.e. the firing of the back neuron 140 (FIRE signal FIRE) and the firing of the front neuron 130 have a higher causal relationship, so the weight (W) of the synaptic circuit 120 is increased.
In other embodiments, if the firing of the back neuron 140 (FIRE signal FIRE) is directly caused by the firing of another pre-neuron (not shown), the control signal CS is more likely to fall in the preceding time interval of the pulse signal PS2 (axon pulse STDP), so that the phase change element PCM in the synaptic circuit 120 corresponding to the pre-neuron 130 is set to a high value, which means that the firing of the back neuron 140 (FIRE signal FIRE) and the firing of the pre-neuron 130 are less causal, and thus the weight (W) of the synaptic circuit 120 is reduced.
The neural circuit 100 can perform learning actions using the above operations to implement a neural network system in a similar organism.
Please refer to fig. 5. Fig. 5 is a schematic diagram of a neural circuit 500 according to some embodiments of the present invention. The neural circuit 500 of FIG. 5 differs from the neural circuit 100 of FIG. 1 in that the synapse circuit 520 of the neural circuit 500 replaces the switch D1 in the neural circuit 100 with a switch SW 1. In fig. 5, switch SW1 is an nmos field effect transistor.
For the example of fig. 5, the switch SW1 includes at least three terminals (a first terminal, a second terminal, and a control terminal). The first terminal is a source terminal, the second terminal is a drain terminal, and the control terminal is a gate terminal. The first terminal of the switch SW1 is coupled to the pulse signal generator G1 to receive the pulse signal PS 1. The second terminal of the switch SW1 is coupled to the phase change element PCM. A control terminal of the switch SW1 is coupled to the first terminal of the switch SW 1.
The connections and operations of the other components of the neural circuit 500 are similar to those of the neural circuit 100 in fig. 1, and thus are not described herein again.
Please refer to fig. 6. Fig. 6 is a schematic diagram of switch SWR 1. For example, in fig. 6, the switch SWR1 is a pmos fet, and the control terminal of the switch SWR1 is coupled to the second terminal of the switch SWR 1. In some embodiments, switch SWR1 may be used in place of switch SW1 in fig. 5 to accomplish a similar operation.
Please refer to fig. 7. Fig. 7 is a schematic diagram of switch SWR 2. For the example of fig. 7, switch SWR2 is a bipolar transistor. In some embodiments, switch SWR2 may be used in place of switch SW1 in fig. 5 to accomplish a similar operation.
Please refer to fig. 8A and fig. 8B. Fig. 8A is a schematic diagram of switch SWR 3. Fig. 8B is a schematic structural diagram of the switch SWR3 of fig. 8A. Switch SWR3 is a junction field effect transistor. In some embodiments, switch SWR3 can be used to replace switch D1 in fig. 1 to accomplish similar operations. The first region (N-type region) 701 can be used as a cathode terminal, and the second region (P-type region) 702 can be used as an anode terminal.
Please refer to fig. 9. Fig. 9 is a flow chart of a method 900 of operating a type of neural circuit according to some embodiments of the present invention. For example, in fig. 9, the operation method 900 includes operations S910, S920, S930, S940, S950 and S960. In some embodiments, the operation method 900 is applied to the neural circuit 100 of fig. 1, but the present invention is not limited thereto. For ease of understanding, the following discussion will be in conjunction with FIG. 1.
The pre-neuron 130 includes the role of Axon (Axon), and in operation S910, the pre-neuron 130 sends a spike signal from the Axon driver 131, which is received by the synapse circuit 120 and then sent to the post-neuron 140. In some embodiments, the pulsed signal PS1 is sent through the axon of the anterior neuron 130, the pulsed signal PS1 is received through the first switch D1 of the synaptic electrical circuit 120 and sent to the posterior neuron 140.
In operation S920, an input terminal of the rear neuron 140 (comparator COM) is charged in response to the pulse signal PS 1. In some embodiments, the post-neuron 140 includes the role of a dendrite (dendrite) to receive a signal from the synaptic electrical circuit 120.
In operation S930, a pulsed signal PS2 is sent by the axon drive 131 of the pre-neuron 130, and a pulsed signal PS2 is received by a first terminal of a switch SW2 of the synaptic electrical circuit 120.
In operation S940, the post neuron 140 selects a voltage threshold V according to the voltage level Vp of the input terminalthThe comparison results in the excitation signal FIRE. In some embodiments, when the voltage level Vp is greater than the voltage threshold VthThe comparator COM outputs the FIRE signal FIRE.
In operation S950, the control signal CS is generated by the rear neuron 140 according to the FIRE signal FIRE. In some embodiments, the delay circuit TD adds a delay time to the FIRE signal FIRE to generate the control signal CS.
In operation S960, the switch SW2 of the synaptic circuit 120 is turned on or off according to the control signal CS, and the second pulse signal PS2 received by the first terminal of the switch SW2 is used to control the state of the phase change element PCM of the synaptic circuit 120. Accordingly, the weight of the neural circuit 100 can be determined according to the state of the phase change element PCM. In some embodiments, the phase change element PCM comprises a phase change material. The different resistance values correspond to different phase change materials.
The description of method 900 includes exemplary operations, but the operations of method 900 need not be performed in the order illustrated. It is within the spirit and scope of the present invention that the order of the operations of method 900 be altered or that the operations be performed concurrently, partially concurrently or with partial omission as appropriate.
To sum up, the utility model discloses a neural network system is built out to neural circuit class, usable circuit.
Although the present invention has been described with reference to the above embodiments, it is not intended to limit the present invention, and those skilled in the art can make various changes and modifications without departing from the spirit and scope of the present invention.