US11468248B2 - Semiconductor device - Google Patents
Semiconductor device Download PDFInfo
- Publication number
- US11468248B2 US11468248B2 US16/500,996 US201816500996A US11468248B2 US 11468248 B2 US11468248 B2 US 11468248B2 US 201816500996 A US201816500996 A US 201816500996A US 11468248 B2 US11468248 B2 US 11468248B2
- Authority
- US
- United States
- Prior art keywords
- voltage
- output
- circuit
- input
- inverter
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active, expires
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06G—ANALOGUE COMPUTERS
- G06G7/00—Devices in which the computing operation is performed by varying electric or magnetic quantities
- G06G7/48—Analogue computers for specific processes, systems or devices, e.g. simulators
- G06G7/60—Analogue computers for specific processes, systems or devices, e.g. simulators for living beings, e.g. their nervous systems ; for problems in the medical field
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/048—Activation functions
-
- G06N3/0635—
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/06—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons
- G06N3/063—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons using electronic means
- G06N3/065—Analogue means
-
- H01L21/822—
-
- H01L27/04—
-
- H01L28/40—
-
- H—ELECTRICITY
- H03—ELECTRONIC CIRCUITRY
- H03F—AMPLIFIERS
- H03F3/00—Amplifiers with only discharge tubes or only semiconductor devices as amplifying elements
- H03F3/45—Differential amplifiers
- H03F3/45071—Differential amplifiers with semiconductor devices only
-
- H—ELECTRICITY
- H10—SEMICONDUCTOR DEVICES; ELECTRIC SOLID-STATE DEVICES NOT OTHERWISE PROVIDED FOR
- H10D—INORGANIC ELECTRIC SEMICONDUCTOR DEVICES
- H10D1/00—Resistors, capacitors or inductors
- H10D1/60—Capacitors
- H10D1/68—Capacitors having no potential barriers
-
- H—ELECTRICITY
- H10—SEMICONDUCTOR DEVICES; ELECTRIC SOLID-STATE DEVICES NOT OTHERWISE PROVIDED FOR
- H10D—INORGANIC ELECTRIC SEMICONDUCTOR DEVICES
- H10D84/00—Integrated devices formed in or on semiconductor substrates that comprise only semiconducting layers, e.g. on Si wafers or on GaAs-on-Si wafers
-
- H—ELECTRICITY
- H10—SEMICONDUCTOR DEVICES; ELECTRIC SOLID-STATE DEVICES NOT OTHERWISE PROVIDED FOR
- H10D—INORGANIC ELECTRIC SEMICONDUCTOR DEVICES
- H10D84/00—Integrated devices formed in or on semiconductor substrates that comprise only semiconducting layers, e.g. on Si wafers or on GaAs-on-Si wafers
- H10D84/01—Manufacture or treatment
- H10D84/02—Manufacture or treatment characterised by using material-based technologies
- H10D84/03—Manufacture or treatment characterised by using material-based technologies using Group IV technology, e.g. silicon technology or silicon-carbide [SiC] technology
- H10D84/038—Manufacture or treatment characterised by using material-based technologies using Group IV technology, e.g. silicon technology or silicon-carbide [SiC] technology using silicon technology, e.g. SiGe
Definitions
- the prevent invention relates to semiconductor devices and, more particularly, to a semiconductor device capable of being used as a constituent element of a neuromorphic analogue circuit.
- a neuromorphic system means an information processing system having been established by obtaining hints from, or imitating, information processing in a cranial nerve system. Through the use of the neuromorphic system, it is expected that information processing that is difficult for existing digital computers is efficiently executed.
- a silicon neural network one of the neuromorphic systems, is a circuit for reproducing an electrophysiological activity of a neural network.
- the silicon neural network is a network resulting from coupling of a large number of silicon neuron circuits via silicon synapse circuits.
- the silicon neural network is capable of reproducing electrical activities equivalent to those of the neural network in real time or at a speed faster than the real time.
- the neuron means a cell constituting a neuro system.
- the functions of the neuron are specific to information processing and information communication, and are unique to animals.
- the robustness means the improvement of an inner mechanism for blocking changes due to influences of external disturbances, such as the change of stress and the change of an environment.
- an ion channel of a neuronal cell has a sigmoid function-like characteristic in response to a membrane potential or the like.
- the sigmoid function is a function used in a mathematical model of a neural activity, and the like.
- a Hodgkin-Huxley model a standard neuron ignition model, is known.
- FIG. 1 is a diagram illustrating changes in response to a membrane potential for various activation variables in the Hodgkin-Huxley model, which is a standard neuron ignition model.
- a circuit having a sigmoid function-like input/output characteristic plays a fundamental role.
- the sigmoid function is a function having a nonlinear input/output characteristic represented by the following numerical expression.
- sigmoid function-like means “having a nonlinear characteristic like the sigmoid function”.
- sigmoid function-like means “having a nonlinear characteristic like the sigmoid function”.
- a function obtained by the exponentiation of the above function, such as 1 ⁇ 2 power of the above function, and represented by the following numerical expression is also referred to as “sigmoid function-like”.
- FIG. 2 is a diagram illustrating a sigmoid function or sigmoid function-like functions.
- sign A indicates a sigmoid function
- sign B indicates a sigmoid decreasing function
- sign C indicates the square root of the sigmoid function (sign A).
- Non Patent Literature 1 an element having, in its input/output, a sigmoid function-like characteristic, such as illustrated in FIG. 2 , is used. Further, in Non Patent Literature 1, there is disclosed a technique that achieves a silicon neuron circuit, such as illustrated in FIG. 5 , by combining a differential pair amplifier illustrated in FIG. 3 , and a nonlinear circuit achieved in a cascode circuit illustrated in FIG. 4 .
- circuit f v and circuit g v are circuits having a sigmoid function-like input/output characteristic.
- Circuit f v in FIG. 5 is implemented by the differential pair amplifier illustrated in FIG. 3
- circuit g v is implemented by the cascode circuit illustrated in FIG. 4 .
- I av is a constant current source.
- C is a capacitor and retains membrane potential V.
- this silicon neuron circuit is capable of receiving stimulus current I stim from, for example, another neuron or the like.
- the silicon neuron circuit of FIG. 5 achieves the reduction of power consumption by suppressing the amount of current through the use of metal-oxide-semiconductor field effect transistors (MOSFETs) in a subthreshold region.
- MOSFETs metal-oxide-semiconductor field effect transistors
- Non Patent Literature 2 As a circuit technique using noise, a stochastic logic gate is reported in Non Patent Literature 2, and the stochastic logic gate utilizes a phenomenon called a stochastic resonance.
- FIG. 6 it is shown that individual potentials represented by a full line and a dashed line have mutually different stabilities.
- Each of the potentials illustrated in FIG. 6 is a dynamics system potential having two different stable states ( ⁇ , ⁇ ). It is disclosed that, when a sufficient amount of noise exists, in the potential represented by the dashed line, a staying probability at stable point ⁇ is larger than a staying probability at stable point ⁇ .
- Patent Literature 1 there is disclosed a technique that achieves an annealing calculation by arbitrarily causing bit errors of static random access memory (SRAM).
- SRAM static random access memory
- the silicon neuron circuit is expected to be implemented in analog circuits having a small circuit size and small power consumption. Further, for the silicon neuron circuit, the improvement of the degree of integration and the further improvement of the efficiency of power are required. In general, however, for an analog circuit, a higher circuit accuracy than that of a digital circuit is required. In the analog circuit, therefore, manufacturing error tolerance of each element constituting the circuit is lower than in the digital circuit. Consequently, there is a problem in that it is difficult to manufacture the analog circuit using a highly integrated process, such as used in the digital circuit.
- an object of the present invention is to provide a semiconductor device having a high degree of integration and high temperature resistance and intended to reduce power consumption.
- a semiconductor device includes an input means to which a voltage is applied, a current output means that outputs a high level current or a low level current in response to the voltage applied to the input means, and a stochastic circuit that, in response to the voltage applied to the input means, changes a probability that the high level current or the low level current is output from the current output means, in accordance with a sigmoid function used in a mathematical model of a neural activity.
- a semiconductor device having a high degree of integration and high temperature resistance and intended to reduce power consumption can be provided.
- FIG. 1 is a diagram illustrating changes in response to a membrane potential for various activation variables in a Hodgkin-Huxley model, namely, a standard neuron ignition model.
- FIG. 2 is a diagram illustrating a sigmoid function and sigmoid function-like functions.
- FIG. 3 is a diagram illustrating a nonlinear circuit (a differential amplifier), namely, a technique for implementing a silicon neuron circuit.
- FIG. 4 is a diagram illustrating a nonlinear circuit (a cascode circuit), namely, a technique for implementing a silicon neuron circuit.
- FIG. 5 is a diagram illustrating an example of techniques for implementing a silicon neuron circuit.
- FIG. 6 is a diagram of an example illustrating a dynamics system potential having two different stable states
- FIG. 7 is a diagram illustrating an example of the outline configuration of a circuit having a sigmoid function-like input/output characteristic and included in a semiconductor device according to an example embodiment.
- FIG. 8 is a diagram illustrating an example of an output current at the time when an input voltage is constant, in a circuit having a sigmoid function-like input/output characteristic and included in a semiconductor device according to an example embodiment.
- FIG. 9 is a diagram illustrating an example of the configuration of a stochastic circuit constituting a circuit having a sigmoid function-like input/output characteristic and included in a semiconductor device according to a first example embodiment.
- FIG. 10 is a diagram illustrating an example of an output voltage that is output in response to an input voltage of a bistable circuit of FIG. 9 .
- FIG. 11 is a diagram illustrating an example of the configuration of a stochastic circuit constituting a circuit having a sigmoid function-like input/output characteristic and included in a semiconductor device according to a second example embodiment.
- FIG. 12 is a diagram illustrating an input/output characteristic of an inverter of a flipflop circuit of FIG. 11 .
- FIG. 13 is a diagram illustrating the flipflop circuit of FIG. 11 in a two-dimensional dynamics system.
- FIG. 14 is a diagram illustrating that the dynamics system of the flipflop circuit of FIG. 11 is changed.
- FIG. 15 is a diagram illustrating an example of the configuration of a bistable circuit constituting a circuit having a sigmoid function-like input/output characteristic and included in a semiconductor device according to a third example embodiment.
- FIG. 16 is a diagram illustrating a simulation of an output voltage of a bistable circuit of FIG. 15 at the time when an input voltage of the bistable circuit is changed.
- FIG. 17 is a diagram illustrating an average value of an output voltage of a bistable circuit of FIG. 15 at the time when an input voltage of the bistable circuit is changed.
- FIG. 18 is a diagram illustrating temperature dependency of an average value of an output voltage of a bistable circuit of FIG. 15 at the time when an input voltage of the bistable circuit is changed.
- FIG. 19 is a diagram illustrating an example of the configuration of a stochastic circuit constituting a circuit having a sigmoid function-like input/output characteristic and included in a semiconductor device according to a fourth example embodiment.
- FIG. 20 is a diagram illustrating an example of an output voltage that is output in response to an input voltage of a bistable circuit of FIG. 19 .
- FIG. 21 is a diagram illustrating an example of an output current that is output in response to an input voltage of a bistable circuit of FIG. 19 .
- FIG. 22 is a diagram illustrating an example of the configuration of a stochastic circuit constituting a circuit having a sigmoid function-like input/output characteristic and included in a semiconductor device according to a fifth example embodiment.
- FIG. 23 is a diagram illustrating a result of the simulation of an average value of an output voltage of a bistable circuit of FIG. 22 at the time when an input voltage of the bistable circuit is changed.
- FIG. 24 is a diagram illustrating an example of the configuration of a stochastic circuit constituting a circuit having a sigmoid function-like input/output characteristic and included in a semiconductor device according to a sixth example embodiment.
- FIG. 25 is a diagram illustrating an example of the configuration of a stochastic circuit consisting a circuit having a sigmoid function-like input/output characteristic and included in a semiconductor device according to a seventh example embodiment.
- FIG. 26 is a diagram illustrating an example of the configuration of a stochastic circuit consisting a circuit having a sigmoid function-like input/output characteristic and included in a semiconductor device according to an eighth example embodiment.
- FIG. 27 is a diagram illustrating a simulation of an output voltage of a bistable circuit of FIG. 26 in various leak adjustment voltages V leak of the bistable circuit.
- FIG. 28 is a diagram illustrating an example of the configuration in which circuit D that changes a sigmoid function-like input/output characteristic is inserted between an input voltage and a stochastic circuit of a semiconductor device according to an example embodiment.
- FIG. 29 illustrates an example of a circuit that is implemented at the input of a circuit having a sigmoid function-like input/output characteristic and included in a semiconductor device according to a tenth example embodiment.
- FIG. 30 is a diagram illustrating an example of the configuration of a stochastic circuit constituting a circuit having a sigmoid function-like input/output characteristic and included in a semiconductor device according to an eleventh example embodiment.
- FIG. 31 is a diagram illustrating an example of the configuration of a semiconductor device according to a twelfth example embodiment.
- FIG. 7 is a diagram illustrating an example of the outline configuration of a circuit having a sigmoid function-like input/output characteristic and included in a semiconductor device according to an example embodiment.
- FIG. 8 is a diagram illustrating an output current at the time when an input voltage is constant, in the circuit having a sigmoid function-like input/output characteristic and included in the semiconductor device according to the example embodiment.
- the circuit having a sigmoid function-like input/output characteristic and included in the semiconductor device according to the present example embodiment has a configuration in which one or more A circuits (hereinafter referred to as stochastic circuits A) are connected in parallel to input voltage V in .
- stochastic means “probabilistic”.
- Each stochastic circuit A outputs output current i out in response to input voltage v in . As illustrated in FIG. 8 , output current i out relative to time t in each stochastic circuit A becomes a magnitude i H or i L .
- Each stochastic circuit A is defined as a circuit in which, in response to input voltage v in , a probability that i H or i L of output current i out is output is increased or decreased with a sigmoid function-like.
- Each stochastic circuit A which are connected in parallel to input voltage v in , operate independently.
- the output impedance of stochastic circuits A becomes sufficiently large or is designed in such a way as to also take finite output impedance into consideration.
- the circuit illustrated in FIG. 7 allows the reduction of noise due to probabilistic operation. Further, through the addition of output current i out of each stochastic circuit A, the circuit illustrated in FIG. 7 is capable of reducing the requirements for the temperature dependence and the circuit accuracy of an analog output.
- stochastic circuit A has a CMOS (Complementary MOS) configuration.
- CMOS Complementary MOS
- stochastic circuit A is configured to be capable of suppressing power consumption other than that at the time when output current i out is changed to an output level, such as i H or i L .
- FIG. 9 is a diagram illustrating an example of the configuration of a stochastic circuit constituting a circuit having a sigmoid function-like input/output characteristic and included in the semiconductor device according to the first example embodiment.
- Stochastic circuit A has a configuration such as illustrated in FIG. 9 .
- Stochastic circuit A includes circuit B (hereinafter referred to as bistable circuit B), a noise introduction unit that applies noise to bistable circuit B, and circuit C.
- circuit B has a stable state in which V H or V L is output as output voltage V out .
- output voltage V out is configured to transit between V H and V L states in response to noise applied from the noise introduction unit. Moreover, a probability that output voltage V out becomes V H or V L is configured to be capable of being controlled using external voltage (input voltage) V in . Further, circuit C is a circuit that converts a voltage into a current.
- output voltage V out of bistable circuit B relative to time t probabilistically outputs either voltage V H or V L in response to input voltage V in .
- Circuit c converts a voltage having been output from circuit B into a current.
- circuit C outputs current I H or I L .
- bistable circuit 8 can be represented by a dynamics system on the potential having been described in FIG. 6 .
- the dynamics system can stably exist at one minimum value ⁇ or at the other one minimum value ⁇ . It is assumed that bistable circuit B outputs V H in state ⁇ and V L in state ⁇ . When noise is applied in this state, the behavior of bistable circuit B allows its state to transit from ⁇ to ⁇ or from ⁇ to ⁇ at a constant probability.
- V in external voltage
- a characteristic (a nonlinear characteristic) in which, in response to input voltage V in , a probability that output voltage V out is V H or V L is changed with a sigmoid function-like can be obtained.
- FIG. 11 is a diagram illustrating an example of the configuration of a stochastic circuit constituting a circuit having a sigmoid function-like input/output characteristic and included in the semiconductor device according to the second example embodiment.
- bistable circuit B is configured by a flipflop circuit in which inverters are connected.
- bias voltage (input voltage) V in to inverter 1 or inverter 1 and inverter 2 , which is used in the flipflop circuit, the input/output characteristics of the inverters are changed, such as illustrated in FIG. 12 .
- FIG. 12 is a diagram illustrating an input/output characteristic of the inverters constituting the flipflop circuit of FIG. 11 .
- FIG. 13 is a diagram illustrating the flipflop circuit of FIG. 11 with the two-dimensional dynamics system.
- FIG. 13 Two individual full lines in FIG. 13 illustrate an input/output characteristic of inverter 1 and an input/output characteristic of inverter 2 .
- Cross points ⁇ and ⁇ of the two full lines are stable points, and cross point S is a saddle point.
- the saddle point means a point that is a maximum value when seen from a certain direction and that is a minimum value when seen from another direction.
- Output voltage V out of stable point ⁇ is Gnd (a ground voltage).
- Output voltage V out of stable point ⁇ becomes V dd (a power supply voltage of the inverters).
- a state in the vicinity of each stable point ( ⁇ , ⁇ ) becomes a state toward the each stable point.
- the stability can be determined at, for example, the position of the saddle point (cross point S). The nearer the saddle point (cross point S) is located, the lower the stability is.
- bias voltage (input voltage) V in of an inverter By changing bias voltage (input voltage) V in of an inverter, the position of the saddle point (cross point S) can be changed. That is, by changing input voltage V in , the stabilities of stable point ⁇ and stable point ⁇ can be changed. With this configuration, a probability that output voltage V out is output can be nonlinearly changed.
- a characteristic (a nonlinear characteristic) in which, in response to input voltage V in , a probability that output voltage V out outputs V dd is changed with a sigmoid function-like can be obtained.
- FIG. 15 is a diagram illustrating an example of the configuration of a bistable circuit constituting a circuit having a sigmoid function-like input/output characteristic and included in the semiconductor device according to the third example embodiment.
- bistable circuit B is configured using constant voltage source V pcas including a PMOS cascode and constant voltage source V ncas including an NMOS cascode.
- output voltage V out is Gnd (a ground voltage) or V dd (a power supply voltage), and results in a stable state. Further, as output voltage V out , Gnd (the ground voltage) or V dd (the power supply voltage) is probabilistically output by noise. Input voltage V in is directly connected to the bias input of one of invertors. Further, at this time, a probability that power supply voltage V dd is output is changed in response to input voltage V in . The probability that power supply voltage V dd is output is nonlinearly increased with a sigmoid function-like in response to input voltage V in .
- a characteristic (a nonlinear characteristic) in which, in response to input voltage V in , a probability that output voltage V out outputs V dd is changed with a sigmoid function-like can be obtained.
- FIG. 16 there is illustrated a simulation of the output voltage of the bistable circuit of FIG. 15 at the time when input voltage V in of the bistable circuit is changed.
- output voltages V out at the times when input voltage V in reaches approximately middle points within a range from 0 V to 1 V, namely, three points (0.45 V, 0.5 V, and 0.55 V) at which a state in which output voltage V out is rapidly changed within the range from 0 V to 1 V is significant are simulated using a circuit simulator Spectre, a product of Cadence company.
- FIG. 17 there is illustrated in FIG. 17 in which its horizontal axis corresponds to input voltage V in , and its vertical axis corresponds to an average value of output voltage V out of the bistable circuit of FIG. 15 at the time when input voltage V in of the bistable circuit is changed. It can be understood that the average value of output voltage V out has nonlinearity with a sigmoid function-like in response to input voltage V in .
- FIG. 18 there is illustrated in FIG. 18 in which its horizontal axis corresponds to input voltage V in , and its vertical axis corresponds to an average value of output voltage V out , the average value being represented as a temperature characteristic at the time when input voltage V in of the bistable circuit of FIG. 15 is changed.
- a full line represents a change at 17° C.
- a dotted line represents a change at 27° C.
- a dashed line represents a change at 37° C.
- the average value of output voltage V out is scarcely changed even the temperature is changed.
- the bistable circuit has high temperature stability.
- FIG. 19 is a diagram illustrating an example of the configuration of a stochastic circuit constituting a circuit having a sigmoid function-like input/output characteristic and included in the semiconductor device according to the fourth example embodiment, the stochastic circuit is configured by a flipflop circuit in which inverters are connected.
- bias voltage (input voltage) V in to inverter 3 , or inverter 3 and inverter 4 , the characteristics of the inverters are changed.
- the flipflop circuit is configured to allow inverter 3 , inverter 4 , or both of inverters 3 and 4 to, in each of two stable states of the flipflop, cause output current i out dependent on the stable state.
- FIG. 19 there is illustrated a configuration, as an example, in which both of input voltage V in and output current i out are connected to inverter 3 .
- the state of the flipflop circuit of FIG. 19 can be understood, just like the second example embodiment, with the two-dimensional dynamics system in which V out and V out (NOT) are handled as variables and which has stable points ( ⁇ , ⁇ ) and a saddle point (S) as illustrated in FIG. 13 .
- V out and V out NOT
- ⁇ , ⁇ stable points
- S saddle point
- V in bias voltage
- the input/output characteristic of the inverters is changed. That is, by changing the position of saddle point S in the dynamics system, the stabilities of stable point ⁇ and stable point ⁇ can be changed.
- the power consumption can be reduced.
- FIG. 22 is a diagram illustrating an example of the configuration of a stochastic circuit constituting a circuit having a sigmoid function-like input/output characteristic and included in the semiconductor device according to the fifth example embodiment, the stochastic circuit is configured by a flipflop circuit in which inverters are connected. One of the inverters is configured to allow an input voltage to be applied to its PMOS. An output current arises as an output current of the above inverter.
- the power consumption can be reduced.
- FIG. 23 there is illustrated a simulation of an average output voltage of the bistable circuit of FIG. 22 at the time when input voltage V in of the bistable circuit is changed.
- Output current results in the product of a probability that output voltage V out indicates V dd and an amount of leak current, and thus, by taking into consideration an influence exerted on input voltage V in by the leak current, a sigmoid function-like input/output characteristic can be obtained.
- FIG. 24 is a diagram illustrating an example of the configuration of a stochastic circuit constituting a circuit having a sigmoid function-like input/output characteristic and included in the semiconductor device according to the sixth example embodiment, the stochastic circuit is configured by a flipflop circuit in which inverters are connected. Input voltage V in and output current i out are each connected to different inverters, respectively and bias voltage V b for adjusting the magnitude of output current i out is connected to the gate voltage of PMOS of an inverter through which output current i out flows.
- V out probabilistically indicates Gnd or V dd by noise, and when V out indicates V dd , output current i out becomes high. Further, a probability that V out indicates V dd is changed with a sigmoid function-like by changing the stability of the flipflop circuit using input voltage V in . Further, the magnitude of output current i out is adjusted by bias voltage V b .
- any sigmoid function-like input/output characteristic can be obtained because a probability that the output current becomes high can be changed by the input voltage and further the magnitude of the output current can be changed by bias voltage V b .
- FIG. 25 is a diagram illustrating an example of the configuration of a stochastic circuit having a sigmoid function-like input/output characteristic and included in the semiconductor device according to the seventh example embodiment.
- the present example embodiment has a configuration in which leak element (leak) is connected to a flipflop circuit in such a way as to interconnect V out and V out (NOT). Further, leak element leak is configured to be capable of adjusting the magnitude of the leak current using leak adjustment voltage V leak .
- transition probabilities between stable points depend on the magnitude of noise, but the transition probabilities between stable points can be changed by leak adjustment voltage V leak . Accordingly, it becomes possible to operate the transition probabilities between stable points constant under various noise conditions.
- FIG. 26 is a diagram illustrating an example of the configuration of a stochastic circuit constituting a circuit having a sigmoid function-like input/output characteristic and included in the semiconductor device according to the eighth example embodiment.
- the present example embodiment has a configuration in which leak element leak used in the above configuration of the seventh example embodiment is implemented by a MOSFET.
- the leak element is an NMOS
- a leak current flowing through the NMOS is increased as leak adjustment voltage V leak is increased.
- the stability of the flipflop becomes worse, and the probabilities of transitions between the two stable states become large.
- Resistance to noise can be adjusted by leak adjustment voltage V leak , and thus, the circuit can be driven under various noise conditions.
- FIG. 27 there is illustrated a result of a simulation of output voltage V out at the time when leak adjustment voltage V leak is changed from 350 mV to 400 mV.
- FIG. 28 illustrates an example of the configuration in which circuit D that changes a sigmoid function-like input/output characteristic is inserted between input voltage V in and stochastic circuit A in FIG. 7 , in which the fundamental configuration is illustrated.
- Input voltage V in is input to circuit D
- output voltage V′ in of circuit D is input to stochastic circuit A.
- Input voltage V in and output voltage V′ in of circuit D have a relationship, such as numerical expression 3 described below.
- v′ in ⁇ ( v in ⁇ ) Numerical Expression 3
- ⁇ 0 and ⁇ 0 are arbitrarily defined constants.
- an input/output characteristic of a sigmoid function in stochastic circuit A such as numerical expression 4 described below
- a function of input voltage V in of circuit D such as numerical expression 5 described below.
- Various sigmoid function shapes can be implemented by inserting circuit D that changes a sigmoid function-like input/output characteristic, between input voltage V in and stochastic circuit A.
- various silicon neuron circuits can be produced by implementing various sigmoid function shapes.
- FIG. 29 illustrates an example of a circuit that is implemented as circuit D having been described in the above ninth example embodiment, in such a way as to allow the input of capacitor C 1 to correspond to input voltage V in of circuit D, and allow the output of a voltage division circuit including capacitor C 1 and capacitor C 2 to correspond to input voltage V′ in of stochastic circuit A.
- Circuit D including capacitor C 1 and capacitor C 2 has a relationship between input voltage V in and output voltage V′ in (the input voltage of stochastic circuit A), such as numerical expression 6 described below.
- Circuit D is composed of a voltage dividing circuit using capacitors. Thus, power consumption loss along with the leak of a direct current can be reduced as much as possible. Further, the form of a circuit for the sigmoid function can be changed.
- FIG. 30 illustrates an example of a circuit in which circuit C having been described in the above first example embodiment ( FIG. 9 ) includes a MOSFET. Specifically, output voltage V out of bistable circuit B is connected to the gate terminal of the MOSFET; output current I out of circuit C is connected to the source terminal of the MOSFET; and power supply voltage V dd is connected to the drain terminal.
- output voltage V out By making output voltage V out having been output from bistable circuit B a gate voltage of the MOSFET, when output voltage V out is power supply voltage V dd , output current I out flows from the source terminal of the MOSFET. When output voltage V out is Gnd (the ground voltage), output current I out does not flow from the source terminal of the MOSFET.
- Output voltage V out is an on/off signal of power supply voltage V dd and Gnd (the ground voltage). Thus, even though output current I out flowing through the MOSFET has no linearity relative to the gate voltage, output current I out dependent on an average voltage of output voltage V out can be obtained.
- This circuit can be implemented using a simple configuration.
- FIG. 31 is a diagram illustrating an example of the configuration of semiconductor device according to the twelfth example embodiment.
- semiconductor device 10 includes input unit 1 , stochastic circuit unit 2 , and current output unit 3 .
- Input unit 1 is a unit to which a voltage is applied from the outside.
- Current output unit 3 is a unit that outputs a high level current (i H ) or a low level current (i L ) in response to the voltage applied to input unit 1 .
- Stochastic circuit unit 2 is a unit that, in response to the voltage applied to input unit 1 , changes a probability that the high level current (i H ) or the low level current (i L ) is output from current output unit 3 , in accordance with a sigmoid function that is used in a mathematical model of a neural activity, and the like.
- bistable circuit B constituting stochastic circuit A has a digital circuit configuration in which output voltage V out transits between two stable states, such as a high level voltage (V H ) and a low level voltage (V L ). For this reason, a high degree of integration, which is a merit of digital circuits, can be achieved. Further, the temperature dependency can be eliminated, like the case of digital circuits.
- stochastic circuit A has a CMOS configuration. With this configuration, power consumption can be further reduced, as compared with a bipolar transistor circuit.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Biomedical Technology (AREA)
- Health & Medical Sciences (AREA)
- Biophysics (AREA)
- Life Sciences & Earth Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Mathematical Physics (AREA)
- General Physics & Mathematics (AREA)
- Neurology (AREA)
- Data Mining & Analysis (AREA)
- Power Engineering (AREA)
- Computing Systems (AREA)
- General Engineering & Computer Science (AREA)
- Evolutionary Computation (AREA)
- Computational Linguistics (AREA)
- Software Systems (AREA)
- Molecular Biology (AREA)
- Artificial Intelligence (AREA)
- Computer Hardware Design (AREA)
- Physiology (AREA)
- Neurosurgery (AREA)
- Logic Circuits (AREA)
- Semiconductor Integrated Circuits (AREA)
Abstract
Description
- Patent Document 1: JP2016-051491A
- Non-patent Document 1: T. Kohno and K. Aihara, “A qualitative-modeling-based low power silicon nerve membrane”, International Conference on Electronics, Circuits and Systems, ICECS (2014).
- Non-Patent Document 2: K. Murali, et al., “Reliable logic circuit elements that exploit nonlinearity in the Presence of a Noise Floor”, Phys. Rev. Lett. 102, 104101 (2009).
v′ in=α(v in−β)
(Effect)
(Effect)
-
- 1 input unit
- 2 stochastic circuit unit
- 3 current output unit
- 10 semiconductor device
- Vdd power supply voltage
- Gnd ground voltage
- Vin, vin input voltage
- Vout, vout output voltage
- Iout, iout output current
Claims (10)
v′ in=α(v in−β) Numerical Expression 1
Applications Claiming Priority (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JPJP2017-077164 | 2017-04-07 | ||
| JP2017-077164 | 2017-04-07 | ||
| JP2017077164 | 2017-04-07 | ||
| PCT/JP2018/014251 WO2018186390A1 (en) | 2017-04-07 | 2018-04-03 | Semiconductor device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| US20200034577A1 US20200034577A1 (en) | 2020-01-30 |
| US11468248B2 true US11468248B2 (en) | 2022-10-11 |
Family
ID=63713088
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US16/500,996 Active 2039-11-10 US11468248B2 (en) | 2017-04-07 | 2018-04-03 | Semiconductor device |
Country Status (3)
| Country | Link |
|---|---|
| US (1) | US11468248B2 (en) |
| JP (1) | JPWO2018186390A1 (en) |
| WO (1) | WO2018186390A1 (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP7438994B2 (en) * | 2021-01-07 | 2024-02-27 | 株式会社東芝 | Neural network device and learning method |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH02287670A (en) | 1989-04-27 | 1990-11-27 | Mitsubishi Electric Corp | semiconductor neural network |
| US5148514A (en) * | 1989-05-15 | 1992-09-15 | Mitsubishi Denki Kabushiki Kaisha | Neural network integrated circuit device having self-organizing function |
| JPH0793277A (en) | 1993-09-24 | 1995-04-07 | Nec Corp | Semiconductor integrated circuit device using neural network |
| JPH1065124A (en) | 1996-06-10 | 1998-03-06 | Hitachi Ltd | Semiconductor integrated circuit device |
| JP2001034735A (en) | 2000-01-01 | 2001-02-09 | Hitachi Ltd | Information processing device |
| JP2005245177A (en) | 2004-02-27 | 2005-09-08 | Fuji Xerox Co Ltd | High-voltage power unit |
| JP2008034667A (en) | 2006-07-31 | 2008-02-14 | Renesas Technology Corp | Semiconductor integrated circuit device |
| JP2016051811A (en) | 2014-08-29 | 2016-04-11 | 株式会社日立製作所 | Semiconductor device and quality control method thereof |
| JP2016051491A (en) | 2014-08-29 | 2016-04-11 | 株式会社日立製作所 | Semiconductor device |
| US10732933B2 (en) * | 2018-05-10 | 2020-08-04 | Sandisk Technologies Llc | Generating random bitstreams with magnetic tunnel junctions |
-
2018
- 2018-04-03 US US16/500,996 patent/US11468248B2/en active Active
- 2018-04-03 JP JP2019511256A patent/JPWO2018186390A1/en active Pending
- 2018-04-03 WO PCT/JP2018/014251 patent/WO2018186390A1/en not_active Ceased
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH02287670A (en) | 1989-04-27 | 1990-11-27 | Mitsubishi Electric Corp | semiconductor neural network |
| US5148514A (en) * | 1989-05-15 | 1992-09-15 | Mitsubishi Denki Kabushiki Kaisha | Neural network integrated circuit device having self-organizing function |
| JPH0793277A (en) | 1993-09-24 | 1995-04-07 | Nec Corp | Semiconductor integrated circuit device using neural network |
| JPH1065124A (en) | 1996-06-10 | 1998-03-06 | Hitachi Ltd | Semiconductor integrated circuit device |
| JP2001034735A (en) | 2000-01-01 | 2001-02-09 | Hitachi Ltd | Information processing device |
| JP2005245177A (en) | 2004-02-27 | 2005-09-08 | Fuji Xerox Co Ltd | High-voltage power unit |
| JP2008034667A (en) | 2006-07-31 | 2008-02-14 | Renesas Technology Corp | Semiconductor integrated circuit device |
| JP2016051811A (en) | 2014-08-29 | 2016-04-11 | 株式会社日立製作所 | Semiconductor device and quality control method thereof |
| JP2016051491A (en) | 2014-08-29 | 2016-04-11 | 株式会社日立製作所 | Semiconductor device |
| US10732933B2 (en) * | 2018-05-10 | 2020-08-04 | Sandisk Technologies Llc | Generating random bitstreams with magnetic tunnel junctions |
Non-Patent Citations (3)
| Title |
|---|
| International Search Report of PCT/JP2018/014251 dated Jun. 12, 2018. |
| K. Murali et al., "Reliable Logic Circuit Elements that Exploit Nonlinearity in the Presence of a Noise Floor," Physical Review Letters, Mar. 13, 2009, pp. 104101-1-104101-4, vol. 102. |
| Takashi Kohno et al., "A Qualitative-Modeling-Based Low-Power Silicon Nerve Membrane," International Conference on Electronics, Circuits and Systems, ICECS, 2014, pp. 199-202. |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2018186390A1 (en) | 2018-10-11 |
| US20200034577A1 (en) | 2020-01-30 |
| JPWO2018186390A1 (en) | 2020-05-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8275728B2 (en) | Neuromorphic computer | |
| US10606300B2 (en) | Methods and apparatuses including a process, voltage, and temperature independent current generator circuit | |
| Diorio et al. | A floating-gate MOS learning array with locally computed weight updates | |
| TWI252946B (en) | Level shifter having low peak current | |
| US10818333B2 (en) | Circuitry for one-transistor synapse cell and operation method of the same | |
| US5706403A (en) | Semiconductor neural circuit device | |
| US10741611B1 (en) | Resistive processing units with complementary metal-oxide-semiconductor non-volatile analog memory | |
| CN101989842A (en) | Operational amplifier and semiconductor device using the same | |
| US12093342B2 (en) | Dynamic bias analog vector-matrix multiplication operation circuit and operation control method therefor | |
| Hsu et al. | Competitive learning with floating-gate circuits | |
| Lu et al. | A floating-gate analog memory with bidirectional sigmoid updates in a standard digital process | |
| US11468248B2 (en) | Semiconductor device | |
| CN1720661B (en) | differential circuit | |
| JPS6070591A (en) | Sense amplifier | |
| US20250165023A1 (en) | Bias voltage generating device and operating method | |
| US20150236579A1 (en) | Current generation circuits and semiconductor devices including the same | |
| JP3948446B2 (en) | Semiconductor device | |
| KR20080102950A (en) | Voltage Follower Circuit Driven at Low Voltage | |
| US12430548B2 (en) | Variable sensitivity node | |
| US11050397B2 (en) | Interpolation operational amplifier circuit and display panel | |
| US20160071559A1 (en) | Data readout circuit | |
| US11782680B2 (en) | Arithmetic logic unit, multiply-accumulate operation device, multiply-accumulate operation circuit, and multiply-accumulate operation system | |
| US20250292075A1 (en) | Non-linear current attenuation in neural networks | |
| EP3680825A1 (en) | Random weight generating circuit | |
| US9906195B2 (en) | High bandwidth amplifier |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| AS | Assignment |
Owner name: NEC CORPORATION, JAPAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:SAKEMI, YUSUKE;KOHNO, TAKASHI;REEL/FRAME:050629/0389 Effective date: 20190904 Owner name: THE UNIVERSITY OF TOKYO, JAPAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:SAKEMI, YUSUKE;KOHNO, TAKASHI;REEL/FRAME:050629/0389 Effective date: 20190904 |
|
| FEPP | Fee payment procedure |
Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT RECEIVED |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED |
|
| STCF | Information on status: patent grant |
Free format text: PATENTED CASE |