EP2384488B1 - Electronic learning synapse with spike-timing dependent plasticity using memory-switching elements - Google Patents

Electronic learning synapse with spike-timing dependent plasticity using memory-switching elements Download PDF

Info

Publication number
EP2384488B1
EP2384488B1 EP10717576.2A EP10717576A EP2384488B1 EP 2384488 B1 EP2384488 B1 EP 2384488B1 EP 10717576 A EP10717576 A EP 10717576A EP 2384488 B1 EP2384488 B1 EP 2384488B1
Authority
EP
European Patent Office
Prior art keywords
synaptic
voltage
post
pulse
terminal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP10717576.2A
Other languages
German (de)
English (en)
French (fr)
Other versions
EP2384488A1 (en
Inventor
Rohit Sudhir SHENOY
Dharmendra Shantilal Modha
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
International Business Machines Corp
Original Assignee
International Business Machines Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by International Business Machines Corp filed Critical International Business Machines Corp
Publication of EP2384488A1 publication Critical patent/EP2384488A1/en
Application granted granted Critical
Publication of EP2384488B1 publication Critical patent/EP2384488B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/049—Temporal neural networks, e.g. delay elements, oscillating neurons or pulsed inputs
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/06—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons
    • G06N3/063—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons using electronic means
    • G06N3/065—Analogue means
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/088—Non-supervised learning, e.g. competitive learning

Definitions

  • the present invention relates to artificial neural networks, and more specifically, to electronic learning synapses with spike-dependent plasticity.
  • the point of contact between an axon of a neuron and a dendrite on another neuron is called a synapse, and with respect to the synapse, the two neurons are respectively called pre-synaptic and post-synaptic.
  • the essence of our individual experiences is stored in conductance of the synapses.
  • the synaptic conductance changes with time as a function of the relative spike times of pre- and post-synaptic neurons as per spike-timing dependent plasticity (STDP).
  • the STDP rule increases the conductance of a synapse if its post-synaptic neuron fires after its pre-synaptic neuron fires, and decreases the conductance of a synapse if the order of two firings is reversed. Further, the change depends on the precise delay between the two events: the more the delay, the less the magnitude of change.
  • Artificial neural networks are computational systems that permit computers to essentially function in a manner analogous to that of biological brains. Artificial neural networks do not utilize the traditional digital model of manipulating 0s and Is. Instead, they create connections between processing elements, which are equivalent to neurons of a human brain. Artificial neural networks may be based on various electronic circuits that are modeled on neurons.
  • phase change memory is described in Matthew J Breitwisch Ed - Akio Kawabata et al: "Phase Change Memory Interconnect Technology Conference, 2008. IITC 2008. International, IEEE, Piscataway, NJ, USA, 1 June 2008, pages 219-221, XP031274544ISBN: 978-1-4244-1911-1 .
  • an apparatus comprising: a uni-polar, two-terminal bi-stable device connected to a pre-synaptic terminal; a diode having first and second ends, the diode connected at the first end to said bi-stable device and connected at the second end to a post-synaptic terminal; and at least one pulse shaper element generating a series of voltage pulses to said pre-synaptic and post-synaptic terminals, wherein in response to a received pre-synaptic spike, said pulse shaper element generates a pulse at said pre-synaptic terminal that occurs a predetermined period of time after said received pre-synaptic spike, and wherein in response to a post-synaptic spike, said pulse shaper element generates a pulse at said post-synaptic terminal that starts at a baseline value and reaches a first voltage value a first period of time after said post-synaptic spike, followed
  • a computer program product for performing the aforementioned method.
  • Embodiments of the invention provide a system, method and computer readable medium for electronic learning synapses with spike-dependent plasticity using memory switching elements.
  • the term "neuron” was coined by Heinrich Wilhelm Gottfried von Waldeyer-Hartz in 1891 to capture the discrete information processing units of the brain.
  • the junctions between two neurons were termed “synapses” by Sir Charles Sherrington in 1897. Information flows only along one direction through a synapse, thus we talk about a "pre-synaptic” and a "post-synaptic” neuron.
  • Neurons when activated by sufficient input received via synapses, emit “spikes” that are delivered to those synapses that the neuron is pre-synaptic to. Neurons can be either “excitatory” or “inhibitory.”
  • a brain can be thought of as a directed graph where nodes are neurons and edges are synapses.
  • the following table shows the rough number of neurons and synapses in a mouse, rat, and human. Each neuron in mammalian cortex makes roughly 8,000 synapses with other neurons.
  • the computation, communication, and memory resources of the brain all scale with the number of synapses and not with the number of neurons. Even power and space requirements scale as number of synapses.
  • synapses Some of the physical characteristics of the synapses are as follows. Synaptic density is roughly 7.2 x 10 8 per mm 3 which roughly corresponds to placing synapses at a three dimensional grid with 1 ⁇ m spacing in every direction. This figure seems to be a constant of nature across all mammalian cortices.
  • Synaptic weight is the influence that a pre-synaptic firing will have on post-synaptic neuron.
  • Synaptic weights are plastic or adaptive, and change through time. Synaptic weight exhibits two forms of plasticity: (a) Long-term and (b) Short-term. Long-term changes in the transmission properties of synapses provide a physiological substrate for learning and memory, whereas short-term changes support a variety of computations. The mechanism of short-term plasticity is a form of gain control, and is not treated in this disclosure. The mechanism of long-term weight adaptation is known as spike-timing dependent plasticity (STDP).
  • STDP spike-timing dependent plasticity
  • Causality is a key element of STDP. Correlated activity can occur purely by chance, rather than reflecting a causal relationship that should be learned.
  • STDP can be summarized as follows: if the post-synaptic neuron fires within a short time of the pre-synaptic neuron, then synapse is turned fully ON, whereas if the pre-synaptic neuron fires within a short time of the post-synaptic neuron, then synapse is turned fully OFF.
  • the STDP rule permits the brain to extract causality and correlations from a spatio-temporally varying environment.
  • a key characteristic of classical von Neumann computing is the separation of computation and memory. Specifically, if a memory location is to be modified, it is brought into a separate computing unit, modified, and then restored. This three-step process creates the classical von Neumann bottleneck that has plagued modern computer systems. In contrast to von Neumann computing, synapses are memory elements that are modified in-place, that is, memory and computation are distributed in the brain.
  • embodiments of the present invention include a device that exhibits synapse-like function.
  • embodiments make use of a memory-switching element whose program and erase operations can be accomplished with the same voltage polarity.
  • a memory-switching element whose program and erase operations can be accomplished with the same voltage polarity.
  • An example of such a device is a phase-change memory (PCM), which in this case is a uni-polar, two-terminal, bi-stable device.
  • PCM phase-change memory
  • a phase-change memory device can be switched as follows: a lower voltage (current) pulse to program or set (that is, go from low conductance amorphous state to high conductance crystalline state) and a higher voltage (current) pulse to erase or reset (that is, go from high conductance to low conductance state).
  • Embodiments of the invention make use of novel bipolar pre and post-synaptic pulses that can capture the essence of STDP in such materials. Specifically, by using the PCM device in series with a diode, these novel pre and post-synaptic pulses can be shaped to program the device if the post-synaptic pulse follows the pre-synaptic pulse within 100 ms, or erase the device if the pre-synaptic pulse follows the post-synaptic pulse within 100 ms. While the disclosed embodiments may not permit multiple conductance states, they can reward causality and punish anti-causality in a STDP-like way. Embodiments of the present invention disclose a synapse-like device, which breaks the mold of traditional computing by creating a form of active memory.
  • FIG. 1 shows a schematic of the artificial synapse system 10 which consists of an artificial binary synapse 12, and a two terminal PCM device 14 in series with a diode 16.
  • the artificial binary synapse 12 includes a pre-synaptic node 18 and a post-synaptic node 20.
  • a pulse shaper unit 22 has a pre-synaptic output 24 connected to the pre-synaptic node 18 and a post-synaptic output connected to the post-synaptic node 20.
  • the pulse shaper unit 22 includes a pre-synaptic spike input 24 and a post-synaptic spike input 26.
  • the pulse shaper unit 22 receives pre-synaptic and post-synaptic spikes at its two inputs 24, 26 respectively, and transforms them into pre-synaptic and post-synaptic input pulses as described below and shown in FIGs. 2-6 .
  • separate electronic devices or components may be employed in the place of the single pulse shaper unit 22: one receiving the pre-synaptic spike and one receiving the post-synaptic spike.
  • RESET high conductance crystalline
  • the diode 16 is assumed to have the following property. Voltages ⁇ 0.7V applied between the anode and cathode will not result in any current being passed. Voltages > 0.7V will result in the diode turning on with low resistance. A negligible amount of voltage is assumed to drop across the diode in its turned-on state. Thus the diode serves as a voltage level shifter for all voltages > 0.7 V.
  • the pulse shaper unit 22 transforms the raw pre-synaptic and post-synaptic spikes received at its inputs 24, 26 into specially shaped pulses that are shown in FIG. 2 . In some embodiments, the pulse shaper unit 22 could be shared among many synapses similar to synapse 12 in order to reduce overall area consumption.
  • the pulse shaper unit 22 generates the pre-synaptic pulse shown in FIG. 2 , which is essentially a 1.5V spike of very narrow width (e.g., 10-100 nsec) and is triggered 100 ms after the arrival of the original pre-synaptic spike received at its input 24.
  • the pulse shaper unit 22 also generates a post-synaptic pulse which has two parts: a -0.3V level voltage triggered a few ms (e.g., 5 ms) after the arrival of the original post-synaptic spike at post-synaptic input 26 followed by a -0.6V level voltage 100 ms after the arrival of the original post-synaptic spike.
  • This -0.6V level voltage relaxes back to 0V in a time slightly shorter than 100 ms (95 ms in this example).
  • zero (0) V is applied to both the pre-synaptic and post-synaptic nodes 18, 20 of the artificial binary synapse 12 shown in FIG. 1 .
  • the effective voltages that develop across the artificial binary synapse 12 and the PCM device 14 are shown in FIG. 3 .
  • the main purpose of the diode 16 is apparent. By rectifying the current that could potentially flow through the synapse, the energy dissipated per synaptic operation is greatly reduced since current flows for 10-100 ns, instead of ⁇ 200 ms.
  • FIG. 7 is a flowchart of a process 30 for causing an artificial synapse, such as the artificial synapse 12, to exhibit STDP-like behavior in accordance with an embodiment of the invention.
  • a pre-synaptic spike is received at input 24.
  • a post-synaptic spike is received at input 26.
  • a pre-synaptic pulse is generated by the pulse shaper unit 22 a predetermined period of time after the pre-synaptic spike, in block 36.
  • a post-synaptic pulse is generated by the pulse shaper unit 22 having multiple voltage levels at specified times, in block 38. In particular, this may comprise the post-synaptic pulse shown in FIG. 2 .
  • the generated pre-synaptic pulse is applied to a pre-synaptic node of a synaptic device, such as device 12.
  • the generated post-synaptic pulse is applied to a post-synaptic node of a synaptic device, such as device 12.
  • the full width half maximum (FWHM) of the one of the voltage pulses is shorter in duration than the FWHM of the other of the voltage pulses by at least a factor of 1000.
  • the shapes of the pre-synaptic and post-synaptic pulses may be switched and the resulting pre-synaptic pulse may be reflected around the y-axis.
  • a pre-synaptic pulse in response to the pre-synaptic spike, is generated that starts at a baseline level and reaches a first voltage level a first period of time after the pre-synaptic spike, followed by a second voltage level a second period of time after the pre synaptic spike, followed by a return to the baseline voltage a third period of time after the pre-synaptic spike.
  • a post-synaptic pulse is generated that occurs a predetermined period of time after the received post-synaptic spike.
  • devices which are not uni-polar may be used; however, the pulses may need to be modified.
  • devices other than two-terminal bi-stable PCM devices may be used.
  • devices other than PCM devices may be used, which have the property that their resistance can be changed as a function of the voltage applied across it, or as a function of the current running through it.
  • the present invention may be used in a variety of architectures for various purposes, such as to form spatio-temporal associations between a neural network and environmental events.
  • One such example may be to embed the present invention in a cross bar array that forms a set of synapses connected to a set of neurons in an artificial neural network.
  • the artificial synapse 10 in FIG. 1 may be connected at the junction of the vertical and horizontal bars of the cross-bar array.
  • the vertical bars may be pre-synaptic wires connected to the pre-synaptic input 24 and the horizontal bars may be post-synaptic wires connected to the post-synaptic input 26 shown in FIG. 1 .
  • embodiments of the invention provide an electronic learning synapse with STDP plasticity using memory-switching elements.
  • the present invention may be embodied as a system, method or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment (including firmware, resident software, micro-code, etc.) or an embodiment combining software and hardware aspects that may all generally be referred to herein as a "circuit,” "module” or "system.”
  • the present invention may take the form of a computer program product embodied in any tangible medium of expression having computer usable program code embodied in the medium. Any combination of one or more computer usable or computer readable medium(s) may be utilized.
  • the computer-usable or computer-readable medium may be, for example but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, device, or propagation medium.
  • the computer-readable medium include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CDROM), an optical storage device, a transmission media such as those supporting the Internet or an intranet, or a magnetic storage device.
  • the computer-usable or computer-readable medium could even be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, for instance, via optical scanning of the paper or other medium, then compiled, interpreted, or otherwise processed in a suitable manner, if necessary, and then stored in a computer memory.
  • a computer-usable or computer-readable medium may be any medium that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device.
  • the computer-usable medium may include a propagated data signal with the computer-usable program code embodied therewith, either in baseband or as part of a carrier wave.
  • the computer usable program code may be transmitted using any appropriate medium, including but not limited to wireless, wire line, optical fiber cable, and/or RF, etc.
  • Computer program code for carrying out operations of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C++ or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages.
  • the program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server.
  • the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet Service Provider).
  • LAN local area network
  • WAN wide area network
  • Internet Service Provider for example, AT&T, MCI, Sprint, EarthLink, MSN, GTE, etc.
  • These computer program instructions may also be stored in a computer-readable medium that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable medium produce an article of manufacture including instruction means which implement the function/act specified in the flowchart and/or block diagram block or blocks.
  • the computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.
  • each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s).
  • the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved.
  • FIG. 8 is a high level block diagram showing an information processing system useful for implementing one embodiment of the present invention.
  • the computer system includes one or more processors, such as processor 102.
  • the processor 102 is connected to a communication infrastructure 104 (e.g., a communications bus, cross-over bar, or network).
  • a communication infrastructure 104 e.g., a communications bus, cross-over bar, or network.
  • the computer system can include a display interface 106 that forwards graphics, text, and other data from the communication infrastructure 104 (or from a frame buffer not shown) for display on a display unit 108.
  • the computer system also includes a main memory 110, preferably random access memory (RAM), and may also include a secondary memory 112.
  • the secondary memory 112 may include, for example, a hard disk drive 114 and/or a removable storage drive 116, representing, for example, a floppy disk drive, a magnetic tape drive, or an optical disk drive.
  • the removable storage drive 116 reads from and/or writes to a removable storage unit 118 in a manner well known to those having ordinary skill in the art.
  • Removable storage unit 118 represents, for example, a floppy disk, a compact disc, a magnetic tape, or an optical disk, etc. which is read by and written to by removable storage drive 116.
  • the removable storage unit 118 includes a computer readable medium having stored therein computer software and/or data.
  • the secondary memory 112 may include other similar means for allowing computer programs or other instructions to be loaded into the computer system.
  • Such means may include a removable storage unit 120 and an interface 122.
  • Other examples of such means may include a program cartridge and cartridge interface (such as that found in video game devices), a removable memory chip (such as an EPROM, or PROM) and associated socket, and other removable storage units 120 and interfaces 122 which allow software and data to be transferred from the removable storage unit 120 to the computer system.
  • the computer system may also include a communications interface 124.
  • Communications interface 124 allows software and data to be transferred between the computer system and external devices. Examples of communications interface 124 may include a modem, a network interface (such as an Ethernet card), a communications port, or a PCMCIA slot and card, etc.
  • Software and data transferred via communications interface 124 are in the form of signals which may be, for example, electronic, electromagnetic, optical, or other signals capable of being received by communications interface 124. These signals are provided to communications interface 124 via a communications path (i.e., channel) 126.
  • This communications path 126 carries signals and may be implemented using wire or cable, fiber optics, a phone line, a cellular phone link, an RF link, and/or other communications channels.
  • computer program medium “computer usable medium,” and “computer readable medium” are used to generally refer to media such as main memory 110 and secondary memory 112, removable storage drive 116, and a hard disk installed in hard disk drive 114.
  • Computer programs are stored in main memory 110 and/or secondary memory 112. Computer programs may also be received via communications interface 124. Such computer programs, when executed, enable the computer system to perform the features of the present invention as discussed herein. In particular, the computer programs, when executed, enable the processor 102 to perform the features of the computer system. Accordingly, such computer programs represent controllers of the computer system.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Evolutionary Computation (AREA)
  • General Engineering & Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Artificial Intelligence (AREA)
  • General Health & Medical Sciences (AREA)
  • Molecular Biology (AREA)
  • Computing Systems (AREA)
  • Computational Linguistics (AREA)
  • General Physics & Mathematics (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • Neurology (AREA)
  • Semiconductor Memories (AREA)
  • User Interface Of Digital Computer (AREA)
EP10717576.2A 2009-05-21 2010-04-09 Electronic learning synapse with spike-timing dependent plasticity using memory-switching elements Active EP2384488B1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US12/470,403 US8250010B2 (en) 2009-05-21 2009-05-21 Electronic learning synapse with spike-timing dependent plasticity using unipolar memory-switching elements
PCT/EP2010/054719 WO2010133401A1 (en) 2009-05-21 2010-04-09 Electronic learning synapse with spike-timing dependent plasticity using memory-switching elements

Publications (2)

Publication Number Publication Date
EP2384488A1 EP2384488A1 (en) 2011-11-09
EP2384488B1 true EP2384488B1 (en) 2013-06-19

Family

ID=42289016

Family Applications (1)

Application Number Title Priority Date Filing Date
EP10717576.2A Active EP2384488B1 (en) 2009-05-21 2010-04-09 Electronic learning synapse with spike-timing dependent plasticity using memory-switching elements

Country Status (6)

Country Link
US (2) US8250010B2 (zh)
EP (1) EP2384488B1 (zh)
JP (1) JP5420067B2 (zh)
CN (1) CN102341815B (zh)
TW (1) TWI509537B (zh)
WO (1) WO2010133401A1 (zh)

Families Citing this family (96)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8812418B2 (en) * 2009-06-22 2014-08-19 Hewlett-Packard Development Company, L.P. Memristive adaptive resonance networks
US9122994B2 (en) 2010-03-26 2015-09-01 Brain Corporation Apparatus and methods for temporally proximate object recognition
US9311593B2 (en) 2010-03-26 2016-04-12 Brain Corporation Apparatus and methods for polychronous encoding and multiplexing in neuronal prosthetic devices
US9405975B2 (en) 2010-03-26 2016-08-02 Brain Corporation Apparatus and methods for pulse-code invariant object recognition
US8467623B2 (en) 2010-03-26 2013-06-18 Brain Corporation Invariant pulse latency coding systems and methods systems and methods
US9129220B2 (en) * 2010-07-07 2015-09-08 Qualcomm Incorporated Methods and systems for digital neural processing with discrete-level synapes and probabilistic STDP
US9152915B1 (en) 2010-08-26 2015-10-06 Brain Corporation Apparatus and methods for encoding vector into pulse-code output
US8942466B2 (en) 2010-08-26 2015-01-27 Brain Corporation Sensory input processing apparatus and methods
US20120084240A1 (en) * 2010-09-30 2012-04-05 International Business Machines Corporation Phase change memory synaptronic circuit for spiking computation, association and recall
US9269042B2 (en) 2010-09-30 2016-02-23 International Business Machines Corporation Producing spike-timing dependent plasticity in a neuromorphic network utilizing phase change synaptic devices
JP5656202B2 (ja) * 2010-10-18 2015-01-21 国立大学法人大阪大学 特徴抽出装置、特徴抽出方法、及び、そのプログラム
US8812414B2 (en) 2011-05-31 2014-08-19 International Business Machines Corporation Low-power event-driven neural computing architecture in neural networks
US9070039B2 (en) 2013-02-01 2015-06-30 Brian Corporation Temporal winner takes all spiking neuron network sensory processing apparatus and methods
US9147156B2 (en) 2011-09-21 2015-09-29 Qualcomm Technologies Inc. Apparatus and methods for synaptic update in a pulse-coded network
US9047568B1 (en) 2012-09-20 2015-06-02 Brain Corporation Apparatus and methods for encoding of sensory data using artificial spiking neurons
KR101888468B1 (ko) 2011-06-08 2018-08-16 삼성전자주식회사 Ｓｔｄｐ 기능 셀을 위한 시냅스, ｓｔｄｐ 기능 셀 및 ｓｔｄｐ 기능 셀을 이용한 뉴로모픽 회로
FR2977351B1 (fr) 2011-06-30 2013-07-19 Commissariat Energie Atomique Methode d'apprentissage non supervise dans un reseau de neurones artificiel a base de nano-dispositifs memristifs et reseau de neurones artificiel mettant en oeuvre la methode.
FR2977350B1 (fr) 2011-06-30 2013-07-19 Commissariat Energie Atomique Reseau de neurones artificiels a base de dispositifs memristifs complementaires
US9053428B2 (en) 2011-07-21 2015-06-09 Qualcomm Incorporated Method and apparatus of robust neural temporal coding, learning and cell recruitments for memory using oscillation
US8843425B2 (en) * 2011-07-29 2014-09-23 International Business Machines Corporation Hierarchical routing for two-way information flow and structural plasticity in neural networks
US9147155B2 (en) 2011-08-16 2015-09-29 Qualcomm Incorporated Method and apparatus for neural temporal coding, learning and recognition
US9104973B2 (en) 2011-09-21 2015-08-11 Qualcomm Technologies Inc. Elementary network description for neuromorphic systems with plurality of doublets wherein doublet events rules are executed in parallel
US8719199B2 (en) 2011-09-21 2014-05-06 Brain Corporation Systems and methods for providing a neural network having an elementary network description for efficient implementation of event-triggered plasticity rules
US9460387B2 (en) * 2011-09-21 2016-10-04 Qualcomm Technologies Inc. Apparatus and methods for implementing event-based updates in neuron networks
US8725662B2 (en) 2011-09-21 2014-05-13 Brain Corporation Apparatus and method for partial evaluation of synaptic updates based on system events
US8725658B2 (en) 2011-09-21 2014-05-13 Brain Corporation Elementary network description for efficient memory management in neuromorphic systems
US8909576B2 (en) 2011-09-16 2014-12-09 International Business Machines Corporation Neuromorphic event-driven neural computing architecture in a scalable neural network
US9092735B2 (en) 2011-09-21 2015-07-28 Qualcomm Incorporated Method and apparatus for structural delay plasticity in spiking neural networks
US10210452B2 (en) 2011-09-21 2019-02-19 Qualcomm Incorporated High level neuromorphic network description apparatus and methods
US9098811B2 (en) 2012-06-04 2015-08-04 Brain Corporation Spiking neuron network apparatus and methods
US9117176B2 (en) 2011-09-21 2015-08-25 Qualcomm Technologies Inc. Round-trip engineering apparatus and methods for neural networks
US9111224B2 (en) * 2011-10-19 2015-08-18 Qualcomm Incorporated Method and apparatus for neural learning of natural multi-spike trains in spiking neural networks
US9111222B2 (en) * 2011-11-09 2015-08-18 Qualcomm Incorporated Method and apparatus for switching the binary state of a location in memory in a probabilistic manner to store synaptic weights of a neural network
US8996430B2 (en) 2012-01-27 2015-03-31 International Business Machines Corporation Hierarchical scalable neuromorphic synaptronic system for synaptic and structural plasticity
US9367797B2 (en) * 2012-02-08 2016-06-14 Jason Frank Hunzinger Methods and apparatus for spiking neural computation
US8909575B2 (en) 2012-02-29 2014-12-09 Qualcomm Incorporated Method and apparatus for modeling neural resource based synaptic placticity
US9224090B2 (en) * 2012-05-07 2015-12-29 Brain Corporation Sensory input processing apparatus in a spiking neural network
US9129221B2 (en) * 2012-05-07 2015-09-08 Brain Corporation Spiking neural network feedback apparatus and methods
US20130297539A1 (en) * 2012-05-07 2013-11-07 Filip Piekniewski Spiking neural network object recognition apparatus and methods
US9064215B2 (en) 2012-06-14 2015-06-23 Qualcomm Incorporated Learning spike timing precision
US8924322B2 (en) * 2012-06-15 2014-12-30 International Business Machines Corporation Multi-processor cortical simulations with reciprocal connections with shared weights
US9412041B1 (en) 2012-06-29 2016-08-09 Brain Corporation Retinal apparatus and methods
US9111215B2 (en) 2012-07-03 2015-08-18 Brain Corporation Conditional plasticity spiking neuron network apparatus and methods
US8977582B2 (en) 2012-07-12 2015-03-10 Brain Corporation Spiking neuron network sensory processing apparatus and methods
US9256823B2 (en) * 2012-07-27 2016-02-09 Qualcomm Technologies Inc. Apparatus and methods for efficient updates in spiking neuron network
US9159020B2 (en) 2012-09-14 2015-10-13 International Business Machines Corporation Multiplexing physical neurons to optimize power and area
US9311594B1 (en) 2012-09-20 2016-04-12 Brain Corporation Spiking neuron network apparatus and methods for encoding of sensory data
US9218563B2 (en) 2012-10-25 2015-12-22 Brain Corporation Spiking neuron sensory processing apparatus and methods for saliency detection
US9183493B2 (en) 2012-10-25 2015-11-10 Brain Corporation Adaptive plasticity apparatus and methods for spiking neuron network
US9111226B2 (en) 2012-10-25 2015-08-18 Brain Corporation Modulated plasticity apparatus and methods for spiking neuron network
US8943007B2 (en) 2012-10-26 2015-01-27 International Business Machines Corporation Spike tagging for debugging, querying, and causal analysis
US8990130B2 (en) * 2012-11-21 2015-03-24 International Business Machines Corporation Consolidating multiple neurosynaptic cores into one memory
US9275326B2 (en) 2012-11-30 2016-03-01 Brain Corporation Rate stabilization through plasticity in spiking neuron network
US9123127B2 (en) 2012-12-10 2015-09-01 Brain Corporation Contrast enhancement spiking neuron network sensory processing apparatus and methods
CN103078055B (zh) * 2013-01-04 2015-06-03 华中科技大学 一种模拟生物神经突触的单元、装置及方法
US9177245B2 (en) 2013-02-08 2015-11-03 Qualcomm Technologies Inc. Spiking network apparatus and method with bimodal spike-timing dependent plasticity
US9542643B2 (en) * 2013-05-21 2017-01-10 Qualcomm Incorporated Efficient hardware implementation of spiking networks
US9436909B2 (en) 2013-06-19 2016-09-06 Brain Corporation Increased dynamic range artificial neuron network apparatus and methods
US9239985B2 (en) 2013-06-19 2016-01-19 Brain Corporation Apparatus and methods for processing inputs in an artificial neuron network
US9552546B1 (en) 2013-07-30 2017-01-24 Brain Corporation Apparatus and methods for efficacy balancing in a spiking neuron network
US9558443B2 (en) 2013-08-02 2017-01-31 International Business Machines Corporation Dual deterministic and stochastic neurosynaptic core circuit
US9418332B2 (en) 2013-08-16 2016-08-16 Qualcomm Incorporated Post ghost plasticity
US9305256B2 (en) * 2013-10-02 2016-04-05 Qualcomm Incorporated Automated method for modifying neural dynamics
US9489623B1 (en) 2013-10-15 2016-11-08 Brain Corporation Apparatus and methods for backward propagation of errors in a spiking neuron network
US10339447B2 (en) * 2014-01-23 2019-07-02 Qualcomm Incorporated Configuring sparse neuronal networks
US9852006B2 (en) 2014-03-28 2017-12-26 International Business Machines Corporation Consolidating multiple neurosynaptic core circuits into one reconfigurable memory block maintaining neuronal information for the core circuits
US9939253B2 (en) 2014-05-22 2018-04-10 Brain Corporation Apparatus and methods for distance estimation using multiple image sensors
US10194163B2 (en) 2014-05-22 2019-01-29 Brain Corporation Apparatus and methods for real time estimation of differential motion in live video
US9713982B2 (en) 2014-05-22 2017-07-25 Brain Corporation Apparatus and methods for robotic operation using video imagery
US20150379397A1 (en) 2014-06-28 2015-12-31 Brainchip, Inc. Secure voice signature communications system
US9848112B2 (en) 2014-07-01 2017-12-19 Brain Corporation Optical detection apparatus and methods
US10057593B2 (en) 2014-07-08 2018-08-21 Brain Corporation Apparatus and methods for distance estimation using stereo imagery
US9870617B2 (en) 2014-09-19 2018-01-16 Brain Corporation Apparatus and methods for saliency detection based on color occurrence analysis
US9881349B1 (en) 2014-10-24 2018-01-30 Gopro, Inc. Apparatus and methods for computerized object identification
US10970625B2 (en) * 2014-11-03 2021-04-06 Hewlett Packard Enterprise Development Lp Device with multiple resistance switches with different switching characteristics
US9830981B2 (en) * 2015-01-14 2017-11-28 International Business Machines Corporation Neuromorphic memory circuit using a leaky integrate and fire (LIF) line to transmit axon LIF pulse and a conductive denrite LIF line
WO2016122472A1 (en) * 2015-01-28 2016-08-04 Hewlett Packard Enterprise Development Lp Selector relaxation time reduction
US10489705B2 (en) 2015-01-30 2019-11-26 International Business Machines Corporation Discovering and using informative looping signals in a pulsed neural network having temporal encoders
US9990580B2 (en) 2015-03-13 2018-06-05 International Business Machines Corporation Neuromorphic synapses
US10074050B2 (en) 2015-07-13 2018-09-11 Denso Corporation Memristive neuromorphic circuit and method for training the memristive neuromorphic circuit
US10332004B2 (en) 2015-07-13 2019-06-25 Denso Corporation Memristive neuromorphic circuit and method for training the memristive neuromorphic circuit
US10197664B2 (en) 2015-07-20 2019-02-05 Brain Corporation Apparatus and methods for detection of objects using broadband signals
US9767407B2 (en) 2015-09-18 2017-09-19 Samsung Electronics Co., Ltd. Weighting device, neural network, and operating method of the weighting device
CN107533459B (zh) * 2016-03-31 2020-11-20 慧与发展有限责任合伙企业 使用电阻存储器阵列的数据处理方法和单元
CN106292631A (zh) * 2016-08-25 2017-01-04 哈尔滨理工大学 一种基于神经网络的pwm整流器故障诊断系统
CN106407988B (zh) * 2016-09-05 2019-11-26 中国科学院自动化研究所 基于电镜序列切片图像的突触检测方法
CN110214330A (zh) 2016-10-27 2019-09-06 佛罗里达大学研究基金会公司 神经形态电路的忆阻学习
US20180146149A1 (en) 2016-11-21 2018-05-24 Samsung Electronics Co., Ltd. Event-based sensor, user device including the same, and operation method of the same
KR20180120511A (ko) * 2017-04-27 2018-11-06 에스케이하이닉스 주식회사 전달 함수 회로들을 가진 시냅스 어레이를 포함하는 뉴로모픽 소자
JP6724870B2 (ja) 2017-06-19 2020-07-15 株式会社デンソー 人工ニューラルネットワーク回路の訓練方法、訓練プログラム、及び訓練装置
US11861429B2 (en) 2018-04-30 2024-01-02 Hewlett Packard Enterprise Development Lp Resistive and digital processing cores
US11593624B2 (en) 2019-08-23 2023-02-28 Micron Technology, Inc. Self select memory cell based artificial synapse
US11183238B2 (en) * 2019-08-28 2021-11-23 International Business Machines Corporation Suppressing outlier drift coefficients while programming phase change memory synapses
JP6899024B1 (ja) * 2020-06-11 2021-07-07 ウィンボンド エレクトロニクス コーポレーション 抵抗変化型シナプスアレイ装置
US11557343B2 (en) 2021-06-22 2023-01-17 International Business Machines Corporation Pulsing synaptic devices based on phase-change memory to increase the linearity in weight update
US20220414453A1 (en) * 2021-06-28 2022-12-29 X Development Llc Data augmentation using brain emulation neural networks

Family Cites Families (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB9122362D0 (en) 1991-10-22 1991-12-04 British Telecomm Resistive memory element
US6141241A (en) 1998-06-23 2000-10-31 Energy Conversion Devices, Inc. Universal memory element with systems employing same and apparatus and method for reading, writing and programming same
US6314014B1 (en) 1999-12-16 2001-11-06 Ovonyx, Inc. Programmable resistance memory arrays with reference cells
US7092923B2 (en) 2001-11-26 2006-08-15 Exploitation Of Next Generation Co. Ltd. Synapse element with learning function and semiconductor integrated circuit device including the synapse element
US7412428B2 (en) 2002-03-12 2008-08-12 Knowmtech, Llc. Application of hebbian and anti-hebbian learning to nanotechnology-based physical neural networks
US6844582B2 (en) 2002-05-10 2005-01-18 Matsushita Electric Industrial Co., Ltd. Semiconductor device and learning method thereof
US6671710B2 (en) 2002-05-10 2003-12-30 Energy Conversion Devices, Inc. Methods of computing with digital multistate phase change materials
US6999953B2 (en) 2002-07-03 2006-02-14 Energy Conversion Devices, Inc. Analog neurons and neurosynaptic networks
US7186998B2 (en) 2003-03-10 2007-03-06 Energy Conversion Devices, Inc. Multi-terminal device having logic functional
US7085155B2 (en) 2003-03-10 2006-08-01 Energy Conversion Devices, Inc. Secured phase-change devices
US7426501B2 (en) 2003-07-18 2008-09-16 Knowntech, Llc Nanotechnology neural network methods and systems
KR100564602B1 (ko) 2003-12-30 2006-03-29 삼성전자주식회사 상 변화 메모리 어레이의 셋 프로그래밍 방법 및 기입드라이버 회로
US7401058B2 (en) 2004-04-29 2008-07-15 University Of Massachusetts Artificial neuron with phase-encoded logic
JP4345676B2 (ja) * 2005-01-12 2009-10-14 エルピーダメモリ株式会社 半導体記憶装置
JP4728055B2 (ja) * 2005-06-24 2011-07-20 エルピーダメモリ株式会社 人工神経回路
KR100773095B1 (ko) * 2005-12-09 2007-11-02 삼성전자주식회사 상 변화 메모리 장치 및 그것의 프로그램 방법
US8138028B2 (en) 2007-02-12 2012-03-20 Macronix International Co., Ltd Method for manufacturing a phase change memory device with pillar bottom electrode
US20090029031A1 (en) 2007-07-23 2009-01-29 Tyler Lowrey Methods for forming electrodes in phase change memory devices
US7967994B2 (en) 2007-10-25 2011-06-28 Ovonyx, Inc. Method and apparatus for chalcogenide device formation
US8447714B2 (en) 2009-05-21 2013-05-21 International Business Machines Corporation System for electronic learning synapse with spike-timing dependent plasticity using phase change memory

Also Published As

Publication number Publication date
US8682822B2 (en) 2014-03-25
EP2384488A1 (en) 2011-11-09
US20100299296A1 (en) 2010-11-25
CN102341815B (zh) 2014-07-09
JP5420067B2 (ja) 2014-02-19
US20120265719A1 (en) 2012-10-18
TWI509537B (zh) 2015-11-21
TW201110040A (en) 2011-03-16
CN102341815A (zh) 2012-02-01
US8250010B2 (en) 2012-08-21
WO2010133401A1 (en) 2010-11-25
JP2012527669A (ja) 2012-11-08

Similar Documents

Publication Publication Date Title
EP2384488B1 (en) Electronic learning synapse with spike-timing dependent plasticity using memory-switching elements
US8447714B2 (en) System for electronic learning synapse with spike-timing dependent plasticity using phase change memory
US11270192B2 (en) Producing spike-timing dependent plasticity in a neuromorphic network utilizing phase change synaptic devices
KR102449941B1 (ko) 효율적인 행렬 곱셈을 위한 시스템 및 방법
US9189732B2 (en) Method for non-supervised learning in an artificial neural network based on memristive nanodevices, and artificial neural network implementing said method
US9830982B2 (en) Neuromorphic memory circuit using a dendrite leaky integrate and fire (LIF) charge
US10713562B2 (en) Neuromorphic memory circuit
US7978510B2 (en) Stochastic synapse memory element with spike-timing dependent plasticity (STDP)
US8832011B2 (en) Electronic synapses from stochastic binary memory devices
US20140122402A1 (en) Network of artificial neurons based on complementary memristive devices
EP2641214A1 (en) Electronic synapses for reinforcement learning
US20220138546A1 (en) Expandable neuromorphic circuit
Afifi et al. CMOL implementation of spiking neurons and spike‐timing dependent plasticity
Wu et al. Enabling bio-plausible multi-level stdp using cmos neurons with dendrites and bistable rrams
EP4002219A1 (en) Circuit and method for spike time dependent plasticity
US20220215229A1 (en) Neural network device and learning method
EP4002220A1 (en) Synapse circuit for three-factor learning
Jeong Hardware spiking artificial neurons, their response function, and noises

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20110803

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK SM TR

DAX Request for extension of the european patent (deleted)
GRAJ Information related to disapproval of communication of intention to grant by the applicant or resumption of examination proceedings by the epo deleted

Free format text: ORIGINAL CODE: EPIDOSDIGR1

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: NV

Representative=s name: IBM RESEARCH GMBH ZURICH RESEARCH LABORATORY I, CH

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 618012

Country of ref document: AT

Kind code of ref document: T

Effective date: 20130715

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: GB

Ref legal event code: 746

Effective date: 20130725

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602010007946

Country of ref document: DE

Effective date: 20130829

REG Reference to a national code

Ref country code: DE

Ref legal event code: R084

Ref document number: 602010007946

Country of ref document: DE

Effective date: 20130716

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130920

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130619

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130930

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130619

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130619

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130919

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130619

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 618012

Country of ref document: AT

Kind code of ref document: T

Effective date: 20130619

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130619

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130919

REG Reference to a national code

Ref country code: NL

Ref legal event code: VDEP

Effective date: 20130619

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130619

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130619

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130724

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130619

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130619

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130619

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20131019

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20131021

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130619

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130619

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130619

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130619

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130619

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130619

26N No opposition filed

Effective date: 20140320

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130619

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602010007946

Country of ref document: DE

Effective date: 20140320

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130619

Ref country code: LU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140409

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

REG Reference to a national code

Ref country code: FR

Ref legal event code: ST

Effective date: 20141231

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20140430

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20140430

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20140430

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20140409

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130619

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130619

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130619

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20100409

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130619

REG Reference to a national code

Ref country code: DE

Ref legal event code: R082

Ref document number: 602010007946

Country of ref document: DE

Representative=s name: KUISMA, SIRPA, FI

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230423

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20240429

Year of fee payment: 15

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20240430

Year of fee payment: 15