WO2024028371A1

WO2024028371A1 - Neuromorphic circuit for physically producing a neural network and associated production and inference method

Info

Publication number: WO2024028371A1
Application number: PCT/EP2023/071366
Authority: WO
Inventors: Paolo Bortolotti; Abdelmadjid Anane; Vincent Cros; Joo-Von Kim; Grégoire DE LOUBENS; Alfredo De Rossi
Original assignee: Thales; Centre National De La Recherche Scientifique; Universite Paris-Saclay; Commissariat à l'énergie atomique et aux énergies alternatives
Priority date: 2022-08-02
Filing date: 2023-08-02
Publication date: 2024-02-08
Also published as: FR3138719A1

Abstract

The invention relates to a neuromorphic circuit (10) for physically producing a neural network. The neuromorphic circuit (10) comprises: - at least one component (26) that is capable of being excited according to a plurality of excitation eigenmodes with a respective population and of having a plurality of excitation configurations, - a unit (28) for configuring the component (26) capable of exciting the component (26) in order to obtain an excitation configuration chosen on the basis of a desired neural network architecture, and - a unit (30) for interrogating the component (26) capable of selectively modifying the populations of first excitation eigenmodes and of measuring the populations of second excitation eigenmodes, the first and second excitation eigenmodes being the excitation modes of the input neurons and the output neurons of the desired architecture, respectively.

Description

Neuromorphic circuit physically realizing a neural network and associated production and inference method

FIELD OF INVENTION

The present invention relates to a neuromorphic circuit physically realizing a neural network. It also relates to a process of associated realization and inference.

BACKGROUND OF THE INVENTION

The development of the internet and connected sensors makes it possible to obtain considerable quantities of data. This phenomenon, often referred to as “big data”, involves the use of computers to be able to exploit all of the data obtained. Such exploitation can be used in multiple fields, including automatic data processing, diagnostic assistance, predictive analysis, autonomous vehicles, bioinformatics or surveillance.

To implement such exploitation, it is known to use machine learning algorithms that are part of programs that can be executed on processors such as CPUs or GPUs. A CPU is a processor, the acronym CPU coming from the English term “Central Processing Unit” literally meaning central processing unit while a GPU is a graphics processor, the acronym GPU coming from the English term “Graphics Processing Unit” literally meaning graphics unit treatment.

Among the learning implementation techniques, the use of formal neural networks, and in particular deep neural networks, is increasingly widespread, these structures being considered very promising due to their performance for many tasks such as automatic data classification, pattern recognition, automatic language translation and understanding, robotic control, automatic navigation, recommender systems, anomaly detection, fraud detection, research DNA or the discovery of new molecules.

A neural network is generally composed of a succession of layers of neurons, each of which takes its inputs from the outputs of the previous layer. More precisely, each layer includes neurons taking their inputs from the outputs of the neurons of the previous layer. Each layer is connected by a plurality of synapses. A synaptic weight is associated with each synapse. It is a real number, which takes positive and negative values. For each layer, the input of a neuron is the weighted sum of the outputs of the neurons of the previous layer, the weighting being done by the synaptic weights.

For an implementation in a CPU or a GPU, a problem of Von Neumann bottleneck (also called "Von Neumann bottleneck" according to its English name) appears due to the fact that the implementation of a deep neural network (more of three layers and up to several dozen) involves using both the memory(s) and the processor while the latter elements are spatially separated. This results in congestion of the communication bus between the memory(s) and the processor both while the neural network, once trained, is used to carry out a task, and, even more so, while the neural network is trained, that is to say while its synaptic weights are adjusted to solve the task in question with maximum performance.

It is therefore desirable to develop dedicated hardware architectures, combining memory and calculation, to create fast, low-consumption neural networks capable of learning in real time.

It is known to create neural networks based on CMOS type technology. It is understood by the acronym “CMOS”, complementary metal oxide semiconductor (acronym coming from the English expression “Complementary Metal-Oxide-Semiconductor”). The acronym CMOS designates both a manufacturing process and a component obtained by such a manufacturing process.

A neural network based on optical type technologies is also known.

More precisely, three architectural proposals are the subject of specific studies: CMOS neural networks and CMOS synapses, optical neural networks and optical synapses and CMOS neural networks and memristive synapses. Memristive synapses are synapses using memristors. In electronics, the memristor (or memristance) is a passive electronic component. The name is a portmanteau formed from the two English words memory and resistor. A memristor is a non-volatile memory component, the value of its electrical resistance changing with the application of a voltage for a certain duration and remaining at that value in the absence of voltage.

However, according to each of these technologies, each neuron occupies several tens of micrometers on a side. For CMOS and optical technologies, each synapse also occupies several tens of micrometers on a side. The result is that, on a limited surface corresponding for example to an electronic chip, the number of neurons and synapses that can be integrated is limited, which results in a reduction in the performance of the neural network.

For impulse neural networks, to the aforementioned problems, there is also the difficulty of implementing training since the gradient backpropagation technique which is currently the most effective cannot be directly used.

To train impulse neural networks, it is known to use a principle derived from Hebb's rule according to which two neurons have a stronger synaptic link when they emit impulses simultaneously. For example, a constraint is applied to each synapse so that the associated weight is increased if the two neurons connected to the synapse have each emitted an impulse with a time interval less than a predefined threshold or is reduced otherwise.

However, because this technique does not solve the optimization of a global objective function, its precision is not always satisfactory.

SUMMARY OF THE INVENTION

There is therefore a need for a neuromorphic circuit making it possible to produce a large number of synapses and neurons and having reduced consumption.

For this purpose, the description describes a neuromorphic circuit physically producing a neural network, the neural network comprising a set of neurons connected by synapses, the neuromorphic circuit comprising:

- at least one component able to be excited according to a plurality of specific excitation modes with a respective population, the component thus being adapted to present several excitation configurations, each excitation configuration being defined by the specific excitation modes excited and their respective population, each pair of excitation modes being coupled by a respective coupling, each specific excitation mode being a neuron of the neural network and each coupling being a synapse of the neural network,

- a configuration unit of the at least one component, the configuration unit being able to excite the component to obtain an excitation configuration chosen as a function of a desired neural network architecture, the desired architecture comprising neurons d input and output neurons, and

- an interrogation unit for at least one component, the component interrogation unit being able to selectively modify the populations of first own excitation modes and to measure the populations of second own excitation modes, the first modes own excitation being the modes of excitation of the input neurons and the second proper excitation modes being the excitation modes of the output neurons.

According to particular embodiments, the neuromorphic circuit has one or more of the following characteristics, taken in isolation or in all technically possible combinations:

- the component is capable of being excited in a regime in which the amplitude of a coupling between each pair of specific excitation modes in each excitation configuration depends on the respective populations of each of the two specific excitation modes;

- the at least one component has two regimes, a first regime in which the amplitude of the coupling between each pair of specific excitation modes is independent of the population of each of the two specific excitation modes and a second regime in which the amplitude of the coupling between each pair of specific excitation modes depends on the population of each of the two specific excitation modes, the configuration unit being suitable for exciting the component in the second regime;

- the configuration unit is capable of exciting the specific excitation modes according to an initial configuration different from the chosen excitation configuration, the component relaxing towards the chosen excitation configuration;

- the at least one component is a layer of ferromagnetic element;

- the ferromagnetic element is an iron and yttrium garnet;

- the at least one component is chosen from the list consisting of: a magnetic microstructure, a cavity, a metamaterial, and a superconducting resonator;

- the configuration unit is chosen from an optical excitation unit, and an electrical excitation unit.

- the interrogation unit is chosen from: an optical excitation unit, and an electrical excitation unit.

The description also describes a method for physically producing a neural network having a desired architecture, the neural network comprising a set of neurons connected by synapses, the physical production method comprising:

- a step of configuring at least one component of a neuromorphic circuit physically producing a network of neurons having been configured, the at least one component being able to be excited according to a plurality of specific excitation modes with a respective population , the component thus being able to present several excitation configurations, each excitation configuration being defined by the modes of excited own excitations and their respective population, each pair of excitation modes being coupled by a respective coupling, each own excitation mode being a neuron of the neural network and each coupling being a synapse of the neural network, the configuration step being implemented by a configuration unit of the at least one component, the configuration unit forming part of the neuromorphic circuit and comprising the excitation of the at least one component to obtain an excitation configuration chosen as a function of the desired architecture.

The description also relates to a method for inferring a neural network having a desired architecture, the neural network comprising a set of neurons connected by synapses, at least one component of a neuromorphic circuit physically producing a neural network having been configured, the at least one component being capable of being excited according to a plurality of specific excitation modes with a respective population, the component thus being capable of presenting several excitation configurations, each excitation configuration being defined by the excited proper excitation modes and their respective population, each pair of excitation modes being coupled by a respective coupling, each proper excitation mode being a neuron of the neural network and each coupling being a synapse of the neural network, the configuration having been implemented by a configuration unit of the at least one component, the configuration unit forming part of the neuromorphic circuit and comprising the excitation of the at least one component to obtain an excitation configuration chosen as a function of the desired architecture, the inference process comprising:

- a step of selective modification of the populations of first specific excitation modes, the first specific excitation modes being the excitation modes of the input neurons, the modification step being implemented by an interrogation unit of the neuromorphic circuit, and

- a step of measuring the populations of second specific excitation modes, the second specific excitation modes being the excitation modes of the output neurons, the measuring step being carried out after reaching a stable state for the at least one component, the measurement step being implemented by the interrogation unit.

In this description, the expression “specific to” means indifferently

“suitable for”, “suitable for” or “configured for”. BRIEF DESCRIPTION OF THE DRAWINGS

Characteristics and advantages of the invention will appear on reading the description which follows, given solely by way of non-limiting example, and made with reference to the appended drawings, in which:

- Figure 1 is a schematic representation of a neuromorphic circuit,

- Figure 2 is a schematic representation of an example of a neural network,

- Figure 3 is a flowchart of an example of implementation of an inference method using the neuromorphic circuit of Figure 1, and

- Figure 4 is an example of an experimental implementation of the neuromorphic circuit of Figure 1.

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS

GENERAL NEUROMORPHIC CIRCUIT

With reference to Figure 1, a neuromorphic circuit 10 is described.

As its name indicates, the neuromorphic circuit 10 is a circuit physically producing a network of neurons 12.

Otherwise formulated, the neuromorphic circuit 10 is a physical circuit adapted to carry out the operations of a neural network 12.

In particular, the neuromorphic circuit 10 is suitable for implementing a neural network 12 as shown schematically in Figure 2.

The neural network 12 described is a network comprising an ordered succession of layers 14 of neurons 16, each of which takes its inputs from the outputs of the previous layer 14.

By definition, in biology, a neuron, or nerve cell, is an excitable cell constituting the basic functional unit of the nervous system. Neurons ensure the transmission of a bioelectric signal called nerve impulses. Neurons have two physiological properties: excitability, that is to say the capacity to respond to stimulation and to convert them into nerve impulses, and conductivity, that is to say the capacity to transmit signals. impulses. In formal neural networks, the behavior of biological neurons is imitated by a mathematical function, called activation, which has the property of being non-linear (to be able to transform the input in a useful way) and preferably of being differentiable (to allow learning by backpropagation of the gradient). Models closer to the biological neuron exist, in which the neuron emits impulses (or trains of impulses) with a certain frequency which depends on the incoming pulses. The activation function in this case can be represented as a function giving the variation of the average pulse emission frequency with the input current.

More precisely, each layer 14 comprises neurons 16 taking their inputs from the outputs of the neurons 16 of the previous layer 14.

In the case of Figure 2, the neural network 12 described is a network comprising a single hidden layer of neurons 18. However, this number of hidden layers of neurons is not limiting.

The uniqueness of the hidden layer of neurons 18 means that the neural network 12 includes an input layer 20 followed by the hidden layer of neurons 18, itself followed by an output layer 22.

The layers are indexable by an integer index i, the first layer corresponding to input layer 20 and the last to output layer 22.

Each layer 14 is connected by a plurality of synapses 24.

In biology, the synapse designates a functional contact zone which is established between two neurons 16. Depending on its behavior, the biological synapse can excite or inhibit the downstream neuron in response to the upstream neuron. In formal neural networks, a positive synaptic weight corresponds to an excitatory synapse while a negative synaptic weight corresponds to an inhibitory synapse. Biological neural networks learn by modifying synaptic transmissions throughout the network. Similarly, formal neural networks can be trained to perform tasks by modifying synaptic weights according to a learning rule. In the context of this application, a synapse 24 is a component performing a function equivalent to a synaptic weight of modifiable value.

A synaptic weight is therefore associated with each synapse 24. For example, it is a real number, which takes positive as well as negative values.

For each layer 14, the input of a neuron 16 is the weighted sum of the outputs of the neurons 16 of the previous layer 14, the weighting being done by the synaptic weights.

According to the example described, each layer 14 of neurons 16 is fully connected.

A fully connected neuron layer is one in which the neurons in the layer are each connected to all the neurons in the previous layer. Such a type of layer is more often called according to the English term of

“fully connected”.

In this case, the neural network 12 is a pulse neural network. A spiking neural network is often called by the acronym SNN which refers to the English name “Spiking Neural Network”.

In such an impulse neural network, a neuron is a dynamic element varying in time as described above and characterized here by its pulse emission frequency. When a neuron 16, called pre-synaptic, upstream, emits an impulse, the synapse 24 weights this impulse and transmits it to the neuron 16, called postsynaptic, downstream, which possibly in turn emits an impulse.

The stimulation transmitted by synapse 24 is a stimulation of a part of the downstream neuron 16, called membrane and presenting a potential. If this membrane potential charges beyond a so-called activation threshold, neuron 16 emits an impulse.

Specifically, synapse 24 performs a multiplication between input weight and activation. The input activation of downstream neuron 16 is the output signal sent by upstream neuron 16.

The downstream neuron 16 increases its membrane potential, compares it to a threshold and emits an output pulse when the membrane potential exceeds this threshold.

In some cases, an upstream neuron 16 is permanently activated (like an input neuron) in order to add biases to the membrane potential of the downstream neuron 16 which enrich the expressivity of the function learned by the neural network 12. Such a neuron 16 is a “bias neuron”.

The operation which has just been described is valid in the other direction.

More precisely, in the example of Figure 2, for all layers 14 of neurons 16, with the exception of the first layer 20 and the bias neurons 16, the neurons 16 are connected by a synapse 24 which is bidirectional.

Therefore, the same calculation can be carried out by exchanging the role of the two neurons 16.

As visible in Figure 1, the neuromorphic circuit 10 comprises a component 26, a configuration unit 28 of the component 26 and an interrogation unit 30 of the component 26.

In the example described, component 26 is unique but configurations could be considered where component 26 is not unique (see the “other specific examples” paragraph).

Component 26 can be excited according to a plurality of specific excitation modes with a respective population.

In the proposed schematic example, it is assumed that component 26 has 7 excitation modes.

Excitation modes or excited states are quantified. This means that the excitation modes can be referenced by an integer i, with the excitation modes usually being ordered by increasing energy.

In this case, by way of non-limiting illustration, it is assumed that there are 7 modes of excitement and that the integer i varies between 1 and 7.

The existence of excitation modes also makes it possible to define a reciprocal space in which the excitation modes are characterized by a respective eigenvector. Therefore, in the following, each excitation mode is denoted k, with reference to its eigenvector.

Furthermore, the population of an excitation mode k can be represented by the chemical potential ni.

As a result, an excitation mode k with its respective population can be denoted k(ni).

According to the example described, component 26 has two regimes, namely a linear regime (first regime) and a non-linear regime (second regime).

In the linear regime, the amplitude of the coupling between each pair of natural excitation modes ki to k ₇ is independent of the population of each of the two natural excitation modes ki to k ₇ .

Thus, the population of the excitation modes ki to k ₇ in the linear regime does not affect the energy of the excitation modes ki to k ₇ . It follows that the excitation modes k to k ₇ can be considered as quasi-orthogonal in the reciprocal space.

When component 26 is in the linear regime which populates these excitation modes k to k ₇ , this does not affect their energy and the excitation modes k to k ₇ can be considered as mainly orthogonal in the reciprocal space. In this regime, the coupling between excitation modes k to k ₇ is thus weak.

By contrast, in the non-linear regime, the amplitude of the coupling between each pair of natural excitation modes k to k ₇ depends on the population of each of the two natural excitation modes k to k ₇ .

Of course, this is not limiting, the amplitude of the coupling can also be affected by the population in another excitation mode k to k ₇ .

This corresponds to a regime in which the coupling between pairs of excitation modes k to k ₇ becomes significant, which allows the transfer of information from one excitation mode k to k ₇ to another excitation mode k to k ₇ .

The amplitudes of the couplings can be formalized as a matrix A of synaptic dynamic weights. Each element of the matrix A is an element ay where the indices i and j refer respectively to the two excitation modes k and kj. Each element ay depends on the population of excitation modes k and kj. The transition from the linear regime to a non-linear regime is obtained by increasing the population of excitation modes ki to k ₇ .

The component 26 described thus presents several excitation configurations, each excitation configuration being defined by the specific excitation modes ki to k ₇ excited and their respective population and corresponding to operation in the non-linear regime.

Otherwise stated, an excitation configuration corresponds to a set of values ki(ni) for all values of i.

This makes it possible to create a neural network with, on the one hand, the excitation modes ki to k ₇ and, on the other hand, the couplings.

Each excitation mode ki to k ₇ corresponds to a neuron and each coupling between two excitation modes ki to k ₇ corresponding to a synapse between the two neurons associated with the two excitation modes ki to k ₇ considered.

Otherwise formulated, the neurons of the neural network 12 are produced by the specific excitation modes ki to k ₇ of the component 26 while the synapses are produced by the non-linear coupling matrix of the excitation modes ki to k ₇ of the component 26 (matrix A presented previously).

Component 26 is thus a programmable component capable of creating the architecture of numerous neural networks.

By the expression “architecture” is meant the structure of the neural network 12, that is to say in particular, the position of each layer of neurons, the number of layers, the number of neurons in each layer and the links (synapses) between each neuron.

It is the configuration unit 28 of component 26 which is suitable for programming component 26.

The configuration unit 28 of the component 26 is capable of exciting the component 26 to obtain an excitation configuration chosen as a function of a desired neural network architecture.

The desired architecture is assumed to be known, knowing that it can in particular be obtained by carrying out training for a predetermined task or chosen by an expert as particularly appropriate for said task.

The desired architecture makes it possible to determine a matrix A which corresponds to values of k(ni) for all values of i, that is to say an excitation configuration.

This implies that the configuration unit 28 is capable of exciting the component 26 in the non-linear regime. According to a particular embodiment, the configuration unit 28 of the component 26 is capable of exciting the specific excitation modes ki to k ₇ according to an initial configuration different from the chosen excitation configuration.

Component 26 then naturally relaxes towards an equilibrium configuration, this equilibrium configuration being the chosen excitation configuration.

In a more formalized manner, the configuration unit 28 performs an initial configuration kio(n _io ) then the component 26 can relax until reaching a dynamic quasi-equilibrium corresponding to ki(ni) which is the desired configuration.

The initial configuration is chosen to be simpler to obtain, for example because it involves populating fewer different excitation modes ki to k ₇ .

The interrogation unit 30 serves to interrogate the component 26, that is to say, to send input data to the neural network to obtain at least one output data.

For this, according to the example of Figure 1, the interrogation unit 30 comprises two subunits 32 and 34.

The first subunit 32 is capable of selectively modifying the populations of first specific excitation modes ki to k ₇ , the first specific excitation modes ki to k ₇ being the excitation modes of the input neurons (those of the input layer 20).

This means that the first subunit 32 is a subunit for sending input data to component 26.

The second subunit 34 is suitable for measuring the populations of second specific excitation modes ki to k ₇ , the second specific excitation modes ki to k ₇ being the excitation modes of the output neurons (those of the layer input 22).

This means that the second subunit 34 is a subunit for obtaining at least one output data from component 26.

The operation of the neuromorphic circuit 10 is now described with reference to Figure 3 which corresponds to a flowchart of an example of implementation of an inference method.

This method comprises three steps: a configuration step 40, a modification step E42 and a measurement step E44.

During configuration step E40, the configuration unit 28 excites the component 26 to obtain a chosen excitation configuration.

For example, the configuration unit 28 receives a control signal indicating the excitation signal to apply (for example, a radio frequency signal with multiple frequencies as proposed in the embodiment of the following paragraph). This excitation signal has been previously calculated, for example by a simulation tool, to make it possible to physically create a desired neural network architecture.

As explained previously, this excitation signal can be used to obtain an initial configuration of component 26 which will relax towards a final configuration corresponding to the desired architecture.

During the modification step E42, the interrogation unit 30 selectively modifies populations of first specific excitation modes.

This selective modification corresponds to the fact that it is desired that the neural network performs an inference on input data.

The input data is converted into an excitation signal for example by the aforementioned simulation tool and a control unit sends a command indicating to the interrogation unit 30 that it must send said excitation signal.

Component 26 then evolves naturally until reaching a stable state after such excitation.

During the measurement step E44, the interrogation unit 30 measures the populations of second specific excitation modes.

Thus, the interrogation unit 30 obtains the output data of the neural network, that is to say its prediction for the input data injected during the modification step E42.

This output data is obtained by converting the signal measured by the interrogation unit 30 by the inverse operation of that which was used to obtain the excitation signal for the input data.

An inference of the desired neural network is thus carried out in three steps.

Of course, it is possible to carry out these steps independently. In particular, it is possible to implement the physical creation of the neural network (configuration step 40) and the inference itself (steps 42 and 44).

In each case, the present neuromorphic circuit 10 corresponds to a physical realization of a neural network which is qualitatively different from all the physical realizations known to date. Instead of designing and structuring individual nonlinear elements (neurons) and their interconnections (synapses) in real space, it is proposed to realize these elements in a reciprocal space of high dimensionality. To do this, it is sufficient to populate the specific excitation modes of component 26 in the presence of strong non-linearities to couple these excitation modes.

Thus, the connectivity of the neural network 12 can potentially be increased by several orders of magnitude, since it can use the full spectrum of eigenmodes in a given system. Values as large as 10 ⁶ can be obtained.

Otherwise formulated, the physical realization in real space of components connected by physical links is no longer necessary here to obtain a large number of neurons presenting a large number of connections while guaranteeing good reconfigurability of the synaptic weights.

The corollary of this observation is that the neuromorphic circuit 10 is a neuromorphic circuit that is more economical in energy consumption.

It should be noted here that a neuromorphic circuit 10 realizing highly interconnected neurons can be used for solving problems beyond neuromorphic computing. In particular, it could be envisaged to use this neuromorphic circuit 10 to solve difficult non-deterministic polynomial time problems. These problems are often referred to as “NP-hard”. An example is to solve a problem that can be projected onto an Ising model. Such potential could make such a neuromorphic circuit 10 a serious competitor to quantum computer achievements.

In addition, the neuromorphic circuit 10 is easily reconfigurable. The same neuromorphic circuit 10 can be used to perform different operations. To do this, it is sufficient to modify the signals of the configuration unit 28 and the interrogation unit 30 depending on the intended application.

SPECIAL EXAMPLE

A particular example of implementation of the neuromorphic circuit 10 is now described with reference to Figure 4.

In this specific example, component 26 is made of a ferromagnetic element.

According to the example proposed, the ferromagnetic element is iron and yttrium garnet.

Yttrium iron garnet is more commonly referred to as YIG and refers to the element with the chemical formula YsFesO^. The abbreviation YIG here refers to the corresponding English name “Yttrium Iron Garnet”.

Component 26 is here a thin layer.

Such a layer is obtained by growth of a layer or a multilayer of which at least one of the layers is magnetic.

The size and geometry of component 26 are chosen to have appropriate energy separation between modes. Typically, for a single layer of YIG forming a cylinder, the size of the base of the cylinder is a few micrometers.

The shape of the base is circular (as visible in Figure 4) or rectangular.

The thickness of the layer forming component 26 is typically a few tens of nanometers.

Due to these dimensions, component 26 is a magnetic microstructure.

Component 26 is possibly covered with an overlayer 50 as is the case in the example illustrated.

The overlayer 50 serves to dynamically adjust the effective magnetic damping of the component 26. The damping is, by definition, the characteristic life time of the different excitation states.

The overlayer 50 is, for example, made of platinum.

The overlay 50 is controlled by a current generator. Such a generator can deliver direct current or a current forming time slots.

In such a system, collective oscillations of the magnetization around the equilibrium configuration are observed.

These oscillations are spin waves which present quantized excitation modes.

The excitation modes therefore correspond here to a discrete frequency spectrum.

As explained in the previous section, these excitation modes can be used to realize the neurons of the neural network.

The different interactions taking place naturally in ferromagnetic elements can be described by an appropriate effective field, which itself depends on the magnetization, rendering the dynamics of the excitation modes, for sufficiently large deviations from the excitation mode. fundamental, strongly non-linear.

More precisely, the dynamics of magnetization coupled with geometric effects and external stimuli such as applied fields and currents generate non-linear interactions by exchange and dipole-dipole interactions.

This corresponds to a regime in which most spin wave excitation modes are coupled together and the amplitude of the coupling depends on the population of each excitation mode.

As explained in the previous section, these couplings can be used to realize the synapses of the neural network benefiting from high connectivity. Furthermore, it is possible to dynamically modify the synaptic weights of each synapse by controlling the population of each of the spin wave modes by application of an external signal.

For this, it is used as configuration unit 28 an antenna.

The configuration unit 28 is capable of revealing non-linearities at very low excitation amplitude, typically for a few microTeslas (-30 dBm) of alternating magnetic fields at 10 GHz.

Stronger excitation of component 26 makes it possible to reach deep nonlinear regimes of spin wave dynamics. In such a regime, the indexing of linear modes is no longer an adequate physical description of the behavior of the system.

The configuration unit 28 then uses radio frequency signals in the time and frequency domains to selectively populate the specific excitation modes, the spectral density of these signals respecting the previous excitation conditions.

The interrogation unit 30 is either the same antenna as the configuration unit 28 or, as shown in Figure 4, another antenna.

It should be noted that YIG is particularly suitable here because the thin films can be nanostructured down to 300 nanometers (nm) without any negative impact on their magnetic properties. In particular, YIG exhibits very low spin wave damping, with this damping reaching 8 x 10 ^-5 in the geometries described in this section.

This low damping gives rise to extremely rich dynamic behavior with numerous non-linear effects thus making the excitation modes accessible. Good exploitation of these non-linear effects makes it possible to easily control the kj(ni) configurations.

Other materials than YIG can nevertheless be considered.

In particular, the materials are metal alloys of the elements, such as NiFe, CoFeB or CoNi.

Alternatively, the materials are Heusler compounds like CoFeMnSi.

It is also possible to use doped YIG or to substitute the yttrium Y of YIG with another atom, for example thulium (Tm) or bismuth (Bi).

The neuromorphic circuit 10 is here a spintronic device. As such, it has the advantage of being compatible with CMOS circuits. OTHER SPECIAL EXAMPLES

The particular realization described in the previous section is not limiting since many other physical systems present analogous behaviors of their excitation spectrum.

In particular, photonic crystals which are optical cavities produced by nanostructuring are multimode elements. In addition, the non-linear regime and the couplings between modes can be obtained by modulation of the dielectric constant by generation of electron-hole pairs by optical pumping.

As another example, we can consider metamaterials which are versatile systems where resonances can be defined geometrically. By using materials with low dissipation, operation in non-linear mode would be obtained. A superconducting resonator is an example of such a metamaterial.

More generally, it is sufficient to have a physical system capable of being excited according to a plurality of specific excitation modes with a respective population and for each pair of excitation modes to be coupled by a respective and controllable coupling.

It should be noted here that it is not necessary to be able to control all the specific excitation modes of the physical system but only a part and that on this part, the coupling is controllable by the population of these specific excitation modes. .

In addition, non-accessible modes can nevertheless be used to increase the number of degrees of freedom and thus considerably increase the depth of the neural network produced.

Such control could use any physical effect so that the configuration 28 and interrogation 30 units could be an optical excitation unit, an electrical excitation unit.

Claims

1. Neuromorphic circuit (10) physically producing a neural network, the neural network comprising a set of neurons connected by synapses, the neuromorphic circuit (10) comprising:

- at least one component (26) capable of being excited according to a plurality of specific excitation modes with a respective population, the component (26) thus being capable of presenting several excitation configurations, each excitation configuration being defined by the excited proper excitation modes and their respective population, each pair of excitation modes being coupled by a respective coupling, each proper excitation mode being a neuron of the neural network and each coupling being a synapse of the neural network,

- a configuration unit (28) of the at least one component (26), the configuration unit (28) being able to excite the component (26) to obtain an excitation configuration chosen according to a desired architecture of neural network, the desired architecture comprising input neurons and output neurons, and

- an interrogation unit (30) of at least one component (26), the interrogation unit (30) of the component (26) being capable of selectively modifying the populations of first specific excitation modes and of measuring the populations of second proper excitation modes, the first proper excitation modes being the excitation modes of the input neurons and the second proper excitation modes being the excitation modes of the output neurons.

2. Neuromorphic circuit according to claim 1, in which the component (26) is capable of being excited in a regime in which the amplitude of a coupling between each pair of specific excitation modes in each excitation configuration depends on the respective populations of each of the two specific excitation modes.

3. Neuromorphic circuit according to claim 1 or 2, in which the at least one component (26) has two regimes, a first regime in which the amplitude of the coupling between each pair of specific excitation modes is independent of the population of each of the two specific excitation modes and a second regime in which the amplitude of the coupling between each pair of specific excitation modes depends of the population of each of the two specific excitation modes, the configuration unit (28) being able to excite the component (26) in the second regime.

4. Neuromorphic circuit according to any one of claims 1 to 3, in which the configuration unit (28) is capable of exciting the specific excitation modes according to an initial configuration different from the chosen excitation configuration, the component (26) relaxing towards the chosen excitation configuration.

5. Neuromorphic circuit according to any one of claims 1 to 4, in which the at least one component (26) is a layer of ferromagnetic element.

6. Neuromorphic circuit according to claim 5, in which the ferromagnetic element is an iron and yttrium garnet.

7. Neuromorphic circuit according to any one of claims 1 to 4, in which the at least one component (26) is chosen from the list consisting of:

- a magnetic microstructure

- a cavity,

- a metamaterial, and

- a superconducting resonator.

8. Neuromorphic circuit according to any one of claims 1 to 7, in which the configuration unit (28) is chosen from:

- an optical excitation unit, and

- an electrical excitation unit.

9. Neuromorphic circuit according to any one of claims 1 to 8, in which the interrogation unit (30) is chosen from:

- an optical excitation unit, and

- an electrical excitation unit.

10. Method for physically producing a neural network having a desired architecture, the neural network comprising a set of neurons connected by synapses, the physical production method comprising:

- a step of configuring at least one component (26) of a neuromorphic circuit (10) physically producing a neural network having been configured, the at least one component (26) being able to be excited according to a plurality of specific excitation modes with a respective population, the component (26) thus being able to present several excitation configurations, each excitation configuration being defined by the modes d own excitation excited and their respective population, each pair of excitation modes being coupled by a respective coupling, each own excitation mode being a neuron of the neural network and each coupling being a synapse of the neural network, the step configuration being implemented by a configuration unit (28) of the at least one component (26), the configuration unit (28) forming part of the neuromorphic circuit (10) and comprising the excitation of the at least one component ( 26) to obtain an excitation configuration chosen according to the desired architecture.

11. Method for inferring a neural network having a desired architecture, the neural network comprising a set of neurons connected by synapses, at least one component (26) of a neuromorphic circuit (10) physically producing a network of neurons having been configured, the at least one component (26) being capable of being excited according to a plurality of specific excitation modes with a respective population, the component (26) thus being capable of presenting several excitation configurations, each excitation configuration being defined by the proper excited excitation modes and their respective population, each pair of excitation modes being coupled by a respective coupling, each proper excitation mode being a neuron of the neural network and each coupling being a synapse of the neural network, the configuration having been implemented by a configuration unit (28) of the at least one component (26), the configuration unit (28) forming part of the neuromorphic circuit (10) and comprising the excitation of at least one component (26) to obtain an excitation configuration chosen according to the desired architecture, the inference method comprising:

- a step of selective modification of the populations of first specific excitation modes, the first specific excitation modes being the excitation modes of the input neurons, the modification step being implemented by an interrogation unit (30) of the neuromorphic circuit (10), and

- a step of measuring the populations of second specific excitation modes, the second specific excitation modes being the excitation modes of the output neurons, the measuring step being carried out after reaching a stable state for the at least one component (26), the measurement step being implemented by the interrogation unit (30).