WO2024003374A1 - Technique de transformation de fourier - Google Patents
Technique de transformation de fourier Download PDFInfo
- Publication number
- WO2024003374A1 WO2024003374A1 PCT/EP2023/068056 EP2023068056W WO2024003374A1 WO 2024003374 A1 WO2024003374 A1 WO 2024003374A1 EP 2023068056 W EP2023068056 W EP 2023068056W WO 2024003374 A1 WO2024003374 A1 WO 2024003374A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- neurons
- input
- domain components
- time domain
- output
- Prior art date
Links
- 230000009466 transformation Effects 0.000 title claims abstract description 14
- 238000000034 method Methods 0.000 title claims description 59
- 210000004205 output neuron Anatomy 0.000 claims abstract description 134
- 210000002364 input neuron Anatomy 0.000 claims abstract description 127
- 230000008878 coupling Effects 0.000 claims abstract description 52
- 238000010168 coupling process Methods 0.000 claims abstract description 52
- 238000005859 coupling reaction Methods 0.000 claims abstract description 52
- 238000004891 communication Methods 0.000 claims description 68
- 238000012545 processing Methods 0.000 claims description 40
- 238000012421 spiking Methods 0.000 claims description 19
- 238000013507 mapping Methods 0.000 claims description 16
- 230000005540 biological transmission Effects 0.000 claims description 14
- 230000010363 phase shift Effects 0.000 claims description 10
- 125000004122 cyclic group Chemical group 0.000 claims description 8
- 230000004913 activation Effects 0.000 claims description 6
- 238000001994 activation Methods 0.000 claims description 6
- 230000001413 cellular effect Effects 0.000 claims description 6
- 210000002569 neuron Anatomy 0.000 description 54
- 239000013598 vector Substances 0.000 description 21
- 239000012528 membrane Substances 0.000 description 18
- 239000011159 matrix material Substances 0.000 description 11
- 230000008901 benefit Effects 0.000 description 9
- 238000005259 measurement Methods 0.000 description 7
- 238000010586 diagram Methods 0.000 description 6
- 239000003990 capacitor Substances 0.000 description 5
- 230000000694 effects Effects 0.000 description 5
- 230000001537 neural effect Effects 0.000 description 5
- 210000000225 synapse Anatomy 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 4
- 238000003491 array Methods 0.000 description 3
- 238000013528 artificial neural network Methods 0.000 description 3
- 238000004364 calculation method Methods 0.000 description 3
- 238000005265 energy consumption Methods 0.000 description 3
- 230000007774 longterm Effects 0.000 description 3
- 230000004044 response Effects 0.000 description 3
- 230000011664 signaling Effects 0.000 description 3
- 230000001360 synchronised effect Effects 0.000 description 3
- 230000009471 action Effects 0.000 description 2
- 210000004027 cell Anatomy 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000014509 gene expression Effects 0.000 description 2
- 230000010354 integration Effects 0.000 description 2
- 238000012886 linear function Methods 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 230000007246 mechanism Effects 0.000 description 2
- 230000004931 aggregating effect Effects 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 239000000969 carrier Substances 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 210000003477 cochlea Anatomy 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 239000004020 conductor Substances 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000003306 harvesting Methods 0.000 description 1
- 210000001153 interneuron Anatomy 0.000 description 1
- 229940050561 matrix product Drugs 0.000 description 1
- 230000003278 mimic effect Effects 0.000 description 1
- 230000000116 mitigating effect Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
- 238000003825 pressing Methods 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 238000013468 resource allocation Methods 0.000 description 1
- 230000004043 responsiveness Effects 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 238000003860 storage Methods 0.000 description 1
- 230000000946 synaptic effect Effects 0.000 description 1
- 230000002195 synergetic effect Effects 0.000 description 1
- 230000036962 time dependent Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
- 238000011144 upstream manufacturing Methods 0.000 description 1
- 230000003245 working effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/049—Temporal neural networks, e.g. delay elements, oscillating neurons or pulsed inputs
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/06—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons
- G06N3/063—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons using electronic means
- G06N3/065—Analogue means
-
- H—ELECTRICITY
- H03—ELECTRONIC CIRCUITRY
- H03D—DEMODULATION OR TRANSFERENCE OF MODULATION FROM ONE CARRIER TO ANOTHER
- H03D7/00—Transference of modulation from one carrier to another, e.g. frequency-changing
- H03D7/16—Multiple-frequency-changing
- H03D7/165—Multiple-frequency-changing at least two frequency changers being located in different paths, e.g. in two paths with carriers in quadrature
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L5/00—Arrangements affording multiple use of the transmission path
- H04L5/0001—Arrangements for dividing the transmission path
- H04L5/0003—Two-dimensional division
- H04L5/0005—Time-frequency
- H04L5/0007—Time-frequency the frequencies being orthogonal, e.g. OFDM(A), DMT
Definitions
- the present disclosure relates to a technique for performing a Fourier transformation. More specifically, and without limitation, a device and a method are provided for generating a time domain signal for orthogonal frequency division multiplexing.
- the Third Generation Partnership Project (3GPP) defines multiple radio access technologies (RATs) including fourth generation (4G) Long Term Evolution (LTE) and fifth generation (5G).
- RATs also referred to as Wi-Fi.
- RATs enable radio communications in downlinks (DLs) from a radio access network (RAN) comprising base stations to radio devices, in uplinks (ULs) from radio devices to the RAN, and in sidelinks (SLs) from radio device to radio device - also referred to as device-to-device (D2D) communication - without going through a base station.
- Radio devices for 3GPP RATs and Wi-Fi are also referred to as user equipments (UEs) and mobile stations (MSs), respectively.
- UEs user equipments
- MSs mobile stations
- base stations and radio devices are collectively referred to as stations.
- Such RATs use orthogonal frequency division multiplexing (OFDM) and demultiplexing for transmitting to and receiving from one or more stations, including orthogonal frequency division multiple access (OFDMA).
- OFDM orthogonal frequency division multiplexing
- OFDMA orthogonal frequency division multiple access
- Neuromorphic computing is a computation paradigm that has the potential to overcome some bottlenecks of the classical von-Neumann architecture. Such benefits include low-energy, event-driven computation, as well as parallelism and co-location of memory and computation. Event-driven computation means that a computation takes place only for active input, which reduces energy consumption. This can be an important advantage, for example, in low-power or so-called zero-power loT devices, including simple sensory devices. Zero-power may mean that the loT device relies on harvesting energy from its environment or is powered by usage, e.g., the mechanical energy of pressing a light switch. Hardware devices for neuromorphic computation are currently advancing, including neuromorphic chips in research such as the "Intel Loihi", and entering commercial availability.
- the document US 2021/0326689 Al proposes a way to set conductance values in an analogue circuit for executing matrix dot product operation, such that negative and positive values in the matrix can be allowed.
- the resulting dotproduct is the voltage value on different output lines.
- the voltage values are further converted to binary 0 or 1 and are used to make classification decisions, e.g., for classifying an image.
- the primary use case shown is image processing.
- the document US 2020/0356847 Al describes a programmable conductor circuit used as a sequence of input spikes.
- a rate of spikes represents an input value.
- a sequence of spikes on the output represents the output value.
- Existing analogue circuits for dot-product calculation such as the technique of document US 2021/0326689 Al, assume that the input of the calculation are real-valued signals.
- the existing analogue circuits include components that handle the possible negative values in the calculations and assume that the input is represented by an analogue-valued signal, e.g. a voltage or a current.
- an analogue-valued signal e.g. a voltage or a current.
- the existing technique is not optimal when the input signal is binary-valued and cannot be directly applied for spike-based digital input.
- An alternative or more specific object is to provide a DFT technique, which input and/or output are spike-encoded digital data and can work asynchronously.
- a device for generating a time domain signal based on binary-valued frequency domain components comprises input neurons for representing binary values of the binary-valued frequency domain components.
- the device further comprises neuromorphic couplings configured to map the binary-valued frequency domain components to time domain components of the time domain signal using weights according to an inverse discrete Fourier transformation (IDFT).
- IDFT inverse discrete Fourier transformation
- the device further comprises output neurons for representing the time domain components of the time domain signal.
- Each of the output neurons is configured to sum up contributions mapped to the respective one of the output neurons by the neuromorphic couplings from each of the input neurons.
- Embodiments of the device may generate the time domain components based on asynchronously received frequency domain components.
- Each of the input neurons may (e.g., time-integrate or buffer) at least one spike that represents a value of one for the respective one of the frequency domain components.
- spikes may be received at different input neurons at different times (i.e., asynchronously) and still be processed to generate the contributions according to the mapping performed by the neuromorphic couplings and to generate the time domain components by the output neurons.
- the neuromorphic couplings may perform a neuromorphic computation, e.g. a matrix product between the input neurons (e.g., the values of the inner potentials of the input neurons) as an input vector and the weights being elements of an IDFT matrix (i.e., a matrix for an Inverse Discrete Fourier Transform), or a plurality of scalar products (also referred to as dot-products) between the input neurons as the input vector and a row of the weights (i.e., the weights used for mapping to one of the time domain components).
- the input vector may be encoded using a Vector Symbolic Architecture (VSA).
- VSA Vector Symbolic Architecture
- the input neurons may represent the frequency domain components, i.e., the signal values at the different sub-carriers in the frequency domain (which may also be referred to as Fourier coefficients) for a given OFDM symbol.
- the (e.g., complex-valued or real-valued) weights according to the inverse discrete Fourier transformation (IDFT) may be matrix coefficients of a unitary matrix of the IDFT, which may also be referred to as IDFT coefficients.
- IDFT coefficients As each product between the frequency components (of the input neurons) and the complexvalued weights of the unitary IDFT matrix can be decomposed into real and imaginary parts for the time domain components, the weights used for the mapping (by the neuromorphic couplings) of the frequency domain components (represented by the input neurons) to the time domain components (represented by the output neurons) may be real-valued.
- the weights used by the neuromorphic couplings may also be referred to as FFT coefficients (which is not to be confused with the Fourier coefficients representing the frequency components).
- the time domain signal resulting from the IDFT may be an orthogonal frequency division multiplexing (OFDM) signal.
- the OFDM signal may comprise an OFDM symbol.
- the output neurons e.g., the values of the inner potentials of the output neurons
- the output neurons may represent the time domain components, i.e., the signal values (or samples) at the different points in time (e.g., within the duration of the respective OFDM symbol).
- At least some embodiments of the device may perform an inverse DFT (e.g., a fast Fourier transform, FFT) with reduced energy consumption by virtue of the neuromorphic hardware (i.e., the input neurons, the neuromorphic couplings, and/or the output neurons), e.g., for an energy-efficient OFDM transceiver.
- an inverse DFT e.g., a fast Fourier transform, FFT
- the neuromorphic hardware i.e., the input neurons, the neuromorphic couplings, and/or the output neurons
- the input neurons, the neuromorphic coupling, and the output neurons may be implemented by (e.g., a single piece of) neuromorphic hardware.
- the neuromorphic couplings may correspond to a single intermediate layer between the input neurons and the output neurons.
- the neuromorphic couplings may correspond to synapses of the output neurons.
- At least one or each of the input neurons may be a spiking neuron.
- at least one or each of the input neurons and/or at least one or each of the output neurons may be distinguished from neurons in regular artificial neural networks.
- Each of the frequency domain components may be represented by a different one, or a different pair, of the input neurons.
- each of the time domain components may be represented by a different pair of the output neurons.
- the number of input neurons may be equal to the number of output neurons.
- the device aspect may further comprise at least one of the following embodiments.
- the neuromorphic couplings may comprise resistances corresponding to the weights.
- the contributions may correspond to voltage drops at the resistances when currents corresponding to the binary-valued frequency domain components energize a respective one of the resistances.
- weights may correspond to multiplications of a respective one of the binary-valued frequency domain components with a respective one of the weights.
- the contributions may be the result of the multiplications.
- the neuromorphic couplings may implement the multiplications (e.g., each of the multiplications) according to Ohm's law.
- the respective one of the binary-valued frequency domain components may be represented by a current
- the respective one of the weights may be represented by a resistance
- the respective one of the contributions may correspond to the voltage drop at the resistance.
- a spike input at any one of the input neurons may correspond to a value of one of the respective one of the binary-valued frequency domain components.
- the absence of a spike input at any one of the input neurons within a predefined time window may correspond to a value of zero of the respective one of the binary-valued frequency domain components.
- the input neurons may or may not comprise or apply a non-linear function or a threshold to the binary-valued frequency domain components.
- the neuromorphic couplings and/or the output neurons may or may not comprise or apply a non-linear function or a threshold to the contributions.
- the neuromorphic couplings may be configured to energize a respective one of the weights for the mapping only when the binary-valued frequency domain component, which is mapped using the respective one of the weights, comprises a value of one.
- the neuromorphic couplings may be configured to not energize a respective one of the weights for the mapping when the binary-valued frequency domain component, which is mapped using the respective one of the weights, comprises a value of zero.
- the respective one of the weights may be energized by energy of the binary-valued frequency domain component representing the value of one.
- An input signal and an output signal comprising a spike signal may also be referred to as a spike-based input and a spike-based output, respectively.
- At least one or each of the output neurons may comprise a spiking threshold.
- the spiking threshold of the respective one of the output neurons may be greater than the highest possible inner potential of the respective one of the output neurons that is reachable by activations on the input neurons.
- the spiking threshold may be set such that the inner potential of the output neurons does not reach the spiking threshold of the output neurons. This may enable that the time domain components are linearly depending (e.g., proportional to) the frequency domain components.
- the input neurons may be configured to receive a spike signal.
- the spike signal may represent application data encoded into spike activations.
- the input neurons receive the application data in the form of spikes (i.e., as a spike signal).
- the spike signal may result from encoding input data according to a neuromorphic representation.
- the neuromorphic representation e.g., how the application data is encoded into spikes, may depend on the implementation.
- the input neurons may realize the representation via their spiking activities.
- the input neurons may receive the application data as an analogue signal, e.g. a voltage may represent the real and imaginary parts of the frequency components.
- the spike signal may be a spike-encoded signal.
- the input neurons may apply a time-dependent analysis of the spike signal resulting in the binary-valued frequency domain component represented by an electric potential (or voltage, e.g., a membrane potential or membrane voltage) of the input neuron.
- At least one or each of the input neurons may comprise a reactance for integrating the respective spike signal over time.
- at least one or each of the input neurons may comprise a capacitance and a resistance defining a time scale for integrating the respective spike signal.
- At least one or each of the output neurons may comprise an electric potential representing a respective one of the time domain components.
- at least one or each of the output neurons may be configured to aggregate spike signals in the contributions resulting from the neuromorphic couplings mapping spike signals in the binary-valued frequency domain components from the input neurons.
- the electric potential may be a voltage, e.g., a membrane potential or membrane voltage of the respective output neuron.
- the aggregating may comprise an adding (e.g., the afore-mentioned time integration) of the weighted spike signals from the input neurons.
- the electric potential may decay according to a resistance (e.g., a membrane resistance) and/or an equilibrium potential of the respective one of the output neurons.
- the input neurons may comprise a first input set of input neurons and a second input set of input neurons that is disjoint from the first input set.
- the first input set may be mapped to the time domain components using the weights according to the IDFT.
- the second input set may be mapped to the time domain components using the weights according to the IDFT with inverted sign.
- the input neurons may comprise a first input set of input neurons and a second input set of input neurons that is disjoint from the first input set.
- the first input set may be mapped to the time domain components using the weights according to the IDFT.
- the second input set may be mapped to the time domain components using the weights according to the IDFT.
- Each of the output neurons may be configured to sum up contributions mapped to the respective one of the output neurons from the first input set.
- each of the output neurons may be configured to subtract contributions mapped to the respective one of the output neurons from the second input set.
- corresponding pairs of input neurons in the first and second sets may represent a modulation symbol according to at least one of on-off-keying (OOK) and phase-shift keying (PSK).
- OOK on-off-keying
- PSK phase-shift keying
- the pair of binary values (0,0) may represent a zero frequency domain component
- the pair of binary values (1,0) may represent a plus one frequency domain component
- the pair of binary values (0,1) may represent a minus one frequency domain component
- the binary values (1,1) may be unused or equivalent to (0,0).
- the input neurons may comprise mutually disjoint first, second, third, and fourth input sets of input neurons.
- the first input set may be mapped to the time domain components using the weights according to the IDFT.
- the second input set may be mapped to the time domain components using the weights according to the IDFT with inverted sign.
- the third input set may be mapped to the time domain components using the weights according to the IDFT with a phase shift by +90 degrees.
- the fourth input set may be mapped to the time domain components using the weights according to the IDFT with a phase shift by -90 degrees.
- corresponding groups of input neurons in the first, second, third, and fourth sets may represent a modulation symbol according to at least one of Quadrature Phase-Shift Keying (QPSK) and Quadrature Amplitude Modulation (QAM) 4.
- QPSK Quadrature Phase-Shift Keying
- QAM Quadrature Amplitude Modulation
- the group of binary values (1,0, 0,0) may represent a first QPSK constellation
- the group of binary values (0, 1,0,0) may represent a second QPSK constellation
- the group of binary values (0,0, 1,0) may represent a third QPSK constellation
- the group of binary values (0,0,0, 1) may represent a fourth QPSK constellation.
- the output neurons may comprise a first output set of output neurons and a second output set of output neurons that is disjoint from the first output set.
- the neuromorphic couplings may be configured to map the binaryvalued frequency domain components to the first output set using weights according to the real part of the IDFT.
- the neuromorphic couplings may be configured to further map the binary-valued frequency domain components to the second output set using weights according to the imaginary part of the IDFT.
- the input neurons may comprise an odd input set of N input neurons corresponding to odd frequency domain components and an even input set of N input neurons corresponding to even frequency domain components.
- Each of the odd input set and the even input set may be mapped to the time domain components using the weights according to the IDFT of size N.
- the neuromorphic couplings or the output neurons may be configured to sum up the contributions mapped to the respective one of the output neurons from the odd input set and the contributions mapped to the respective one of the output neurons from the even input set for the first N output neurons.
- the neuromorphic couplings or the output neurons may be configured to subtract the contributions mapped to the respective one of the output neurons from the even input set from the contributions mapped to the respective one of the output neurons from the odd input set for the second N output neurons.
- the neuromorphic couplings splitting the input neurons corresponding to odd and even frequency domain components may enable a fast Fourier transformation (FFT) on neuromorphic hardware.
- FFT fast Fourier transformation
- the contributions mapped to the respective one of the output neurons from the even input set may further comprise a phase factor.
- the phase factor may depend only on the respective one of the output neurons.
- At least one or each of the input neurons and/or at least one or each of the output neurons may comprise a reactance, optionally a capacitance or an inductance, for asynchronously collecting one or more spikes representing the binary value of the binary-valued frequency domain components.
- the input neurons may be emitting spikes such that they encode, e.g. for representing, input data (e.g., application data).
- the output neurons may collect the (e.g., asynchronously arriving) spikes resulting in the mapping of the frequency domain components to the time domain components by the neuromorphic couplings.
- the device may further comprise a demultiplexing unit.
- the demultiplexing unit may comprise a clock and a cyclic counter.
- the clock may be configured to cyclically increase the cyclic counter.
- the time domain components may be read out from the output neurons according to the cyclic counter.
- the size of the cyclic counter (i.e., the number of different integer values representable by the cyclic counter) may correspond to the number of output neurons.
- the device may further comprise a radio frequency converter configured to up-converting a real part of a current one of the time domain components to a radio frequency and to up-converting an imaginary part of a current one of the time domain components to the radio frequency with a 90 degree phase shift.
- a radio frequency converter configured to up-converting a real part of a current one of the time domain components to a radio frequency and to up-converting an imaginary part of a current one of the time domain components to the radio frequency with a 90 degree phase shift.
- a radio device for transmitting an orthogonal frequency division multiplexing symbol (OFDM symbol)
- the radio device comprises a radio interface for transmitting a time domain signal comprising the OFDM symbol.
- the radio device further comprises a device for neuromorphic computation according the one device aspect (e.g., any one of the embodiments of the one device aspect).
- the radio device further comprises a processing circuitry coupled to memory that is configured to store instructions of a radio communications protocol.
- the processing circuitry is operable to execute the instructions, such that the processing circuitry provides the binary-valued frequency domain components to the input neurons of the device.
- the output neurons of the device may be coupled to the radio interface to provide the time domain signal comprising the OFDM symbol.
- a user equipment configured to communicate with a base station on an uplink (UL) or with another radio device on a sidelink (SL)
- the UE comprises a radio interface for transmitting an OFDM symbol.
- the UE further comprises a device for neuromorphic computation according the one device aspect (e.g., any one of the embodiments of the one device aspect).
- the UE further comprises a processing circuitry coupled to memory that is configured to store instructions of a radio communications protocol.
- the processing circuitry may be operable to execute the instructions, such that the processing circuitry provides the binary-valued frequency domain components to the input neurons of the device.
- the output neurons of the device are coupled to the radio interface to provide the time domain signal comprising the OFDM symbol.
- a method of generating a time domain signal based on binary-valued frequency domain components comprises a step of representing binary values of the binary-valued frequency domain components in input neurons.
- the method further comprises a step of mapping the binary-valued frequency domain components to time domain components of the time domain signal using weights according to an inverse discrete Fourier transformation (IDFT) in neuromorphic couplings.
- IDFT inverse discrete Fourier transformation
- the method further comprises a step of representing the time domain components of the time domain signal in output neurons.
- Each of the output neurons may be configured to sum up contributions mapped to the respective one of the output neurons by the neuromorphic couplings from each of the input neurons.
- the method according to the method aspect may further comprise any of the features or steps of any one of the embodiments of the one device aspect.
- a communication system includes a host computer comprising processing circuitry configure to provide user data.
- the host computer comprises a communication interface configured to forward user data to a (e.g., cellular and/or ad hoc) radio network for transmission to a user equipment (UE) and/or to receive user data through the radio network from the UE.
- a e.g., cellular and/or ad hoc
- the UE may be an embodiment of the still other device aspect.
- the UE may comprise a radio interface and processing circuitry.
- the processing circuitry of the UE may be configured to provide the binary-valued frequency domain components (e.g., encoding the user data) to a device embodying the one device aspect (e.g., any one of the embodiments of the one device aspect).
- the communication system may be embodied according to at least one of the following embodiments.
- the communication system may comprise the UE.
- the radio network may further comprise a base station, or a radio device functioning as a gateway, which is configured to communicate with the UE.
- the processing circuitry of the host computer may be configured to execute a host application, thereby providing the user data.
- the processing circuitry of the UE may be configured to execute a client application associated with the host application.
- the circuit architecture of at least some embodiments does not require a purpose-built analogue circuit.
- Embodiments can be directly applicable for implementation on general purpose neuromorphic hardware.
- the technique may enable applying neuromorphic hardware in radio communication, which is an increasingly important area with only few existing solutions available so far.
- the technique enables an energy-efficient implementation of the Discrete Fourier Transform (DFT) on general purpose neuromorphic hardware.
- the input neurons and/or the output neuron may be implemented according to a Leaky Integrate and Fire (LIF) neurons to compute the IDFT for an input signal represented by neural spike activations as the binaryvalued frequency domain components.
- LIF Leaky Integrate and Fire
- IDFT While referring to IDFT, the technique is readily applicable to a DFT and/or for generating frequency domain components based on time domain components (e.g., for receiving and/or demultiplexing an OFDM symbol).
- the device may be embodied by a radio device.
- any "radio device” may be a user equipment (UE).
- UE user equipment
- the technique may be applied for generating an OFDM symbol, e.g. according to Third Generation Partnership Project (3GPP) New Radio (NR) or 3GPP Long Term Evolution (LTE) or according to the standard family IEEE 802.11 (Wi-Fi).
- 3GPP Third Generation Partnership Project
- NR New Radio
- LTE Long Term Evolution
- Wi-Fi wireless Fidelity
- the technique may be implemented for uplink (UL) or sidelink (SL) radio transmission.
- UL uplink
- SL sidelink
- the SL may be implemented using proximity services (ProSe), e.g. according to a 3GPP specification.
- Any radio device may be a user equipment (UE), e.g., according to a 3GPP specification.
- the time domain signal may be transmitted to a radio access network (RAN).
- the RAN may comprise one or more base stations.
- the radio device may be a node in a radio network, e.g. a vehicular, ad hoc and/or mesh network comprising two or more radio devices (e.g., vehicles such as cars), e.g., acting as remote radio device and/or relay radio device.
- the radio devices may be a 3GPP user equipment (UE) or a Wi-Fi station (STA).
- the radio device may be a mobile or portable station, a device for machinetype communication (MTC), a device for narrowband Internet of Things (NB-loT) or a combination thereof.
- MTC machinetype communication
- NB-loT narrowband Internet of Things
- Examples for the UE and the mobile station include a mobile phone, a tablet computer and a self-driving vehicle.
- Examples for the portable station include a laptop computer and a television set.
- Examples for the MTC device or the NB-loT device include robots, sensors and/or actuators, e.g., in manufacturing, automotive communication and home automation.
- the MTC device or the NB-loT device may be implemented in a manufacturing plant, household appliances and consumer electronics.
- the RAN may be implemented by one or more base stations (e.g., network nodes).
- the radio device may be wirelessly connected or connectable (e.g., according to a radio resource control, RRC, state or active mode) with another radio device (e.g., the relay radio device) and/or at least one base station of the RAN.
- RRC radio resource control
- the base station may encompass any station that is configured to provide radio access to any of the radio devices.
- the base stations may also be referred to as cell, transmission and reception point (TRP), radio access node or access point (AP).
- the base station and/or the relay radio device may provide a data link to a host computer providing the user data to the remote radio device or gathering user data from the remote radio device.
- Examples for the network node e.g., base station
- the RAN may be implemented according to the Global System for Mobile Communications (GSM), the Universal Mobile Telecommunications System (UMTS), 3GPP Long Term Evolution (LTE) and/or 3GPP New Radio (NR).
- GSM Global System for Mobile Communications
- UMTS Universal Mobile Telecommunications System
- LTE 3GPP Long Term Evolution
- NR 3GPP New Radio
- Any aspect of the technique may be implemented on a Physical Layer (PHY), a Medium Access Control (MAC) layer, a Radio Link Control (RLC) layer, a packet data convergence protocol (PDCP) layer, and/or a Radio Resource Control (RRC) layer of a protocol stack for the radio communication.
- PHY Physical Layer
- MAC Medium Access Control
- RLC Radio Link Control
- PDCP packet data convergence protocol
- RRC Radio Resource Control
- referring to a protocol of a layer may also refer to the corresponding layer in the protocol stack.
- referring to a layer of the protocol stack may also refer to the corresponding protocol of the layer. Any protocol may be implemented by a corresponding method.
- the device may further comprises processing circuitry (e.g., at least one processor) and a memory.
- Said memory comprises instructions executable by said at least one processor whereby the device is operative to perform a communications protocol for providing the frequency domain components, e.g., spike-encoded (i.e., as a spike-based signal).
- a communication system including a host computer is provided.
- the host computer comprises a processing circuitry configured to provide user data, e.g., triggering the time domain signal or in response to the time domain signal.
- the host computer further comprises a communication interface configured to forward the user data to a cellular network (e.g., through the RAN and/or the base station) for transmission to a UE (e.g., embodying the device aspect).
- the UE comprises an embodiment of the device.
- the UE comprises a radio interface and processing circuitry, which is configured to execute a radio communication protocol for providing the frequency domain components to the device.
- the communication system may further include the UE.
- the cellular network may further include one or more base stations configured for radio communication with the UE and/or to provide a data link between the UE and the host computer using the method aspect.
- any one of the device, the radio device, the UE, the base station, the communication system or any node or station for embodying the technique may further include any feature disclosed in the context of the method aspect and/or the device aspect.
- any one of the units and modules disclosed herein may be configured to perform or initiate one or more of the steps of the method aspect.
- Fig. 1 shows a schematic block diagram of an embodiment of a device for generating a time domain signal based on binary-valued frequency domain components
- Fig. 2 shows a schematic block diagram of an embodiment of a device for generating a time domain signal based on binary-valued frequency domain components
- Fig. 3 schematically illustrates a more detailed embodiment of the device of Fig. 1;
- Fig. 4 schematically illustrates a first example of the neuromorphic couplings, which may be implemented in any embodiment of the device of Fig. 1;
- Fig. 5 schematically illustrates a second example of the neuromorphic couplings, which may be implemented in any embodiment of the device of Fig. 1;
- Fig. 6 schematically illustrates a third example of the neuromorphic couplings, which may be implemented in any embodiment of the device of Fig. 1;
- Fig. 7A schematically illustrates a first example of a spike-based signal, which may be implemented in any embodiment of the device of Fig. 1;
- Fig. 7B schematically illustrates a second example of a spike-based signal, which may be implemented in any embodiment of the device of Fig. 1;
- Fig. 7B schematically illustrates a second example of a spike-based signal, which may be implemented in any embodiment of the device of Fig. 1;
- Fig. 8 schematically illustrates an example of a neuron, which may be implemented as input neurons and/or output neurons in any embodiment of the device of Fig. 1;
- Fig. 9 schematically illustrates an example of a radio network including a radio device embodying the device of Fig. 1;
- Fig. 10 shows a schematic block diagram of a radio device embodying the device of Fig. 1;
- Fig. 11 schematically illustrates an example telecommunication network connected via an intermediate network to a host computer
- Fig. 12 shows a generalized block diagram of a host computer communicating via a base station or radio device functioning as a gateway with a user equipment over a partially wireless connection;
- Figs. 13 and 14 show flowcharts for methods implemented in a communication system including a host computer, a base station or radio device functioning as a gateway and a user equipment.
- WLAN Wireless Local Area Network
- 3GPP LTE e.g., LTE-Advanced or a related radio access technique such as MulteFire
- Bluetooth according to the Bluetooth Special Interest Group (SIG), particularly Bluetooth Low Energy, Bluetooth Mesh Networking and Bluetooth broadcasting, for Z-Wave according to the Z-Wave Alliance or for ZigBee based on IEEE 802.15.4.
- SIG Bluetooth Special Interest Group
- Fig. 1 schematically illustrates a block diagram of an embodiment of a device for generating a time domain signal based on binary-valued frequency domain components.
- the device is generically referred to by reference sign 100.
- the device 100 comprises input neurons 102 representing binary values of the binary-valued frequency domain components.
- the device 100 further comprises neuromorphic couplings 104 configured to map the binary-valued frequency domain components to time domain components of the time domain signal using weights according to an inverse discrete Fourier transformation (IDFT).
- IDFT inverse discrete Fourier transformation
- the device 100 further comprises output neurons 106 representing the time domain components of the time domain signal, wherein each of the output neurons 106 is configured to sum up contributions mapped to the respective one of the output neurons 106 by the neuromorphic couplings 104 from each of the input neurons 102.
- the device 100 comprises an up-converter for up-converting the time domain signal (e.g., a baseband signal) to a radio frequency for radio transmission.
- an up-converter for up-converting the time domain signal (e.g., a baseband signal) to a radio frequency for radio transmission.
- neuromorphic computing may refer to hardware that performs the computation (e.g., the multiplication by the weights or the summing up of the contributions) by a set of spiking neurons and the activations between them.
- neuromorphic computing may refer to hardware that performs the computation in colocation with the memory storing the result of the computation (e.g., in-memory computation).
- the device 100 may be embodied by any transmitting station (or briefly: transmitter). Alternatively or in addition, the device 100 may be embodied by a radio device, e.g., a user equipment (UE).
- the radio device may be configured for radio access to a radio access network (RAN) and/or for sidelink (SL) communication with another radio device.
- RAN radio access network
- SL sidelink
- the device 100 and the RAN or the other radio device may be in direct radio communication, e.g., at least for transmitting the time domain signal.
- the receiving station may be embodied by a base station (e.g., network node) of the RAN and/or the other radio device.
- Fig. 2 shows an example flowchart for a method 200 of generating a time domain signal based on binary-valued frequency domain components.
- a step 202 binary values of the binary-valued frequency domain components are represented by means of input neurons.
- the binary-valued frequency domain components are mapped, by means of neuromorphic couplings, to time domain components of the time domain signal using weights according to an inverse discrete Fourier transformation (IDFT).
- IDFT inverse discrete Fourier transformation
- the time domain components of the time domain signal are represented by means of output neurons.
- Each of the output neurons is configured to sum up contributions mapped to the respective one of the output neurons by the neuromorphic couplings (e.g., from each of the input neurons).
- the hardware is not required to execute a summation operation.
- the summation may be implemented the respective neuron by integrating incoming spikes into its inner potential (also referred to as inner state). How integration is physically implemented may depend on the hardware realization of the respective neuron (e.g., analogue or digital).
- the method 200 further comprises a step of transmitting (e.g., data or control signaling) in one or more OFDM symbols, which are generated in the time domain signal according to the frequency domain components.
- the frequency domain components may correspond to contiguous subcarriers.
- Each OFDM symbol may comprise a resource element on each subcarrier.
- Each resource element may carry a modulation symbol, e.g., according to quadrature amplitude modulation (QAM).
- QAM quadrature amplitude modulation
- the method 200 may be performed by the device 100.
- the modules 102, 104 and 106 e.g., in a single piece of neuromorphic hardware
- the technique may be applied to a transmission on an uplink (UL), downlink (DL) or direct communications between radio devices, e.g., device-to-device (D2D) communications or sidelink (SL) communications.
- UL uplink
- DL downlink
- D2D device-to-device
- SL sidelink
- Each of the transmitting station 100 and a corresponding receiving station may be a radio device or a base station.
- any radio device 100 may be a mobile or portable station and/or any radio device wirelessly connectable to a base station or RAN, or to another radio device.
- the radio device may be a user equipment (UE), a device for machine-type communication (MTC) or a device for (e.g., narrowband) Internet of Things (loT).
- UE user equipment
- MTC machine-type communication
- LoT narrowband Internet of Things
- Two or more radio devices may be configured to wirelessly connect to each other, e.g., in an ad hoc radio network or via a 3GPP SL connection.
- any base station may be a station providing radio access, may be part of a radio access network (RAN) and/or may be a node connected to the RAN for controlling the radio access.
- the base station may be an access point, for example a Wi-Fi access point.
- the technique may be embodied by a method 200 for mapping a spiking activity of the input neurons 102 (e.g., 0 meaning no event, 1 as spike event being indicative of a baseline, or optionally: two input neurons (indicative of 0 or +1 and 0 or -1, respectively) for each of real part and imaginary part of the frequency domain component.
- a spiking activity of the input neurons 102 e.g., 0 meaning no event, 1 as spike event being indicative of a baseline, or optionally: two input neurons (indicative of 0 or +1 and 0 or -1, respectively) for each of real part and imaginary part of the frequency domain component.
- Embodiments of the technique may provide an OFDM radio waveform as the time domain signal, e.g., wherein each of the output neuron 106 in a population is mapped to a distinct OFDM subcarrier and/or the spiking activity of that neuron is indicated by the modulation of that subcarrier.
- the modulation scheme is less complex than QAM 64.
- the modulation may use OOK, PSK, and/or QPSK.
- the time domain signal (e.g., the time domain OFDM signal) may be generated by executing the Inverse Fourier Transform with the output neurons 106 (e.g., an output neuron population).
- the neuromorphic couplings 104 may be part of the output neurons.
- every input neuron 102 may be connected to every output neuron 106 such that the weights (i.e., the connection weight matrix) corresponds to the Fourier coefficients.
- the output neurons 106 may comprise one output neuron population (i.e. a first output set) for the real part corresponding to the quadrature signal component and another set (i.e., a second output set) of output neurons corresponding to the imaginary part of the signal.
- the real and imaginary Fourier components of the DFT are applied as the weights (i.e., the connection weight matrix) for the real and imaginary neuron populations, respectively, i.e., for the first and second output set, respectively.
- a membrane potential of each output neuron may be configured to store an analogue value of the respective one of the time domain component, i.e., of the time domain signal at consecutive time samples.
- the output neuron may or may not be capable of generating a spike and/or may or may not comprise a spiking threshold for outputting a spike.
- the spiking threshold may be set high enough such that the output neurons never spikes (e.g., at least during the neuromorphic computation of the IDFT). For example, the threshold is set higher than the largest possible value of the input sum.
- the output neurons do not spike at any circumstances, otherwise the inner potential could incorrectly store the value resulting from the IDFT (i.e., the time domain component).
- the technique may be implemented by using the input neurons and/or output neurons in a very special way.
- the membrane potential of the output neurons may be read out in a circular fashion to obtain a time series of the resulting time domain signal (e.g., OFDM signal).
- a time series of the resulting time domain signal e.g., OFDM signal
- a length of the time samples is set according to (e.g., predefined or configured) subcarrier spacing (SCS) and sampling frequency.
- SCS subcarrier spacing
- the time series complex-valued signal samples (i.e., the time domain components) may be used as the input to a quadrature modulator.
- a neuromorphic computation 300 of the inverse Discrete Fourier Transform (IDFT or an inverse DFT) is applied to generate OFDM radio waveform as the time domain signal or the receive the OFDM radio waveform for demodulating of the frequency components in the frequency domain.
- IDFT inverse Discrete Fourier Transform
- inverse DFT inverse Discrete Fourier Transform
- the input data may result directly or indirectly from an application, and/or from a radio communication protocol stack 302, implemented at a radio device (e.g., UE) embodying the device 100.
- a radio device e.g., UE
- an application layer at the top of the protocol stack may provide the data that is processed by the radio communication protocol stack 302.
- a physical layer (PHY) 304 of the stack 302 may output the frequency domain components for the input neurons 306 (e.g., the input neurons 102).
- the input data is assumed to be in the form of binary, typically high-dimensional vectors. These vectors are represented via the neural activity of a group of input neurons 306.
- one layer of input neurons 306 is used, wherein there is one neuron corresponding to each vector dimension.
- a spiking activity 308 of the input neuron 306 encodes a binary value of the respective vector dimension. This means that when the vector has a binary value of 1, the corresponding input neuron 306 emits a spike 308, otherwise the input neuron 306 remains silent.
- the input neurons 306 do not have to be in synchronization, e.g., as long as a decay time of the membrane potential 314 of the input neurons 306 is longer than a time offset between the spikes 308.
- the input neurons 306 and/or the output neurons 312 may be reset.
- a condition for including spikes in the same computation of the IDFT may be that a delay offset between the spikes of the input neurons 306 is less than a symbol time (e.g., a length of an OFDM symbol). That is, all input spikes should arrive at the input neurons 306 before the next read-out happens on the output neurons 312.
- the read-out may be performed done with periodicity of the symbol time.
- the spikes representing the active vector dimensions do not necessarily have to happen synchronously. They may arrive asynchronously (e.g., within some time window) and this will not affect the resulting computation. This can be an important advantage and simplification in many applications, if strict time synchronization of the input neurons 308 can be omitted.
- a data vector as the binary values of the frequency domain components may be not encoded, stored and/or processed as a vector of integers or Booleans as in a conventional compute architecture.
- the spike patterns at the input neurons 306 and/or the output neurons 312 may represent the information and there is no separate memory elements for storing the respective components.
- the information vector may be stored in pieces in the inner states (e.g., the membrane potentials 314) of the individual neurons 306 and/or 312.
- the weights 310 corresponding to the DFT may encode the minus sign for mapping the second one of each of the pairs of input neurons 306.
- the first input neuron 306 of the respective pair fires, it corresponds to the value of 1, when the other second input neuron 306 of the pair fires, then it corresponds to the value of -1.
- none of them fires it means a value of 0.
- one input neuron 306 may correspond to the binary value of the real part of the complex-valued frequency domain component.
- Another input neuron 306 may correspond to the binary value of the imaginary part of the respective one of the frequency domain components.
- Each of the real and imaginary parts of the respective one of the frequency domain components are binary.
- each of the real and imaginary parts of the respective one of the frequency domain components may be represented by 2 neurons, which may allow to encode the values +1, -1, 0 for the respective part.
- the dimensioned vector e.g., the one binary value, or the two (i.e. pair of) binary values or the four (i.e., group of) binary values associated to one of the input neurons 306, is logically mapped to a frequency domain components (e.g., OFDM subcarriers), e.g., in a one-to-one manner (e.g., one pair or one group is reported to one subcarrier).
- a frequency domain components e.g., OFDM subcarriers
- each of the input neurons 306 may be connected with one of the frequency domain components.
- the one or multiple input neurons 306 encoding the given vector dimension value is or are connected to output neurons 312 (e.g., a second neuron layer), optionally where the IDFT computation 300 is performed (i.e., the neuromorphic coupling 300 may be an input part of the output neurons 312).
- the weights 310 e.g., a connection matrix
- Fig. 4 schematically illustrates an example of the neuromorphic coupling 300 of an IDFT neuron bank 306, 312 (i.e., the input and output neurons) and connectivity weights 310 for a 1/0 encoded input, i.e. one binary input value is associated with one frequency domain component (e.g., one subcarrier).
- Fig. 5 schematically illustrates an example of the neuromorphic coupling 300 of an IDFT neuron bank 306, 312 (i.e., the input and output neurons) and connectivity weights 310 for +1/-1/0 encoded input, i.e. a pair of two binary input value being associated with one frequency domain component (e.g., one subcarrier).
- IDFT neuron bank 306, 312 i.e., the input and output neurons
- connectivity weights 310 for +1/-1/0 encoded input, i.e. a pair of two binary input value being associated with one frequency domain component (e.g., one subcarrier).
- the neuromorphic coupling 300 may be composed of an input neuron bank with one (e.g., according to the embodiment of Fig. 4) or more (e.g., according to the embodiment of Fig. 5) input neurons 306 per frequency domain component (e.g., per vector dimension) and two output neuron banks (for a pair of output neurons 312) per time domain component.
- One output neuron 312 per time domain component is for the real part of the resulting IDFT computation.
- Another output neuron 312 per time domain component is for the imaginary value of the IDFT.
- f .2n:kn e J N 1 wherein the index n corresponds to the n-th output neuron 312 on the output (i.e., in the time domain). That is, for the n-th output neuron 312 on the output, the weights 310 from the k-t h input neuron 306 is according to the above expressions.
- Fig. 3 further schematically illustrates applying the neuromorphic IDFT computation 300 in an OFDM transmitter.
- a memory of each of the neurons 306, 312 may correspond to an inner potential 314 (e.g., membrane potential), which is represented by voltage.
- DAC digital to analog converter
- the neuromorphic hardware 300, 306, 312 may be implemented in an analog domain and/or digital domain.
- the neuromorphic hardware 300, 306, 312 may achieve energy efficiency, because the neuromorphic computation is event- driven.
- (binary-valued) input neurons 306 per frequency domain component e.g., encoding the input data vector
- input neuron banks there are 2 or 4, or more, input neuron banks on the input and these input neuron banks are connected to the first and second output set of output neuron, i.e., the real and imaginary output banks, with weights from the IDFT modified with the value that the given input neuron corresponds to.
- the input neurons 306 encoding the value of +1 are connected with the corresponding real and imaginary IDFT weights multiplied with +1, while the input neurons 306 encoding the value of -1 are connected with the IDFT weights multiplied with -1, e.g., as illustrated in Fig. 5.
- the input connections can be constructed in a similar way in case the input vector is complexed valued and is represented by 2 or 4 neurons (depending on whether 0/+1 or +1/-1/0 are the possible values both for the "Real” and “Imag” components).
- the only difference as compared to the connectivity structure in Fig. 4 is that the input neuron banks for the "Real” and “Imag” components need to be connected only to the "Real” and “Imag” output neurons, respectively.
- the computation happens by the input spikes summing up with the respective weighting in the membrane potential of the output neurons. We note that the spikes of the input neurons do not need to occur synchronously at once. The computation is not impacted if the input spikes arrive asynchronously.
- the inner potential 314 of output neuron n representing the real part of the IDFT value for time sample n is: which is exactly the IDFT formula.
- the inner potential 314 of the n-th output neuron 312 representing the imaginary part of the IDFT value is:
- the next step in the execution in Fig. 3 is to read out the resulting IDFT output from the output neurons 312 and create an analogue valued time series signal, which can be directly used for carrier modulation, e.g., to make quadrature modulation in our case.
- the membrane potential 314 of the output neurons will store the resulting IDFT value. What remains is to access the inner state of the neurons and read out the membrane potential. It may depend on the particular neuron hardware realization how the access to the neuron inner state is provided but it is typically available in most of the neuron implementations.
- a simple digital circuitry composed of a digital counter plus demultiplexer, where the counter is stepped through the time step indices (i.e., corresponding to the output neurons) and the demultiplexer activates the respective output circuit, which drives a switching element (e.g., a MOSFET transistor), which switches the given neuron inner potential circuit to the output.
- a switching element e.g., a MOSFET transistor
- the same switching mechanism may be applied for the first and second output set of output neurons 314 for the real and imaginary neurons in parallel, resulting in the complexed value components on the in-phase (I) and quadrature (Q) lines, respectively, which eventually may drive a quadrature modulator directly.
- Any embodiment may use at least one of the following features of neuromorphic computing.
- Neuromorphic hardware 300 e.g., Spiking Neural Networks (SNNs) may be designed to mimic the operation of biological neurons and their spike-based communication.
- SNNs Spiking Neural Networks
- spikes all the information carried between the neurons are represented by spikes.
- a spike itself can be considered as binary data, wherein the presence of a spike implicitly carries the information.
- An example for devices generating spike type of data are neuromorphic or event cameras, wherein each pixel directly feeds corresponding one or more neurons, and these neurons emit spikes when the change in light intensity exceeds a predefined threshold.
- sensors such as artificial cochlea, skin or touch sensors are directly generating spikes as output signal, or actuators, like robotic arms, which can be controlled via spike signals.
- actuators like robotic arms, which can be controlled via spike signals.
- chips executing neuromorphic computing as opposed to traditional arithmetic compute, suitable to process e.g., the outputs of neuromorphic sensors.
- a neuron model The basic operation of a neuron model is illustrated in Fig. 6.
- Each spike received on any of the input synapses of the neuron increase the voltage potential of the neuron and when it reaches a threshold, the neuron emits an output spike.
- It is also called as integrate and fire neuron model.
- An SNN is a collection of many hundreds or thousands of such neurons, which are inter-connected via synapses according to below model. The connections are not full mesh and are typically localized.
- Fig. 6 schematically illustrates a neuron model 300 (i.e., a part of the neuromorphic hardware) including weights 310 for the mapping at an output neuron 312.
- the information may be encoded into a rate of spikes or into a timing of individual spikes, e.g. as indicated in Figs. 7A and 7B, respectively.
- a higher spike rate might be the representation of a larger numerical number.
- the relative time between spikes or in relation to some reference may carry information, e.g., a larger relative delay between spikes may indicate a larger encoded numerical value as compared to the first spike.
- delay jitters occur, they can obviously distort the encoded value and can cause noise and inaccuracies in the neuromorphic system.
- Figs. 7A and 7B illustrate examples or a rate-based and time-based neural encoding.
- the above embodiments can fulfill special requirements for radio technology to effectively support distributed neuromorphic computation.
- the radio technology needs to have the following capabilities: (i) low delay and low jitter to preserve the time sensitive aspect of spike information encoding; (ii) medium access and resource allocation methods must support unpredictable and/or burst-like traffic patterns; (iii) both unicast and groupcast communication will be needed to effectively support dense, local inter-neuron connectivity, as well as, sparse and remote synapses; (iv) usual loss and Block Error Rate (BLER) mitigation algorithms, like radio retransmission or large transmission buffer sizes may be applied only with significant limitations.
- BLER Block Error Rate
- any embodiment may implement at least one of the following neuromorphic hardware implementation options.
- Embodiments of the neuromorphic IDFT computation 300 and the device 100 can be applied on any neuromorphic hardware.
- the hardware may be generally distinguished between analogue and digital neuromorphic hardware chips.
- Embodiments of the method 200 are not restricted to any of these. For illustration, some guidelines for the different implementation cases are summarized below.
- An analogue implementation of a neuromorphic chip can be as simple as a capacitor, a resistor and a comparator circuit, e.g. as schematically illustrated in Fig. 8.
- the input current whose source can be a spike from an upstream neuron loads the capacitor 314.
- the capacitor has a constant leakage via the resistor.
- the voltage on the capacitor is the membrane potential of the neuron.
- the resulting value of the given IDFT component may be stored in the membrane potential 314 of the neuron 312.
- the membrane potential 314 of the neuron 312 is fed into a comparator and when it reaches a threshold, a voltage spike is emitted on the output. Otherwise, the voltage 314 of the capacitor is directly at the output 314.
- An analogue neuromorphic chip may be composed of thousands of such simple circuitry elements, which need to be connected with a programmable interconnect circuitry.
- the weights 310 on the synaptic inter-connections may be set e.g., by selecting the resistor value on the inter-connections.
- the neuron circuit parameters, such as R, C or the voltage threshold, together with possibly other neuron parameters are programmable in a similar way.
- Fig. 8 schematically illustrates a simple example on an implementation of an analogue neuron 312.
- neuromorphic hardware elements may implement the neuron operations in a digital way.
- the neuro chip may consists of so called neural cores, where each neural core implement a number of single neurons as simple elementary compute and memory element.
- the neuron computation is programmable with a largely reduced instruction set, which is the minimal instructions needed to compute the neuron state updates. The computation is triggered based on the input event, i.e., if no event is received no state update needs to be computed.
- digital encoded, short mini-packets need to be routed on the on-chip network between the cores.
- the communication and neuron state updates may be done in a synchronous way, meaning that the state updates happen in sync at all neurons or it can be done in an asynchronous way.
- Both the analogue and the digital neuron implementation exhibit the benefit of largely parallel computation, as state updates happen at each neuron in parallel, energy efficiency, meaning that computation is event based and no energy is consumed when there is no input event. For example, when the input data has a value of zero at some dimensions, there will be no spike events, consequently no computation will be performed for the zero components. This is in contrast to conventional matrix arithmetic where the same multiplication, summation is performed for the zero valued components as well, consuming the same energy independent of the value to be computed.
- the device 100 may be embodied by radio devices, e.g., UEs, in a (e.g., cellular) radio access network 900 comprising base stations 902 (e.g., network nodes) each serving one or more cells 904.
- the device may be embodied by radio devices 100 in direct (e.g., sidelink) communication.
- Fig. 10 shows a schematic block diagram for an embodiment of the device 100.
- the device 100 comprises neuromorphic hardware embodying the device 100 for performing the method 200.
- the device 100 may be embodied by a radio device 1000, e.g., a transmitting UE (or, alternatively, by a base station, e.g., a gNodeB).
- a radio device 1000 e.g., a transmitting UE (or, alternatively, by a base station, e.g., a gNodeB).
- the radio device 1000 comprises a radio interface 1002 coupled to the device 100 for radio communication (e.g., radio transmission of the generated time domain signal) with one or more receiving stations, e.g., functioning as a receiving base station or a receiving UE.
- radio communication e.g., radio transmission of the generated time domain signal
- receiving stations e.g., functioning as a receiving base station or a receiving UE.
- the radio device 100 may or may not further comprise processing circuitry 1008, e.g., one or more processors 1004 and memory 1006 coupled to the processors 1004.
- the memory 1006 may be encoded with instructions that implement radio communication protocols and/or for providing the binary-valued frequency domain components to the device 100.
- the radio device comprises no regular CPU and memory.
- the device 100 may comprise exclusively neuromorphic hardware.
- the radio device 100 replaces regular protocol stacks (e.g., at least one of PDCP, RLC, and MAC) by neuromorphic hardware.
- the device comprises at least one of an ASICS, FPGA, and a CPU for some auxiliary tasks.
- the neuromorphic hardware embodying the device 100 may comprise a spiking neural network (SNN).
- the processing circuitry 1008 may obey a von- Neumann architecture.
- the one or more processors 1004 may be a combination of one or more of a microprocessor, controller, microcontroller, central processing unit, digital signal processor, application specific integrated circuit, field programmable gate array, or any other suitable computing device, resource, or combination of hardware, microcode and/or encoded logic operable to provide, either alone or in conjunction with other components of the radio device 1000, such as the memory 1006 and/or the neuromorphic hardware of the device 100, transmitter functionality.
- the one or more processors 1004 may execute instructions stored in the memory 1006. Such functionality may include providing, or triggering, various features and steps discussed herein, including any of the benefits disclosed herein.
- the expression "the device being operative to perform an action” may denote the device 100 being configured to perform the action.
- a communication system 1100 includes a telecommunication network 1110, such as a 3GPP-type cellular network, which comprises an access network 1111, such as a radio access network, and a core network 1114.
- the access network 1111 comprises a plurality of base stations 1112a, 1112b, 1112c, such as NBs, eNBs, gNBs or other types of wireless access points, each defining a corresponding coverage area 1113a, 1113b, 1113c.
- Each base station 1112a, 1112b, 1112c is connectable to the core network 1114 over a wired or wireless connection 1115.
- a first user equipment (UE) 1191 located in coverage area 1113c is configured to wirelessly connect to, or be paged by, the corresponding base station 1112c.
- a second UE 1192 in coverage area 1113a is wirelessly connectable to the corresponding base station 1112a. While a plurality of UEs 1191, 1192 are illustrated in this example, the disclosed embodiments are equally applicable to a situation where a sole UE is in the coverage area or where a sole UE is connecting to the corresponding base station 1112.
- Any of the base stations 1112 and the UEs 1191, 1192 may embody the device 100.
- the telecommunication network 1110 is itself connected to a host computer 1130, which may be embodied in the hardware and/or software of a standalone server, a cloud-implemented server, a distributed server or as processing resources in a server farm.
- the host computer 1130 may be under the ownership or control of a service provider, or may be operated by the service provider or on behalf of the service provider.
- the connections 1121, 1122 between the telecommunication network 1110 and the host computer 1130 may extend directly from the core network 1114 to the host computer 1130 or may go via an optional intermediate network 1120.
- the intermediate network 1120 may be one of, or a combination of more than one of, a public, private or hosted network; the intermediate network 1120, if any, may be a backbone network or the Internet; in particular, the intermediate network 1120 may comprise two or more sub-networks (not shown).
- the communication system 1100 of Fig. 11 as a whole enables connectivity between one of the connected UEs 1191, 1192 and the host computer 1130.
- the connectivity may be described as an over-the-top (OTT) connection 1150.
- the host computer 1130 and the connected UEs 1191, 1192 are configured to communicate data and/or signaling via the OTT connection 1150, using the access network 1111, the core network 1114, any intermediate network 1120 and possible further infrastructure (not shown) as intermediaries.
- the OTT connection 1150 may be transparent in the sense that the participating communication devices through which the OTT connection 1150 passes are unaware of routing of uplink and downlink communications.
- a base station 1112 need not be informed about the past routing of an incoming downlink communication with data originating from a host computer 1130 to be forwarded (e.g., handed over) to a connected UE 1191. Similarly, the base station 1112 need not be aware of the future routing of an outgoing uplink communication originating from the UE 1191 towards the host computer 1130.
- the energy consumption and/or CO2 emissions of the OTT connection 1150 can be reduced.
- a host computer 1210 comprises hardware 1215 including a communication interface 1216 configured to set up and maintain a wired or wireless connection with an interface of a different communication device of the communication system 1200.
- the host computer 1210 further comprises processing circuitry 1218, which may have storage and/or processing capabilities.
- the processing circuitry 1218 may comprise one or more programmable processors, application-specific integrated circuits, field programmable gate arrays or combinations of these (not shown) adapted to execute instructions.
- the host computer 1210 further comprises software 1211, which is stored in or accessible by the host computer 1210 and executable by the processing circuitry 1218.
- the software 1211 includes a host application 1212.
- the host application 1212 may be operable to provide a service to a remote user, such as a UE 1230 connecting via an OTT connection 1250 terminating at the UE 1230 and the host computer 1210.
- the host application 1212 may provide user data, which is transmitted using the OTT connection 1250.
- the user data may depend on the location of the UE 1230.
- the user data may comprise auxiliary information or precision advertisements (also: ads) delivered to the UE 1230.
- the OTT connection 1250 may carry neuromorphic data and/or the user data may comprise neuromorphic data.
- the neuromorphic data may comprise data from a neuromorphic service, e.g., neuromorphic implementation of artificial intelligence (Al, or Al application).
- the location may be reported by the UE 1230 to the host computer, e.g., using the OTT connection 1250, and/or by the base station 1220, e.g., using a connection 1260.
- the communication system 1200 further includes a base station 1220 provided in a telecommunication system and comprising hardware 1225 enabling it to communicate with the host computer 1210 and with the UE 1230.
- the hardware 1225 may include a communication interface 1226 for setting up and maintaining a wired or wireless connection with an interface of a different communication device of the communication system 1200, as well as a radio interface 1227 for setting up and maintaining at least a wireless connection 1270 with a UE 1230 located in a coverage area (not shown in Fig. 12) served by the base station 1220.
- the communication interface 1226 may be configured to facilitate a connection 1260 to the host computer 1210.
- the connection 1260 may be direct, or it may pass through a core network (not shown in Fig. 12) of the telecommunication system and/or through one or more intermediate networks outside the telecommunication system.
- the hardware 1225 of the base station 1220 further includes processing circuitry 1228, which may comprise one or more programmable processors, application-specific integrated circuits, field programmable gate arrays or combinations of these (not shown) adapted to execute instructions.
- the base station 1220 further has software 1221 stored internally or accessible via an external connection.
- the communication system 1200 further includes the UE 1230 already referred to.
- Its hardware 1235 may include a radio interface 1237 configured to set up and maintain a wireless connection 1270 with a base station serving a coverage area in which the UE 1230 is currently located.
- the hardware 1235 of the UE 1230 further includes processing circuitry 1238, which may comprise one or more programmable processors, application-specific integrated circuits, field programmable gate arrays or combinations of these (not shown) adapted to execute instructions.
- the UE 1230 further comprises software 1231, which is stored in or accessible by the UE 1230 and executable by the processing circuitry 1238.
- the software 1231 includes a client application 1232.
- the client application 1232 may be operable to provide a service to a human or non-human user via the UE 1230, with the support of the host computer 1210.
- an executing host application 1212 may communicate with the executing client application 1232 via the OTT connection 1250 terminating at the UE 1230 and the host computer 1210.
- the client application 1232 may receive request data from the host application 1212 and provide user data in response to the request data.
- the OTT connection 1250 may transfer both the request data and the user data.
- the client application 1232 may interact with the user to generate the user data that it provides.
- the host computer 1210, base station 1220 and UE 1230 illustrated in Fig. 12 may be identical to the host computer 1130, one of the base stations 1112a, 1112b, 1112c and one of the UEs 1191, 1192 of Fig. 11, respectively.
- the inner workings of these entities may be as shown in Fig. 12, and, independently, the surrounding network topology may be that of Fig. 11.
- the OTT connection 1250 has been drawn abstractly to illustrate the communication between the host computer 1210 and the UE 1230 via the base station 1220, without explicit reference to any intermediary devices and the precise routing of messages via these devices.
- Network infrastructure may determine the routing, which it may be configured to hide from the UE 1230 or from the service provider operating the host computer 1210, or both. While the OTT connection 1250 is active, the network infrastructure may further take decisions by which it dynamically changes the routing (e.g., on the basis of load balancing consideration or reconfiguration of the network).
- the wireless connection 1270 between the UE 1230 and the base station 1220 is in accordance with the teachings of the embodiments described throughout this disclosure.
- One or more of the various embodiments improve the performance of OTT services provided to the UE 1230 using the OTT connection 1250, in which the wireless connection 1270 forms the last segment. More precisely, the teachings of these embodiments may reduce the latency and improve the data rate and thereby provide benefits such as better responsiveness and improved QoS.
- a measurement procedure may be provided for the purpose of monitoring data rate, latency, QoS and other factors on which the one or more embodiments improve.
- the measurement procedure and/or the network functionality for reconfiguring the OTT connection 1250 may be implemented in the software 1211 of the host computer 1210 or in the software 1231 of the UE 1230, or both.
- sensors may be deployed in or in association with communication devices through which the OTT connection 1250 passes; the sensors may participate in the measurement procedure by supplying values of the monitored quantities exemplified above, or supplying values of other physical quantities from which software 1211, 1231 may compute or estimate the monitored quantities.
- the reconfiguring of the OTT connection 1250 may include message format, retransmission settings, preferred routing etc.; the reconfiguring need not affect the base station 1220, and it may be unknown or imperceptible to the base station 1220. Such procedures and functionalities may be known and practiced in the art.
- measurements may involve proprietary UE signaling facilitating the host computer's 1210 measurements of throughput, propagation times, latency and the like.
- the measurements may be implemented in that the software 1211, 1231 causes messages to be transmitted, in particular empty or "dummy" messages, using the OTT connection 1250 while it monitors propagation times, errors etc.
- Fig. 13 is a flowchart illustrating a method implemented in a communication system, in accordance with one embodiment.
- the communication system includes a host computer, a base station and a UE which may be those described with reference to Figs. 11 and 12. For simplicity of the present disclosure, only drawing references to Fig. 13 will be included in this paragraph.
- the host computer provides user data.
- the host computer provides the user data by executing a host application.
- the host computer initiates a transmission carrying the user data to the UE.
- the base station transmits to the UE the user data which was carried in the transmission that the host computer initiated, in accordance with the teachings of the embodiments described throughout this disclosure.
- the UE executes a client application associated with the host application executed by the host computer.
- Fig. 14 is a flowchart illustrating a method implemented in a communication system, in accordance with one embodiment.
- the communication system includes a host computer, a base station and a UE which may be those described with reference to Figs. 11 and 12. For simplicity of the present disclosure, only drawing references to Fig. 14 will be included in this paragraph.
- the host computer provides user data.
- the host computer provides the user data by executing a host application.
- the host computer initiates a transmission carrying the user data to the UE. The transmission may pass via the base station, in accordance with the teachings of the embodiments described throughout this disclosure.
- the UE receives the user data carried in the transmission.
- At least some embodiments of the technique can be directly mapped to existing, general purpose neuromorphic hardware and to available neuron models. Some embodiments do not require special purpose components. For example, there is no need for components that scale and transcode the analogue input signals.
- Same or further embodiments supports spike-based input (e.g., as opposed to analogue-based encoding) for which DFT is to be computed.
- spike-based input e.g., as opposed to analogue-based encoding
- DFT digital filter
- the input needs not (e.g., the binary-valued frequency domain components need not) to be synchronized (e.g., spikes corresponding to different frequency domain components may arrive asynchronously).
- the computation in the device 100 may be fully event driven. The computation may start when the event arrives.
- Same or further embodiments can store the result in the neuron states of the output neuron, e.g., in the membrane potential as local memory of the output neurons.
- the output may correspond to inner (e.g., membrane) potential of the output neurons.
- Same or further embodiments allow a highly energy efficient implementation of the DFT computation and/or can be directly applied e.g., in low-power or zeroenergy loT transceiver devices for signal processing operations.
- a radio transceiver based completely on neuromorphic hardware, e.g., that does not include conventional central processing unit (CPU) or digital signal processor (DSP) or graphics processing unit (GPU) and memory elements.
- CPU central processing unit
- DSP digital signal processor
- GPU graphics processing unit
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Biomedical Technology (AREA)
- Biophysics (AREA)
- General Health & Medical Sciences (AREA)
- General Physics & Mathematics (AREA)
- Evolutionary Computation (AREA)
- Computational Linguistics (AREA)
- Molecular Biology (AREA)
- Computing Systems (AREA)
- General Engineering & Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Mathematical Physics (AREA)
- Software Systems (AREA)
- Artificial Intelligence (AREA)
- Neurology (AREA)
- Power Engineering (AREA)
- Digital Transmission Methods That Use Modulated Carrier Waves (AREA)
Abstract
L'invention concerne un dispositif (100) servant à générer un signal du domaine temporel sur la base de composantes du domaine fréquentiel à valeur binaire. Le dispositif (100) comprend des neurones d'entrée (102 ; 306) représentant des valeurs binaires des composantes du domaine fréquentiel à valeur binaire ; des couplages neuromorphiques (104 ; 300) configurés pour associer aux composantes du domaine fréquentiel à valeur binaire des composantes du domaine temporel du signal du domaine temporel en utilisant des poids conformes à une transformation de Fourier discrète inverse, IDFT ; et des neurones de sortie (106 ; 312) représentant les composantes du domaine temporel du signal du domaine temporel, chacun des neurones de sortie (106 ; 312) étant configuré pour faire la somme de contributions associées à ce neurone respectif des neurones de sortie (106 ; 312) par les couplages neuromorphiques (104 ; 300) partant de chacun des neurones d'entrée (102 ; 306).
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US202263357135P | 2022-06-30 | 2022-06-30 | |
US63/357,135 | 2022-06-30 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2024003374A1 true WO2024003374A1 (fr) | 2024-01-04 |
Family
ID=87155670
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/EP2023/068056 WO2024003374A1 (fr) | 2022-06-30 | 2023-06-30 | Technique de transformation de fourier |
Country Status (1)
Country | Link |
---|---|
WO (1) | WO2024003374A1 (fr) |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10664271B2 (en) | 2016-01-30 | 2020-05-26 | Hewlett Packard Enterprise Development Lp | Dot product engine with negation indicator |
US20200356847A1 (en) | 2019-05-07 | 2020-11-12 | Hrl Laboratories, Llc | Transistorless all-memristor neuromorphic circuits for in-memory computing |
US20210326689A1 (en) | 2016-07-14 | 2021-10-21 | University Of Dayton | Analog neuromorphic circuits for dot-product operation implementing resistive memories |
-
2023
- 2023-06-30 WO PCT/EP2023/068056 patent/WO2024003374A1/fr unknown
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10664271B2 (en) | 2016-01-30 | 2020-05-26 | Hewlett Packard Enterprise Development Lp | Dot product engine with negation indicator |
US20210326689A1 (en) | 2016-07-14 | 2021-10-21 | University Of Dayton | Analog neuromorphic circuits for dot-product operation implementing resistive memories |
US20200356847A1 (en) | 2019-05-07 | 2020-11-12 | Hrl Laboratories, Llc | Transistorless all-memristor neuromorphic circuits for in-memory computing |
Non-Patent Citations (3)
Title |
---|
QUNSONG ZENG ET AL: "Realizing Ultra-Fast and Energy-Efficient Baseband Processing Using Analogue Resistive Switching Memory", ARXIV.ORG, CORNELL UNIVERSITY LIBRARY, 201 OLIN LIBRARY CORNELL UNIVERSITY ITHACA, NY 14853, 7 May 2022 (2022-05-07), XP091221942 * |
ROSEMARIE VELIK: "Discrete Fourier Transform Computation Using Neural Networks", COMPUTATIONAL INTELLIGENCE AND SECURITY, 2008. CIS '08. INTERNATIONAL CONFERENCE ON, IEEE, PISCATAWAY, NJ, USA, 13 December 2008 (2008-12-13), pages 120 - 123, XP031379092, ISBN: 978-0-7695-3508-1 * |
VERES ANDRÁS ET AL: "A Communication Data Layer for Distributed Neuromorphic Systems", ARTIFICIAL INTELLIGENCE APPLICATIONS AND INNOVATIONS : 18TH IFIP WG 12.5 INTERNATIONAL CONFERENCE, AIAI 2022, HERSONISSOS, CRETE, GREECE, JUNE 17-20, 2022, PROCEEDINGS, PART II, vol. 647, 10 June 2022 (2022-06-10), Cham, pages 3 - 16, XP093078476, ISBN: 978-3-031-08337-2, Retrieved from the Internet <URL:https://link.springer.com/content/pdf/10.1007/978-3-031-08337-2_1> [retrieved on 20230904], DOI: 10.1007/978-3-031-08337-2_1 * |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
Shahab et al. | Grant-free non-orthogonal multiple access for IoT: A survey | |
Ye et al. | End-to-end quality of service in 5G networks: Examining the effectiveness of a network slicing framework | |
US20230209390A1 (en) | Intelligent Radio Access Network | |
US20210345134A1 (en) | Handling of machine learning to improve performance of a wireless communications network | |
Bormann et al. | Coap: An application protocol for billions of tiny internet nodes | |
US11617094B2 (en) | Machine learning in radio access networks | |
CN103329611B (zh) | 管理越过无线网络的通信 | |
CN109417761A (zh) | 在移动设备中启用低功率模式 | |
US20180198502A1 (en) | Method and device for determining rank-related information in wireless communication system | |
Qiu et al. | A novel QoS-enabled load scheduling algorithm based on reinforcement learning in software-defined energy internet | |
CN109121192A (zh) | 高效的扫描和服务发现 | |
EP4335133A1 (fr) | Capacité d'ue pour l'ai/am | |
Asadi et al. | DORE: An experimental framework to enable outband D2D relay in cellular networks | |
US11197223B2 (en) | Method and apparatus for determining transmission path of packet in wireless communication | |
Hassan et al. | MoT: A deterministic latency MAC protocol for mission-critical IoT applications | |
Lopez-Perez et al. | A survey on 5g energy efficiency: Massive mimo, lean carrier design, sleep modes, and machine learning | |
CN103155677A (zh) | 用于蜂窝网络中的对等链路和无线广域网链路的联合调度的方法和装置 | |
Umamaheswari et al. | Internet of Things and RPL routing protocol: A study and evaluation | |
WO2023040971A1 (fr) | Procédé, appareil et système pour télécharger un modèle d'intelligence artificielle | |
CN109219114A (zh) | 唤醒无线电链路适配 | |
CN109219936A (zh) | 用于多连接中的可靠通信的装置和方法 | |
TW201408102A (zh) | 增強式功率節省最佳化組態處理技術 | |
EP4179838A1 (fr) | Technique d'activation d'entités de contrôle de liaison radio secondaires pour une duplication de paquets | |
US11805497B2 (en) | Method and apparatus for uplink transmission using MIMO in wireless communication system | |
Zhang et al. | Intelligent ultra-reliable and low latency communications: Security and flexibility |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 23738456 Country of ref document: EP Kind code of ref document: A1 |