EP3232684A1 - Procédé de transmission d'un signal audio provenant d'un émetteur à un récepteur - Google Patents

Procédé de transmission d'un signal audio provenant d'un émetteur à un récepteur Download PDF

Info

Publication number
EP3232684A1
EP3232684A1 EP17155770.5A EP17155770A EP3232684A1 EP 3232684 A1 EP3232684 A1 EP 3232684A1 EP 17155770 A EP17155770 A EP 17155770A EP 3232684 A1 EP3232684 A1 EP 3232684A1
Authority
EP
European Patent Office
Prior art keywords
reconstructed
prognosis
value
transmitter
created
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP17155770.5A
Other languages
German (de)
English (en)
Other versions
EP3232684B1 (fr
Inventor
Tobias Daniel Rosenkranz
Henning Puder
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sivantos Pte Ltd
Original Assignee
Sivantos Pte Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sivantos Pte Ltd filed Critical Sivantos Pte Ltd
Publication of EP3232684A1 publication Critical patent/EP3232684A1/fr
Application granted granted Critical
Publication of EP3232684B1 publication Critical patent/EP3232684B1/fr
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/50—Customised settings for obtaining desired overall acoustical characteristics
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/55—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception using an external connection, either wireless or wired
    • H04R25/554—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception using an external connection, either wireless or wired using a wireless connection, e.g. between microphone and amplifier or using Tcoils
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/02—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders
    • G10L19/032—Quantisation or dequantisation of spectral components
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/02—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders
    • G10L19/032—Quantisation or dequantisation of spectral components
    • G10L19/038—Vector quantisation, e.g. TwinVQ audio
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/038—Speech enhancement, e.g. noise reduction or echo cancellation using band spreading techniques
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/55—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception using an external connection, either wireless or wired
    • H04R25/552—Binaural
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
    • G10L25/03—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 characterised by the type of extracted parameters
    • G10L25/12—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 characterised by the type of extracted parameters the extracted parameters being prediction coefficients
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2225/00—Details of deaf aids covered by H04R25/00, not provided for in any of its subgroups
    • H04R2225/43—Signal processing in hearing aids to enhance the speech intelligibility
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2225/00—Details of deaf aids covered by H04R25/00, not provided for in any of its subgroups
    • H04R2225/51—Aspects of antennas or their circuitry in or for hearing aids
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2225/00—Details of deaf aids covered by H04R25/00, not provided for in any of its subgroups
    • H04R2225/53—Hearing aid for unilateral hearing impairment using Contralateral Routing Of Signals [CROS]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2430/00—Signal processing covered by H04R, not provided for in its groups
    • H04R2430/03—Synergistic effects of band splitting and sub-band processing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2460/00—Details of hearing devices, i.e. of ear- or headphones covered by H04R1/10 or H04R5/033 but not provided for in any of their subgroups, or of hearing aids covered by H04R25/00 but not provided for in any of its subgroups
    • H04R2460/03—Aspects of the reduction of energy consumption in hearing devices

Definitions

  • the invention relates to a method for transmitting an audio signal from a transmitter to a receiver.
  • the invention further relates to a hearing aid and a hearing aid system with two such hearing aids.
  • the hearing aid is preferably a hearing aid.
  • a hearing aid Persons suffering from a reduction in hearing usually use a hearing aid.
  • an ambient sound is usually detected by means of an electromechanical sound transducer.
  • the detected electrical signals are processed by means of an amplifier circuit and introduced by means of another electromechanical transducer in the ear canal of the person.
  • Different types of hearing aids are known.
  • the so-called “behind-the-ear devices” are worn between the skull and the auricle.
  • the introduction of the amplified sound signal into the ear canal takes place here by means of a sound tube.
  • Another common embodiment of a hearing aid is an "in-ear device" in which the hearing aid itself is inserted into the ear canal. Consequently, the auditory canal is at least partially closed by means of this hearing aid, so that no further sound - or only a greatly reduced amount of sound - can penetrate into the auditory canal, apart from the sound signals generated by the hearing aid.
  • a hearing aid system with two such hearing aid is used.
  • each of the ears is assigned to one of the hearing aids.
  • this requires transmission with only a comparatively small time offset.
  • the head of the person acts as an attenuation, which is why the transmission rate between the hearing aids is limited.
  • the limited energy storage of hearing aids and the otherwise excessive burden on the person a transmission power limited.
  • the invention has for its object to provide a particularly suitable method for transmitting an audio signal from a transmitter to a receiver and a particularly suitable hearing aid and a particularly suitable hearing aid system with two hearing aids, in particular an audio quality is improved, and preferably reduces a transmission rate is.
  • the method is for transmitting an audio signal from a transmitter to a receiver, wherein the transmitter or the receiver is preferably a component of a hearing device.
  • the respectively remaining element that is to say the transmitter or the receiver, is suitably a component of a further component of a hearing device system having the hearing device.
  • the hearing aid is a headphone or includes a headphone.
  • the hearing aid is particularly preferably a hearing aid.
  • the hearing aid is used to support a person suffering from a reduction in hearing.
  • the hearing aid is a medical device by means of which, for example, a partial hearing loss is compensated.
  • the hearing aid is, for example, a "receiver-in-the-canal" hearing aid (RIC), an in-the-ear hearing aid, such as an "in-the-ear” hearing aid.
  • ITC in-the-canal hearing aid
  • CIC complete-in-canal hearing aid
  • the hearing aid device is particularly preferably a behind-the-ear hearing aid device ("behind-the-ear” hearing aid device) which is worn behind an auricle.
  • the method provides that, at the transmitter end, an input signal corresponding to the audio signal is temporally divided into time windows, wherein the length of the time windows is preferably the same.
  • the length of the time window is, for example, between 0.5 ms and 2 ms and in particular equal to 1 ms.
  • the input signal is preferably the audio signal or in part thereof.
  • the audio signal is decomposed into different input signals, each input signal being respectively divided into different time windows, which differ in particular on the basis of their length.
  • the input signal is divided on the transmitter side into a number of frequency channels. On the transmitter side, each frequency channel is assigned a current channel value.
  • the channel value is, for example, an amplitude and / or a phase or a signal level.
  • the current channel values are divided into a first current data record and a second current data record, wherein the first current data record and the second current data record each comprise at least one of the current channel values.
  • the first current data record has only a single one of the current channel values.
  • a first prognosis for the first current data record is created on the transmitter side.
  • the creation takes place in particular such that a difference ("ubendikationstinct") between the first current record and the first prognosis is as small as possible.
  • the first forecast includes as many values as the first current record.
  • the first forecast includes only a single value.
  • the temporally preceding channel value has been assigned to one of the frequency channels one time slot earlier, for example the same frequency channel for which the prognosis is being compiled, in particular if the first current record comprises only a single one of the current channel values.
  • a number of temporally preceding channel values are used, whereby, for example, channel values from other frequency channels and / or channel values are used whose time interval varies.
  • a first deviation between the first prognosis and the first current dataset is determined, ie by how much the first prognosis and the first current dataset differ.
  • a second prognosis for the second current data record is created.
  • the second prognosis expediently comprises just as many values as the second current dataset, wherein the generation of the second prognosis takes place in particular such that a difference between the second current dataset and the second prognosis is as small as possible.
  • a second deviation between the second prognosis and the second current dataset is determined, ie by how much the second prognosis and the second current dataset differ.
  • a first transmission value corresponding to the first deviation is transmitted from the transmitter to the receiver, wherein the first transmission value is expediently first created on the transmitter side based on the first deviation.
  • the first transmission value preferably has a lower dimensionality or at most the same dimensionality as the first deviation, and is for example a one-dimensional value.
  • a second transmission value corresponding to the second deviation is transmitted by the transmitter to the receiver, wherein the second transmission value is expediently first created on the transmitter side on the basis of the second deviation.
  • the second transmission value preferably has a lower dimensionality or at most the same dimensionality as the second deviation, and is for example a multidimensional or particularly preferably a one-dimensional value.
  • the dimensionality of the first and second transmission values is the same.
  • a first reconstructed data record is created on the receiver side on the basis of a previously reconstructed output signal and the transmitted first transmission value.
  • a temporally preceding reconstructed output signal it is expedient to use a value or a data record which corresponds to the temporally preceding channel value present at the transmitter end. For example, zero (0) is used at the beginning of the method as the temporally preceding channel value or as a previously reconstructed output signal, or a specific value is first transmitted from the transmitter to the receiver, and both at the transmitter and at the receiver as temporally preceding channel value or used as temporally preceding reconstructed output signal.
  • the first reconstructed data record created in this way thus essentially corresponds to the first data record on the transmitter side, with differences preferably being present only on the basis of the generation of the first transmission value.
  • a second reconstructed data record is created on the receiver side based on the first reconstructed data record and the transmitted second transmission value.
  • additional data that are available on the receiver side are used for the creation.
  • the second reconstructed data record created in this way essentially corresponds to the second data record present on the transmitter side, with differences preferably being present only on the basis of the generation of the second transmission value and / or due to differences between the first reconstructed data record and the first data record.
  • the first reconstructed data set and the second reconstructed data record are combined on the receiver side into a reconstructed output signal.
  • the summary here is in particular the inverse function for the transmitter-side distribution of the current channel values into the first current data record and the second current data record, so that the transmitter-side distribution of the input signal into the frequency channels is present on the receiver side.
  • the reconstructed output signal essentially corresponds to the transmitter side existing distribution of the input signal in the frequency channels.
  • the reconstructed output signal is further processed and the individual frequencies are combined and transferred into the time domain.
  • the method is executed again, the reconstructed output signal is used and used as the previously preceding reconstructed output signal.
  • the method is executed again after the expiry of the specific time window.
  • the first transmission value is created as soon as the first deviation is created, and then transmitted directly thereafter to the receiver, in particular temporally before or at least simultaneously before the creation of the second prognosis.
  • the second prediction / the second deviation and the first reconstructed data record are essentially created at the same time, so that a simultaneous processing takes place on the transmitter and receiver side, which is why a transmission speed is increased.
  • the second prognosis is expediently also generated on the transmitter side on the basis of the temporally preceding channel value and the second reconstructed dataset on the receiver side based on the temporally preceding reconstructed output signal, wherein, for example, a number of temporally preceding reconstructed output signals or temporally preceding channel values are used. In this way, the second deviation is reduced.
  • a linear prediction is used to generate the first prognosis and the first reconstructed dataset.
  • a linear prediction is used to generate the second prognosis and the second reconstructed dataset.
  • each value is created by means of a linear combination, wherein preferably a number of temporally preceding channel values, a number of temporally preceding reconstructed output signals, a number of first current data records or a number of first reconstructed data records are used.
  • x (n) denotes the first prognosis, the first reconstructed dataset, the second prognosis or the second reconstructed dataset.
  • a i denotes a coefficient
  • A a coefficient matrix and y the totality of the values used for the generation, in particular the temporally preceding channel values, the temporally preceding reconstructed output signals, the first current data sets or the first reconstructed data records, in particular a number of such Values are used, the respective date of their creation differs.
  • the creation time here is n - i, and the number used is N.
  • One kind of linear prediction is, for example, in " Benesty, J., Chen, J., & Huang, Y. (Arden). (2008). Linear Prediction. In J. Benesty, MM Sondhi, & Y. (Arden) Huang (Eds.), Springer Handbook of Speech Processing (pp. 111-125). Springer Verlag "revealed, especially in Chapter 7.2 (page 112 -113 ), in particular formula 7.6, and in particular in Chapter 7.9 (Page 120 -124 ), in particular formula 7.108.
  • the input signal is divided into the frequency channels by means of a Fourier transformation.
  • particularly preferred channel filter are used, which are preferably combined in a filter bank.
  • the first transmission value is created by quantizing the first deviation
  • / or the second transmission value is created by quantizing the second deviation.
  • the first deviation of the first transmission value is assigned, which expediently only can assume a discrete number of different values.
  • the second deviation is assigned the second transmission value, which can expediently assume only a discrete number of different values, the number being for example different or equal to the number of possible values of the first transmission value.
  • the first or second transmission value is a discrete value.
  • a third reconstructed data set is preferably generated on the basis of the first transmission value and / or the second transmission value and on the basis of the first prognosis or second prognosis.
  • the third reconstructed data set corresponds to the reconstructed output signal but is present on the transmitter side.
  • the output signal is also reconstructed on the basis of the first transmission value or the second transmission value, whereby the output signal may deviate slightly from the input signal due to the quantization and the induced noise introduced as a result.
  • the third reconstructed data set is used as temporally preceding channel value. At least one of the values of the third reconstructed data set or all values for this is used.
  • the advantage of this method is that only information / signals are used that are available both at the transmitter and at the receiver.
  • the reconstructed signals in the transmitter and receiver are identical (at least in the case of faultless transmission).
  • the same quantization is used as for the quantization of the second deviation.
  • the quantization is a vector quantization.
  • a so-called gain-shape vector quantization is used.
  • the quantized signal is here divided into the signal shape / vector shape and a scaling factor (gain).
  • gain-shape vector quantization is the logarithmic vector quantization, in particular the (spherical) logarithmic vector quantization.
  • possible signal forms / vector shapes are points on a (potentially) high-dimensional unit sphere (ie with radius 1).
  • the scaling factor is quantized logarithmically, for example, with the known A-law.
  • Waveforms / vector shapes may also be other shapes such as (high dimensional) pyramids or cubes.
  • spherical-logarithmic vector quantization is " B. Matschkai and JB Huber, "Spherical Logarithmic Quantization", IEEE Trans. Audio, Speech, and Language Processing, vol. 18, pp. 126-140, Jan. 2010 in particular from Chapter III, an example being disclosed in Chapter IV, in particular in Figs. 8 and 9.
  • the first reconstructed data record is created by using the first transmission value to create a first auxiliary data record which corresponds to the first deviation.
  • the first transfer value would result.
  • a one-to-one function is used to generate the first transmission value, and the inverse function of this is used to generate the first auxiliary data set on the basis of the first transmission value.
  • a first auxiliary prognosis is created, which corresponds to the first prognosis, and this preferably corresponds.
  • the same calculation rule is preferably used to generate the first auxiliary prognosis on the basis of the previously reconstructed output signal, as for the generation of the first prognosis on the basis of the temporally preceding channel value.
  • the temporally preceding reconstructed output signal is also divided into channels corresponding to the frequency channels.
  • the first auxiliary data set is added to the first auxiliary prognosis.
  • the addition takes place in a value-wise manner.
  • corresponding values of the two data sets are added together in each case, and this sum forms a value in each case of the first reconstructed data set.
  • each value of the first auxiliary data set is added to a value of the first auxiliary prognosis.
  • the first reconstructed record corresponds to the first current record. In other words, all values of the two data sets are substantially the same.
  • the second reconstructed data record is created by using the second transmission value to create a second auxiliary data record which corresponds to the second deviation.
  • the second transfer value would result.
  • a one-to-one function is used to generate the second transmission value, and the inverse function thereof is used to generate the second auxiliary data set on the basis of the second transmission value.
  • a second auxiliary prognosis is created, which corresponds to the second prognosis, and this preferably corresponds.
  • the same calculation rule is preferably used on the basis of the first reconstructed data set as for the generation of the second prognosis on the basis of the first data set.
  • the second auxiliary data set is added to the second auxiliary prognosis.
  • the addition takes place in a value-wise manner.
  • the corresponding value of the two data sets is added together in each case, and this sum forms in each case a value of the second reconstructed data record.
  • each value of the second auxiliary data set is added to a value of the second auxiliary prognosis.
  • the second reconstructed record corresponds to the second current record. In other words, all values of the two data sets are substantially the same.
  • both the first and the second auxiliary data record are created on the transmitter side and in each case added to the values of the first or second prognosis. If, as a result of the quantization, noise is introduced into the first or second transmission value, this is determined when the first one is determined again or second prognosis or auxiliary prognosis, both on the transmitter and on the receiver side.
  • the first and / or second deviation is created by creating the difference between each current channel value of the first current data set or the second current data set and an associated prediction value of the first or second prediction to form a difference value.
  • each current channel value of the respective current data record is subtracted from a corresponding forecast value of the respective prognosis, or each forecast value of the respective prognosis is subtracted from the corresponding current channel value of the respective current data record.
  • the difference values created here form the first or second deviation.
  • the first / second deviation is a data set / vector
  • the number of difference values of the first deviation is equal to the number of current channel values of the first current data set equal to the number of prediction values of the first prediction.
  • the number of difference values of the second deviation is equal to the number of the current channel value of the second current data set and equal to the number of forecast values of the second prognosis.
  • the generation of the individual forecast values of the first prognosis takes place, in particular, independently of one another, and the prognosis values are preferably created at least partially in parallel over time. Alternatively or particularly preferably in combination with this, the generation of the individual forecast values of the second prognosis takes place in particular independently of one another, and the prognosis values are preferably created at least partially in parallel over time.
  • the current channel values are split substantially equally between the first current record and the second current record, so that the first current record thus has substantially the same number of channel values as the second current record, for example, the numbers being one (1) differ.
  • each frequency channel is assigned an index, wherein expediently all frequency channels with a straight index one of the current data sets and the frequency channels with an odd index the remaining current data set be assigned.
  • all frequency channels with an odd index are assigned to the first current record.
  • the first reconstructed data record and the second reconstructed data record also have essentially the same number of reconstructed channel values.
  • the input signal is decomposed into a number N of frequency channels.
  • the signal thus represents the current channel values and the temporally preceding channel values.
  • the signal can be denoted by x (t, k), where t denotes the (discrete) time index and k the channel index.
  • the totality of the current channel values is thus x (t1, k), where the time index t1 denotes the current time / window. Every x (t, k) is generally a complex number.
  • x (t, k ⁇ 1) 0.
  • x (t, k> N + 1) 0.
  • the prediction based on temporally preceding values is performed in parallel in a plurality of frequency channels, and thus the first prediction is made.
  • the frequency channels can be chosen, for example, equidistant, with any selection is possible, such as every other frequency channel.
  • This method has the advantage that the values which can now be calculated in parallel can be quantized by means of vector quantization, which i.a. leads to a lower quantization noise.
  • the reconstructed values of the same time step obtained in the previous step can now be used for the prediction.
  • the second forecast is created. For example, the creation is done for all odd channel numbers.
  • the hearing device has a communication device for transmitting and / or receiving an audio signal.
  • the communication device comprises a transmitter or a receiver.
  • the communication device is suitable as well as provided and set up a method for transmitting an audio signal from the transmitter or to the receiver.
  • the method provides that, on the transmitter side, an input signal corresponding to the audio signal for a specific time window is divided into a number of frequency channels, and that a current channel value is assigned to each frequency channel on the transmitter side.
  • the current channel values are divided on the transmitter side into a first current data record and a second current data record, and on the transmitter side, a first prognosis for the first current data record is created on the basis of a preceding channel value.
  • a first deviation between the first prognosis and the first current dataset is determined on the transmitter side, and a second prognosis for the second current dataset is created on the transmitter side on the basis of the first current dataset.
  • a second deviation between the second prognosis and the second current dataset is determined on the transmitter side.
  • the method provides that a first transmission value corresponding to the first deviation and a second transmission value corresponding to the second deviation are transmitted from the transmitter to the receiver.
  • a first reconstructed data record is created based on a temporally preceding reconstructed output signal and the transmitted first transmission value
  • a second reconstructed data record is created on the basis of the first reconstructed data record and the transmitted second transmission value.
  • the receiver side reconciles the first reconstructed data set and the second reconstructed data record into a reconstructed output signal.
  • the communication device only comprises the transmitter, in this case in particular only the transmitter-side working steps and a work step for transmitting the deviations are carried out. If the communication device only has the receiver, in particular only the receiver-side working steps and a work step for receiving the deviations are carried out.
  • the transmission is wireless, such as inductive or wireless.
  • the hearing device preferably comprises a sensor, by means of which an audio signal is detected during operation.
  • the sensor is preferably an electromechanical transducer, such as a microphone.
  • the input signal is the audio signal or the input signal is generated based on the audio signal.
  • the input signal is a part of the audio signal, or corresponds to a certain frequency range of the audio signal.
  • the hearing device comprises, for example, a signal processing unit and / or filter.
  • the hearing device preferably comprises an amplifier circuit by means of which the audio signal can be amplified.
  • the hearing aid comprises an actuator, by means of which a sound signal is generated, such as a loudspeaker, and which is suitable for outputting the output signal or the reconstructed output signal, and is provided and suitable, for example.
  • the hearing aid is a headphone or includes a headphone.
  • the hearing aid is particularly preferably a hearing aid.
  • the hearing aid is used to support a person suffering from a reduction in hearing.
  • the hearing aid is a medical device by means of which, for example, a partial hearing loss is compensated.
  • the hearing aid is, for example, a "receiver-in-the-canal" hearing aid (RIC), an in-the-ear hearing aid such as an in-the-ear hearing aid, an in-the-ear -canal "- a hearing aid (ITC) or a complete-in-canal hearing aid (CIC), a pair of hearing glasses, a pocket hearing aid, a bone conduction hearing aid or an implant.
  • the hearing aid device is particularly preferably a behind-the-ear hearing aid device ("behind-the-ear” hearing aid device) which is worn behind an auricle.
  • the hearing aid is provided and adapted to be worn on the human body.
  • the hearing aid preferably comprises a holding device, by means of which an attachment to the human body is possible.
  • the hearing device is a hearing aid device
  • the hearing device is provided and set up, for example, to be arranged behind the ear or within an auditory canal.
  • the hearing aid is wireless and provided and set up, at least partially inserted into an ear canal to become.
  • the hearing aid is a component of a hearing aid system which comprises a further hearing aid or a further device, such as a directional microphone or another device having a microphone.
  • the device preferably comprises the transmitter and the hearing device the receiver, and the transmission of the audio signal between the transmitter and the receiver is carried out according to the method.
  • the hearing aid system preferably comprises two hearing aids, each having a communication device, which are provided and arranged for transmitting and / or receiving an audio signal according to the above method.
  • the hearing device system is suitable as well as provided and set up to transmit audio signals between the two hearing aids by means of their respective communication devices, wherein the above method is performed.
  • each of the communication devices each has a transmitter and a receiver, and the audio signals are transmitted between the two communication devices, at least from one of the hearing aids to the remaining one.
  • the transmission is wireless, such as inductive or wireless.
  • the hearing aid system is particularly preferably a hearing aid system.
  • the hearing aid system is used to support a person suffering from a reduction in hearing.
  • the hearing aid system is a medical device by means of which, for example, a partial hearing loss is compensated.
  • the hearing aid system expediently comprises a behind-the-ear hearing aid that is worn behind an auricle, a "receiver-in-the-canal” hearing aid (RIC), an in-the-ear hearing aid, such as an "in-the-ear” hearing aid, an in-the-canal hearing aid (ITC), or a complete-incanal hearing aid (CIC), a pair of hearing glasses, a pocket hearing aid, a bone conduction hearing aid, or one implant.
  • a hearing aid system is used to support a person suffering from a reduction in hearing.
  • the hearing aid system is a medical device by means of which, for example, a partial hearing loss is compensated.
  • the hearing aid system expediently comprises a behind-the-ear hearing
  • the hearing aid system is in particular provided and adapted to be worn on the human body.
  • the hearing aid system preferably comprises a holding device, by means of which an attachment to the human body is made possible.
  • the hearing aid system is a hearing aid system, then at least one of the hearing aids provided and set up, for example, to be arranged behind the ear or within an ear canal.
  • the hearing aid system is wireless and designed and arranged to be at least partially inserted into an ear canal.
  • the hearing device system comprises an energy store, by means of which a power supply is provided.
  • a hearing aid system 2 is shown with two identical hearing aids 4, which are provided and adapted to be worn behind an ear of a user.
  • each hearing aid device 4 comprises a housing 6, which is made of a plastic.
  • a microphone 8 with two electromechanical transducers 10 is arranged within the housing 6, which is made of a plastic.
  • the two electromechanical transducers 10 it is possible to change a directional characteristic of the microphone 8 by a temporal offset between the means of the respective electromechanical transducer 10 detected acoustic signals is changed.
  • the two electromechanical sound transducers 10 are signal-coupled to a signal processing unit 12, which comprises an amplifier circuit.
  • the signal processing unit 12 is formed by means of circuit elements, such as electrical and / or electronic components.
  • a loudspeaker 14 is signal-wise coupled to the signal processing unit 12, by means of which the audio signals 16 received by the microphones 8 and / or processed by the signal processing unit 12 are output as sound signals. These sound signals are conducted by means of a sound tube not shown near the ear of a user of the hearing aid system 2.
  • Each of the hearing aid devices 4 also has a transmitter 18 and a receiver 20, by means of which an exchange of data signals 22 between the two hearing aids 4 takes place.
  • the exchange takes place, for example, by radio or inductively.
  • the signal processing unit 12, the transmitter 18 and the receiver 20 in each case essentially together form a communication device 24. Due to the exchange of the data signals 22, it is possible for the wearer of the hearing device system 2 to convey a spatial sense of hearing.
  • the hearing aid system 2 is configured binaurally.
  • a method 26 is shown, according to which the audio signals 16 are transmitted between the two hearing aids 4 by means of their respective communication device 24.
  • the audio signal 16 is received by means of a hearing aid 4.
  • an input signal 32 is created from this, which consequently corresponds to the audio signal 16 and corresponds to the input signal 32 in FIG FIG. 3 is shown by way of example.
  • the audio signal 16 is filtered, for example.
  • the input signal 32 is subdivided into time windows 34, which have the same time length and which is, for example, equal to one millisecond. Once the last time window 34 is completed, this time window 34 is divided into a number of frequency channels 36, such as in FIG. 4 shown.
  • bandpass filters (frequency-pass filters) 38 which are present within the signal processing unit 16 are used.
  • Each of the frequency channels 36 is assigned a particular current channel value 40.
  • the input signal 32 is divided into the individual frequency channels 36 and discretized by means of the assignment of the current channel value 40.
  • a third operation 42 is carried out on the transmitter 18 side, in which channel values 44 preceding in time are filled. These have been determined, for example, in a previous run of the method 26 or, if the method 26 has not yet been carried out, a standard value is used for this purpose. Also, a fourth step 46 is performed on the receiver 20 side, in which a reconstructed audio signal 48 preceding the time is determined. This corresponds to the temporally preceding channel values 44 and is determined in the same way as the temporally preceding channel values 44.
  • a fifth step 50 is carried out in which the number of current channel values 40 are divided into a first current data record 52 and a second current data record 54.
  • the current channel values 40 associated with an odd frequency channel 36 are assigned to the first data set 52 and the remaining current channel values 40 are assigned to the second current data set 54 so that the two current data sets 52, 54 have substantially the same number of current channel values 40 ,
  • a first prediction 58 for the first current data set 52 is created on the basis of the previously preceding channel values 44.
  • a linear prediction is used to generate the first forecast 58.
  • a number of forecast values 60 are created, wherein each of the forecast values 60 is associated with one of the current channel values 40 of the first current data set 52.
  • the temporally preceding channel values 44 are used, which are assigned to the temporally directly preceding time window 34.
  • the respective Forecast value 60 ("precisified value"), for example, uses only the temporally preceding channel values 44 associated with adjacent frequency channels 36.
  • a first deviation 60 is created between the first prediction 58 and the first current data set 52, for which the difference between each of the current channel values 40 of the first current data set 52 and each of the prediction values 60 of the first prediction 62 deducted from a difference value.
  • the number of forecast values 60 and the number of difference values correspond to the number of current channel values 40 of the first current data set 52.
  • a first transmission value 66 is generated by means of a spherical logarithmic quantization, which corresponds to the first deviation 62.
  • the first transmission value 66 is one-dimensional.
  • the multidimensional first deviation 62 is assigned the one-dimensional first transmission value 66.
  • a ninth step 68 is carried out by means of the communication device 24 of the hearing aid 4 having the receiver 20, in which a first auxiliary data set 70 is created by means of the inverse function corresponding to the quantization, which thus corresponds to the first deviation 62.
  • a first auxiliary prediction 72 is also generated with prediction values, using the same linear prediction as for generating the first prediction 58. Since the temporally preceding reconstructed output signal 48 corresponds to temporally preceding channel values 44 the first auxiliary prediction 72 of the first prognosis 58. Furthermore, the first auxiliary data set 70 is added to the first auxiliary prognosis 72 in a manner that is valid in terms of value. The resulting data set is a first reconstructed data set 74 which, with the exception of any noise / interference induced due to the use of the spherical logarithmic quantization, corresponds to the first data set 52 present on the transmitter 18 side.
  • a second prognosis 78 is calculated with a number of current channel values 44 of the second current data record 54 corresponding number of forecast values 80 ("precisified value").
  • the channel values 44 of adjacent frequency channels 36 of the first current data set 52 and the respective temporally preceding value of the same frequency band 36 will be used to generate the prediction values 80. Consequently, the second prediction 78 is generated based on the temporally preceding channel values 44 and the first current data set 52.
  • Each of the prediction values 80 corresponds to one of the current channel values 44 of the second current data set 54.
  • a second deviation 84 between the second prediction 78 and the second current data set 54 is determined by the difference between each current channel value 40 of the second current record 54 and the respectively associated forecast value 80 of the second forecast 78 is created to form a difference value.
  • the number of difference values forms the second deviation 84.
  • a second transmission value 88 is generated by means of the second deviation 84 by means of spherical logarithmic quantization, which consequently corresponds to the second deviation 84.
  • the second transmission value 86 is also one-dimensional in this case, and, for example, substantially the same spherical logarithmic quantization is used, which is also used to generate the first transmission value 66.
  • the second transmission value 88 is transmitted by the transmitter 18 by means of the data signals 22 to the receiver 20 of the hearing aid 4, to which the first transmission value 66 has also been transmitted.
  • a second reconstructed data record 92 is created in a thirteenth operation 90.
  • a second auxiliary data record 94 is created, wherein a for spherical logarithmic quantization inverse function is performed. Consequently, the second auxiliary data set 94, with the exception of any noise introduced as a result of the quantization, corresponds to the second deviation 84.
  • the first reconstructed data set 74 and the preceding reconstructed output signal 48 and the first reconstructed one Dataset 74 created a second auxiliary prognosis 96, for which a linear prediction is used.
  • the same coefficients are used as for the generation of the second prediction 78. Therefore, the second auxiliary prediction 96 substantially corresponds to the second prediction 78 due to the substantially same values used to generate the prediction Werteweise the second auxiliary prognosis 96 added.
  • the second reconstructed data set 92 is produced on the receiver side based on the temporally preceding reconstructed output signal 48 and the first reconstructed data set 74.
  • a subsequent fourteenth operation 98 the first reconstructed data record 74 and the second reconstructed data record 92 are combined into a reconstructed output signal 100, which consequently essentially has the current channel values 40. Any difference is present only due to any quantization effects.
  • the output signal 100 is used in a renewed execution of the method 26 as temporally previously reconstructed output signal 48 or at least added to this.
  • the reconstructed output signal 100 is transformed from the frequency space to the time period and output, for example, by means of the loudspeaker 14.
  • a sixteenth operation 104 is carried out on the transmitter 18 side, in which a third reconstructed data set 106 is created on the basis of the first and second transmission values 66, 88 as well as the first and second prognoses 58, 78.
  • the ninth step 68 and the thirteenth step 90 are carried out essentially on the part of the transmitter 18, the first prognosis 58 instead of the first auxiliary prognosis 72 and the first prognosis second prognosis 78 is used instead of the second auxiliary prognosis 96.
  • the two reconstructed data sets are added to form the third reconstructed data set 106.
  • the third reconstructed data set 106 corresponds to the output signal 100.
  • the third reconstructed data set 106 also has any noise due to the quantization used.
  • the third reconstructed data record 106 is used in a renewed execution of the method 26 as temporally preceding channel values 44, so that both on the side of the transmitter 18 and on the side of the receiver 20 for generating the respective forecasts 58, 72, 78, 96, the respective same input data be used.
  • FIG. 5 is a further embodiment of the preparation of the first prediction 58 and the creation of the second prognosis 78 and consequently also the creation of the two reconstructed data sets 74, 92 shown.
  • the first current data record 54 has only one of the current channel values 44, and consequently the first forecast 58 only contains a single forecast value 60.
  • the first forecast 58 only contains a single forecast value 60.
  • one of the forecast values 80 of the second prognosis 78 is created. which is assigned to the directly adjacent frequency channel 36.
  • the current channel value 40 associated with this prognosis value 80 is again used in a further working step to determine a further prognosis value 80 which is assigned to the same in the directly adjacent frequency channel 36, etc.
  • all prognosis values 80 are based on the single current channel value 40 of the first actual value Record 54 created.
  • the first data record 52 substantially comprises one fifth of all current channel values 40, wherein these are assigned, for example, to frequency channels 36 which are spaced apart from each other by means of four of the frequency channels 36.
  • the prognosis values 80 of the second prognosis 78 and consequently also of the second auxiliary prognosis 96 these are used, the number of the prognosis value 80 corresponding to the number of prognosis values 60.
  • the current ones are assigned Channel values 40 further prediction values 80 which are assigned to the directly adjacent frequency band 36 are determined.
  • the current channel values 40 are divided into several data sets, and a number of deviations are determined and a corresponding transmission value corresponding thereto is transmitted. In other words that will be in FIG. 2 illustrated method 26 executed essentially cascaded.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Signal Processing (AREA)
  • Acoustics & Sound (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Human Computer Interaction (AREA)
  • Computational Linguistics (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Multimedia (AREA)
  • Otolaryngology (AREA)
  • Neurosurgery (AREA)
  • General Health & Medical Sciences (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Quality & Reliability (AREA)
  • Circuit For Audible Band Transducer (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)
EP17155770.5A 2016-04-14 2017-02-13 Procédé de transmission d'un signal audio provenant d'un émetteur à un récepteur Active EP3232684B1 (fr)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
DE102016206327.8A DE102016206327A1 (de) 2016-04-14 2016-04-14 Verfahren zum Übertragen eines Audiosignals von einem Sender zu einem Empfänger

Publications (2)

Publication Number Publication Date
EP3232684A1 true EP3232684A1 (fr) 2017-10-18
EP3232684B1 EP3232684B1 (fr) 2019-07-31

Family

ID=58046514

Family Applications (1)

Application Number Title Priority Date Filing Date
EP17155770.5A Active EP3232684B1 (fr) 2016-04-14 2017-02-13 Procédé de transmission d'un signal audio provenant d'un émetteur à un récepteur

Country Status (4)

Country Link
US (1) US10123135B2 (fr)
EP (1) EP3232684B1 (fr)
DE (1) DE102016206327A1 (fr)
DK (1) DK3232684T3 (fr)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102016206985A1 (de) * 2016-04-25 2017-10-26 Sivantos Pte. Ltd. Verfahren zum Übertragen eines Audiosignals

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040044527A1 (en) * 2002-09-04 2004-03-04 Microsoft Corporation Quantization and inverse quantization for audio
US20100014679A1 (en) * 2008-07-11 2010-01-21 Samsung Electronics Co., Ltd. Multi-channel encoding and decoding method and apparatus
US20110046966A1 (en) * 2009-08-24 2011-02-24 Sling Media Pvt Ltd Frequency band scale factor determination in audio encoding based upon frequency band signal energy

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040044527A1 (en) * 2002-09-04 2004-03-04 Microsoft Corporation Quantization and inverse quantization for audio
US20100014679A1 (en) * 2008-07-11 2010-01-21 Samsung Electronics Co., Ltd. Multi-channel encoding and decoding method and apparatus
US20110046966A1 (en) * 2009-08-24 2011-02-24 Sling Media Pvt Ltd Frequency band scale factor determination in audio encoding based upon frequency band signal energy

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
B. MATSCHKAI; J. B. HUBER: "Spherical logarithmic quantization", IEEE TRANS. AUDIO, SPEECH, AND LANGUAGE PROCESSING, vol. 18, January 2010 (2010-01-01), pages 126 - 140
BENESTY, J.; CHEN, J.; HUANG, Y.: "Springer Handbook of Speech Processing", 2008, SPRINGER VERLAG, article "Linear Prediction", pages: 111 - 125

Also Published As

Publication number Publication date
EP3232684B1 (fr) 2019-07-31
DK3232684T3 (da) 2019-11-04
US20170303054A1 (en) 2017-10-19
DE102016206327A1 (de) 2017-10-19
US10123135B2 (en) 2018-11-06

Similar Documents

Publication Publication Date Title
EP2180726B1 (fr) Localisation du son avec des prothèses auditives binaurales
DE60222813T2 (de) Hörgerät und methode für das erhöhen von redeverständlichkeit
EP3451705B1 (fr) Procédé et dispositif de reconnaissance rapide de voix propre
EP1912471B1 (fr) Traitement d'un signal d'entrée dans une prothése auditive
EP2437258B1 (fr) Procédé et dispositif de compression de fréquence à décalage de fréquence sélectif
DE102007017761A1 (de) Verfahren zur Anpassung eines binauralen Hörgerätesystems
EP2811762B1 (fr) Système binaural de formation de faisceau fondé sur la logique
DE102007035171A1 (de) Verfahren zum Anpassen eines Hörgeräts mit Hilfe eines perzeptiven Modells
EP3232684B1 (fr) Procédé de transmission d'un signal audio provenant d'un émetteur à un récepteur
DE102008046040A1 (de) Verfahren zum Betrieb einer Hörvorrichtung mit Richtwirkung und zugehörige Hörvorrichtung
EP2584795B1 (fr) Procédé de détermination d'une ligne caractéristique de compression
EP1912470A2 (fr) Procédé pour la compression dynamique d'un signal audio et appareil auditif correspondant
DE102014218672B3 (de) Verfahren und Vorrichtung zur Rückkopplungsunterdrückung
EP3448063B1 (fr) Procédé de réglage d'un dispositif de correction auditive
EP1945000B1 (fr) Procédé destiné à la réduction de puissances d'interférence et système acoustique correspondant
DE102016207936A1 (de) Verfahren zum Betrieb eines Hörgeräts
EP2629550B1 (fr) Prothèse auditive avec un filtre adaptatif et procédé pour le filtrage d'un signal audio
DE102007035173A1 (de) Verfahren zum Einstellen eines Hörsystems mit einem perzeptiven Modell für binaurales Hören und entsprechendes Hörsystem
EP1303166A2 (fr) Procédé d'utilisation d'une prothèse auditive et assemblage avec une prothèse auditive
EP3240307B1 (fr) Procédé de transfert d'un signal audio
DE102021210098A1 (de) Verfahren zum Betrieb eines Hörgeräts
EP3048813B1 (fr) Procédé et dispositif de suppression du bruit basée sur l'inter-corrélation de bandes secondaires
DE102008058496B4 (de) Filterbanksystem mit spezifischen Sperrdämpfungsanteilen für eine Hörvorrichtung
DE102007010601A1 (de) Hörsystem mit verteilter Signalverarbeitung und entsprechendes Verfahren
DE102005020316B3 (de) Hörgerätsystem mit Monosignalerzeugung und entsprechendes Verfahren

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN PUBLISHED

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: SIVANTOS PTE. LTD.

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20180327

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: DE

Ref legal event code: R079

Ref document number: 502017001866

Country of ref document: DE

Free format text: PREVIOUS MAIN CLASS: H04R0025000000

Ipc: G10L0019040000

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

RIC1 Information provided on ipc code assigned before grant

Ipc: G10L 19/032 20130101ALI20190123BHEP

Ipc: H04R 25/00 20060101ALI20190123BHEP

Ipc: G10L 19/04 20130101AFI20190123BHEP

Ipc: G10L 25/12 20130101ALI20190123BHEP

Ipc: G10L 19/038 20130101ALI20190123BHEP

INTG Intention to grant announced

Effective date: 20190222

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

Ref country code: GB

Ref legal event code: FG4D

Free format text: NOT ENGLISH

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1161761

Country of ref document: AT

Kind code of ref document: T

Effective date: 20190815

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

Free format text: LANGUAGE OF EP DOCUMENT: GERMAN

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 502017001866

Country of ref document: DE

REG Reference to a national code

Ref country code: CH

Ref legal event code: NV

Representative=s name: E. BLUM AND CO. AG PATENT- UND MARKENANWAELTE , CH

REG Reference to a national code

Ref country code: DK

Ref legal event code: T3

Effective date: 20191031

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20190731

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190731

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190731

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190731

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191031

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190731

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191202

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191031

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190731

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190731

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190731

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191101

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190731

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190731

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190731

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190731

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190731

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190731

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190731

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190731

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200224

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190731

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190731

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 502017001866

Country of ref document: DE

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG2D Information on lapse in contracting state deleted

Ref country code: IS

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191030

26N No opposition filed

Effective date: 20200603

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190731

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20200229

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190731

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200213

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200213

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200229

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190731

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190731

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190731

REG Reference to a national code

Ref country code: AT

Ref legal event code: MM01

Ref document number: 1161761

Country of ref document: AT

Kind code of ref document: T

Effective date: 20220213

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220213

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20240216

Year of fee payment: 8

Ref country code: CH

Payment date: 20240301

Year of fee payment: 8

Ref country code: GB

Payment date: 20240222

Year of fee payment: 8

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20240222

Year of fee payment: 8

Ref country code: DK

Payment date: 20240221

Year of fee payment: 8