EP2975864B1 - Appareil de traitement de signal pour système audio pour automobile et procédé de traitement de signaux pour un système acoustique de véhicule - Google Patents

Appareil de traitement de signal pour système audio pour automobile et procédé de traitement de signaux pour un système acoustique de véhicule Download PDF

Info

Publication number
EP2975864B1
EP2975864B1 EP14177369.7A EP14177369A EP2975864B1 EP 2975864 B1 EP2975864 B1 EP 2975864B1 EP 14177369 A EP14177369 A EP 14177369A EP 2975864 B1 EP2975864 B1 EP 2975864B1
Authority
EP
European Patent Office
Prior art keywords
signal
room simulation
surround
speaker
height
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP14177369.7A
Other languages
German (de)
English (en)
Other versions
EP2975864A1 (fr
Inventor
Timo Esser
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Alpine Electronics Inc
Original Assignee
Alpine Electronics Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alpine Electronics Inc filed Critical Alpine Electronics Inc
Priority to EP14177369.7A priority Critical patent/EP2975864B1/fr
Publication of EP2975864A1 publication Critical patent/EP2975864A1/fr
Application granted granted Critical
Publication of EP2975864B1 publication Critical patent/EP2975864B1/fr
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S5/00—Pseudo-stereo systems, e.g. in which additional channel signals are derived from monophonic signals by means of phase shifting, time delay or reverberation 
    • H04S5/005—Pseudo-stereo systems, e.g. in which additional channel signals are derived from monophonic signals by means of phase shifting, time delay or reverberation  of the pseudo five- or more-channel type, e.g. virtual surround
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2499/00—Aspects covered by H04R or H04S not otherwise provided for in their subgroups
    • H04R2499/10—General applications
    • H04R2499/13—Acoustic transducers and sound field adaptation in vehicles
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30—Control circuits for electronic adaptation of the sound field
    • H04S7/305—Electronic adaptation of stereophonic audio signals to reverberation of the listening space

Definitions

  • the present invention is in the field of sound systems for passenger transport vehicles, such as cars, buses and trucks.
  • the present invention is in the field of a signal processing apparatus for a vehicle sound system and a signal processing method for a vehicle sound system.
  • EP 2 629 552 A1 discloses an audio surround processing system that receives an audio source signal having at least two audio channels and generates a number of additional surround sound signals in which an amount of artificially generated ambient energy is controlled in real-time at least in part by an estimate of ambient energy that is contained in the audio source signal.
  • WO 2014/088328 discloses an appratus for upmixing signals to generate height signals using all available channels as input, without defining a specific equation for the upmix.
  • WO 2010/027882 discloses the use of rear channels for generating height signals.
  • US 2006/222187 discloses the use of front and rear channels to generate height signals, but in an application related to microphones and without separating left and right signals.
  • US 2012/008789 discloses the use of front signals to generate height signals.
  • the present invention is related to a signal processing apparatus, as claimed in claim 1, and a signal processing method, as claimed in claim 10. Further exemplary embodiments of the invention are disclosed in the dependent claims.
  • the signal processing apparatus performs an up-conversion of the multi-channel audio signal. It generates at least two 3D audio signals, namely at least the left 3D signal and the right 3D signal, in addition to the multi-channel audio signal.
  • the left 3D signal and the right 3D signal are provided in addition to the left front signal, the left surround signal, the right front signal and the right surround signal, and as these signals are output via speakers in an upper portion of the vehicle, the passenger's audio experience is more voluminous. The passenger has the impression that he/she is listening to the audio content in a larger space.
  • the left 3D signal and the right 3D signal are referred to as a left 3D height signal and a right 3D height signal, because these signals create the perceived height of the listening room, when output via the speakers in the upper portion of the vehicle.
  • the left front signal and the left surround signal are separate inputs to the left room simulation function.
  • the right front signal and the right surround signal are separate inputs to the right room simulation function.
  • the room simulation functions are able to provide 3D sound that is adapted to the kind of audio content present.
  • orchestra music having a large diffuse surround component also referred to as uncorrelated sound component or reverb
  • the room simulation functions may provide strong 3D signals.
  • the room simulation functions may provide weaker 3D signals.
  • the signal processing apparatus allows for adding a high degree of 3D sound when appropriate in light of the type of audio content, while preventing an artificially sounding, excessive expansion of audio content when a large 3D sound component is not appropriate.
  • the signal processing apparatus allows for adding some 3D sound for all types of audio content, leading to an improved listening experience for all types of audio content.
  • the signal processing apparatus comprises a room simulation module which always some 3D sound component, but only adds a large amount of 3D sound component when appropriate in light of the type of audio content. This can all be done in a fairly simple way through a single set of room simulation functions. No explicit distinction between different kinds of audio content and no application of different room simulation functions for different kinds of audio content is necessary.
  • the room simulation functions simulate an auditory space. In other words, they add a simulated room effect to the multi-channel audio signal. They provide a simulated room transfer function to the multi-channel audio signal. While the room simulation functions rely on multiple inputs for adding the appropriate amount of room simulation, the overall perceived room is more than an extraction of particular signal components, such as reverb, from the source signal.
  • the room simulation functions add a synthetic room which may depend in size and character on the room signal extracted from the original signal by the surround upmix at the input.
  • the left 3D speaker and the right 3D speaker are positioned in an upper portion of an interior space of a vehicle. They may be positioned towards the front of the interior space or towards the rear of the interior space. It is also possible that there are more than two 3D speakers, such as four 3D speakers. In that case, the signal processing apparatus may provide the same 3D signal to two 3D speakers, respectively, or may provide distinct signals to all four 3D speakers.
  • the term 3D speaker refers to a speaker that emits sounds in an upper portion of a vehicle, such as above a passenger's ear level and/or above the other main loudspeakers.
  • the signal input section is coupled to the room simulation module. Further, the room simulation module is coupled to the signal output section. In addition, the signal output section may be coupled to the signal input section.
  • the multi-channel audio signal may be provided directly from the signal input section to the signal output section.
  • the signal input section may comprise a first stage of signal processing. However, it is also possible that the signal input section is only provided for passing an audio signal on from an audio source.
  • speaker may refer to a single speaker, also referred to as loudspeaker.
  • speaker may also refer to a set of speakers, covering different frequency ranges.
  • the term speaker may refer to a set of two speaker of selected frequencies.
  • the term speaker may refer to the combination of a low frequency speaker and a high frequency speaker. It is equally possible that the term speaker refers to a set of three speakers, outputting low, medium and high frequencies, respectively.
  • a right 3D speaker it is possible that two or three speakers of different frequencies are provided in the right upper portion of the vehicle.
  • These limited frequency speakers may be arranged in one housing or in separate housings in proximity of each other.
  • the left room simulation function weighs the left front signal and the left surround signal differently and the right room simulation function weighs the right front signal and the right surround signal differently.
  • the left room simulation function has different weighing coefficients for the inputs of the left front signal and the left surround signal.
  • the right room simulation function has different weighing coefficients for the right front signal and the right surround signal.
  • the room simulation functions then performs the room simulation on this weighed combination of the respective front and surround signals. This weighing of the front and surround signals provides for a fairly simple, closed implementation of the room simulation functions, applicable to all kinds of audio content.
  • the left room simulation function comprises a left room simulation component calculated as f 1 ( ⁇ 1 ⁇ L S + ⁇ 1 ⁇ L F ), with L S denoting the left surround signal and L F denoting the left front signal and with a, being greater than ⁇ 1
  • the right room simulation function comprises a right room simulation component calculated as f 2 ( ⁇ 2 ⁇ R s + ⁇ 2 ⁇ R F ), with R s denoting the right surround signal and R F denoting the right front signal and with ⁇ 2 being greater than ⁇ 2 .
  • the given formulas with the given relationship between the weighing coefficients ⁇ and ⁇ allow for an optimized addition of room simulation, depending on the type of audio content, implemented as a single set of room simulation functions.
  • the diffuse surround component is weighed stronger than the uncorrelated front signal. This leads to a very natural sound experience to the passenger, with the reverb portion of the multi-channel audio signal being the dominant portion in the processing and in the 3D speaker outputs. At the same time, a comparatively smaller 3D component is provided on the basis of the correlated front signal, leading to a voluminous sound experience also for highly correlated audio sources.
  • f 1 and f 2 refer to functions that simulate an auditory space, thus contributing a room simulation that is an addition as compared to the multi-channel audio signal and that cannot be merely extracted from the multi-channel audio signal.
  • f 1 and f 2 can be the same.
  • the left room simulation component may be calculated in accordance with the same function as the right room simulation component.
  • f 1 and f 2 are different functions.
  • ⁇ 1 equals ⁇ 2 and/or that ⁇ 1 equals ⁇ 2
  • ⁇ 1 is different from ⁇ 2 and/or that ⁇ 1 is different from ⁇ 2 .
  • ⁇ 1 is much greater than ⁇ 1 , i.e. more than 10 times greater. It is also possible that ⁇ 2 is much greater than ⁇ 2 , i.e. at least 10 times greater.
  • ⁇ 1 is much greater than ⁇ 1 , i.e. more than 10 times greater.
  • ⁇ 2 is much greater than ⁇ 2 , i.e. at least 10 times greater.
  • the left room simulation function may have the left room simulation component as the only signal component or may have other signal components, as discussed below.
  • the right room simulation function may have the right room simulation component as the only signal component or may have other signal components.
  • the left room simulation function comprises the left front signal and/or the left surround signal as an additive term, weighed by a respective coefficient
  • the right room simulation function comprises the right front signal and/or the right surround signal as an additive term, weighed by a respective coefficient.
  • additive term refers to a component that contributes to the room simulation functions purely by addition. In other words, it refers to a linear term. For this additive term, no function adding room simulation or any other simulation is applied to the front signal and/or surround signal. The inclusion of such an additive term results in a greater sound stability, increasing the ease of listening as compared to a pure room simulation component being output via the 3D speakers.
  • the left room simulation function comprises a left sound stability component calculated as ( ⁇ 1 ⁇ L S + ⁇ 1 ⁇ L F ), with L S denoting the left surround signal and L F denoting the left front signal and with ⁇ 1 being greater than ⁇ 1
  • the right room simulation function comprises a right sound stability component calculated as ( ⁇ 2 ⁇ R S + ⁇ 2 ⁇ R F ), with R S denoting the right surround signal and RF denoting the right being greater than ⁇ 2 .
  • ⁇ 1 is much greater than ⁇ 1 , i.e. at least 10 times greater.
  • ⁇ 2 is much greater than ⁇ 2 , i.e. at least 10 times greater.
  • ⁇ 1 , ⁇ 2 , ⁇ 1 and ⁇ 2 are greater than ⁇ 1, ⁇ 2, ⁇ 1 and ⁇ 2 .
  • ⁇ 1, ⁇ 2, ⁇ 1 and ⁇ 2 may be much greater than ⁇ 1 ⁇ 2 , ⁇ 1 , and ⁇ 2 , i.e. at least 10 times greater.
  • f 1 and f 2 ensure that the room simulation components are greater than the sound stability components.
  • the left room simulation function comprises a left room simulation component and a left sound stability component, with the left room simulation component being greater than the left sound stability component
  • the right room simulation function comprises a right room simulation component and a right sound stability component, with the right room simulation component being greater than the right sound stability component.
  • the comparison between the components may be carried out on the basis of the component amplitudes or component powers or any other suitable metric.
  • the respective room simulation functions may consist of the respective room simulation component and the respective sound stability component.
  • the respective room simulation and sound stability components may be the only components of the room simulation function in question.
  • the left and right room simulation functions are configured to simulate an auditory space that is larger than an interior space of a vehicle.
  • the vehicle sound system makes the passenger feel like he is listening to the audio content in a room that is larger than the actual interior of the vehicle.
  • superior acoustics can be simulated than can be achieved within the interior of the vehicle with prior art sound systems.
  • the left and right room simulation functions may be adapted to simulate the reverb generated in an enclosed space when an audio source is played.
  • the left and right room simulation functions are configured to simulate an ideal auditory space.
  • the left and right room simulation functions are configured to simulate an ideal auditory space of 4m x 6m x 2.5m.
  • the left 3D signal is a left front 3D signal and the right 3D signal is a right front 3D signal. Accordingly, the left 3D signal and the right 3D signal may be provided to the signal output section for being output to a left front 3D speaker and to a right front 3D speaker. Accordingly, the left 3D speaker may be a left front 3D speaker and the right 3D speaker may be a right front 3D speaker.
  • the room simulation module further comprises a left rear room simulation function generating a left rear 3D signal, with the left front signal and the left surround signal being inputs thereto, and a right rear room simulation function generating a right rear 3D signal, with the right front signal and the right surround signal being inputs thereto.
  • a left rear room simulation function generating a left rear 3D signal
  • a right rear room simulation function generating a right rear 3D signal, with the right front signal and the right surround signal being inputs thereto.
  • front and rear signals are generated in the third dimension, leading to a surrounding of the passenger with speakers from all sides.
  • an additional stereo surround sound is created in the upper portion of the vehicle, leading to an even more voluminous listening experience.
  • the left rear 3D signal and the right rear 3D signal may be output to a left rear 3D speaker and a right rear 3D speaker.
  • the output signal section may be configured for outputting the left rear 3D signal and the right read 3D signal to a left rear 3D speaker and a right rear
  • the multi-channel audio signal is an input signal stemming from an audio source.
  • the vehicle sound system may comprise a DVD drive or CD drive or a hard disk drive or any other suitable means for reading out a memory containing the audio source signal.
  • the audio source signal is transferred to the vehicle in a wireless manner.
  • the input signal may be a multi-channel signal that already contains the left front signal, the left surround signal, the right front signal, and the right surround signal.
  • An example for such an input signal is a 5.1 surround sound signal.
  • the input signal is a different kind of multi-channel audio signal having above discussed four signals.
  • the input signal section comprises an audio signal conversion module, with the audio signal conversion module being adapted to generate the multi-channel audio signal from an input signal missing at least one of the left front signal, the left surround signal, the right front signal and the right surround signal, such as from a two-channel stereo input signal.
  • the room simulation module can also be put to use for audio source signals that lack one of above discussed four signals.
  • the audio signal conversion module may be adapted to extract a left surround signal and a right surround signal from a two-channel stereo input signal. Accordingly, above-discussed features of room simulation simulation can be achieved via subsequent operations of audio signal conversion and room simulation generation.
  • the audio signal conversion module may be coupled to the room simulation module, either directly or via other signal processing modules, such as via a volume and/or fading and/or balance adaptation module.
  • any kind of audio source can be pre-processed for the ensuing room simulation simulation by the room simulation module.
  • the audio source may be any of a 1.0 mono source, a 2.0 stereo source, a 5.1 surround source, a 5.2 surround source, a 7.1 surround source or any other audio source.
  • the audio signal conversion module may be implemented in any of the manners described in EP 1 722 598 A2 with respect to the audio device of said document. The contents of said document is incorporated herein in its entirety.
  • Exemplary embodiments of the invention further include a vehicle sound system comprising a plurality of speakers, the plurality of speakers comprising a left 3D speaker and a right 3D speaker, the left 3D speaker and the right 3D speaker being configured to be disposed in an upper portion of a vehicle, the vehicle sound system further comprising a signal processing apparatus in accordance with any of the embodiments described above, with the signal processing apparatus being coupled to the left 3D speaker and the right 3D speaker for outputting the left 3D signal and the right 3D signal thereto.
  • a vehicle sound system comprising a plurality of speakers, the plurality of speakers comprising a left 3D speaker and a right 3D speaker, the left 3D speaker and the right 3D speaker being configured to be disposed in an upper portion of a vehicle
  • the vehicle sound system further comprising a signal processing apparatus in accordance with any of the embodiments described above, with the signal processing apparatus being coupled to the left 3D speaker and the right 3D speaker for outputting the left 3D signal and the right 3D signal thereto.
  • the plurality of speakers of the vehicle sound system may comprise a left front speaker, a left surround speaker, a right front speaker, a right surround speaker. It may also include additional speaker, such as a center front speaker, a subwoofer, left and right rear speakers.
  • the left and right 3D speakers may be left and right front 3D speakers or left and right rear 3D speakers. It is also possible that the vehicle sound system has left and right front 3D speakers as well as left and right rear 3D speakers.
  • the signal processing apparatus may be coupled to all speakers present in the vehicle sound system.
  • the vehicle sound system may also comprise an audio source reading apparatus, such as a CD player or DVD player or hard disk drive, and/or an audio signal reception apparatus, such as a radio receiver.
  • Exemplary embodiments of the invention further include a passenger transport vehicle, such as a car, bus or truck, comprising a vehicle sound system, as described above, which includes a signal processing apparatus, as described in any of the embodiments above, with the vehicle sound system being installed in the passenger transport vehicle with the left 3D speaker and the right 3D speaker being disposed in an upper portion of the passenger transport vehicle.
  • a passenger transport vehicle such as a car, bus or truck
  • vehicle sound system as described above
  • the vehicle sound system being installed in the passenger transport vehicle with the left 3D speaker and the right 3D speaker being disposed in an upper portion of the passenger transport vehicle.
  • Exemplary embodiments of the invention further include a signal processing method for a vehicle sound system, the method comprising the steps of receiving a multi-channel audio signal comprising at least a left front signal, a left surround signal, a right front signal and a right surround signal, generating at least a left 3D signal and a right 3D signal for providing a room simulation by the vehicle sound system, with the left front signal and the left surround signal being inputs to a left room simulation function that generates the left 3D signal and with the right front signal and the right surround signal being inputs to a right room simulation function that generates the right 3D signal, and outputting the left 3D signal and the right 3D signal to a left 3D speaker and a right 3D speaker disposed in an upper portion of a vehicle.
  • a signal processing method for a vehicle sound system comprising the steps of receiving a multi-channel audio signal comprising at least a left front signal, a left surround signal, a right front signal and a right surround signal, generating at least a left 3D signal
  • Fig. 1 shows a perspective schematic diagram of a passenger transport vehicle 4, having a vehicle sound system 2 in accordance with an exemplary embodiment of the invention.
  • the vehicle sound system 2 comprises twelve speakers.
  • the vehicle sound system comprises a left front speaker 21, a left rear speaker 31, a left surround speaker 23, a right front speaker 22, a right rear speaker 32, a right surround speaker 24, a left front 3D speaker 25, a right front 3D speaker 26, a left rear 3D speaker 27, a right rear 3D speaker 28, a center front speaker 29, and a subwoofer 30. All of these speakers are coupled to a signal processing apparatus 6 by individual signal lines (shown in dashed lines in Fig. 1 ). It is also possible that all of the speakers 21-32 and the signal processing apparatus 6 are coupled via a bus architecture or any other means of signal communication.
  • the vehicle sound system 2 may comprise an audio signal receiving apparatus, such as a tuner, for receiving wireless audio source signals, such as radio broadcast waves or any other kind of signal / data transmission. Additionally/alternatively, it is possible that the vehicle sound system 2 is coupled to an audio source reading apparatus, such as a CD player or a DVD player or a hard disk drive or any other kind of signal / data storage device.
  • the audio signal receiving apparatus and/or the audio source reading apparatus may be coupled to the signal processing apparatus 6 for providing the audio source signal to the signal processing apparatus 6. No matter what the audio source is, the signal processing apparatus is adapted to receive the audio source signal and to generate respective output signals for the plurality of speakers.
  • Fig. 2 shows a signal processing apparatus 6 in accordance with an exemplary embodiment of the invention.
  • the signal processing apparatus 6 comprises a signal input section 62, a room simulation module 64, and a signal output section 66.
  • the exemplary signal processing apparatus 6 is described with a stereo signal being the audio source, which consists of the left source signal L Source and the right source signal R Source , and with the output signal consisting of twelve signals for being output to the twelve speakers of the vehicle 4 described above.
  • the signal input section 62 comprises an audio signal conversion module 70 and a audio signal conditioning module 72.
  • the audio signal conversion module 70 performs an up-conversion of the two-channel stereo input signal.
  • the audio signal conversion module 70 generates a left front signal L F , a right front signal R F , a left surround signal L s , a right surround signal R S , a center front signal C and a subwoofer signal LFE (with LFE denoting "low frequency effects").
  • LFE subwoofer signal
  • the up-converted audio signal is then input into the audio signal conditioning module 72.
  • the audio signal conditioning module 72 is configured to adapt the volume, fading, balance and subwoofer levels of the audio signals. Such signal conditioning is also per se known in the art. Depending on the complexity of the vehicle sound system, the audio signal conditioning module 72 may have different functionality and different degrees of signal conditioning. It is also possible that the audio signal conditioning module 72 is dispensed with and that only a simple volume scaling takes place.
  • the only essential aspect with respect to the signal input section 62 is that a multi-channel signal is provided via the signal input section, which multi-channel audio signal contains a left front signal, a left surround signal, a right front signal and a right surround signal. If the audio source already provides such multi-channel audio signal, such as a 5.1 surround signal, the signal input section may consist of a mere passing on of the source signal.
  • the room simulation module 64 is coupled to the signal input section 62 in such a way that the left front signal L F , the left surround signal L S , the right front signal R F and the right surround signal R L are provided by the signal input section 62 to the room simulation module 64. Based on these four signals, the room simulation module 64 generates four 3D signals, which are configured to be output to four speakers disposed in the upper portion of the vehicle. In particular, the room simulation module 64 generates a left front 3D signal, a right front 3D signal, a left rear 3D signal and a right rear 3D signal. These four 3D signals are generated by the room simulation module 64 in the manner described below.
  • the left rear 3D signal L R3D is generated by a left rear room simulation function in accordance with the following formula:
  • L R 3 ⁇ D f 3 ⁇ 3 ⁇ L S + ⁇ 3 ⁇ L F + ⁇ 3 ⁇ L S + ⁇ 3 ⁇ L F .
  • the right rear 3D signal R R3D is generated by a right rear room simulation function in accordance with the following formula:
  • R R 3 ⁇ D f 4 ⁇ 4 ⁇ R S + ⁇ 4 ⁇ R F + ⁇ 4 ⁇ R S + ⁇ 4 ⁇ R F .
  • ⁇ x, ⁇ x , ⁇ x and ⁇ x are weighing coefficients that allow for a relative scaling of the impact of the left front signal L F , the left surround signal L S , the right front signal R F and the right surround signal R S on the respective 3D signal.
  • ⁇ x is much greater than ⁇ x , in particular at least 10 times greater, for x being 1, 2, 3 and 4.
  • ⁇ x is much greater than ⁇ x , in particular at least 10 times greater, for x being 1, 2, 3 and 4.
  • ⁇ x and ⁇ x are greater than y x and ⁇ x , in particular much greater, i.e. at least 10 times greater, for x being 1, 2, 3 and 4.
  • the four room simulation functions given above each comprise a room simulation component and a sound stability component.
  • the room simulation components are calculated via the functions f 1 , f 2 , f 3 and f4. These functions simulate an auditory space.
  • the functions f 1 , f 2 , f 3 and f 4 are adapted - on the basis of the weighed inputs - to mimic the audio experience a listener would have in a space that is larger than the interior of the passenger transport vehicle.
  • the functions f 1 , f 2 , f 3 and f 4 may be configured to generate the reverb that would be generated by the structure of an enclosed room.
  • the functions f 1 , f 2 , f 3 and f 4 may simulate an ideal auditory space, such as an auditory space of 4m x 6m x 2.5m.
  • the respective sound stability components consist of an addition of the respective left or right surround signal and of the respective left or right front signal, weighed by a respective weighing coefficient ⁇ x or ⁇ x . No further function apart from the weighing coefficients is applied to the inputs for the sound stability components.
  • an appropriate room simulation is generated for all types of audio content.
  • Audio content with a large surround sound component such as orchestra music
  • leads to strong 3D signals i.e. to a strong room simulation.
  • an appropriate amount of 3D simulation is presented to the listener.
  • the room simulation functions generate a lower amount of room simulation. This lower amount of room simulation ensures that the news speaker is not perceived as talking in a large hall with a lot of echo effect on the one hand.
  • the generation of a comparatively low level of room simulation still provides for a voluminous sound experience in the vehicle environment.
  • the signal output section 66 is coupled to both the signal input section 62 and the room simulation module 64. It is configured to receive the left front signal, the left surround signal, the right front signal, the right surround signal, the center front signal and the subwoofer signal from the input section 62. Further, it is configured to receive above discussed four 3D signals, namely the left front 3D signal L F3D , the right front 3D signal R F3D , the left rear 3D signal L R3D , and right rear 3D signal R R3D from the room simulation module 64.
  • the signal output section 66 is provided for outputting twelve signals to the respective speakers in the passenger transport vehicle.
  • the signal output section 66 comprises a mixer module 74.
  • This mixer module 74 allows for a combining or shuffling of the signals before being output to the speakers.
  • the mixer module 74 passes some of the signals on and generates some signals by combination.
  • the mixer module 74 passes on the left front signal L F , the right front signal R F , the center front signal C, the subwoofer signal LFE, the left front 3D signal LF3D, the right front 3D signal RF3D, the left rear 3D signal L R3D , and right rear 3D signal R R3D to the left front speaker 21, the right front speaker 22, the center front speaker 29, the subwoofer 30, the left front 3D speaker 25, the right front 3D speaker 26, the left rear 3D speaker 27, and the right rear 3D speaker 28, respectively.
  • the mixer module 74 further generates an updated left surround signal L S ', an updated right surround signal R S ', a left rear signal L R , and a right rear signal R R .
  • the updated left surround signal L S ', the updated right surround signal R S ', the left rear signal L R , and the right rear signal R R . are output to the left surround speaker 23, the right surround speaker 24, the left rear speaker 31, and the right rear speaker 31.
  • ⁇ x is much greater than ⁇ x , in particular at least 10 times greater, for x being 5 and 6.
  • the updated surround signals L S ' and R S ' are dominated by the surround signals L S and R S , but have a slight component of the respective front signal L F and R F for a more voluminous sound experience.
  • ⁇ x and ⁇ x are comparable in magnitude, i.e. they are less than a factor 10 different, in particular less than a factor 5 different, even more in particular less than a factor 2 different, for x being 7 and 8.
  • the sound from the left and right rear speakers 31 and 32 provides for a natural sound experience between the left and right front speakers 21 and 22 on the one side and the left and right surround speaker 23 and 24 on the other side.
  • the combining or shuffling provided by the mixer module 74 may be desirable in some application scenarios.
  • the mixer module 74 be dispensed with, and that the audio signals may be passed on to the speakers as they are.
  • the left surround signal L s and the right surround signal R s may be passed on to the speakers as they are.
  • the signal output section 66 is provided for passing on the audio signals to the speakers only.
  • the signal input section, the room simulation module, and the signal output section may be implemented in any appropriate manner. They may be implemented in hardware, such as in digital signal processing components. They may also be implemented in software or in any appropriate combination of hardware and software.

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Stereophonic System (AREA)

Claims (10)

  1. Appareil de traitement de signaux (6) pour un système audio (2) destiné à un véhicule, comprenant :
    une partie (62) réservée à l'entrée des signaux, par l'intermédiaire de laquelle, en état de marche, un signal audio à canaux multiples est produit, le signal audio à canaux multiples comprenant au moins un signal avant gauche (LF), un signal d'ambiance gauche (LS), un signal avant droit (RF) et un signal d'ambiance droit (Rs) ;
    dans lequel l'appareil de traitement de signaux (6) comprend en outre :
    un module de simulation acoustique de salle (64) conçu pour recevoir le signal audio à canaux multiples et pour générer au moins un signal de hauteur gauche en 3D (LF3D) et un signal de hauteur droit en 3D (RF3D), le module de simulation acoustique de salle (64) comprenant une fonction de simulation acoustique de salle gauche générant le signal de hauteur gauche en 3D (LF3D), le signal avant gauche (LF) et le signal d'ambiance gauche (LS) y représentant des entrées, et une fonction de simulation acoustique de salle droite générant le signal de hauteur droit en 3D (RF3D), le signal avant droit (RF) et le signal d'ambiance droit (RS) y représentant des entrées ;
    dans lequel la fonction de simulation acoustique de salle gauche représente une fonction de simulation acoustique de salle avant gauche ; dans lequel la fonction de simulation acoustique de salle droite représente une fonction de simulation acoustique de salle avant droite ; dans lequel le signal de hauteur gauche en 3D (LF3D) représente un signal de hauteur avant gauche en 3D et le signal de hauteur droit en 3D (RF3D) représente un signal de hauteur avant droit en 3D ; et
    dans lequel la fonction de simulation acoustique de salle gauche comprend une composante de simulation acoustique de salle gauche calculée sous la forme f1(α1 ∗ LS + β1 ∗ LF), LS désignant le signal d'ambiance gauche et LF désignant le signal avant gauche, et α1 étant supérieur à β1 ; et dans lequel la fonction de simulation acoustique de salle droite comprend une composante de simulation acoustique de salle droite calculée sous la forme f2(a2 ∗ RS + β2 ∗ RF), Rs désignant le signal d'ambiance droit et RF désignant le signal avant droit, et α2 étant supérieur à β2 ; et une partie (66) réservée à la sortie des signaux, destinée à envoyer le signal de hauteur gauche en 3D (LF3D) et le signal de hauteur droit en 3D (RF3D) à un haut-parleur gauche en 3D (25) et à un haut-parleur droit en 3D (26) disposés dans une partie supérieure avant d'un véhicule.
  2. Appareil de traitement de signaux (6) selon la revendication 1, dans lequel la fonction de simulation acoustique de salle gauche comprend une composante de stabilité audio gauche calculée sous la forme (γ1 ∗ Ls + δ1 ∗ LF), Ls désignant le signal d'ambiance gauche et LF désignant le signal avant gauche, et γ1 étant supérieur à δ1 ; et dans lequel la fonction de simulation acoustique de salle droite comprend une composante de stabilité audio droite calculée sous la forme (γ2 ∗ RS + δ2 ∗ RF), RS désignant le signal d'ambiance droit et RF désignant le signal avant droit, et γ2 étant supérieur à δ2.
  3. Appareil de traitement de signaux (6) selon la revendication 1 ou 2, dans lequel la fonction de simulation acoustique de salle gauche comprend une composante de simulation acoustique de salle gauche et une composante de stabilité audio gauche, la composante de stabilité audio gauche comprenant le signal avant gauche (LF) et le signal d'ambiance gauche (LS) sous la forme d'un terme additif, pondérés par l'intermédiaire d'un coefficient respectif, et la composante de simulation acoustique de salle gauche étant supérieure à la composante de stabilité audio gauche, et dans lequel la fonction de simulation acoustique de salle droite comprend une composante de simulation acoustique de salle droite et une composante de stabilité audio droite, la composante de stabilité audio droite comprenant le signal avant droit (RF) et le signal d'ambiance droit (RS) sous la forme d'un terme additif, pondérés par l'intermédiaire d'un coefficient respectif, et la composante de simulation acoustique de salle droite étant supérieure à la composante de stabilité audio droite.
  4. Appareil de traitement de signaux (6) selon l'une quelconque des revendications précédentes, dans lequel les fonctions de simulation acoustique de salle gauche et droite sont configurées pour simuler un espace auditif qui est plus grand qu'un habitacle de véhicule.
  5. Appareil de traitement de signaux (6) selon l'une quelconque des revendications précédentes, dans lequel le module de simulation acoustique de salle (64) comprend en outre une fonction de simulation acoustique de salle arrière gauche générant un signal de hauteur arrière gauche en 3D (LR3D), le signal avant gauche (LF) et le signal d'ambiance gauche (LS) y représentant des entrées, et une fonction de simulation acoustique de salle arrière droite générant un signal de hauteur arrière droit en 3D (RR3D), le signal avant droit (RF) et le signal d'ambiance droit (RS) y représentant des entrées.
  6. Appareil de traitement de signaux (6) selon l'une quelconque des revendications précédentes, dans lequel le signal audio à canaux multiples représente un signal d'entrée qui émane d'une source audio.
  7. Appareil de traitement de signaux (6) selon l'une quelconque des revendications 1 à 5, dans lequel la partie (62) réservée à l'entrée des signaux comprend un module de conversion de signaux audio (70), le module de conversion de signaux audio (70) étant conçu pour générer le signal audio à canaux multiples à partir d'un signal d'entrée dans lequel ne figure pas au moins un signal choisi parmi le signal avant gauche, le signal d'ambiance gauche, le signal avant droit et le signal d'ambiance droit, comme par exemple à partir d'un signal d'entrée stéréo à deux canaux.
  8. Système audio (2) destiné à un véhicule comprenant un certain nombre de haut-parleurs, lesdits plusieurs haut-parleurs comprenant un haut-parleur avant gauche en 3D (25) et un haut-parleur avant droit en 3D (26), le haut-parleur avant gauche en 3D (25) et le haut-parleur avant droit en 3D (26) étant configurés pour venir se disposer dans une partie supérieure avant d'un véhicule (4) ;
    le système audio (2) destiné à un véhicule comprenant en outre un appareil de traitement de signaux (6) selon l'une quelconque des revendications précédentes, l'appareil de traitement de signaux (6) étant couplé au haut-parleur avant gauche en 3D (25) et au haut-parleur avant droit en 3D (26) pour la production du signal de hauteur gauche en 3D (LF3D) et du signal de hauteur droite en 3D (RF3D) aux haut-parleurs en question.
  9. Véhicule (4) destiné au transport de passagers, tel qu'un car, un bus ou une camionnette, comprenant un système audio (2) destiné à un véhicule selon la revendication 8, le système audio (2) destiné à un véhicule étend monté dans le véhicule destiné au transport de passagers, le haut-parleur avant gauche en 3D (25) et le haut-parleur avant droit en 3D (26) étant disposés dans une partie supérieure avant du véhicule (4) destiné au transport des passagers.
  10. Procédé de traitement de signaux pour un système audio destiné à un véhicule, le procédé comprenant l'étape consistant à
    recevoir un signal audio à canaux multiples comprenant au moins un signal avant gauche (LS), un signal d'ambiance gauche (LS), un signal avant droit (RF) et un signal d'ambiance droit (RS) ;
    dans lequel le procédé de traitement de signaux comprend en outre les étapes consistant à :
    générer au moins un signal de hauteur gauche en 3D (LF3D) et un signal de hauteur droit en 3D (RF3D) dans le but d'obtenir une simulation acoustique de salle par l'intermédiaire du système audio destiné à un véhicule, le signal avant gauche (LF) et le signal d'ambiance gauche (Ls) représentant des entrées dans une fonction de simulation acoustique de salle gauche qui génère le signal de hauteur gauche en 3D (LF3D), et le signal avant droit (RF) et le signal d'ambiance droit (RS) représentant des entrées dans une fonction de simulation acoustique de salle droite qui génère le signal de hauteur droit en 3D (RF3D) ;
    dans lequel la fonction de simulation acoustique de salle gauche représente une fonction de simulation acoustique de salle avant gauche, dans lequel la fonction de simulation acoustique de salle droite représente une fonction de simulation acoustique de salle avant droite, dans lequel le signal de hauteur gauche en 3D représente un signal de hauteur avant gauche en 3D et dans lequel le signal de hauteur droite en 3D représente un signal de hauteur avant droit en 3D ; et
    dans lequel la fonction de simulation acoustique de salle gauche comprend une composante de simulation acoustique de salle gauche calculée sous la forme f1(α1 ∗ Ls + β1 ∗ LF), Ls désignant le signal d'ambiance gauche et LF désignant le signal avant gauche, et α1 étant supérieur à β1 ; et dans lequel la fonction de simulation acoustique de salle droite comprend une composante de simulation acoustique de salle droite calculée sous la forme f2(a2 ∗ RS + β2 ∗ RF), RS désignant le signal d'ambiance droit et RF désignant le signal avant droit, et α2 étant supérieur à β2 ; et
    envoyer le signal de hauteur gauche en 3D (LF3D) et le signal de hauteur droit en 3D (RF3D) à un haut-parleur gauche en 3D (25) et un haut-parleur droit en 3D (26) disposés dans une partie supérieure avant d'un véhicule.
EP14177369.7A 2014-07-17 2014-07-17 Appareil de traitement de signal pour système audio pour automobile et procédé de traitement de signaux pour un système acoustique de véhicule Active EP2975864B1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP14177369.7A EP2975864B1 (fr) 2014-07-17 2014-07-17 Appareil de traitement de signal pour système audio pour automobile et procédé de traitement de signaux pour un système acoustique de véhicule

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
EP14177369.7A EP2975864B1 (fr) 2014-07-17 2014-07-17 Appareil de traitement de signal pour système audio pour automobile et procédé de traitement de signaux pour un système acoustique de véhicule

Publications (2)

Publication Number Publication Date
EP2975864A1 EP2975864A1 (fr) 2016-01-20
EP2975864B1 true EP2975864B1 (fr) 2020-05-13

Family

ID=51205284

Family Applications (1)

Application Number Title Priority Date Filing Date
EP14177369.7A Active EP2975864B1 (fr) 2014-07-17 2014-07-17 Appareil de traitement de signal pour système audio pour automobile et procédé de traitement de signaux pour un système acoustique de véhicule

Country Status (1)

Country Link
EP (1) EP2975864B1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP4247003A1 (fr) * 2022-03-18 2023-09-20 Nio Technology (Anhui) Co., Ltd Système sonore à canaux multiples dans un véhicule

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060222187A1 (en) * 2005-04-01 2006-10-05 Scott Jarrett Microphone and sound image processing system
WO2010027882A1 (fr) * 2008-09-03 2010-03-11 Dolby Laboratories Licensing Corporation Amélioration de la reproduction de multiples canaux audio
US20120008789A1 (en) * 2010-07-07 2012-01-12 Korea Advanced Institute Of Science And Technology 3d sound reproducing method and apparatus
WO2014088328A1 (fr) * 2012-12-04 2014-06-12 삼성전자 주식회사 Appareil de fourniture audio et procédé de fourniture audio

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4418774B2 (ja) 2005-05-13 2010-02-24 アルパイン株式会社 オーディオ装置およびサラウンド音生成方法
US8363843B2 (en) * 2007-03-01 2013-01-29 Apple Inc. Methods, modules, and computer-readable recording media for providing a multi-channel convolution reverb
EP2190221B1 (fr) * 2008-11-20 2018-09-12 Harman Becker Automotive Systems GmbH Système audio
US9986356B2 (en) * 2012-02-15 2018-05-29 Harman International Industries, Incorporated Audio surround processing system

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060222187A1 (en) * 2005-04-01 2006-10-05 Scott Jarrett Microphone and sound image processing system
WO2010027882A1 (fr) * 2008-09-03 2010-03-11 Dolby Laboratories Licensing Corporation Amélioration de la reproduction de multiples canaux audio
US20120008789A1 (en) * 2010-07-07 2012-01-12 Korea Advanced Institute Of Science And Technology 3d sound reproducing method and apparatus
WO2014088328A1 (fr) * 2012-12-04 2014-06-12 삼성전자 주식회사 Appareil de fourniture audio et procédé de fourniture audio
EP2930952A1 (fr) * 2012-12-04 2015-10-14 Samsung Electronics Co., Ltd. Appareil de fourniture audio et procédé de fourniture audio

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP4247003A1 (fr) * 2022-03-18 2023-09-20 Nio Technology (Anhui) Co., Ltd Système sonore à canaux multiples dans un véhicule

Also Published As

Publication number Publication date
EP2975864A1 (fr) 2016-01-20

Similar Documents

Publication Publication Date Title
CN1943273B (zh) 声像定位控制装置
EP3061268B1 (fr) Procédé et dispositif mobile pour traiter un signal audio
EP3364669B1 (fr) Appareil et procédé pour générer un signal audio de sortie présentant au moins deux canaux de sortie
EP2806663A1 (fr) Génération de zones sonores individuelles dans une salle d'écoute
US8577065B2 (en) Systems and methods for creating immersion surround sound and virtual speakers effects
TW201119420A (en) Virtual audio processing for loudspeaker or headphone playback
US9661436B2 (en) Audio signal playback device, method, and recording medium
CN108737930B (zh) 车辆导航系统中的可听提示
JP5776597B2 (ja) 音信号処理装置
EP2229012B1 (fr) Dispositif, procédé, programme et système pour annuler la diaphonie lors de la reproduction sonore par plusieurs haut-parleurs agencés autour de l'auditeur
JP2007116365A (ja) マルチチャンネル音響システム及びバーチャルスピーカ音声生成方法
US10257634B2 (en) Apparatus and method for processing stereo signals for reproduction in cars to achieve individual three-dimensional sound by frontal loudspeakers
CN112954581A (zh) 一种音频播放方法、系统及装置
CN104396279A (zh) 用于多声道音频信号的下混合的方法和设备
EP2975864B1 (fr) Appareil de traitement de signal pour système audio pour automobile et procédé de traitement de signaux pour un système acoustique de véhicule
US8165325B2 (en) Automotive virtual surround audio system
CN101461256A (zh) 扬声器系统
JP4402632B2 (ja) オーディオ装置
CN117242782A (zh) 麦克风、用于记录声学信号的方法、用于声学信号的再现设备或用于再现声学信号的方法
JP2001025098A (ja) 車載用音響システム
JP2013165387A (ja) 車載用オーディオ装置
CN117652161A (zh) 用于回放沉浸式音频的音频处理方法
Sound AES 36th INTERNATIONAL CONFERENCE
Koenig Future Needs to Create Natural 3D Auditory Events via More Channel Headphones for MPEG Surround pPurposes
KR20110102719A (ko) 오디오 업믹싱 장치 및 방법

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

17P Request for examination filed

Effective date: 20160720

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20181119

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20190912

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAJ Information related to disapproval of communication of intention to grant by the applicant or resumption of examination proceedings by the epo deleted

Free format text: ORIGINAL CODE: EPIDOSDIGR1

GRAL Information related to payment of fee for publishing/printing deleted

Free format text: ORIGINAL CODE: EPIDOSDIGR3

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTC Intention to grant announced (deleted)
INTG Intention to grant announced

Effective date: 20200219

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602014065355

Country of ref document: DE

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1271813

Country of ref document: AT

Kind code of ref document: T

Effective date: 20200615

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20200513

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200914

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200913

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200813

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200814

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200813

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1271813

Country of ref document: AT

Kind code of ref document: T

Effective date: 20200513

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602014065355

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20210216

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20200731

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200731

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200731

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200717

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200731

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200717

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20240719

Year of fee payment: 11

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20240725

Year of fee payment: 11

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20240730

Year of fee payment: 11