EP2975864A1 - Signal processing apparatus for a vehicle sound system and signal processing method for a vehicle sound system - Google Patents

Signal processing apparatus for a vehicle sound system and signal processing method for a vehicle sound system Download PDF

Info

Publication number
EP2975864A1
EP2975864A1 EP14177369.7A EP14177369A EP2975864A1 EP 2975864 A1 EP2975864 A1 EP 2975864A1 EP 14177369 A EP14177369 A EP 14177369A EP 2975864 A1 EP2975864 A1 EP 2975864A1
Authority
EP
European Patent Office
Prior art keywords
signal
room simulation
surround
speaker
processing apparatus
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP14177369.7A
Other languages
German (de)
French (fr)
Other versions
EP2975864B1 (en
Inventor
Timo Esser
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Alpine Electronics Inc
Original Assignee
Alpine Electronics Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alpine Electronics Inc filed Critical Alpine Electronics Inc
Priority to EP14177369.7A priority Critical patent/EP2975864B1/en
Publication of EP2975864A1 publication Critical patent/EP2975864A1/en
Application granted granted Critical
Publication of EP2975864B1 publication Critical patent/EP2975864B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S5/00Pseudo-stereo systems, e.g. in which additional channel signals are derived from monophonic signals by means of phase shifting, time delay or reverberation 
    • H04S5/005Pseudo-stereo systems, e.g. in which additional channel signals are derived from monophonic signals by means of phase shifting, time delay or reverberation  of the pseudo five- or more-channel type, e.g. virtual surround
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
    • H04R2499/00Aspects covered by H04R or H04S not otherwise provided for in their subgroups
    • H04R2499/10General applications
    • H04R2499/13Acoustic transducers and sound field adaptation in vehicles
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S7/00Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30Control circuits for electronic adaptation of the sound field
    • H04S7/305Electronic adaptation of stereophonic audio signals to reverberation of the listening space

Definitions

  • the present invention is in the field of sound systems for passenger transport vehicles, such as cars, buses and trucks.
  • the present invention is in the field of a signal processing apparatus for a vehicle sound system and a signal processing method for a vehicle sound system.
  • Exemplary embodiments of the invention include a signal processing apparatus for a vehicle sound system, comprising a signal input section, through which in operation a multi-channel audio signal is provided, the multi-channel audio signal comprising at least a left front signal, a left surround signal, a right front signal and a right surround signal, a room simulation module adapted to receive the multi-channel audio signal and to generate at least a left 3D signal and a right 3D signal, with the room simulation module comprising a left room simulation function generating the left 3D signal, with the left front signal and the left surround signal being inputs thereto, and a right room simulation function generating the right 3D signal, with the right front signal and the right surround signal being inputs thereto, and a signal output section for outputting the left 3D signal and the right 3D signal to a left 3D speaker and a right 3D speaker disposed in an upper portion of a vehicle.
  • the signal processing apparatus performs an up-conversion of the multi-channel audio signal. It generates at least two 3D audio signals, namely at least the left 3D signal and the right 3D signal, in addition to the multi-channel audio signal.
  • the left 3D signal and the right 3D signal are provided in addition to the left front signal, the left surround signal, the right front signal and the right surround signal, and as these signals are output via speakers in an upper portion of the vehicle, the passenger's audio experience is more voluminous. The passenger has the impression that he/she is listening to the audio content in a larger space.
  • the left 3D signal and the right 3D signal may also be referred to as a left 3D height signal and a right 3D height signal, because these signals create the perceived height of the listening room, when output via the speakers in the upper portion of the vehicle.
  • the left front signal and the left surround signal are separate inputs to the left room simulation function.
  • the right front signal and the right surround signal are separate inputs to the right room simulation function.
  • the room simulation functions are able to provide 3D sound that is adapted to the kind of audio content present.
  • orchestra music having a large diffuse surround component also referred to as uncorrelated sound component or reverb
  • the room simulation functions may provide strong 3D signals.
  • the room simulation functions may provide weaker 3D signals.
  • the signal processing apparatus allows for adding a high degree of 3D sound when appropriate in light of the type of audio content, while preventing an artificially sounding, excessive expansion of audio content when a large 3D sound component is not appropriate.
  • the signal processing apparatus allows for adding some 3D sound for all types of audio content, leading to an improved listening experience for all types of audio content.
  • the signal processing apparatus may always add some 3D sound component, but only add a large amount of 3D sound component when appropriate in light of the type of audio content. This can all be done in a fairly simple way through a single set of room simulation functions. No explicit distinction between different kinds of audio content and no application of different room simulation functions for different kinds of audio content is necessary.
  • the room simulation functions simulate an auditory space. In other words, they add a simulated room effect to the multi-channel audio signal. They provide a simulated room transfer function to the multi-channel audio signal. While the room simulation functions rely on multiple inputs for adding the appropriate amount of room simulation, the overall perceived room is more than an extraction of particular signal components, such as reverb, from the source signal.
  • the room simulation functions add a synthetic room which may depend in size and character on the room signal extracted from the original signal by the surround upmix at the input.
  • the left 3D speaker and the right 3D speaker are positioned in an upper portion of an interior space of a vehicle. They may be positioned towards the front of the interior space or towards the rear of the interior space. It is also possible that there are more than two 3D speakers, such as four 3D speakers. In that case, the signal processing apparatus may provide the same 3D signal to two 3D speakers, respectively, or may provide distinct signals to all four 3D speakers.
  • the term 3D speaker refers to a speaker that emits sounds in an upper portion of a vehicle, such as above a passenger's ear level and/or above the other main loudspeakers.
  • the signal input section is coupled to the room simulation module. Further, the room simulation module is coupled to the signal output section. In addition, the signal output section may be coupled to the signal input section.
  • the multi-channel audio signal may be provided directly from the signal input section to the signal output section.
  • the signal input section may comprise a first stage of signal processing. However, it is also possible that the signal input section is only provided for passing an audio signal on from an audio source.
  • speaker may refer to a single speaker, also referred to as loudspeaker.
  • speaker may also refer to a set of speakers, covering different frequency ranges.
  • the term speaker may refer to a set of two speaker of selected frequencies.
  • the term speaker may refer to the combination of a low frequency speaker and a high frequency speaker. It is equally possible that the term speaker refers to a set of three speakers, outputting low, medium and high frequencies, respectively.
  • a right 3D speaker it is possible that two or three speakers of different frequencies are provided in the right upper portion of the vehicle.
  • These limited frequency speakers may be arranged in one housing or in separate housings in proximity of each other.
  • the left room simulation function weighs the left front signal and the left surround signal differently and the right room simulation function weighs the right front signal and the right surround signal differently.
  • the left room simulation function has different weighing coefficients for the inputs of the left front signal and the left surround signal.
  • the right room simulation function has different weighing coefficients for the right front signal and the right surround signal.
  • the room simulation functions may then perform the room simulation on this weighed combination of the respective front and surround signals. This weighing of the front and surround signals provides for a fairly simple, closed implementation of the room simulation functions, applicable to all kinds of audio content.
  • the left room simulation function comprises a left room simulation component calculated as f 1 ( ⁇ 1 * L s + ⁇ 1 * L F ), with L s denoting the left surround signal and L F denoting the left front signal and with ⁇ 1 being greater than ⁇ 1
  • the right room simulation function comprises a right room simulation component calculated as f 2 ( ⁇ 2 * Rs + ⁇ 2 * R F ), with Rs denoting the right surround signal and R F denoting the right front signal and with ⁇ 2 being greater than ⁇ 2 .
  • the diffuse surround component is weighed stronger than the uncorrelated front signal. This leads to a very natural sound experience to the passenger, with the reverb portion of the multi-channel audio signal being the dominant portion in the processing and in the 3D speaker outputs. At the same time, a comparatively smaller 3D component is provided on the basis of the correlated front signal, leading to a voluminous sound experience also for highly correlated audio sources.
  • f 1 and f 2 refer to functions that simulate an auditory space, thus contributing a room simulation that is an addition as compared to the multi-channel audio signal and that cannot be merely extracted from the multi-channel audio signal.
  • f 1 and f 2 can be the same.
  • the left room simulation component may be calculated in accordance with the same function as the right room simulation component.
  • f 1 and f 2 are different functions.
  • ⁇ 1 equals ⁇ 2 and/or that ⁇ 1 equals ⁇ 2
  • ⁇ 1 is different from ⁇ 2 and/or that ⁇ 1 is different from ⁇ 2 .
  • ⁇ 1 is much greater than ⁇ 1 , i.e. more than 10 times greater. It is also possible that ⁇ 2 is much greater than ⁇ 2 , i.e. at least 10 times greater.
  • ⁇ 1 is much greater than ⁇ 1 , i.e. more than 10 times greater.
  • ⁇ 2 is much greater than ⁇ 2 , i.e. at least 10 times greater.
  • the left room simulation function may have the left room simulation component as the only signal component or may have other signal components, as discussed below.
  • the right room simulation function may have the right room simulation component as the only signal component or may have other signal components.
  • the left room simulation function comprises the left front signal and/or the left surround signal as an additive term, weighed by a respective coefficient
  • the right room simulation function comprises the right front signal and/or the right surround signal as an additive term, weighed by a respective coefficient.
  • additive term refers to a component that contributes to the room simulation functions purely by addition. In other words, it refers to a linear term. For this additive term, no function adding room simulation or any other simulation is applied to the front signal and/or surround signal. The inclusion of such an additive term results in a greater sound stability, increasing the ease of listening as compared to a pure room simulation component being output via the 3D speakers.
  • the left room simulation function comprises a left sound stability component calculated as ( ⁇ 1 * L S + ⁇ 1 * L F ), with L s denoting the left surround signal and L F denoting the left front signal and with ⁇ 1 being greater than ⁇ 1
  • the right room simulation function comprises a right sound stability component calculated as ( ⁇ 2 * R S + ⁇ 2 * R F ), with R S denoting the right surround signal and R F denoting the right front signal and with ⁇ 2 being greater than ⁇ 2 .
  • ⁇ 1 is much greater than ⁇ 1 , i.e. at least 10 times greater.
  • ⁇ 2 is much greater than ⁇ 2, i.e. at least 10 times greater.
  • ⁇ 1 , ⁇ 2 , ⁇ 1 and ⁇ 2 are greater than ⁇ 1 , ⁇ 2 , ⁇ 1 and ⁇ 2 .
  • ⁇ 1 , ⁇ 2 , ⁇ 1 and ⁇ 2 may be much greater than ⁇ 1 , ⁇ 2 , ⁇ 1 and ⁇ 2 , i.e. at least 10 times greater.
  • f 1 and f 2 ensure that the room simulation components are greater than the sound stability components.
  • the left room simulation function comprises a left room simulation component and a left sound stability component, with the left room simulation component being greater than the left sound stability component
  • the right room simulation function comprises a right room simulation component and a right sound stability component, with the right room simulation component being greater than the right sound stability component.
  • the comparison between the components may be carried out on the basis of the component amplitudes or component powers or any other suitable metric.
  • the respective room simulation functions may consist of the respective room simulation component and the respective sound stability component.
  • the respective room simulation and sound stability components may be the only components of the room simulation function in question.
  • the left and right room simulation functions are configured to simulate an auditory space that is larger than an interior space of a vehicle.
  • the vehicle sound system makes the passenger feel like he is listening to the audio content in a room that is larger than the actual interior of the vehicle.
  • superior acoustics can be simulated than can be achieved within the interior of the vehicle with prior art sound systems.
  • the left and right room simulation functions may be adapted to simulate the reverb generated in an enclosed space when an audio source is played.
  • the left and right room simulation functions are configured to simulate an ideal auditory space.
  • the left and right room simulation functions are configured to simulate an ideal auditory space of 4m x 6m x 2.5m.
  • the left 3D signal is a left front 3D signal and the right 3D signal is a right front 3D signal. Accordingly, the left 3D signal and the right 3D signal may be provided to the signal output section for being output to a left front 3D speaker and to a right front 3D speaker. Accordingly, the left 3D speaker may be a left front 3D speaker and the right 3D speaker may be a right front 3D speaker.
  • the room simulation module further comprises a left rear room simulation function generating a left rear 3D signal, with the left front signal and the left surround signal being inputs thereto, and a right rear room simulation function generating a right rear 3D signal, with the right front signal and the right surround signal being inputs thereto.
  • a left rear room simulation function generating a left rear 3D signal
  • a right rear room simulation function generating a right rear 3D signal, with the right front signal and the right surround signal being inputs thereto.
  • front and rear signals are generated in the third dimension, leading to a surrounding of the passenger with speakers from all sides.
  • an additional stereo surround sound is created in the upper portion of the vehicle, leading to an even more voluminous listening experience.
  • the left rear 3D signal and the right rear 3D signal may be output to a left rear 3D speaker and a right rear 3D speaker.
  • the output signal section may be configured for outputting the left rear 3D signal and the right read 3D signal to a left rear 3D speaker and a right rear
  • the left 3D signal is a left rear 3D signal and the right 3D signal is a right rear 3D signal. Accordingly it is also possible that the room simulation is implemented via rear speakers in the upper portion of the vehicle, in particular only via rear speakers in the upper portion of the vehicle.
  • the multi-channel audio signal is an input signal stemming from an audio source.
  • the vehicle sound system may comprise a DVD drive or CD drive or a hard disk drive or any other suitable means for reading out a memory containing the audio source signal.
  • the audio source signal is transferred to the vehicle in a wireless manner. Notwithstanding which source the audio input signal is coming from, the input signal may be a multi-channel signal that already contains the left front signal, the left surround signal, the right front signal, and the right surround signal.
  • An example for such an input signal is a 5.1 surround sound signal.
  • the input signal is a different kind of multi-channel audio signal having above discussed four signals.
  • the input signal section comprises an audio signal conversion module, with the audio signal conversion module being adapted to generate the multi-channel audio signal from an input signal missing at least one of the left front signal, the left surround signal, the right front signal and the right surround signal, such as from a two-channel stereo input signal.
  • the room simulation module can also be put to use for audio source signals that lack one of above discussed four signals.
  • the audio signal conversion module may be adapted to extract a left surround signal and a right surround signal from a two-channel stereo input signal. Accordingly, above-discussed features of room simulation simulation can be achieved via subsequent operations of audio signal conversion and room simulation generation.
  • the audio signal conversion module may be coupled to the room simulation module, either directly or via other signal processing modules, such as via a volume and/or fading and/or balance adaptation module.
  • any kind of audio source can be pre-processed for the ensuing room simulation simulation by the room simulation module.
  • the audio source may be any of a 1.0 mono source, a 2.0 stereo source, a 5.1 surround source, a 5.2 surround source, a 7.1 surround source or any other audio source.
  • the audio signal conversion module may be implemented in any of the manners described in EP 1 722 598 A2 with respect to the audio device of said document. The contents of said document is incorporated herein in its entirety.
  • Exemplary embodiments of the invention further include a vehicle sound system comprising a plurality of speakers, the plurality of speakers comprising a left 3D speaker and a right 3D speaker, the left 3D speaker and the right 3D speaker being configured to be disposed in an upper portion of a vehicle, the vehicle sound system further comprising a signal processing apparatus in accordance with any of the embodiments described above, with the signal processing apparatus being coupled to the left 3D speaker and the right 3D speaker for outputting the left 3D signal and the right 3D signal thereto.
  • a vehicle sound system comprising a plurality of speakers, the plurality of speakers comprising a left 3D speaker and a right 3D speaker, the left 3D speaker and the right 3D speaker being configured to be disposed in an upper portion of a vehicle
  • the vehicle sound system further comprising a signal processing apparatus in accordance with any of the embodiments described above, with the signal processing apparatus being coupled to the left 3D speaker and the right 3D speaker for outputting the left 3D signal and the right 3D signal thereto.
  • the plurality of speakers of the vehicle sound system may comprise a left front speaker, a left surround speaker, a right front speaker, a right surround speaker. It may also include additional speaker, such as a center front speaker, a subwoofer, left and right rear speakers.
  • the left and right 3D speakers may be left and right front 3D speakers or left and right rear 3D speakers. It is also possible that the vehicle sound system has left and right front 3D speakers as well as left and right rear 3D speakers.
  • the signal processing apparatus may be coupled to all speakers present in the vehicle sound system.
  • the vehicle sound system may also comprise an audio source reading apparatus, such as a CD player or DVD player or hard disk drive, and/or an audio signal reception apparatus, such as a radio receiver.
  • Exemplary embodiments of the invention further include a passenger transport vehicle, such as a car, bus or truck, comprising a vehicle sound system, as described above, which includes a signal processing apparatus, as described in any of the embodiments above, with the vehicle sound system being installed in the passenger transport vehicle with the left 3D speaker and the right 3D speaker being disposed in an upper portion of the passenger transport vehicle.
  • a passenger transport vehicle such as a car, bus or truck
  • vehicle sound system as described above
  • the vehicle sound system being installed in the passenger transport vehicle with the left 3D speaker and the right 3D speaker being disposed in an upper portion of the passenger transport vehicle.
  • Exemplary embodiments of the invention further include a signal processing method for a vehicle sound system, the method comprising the steps of receiving a multi-channel audio signal comprising at least a left front signal, a left surround signal, a right front signal and a right surround signal, generating at least a left 3D signal and a right 3D signal for providing a room simulation by the vehicle sound system, with the left front signal and the left surround signal being inputs to a left room simulation function that generates the left 3D signal and with the right front signal and the right surround signal being inputs to a right room simulation function that generates the right 3D signal, and outputting the left 3D signal and the right 3D signal to a left 3D speaker and a right 3D speaker disposed in an upper portion of a vehicle.
  • a signal processing method for a vehicle sound system comprising the steps of receiving a multi-channel audio signal comprising at least a left front signal, a left surround signal, a right front signal and a right surround signal, generating at least a left 3D signal
  • Fig. 1 shows a perspective schematic diagram of a passenger transport vehicle 4, having a vehicle sound system 2 in accordance with an exemplary embodiment of the invention.
  • the vehicle sound system 2 comprises twelve speakers.
  • the vehicle sound system comprises a left front speaker 21, a left rear speaker 31, a left surround speaker 23, a right front speaker 22, a right rear speaker 32, a right surround speaker 24, a left front 3D speaker 25, a right front 3D speaker 26, a left rear 3D speaker 27, a right rear 3D speaker 28, a center front speaker 29, and a subwoofer 30. All of these speakers are coupled to a signal processing apparatus 6 by individual signal lines (shown in dashed lines in Fig. 1 ). It is also possible that all of the speakers 21-32 and the signal processing apparatus 6 are coupled via a bus architecture or any other means of signal communication.
  • the vehicle sound system 2 may comprise an audio signal receiving apparatus, such as a tuner, for receiving wireless audio source signals, such as radio broadcast waves or any other kind of signal / data transmission. Additionally/alternatively, it is possible that the vehicle sound system 2 is coupled to an audio source reading apparatus, such as a CD player or a DVD player or a hard disk drive or any other kind of signal / data storage device.
  • the audio signal receiving apparatus and/or the audio source reading apparatus may be coupled to the signal processing apparatus 6 for providing the audio source signal to the signal processing apparatus 6. No matter what the audio source is, the signal processing apparatus is adapted to receive the audio source signal and to generate respective output signals for the plurality of speakers.
  • Fig. 2 shows a signal processing apparatus 6 in accordance with an exemplary embodiment of the invention.
  • the signal processing apparatus 6 comprises a signal input section 62, a room simulation module 64, and a signal output section 66.
  • the exemplary signal processing apparatus 6 is described with a stereo signal being the audio source, which consists of the left source signal L Source and the right source signal R Source , and with the output signal consisting of twelve signals for being output to the twelve speakers of the vehicle 4 described above.
  • the signal input section 62 comprises an audio signal conversion module 70 and a audio signal conditioning module 72.
  • the audio signal conversion module 70 performs an up-conversion of the two-channel stereo input signal.
  • the audio signal conversion module 70 generates a left front signal L F , a right front signal R F , a left surround signal L S , a right surround signal Rs, a center front signal C and a subwoofer signal LFE (with LFE denoting "low frequency effects").
  • LFE subwoofer signal
  • the up-converted audio signal is then input into the audio signal conditioning module 72.
  • the audio signal conditioning module 72 is configured to adapt the volume, fading, balance and subwoofer levels of the audio signals. Such signal conditioning is also per se known in the art. Depending on the complexity of the vehicle sound system, the audio signal conditioning module 72 may have different functionality and different degrees of signal conditioning. It is also possible that the audio signal conditioning module 72 is dispensed with and that only a simple volume scaling takes place.
  • the only essential aspect with respect to the signal input section 62 is that a multi-channel signal is provided via the signal input section, which multi-channel audio signal contains a left front signal, a left surround signal, a right front signal and a right surround signal. If the audio source already provides such multi-channel audio signal, such as a 5.1 surround signal, the signal input section may consist of a mere passing on of the source signal.
  • the room simulation module 64 is coupled to the signal input section 62 in such a way that the left front signal L F , the left surround signal Ls, the right front signal R F and the right surround signal R L are provided by the signal input section 62 to the room simulation module 64. Based on these four signals, the room simulation module 64 generates four 3D signals, which are configured to be output to four speakers disposed in the upper portion of the vehicle. In particular, the room simulation module 64 generates a left front 3D signal, a right front 3D signal, a left rear 3D signal and a right rear 3D signal. These four 3D signals are generated by the room simulation module 64 in the manner described below.
  • ⁇ x , ⁇ x , ⁇ x and ⁇ x are weighing coefficients that allow for a relative scaling of the impact of the left front signal L F , the left surround signal L S , the right front signal R F and the right surround signal R S on the respective 3D signal.
  • ⁇ x is much greater than ⁇ x , in particular at least 10 times greater, for x being 1, 2, 3 and 4.
  • ⁇ x is much greater than ⁇ x , in particular at least 10 times greater, for x being 1, 2, 3 and 4.
  • ⁇ x and ⁇ x are greater than ⁇ x and ⁇ x , in particular much greater, i.e. at least 10 times greater, for x being 1, 2, 3 and 4.
  • the four room simulation functions given above each comprise a room simulation component and a sound stability component.
  • the room simulation components are calculated via the functions f 1 , f 2 , f 3 and f 4 .
  • These functions simulate an auditory space.
  • the functions f 1 , f 2 , f 3 and f 4 are adapted - on the basis of the weighed inputs - to mimic the audio experience a listener would have in a space that is larger than the interior of the passenger transport vehicle.
  • the functions f 1 , f 2 , f 3 and f 4 may be configured to generate the reverb that would be generated by the structure of an enclosed room.
  • the functions f 1 , f 2 , f 3 and f 4 may simulate an ideal auditory space, such as an auditory space of 4m x 6m x 2.5m.
  • the respective sound stability components consist of an addition of the respective left or right surround signal and of the respective left or right front signal, weighed by a respective weighing coefficient ⁇ x or ⁇ x . No further function apart from the weighing coefficients is applied to the inputs for the sound stability components.
  • an appropriate room simulation is generated for all types of audio content.
  • Audio content with a large surround sound component such as orchestra music
  • leads to strong 3D signals i.e. to a strong room simulation.
  • an appropriate amount of 3D simulation is presented to the listener.
  • the room simulation functions generate a lower amount of room simulation. This lower amount of room simulation ensures that the news speaker is not perceived as talking in a large hall with a lot of echo effect on the one hand.
  • the generation of a comparatively low level of room simulation still provides for a voluminous sound experience in the vehicle environment.
  • the signal output section 66 is coupled to both the signal input section 62 and the room simulation module 64. It is configured to receive the left front signal, the left surround signal, the right front signal, the right surround signal, the center front signal and the subwoofer signal from the input section 62. Further, it is configured to receive above discussed four 3D signals, namely the left front 3D signal L F3D , the right front 3D signal R F3D , the left rear 3D signal L R3D , and right rear 3D signal R R3D from the room simulation module 64.
  • the signal output section 66 is provided for outputting twelve signals to the respective speakers in the passenger transport vehicle.
  • the signal output section 66 comprises a mixer module 74.
  • This mixer module 74 allows for a combining or shuffling of the signals before being output to the speakers.
  • the mixer module 74 passes some of the signals on and generates some signals by combination.
  • the mixer module 74 passes on the left front signal L F , the right front signal R F , the center front signal C, the subwoofer signal LFE, the left front 3D signal L F3D , the right front 3D signal R F3D , the left rear 3D signal L R3D , and right rear 3D signal R R3D to the left front speaker 21, the right front speaker 22, the center front speaker 29, the subwoofer 30, the left front 3D speaker 25, the right front 3D speaker 26, the left rear 3D speaker 27, and the right rear 3D speaker 28, respectively.
  • the mixer module 74 further generates an updated left surround signal Ls', an updated right surround signal Rs', a left rear signal L R , and a right rear signal R R .
  • the updated left surround signal Ls', the updated right surround signal Rs', the left rear signal L R , and the right rear signal R R . are output to the left surround speaker 23, the right surround speaker 24, the left rear speaker 31, and the right rear speaker 31.
  • ⁇ x is much greater than ⁇ x , in particular at least 10 times greater, for x being 5 and 6.
  • the updated surround signals L S ' and R S ' are dominated by the surround signals Ls and Rs, but have a slight component of the respective front signal L F and R F for a more voluminous sound experience.
  • ⁇ x and ⁇ x are comparable in magnitude, i.e. they are less than a factor 10 different, in particular less than a factor 5 different, even more in particular less than a factor 2 different, for x being 7 and 8.
  • the sound from the left and right rear speakers 31 and 32 provides for a natural sound experience between the left and right front speakers 21 and 22 on the one side and the left and right surround speaker 23 and 24 on the other side.
  • the combining or shuffling provided by the mixer module 74 may be desirable in some application scenarios.
  • the mixer module 74 be dispensed with, and that the audio signals may be passed on to the speakers as they are.
  • the left surround signal L s and the right surround signal R s may be passed on to the speakers as they are.
  • the signal output section 66 is provided for passing on the audio signals to the speakers only.
  • the signal input section, the room simulation module, and the signal output section may be implemented in any appropriate manner. They may be implemented in hardware, such as in digital signal processing components. They may also be implemented in software or in any appropriate combination of hardware and software.

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Stereophonic System (AREA)

Abstract

A signal processing apparatus (6) for a vehicle sound system (2) includes a signal input section (62), through which in operation a multi-channel audio signal is provided, the multi-channel audio signal having at least a left front signal (LF), a left surround signal (Ls), a right front signal (RF) and a right surround signal (RS), a room simulation module (64) adapted to receive the multi-channel audio signal and to generate at least a left 3D signal (LF3D) and a right 3D signal (RF3D), with the room simulation module (64) having a left room simulation function generating the left 3D signal (LF3D), with the left front signal (LF) and the left surround signal (LS) being inputs thereto, and a right room simulation function generating the right 3D signal (RF3D), with the right front signal (RF) and the right surround signal (Rs) being inputs thereto, and a signal output section (66) for outputting the left 3D signal (LF3D) and the right 3D signal (RF3D) to a left 3D speaker (25) and a right 3D speaker (26) disposed in an upper portion of a vehicle.

Description

  • The present invention is in the field of sound systems for passenger transport vehicles, such as cars, buses and trucks. In particular, the present invention is in the field of a signal processing apparatus for a vehicle sound system and a signal processing method for a vehicle sound system.
  • It has long been known in the art to equip passenger transport vehicles with sound systems. Such sound systems are in use for listening to music, news, audio books, audio documentaries and other audio content. As compared to home sound systems, the room acoustics inside a vehicle provide a perceived sound quality that is significantly more inferior to a perfect listening room. Accordingly, it would be beneficial to provide means for a vehicle sound system that increase the perceived sound quality / sound experience for the user and that, in particular, provides an improved sound quality for various different types of audio content.
  • Exemplary embodiments of the invention include a signal processing apparatus for a vehicle sound system, comprising a signal input section, through which in operation a multi-channel audio signal is provided, the multi-channel audio signal comprising at least a left front signal, a left surround signal, a right front signal and a right surround signal, a room simulation module adapted to receive the multi-channel audio signal and to generate at least a left 3D signal and a right 3D signal, with the room simulation module comprising a left room simulation function generating the left 3D signal, with the left front signal and the left surround signal being inputs thereto, and a right room simulation function generating the right 3D signal, with the right front signal and the right surround signal being inputs thereto, and a signal output section for outputting the left 3D signal and the right 3D signal to a left 3D speaker and a right 3D speaker disposed in an upper portion of a vehicle.
  • The signal processing apparatus performs an up-conversion of the multi-channel audio signal. It generates at least two 3D audio signals, namely at least the left 3D signal and the right 3D signal, in addition to the multi-channel audio signal. As the left 3D signal and the right 3D signal are provided in addition to the left front signal, the left surround signal, the right front signal and the right surround signal, and as these signals are output via speakers in an upper portion of the vehicle, the passenger's audio experience is more voluminous. The passenger has the impression that he/she is listening to the audio content in a larger space. The left 3D signal and the right 3D signal may also be referred to as a left 3D height signal and a right 3D height signal, because these signals create the perceived height of the listening room, when output via the speakers in the upper portion of the vehicle.
  • The left front signal and the left surround signal are separate inputs to the left room simulation function. Analogously, the right front signal and the right surround signal are separate inputs to the right room simulation function. With these signals being separate inputs, the room simulation functions are able to provide 3D sound that is adapted to the kind of audio content present. For example, with orchestra music having a large diffuse surround component, also referred to as uncorrelated sound component or reverb, the room simulation functions may provide strong 3D signals. In contrast thereto, in the example of the audio content being a news reader, which audio content typically has low or no reverb, the room simulation functions may provide weaker 3D signals. In this way, the signal processing apparatus allows for adding a high degree of 3D sound when appropriate in light of the type of audio content, while preventing an artificially sounding, excessive expansion of audio content when a large 3D sound component is not appropriate. At the same time, the signal processing apparatus allows for adding some 3D sound for all types of audio content, leading to an improved listening experience for all types of audio content. In other words, the signal processing apparatus may always add some 3D sound component, but only add a large amount of 3D sound component when appropriate in light of the type of audio content. This can all be done in a fairly simple way through a single set of room simulation functions. No explicit distinction between different kinds of audio content and no application of different room simulation functions for different kinds of audio content is necessary.
  • The room simulation functions simulate an auditory space. In other words, they add a simulated room effect to the multi-channel audio signal. They provide a simulated room transfer function to the multi-channel audio signal. While the room simulation functions rely on multiple inputs for adding the appropriate amount of room simulation, the overall perceived room is more than an extraction of particular signal components, such as reverb, from the source signal. The room simulation functions add a synthetic room which may depend in size and character on the room signal extracted from the original signal by the surround upmix at the input.
  • The left 3D speaker and the right 3D speaker are positioned in an upper portion of an interior space of a vehicle. They may be positioned towards the front of the interior space or towards the rear of the interior space. It is also possible that there are more than two 3D speakers, such as four 3D speakers. In that case, the signal processing apparatus may provide the same 3D signal to two 3D speakers, respectively, or may provide distinct signals to all four 3D speakers. The term 3D speaker refers to a speaker that emits sounds in an upper portion of a vehicle, such as above a passenger's ear level and/or above the other main loudspeakers.
  • The signal input section is coupled to the room simulation module. Further, the room simulation module is coupled to the signal output section. In addition, the signal output section may be coupled to the signal input section. In particular, the multi-channel audio signal may be provided directly from the signal input section to the signal output section. The signal input section may comprise a first stage of signal processing. However, it is also possible that the signal input section is only provided for passing an audio signal on from an audio source.
  • The term speaker, as used throughout this disclosure, may refer to a single speaker, also referred to as loudspeaker. However, the term speaker may also refer to a set of speakers, covering different frequency ranges. For example, the term speaker may refer to a set of two speaker of selected frequencies. In particular, the term speaker may refer to the combination of a low frequency speaker and a high frequency speaker. It is equally possible that the term speaker refers to a set of three speakers, outputting low, medium and high frequencies, respectively. In the example of a right 3D speaker, it is possible that two or three speakers of different frequencies are provided in the right upper portion of the vehicle. These limited frequency speakers may be arranged in one housing or in separate housings in proximity of each other.
  • According to a further embodiment, the left room simulation function weighs the left front signal and the left surround signal differently and the right room simulation function weighs the right front signal and the right surround signal differently. In other words, the left room simulation function has different weighing coefficients for the inputs of the left front signal and the left surround signal. Analogously, the right room simulation function has different weighing coefficients for the right front signal and the right surround signal. The room simulation functions may then perform the room simulation on this weighed combination of the respective front and surround signals. This weighing of the front and surround signals provides for a fairly simple, closed implementation of the room simulation functions, applicable to all kinds of audio content.
  • According to a further embodiment, the left room simulation function comprises a left room simulation component calculated as f11 * Ls + β1 * LF), with Ls denoting the left surround signal and LF denoting the left front signal and with α1 being greater than β1, and wherein the right room simulation function comprises a right room simulation component calculated as f22 * Rs + β2 * RF), with Rs denoting the right surround signal and RF denoting the right front signal and with α2 being greater than β2. The given formulas with the given relationship between the weighing coefficients α and β allow for an optimized addition of room simulation, depending on the type of audio content, implemented as a single set of room simulation functions. The diffuse surround component is weighed stronger than the uncorrelated front signal. This leads to a very natural sound experience to the passenger, with the reverb portion of the multi-channel audio signal being the dominant portion in the processing and in the 3D speaker outputs. At the same time, a comparatively smaller 3D component is provided on the basis of the correlated front signal, leading to a voluminous sound experience also for highly correlated audio sources.
  • The expressions "f1" and "f2" refer to functions that simulate an auditory space, thus contributing a room simulation that is an addition as compared to the multi-channel audio signal and that cannot be merely extracted from the multi-channel audio signal. In a particular embodiment, f1 and f2 can be the same. In other words the left room simulation component may be calculated in accordance with the same function as the right room simulation component. However, it is also possible that f1 and f2 are different functions. Also, while it is possible that α1 equals α2 and/or that β1 equals β2, it is also possible that α1 is different from α2 and/or that β1 is different from β2. In a particular embodiment, α1 is much greater than β1, i.e. more than 10 times greater. It is also possible that α2 is much greater than β2, i.e. at least 10 times greater. Such a relationship between the weighing coefficients allows for a particularly good compromise between some added room simulation for all types of audio content and a strong addition of room simulation when appropriate in light of the type of audio content in question.
  • The left room simulation function may have the left room simulation component as the only signal component or may have other signal components, as discussed below. Analogously, the right room simulation function may have the right room simulation component as the only signal component or may have other signal components.
  • According to a further embodiment, the left room simulation function comprises the left front signal and/or the left surround signal as an additive term, weighed by a respective coefficient, and the right room simulation function comprises the right front signal and/or the right surround signal as an additive term, weighed by a respective coefficient. The expression "additive term" refers to a component that contributes to the room simulation functions purely by addition. In other words, it refers to a linear term. For this additive term, no function adding room simulation or any other simulation is applied to the front signal and/or surround signal. The inclusion of such an additive term results in a greater sound stability, increasing the ease of listening as compared to a pure room simulation component being output via the 3D speakers.
  • According to a further embodiment, the left room simulation function comprises a left sound stability component calculated as (γ1 * LS + δ1 * LF), with Ls denoting the left surround signal and LF denoting the left front signal and with γ1 being greater than δ1, and the right room simulation function comprises a right sound stability component calculated as (γ2 * RS + δ2 * RF), with RS denoting the right surround signal and RF denoting the right front signal and with γ2 being greater than δ2. In this way, both the respective front signal as well as the respective surround signal are included into the room simulation functions in a linear manner. Accordingly, above described addition of stability may be implemented in a straightforward manner on the basis of the same front signal and surround signal inputs, without a distinction with respect to the type of audio content being necessary. With the surround signal being weighed stronger than the front signal, a hollow overall sound due to the front signal being output from the upper portion of the vehicle in a dominant manner is prevented. In a particular embodiment γ1 is much greater than δ1, i.e. at least 10 times greater. It is also possible that γ2 is much greater than δ2, i.e. at least 10 times greater. Again, it is possible that γ1 and γ2 are the same or different and that δ1 and δ2 are the same or different.
  • According to a further embodiment, α1, α2, β1 and β2 are greater than γ1, γ2, δ1 and δ2. In this way, it may be ensured that the respective room simulation components are greater than the respective sound stability components. In particular, α1, α2, β1 and β2 may be much greater than γ1, γ2, δ1 and δ2, i.e. at least 10 times greater. However, it is also possible that the particular implementations of f1 and f2 ensure that the room simulation components are greater than the sound stability components.
  • According to a further embodiment, the left room simulation function comprises a left room simulation component and a left sound stability component, with the left room simulation component being greater than the left sound stability component, and wherein the right room simulation function comprises a right room simulation component and a right sound stability component, with the right room simulation component being greater than the right sound stability component. In this way, a comparatively larger room simulation component is combined with a comparatively smaller sound stability component, thus allowing for a dominant 3D room simulation, while at the same time ensuring a relaxing listening experience to the passenger. In a particular embodiment, the respective room simulation components may be much greater than the respective sound stability components, i.e. at least 10 times greater. The comparison between the components may be carried out on the basis of the component amplitudes or component powers or any other suitable metric. In a particular embodiment, the respective room simulation functions may consist of the respective room simulation component and the respective sound stability component. In other words, the respective room simulation and sound stability components may be the only components of the room simulation function in question.
  • According to a further embodiment, the left and right room simulation functions are configured to simulate an auditory space that is larger than an interior space of a vehicle. In this way, the vehicle sound system makes the passenger feel like he is listening to the audio content in a room that is larger than the actual interior of the vehicle. In this way, superior acoustics can be simulated than can be achieved within the interior of the vehicle with prior art sound systems. In particular, the left and right room simulation functions may be adapted to simulate the reverb generated in an enclosed space when an audio source is played. In a particular embodiment, the left and right room simulation functions are configured to simulate an ideal auditory space. In a further particular embodiment, the left and right room simulation functions are configured to simulate an ideal auditory space of 4m x 6m x 2.5m.
  • According to a further embodiment, the left 3D signal is a left front 3D signal and the right 3D signal is a right front 3D signal. Accordingly, the left 3D signal and the right 3D signal may be provided to the signal output section for being output to a left front 3D speaker and to a right front 3D speaker. Accordingly, the left 3D speaker may be a left front 3D speaker and the right 3D speaker may be a right front 3D speaker.
  • According to a further embodiment, the room simulation module further comprises a left rear room simulation function generating a left rear 3D signal, with the left front signal and the left surround signal being inputs thereto, and a right rear room simulation function generating a right rear 3D signal, with the right front signal and the right surround signal being inputs thereto. In this way, front and rear signals are generated in the third dimension, leading to a surrounding of the passenger with speakers from all sides. In other words, an additional stereo surround sound is created in the upper portion of the vehicle, leading to an even more voluminous listening experience. The left rear 3D signal and the right rear 3D signal may be output to a left rear 3D speaker and a right rear 3D speaker. Accordingly, the output signal section may be configured for outputting the left rear 3D signal and the right read 3D signal to a left rear 3D speaker and a right rear 3D speaker.
  • Above discussed features and modifications of the left room simulation function and the right room simulation function can be implemented with respect to the the left rear room simulation function and the right rear room simulation function in an analogous manner. According to a further embodiment, the left 3D signal is a left rear 3D signal and the right 3D signal is a right rear 3D signal. Accordingly it is also possible that the room simulation is implemented via rear speakers in the upper portion of the vehicle, in particular only via rear speakers in the upper portion of the vehicle.
  • According to a further embodiment, the multi-channel audio signal is an input signal stemming from an audio source. For example, the vehicle sound system may comprise a DVD drive or CD drive or a hard disk drive or any other suitable means for reading out a memory containing the audio source signal. It is also possible that the audio source signal is transferred to the vehicle in a wireless manner. Notwithstanding which source the audio input signal is coming from, the input signal may be a multi-channel signal that already contains the left front signal, the left surround signal, the right front signal, and the right surround signal. An example for such an input signal is a 5.1 surround sound signal. It is also possible that the input signal is a different kind of multi-channel audio signal having above discussed four signals.
  • According to an alternative embodiment, the input signal section comprises an audio signal conversion module, with the audio signal conversion module being adapted to generate the multi-channel audio signal from an input signal missing at least one of the left front signal, the left surround signal, the right front signal and the right surround signal, such as from a two-channel stereo input signal. In this way, the room simulation module can also be put to use for audio source signals that lack one of above discussed four signals. In particular, the audio signal conversion module may be adapted to extract a left surround signal and a right surround signal from a two-channel stereo input signal. Accordingly, above-discussed features of room simulation simulation can be achieved via subsequent operations of audio signal conversion and room simulation generation. For this purpose, the audio signal conversion module may be coupled to the room simulation module, either directly or via other signal processing modules, such as via a volume and/or fading and/or balance adaptation module. With an appropriate audio signal conversion module, any kind of audio source can be pre-processed for the ensuing room simulation simulation by the room simulation module. For example, the audio source may be any of a 1.0 mono source, a 2.0 stereo source, a 5.1 surround source, a 5.2 surround source, a 7.1 surround source or any other audio source. In an exemplary embodiment, the audio signal conversion module may be implemented in any of the manners described in EP 1 722 598 A2 with respect to the audio device of said document. The contents of said document is incorporated herein in its entirety.
  • Exemplary embodiments of the invention further include a vehicle sound system comprising a plurality of speakers, the plurality of speakers comprising a left 3D speaker and a right 3D speaker, the left 3D speaker and the right 3D speaker being configured to be disposed in an upper portion of a vehicle, the vehicle sound system further comprising a signal processing apparatus in accordance with any of the embodiments described above, with the signal processing apparatus being coupled to the left 3D speaker and the right 3D speaker for outputting the left 3D signal and the right 3D signal thereto. The additional features and modifications described above with respect to the signal processing apparatus may equally be applied to the vehicle sound system. Above discussed advantages are also attainable with the vehicle sound system.
  • The plurality of speakers of the vehicle sound system may comprise a left front speaker, a left surround speaker, a right front speaker, a right surround speaker. It may also include additional speaker, such as a center front speaker, a subwoofer, left and right rear speakers. The left and right 3D speakers may be left and right front 3D speakers or left and right rear 3D speakers. It is also possible that the vehicle sound system has left and right front 3D speakers as well as left and right rear 3D speakers. The signal processing apparatus may be coupled to all speakers present in the vehicle sound system. The vehicle sound system may also comprise an audio source reading apparatus, such as a CD player or DVD player or hard disk drive, and/or an audio signal reception apparatus, such as a radio receiver.
  • Exemplary embodiments of the invention further include a passenger transport vehicle, such as a car, bus or truck, comprising a vehicle sound system, as described above, which includes a signal processing apparatus, as described in any of the embodiments above, with the vehicle sound system being installed in the passenger transport vehicle with the left 3D speaker and the right 3D speaker being disposed in an upper portion of the passenger transport vehicle. The additional features and modifications described above with respect to the signal processing apparatus and with respect to the vehicle sound system may equally be applied to the passenger transport vehicle. Above discussed advantages are also attainable with the passenger transport vehicle.
  • Exemplary embodiments of the invention further include a signal processing method for a vehicle sound system, the method comprising the steps of receiving a multi-channel audio signal comprising at least a left front signal, a left surround signal, a right front signal and a right surround signal, generating at least a left 3D signal and a right 3D signal for providing a room simulation by the vehicle sound system, with the left front signal and the left surround signal being inputs to a left room simulation function that generates the left 3D signal and with the right front signal and the right surround signal being inputs to a right room simulation function that generates the right 3D signal, and outputting the left 3D signal and the right 3D signal to a left 3D speaker and a right 3D speaker disposed in an upper portion of a vehicle. The additional features and modifications described above with respect to the signal processing apparatus may equally be applied to the signal processing methods. According modifications of the signal processing methods are herewith disclosed. Above discussed advantages are also attainable with the signal processing method.
  • Embodiments of the invention are described in greater detail below with reference to the figures, wherein:
    • Fig. 1 shows a perspective schematic view of an exemplary vehicle having an exemplary vehicle sound system in accordance with the invention installed therein.
    • Fig. 2 shows a block diagram of an exemplary signal processing apparatus in accordance with the invention.
  • Fig. 1 shows a perspective schematic diagram of a passenger transport vehicle 4, having a vehicle sound system 2 in accordance with an exemplary embodiment of the invention. The vehicle sound system 2 comprises twelve speakers. In particular, the vehicle sound system comprises a left front speaker 21, a left rear speaker 31, a left surround speaker 23, a right front speaker 22, a right rear speaker 32, a right surround speaker 24, a left front 3D speaker 25, a right front 3D speaker 26, a left rear 3D speaker 27, a right rear 3D speaker 28, a center front speaker 29, and a subwoofer 30. All of these speakers are coupled to a signal processing apparatus 6 by individual signal lines (shown in dashed lines in Fig. 1). It is also possible that all of the speakers 21-32 and the signal processing apparatus 6 are coupled via a bus architecture or any other means of signal communication.
  • The vehicle sound system 2 may comprise an audio signal receiving apparatus, such as a tuner, for receiving wireless audio source signals, such as radio broadcast waves or any other kind of signal / data transmission. Additionally/alternatively, it is possible that the vehicle sound system 2 is coupled to an audio source reading apparatus, such as a CD player or a DVD player or a hard disk drive or any other kind of signal / data storage device. The audio signal receiving apparatus and/or the audio source reading apparatus may be coupled to the signal processing apparatus 6 for providing the audio source signal to the signal processing apparatus 6. No matter what the audio source is, the signal processing apparatus is adapted to receive the audio source signal and to generate respective output signals for the plurality of speakers.
  • Fig. 2 shows a signal processing apparatus 6 in accordance with an exemplary embodiment of the invention. The signal processing apparatus 6 comprises a signal input section 62, a room simulation module 64, and a signal output section 66. The exemplary signal processing apparatus 6 is described with a stereo signal being the audio source, which consists of the left source signal LSource and the right source signal RSource, and with the output signal consisting of twelve signals for being output to the twelve speakers of the vehicle 4 described above.
  • The signal input section 62 comprises an audio signal conversion module 70 and a audio signal conditioning module 72. The audio signal conversion module 70 performs an up-conversion of the two-channel stereo input signal. In particular, the audio signal conversion module 70 generates a left front signal LF, a right front signal RF, a left surround signal LS, a right surround signal Rs, a center front signal C and a subwoofer signal LFE (with LFE denoting "low frequency effects"). Such up-conversion of a two-channel stereo signal into a 5.1 surround signal via the audio signal conversion module 70 is per se known in the art.
  • The up-converted audio signal is then input into the audio signal conditioning module 72. The audio signal conditioning module 72 is configured to adapt the volume, fading, balance and subwoofer levels of the audio signals. Such signal conditioning is also per se known in the art. Depending on the complexity of the vehicle sound system, the audio signal conditioning module 72 may have different functionality and different degrees of signal conditioning. It is also possible that the audio signal conditioning module 72 is dispensed with and that only a simple volume scaling takes place. The only essential aspect with respect to the signal input section 62 is that a multi-channel signal is provided via the signal input section, which multi-channel audio signal contains a left front signal, a left surround signal, a right front signal and a right surround signal. If the audio source already provides such multi-channel audio signal, such as a 5.1 surround signal, the signal input section may consist of a mere passing on of the source signal.
  • The room simulation module 64 is coupled to the signal input section 62 in such a way that the left front signal LF, the left surround signal Ls, the right front signal RF and the right surround signal RL are provided by the signal input section 62 to the room simulation module 64. Based on these four signals, the room simulation module 64 generates four 3D signals, which are configured to be output to four speakers disposed in the upper portion of the vehicle. In particular, the room simulation module 64 generates a left front 3D signal, a right front 3D signal, a left rear 3D signal and a right rear 3D signal. These four 3D signals are generated by the room simulation module 64 in the manner described below.
  • The left front 3D signal LF3D is generated by a left front room simulation function in accordance with the following formula: L F 3 D = f 1 α 1 * L S + β 1 * L F + γ 1 * L S + δ 1 * L F .
    Figure imgb0001
  • The right front 3D signal RF3D is generated by a right front room simulation function in accordance with the following formula: R F 3 D = f 2 α 2 * R S + β 2 * R F + γ 2 * R S + δ 2 * R F .
    Figure imgb0002
  • The left rear 3D signal LR3D is generated by a left rear room simulation function in accordance with the following formula: L R 3 D = f 3 α 3 * L S + β 3 * L F + γ 3 * L S + δ 3 * L F .
    Figure imgb0003
  • The right rear 3D signal RR3D is generated by a right rear room simulation function in accordance with the following formula: R R 3 D = f 4 α 4 * R S + β 4 * R F + γ 4 * R S + δ 4 * R F .
    Figure imgb0004
  • The parameters αx, βx, γx and δx are weighing coefficients that allow for a relative scaling of the impact of the left front signal LF, the left surround signal LS, the right front signal RF and the right surround signal RS on the respective 3D signal. In the exemplary embodiment described, αx is much greater than βx, in particular at least 10 times greater, for x being 1, 2, 3 and 4. Also, in the exemplary embodiment described, γx is much greater than δx, in particular at least 10 times greater, for x being 1, 2, 3 and 4. In the exemplary embodiment of Fig. 2, αx and βx are greater than γx and δx, in particular much greater, i.e. at least 10 times greater, for x being 1, 2, 3 and 4.
  • The four room simulation functions given above each comprise a room simulation component and a sound stability component. The room simulation components are calculated via the functions f1, f2, f3 and f4. These functions simulate an auditory space. In particular, the functions f1, f2, f3 and f4 are adapted - on the basis of the weighed inputs - to mimic the audio experience a listener would have in a space that is larger than the interior of the passenger transport vehicle. In particular, the functions f1, f2, f3 and f4 may be configured to generate the reverb that would be generated by the structure of an enclosed room. In particular, the functions f1, f2, f3 and f4 may simulate an ideal auditory space, such as an auditory space of 4m x 6m x 2.5m.
  • The respective sound stability components consist of an addition of the respective left or right surround signal and of the respective left or right front signal, weighed by a respective weighing coefficient γx or δx. No further function apart from the weighing coefficients is applied to the inputs for the sound stability components.
  • In this way, multiple effects are achieved, as already discussed in detail above. As the room simulation is dependent on both the respective surround signal and the respective front signal and as these two inputs are weighed differently, an appropriate room simulation is generated for all types of audio content. Audio content with a large surround sound component, such as orchestra music, leads to strong 3D signals, i.e. to a strong room simulation. In this way, an appropriate amount of 3D simulation is presented to the listener. In contrast thereto, for audio content not having a large surround component, such as news speakers or similar content, the room simulation functions generate a lower amount of room simulation. This lower amount of room simulation ensures that the news speaker is not perceived as talking in a large hall with a lot of echo effect on the one hand. On the other hand, the generation of a comparatively low level of room simulation still provides for a voluminous sound experience in the vehicle environment.
  • The signal output section 66 is coupled to both the signal input section 62 and the room simulation module 64. It is configured to receive the left front signal, the left surround signal, the right front signal, the right surround signal, the center front signal and the subwoofer signal from the input section 62. Further, it is configured to receive above discussed four 3D signals, namely the left front 3D signal LF3D, the right front 3D signal RF3D, the left rear 3D signal LR3D, and right rear 3D signal RR3D from the room simulation module 64. The signal output section 66 is provided for outputting twelve signals to the respective speakers in the passenger transport vehicle.
  • In the exemplary embodiment of Fig. 2, the signal output section 66 comprises a mixer module 74. This mixer module 74 allows for a combining or shuffling of the signals before being output to the speakers. In the exemplary embodiment of Fig. 2, the mixer module 74 passes some of the signals on and generates some signals by combination. In particular, the mixer module 74 passes on the left front signal LF, the right front signal RF, the center front signal C, the subwoofer signal LFE, the left front 3D signal LF3D, the right front 3D signal RF3D, the left rear 3D signal LR3D, and right rear 3D signal RR3D to the left front speaker 21, the right front speaker 22, the center front speaker 29, the subwoofer 30, the left front 3D speaker 25, the right front 3D speaker 26, the left rear 3D speaker 27, and the right rear 3D speaker 28, respectively. The mixer module 74 further generates an updated left surround signal Ls', an updated right surround signal Rs', a left rear signal LR, and a right rear signal RR. The updated left surround signal Ls', the updated right surround signal Rs', the left rear signal LR, and the right rear signal RR. are output to the left surround speaker 23, the right surround speaker 24, the left rear speaker 31, and the right rear speaker 31. These signals are generated in accordance with the following formulas: L S ʹ = α 5 * L S + β 5 * L F ;
    Figure imgb0005
    R S ʹ = α 6 * R S + β 6 * R F ;
    Figure imgb0006
    L R = α 7 * L S + β 7 * L F ;
    Figure imgb0007
    R R = α 8 * R S + β 8 * R F ;
    Figure imgb0008
  • In the exemplary embodiment of Fig. 2, αx is much greater than βx, in particular at least 10 times greater, for x being 5 and 6. In this way, the updated surround signals LS' and RS' are dominated by the surround signals Ls and Rs, but have a slight component of the respective front signal LF and RF for a more voluminous sound experience. In the exemplary embodiment of Fig. 2, αx and βx are comparable in magnitude, i.e. they are less than a factor 10 different, in particular less than a factor 5 different, even more in particular less than a factor 2 different, for x being 7 and 8. In this way, the sound from the left and right rear speakers 31 and 32 provides for a natural sound experience between the left and right front speakers 21 and 22 on the one side and the left and right surround speaker 23 and 24 on the other side.
  • It is pointed out that the combining or shuffling provided by the mixer module 74 may be desirable in some application scenarios. However, it is also possible that the mixer module 74 be dispensed with, and that the audio signals may be passed on to the speakers as they are. In this case, it is for example possible to pass on the left surround signal Ls and the right surround signal Rs to the left and right surround speakers 23 and 24, as they are. It is further for example possible to provide the rear speakers 31 and 32 with the respective surround signals LS and RS or with the respective front signals LF and RF. In general, it is possible that the signal output section 66 is provided for passing on the audio signals to the speakers only.
  • The signal input section, the room simulation module, and the signal output section may be implemented in any appropriate manner. They may be implemented in hardware, such as in digital signal processing components. They may also be implemented in software or in any appropriate combination of hardware and software.

Claims (15)

  1. Signal processing apparatus (6) for a vehicle sound system (2), comprising:
    a signal input section (62), through which in operation a multi-channel audio signal is provided, the multi-channel audio signal comprising at least a left front signal (LF), a left surround signal (LS), a right front signal (RF) and a right surround signal (RS),
    a room simulation module (64) adapted to receive the multi-channel audio signal and to generate at least a left 3D signal (LF3D) and a right 3D signal (RF3D), with the room simulation module (64) comprising a left room simulation function generating the left 3D signal (LF3D), with the left front signal (LF) and the left surround signal (Ls) being inputs thereto, and a right room simulation function generating the right 3D signal (RF30), with the right front signal (RF) and the right surround signal (Rs) being inputs thereto, and
    a signal output section (66) for outputting the left 3D signal (LF3D) and the right 3D signal (RF3D) to a left 3D speaker (25) and a right 3D speaker (26) disposed in an upper portion of a vehicle.
  2. Signal processing apparatus (6) according to claim 1, wherein the left room simulation function weighs the left front signal (LF) and the left surround signal (Ls) differently and wherein the right room simulation function weighs the right front signal (RF) and the right surround signal (Rs) differently.
  3. Signal processing apparatus (6) according to claim 1 or 2, wherein the left room simulation function comprises a left room simulation component calculated as f11 * LS + β1 * LF), with Ls denoting the left surround signal and LF denoting the left front signal and with α1 being greater than β1, and wherein the right room simulation function comprises a right room simulation component calculated as f22 * Rs + β2 * RF), with Rs denoting the right surround signal and RF denoting the right front signal and with α2 being greater than β2.
  4. Signal processing apparatus (6) according to any of the preceding claims, wherein the left room simulation function comprises the left front signal (LF) and/or the left surround signal (LS) as an additive term, weighed by a respective coefficient, and wherein the right room simulation function comprises the right front signal (RF) and/or the right surround signal (RS) as an additive term, weighed by a respective coefficient.
  5. Signal processing apparatus (6) according to any of the preceding claims, wherein the left room simulation function comprises a left sound stability component calculated as (γ1 * LS + δ1 * LF), with Ls denoting the left surround signal and LF denoting the left front signal and with γ1 being greater than δ1, and wherein the right room simulation function comprises a right sound stability component calculated as (γ2 * Rs + δ2 * RF), with RS denoting the right surround signal and RF denoting the right front signal and with γ2 being greater than δ2.
  6. Signal processing apparatus (6) according to any of the preceding claims, wherein the left room simulation function comprises a left room simulation component and a left sound stability component, with the left room simulation component being greater than the left sound stability component, and wherein the right room simulation function comprises a right room simulation component and a right sound stability component, with the right room simulation component being greater than the right sound stability component.
  7. Signal processing apparatus (6) according to any of the preceding claims, wherein the left and right room simulation functions are configured to simulate an auditory space that is larger than an interior space of a vehicle.
  8. Signal processing apparatus (6) according to any of the preceding claims, wherein the left room simulation function is a left front room simulation function, wherein the right room simulation function is a right front room simulation function, wherein the left 3D signal (LF3D) is a left front 3D signal and wherein the right 3D signal (RF3D) is a right front 3D signal.
  9. Signal processing apparatus (6) according to claim 8, wherein the room simulation module (64) further comprises a left rear room simulation function generating a left rear 3D signal (LR3D), with the left front signal (LF) and the left surround signal (LS) being inputs thereto, and a right rear room simulation function generating a right rear 3D signal (RR3D), with the right front signal (RF) and the right surround signal (Rs) being inputs thereto.
  10. Signal processing apparatus (6) according to any of claims 1 to 7, wherein the left 3D signal is a left rear 3D signal and wherein the right 3D signal is a right rear 3D signal.
  11. Signal processing apparatus (6) according to any of the preceding claims, wherein the multi-channel audio signal is an input signal stemming from an audio source.
  12. Signal processing apparatus (6) according to any of claims 1 to 10, wherein the input signal section (62) comprises an audio signal conversion module (70), with the audio signal conversion module (70) being adapted to generate the multi-channel audio signal from an input signal missing at least one of the left front signal, the left surround signal, the right front signal and the right surround signal, such as from a two-channel stereo input signal.
  13. Vehicle sound system (2) comprising a plurality of speakers, the plurality of speakers comprising a left 3D speaker (25) and a right 3D speaker (26), the left 3D speaker (25) and the right 3D speaker (26) being configured to be disposed in an upper portion of a vehicle (4),
    the vehicle sound system (2) further comprising a signal processing apparatus (6) according to any of the preceding claims, with the signal processing apparatus (6) being coupled to the left 3D speaker (25) and the right 3D speaker (26) for outputting the left 3D signal (LF3D) and the right 3D signal thereto (RF3D).
  14. Passenger transport vehicle (4), such as a car, bus or truck, comprising a vehicle sound system (2) according to claim 13, the vehicle sound system (2) being installed in the passenger transport vehicle with the left 3D speaker (25) and the right 3D speaker (26) being disposed in an upper portion of the passenger transport vehicle (4).
  15. Signal processing method for a vehicle sound system, the method comprising the steps of:
    receiving a multi-channel audio signal comprising at least a left front signal (LF), a left surround signal (LS), a right front signal (RF) and a right surround signal (Rs),
    generating at least a left 3D signal (LF3D) and a right 3D signal (RF3D) for providing a room simulation by the vehicle sound system, with the left front signal (LF) and the left surround signal (Ls) being inputs to a left room simulation function that generates the left 3D signal (LF3D) and with the right front signal (RF) and the right surround signal (Rs) being inputs to a right room simulation function that generates the right 3D signal (RF3D), and
    outputting the left 3D signal (LF3D) and the right 3D signal (RF3D) to a left 3D speaker (25) and a right 3D speaker (26) disposed in an upper portion of a vehicle.
EP14177369.7A 2014-07-17 2014-07-17 Signal processing apparatus for a vehicle sound system and signal processing method for a vehicle sound system Active EP2975864B1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP14177369.7A EP2975864B1 (en) 2014-07-17 2014-07-17 Signal processing apparatus for a vehicle sound system and signal processing method for a vehicle sound system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
EP14177369.7A EP2975864B1 (en) 2014-07-17 2014-07-17 Signal processing apparatus for a vehicle sound system and signal processing method for a vehicle sound system

Publications (2)

Publication Number Publication Date
EP2975864A1 true EP2975864A1 (en) 2016-01-20
EP2975864B1 EP2975864B1 (en) 2020-05-13

Family

ID=51205284

Family Applications (1)

Application Number Title Priority Date Filing Date
EP14177369.7A Active EP2975864B1 (en) 2014-07-17 2014-07-17 Signal processing apparatus for a vehicle sound system and signal processing method for a vehicle sound system

Country Status (1)

Country Link
EP (1) EP2975864B1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114697855A (en) * 2022-03-18 2022-07-01 蔚来汽车科技(安徽)有限公司 Multichannel vehicle-mounted sound system

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1722598A2 (en) 2005-05-13 2006-11-15 Alpine Electronics, Inc. Audio device and method for generating surround sound
WO2008108968A1 (en) * 2007-03-01 2008-09-12 Apple Inc. Methods, modules, and computer-readable recording media for providing a multi-channel convolution reverb
EP2190221A1 (en) * 2008-11-20 2010-05-26 Harman Becker Automotive Systems GmbH Audio system
EP2629552A1 (en) * 2012-02-15 2013-08-21 Harman International Industries, Incorporated Audio surround processing system

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060222187A1 (en) * 2005-04-01 2006-10-05 Scott Jarrett Microphone and sound image processing system
TWI559786B (en) * 2008-09-03 2016-11-21 杜比實驗室特許公司 Enhancing the reproduction of multiple audio channels
KR20120004909A (en) * 2010-07-07 2012-01-13 삼성전자주식회사 Stereo playback method and apparatus
BR112015013154B1 (en) * 2012-12-04 2022-04-26 Samsung Electronics Co., Ltd Audio delivery device, and audio delivery method

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1722598A2 (en) 2005-05-13 2006-11-15 Alpine Electronics, Inc. Audio device and method for generating surround sound
WO2008108968A1 (en) * 2007-03-01 2008-09-12 Apple Inc. Methods, modules, and computer-readable recording media for providing a multi-channel convolution reverb
EP2190221A1 (en) * 2008-11-20 2010-05-26 Harman Becker Automotive Systems GmbH Audio system
EP2629552A1 (en) * 2012-02-15 2013-08-21 Harman International Industries, Incorporated Audio surround processing system

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114697855A (en) * 2022-03-18 2022-07-01 蔚来汽车科技(安徽)有限公司 Multichannel vehicle-mounted sound system
CN114697855B (en) * 2022-03-18 2025-05-27 蔚来汽车科技(安徽)有限公司 Multi-channel car audio system

Also Published As

Publication number Publication date
EP2975864B1 (en) 2020-05-13

Similar Documents

Publication Publication Date Title
ES2895436T3 (en) Apparatus and method for generating an audio output signal having at least two output channels
US8577065B2 (en) Systems and methods for creating immersion surround sound and virtual speakers effects
TW201119420A (en) Virtual audio processing for loudspeaker or headphone playback
CN108737930B (en) Audible prompts in a vehicle navigation system
EP2229012B1 (en) Device, method, program, and system for canceling crosstalk when reproducing sound through plurality of speakers arranged around listener
US20150215721A1 (en) Audio signal playback device, method, and recording medium
US10257634B2 (en) Apparatus and method for processing stereo signals for reproduction in cars to achieve individual three-dimensional sound by frontal loudspeakers
JP2013201559A (en) Sound signal processing device
HK1247494A1 (en) Apparatus and method for processing stereo signals for reproduction in cars to achieve individual three-dimensional sound by frontal loudspeakers
EP3448066A1 (en) Signal processor
US8165325B2 (en) Automotive virtual surround audio system
EP2975864B1 (en) Signal processing apparatus for a vehicle sound system and signal processing method for a vehicle sound system
US20240373184A1 (en) A method of processing audio for playback of immersive audio
JP4402632B2 (en) Audio equipment
CN119516985B (en) Convenient accompaniment playing method, device, medium and electronic equipment based on eliminating original sound
CN120583364A (en) Sound processing method, device, storage medium and electronic device
CN117652161A (en) Audio processing methods for playback of immersive audio
JP6252426B2 (en) Audio signal processing device
JPH03139100A (en) On-vehicle sound reproducing device
JP2006053435A (en) Acoustic control device and acoustic control method
Sound AES 36th INTERNATIONAL CONFERENCE
JPH01293100A (en) On-vehicle stereo reproducing device
JP2008053902A (en) Acoustic reproduction system and method
HK1196198A1 (en) Apparatus and method and computer program for generating a stereo output signal for providing additional output channels
HK1196198B (en) Apparatus and method and computer program for generating a stereo output signal for providing additional output channels

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

17P Request for examination filed

Effective date: 20160720

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20181119

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20190912

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAJ Information related to disapproval of communication of intention to grant by the applicant or resumption of examination proceedings by the epo deleted

Free format text: ORIGINAL CODE: EPIDOSDIGR1

GRAL Information related to payment of fee for publishing/printing deleted

Free format text: ORIGINAL CODE: EPIDOSDIGR3

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTC Intention to grant announced (deleted)
INTG Intention to grant announced

Effective date: 20200219

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602014065355

Country of ref document: DE

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1271813

Country of ref document: AT

Kind code of ref document: T

Effective date: 20200615

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20200513

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200914

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200913

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200813

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200814

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200813

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1271813

Country of ref document: AT

Kind code of ref document: T

Effective date: 20200513

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602014065355

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20210216

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20200731

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200731

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200731

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200717

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200731

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200717

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20250722

Year of fee payment: 12

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20250722

Year of fee payment: 12

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20250725

Year of fee payment: 12