EP2975864A1 - Signal processing apparatus for a vehicle sound system and signal processing method for a vehicle sound system - Google Patents
Signal processing apparatus for a vehicle sound system and signal processing method for a vehicle sound system Download PDFInfo
- Publication number
- EP2975864A1 EP2975864A1 EP14177369.7A EP14177369A EP2975864A1 EP 2975864 A1 EP2975864 A1 EP 2975864A1 EP 14177369 A EP14177369 A EP 14177369A EP 2975864 A1 EP2975864 A1 EP 2975864A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- signal
- room simulation
- surround
- speaker
- processing apparatus
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S5/00—Pseudo-stereo systems, e.g. in which additional channel signals are derived from monophonic signals by means of phase shifting, time delay or reverberation
- H04S5/005—Pseudo-stereo systems, e.g. in which additional channel signals are derived from monophonic signals by means of phase shifting, time delay or reverberation of the pseudo five- or more-channel type, e.g. virtual surround
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
- H04R2499/00—Aspects covered by H04R or H04S not otherwise provided for in their subgroups
- H04R2499/10—General applications
- H04R2499/13—Acoustic transducers and sound field adaptation in vehicles
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
- H04S7/30—Control circuits for electronic adaptation of the sound field
- H04S7/305—Electronic adaptation of stereophonic audio signals to reverberation of the listening space
Definitions
- the present invention is in the field of sound systems for passenger transport vehicles, such as cars, buses and trucks.
- the present invention is in the field of a signal processing apparatus for a vehicle sound system and a signal processing method for a vehicle sound system.
- Exemplary embodiments of the invention include a signal processing apparatus for a vehicle sound system, comprising a signal input section, through which in operation a multi-channel audio signal is provided, the multi-channel audio signal comprising at least a left front signal, a left surround signal, a right front signal and a right surround signal, a room simulation module adapted to receive the multi-channel audio signal and to generate at least a left 3D signal and a right 3D signal, with the room simulation module comprising a left room simulation function generating the left 3D signal, with the left front signal and the left surround signal being inputs thereto, and a right room simulation function generating the right 3D signal, with the right front signal and the right surround signal being inputs thereto, and a signal output section for outputting the left 3D signal and the right 3D signal to a left 3D speaker and a right 3D speaker disposed in an upper portion of a vehicle.
- the signal processing apparatus performs an up-conversion of the multi-channel audio signal. It generates at least two 3D audio signals, namely at least the left 3D signal and the right 3D signal, in addition to the multi-channel audio signal.
- the left 3D signal and the right 3D signal are provided in addition to the left front signal, the left surround signal, the right front signal and the right surround signal, and as these signals are output via speakers in an upper portion of the vehicle, the passenger's audio experience is more voluminous. The passenger has the impression that he/she is listening to the audio content in a larger space.
- the left 3D signal and the right 3D signal may also be referred to as a left 3D height signal and a right 3D height signal, because these signals create the perceived height of the listening room, when output via the speakers in the upper portion of the vehicle.
- the left front signal and the left surround signal are separate inputs to the left room simulation function.
- the right front signal and the right surround signal are separate inputs to the right room simulation function.
- the room simulation functions are able to provide 3D sound that is adapted to the kind of audio content present.
- orchestra music having a large diffuse surround component also referred to as uncorrelated sound component or reverb
- the room simulation functions may provide strong 3D signals.
- the room simulation functions may provide weaker 3D signals.
- the signal processing apparatus allows for adding a high degree of 3D sound when appropriate in light of the type of audio content, while preventing an artificially sounding, excessive expansion of audio content when a large 3D sound component is not appropriate.
- the signal processing apparatus allows for adding some 3D sound for all types of audio content, leading to an improved listening experience for all types of audio content.
- the signal processing apparatus may always add some 3D sound component, but only add a large amount of 3D sound component when appropriate in light of the type of audio content. This can all be done in a fairly simple way through a single set of room simulation functions. No explicit distinction between different kinds of audio content and no application of different room simulation functions for different kinds of audio content is necessary.
- the room simulation functions simulate an auditory space. In other words, they add a simulated room effect to the multi-channel audio signal. They provide a simulated room transfer function to the multi-channel audio signal. While the room simulation functions rely on multiple inputs for adding the appropriate amount of room simulation, the overall perceived room is more than an extraction of particular signal components, such as reverb, from the source signal.
- the room simulation functions add a synthetic room which may depend in size and character on the room signal extracted from the original signal by the surround upmix at the input.
- the left 3D speaker and the right 3D speaker are positioned in an upper portion of an interior space of a vehicle. They may be positioned towards the front of the interior space or towards the rear of the interior space. It is also possible that there are more than two 3D speakers, such as four 3D speakers. In that case, the signal processing apparatus may provide the same 3D signal to two 3D speakers, respectively, or may provide distinct signals to all four 3D speakers.
- the term 3D speaker refers to a speaker that emits sounds in an upper portion of a vehicle, such as above a passenger's ear level and/or above the other main loudspeakers.
- the signal input section is coupled to the room simulation module. Further, the room simulation module is coupled to the signal output section. In addition, the signal output section may be coupled to the signal input section.
- the multi-channel audio signal may be provided directly from the signal input section to the signal output section.
- the signal input section may comprise a first stage of signal processing. However, it is also possible that the signal input section is only provided for passing an audio signal on from an audio source.
- speaker may refer to a single speaker, also referred to as loudspeaker.
- speaker may also refer to a set of speakers, covering different frequency ranges.
- the term speaker may refer to a set of two speaker of selected frequencies.
- the term speaker may refer to the combination of a low frequency speaker and a high frequency speaker. It is equally possible that the term speaker refers to a set of three speakers, outputting low, medium and high frequencies, respectively.
- a right 3D speaker it is possible that two or three speakers of different frequencies are provided in the right upper portion of the vehicle.
- These limited frequency speakers may be arranged in one housing or in separate housings in proximity of each other.
- the left room simulation function weighs the left front signal and the left surround signal differently and the right room simulation function weighs the right front signal and the right surround signal differently.
- the left room simulation function has different weighing coefficients for the inputs of the left front signal and the left surround signal.
- the right room simulation function has different weighing coefficients for the right front signal and the right surround signal.
- the room simulation functions may then perform the room simulation on this weighed combination of the respective front and surround signals. This weighing of the front and surround signals provides for a fairly simple, closed implementation of the room simulation functions, applicable to all kinds of audio content.
- the left room simulation function comprises a left room simulation component calculated as f 1 ( ⁇ 1 * L s + ⁇ 1 * L F ), with L s denoting the left surround signal and L F denoting the left front signal and with ⁇ 1 being greater than ⁇ 1
- the right room simulation function comprises a right room simulation component calculated as f 2 ( ⁇ 2 * Rs + ⁇ 2 * R F ), with Rs denoting the right surround signal and R F denoting the right front signal and with ⁇ 2 being greater than ⁇ 2 .
- the diffuse surround component is weighed stronger than the uncorrelated front signal. This leads to a very natural sound experience to the passenger, with the reverb portion of the multi-channel audio signal being the dominant portion in the processing and in the 3D speaker outputs. At the same time, a comparatively smaller 3D component is provided on the basis of the correlated front signal, leading to a voluminous sound experience also for highly correlated audio sources.
- f 1 and f 2 refer to functions that simulate an auditory space, thus contributing a room simulation that is an addition as compared to the multi-channel audio signal and that cannot be merely extracted from the multi-channel audio signal.
- f 1 and f 2 can be the same.
- the left room simulation component may be calculated in accordance with the same function as the right room simulation component.
- f 1 and f 2 are different functions.
- ⁇ 1 equals ⁇ 2 and/or that ⁇ 1 equals ⁇ 2
- ⁇ 1 is different from ⁇ 2 and/or that ⁇ 1 is different from ⁇ 2 .
- ⁇ 1 is much greater than ⁇ 1 , i.e. more than 10 times greater. It is also possible that ⁇ 2 is much greater than ⁇ 2 , i.e. at least 10 times greater.
- ⁇ 1 is much greater than ⁇ 1 , i.e. more than 10 times greater.
- ⁇ 2 is much greater than ⁇ 2 , i.e. at least 10 times greater.
- the left room simulation function may have the left room simulation component as the only signal component or may have other signal components, as discussed below.
- the right room simulation function may have the right room simulation component as the only signal component or may have other signal components.
- the left room simulation function comprises the left front signal and/or the left surround signal as an additive term, weighed by a respective coefficient
- the right room simulation function comprises the right front signal and/or the right surround signal as an additive term, weighed by a respective coefficient.
- additive term refers to a component that contributes to the room simulation functions purely by addition. In other words, it refers to a linear term. For this additive term, no function adding room simulation or any other simulation is applied to the front signal and/or surround signal. The inclusion of such an additive term results in a greater sound stability, increasing the ease of listening as compared to a pure room simulation component being output via the 3D speakers.
- the left room simulation function comprises a left sound stability component calculated as ( ⁇ 1 * L S + ⁇ 1 * L F ), with L s denoting the left surround signal and L F denoting the left front signal and with ⁇ 1 being greater than ⁇ 1
- the right room simulation function comprises a right sound stability component calculated as ( ⁇ 2 * R S + ⁇ 2 * R F ), with R S denoting the right surround signal and R F denoting the right front signal and with ⁇ 2 being greater than ⁇ 2 .
- ⁇ 1 is much greater than ⁇ 1 , i.e. at least 10 times greater.
- ⁇ 2 is much greater than ⁇ 2, i.e. at least 10 times greater.
- ⁇ 1 , ⁇ 2 , ⁇ 1 and ⁇ 2 are greater than ⁇ 1 , ⁇ 2 , ⁇ 1 and ⁇ 2 .
- ⁇ 1 , ⁇ 2 , ⁇ 1 and ⁇ 2 may be much greater than ⁇ 1 , ⁇ 2 , ⁇ 1 and ⁇ 2 , i.e. at least 10 times greater.
- f 1 and f 2 ensure that the room simulation components are greater than the sound stability components.
- the left room simulation function comprises a left room simulation component and a left sound stability component, with the left room simulation component being greater than the left sound stability component
- the right room simulation function comprises a right room simulation component and a right sound stability component, with the right room simulation component being greater than the right sound stability component.
- the comparison between the components may be carried out on the basis of the component amplitudes or component powers or any other suitable metric.
- the respective room simulation functions may consist of the respective room simulation component and the respective sound stability component.
- the respective room simulation and sound stability components may be the only components of the room simulation function in question.
- the left and right room simulation functions are configured to simulate an auditory space that is larger than an interior space of a vehicle.
- the vehicle sound system makes the passenger feel like he is listening to the audio content in a room that is larger than the actual interior of the vehicle.
- superior acoustics can be simulated than can be achieved within the interior of the vehicle with prior art sound systems.
- the left and right room simulation functions may be adapted to simulate the reverb generated in an enclosed space when an audio source is played.
- the left and right room simulation functions are configured to simulate an ideal auditory space.
- the left and right room simulation functions are configured to simulate an ideal auditory space of 4m x 6m x 2.5m.
- the left 3D signal is a left front 3D signal and the right 3D signal is a right front 3D signal. Accordingly, the left 3D signal and the right 3D signal may be provided to the signal output section for being output to a left front 3D speaker and to a right front 3D speaker. Accordingly, the left 3D speaker may be a left front 3D speaker and the right 3D speaker may be a right front 3D speaker.
- the room simulation module further comprises a left rear room simulation function generating a left rear 3D signal, with the left front signal and the left surround signal being inputs thereto, and a right rear room simulation function generating a right rear 3D signal, with the right front signal and the right surround signal being inputs thereto.
- a left rear room simulation function generating a left rear 3D signal
- a right rear room simulation function generating a right rear 3D signal, with the right front signal and the right surround signal being inputs thereto.
- front and rear signals are generated in the third dimension, leading to a surrounding of the passenger with speakers from all sides.
- an additional stereo surround sound is created in the upper portion of the vehicle, leading to an even more voluminous listening experience.
- the left rear 3D signal and the right rear 3D signal may be output to a left rear 3D speaker and a right rear 3D speaker.
- the output signal section may be configured for outputting the left rear 3D signal and the right read 3D signal to a left rear 3D speaker and a right rear
- the left 3D signal is a left rear 3D signal and the right 3D signal is a right rear 3D signal. Accordingly it is also possible that the room simulation is implemented via rear speakers in the upper portion of the vehicle, in particular only via rear speakers in the upper portion of the vehicle.
- the multi-channel audio signal is an input signal stemming from an audio source.
- the vehicle sound system may comprise a DVD drive or CD drive or a hard disk drive or any other suitable means for reading out a memory containing the audio source signal.
- the audio source signal is transferred to the vehicle in a wireless manner. Notwithstanding which source the audio input signal is coming from, the input signal may be a multi-channel signal that already contains the left front signal, the left surround signal, the right front signal, and the right surround signal.
- An example for such an input signal is a 5.1 surround sound signal.
- the input signal is a different kind of multi-channel audio signal having above discussed four signals.
- the input signal section comprises an audio signal conversion module, with the audio signal conversion module being adapted to generate the multi-channel audio signal from an input signal missing at least one of the left front signal, the left surround signal, the right front signal and the right surround signal, such as from a two-channel stereo input signal.
- the room simulation module can also be put to use for audio source signals that lack one of above discussed four signals.
- the audio signal conversion module may be adapted to extract a left surround signal and a right surround signal from a two-channel stereo input signal. Accordingly, above-discussed features of room simulation simulation can be achieved via subsequent operations of audio signal conversion and room simulation generation.
- the audio signal conversion module may be coupled to the room simulation module, either directly or via other signal processing modules, such as via a volume and/or fading and/or balance adaptation module.
- any kind of audio source can be pre-processed for the ensuing room simulation simulation by the room simulation module.
- the audio source may be any of a 1.0 mono source, a 2.0 stereo source, a 5.1 surround source, a 5.2 surround source, a 7.1 surround source or any other audio source.
- the audio signal conversion module may be implemented in any of the manners described in EP 1 722 598 A2 with respect to the audio device of said document. The contents of said document is incorporated herein in its entirety.
- Exemplary embodiments of the invention further include a vehicle sound system comprising a plurality of speakers, the plurality of speakers comprising a left 3D speaker and a right 3D speaker, the left 3D speaker and the right 3D speaker being configured to be disposed in an upper portion of a vehicle, the vehicle sound system further comprising a signal processing apparatus in accordance with any of the embodiments described above, with the signal processing apparatus being coupled to the left 3D speaker and the right 3D speaker for outputting the left 3D signal and the right 3D signal thereto.
- a vehicle sound system comprising a plurality of speakers, the plurality of speakers comprising a left 3D speaker and a right 3D speaker, the left 3D speaker and the right 3D speaker being configured to be disposed in an upper portion of a vehicle
- the vehicle sound system further comprising a signal processing apparatus in accordance with any of the embodiments described above, with the signal processing apparatus being coupled to the left 3D speaker and the right 3D speaker for outputting the left 3D signal and the right 3D signal thereto.
- the plurality of speakers of the vehicle sound system may comprise a left front speaker, a left surround speaker, a right front speaker, a right surround speaker. It may also include additional speaker, such as a center front speaker, a subwoofer, left and right rear speakers.
- the left and right 3D speakers may be left and right front 3D speakers or left and right rear 3D speakers. It is also possible that the vehicle sound system has left and right front 3D speakers as well as left and right rear 3D speakers.
- the signal processing apparatus may be coupled to all speakers present in the vehicle sound system.
- the vehicle sound system may also comprise an audio source reading apparatus, such as a CD player or DVD player or hard disk drive, and/or an audio signal reception apparatus, such as a radio receiver.
- Exemplary embodiments of the invention further include a passenger transport vehicle, such as a car, bus or truck, comprising a vehicle sound system, as described above, which includes a signal processing apparatus, as described in any of the embodiments above, with the vehicle sound system being installed in the passenger transport vehicle with the left 3D speaker and the right 3D speaker being disposed in an upper portion of the passenger transport vehicle.
- a passenger transport vehicle such as a car, bus or truck
- vehicle sound system as described above
- the vehicle sound system being installed in the passenger transport vehicle with the left 3D speaker and the right 3D speaker being disposed in an upper portion of the passenger transport vehicle.
- Exemplary embodiments of the invention further include a signal processing method for a vehicle sound system, the method comprising the steps of receiving a multi-channel audio signal comprising at least a left front signal, a left surround signal, a right front signal and a right surround signal, generating at least a left 3D signal and a right 3D signal for providing a room simulation by the vehicle sound system, with the left front signal and the left surround signal being inputs to a left room simulation function that generates the left 3D signal and with the right front signal and the right surround signal being inputs to a right room simulation function that generates the right 3D signal, and outputting the left 3D signal and the right 3D signal to a left 3D speaker and a right 3D speaker disposed in an upper portion of a vehicle.
- a signal processing method for a vehicle sound system comprising the steps of receiving a multi-channel audio signal comprising at least a left front signal, a left surround signal, a right front signal and a right surround signal, generating at least a left 3D signal
- Fig. 1 shows a perspective schematic diagram of a passenger transport vehicle 4, having a vehicle sound system 2 in accordance with an exemplary embodiment of the invention.
- the vehicle sound system 2 comprises twelve speakers.
- the vehicle sound system comprises a left front speaker 21, a left rear speaker 31, a left surround speaker 23, a right front speaker 22, a right rear speaker 32, a right surround speaker 24, a left front 3D speaker 25, a right front 3D speaker 26, a left rear 3D speaker 27, a right rear 3D speaker 28, a center front speaker 29, and a subwoofer 30. All of these speakers are coupled to a signal processing apparatus 6 by individual signal lines (shown in dashed lines in Fig. 1 ). It is also possible that all of the speakers 21-32 and the signal processing apparatus 6 are coupled via a bus architecture or any other means of signal communication.
- the vehicle sound system 2 may comprise an audio signal receiving apparatus, such as a tuner, for receiving wireless audio source signals, such as radio broadcast waves or any other kind of signal / data transmission. Additionally/alternatively, it is possible that the vehicle sound system 2 is coupled to an audio source reading apparatus, such as a CD player or a DVD player or a hard disk drive or any other kind of signal / data storage device.
- the audio signal receiving apparatus and/or the audio source reading apparatus may be coupled to the signal processing apparatus 6 for providing the audio source signal to the signal processing apparatus 6. No matter what the audio source is, the signal processing apparatus is adapted to receive the audio source signal and to generate respective output signals for the plurality of speakers.
- Fig. 2 shows a signal processing apparatus 6 in accordance with an exemplary embodiment of the invention.
- the signal processing apparatus 6 comprises a signal input section 62, a room simulation module 64, and a signal output section 66.
- the exemplary signal processing apparatus 6 is described with a stereo signal being the audio source, which consists of the left source signal L Source and the right source signal R Source , and with the output signal consisting of twelve signals for being output to the twelve speakers of the vehicle 4 described above.
- the signal input section 62 comprises an audio signal conversion module 70 and a audio signal conditioning module 72.
- the audio signal conversion module 70 performs an up-conversion of the two-channel stereo input signal.
- the audio signal conversion module 70 generates a left front signal L F , a right front signal R F , a left surround signal L S , a right surround signal Rs, a center front signal C and a subwoofer signal LFE (with LFE denoting "low frequency effects").
- LFE subwoofer signal
- the up-converted audio signal is then input into the audio signal conditioning module 72.
- the audio signal conditioning module 72 is configured to adapt the volume, fading, balance and subwoofer levels of the audio signals. Such signal conditioning is also per se known in the art. Depending on the complexity of the vehicle sound system, the audio signal conditioning module 72 may have different functionality and different degrees of signal conditioning. It is also possible that the audio signal conditioning module 72 is dispensed with and that only a simple volume scaling takes place.
- the only essential aspect with respect to the signal input section 62 is that a multi-channel signal is provided via the signal input section, which multi-channel audio signal contains a left front signal, a left surround signal, a right front signal and a right surround signal. If the audio source already provides such multi-channel audio signal, such as a 5.1 surround signal, the signal input section may consist of a mere passing on of the source signal.
- the room simulation module 64 is coupled to the signal input section 62 in such a way that the left front signal L F , the left surround signal Ls, the right front signal R F and the right surround signal R L are provided by the signal input section 62 to the room simulation module 64. Based on these four signals, the room simulation module 64 generates four 3D signals, which are configured to be output to four speakers disposed in the upper portion of the vehicle. In particular, the room simulation module 64 generates a left front 3D signal, a right front 3D signal, a left rear 3D signal and a right rear 3D signal. These four 3D signals are generated by the room simulation module 64 in the manner described below.
- ⁇ x , ⁇ x , ⁇ x and ⁇ x are weighing coefficients that allow for a relative scaling of the impact of the left front signal L F , the left surround signal L S , the right front signal R F and the right surround signal R S on the respective 3D signal.
- ⁇ x is much greater than ⁇ x , in particular at least 10 times greater, for x being 1, 2, 3 and 4.
- ⁇ x is much greater than ⁇ x , in particular at least 10 times greater, for x being 1, 2, 3 and 4.
- ⁇ x and ⁇ x are greater than ⁇ x and ⁇ x , in particular much greater, i.e. at least 10 times greater, for x being 1, 2, 3 and 4.
- the four room simulation functions given above each comprise a room simulation component and a sound stability component.
- the room simulation components are calculated via the functions f 1 , f 2 , f 3 and f 4 .
- These functions simulate an auditory space.
- the functions f 1 , f 2 , f 3 and f 4 are adapted - on the basis of the weighed inputs - to mimic the audio experience a listener would have in a space that is larger than the interior of the passenger transport vehicle.
- the functions f 1 , f 2 , f 3 and f 4 may be configured to generate the reverb that would be generated by the structure of an enclosed room.
- the functions f 1 , f 2 , f 3 and f 4 may simulate an ideal auditory space, such as an auditory space of 4m x 6m x 2.5m.
- the respective sound stability components consist of an addition of the respective left or right surround signal and of the respective left or right front signal, weighed by a respective weighing coefficient ⁇ x or ⁇ x . No further function apart from the weighing coefficients is applied to the inputs for the sound stability components.
- an appropriate room simulation is generated for all types of audio content.
- Audio content with a large surround sound component such as orchestra music
- leads to strong 3D signals i.e. to a strong room simulation.
- an appropriate amount of 3D simulation is presented to the listener.
- the room simulation functions generate a lower amount of room simulation. This lower amount of room simulation ensures that the news speaker is not perceived as talking in a large hall with a lot of echo effect on the one hand.
- the generation of a comparatively low level of room simulation still provides for a voluminous sound experience in the vehicle environment.
- the signal output section 66 is coupled to both the signal input section 62 and the room simulation module 64. It is configured to receive the left front signal, the left surround signal, the right front signal, the right surround signal, the center front signal and the subwoofer signal from the input section 62. Further, it is configured to receive above discussed four 3D signals, namely the left front 3D signal L F3D , the right front 3D signal R F3D , the left rear 3D signal L R3D , and right rear 3D signal R R3D from the room simulation module 64.
- the signal output section 66 is provided for outputting twelve signals to the respective speakers in the passenger transport vehicle.
- the signal output section 66 comprises a mixer module 74.
- This mixer module 74 allows for a combining or shuffling of the signals before being output to the speakers.
- the mixer module 74 passes some of the signals on and generates some signals by combination.
- the mixer module 74 passes on the left front signal L F , the right front signal R F , the center front signal C, the subwoofer signal LFE, the left front 3D signal L F3D , the right front 3D signal R F3D , the left rear 3D signal L R3D , and right rear 3D signal R R3D to the left front speaker 21, the right front speaker 22, the center front speaker 29, the subwoofer 30, the left front 3D speaker 25, the right front 3D speaker 26, the left rear 3D speaker 27, and the right rear 3D speaker 28, respectively.
- the mixer module 74 further generates an updated left surround signal Ls', an updated right surround signal Rs', a left rear signal L R , and a right rear signal R R .
- the updated left surround signal Ls', the updated right surround signal Rs', the left rear signal L R , and the right rear signal R R . are output to the left surround speaker 23, the right surround speaker 24, the left rear speaker 31, and the right rear speaker 31.
- ⁇ x is much greater than ⁇ x , in particular at least 10 times greater, for x being 5 and 6.
- the updated surround signals L S ' and R S ' are dominated by the surround signals Ls and Rs, but have a slight component of the respective front signal L F and R F for a more voluminous sound experience.
- ⁇ x and ⁇ x are comparable in magnitude, i.e. they are less than a factor 10 different, in particular less than a factor 5 different, even more in particular less than a factor 2 different, for x being 7 and 8.
- the sound from the left and right rear speakers 31 and 32 provides for a natural sound experience between the left and right front speakers 21 and 22 on the one side and the left and right surround speaker 23 and 24 on the other side.
- the combining or shuffling provided by the mixer module 74 may be desirable in some application scenarios.
- the mixer module 74 be dispensed with, and that the audio signals may be passed on to the speakers as they are.
- the left surround signal L s and the right surround signal R s may be passed on to the speakers as they are.
- the signal output section 66 is provided for passing on the audio signals to the speakers only.
- the signal input section, the room simulation module, and the signal output section may be implemented in any appropriate manner. They may be implemented in hardware, such as in digital signal processing components. They may also be implemented in software or in any appropriate combination of hardware and software.
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Stereophonic System (AREA)
Abstract
Description
- The present invention is in the field of sound systems for passenger transport vehicles, such as cars, buses and trucks. In particular, the present invention is in the field of a signal processing apparatus for a vehicle sound system and a signal processing method for a vehicle sound system.
- It has long been known in the art to equip passenger transport vehicles with sound systems. Such sound systems are in use for listening to music, news, audio books, audio documentaries and other audio content. As compared to home sound systems, the room acoustics inside a vehicle provide a perceived sound quality that is significantly more inferior to a perfect listening room. Accordingly, it would be beneficial to provide means for a vehicle sound system that increase the perceived sound quality / sound experience for the user and that, in particular, provides an improved sound quality for various different types of audio content.
- Exemplary embodiments of the invention include a signal processing apparatus for a vehicle sound system, comprising a signal input section, through which in operation a multi-channel audio signal is provided, the multi-channel audio signal comprising at least a left front signal, a left surround signal, a right front signal and a right surround signal, a room simulation module adapted to receive the multi-channel audio signal and to generate at least a left 3D signal and a right 3D signal, with the room simulation module comprising a left room simulation function generating the left 3D signal, with the left front signal and the left surround signal being inputs thereto, and a right room simulation function generating the right 3D signal, with the right front signal and the right surround signal being inputs thereto, and a signal output section for outputting the left 3D signal and the right 3D signal to a left 3D speaker and a right 3D speaker disposed in an upper portion of a vehicle.
- The signal processing apparatus performs an up-conversion of the multi-channel audio signal. It generates at least two 3D audio signals, namely at least the left 3D signal and the right 3D signal, in addition to the multi-channel audio signal. As the left 3D signal and the right 3D signal are provided in addition to the left front signal, the left surround signal, the right front signal and the right surround signal, and as these signals are output via speakers in an upper portion of the vehicle, the passenger's audio experience is more voluminous. The passenger has the impression that he/she is listening to the audio content in a larger space. The left 3D signal and the right 3D signal may also be referred to as a left 3D height signal and a right 3D height signal, because these signals create the perceived height of the listening room, when output via the speakers in the upper portion of the vehicle.
- The left front signal and the left surround signal are separate inputs to the left room simulation function. Analogously, the right front signal and the right surround signal are separate inputs to the right room simulation function. With these signals being separate inputs, the room simulation functions are able to provide 3D sound that is adapted to the kind of audio content present. For example, with orchestra music having a large diffuse surround component, also referred to as uncorrelated sound component or reverb, the room simulation functions may provide strong 3D signals. In contrast thereto, in the example of the audio content being a news reader, which audio content typically has low or no reverb, the room simulation functions may provide weaker 3D signals. In this way, the signal processing apparatus allows for adding a high degree of 3D sound when appropriate in light of the type of audio content, while preventing an artificially sounding, excessive expansion of audio content when a large 3D sound component is not appropriate. At the same time, the signal processing apparatus allows for adding some 3D sound for all types of audio content, leading to an improved listening experience for all types of audio content. In other words, the signal processing apparatus may always add some 3D sound component, but only add a large amount of 3D sound component when appropriate in light of the type of audio content. This can all be done in a fairly simple way through a single set of room simulation functions. No explicit distinction between different kinds of audio content and no application of different room simulation functions for different kinds of audio content is necessary.
- The room simulation functions simulate an auditory space. In other words, they add a simulated room effect to the multi-channel audio signal. They provide a simulated room transfer function to the multi-channel audio signal. While the room simulation functions rely on multiple inputs for adding the appropriate amount of room simulation, the overall perceived room is more than an extraction of particular signal components, such as reverb, from the source signal. The room simulation functions add a synthetic room which may depend in size and character on the room signal extracted from the original signal by the surround upmix at the input.
- The left 3D speaker and the right 3D speaker are positioned in an upper portion of an interior space of a vehicle. They may be positioned towards the front of the interior space or towards the rear of the interior space. It is also possible that there are more than two 3D speakers, such as four 3D speakers. In that case, the signal processing apparatus may provide the same 3D signal to two 3D speakers, respectively, or may provide distinct signals to all four 3D speakers. The term 3D speaker refers to a speaker that emits sounds in an upper portion of a vehicle, such as above a passenger's ear level and/or above the other main loudspeakers.
- The signal input section is coupled to the room simulation module. Further, the room simulation module is coupled to the signal output section. In addition, the signal output section may be coupled to the signal input section. In particular, the multi-channel audio signal may be provided directly from the signal input section to the signal output section. The signal input section may comprise a first stage of signal processing. However, it is also possible that the signal input section is only provided for passing an audio signal on from an audio source.
- The term speaker, as used throughout this disclosure, may refer to a single speaker, also referred to as loudspeaker. However, the term speaker may also refer to a set of speakers, covering different frequency ranges. For example, the term speaker may refer to a set of two speaker of selected frequencies. In particular, the term speaker may refer to the combination of a low frequency speaker and a high frequency speaker. It is equally possible that the term speaker refers to a set of three speakers, outputting low, medium and high frequencies, respectively. In the example of a right 3D speaker, it is possible that two or three speakers of different frequencies are provided in the right upper portion of the vehicle. These limited frequency speakers may be arranged in one housing or in separate housings in proximity of each other.
- According to a further embodiment, the left room simulation function weighs the left front signal and the left surround signal differently and the right room simulation function weighs the right front signal and the right surround signal differently. In other words, the left room simulation function has different weighing coefficients for the inputs of the left front signal and the left surround signal. Analogously, the right room simulation function has different weighing coefficients for the right front signal and the right surround signal. The room simulation functions may then perform the room simulation on this weighed combination of the respective front and surround signals. This weighing of the front and surround signals provides for a fairly simple, closed implementation of the room simulation functions, applicable to all kinds of audio content.
- According to a further embodiment, the left room simulation function comprises a left room simulation component calculated as f1(α1 * Ls + β1 * LF), with Ls denoting the left surround signal and LF denoting the left front signal and with α1 being greater than β1, and wherein the right room simulation function comprises a right room simulation component calculated as f2(α2 * Rs + β2 * RF), with Rs denoting the right surround signal and RF denoting the right front signal and with α2 being greater than β2. The given formulas with the given relationship between the weighing coefficients α and β allow for an optimized addition of room simulation, depending on the type of audio content, implemented as a single set of room simulation functions. The diffuse surround component is weighed stronger than the uncorrelated front signal. This leads to a very natural sound experience to the passenger, with the reverb portion of the multi-channel audio signal being the dominant portion in the processing and in the 3D speaker outputs. At the same time, a comparatively smaller 3D component is provided on the basis of the correlated front signal, leading to a voluminous sound experience also for highly correlated audio sources.
- The expressions "f1" and "f2" refer to functions that simulate an auditory space, thus contributing a room simulation that is an addition as compared to the multi-channel audio signal and that cannot be merely extracted from the multi-channel audio signal. In a particular embodiment, f1 and f2 can be the same. In other words the left room simulation component may be calculated in accordance with the same function as the right room simulation component. However, it is also possible that f1 and f2 are different functions. Also, while it is possible that α1 equals α2 and/or that β1 equals β2, it is also possible that α1 is different from α2 and/or that β1 is different from β2. In a particular embodiment, α1 is much greater than β1, i.e. more than 10 times greater. It is also possible that α2 is much greater than β2, i.e. at least 10 times greater. Such a relationship between the weighing coefficients allows for a particularly good compromise between some added room simulation for all types of audio content and a strong addition of room simulation when appropriate in light of the type of audio content in question.
- The left room simulation function may have the left room simulation component as the only signal component or may have other signal components, as discussed below. Analogously, the right room simulation function may have the right room simulation component as the only signal component or may have other signal components.
- According to a further embodiment, the left room simulation function comprises the left front signal and/or the left surround signal as an additive term, weighed by a respective coefficient, and the right room simulation function comprises the right front signal and/or the right surround signal as an additive term, weighed by a respective coefficient. The expression "additive term" refers to a component that contributes to the room simulation functions purely by addition. In other words, it refers to a linear term. For this additive term, no function adding room simulation or any other simulation is applied to the front signal and/or surround signal. The inclusion of such an additive term results in a greater sound stability, increasing the ease of listening as compared to a pure room simulation component being output via the 3D speakers.
- According to a further embodiment, the left room simulation function comprises a left sound stability component calculated as (γ1 * LS + δ1 * LF), with Ls denoting the left surround signal and LF denoting the left front signal and with γ1 being greater than δ1, and the right room simulation function comprises a right sound stability component calculated as (γ2 * RS + δ2 * RF), with RS denoting the right surround signal and RF denoting the right front signal and with γ2 being greater than δ2. In this way, both the respective front signal as well as the respective surround signal are included into the room simulation functions in a linear manner. Accordingly, above described addition of stability may be implemented in a straightforward manner on the basis of the same front signal and surround signal inputs, without a distinction with respect to the type of audio content being necessary. With the surround signal being weighed stronger than the front signal, a hollow overall sound due to the front signal being output from the upper portion of the vehicle in a dominant manner is prevented. In a particular embodiment γ1 is much greater than δ1, i.e. at least 10 times greater. It is also possible that γ2 is much greater than δ2, i.e. at least 10 times greater. Again, it is possible that γ1 and γ2 are the same or different and that δ1 and δ2 are the same or different.
- According to a further embodiment, α1, α2, β1 and β2 are greater than γ1, γ2, δ1 and δ2. In this way, it may be ensured that the respective room simulation components are greater than the respective sound stability components. In particular, α1, α2, β1 and β2 may be much greater than γ1, γ2, δ1 and δ2, i.e. at least 10 times greater. However, it is also possible that the particular implementations of f1 and f2 ensure that the room simulation components are greater than the sound stability components.
- According to a further embodiment, the left room simulation function comprises a left room simulation component and a left sound stability component, with the left room simulation component being greater than the left sound stability component, and wherein the right room simulation function comprises a right room simulation component and a right sound stability component, with the right room simulation component being greater than the right sound stability component. In this way, a comparatively larger room simulation component is combined with a comparatively smaller sound stability component, thus allowing for a dominant 3D room simulation, while at the same time ensuring a relaxing listening experience to the passenger. In a particular embodiment, the respective room simulation components may be much greater than the respective sound stability components, i.e. at least 10 times greater. The comparison between the components may be carried out on the basis of the component amplitudes or component powers or any other suitable metric. In a particular embodiment, the respective room simulation functions may consist of the respective room simulation component and the respective sound stability component. In other words, the respective room simulation and sound stability components may be the only components of the room simulation function in question.
- According to a further embodiment, the left and right room simulation functions are configured to simulate an auditory space that is larger than an interior space of a vehicle. In this way, the vehicle sound system makes the passenger feel like he is listening to the audio content in a room that is larger than the actual interior of the vehicle. In this way, superior acoustics can be simulated than can be achieved within the interior of the vehicle with prior art sound systems. In particular, the left and right room simulation functions may be adapted to simulate the reverb generated in an enclosed space when an audio source is played. In a particular embodiment, the left and right room simulation functions are configured to simulate an ideal auditory space. In a further particular embodiment, the left and right room simulation functions are configured to simulate an ideal auditory space of 4m x 6m x 2.5m.
- According to a further embodiment, the left 3D signal is a left front 3D signal and the right 3D signal is a right front 3D signal. Accordingly, the left 3D signal and the right 3D signal may be provided to the signal output section for being output to a left front 3D speaker and to a right front 3D speaker. Accordingly, the left 3D speaker may be a left front 3D speaker and the right 3D speaker may be a right front 3D speaker.
- According to a further embodiment, the room simulation module further comprises a left rear room simulation function generating a left rear 3D signal, with the left front signal and the left surround signal being inputs thereto, and a right rear room simulation function generating a right rear 3D signal, with the right front signal and the right surround signal being inputs thereto. In this way, front and rear signals are generated in the third dimension, leading to a surrounding of the passenger with speakers from all sides. In other words, an additional stereo surround sound is created in the upper portion of the vehicle, leading to an even more voluminous listening experience. The left rear 3D signal and the right rear 3D signal may be output to a left rear 3D speaker and a right rear 3D speaker. Accordingly, the output signal section may be configured for outputting the left rear 3D signal and the right read 3D signal to a left rear 3D speaker and a right rear 3D speaker.
- Above discussed features and modifications of the left room simulation function and the right room simulation function can be implemented with respect to the the left rear room simulation function and the right rear room simulation function in an analogous manner. According to a further embodiment, the left 3D signal is a left rear 3D signal and the right 3D signal is a right rear 3D signal. Accordingly it is also possible that the room simulation is implemented via rear speakers in the upper portion of the vehicle, in particular only via rear speakers in the upper portion of the vehicle.
- According to a further embodiment, the multi-channel audio signal is an input signal stemming from an audio source. For example, the vehicle sound system may comprise a DVD drive or CD drive or a hard disk drive or any other suitable means for reading out a memory containing the audio source signal. It is also possible that the audio source signal is transferred to the vehicle in a wireless manner. Notwithstanding which source the audio input signal is coming from, the input signal may be a multi-channel signal that already contains the left front signal, the left surround signal, the right front signal, and the right surround signal. An example for such an input signal is a 5.1 surround sound signal. It is also possible that the input signal is a different kind of multi-channel audio signal having above discussed four signals.
- According to an alternative embodiment, the input signal section comprises an audio signal conversion module, with the audio signal conversion module being adapted to generate the multi-channel audio signal from an input signal missing at least one of the left front signal, the left surround signal, the right front signal and the right surround signal, such as from a two-channel stereo input signal. In this way, the room simulation module can also be put to use for audio source signals that lack one of above discussed four signals. In particular, the audio signal conversion module may be adapted to extract a left surround signal and a right surround signal from a two-channel stereo input signal. Accordingly, above-discussed features of room simulation simulation can be achieved via subsequent operations of audio signal conversion and room simulation generation. For this purpose, the audio signal conversion module may be coupled to the room simulation module, either directly or via other signal processing modules, such as via a volume and/or fading and/or balance adaptation module. With an appropriate audio signal conversion module, any kind of audio source can be pre-processed for the ensuing room simulation simulation by the room simulation module. For example, the audio source may be any of a 1.0 mono source, a 2.0 stereo source, a 5.1 surround source, a 5.2 surround source, a 7.1 surround source or any other audio source. In an exemplary embodiment, the audio signal conversion module may be implemented in any of the manners described in
EP 1 722 598 A2 with respect to the audio device of said document. The contents of said document is incorporated herein in its entirety. - Exemplary embodiments of the invention further include a vehicle sound system comprising a plurality of speakers, the plurality of speakers comprising a left 3D speaker and a right 3D speaker, the left 3D speaker and the right 3D speaker being configured to be disposed in an upper portion of a vehicle, the vehicle sound system further comprising a signal processing apparatus in accordance with any of the embodiments described above, with the signal processing apparatus being coupled to the left 3D speaker and the right 3D speaker for outputting the left 3D signal and the right 3D signal thereto. The additional features and modifications described above with respect to the signal processing apparatus may equally be applied to the vehicle sound system. Above discussed advantages are also attainable with the vehicle sound system.
- The plurality of speakers of the vehicle sound system may comprise a left front speaker, a left surround speaker, a right front speaker, a right surround speaker. It may also include additional speaker, such as a center front speaker, a subwoofer, left and right rear speakers. The left and right 3D speakers may be left and right front 3D speakers or left and right rear 3D speakers. It is also possible that the vehicle sound system has left and right front 3D speakers as well as left and right rear 3D speakers. The signal processing apparatus may be coupled to all speakers present in the vehicle sound system. The vehicle sound system may also comprise an audio source reading apparatus, such as a CD player or DVD player or hard disk drive, and/or an audio signal reception apparatus, such as a radio receiver.
- Exemplary embodiments of the invention further include a passenger transport vehicle, such as a car, bus or truck, comprising a vehicle sound system, as described above, which includes a signal processing apparatus, as described in any of the embodiments above, with the vehicle sound system being installed in the passenger transport vehicle with the left 3D speaker and the right 3D speaker being disposed in an upper portion of the passenger transport vehicle. The additional features and modifications described above with respect to the signal processing apparatus and with respect to the vehicle sound system may equally be applied to the passenger transport vehicle. Above discussed advantages are also attainable with the passenger transport vehicle.
- Exemplary embodiments of the invention further include a signal processing method for a vehicle sound system, the method comprising the steps of receiving a multi-channel audio signal comprising at least a left front signal, a left surround signal, a right front signal and a right surround signal, generating at least a left 3D signal and a right 3D signal for providing a room simulation by the vehicle sound system, with the left front signal and the left surround signal being inputs to a left room simulation function that generates the left 3D signal and with the right front signal and the right surround signal being inputs to a right room simulation function that generates the right 3D signal, and outputting the left 3D signal and the right 3D signal to a left 3D speaker and a right 3D speaker disposed in an upper portion of a vehicle. The additional features and modifications described above with respect to the signal processing apparatus may equally be applied to the signal processing methods. According modifications of the signal processing methods are herewith disclosed. Above discussed advantages are also attainable with the signal processing method.
- Embodiments of the invention are described in greater detail below with reference to the figures, wherein:
-
Fig. 1 shows a perspective schematic view of an exemplary vehicle having an exemplary vehicle sound system in accordance with the invention installed therein. -
Fig. 2 shows a block diagram of an exemplary signal processing apparatus in accordance with the invention. -
Fig. 1 shows a perspective schematic diagram of apassenger transport vehicle 4, having a vehicle sound system 2 in accordance with an exemplary embodiment of the invention. The vehicle sound system 2 comprises twelve speakers. In particular, the vehicle sound system comprises a left front speaker 21, a leftrear speaker 31, aleft surround speaker 23, a rightfront speaker 22, a rightrear speaker 32, aright surround speaker 24, a leftfront 3D speaker 25, a rightfront 3D speaker 26, a leftrear 3D speaker 27, a rightrear 3D speaker 28, acenter front speaker 29, and asubwoofer 30. All of these speakers are coupled to asignal processing apparatus 6 by individual signal lines (shown in dashed lines inFig. 1 ). It is also possible that all of the speakers 21-32 and thesignal processing apparatus 6 are coupled via a bus architecture or any other means of signal communication. - The vehicle sound system 2 may comprise an audio signal receiving apparatus, such as a tuner, for receiving wireless audio source signals, such as radio broadcast waves or any other kind of signal / data transmission. Additionally/alternatively, it is possible that the vehicle sound system 2 is coupled to an audio source reading apparatus, such as a CD player or a DVD player or a hard disk drive or any other kind of signal / data storage device. The audio signal receiving apparatus and/or the audio source reading apparatus may be coupled to the
signal processing apparatus 6 for providing the audio source signal to thesignal processing apparatus 6. No matter what the audio source is, the signal processing apparatus is adapted to receive the audio source signal and to generate respective output signals for the plurality of speakers. -
Fig. 2 shows asignal processing apparatus 6 in accordance with an exemplary embodiment of the invention. Thesignal processing apparatus 6 comprises asignal input section 62, aroom simulation module 64, and asignal output section 66. The exemplarysignal processing apparatus 6 is described with a stereo signal being the audio source, which consists of the left source signal LSource and the right source signal RSource, and with the output signal consisting of twelve signals for being output to the twelve speakers of thevehicle 4 described above. - The
signal input section 62 comprises an audiosignal conversion module 70 and a audiosignal conditioning module 72. The audiosignal conversion module 70 performs an up-conversion of the two-channel stereo input signal. In particular, the audiosignal conversion module 70 generates a left front signal LF, a right front signal RF, a left surround signal LS, a right surround signal Rs, a center front signal C and a subwoofer signal LFE (with LFE denoting "low frequency effects"). Such up-conversion of a two-channel stereo signal into a 5.1 surround signal via the audiosignal conversion module 70 is per se known in the art. - The up-converted audio signal is then input into the audio
signal conditioning module 72. The audiosignal conditioning module 72 is configured to adapt the volume, fading, balance and subwoofer levels of the audio signals. Such signal conditioning is also per se known in the art. Depending on the complexity of the vehicle sound system, the audiosignal conditioning module 72 may have different functionality and different degrees of signal conditioning. It is also possible that the audiosignal conditioning module 72 is dispensed with and that only a simple volume scaling takes place. The only essential aspect with respect to thesignal input section 62 is that a multi-channel signal is provided via the signal input section, which multi-channel audio signal contains a left front signal, a left surround signal, a right front signal and a right surround signal. If the audio source already provides such multi-channel audio signal, such as a 5.1 surround signal, the signal input section may consist of a mere passing on of the source signal. - The
room simulation module 64 is coupled to thesignal input section 62 in such a way that the left front signal LF, the left surround signal Ls, the right front signal RF and the right surround signal RL are provided by thesignal input section 62 to theroom simulation module 64. Based on these four signals, theroom simulation module 64 generates four 3D signals, which are configured to be output to four speakers disposed in the upper portion of the vehicle. In particular, theroom simulation module 64 generates a left front 3D signal, a right front 3D signal, a left rear 3D signal and a right rear 3D signal. These four 3D signals are generated by theroom simulation module 64 in the manner described below. -
-
-
-
- The parameters αx, βx, γx and δx are weighing coefficients that allow for a relative scaling of the impact of the left front signal LF, the left surround signal LS, the right front signal RF and the right surround signal RS on the respective 3D signal. In the exemplary embodiment described, αx is much greater than βx, in particular at least 10 times greater, for x being 1, 2, 3 and 4. Also, in the exemplary embodiment described, γx is much greater than δx, in particular at least 10 times greater, for x being 1, 2, 3 and 4. In the exemplary embodiment of
Fig. 2 , αx and βx are greater than γx and δx, in particular much greater, i.e. at least 10 times greater, for x being 1, 2, 3 and 4. - The four room simulation functions given above each comprise a room simulation component and a sound stability component. The room simulation components are calculated via the functions f1, f2, f3 and f4. These functions simulate an auditory space. In particular, the functions f1, f2, f3 and f4 are adapted - on the basis of the weighed inputs - to mimic the audio experience a listener would have in a space that is larger than the interior of the passenger transport vehicle. In particular, the functions f1, f2, f3 and f4 may be configured to generate the reverb that would be generated by the structure of an enclosed room. In particular, the functions f1, f2, f3 and f4 may simulate an ideal auditory space, such as an auditory space of 4m x 6m x 2.5m.
- The respective sound stability components consist of an addition of the respective left or right surround signal and of the respective left or right front signal, weighed by a respective weighing coefficient γx or δx. No further function apart from the weighing coefficients is applied to the inputs for the sound stability components.
- In this way, multiple effects are achieved, as already discussed in detail above. As the room simulation is dependent on both the respective surround signal and the respective front signal and as these two inputs are weighed differently, an appropriate room simulation is generated for all types of audio content. Audio content with a large surround sound component, such as orchestra music, leads to strong 3D signals, i.e. to a strong room simulation. In this way, an appropriate amount of 3D simulation is presented to the listener. In contrast thereto, for audio content not having a large surround component, such as news speakers or similar content, the room simulation functions generate a lower amount of room simulation. This lower amount of room simulation ensures that the news speaker is not perceived as talking in a large hall with a lot of echo effect on the one hand. On the other hand, the generation of a comparatively low level of room simulation still provides for a voluminous sound experience in the vehicle environment.
- The
signal output section 66 is coupled to both thesignal input section 62 and theroom simulation module 64. It is configured to receive the left front signal, the left surround signal, the right front signal, the right surround signal, the center front signal and the subwoofer signal from theinput section 62. Further, it is configured to receive above discussed four 3D signals, namely the left front 3D signal LF3D, the right front 3D signal RF3D, the left rear 3D signal LR3D, and right rear 3D signal RR3D from theroom simulation module 64. Thesignal output section 66 is provided for outputting twelve signals to the respective speakers in the passenger transport vehicle. - In the exemplary embodiment of
Fig. 2 , thesignal output section 66 comprises amixer module 74. Thismixer module 74 allows for a combining or shuffling of the signals before being output to the speakers. In the exemplary embodiment ofFig. 2 , themixer module 74 passes some of the signals on and generates some signals by combination. In particular, themixer module 74 passes on the left front signal LF, the right front signal RF, the center front signal C, the subwoofer signal LFE, the left front 3D signal LF3D, the right front 3D signal RF3D, the left rear 3D signal LR3D, and right rear 3D signal RR3D to the left front speaker 21, the rightfront speaker 22, thecenter front speaker 29, thesubwoofer 30, the leftfront 3D speaker 25, the rightfront 3D speaker 26, the leftrear 3D speaker 27, and the rightrear 3D speaker 28, respectively. Themixer module 74 further generates an updated left surround signal Ls', an updated right surround signal Rs', a left rear signal LR, and a right rear signal RR. The updated left surround signal Ls', the updated right surround signal Rs', the left rear signal LR, and the right rear signal RR. are output to theleft surround speaker 23, theright surround speaker 24, the leftrear speaker 31, and the rightrear speaker 31. These signals are generated in accordance with the following formulas: - In the exemplary embodiment of
Fig. 2 , αx is much greater than βx, in particular at least 10 times greater, for x being 5 and 6. In this way, the updated surround signals LS' and RS' are dominated by the surround signals Ls and Rs, but have a slight component of the respective front signal LF and RF for a more voluminous sound experience. In the exemplary embodiment ofFig. 2 , αx and βx are comparable in magnitude, i.e. they are less than a factor 10 different, in particular less than a factor 5 different, even more in particular less than a factor 2 different, for x being 7 and 8. In this way, the sound from the left and right 31 and 32 provides for a natural sound experience between the left and rightrear speakers front speakers 21 and 22 on the one side and the left and 23 and 24 on the other side.right surround speaker - It is pointed out that the combining or shuffling provided by the
mixer module 74 may be desirable in some application scenarios. However, it is also possible that themixer module 74 be dispensed with, and that the audio signals may be passed on to the speakers as they are. In this case, it is for example possible to pass on the left surround signal Ls and the right surround signal Rs to the left and 23 and 24, as they are. It is further for example possible to provide theright surround speakers 31 and 32 with the respective surround signals LS and RS or with the respective front signals LF and RF. In general, it is possible that therear speakers signal output section 66 is provided for passing on the audio signals to the speakers only. - The signal input section, the room simulation module, and the signal output section may be implemented in any appropriate manner. They may be implemented in hardware, such as in digital signal processing components. They may also be implemented in software or in any appropriate combination of hardware and software.
Claims (15)
- Signal processing apparatus (6) for a vehicle sound system (2), comprising:a signal input section (62), through which in operation a multi-channel audio signal is provided, the multi-channel audio signal comprising at least a left front signal (LF), a left surround signal (LS), a right front signal (RF) and a right surround signal (RS),a room simulation module (64) adapted to receive the multi-channel audio signal and to generate at least a left 3D signal (LF3D) and a right 3D signal (RF3D), with the room simulation module (64) comprising a left room simulation function generating the left 3D signal (LF3D), with the left front signal (LF) and the left surround signal (Ls) being inputs thereto, and a right room simulation function generating the right 3D signal (RF30), with the right front signal (RF) and the right surround signal (Rs) being inputs thereto, anda signal output section (66) for outputting the left 3D signal (LF3D) and the right 3D signal (RF3D) to a left 3D speaker (25) and a right 3D speaker (26) disposed in an upper portion of a vehicle.
- Signal processing apparatus (6) according to claim 1, wherein the left room simulation function weighs the left front signal (LF) and the left surround signal (Ls) differently and wherein the right room simulation function weighs the right front signal (RF) and the right surround signal (Rs) differently.
- Signal processing apparatus (6) according to claim 1 or 2, wherein the left room simulation function comprises a left room simulation component calculated as f1(α1 * LS + β1 * LF), with Ls denoting the left surround signal and LF denoting the left front signal and with α1 being greater than β1, and wherein the right room simulation function comprises a right room simulation component calculated as f2(α2 * Rs + β2 * RF), with Rs denoting the right surround signal and RF denoting the right front signal and with α2 being greater than β2.
- Signal processing apparatus (6) according to any of the preceding claims, wherein the left room simulation function comprises the left front signal (LF) and/or the left surround signal (LS) as an additive term, weighed by a respective coefficient, and wherein the right room simulation function comprises the right front signal (RF) and/or the right surround signal (RS) as an additive term, weighed by a respective coefficient.
- Signal processing apparatus (6) according to any of the preceding claims, wherein the left room simulation function comprises a left sound stability component calculated as (γ1 * LS + δ1 * LF), with Ls denoting the left surround signal and LF denoting the left front signal and with γ1 being greater than δ1, and wherein the right room simulation function comprises a right sound stability component calculated as (γ2 * Rs + δ2 * RF), with RS denoting the right surround signal and RF denoting the right front signal and with γ2 being greater than δ2.
- Signal processing apparatus (6) according to any of the preceding claims, wherein the left room simulation function comprises a left room simulation component and a left sound stability component, with the left room simulation component being greater than the left sound stability component, and wherein the right room simulation function comprises a right room simulation component and a right sound stability component, with the right room simulation component being greater than the right sound stability component.
- Signal processing apparatus (6) according to any of the preceding claims, wherein the left and right room simulation functions are configured to simulate an auditory space that is larger than an interior space of a vehicle.
- Signal processing apparatus (6) according to any of the preceding claims, wherein the left room simulation function is a left front room simulation function, wherein the right room simulation function is a right front room simulation function, wherein the left 3D signal (LF3D) is a left front 3D signal and wherein the right 3D signal (RF3D) is a right front 3D signal.
- Signal processing apparatus (6) according to claim 8, wherein the room simulation module (64) further comprises a left rear room simulation function generating a left rear 3D signal (LR3D), with the left front signal (LF) and the left surround signal (LS) being inputs thereto, and a right rear room simulation function generating a right rear 3D signal (RR3D), with the right front signal (RF) and the right surround signal (Rs) being inputs thereto.
- Signal processing apparatus (6) according to any of claims 1 to 7, wherein the left 3D signal is a left rear 3D signal and wherein the right 3D signal is a right rear 3D signal.
- Signal processing apparatus (6) according to any of the preceding claims, wherein the multi-channel audio signal is an input signal stemming from an audio source.
- Signal processing apparatus (6) according to any of claims 1 to 10, wherein the input signal section (62) comprises an audio signal conversion module (70), with the audio signal conversion module (70) being adapted to generate the multi-channel audio signal from an input signal missing at least one of the left front signal, the left surround signal, the right front signal and the right surround signal, such as from a two-channel stereo input signal.
- Vehicle sound system (2) comprising a plurality of speakers, the plurality of speakers comprising a left 3D speaker (25) and a right 3D speaker (26), the left 3D speaker (25) and the right 3D speaker (26) being configured to be disposed in an upper portion of a vehicle (4),
the vehicle sound system (2) further comprising a signal processing apparatus (6) according to any of the preceding claims, with the signal processing apparatus (6) being coupled to the left 3D speaker (25) and the right 3D speaker (26) for outputting the left 3D signal (LF3D) and the right 3D signal thereto (RF3D). - Passenger transport vehicle (4), such as a car, bus or truck, comprising a vehicle sound system (2) according to claim 13, the vehicle sound system (2) being installed in the passenger transport vehicle with the left 3D speaker (25) and the right 3D speaker (26) being disposed in an upper portion of the passenger transport vehicle (4).
- Signal processing method for a vehicle sound system, the method comprising the steps of:receiving a multi-channel audio signal comprising at least a left front signal (LF), a left surround signal (LS), a right front signal (RF) and a right surround signal (Rs),generating at least a left 3D signal (LF3D) and a right 3D signal (RF3D) for providing a room simulation by the vehicle sound system, with the left front signal (LF) and the left surround signal (Ls) being inputs to a left room simulation function that generates the left 3D signal (LF3D) and with the right front signal (RF) and the right surround signal (Rs) being inputs to a right room simulation function that generates the right 3D signal (RF3D), andoutputting the left 3D signal (LF3D) and the right 3D signal (RF3D) to a left 3D speaker (25) and a right 3D speaker (26) disposed in an upper portion of a vehicle.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| EP14177369.7A EP2975864B1 (en) | 2014-07-17 | 2014-07-17 | Signal processing apparatus for a vehicle sound system and signal processing method for a vehicle sound system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| EP14177369.7A EP2975864B1 (en) | 2014-07-17 | 2014-07-17 | Signal processing apparatus for a vehicle sound system and signal processing method for a vehicle sound system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| EP2975864A1 true EP2975864A1 (en) | 2016-01-20 |
| EP2975864B1 EP2975864B1 (en) | 2020-05-13 |
Family
ID=51205284
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| EP14177369.7A Active EP2975864B1 (en) | 2014-07-17 | 2014-07-17 | Signal processing apparatus for a vehicle sound system and signal processing method for a vehicle sound system |
Country Status (1)
| Country | Link |
|---|---|
| EP (1) | EP2975864B1 (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114697855A (en) * | 2022-03-18 | 2022-07-01 | 蔚来汽车科技(安徽)有限公司 | Multichannel vehicle-mounted sound system |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1722598A2 (en) | 2005-05-13 | 2006-11-15 | Alpine Electronics, Inc. | Audio device and method for generating surround sound |
| WO2008108968A1 (en) * | 2007-03-01 | 2008-09-12 | Apple Inc. | Methods, modules, and computer-readable recording media for providing a multi-channel convolution reverb |
| EP2190221A1 (en) * | 2008-11-20 | 2010-05-26 | Harman Becker Automotive Systems GmbH | Audio system |
| EP2629552A1 (en) * | 2012-02-15 | 2013-08-21 | Harman International Industries, Incorporated | Audio surround processing system |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060222187A1 (en) * | 2005-04-01 | 2006-10-05 | Scott Jarrett | Microphone and sound image processing system |
| TWI559786B (en) * | 2008-09-03 | 2016-11-21 | 杜比實驗室特許公司 | Enhancing the reproduction of multiple audio channels |
| KR20120004909A (en) * | 2010-07-07 | 2012-01-13 | 삼성전자주식회사 | Stereo playback method and apparatus |
| BR112015013154B1 (en) * | 2012-12-04 | 2022-04-26 | Samsung Electronics Co., Ltd | Audio delivery device, and audio delivery method |
-
2014
- 2014-07-17 EP EP14177369.7A patent/EP2975864B1/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1722598A2 (en) | 2005-05-13 | 2006-11-15 | Alpine Electronics, Inc. | Audio device and method for generating surround sound |
| WO2008108968A1 (en) * | 2007-03-01 | 2008-09-12 | Apple Inc. | Methods, modules, and computer-readable recording media for providing a multi-channel convolution reverb |
| EP2190221A1 (en) * | 2008-11-20 | 2010-05-26 | Harman Becker Automotive Systems GmbH | Audio system |
| EP2629552A1 (en) * | 2012-02-15 | 2013-08-21 | Harman International Industries, Incorporated | Audio surround processing system |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114697855A (en) * | 2022-03-18 | 2022-07-01 | 蔚来汽车科技(安徽)有限公司 | Multichannel vehicle-mounted sound system |
| CN114697855B (en) * | 2022-03-18 | 2025-05-27 | 蔚来汽车科技(安徽)有限公司 | Multi-channel car audio system |
Also Published As
| Publication number | Publication date |
|---|---|
| EP2975864B1 (en) | 2020-05-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| ES2895436T3 (en) | Apparatus and method for generating an audio output signal having at least two output channels | |
| US8577065B2 (en) | Systems and methods for creating immersion surround sound and virtual speakers effects | |
| TW201119420A (en) | Virtual audio processing for loudspeaker or headphone playback | |
| CN108737930B (en) | Audible prompts in a vehicle navigation system | |
| EP2229012B1 (en) | Device, method, program, and system for canceling crosstalk when reproducing sound through plurality of speakers arranged around listener | |
| US20150215721A1 (en) | Audio signal playback device, method, and recording medium | |
| US10257634B2 (en) | Apparatus and method for processing stereo signals for reproduction in cars to achieve individual three-dimensional sound by frontal loudspeakers | |
| JP2013201559A (en) | Sound signal processing device | |
| HK1247494A1 (en) | Apparatus and method for processing stereo signals for reproduction in cars to achieve individual three-dimensional sound by frontal loudspeakers | |
| EP3448066A1 (en) | Signal processor | |
| US8165325B2 (en) | Automotive virtual surround audio system | |
| EP2975864B1 (en) | Signal processing apparatus for a vehicle sound system and signal processing method for a vehicle sound system | |
| US20240373184A1 (en) | A method of processing audio for playback of immersive audio | |
| JP4402632B2 (en) | Audio equipment | |
| CN119516985B (en) | Convenient accompaniment playing method, device, medium and electronic equipment based on eliminating original sound | |
| CN120583364A (en) | Sound processing method, device, storage medium and electronic device | |
| CN117652161A (en) | Audio processing methods for playback of immersive audio | |
| JP6252426B2 (en) | Audio signal processing device | |
| JPH03139100A (en) | On-vehicle sound reproducing device | |
| JP2006053435A (en) | Acoustic control device and acoustic control method | |
| Sound | AES 36th INTERNATIONAL CONFERENCE | |
| JPH01293100A (en) | On-vehicle stereo reproducing device | |
| JP2008053902A (en) | Acoustic reproduction system and method | |
| HK1196198A1 (en) | Apparatus and method and computer program for generating a stereo output signal for providing additional output channels | |
| HK1196198B (en) | Apparatus and method and computer program for generating a stereo output signal for providing additional output channels |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
| AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
| AX | Request for extension of the european patent |
Extension state: BA ME |
|
| 17P | Request for examination filed |
Effective date: 20160720 |
|
| RBV | Designated contracting states (corrected) |
Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
| 17Q | First examination report despatched |
Effective date: 20181119 |
|
| GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
| INTG | Intention to grant announced |
Effective date: 20190912 |
|
| GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
| GRAJ | Information related to disapproval of communication of intention to grant by the applicant or resumption of examination proceedings by the epo deleted |
Free format text: ORIGINAL CODE: EPIDOSDIGR1 |
|
| GRAL | Information related to payment of fee for publishing/printing deleted |
Free format text: ORIGINAL CODE: EPIDOSDIGR3 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
| GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
| INTC | Intention to grant announced (deleted) | ||
| INTG | Intention to grant announced |
Effective date: 20200219 |
|
| GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
| AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
| REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
| REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602014065355 Country of ref document: DE |
|
| REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 1271813 Country of ref document: AT Kind code of ref document: T Effective date: 20200615 |
|
| REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D |
|
| REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20200513 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200513 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200513 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200914 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200513 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200913 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200813 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200814 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200513 Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200513 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200813 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200513 |
|
| REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 1271813 Country of ref document: AT Kind code of ref document: T Effective date: 20200513 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200513 Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200513 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200513 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200513 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200513 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200513 Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200513 Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200513 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200513 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200513 |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602014065355 Country of ref document: DE |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200513 Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200513 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200513 |
|
| REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
| PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
| 26N | No opposition filed |
Effective date: 20210216 |
|
| REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20200731 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200731 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200731 Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200717 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200513 Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200731 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200717 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200513 Ref country code: MT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200513 Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200513 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200513 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20250722 Year of fee payment: 12 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20250722 Year of fee payment: 12 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20250725 Year of fee payment: 12 |
