EP1790195B1 - Method of mixing audio channels using correlated outputs - Google Patents
Method of mixing audio channels using correlated outputs Download PDFInfo
- Publication number
- EP1790195B1 EP1790195B1 EP05793022.4A EP05793022A EP1790195B1 EP 1790195 B1 EP1790195 B1 EP 1790195B1 EP 05793022 A EP05793022 A EP 05793022A EP 1790195 B1 EP1790195 B1 EP 1790195B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- channels
- audio
- channel
- signals
- phase
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000002596 correlated effect Effects 0.000 title claims description 57
- 238000002156 mixing Methods 0.000 title claims description 25
- 238000000034 method Methods 0.000 title claims description 14
- 239000011159 matrix material Substances 0.000 claims description 21
- 230000005236 sound signal Effects 0.000 description 27
- 239000000203 mixture Substances 0.000 description 15
- 239000013598 vector Substances 0.000 description 9
- 238000010586 diagram Methods 0.000 description 7
- 238000001914 filtration Methods 0.000 description 5
- 238000012880 independent component analysis Methods 0.000 description 4
- 230000001427 coherent effect Effects 0.000 description 3
- 230000000593 degrading effect Effects 0.000 description 3
- 230000003044 adaptive effect Effects 0.000 description 2
- 238000013528 artificial neural network Methods 0.000 description 2
- 230000001934 delay Effects 0.000 description 2
- 239000006185 dispersion Substances 0.000 description 2
- 238000000926 separation method Methods 0.000 description 2
- 230000015572 biosynthetic process Effects 0.000 description 1
- 230000003292 diminished effect Effects 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 230000008450 motivation Effects 0.000 description 1
- 230000010363 phase shift Effects 0.000 description 1
- 230000035807 sensation Effects 0.000 description 1
- 238000003786 synthesis reaction Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S3/00—Systems employing more than two channels, e.g. quadraphonic
- H04S3/02—Systems employing more than two channels, e.g. quadraphonic of the matrix type, i.e. in which input signals are combined algebraically, e.g. after having been phase shifted with respect to each other
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
- H04S7/30—Control circuits for electronic adaptation of the sound field
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04B—TRANSMISSION
- H04B1/00—Details of transmission systems, not covered by a single one of groups H04B3/00 - H04B13/00; Details of transmission systems not characterised by the medium used for transmission
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S3/00—Systems employing more than two channels, e.g. quadraphonic
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2499/00—Aspects covered by H04R or H04S not otherwise provided for in their subgroups
- H04R2499/10—General applications
- H04R2499/13—Acoustic transducers and sound field adaptation in vehicles
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
- H04S2400/05—Generation or adaptation of centre channel in multi-channel audio systems
Definitions
- This invention relates to mixing of audio signals and more specifically to a mix or downmix of two or more audio channels using a correlated output.
- Multi-channel audio has received enthusiastic acceptance by movie watchers in both traditional theater and home theater venues as it provides a true "surround sound" experience far superior to mixed stereo content.
- Dolby AC3 (Dolby digital) audio coding system is a world-wide standard for encoding stereo and 5.1 channel audio sound tracks.
- DTS Coherent Acoustics is another frequently used multi-channel audio coding system. DTS Coherent Acoustics is now being used to provide multi-channel music for special events and home listening via broadcast, CDs and DVDs 5.1, 6.1, 7.1, 10.2 and other multi-channel formats
- Car audio systems have over the years advanced from mono to stereo to the multi-speaker systems standard in most every automobile today. However, most content is still provided in a 2-channel stereo (L,R) format. The audio system mixes and delays the two channels to the multi-speaker lay out to provide an enhanced audio experience. However with the growing availability of multi-channel music, multi-channel audio systems are being implemented in automobiles to provide passengers with a "surround sound" experience.
- L,R 2-channel stereo
- the desired mix embodied in the multi-channel format may become "unbalanced". For example, a passenger sitting in the front passenger's seat may here too much of the discrete R channel that is emanating from the front right speaker effectively losing some of the benefits of the surround sound presentation. Even more extreme, a passenger in the back seat may here only the surround sound channels.
- a typical mixer 10 remixes the discrete R,C,L input channels 12,14,16 into R,C,L output channels 18,20,22 for an automobile.
- Each channel is passed through a delay 24 and mixed (multiplied by gain coefficients Gi 26 and summed 28) with the adjacent channels.
- the mixed channels are passed through equalizers 30 to the output channels 18,20,22 for playback on the L,C,R channel speakers in the automobile.
- This approach is generally effective at rebalancing the audio to provide a reasonable surround-sound experience for every passenger in the automobile there are a few potential problems.
- This approach may introduce unwanted artifacts when two channels include the same or very similar content but with a relative time or phase delay. Furthermore, this approach may over mix the signals that were assigned to a specific channel thereby degrading the "discreteness" of the multi-channel audio.
- US 5,610,986 discloses an audio-imaging system which includes at least first and second input channels for receiving first and second channel audio input signals and at least first, second and third output signals which are produced as a combination of the first and second channel audio input signals and a nonzero parameter.
- the parameter is common to the first, second and third output signals and may be made adjustable in order to vary the width of the audio image produced in order to compensate for composition mixing of a program source applied to the input channels.
- a sound-image analyzer is also provided which processes a program source applied to the input channels to at least three fully separated levels representing left, right and center directions of the program source in order to determine a value of the parameter.
- WO 99/14983 discloses an apparatus for creating, utilizing a pair of oppositely opposed headphone speakers, the sensation of a sound source being spatially distant from the area between the pair of headphones, the apparatus comprising: (a) a series of audio inputs representing audio signals being projected from an idealised sound source located at a spatial location relative to the idealised listener; (b) a first mixing matrix means interconnected to the audio inputs and a series of feedback inputs for outputting a predetermined combination of the audio inputs as intermediate output signals; (c) a filter system of filtering the intermediate output signals and outputting filtered intermediate output signals and the series of feedback inputs, the filter system including separate filters for filtering the direct response and short time response and an approximation to the reverberant response, in addition to the feedback response filtering for producing the feedback inputs; and (d) a second matrix mixing means combining the filtered intermediate output signals to produce left and right channel stereo outputs.
- WO 03/094369 discloses a method and system for generating one or more mix coefficients for downmixing a multichannel input signal having a plurality of input channels, to an output signal having a plurality of output channels.
- Mix coefficients may be generated responsive to a comparison of energy between the dowmixed (output) signal and the input signal to the dowmixer, such that energy and intended direction of the input signal are substantially preserved in the output signal.
- the mix coefficient generation may preserve an intended direction of an input signal, for example, received at a surround input channel, in at least one output channel of the output signal.
- the mix coefficient values may be generated in a test downmixer environment. Additionally, one or more mix coefficients may be generated by retrieving predetermined mix coefficient values. Additionally, or in the alternative, one or more mix coefficients may be generated responsive to an input energy of a plurality of the input channels.
- US 2002/071574 discloses a method of combining audio channel signals including shifting the phase of a first audio signal relative to a second audio signal.
- the relative phase shifting is substantially limited to a predetermined frequency range.
- US 6,624,873 discloses a method for providing more than two surround sound channels within the format of a digital soundtrack system designed to provide only two surround sound channels by matrix encoding from three to five additional surround sound channels into two "discrete" surround sound channels.
- the digital audio stream of the digital soundtrack system designed to provide only two surround sound channels remains unaltered, thus providing compatibility with existing playback equipment.
- the format of the media carrying the digital soundtracks also is unaltered.
- the "discreteness" of the digital soundtrack system is not audibly diminished by employing matrix technology to surround sound channels, particularly if active matrix decoding is employed.
- US 5,128,999 discloses a sound field correcting apparatus for adding indirect sound signals to audio signals from a decoder when a steering emphasis operation is not executed in the decoder and for limiting the addition of the indirect sound signals when the steering emphasis operation has been performed by the decoder.
- a reproduction sound having a proper extent feeling and a movement feeling of a sound image is obtained in accordance with a scene of a video image.
- US 4,819,269 discloses a method and system in which direct field sound, represented by the sum of left and right stereo input signals, is projected in a narrow dispersion pattern from a front radiating speaker and reverberant field sounds, represented by difference between left and right stereo input signals, is projected from speakers having a wide dispersion pattern.
- Direct field and reverberant field sounds are acoustically combined in space to create an improved representation of stereo sound.
- US 5,870,480 discloses a sound reproduction system for converting stereo signals on two input channels, which may have been directionally encoded from a four or five channel original using a phase/amplitude film matrix encoder, such signals including at least one component which is directionally encoded through a phase and amplitude encoding device and at least one component that is not directionally encoded but is different in the two input channels, into signals for multiple output channels, for example center, front left, front right, side left, side right, rear left, and rear right, including decoding apparatus for enhancing the directionally encoded component of the input signals in the desired direction and reducing the strength of such signals in channels not associated with the encoded direction, while preserving both the maximum separation between the respective left and right channels and the total energy of the non-directionally encoded component of the input channels in each output channel, such that the instruments recorded on the right input channel stay on the right side of the output channels and the instruments recorded on the left stay on the left side, and the apparent loudness of all the instruments in all the output channels stays the same regardless of the
- the present invention provides a method of mixing audio channels that is effective at rebalancing the audio or downmixing audio channels without introducing unwanted artifacts or overly degrading the discrete presentation of the original audio.
- the correlator can be implemented using any suitable technology including but not limited to Neural Networks, Independent Component Analysis (ICA), Adaptive Filtering or Matrix Decoders.
- ICA Independent Component Analysis
- Matrix Decoders Matrix Decoders
- only the in-phase correlated signal is mixed with the two input channels.
- the in-phase correlated signal represents the same or very similar signals that are present in both channels and in-phase (no or minimal time delay).
- the correlation process provides the in-phase correlated signal, an out-of-phase correlated signal (same or similar signals with appreciable time or phase delay) and one or more independent signals (signals not present in the other input channel) that are mixed with the input channels. This approach provides more mixing
- the mixer may set the mixing coefficients of the out-of-phase and independent signals to zero thereby achieving the same results as if only the in-phase correlated signal were mixed. Or the mixer may simply lower the coefficients in these signals to provide a smoother mix. In other applications, the mixer may want to reduce or remove the out-of-phase signal but retain some of the independent signal. For example, in a 3:2 downmix from L,C,R input channels to L,R output channels it may be desirable to mix the independent C channel signals into the L and R output channels.
- the present invention provides a method of mixing audio channels that is effective at rebalancing the audio without introducing unwanted artifacts or overly softening the discrete presentation of the original audio. This is accomplished between any two or more input channels by processing the audio channels to generate one or more "correlated" audio signals for each pair of input channels.
- the in-phase correlated signal representing content in both channels that is the same or very similar with little or no phase or time delay is mixed with the input channels.
- the present approach may also generate an out-of-phase correlated signal (same or similar signals with appreciable time or phase delay) that is typically discarded and a pair of independent signals (signals not present in the other input channel) that may be mixed with the input channels.
- the provision of both the in-phase correlated signal and the pair of independent signals makes the present approach well suited for the downmixing of audio channels as well.
- the techniques were developed in the context of improving the surround sound experience provided by multi-channel audio in a automobile, the present invention is generally applicable to any two or more audio channels in which mixing occurs in any setting.
- a mixer 40 remixes the discrete R,C,L input channels 42,44,46 into R,C,L output channels 48,50,52 for an automobile.
- Each channel is passed through a delay 54.
- the R and C and L and C channels are input to correlators 56 and 58, respectively, which generate correlated audio signals 60 and 62.
- These correlated audio signals 60 and 62 are mixed (multiplied by gain coefficients Gi 64 and summed 66) with the adjacent channels.
- the mixed channels are passed through equalizers 68 to the output channels 48,50,52 for playback on the L,C,R channel speakers in, for example, the automobile.
- the correlators 56 and 58 can be implemented using any suitable technology including but not limited to Neural Networks, Independent Component Analysis (ICA), Adaptive Filtering or Matrix Decoders.
- LCC in-phase correlated audio signal
- this desire for increased flexibility can be accommodated with a correlator 72 that is configured to produce an in-phase correlated audio signal (RIP,LIP), an out-of-phase correlated audio signal (ROP,LOP) and L and R independent audio signals(RCI,CRI and LCI,CLI).
- RIP,LIP in-phase correlated audio signal
- ROP,LOP out-of-phase correlated audio signal
- L and R independent audio signals RI,CRI and LCI,CLI
- the out of phase components and the independent components for that output channel may be discarded.
- Figures 5a through 5h illustrate a simple four tone example highlighting the benefits and flexibility provided by mixing correlated outputs.
- the L channel includes a 1kHz tone, a 5kHz tone and a 15kHz tone.
- the R channel has a 5 kHz tone, a 10 kHz tone and a 15 kHz tone.
- the 5 kHz tones are in phase and correlated.
- the 15 kHz tones are out of phase.
- the time domain waveforms 72 and 74 for the L (top) and R (bottom) channels are shown in Figure 5a .
- the frequency content 76 and 78 of the L and R channels are shown in Figures 5b and 5c , respectively.
- a 2:1 correlator of the type illustrated in Figure 3 above produces a single in-phase correlated audio signal 80 as shown in Figure 5d .
- This signal can then be mixed with either or both the left and right channels to rebalance the 5kHz tone without introducing any phase or amplitude distortions associated with the out-of-phase 15 kHz tones or mixing in any of the independent audio signals, 1kHz into the R channel or 10kHz in the L channel.
- a 2:4 correlator of the type illustrated in Figure 4 above produces an independent L signal 82 at 1kHz, independent R signal 84 at 10kHz, in-phase correlated signal 86 at 5kHz, and an out-of-phase correlated signal 88 at 15kHz as shown in Figure 5e-5h .
- These signals can then be independently mixed with either or both the left and right channels. In some cases only the in-phase correlate signal 86 will be mixed and the other discarded or set to zero. Alternately, the mixer may prefer to add a small component of these other signals. For example, in a 3:2 downmix in which the C channel does not have a discrete speaker, it may be necessary to mix some of the independent signals.
- the correlator may be implemented using a matrix decoder.
- the earliest multi-channel systems matrix encoded multiple audio channels, e.g. left, right, center and surround (L,R,C,S) channels, into left and right total (Lt,Rt) channels and recorded them in the standard stereo format.
- a matrix decoder decodes the two discrete channels Lt,Rt and expands them into four discrete reconstructed channels L,R,C and S that are amplified and distributed to a five speaker system.
- Dolby Pro Logic provides a set of gain factors for a null point at the center of a five-point sound field.
- the Pro Logic decoder measures the absolute power of the two-channel matrix encoded signals Lt and Rt and calculates power levels for each of the L, R, C and S channels. These power levels are then used to calculate L/R and C/S dominance vectors whose vector sum defines a single dominance vector in the five-point sound field from which the single dominant signal should emanate. The power levels and dominance vectors are time averaged to improve stability.
- the decoder scales the set of gain coefficients at the null point according to the dominance vectors to provide gain factors Hi.
- Neo:6 decoder includes a multiband filter bank, a matrix decoder and a synthesis filter, which together decode Lt and Rt and reconstruct the multi-channel output.
- Neo:6 computes L/R and C/S dominance vector for each subband and averages them using both a slow and fast average.
- Neo:6 uses the dominance vector to map the Lt, Rt subband signals into an expanded 9-point sound field.
- Neo:6 computes gain coefficients for the vector in each subband based on the values of the gain coefficients in the sound field. This allows the subbands to be steered independently in a sound field that observes the motion picture channel configuration.
- a 2:4 matrix decoder 90 is designed to deconstruct Lt and Rt to reconstruct the L, R, C and S channels as encoded in equations 10 and 11.
- An analysis of these equations shows that the L and R channels are independent in Lt and Rt, the C channel is perfectly correlated and the S channel is 180° out-of-phase.
- the reconstructed C channel will represent any in-phase correlated audio signals in Lt and Rt
- the reconstructed S channel will represent any out-of-phase correlated audio signals
- the reconstructed L and R channels will represent independent audio signals from the two input audio channels.
- a 2:3 matrix decoder in which the S channel is mixed into the L and R channels can be used if only the in-phase correlated signal is required.
- the multi-channel mixer provides the desired rebalanced of the multi-channel audio without producing unwanted artifacts or softening the discrete presentation of the audio.
- a typical automotive sound system 100 a plurality of speakers 102 including at least L front and R front in the passenger cabin 104 of the car.
- speaker system also includes C front, R and L side and R and L rear and may include a C rear.
- a multi-channel decoder 106 decodes multi-channel encoded audio from a disk 108 (or broadcast) into multiple discrete audio input channels including at least L front, C front and R front. In this 5.1 channel format right Rs and left Ls surround channels are also provided. The .1 or low frequency channel is not shown.
- a multi-channel mixer 110 mixes the discrete R,C,L channels using correlated outputs into the R,C,L channels for the respective speakers. Each channel is passed through a delay 112. The R and C and L and C channels are input to correlators 114 and 116, respectively, which generate correlated audio signals 118 and 120. These correlated audio signals 118 and 120 are mixed (multiplied by gain coefficients Gi 122 and summed 124) with the adjacent channels. The mixed channels are passed through equalizers 126 to the R,C, L output channels for playback on the R,C,L channel speakers.
- 5.1 audio is being mixed into a 7 speaker system, which is not uncommon. Because of typical home speaker configurations, 5.1 content is more common but many cars use 7 speaker systems.
- the Rs (Ls) channel is passed through a delay 130, split and multiplied by mixing coefficients 132.
- One branch is passed through an equalizer 134 and provided to the R read (L rear).
- the other branch is mixed with the mixed R (L) channel (delay 136, mixing coefficient 138, and summing node 140), passed through an equalizer 142 and provided to the R side (L side).
- the R, R side and R rear discrete audio channels could be mixed using correlated outputs in a manner similar to that described for the R,C,L.
- the left side channels could be similarly mixed.
- the audio was available in an 8.1 format and the speaker system included a C rear speaker, all of the rear speakers could be so mixed.
- the speaker system in the car is not provided with a C front speaker.
- the 3 front channels (R,C,L) must be downmixed into only 2 channels (R,L). This is a common occurrence in non-automotive applications where the C channel speaker does not exist.
- the C channel is simply mixed into both the L and R speakers. In the automotive setting, the same approach can be taken.
- the ideal coefficients for mixing the C channel may not be the same as the desired coefficients for rebalancing and further may create unwanted artifacts do to the out-of-phase correlated signals between the input channels.
- the correlators 150 and 152 generate the in-phase, out-of-phase, and pair of independent audio signals.
- the mixer now has the flexibility to mix the in-phase components as needed to rebalance the signal, discard the out-of-phase components to avoid phase distortion and mix the independent C channel to preserve the audio signals in that channel.
- N channels into M where N>M in this manner will have applicability outside automotive applications.
- content is being generated for new exhibition venues with more discrete channels, e.g. 10.2.
- many of the commercial and consumer venues will have 5.1, 6.1 or 7.1 speaker configurations that will require downmixing.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Signal Processing (AREA)
- Acoustics & Sound (AREA)
- General Physics & Mathematics (AREA)
- Algebra (AREA)
- Computer Networks & Wireless Communication (AREA)
- Mathematical Analysis (AREA)
- Mathematical Optimization (AREA)
- Mathematical Physics (AREA)
- Pure & Applied Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Stereophonic System (AREA)
- Amplifiers (AREA)
Description
- This invention relates to mixing of audio signals and more specifically to a mix or downmix of two or more audio channels using a correlated output.
- Multi-channel audio has received enthusiastic acceptance by movie watchers in both traditional theater and home theater venues as it provides a true "surround sound" experience far superior to mixed stereo content. Dolby AC3 (Dolby digital) audio coding system is a world-wide standard for encoding stereo and 5.1 channel audio sound tracks. DTS Coherent Acoustics is another frequently used multi-channel audio coding system. DTS Coherent Acoustics is now being used to provide multi-channel music for special events and home listening via broadcast, CDs and DVDs 5.1, 6.1, 7.1, 10.2 and other multi-channel formats
- Car audio systems have over the years advanced from mono to stereo to the multi-speaker systems standard in most every automobile today. However, most content is still provided in a 2-channel stereo (L,R) format. The audio system mixes and delays the two channels to the multi-speaker lay out to provide an enhanced audio experience. However with the growing availability of multi-channel music, multi-channel audio systems are being implemented in automobiles to provide passengers with a "surround sound" experience.
- Although a significant improvement over existing audio systems, the confines of the car and proximity of passengers to particular speakers affect the surround-sound experience. In general, the desired mix embodied in the multi-channel format may become "unbalanced". For example, a passenger sitting in the front passenger's seat may here too much of the discrete R channel that is emanating from the front right speaker effectively losing some of the benefits of the surround sound presentation. Even more extreme, a passenger in the back seat may here only the surround sound channels.
- As a result, automakers have found that some amount of remixing of the discrete channels can reestablish the desired balance and improve the surround sound experience for everyone in the car. As shown in
Figure 1 , atypical mixer 10 remixes the discrete R,C,L input channels L output channels delay 24 and mixed (multiplied bygain coefficients Gi 26 and summed 28) with the adjacent channels. Standard mixing equations are:output channels - Although this approach is generally effective at rebalancing the audio to provide a reasonable surround-sound experience for every passenger in the automobile there are a few potential problems. This approach may introduce unwanted artifacts when two channels include the same or very similar content but with a relative time or phase delay. Furthermore, this approach may over mix the signals that were assigned to a specific channel thereby degrading the "discreteness" of the multi-channel audio.
-
US 5,610,986 discloses an audio-imaging system which includes at least first and second input channels for receiving first and second channel audio input signals and at least first, second and third output signals which are produced as a combination of the first and second channel audio input signals and a nonzero parameter. The parameter is common to the first, second and third output signals and may be made adjustable in order to vary the width of the audio image produced in order to compensate for composition mixing of a program source applied to the input channels. A sound-image analyzer is also provided which processes a program source applied to the input channels to at least three fully separated levels representing left, right and center directions of the program source in order to determine a value of the parameter. -
WO 99/14983 -
WO 03/094369 -
US 2002/071574 discloses a method of combining audio channel signals including shifting the phase of a first audio signal relative to a second audio signal. In one example, the relative phase shifting is substantially limited to a predetermined frequency range. -
US 6,624,873 discloses a method for providing more than two surround sound channels within the format of a digital soundtrack system designed to provide only two surround sound channels by matrix encoding from three to five additional surround sound channels into two "discrete" surround sound channels. The digital audio stream of the digital soundtrack system designed to provide only two surround sound channels remains unaltered, thus providing compatibility with existing playback equipment. The format of the media carrying the digital soundtracks also is unaltered. The "discreteness" of the digital soundtrack system is not audibly diminished by employing matrix technology to surround sound channels, particularly if active matrix decoding is employed. -
US 5,128,999 discloses a sound field correcting apparatus for adding indirect sound signals to audio signals from a decoder when a steering emphasis operation is not executed in the decoder and for limiting the addition of the indirect sound signals when the steering emphasis operation has been performed by the decoder. Thus, a reproduction sound having a proper extent feeling and a movement feeling of a sound image is obtained in accordance with a scene of a video image. -
US 4,819,269 discloses a method and system in which direct field sound, represented by the sum of left and right stereo input signals, is projected in a narrow dispersion pattern from a front radiating speaker and reverberant field sounds, represented by difference between left and right stereo input signals, is projected from speakers having a wide dispersion pattern. Direct field and reverberant field sounds are acoustically combined in space to create an improved representation of stereo sound. -
US 5,870,480 discloses a sound reproduction system for converting stereo signals on two input channels, which may have been directionally encoded from a four or five channel original using a phase/amplitude film matrix encoder, such signals including at least one component which is directionally encoded through a phase and amplitude encoding device and at least one component that is not directionally encoded but is different in the two input channels, into signals for multiple output channels, for example center, front left, front right, side left, side right, rear left, and rear right, including decoding apparatus for enhancing the directionally encoded component of the input signals in the desired direction and reducing the strength of such signals in channels not associated with the encoded direction, while preserving both the maximum separation between the respective left and right channels and the total energy of the non-directionally encoded component of the input channels in each output channel, such that the instruments recorded on the right input channel stay on the right side of the output channels and the instruments recorded on the left stay on the left side, and the apparent loudness of all the instruments in all the output channels stays the same regardless of the direction of the directionally encoded component of the input signals; and further including circuits to improve separation in the decoder for uncorrelated left and right side inputs, to improve reproduction of apparent motion between the sides and the rear, to compensate for boost applied to signals in the front quarter of the sound field, and to limit the maximum excursion of each of the direction control signals when the other is changing. - The present invention provides a method of mixing audio channels that is effective at rebalancing the audio or downmixing audio channels without introducing unwanted artifacts or overly degrading the discrete presentation of the original audio.
- This is accomplished between any two or more input channels by processing the audio channels to generate one or more "correlated" audio signals for each pair of input channels. The correlated audio signal(s) are then mixed with the input audio channels to provide the output channels. The correlator can be implemented using any suitable technology including but not limited to Neural Networks, Independent Component Analysis (ICA), Adaptive Filtering or Matrix Decoders.
- In one embodiment, only the in-phase correlated signal is mixed with the two input channels. The in-phase correlated signal represents the same or very similar signals that are present in both channels and in-phase (no or minimal time delay). By mixing only this portion of the audio signals we are able to achieve the desired rebalancing without introducing unwanted artifacts or degrading the discreteness of multi-channel audio.
- In another embodiment, the correlation process provides the in-phase correlated signal, an out-of-phase correlated signal (same or similar signals with appreciable time or phase delay) and one or more independent signals (signals not present in the other input channel) that are mixed with the input channels. This approach provides more mixing
-
- flexibility. The mixer may set the mixing coefficients of the out-of-phase and independent signals to zero thereby achieving the same results as if only the in-phase correlated signal were mixed. Or the mixer may simply lower the coefficients in these signals to provide a smoother mix. In other applications, the mixer may want to reduce or remove the out-of-phase signal but retain some of the independent signal. For example, in a 3:2 downmix from L,C,R input channels to L,R output channels it may be desirable to mix the independent C channel signals into the L and R output channels.
- These and other features and advantages of the invention will be apparent to those skilled in the art from the following detailed description of preferred embodiments, taken together with the accompanying drawings, in which:
-
-
FIG. 1 , as described above, is a known configuration for mixing the discrete L, C and R audio channels in an automobile to improve the surround-sound experience; -
FIG. 2 is a configuration for mixing the discrete L, C and R audio channels using the correlated outputs between the L and C and R and C channels in accordance with the present invention; -
FIG. 3 is a block diagram of a correlator generating a correlated output; -
Fig. 4 is a block diagram of a correlator generating correlated, out-of-phase and independent outputs; -
FIGs. 5a through 5h are simplified diagrams showing time and frequency domain representations of the L and R input channels and frequency domain representations of 2:1 and 4:1 correlated outputs; -
FIG. 6 is a block diagram of an embodiment of the correlator using a 2:4 matrix decoder; -
FIG. 7 is a simplified block diagram of an automobile audio system; -
FIG. 8 is a block diagram of the multi-channel mixer; and -
FIG. 9 is a block diagram of the multi-channel mixer that exploits the downmix capabilities of the correlator shown inFIG. 4 in an automobile. - The application of multi-channel audio to automobiles revealed the desirability for remixing of the discrete audio channels to provide a more uniform surround sound experience for all passengers. However, although a straightforward mix was effective at rebalancing the multi-channel audio this approach could produce unwanted artifacts. If, for example, the R and C channels included the same or very similar content with appreciable phase or time delays, remixing these two channels could produce phase distortion and/or amplitude distortion. Furthermore, much of the desirability of multi-channel audio stems from the discrete unmixed presentation of the audio channels. The remixing process may soften the discrete presentation of the audio.
- Therefore, the present invention provides a method of mixing audio channels that is effective at rebalancing the audio without introducing unwanted artifacts or overly softening the discrete presentation of the original audio. This is accomplished between any two or more input channels by processing the audio channels to generate one or more "correlated" audio signals for each pair of input channels. The in-phase correlated signal representing content in both channels that is the same or very similar with little or no phase or time delay is mixed with the input channels. The present approach may also generate an out-of-phase correlated signal (same or similar signals with appreciable time or phase delay) that is typically discarded and a pair of independent signals (signals not present in the other input channel) that may be mixed with the input channels. The provision of both the in-phase correlated signal and the pair of independent signals makes the present approach well suited for the downmixing of audio channels as well.
- Although the techniques were developed in the context of improving the surround sound experience provided by multi-channel audio in a automobile, the present invention is generally applicable to any two or more audio channels in which mixing occurs in any setting.
- As shown in
Figure 2 , amixer 40 remixes the discrete R,C,L input channels L output channels delay 54. The R and C and L and C channels are input to correlators 56 and 58, respectively, which generate correlated audio signals 60 and 62. These correlated audio signals 60 and 62 are mixed (multiplied bygain coefficients Gi 64 and summed 66) with the adjacent channels. The mixed channels are passed through equalizers 68 to theoutput channels - The
correlators Figure 3 , acorrelator 70 can be configured to produce a single in-phase correlated audio signal (LCC, RCC) that is mixed as follows: - As shown in
Figure 4 , this desire for increased flexibility can be accommodated with acorrelator 72 that is configured to produce an in-phase correlated audio signal (RIP,LIP), an out-of-phase correlated audio signal (ROP,LOP) and L and R independent audio signals(RCI,CRI and LCI,CLI). In general, each of these components can be mixed in accordance with mixing equations: -
-
Figures 5a through 5h illustrate a simple four tone example highlighting the benefits and flexibility provided by mixing correlated outputs. In this example, the L channel includes a 1kHz tone, a 5kHz tone and a 15kHz tone. The R channel has a 5 kHz tone, a 10 kHz tone and a 15 kHz tone. The 5 kHz tones are in phase and correlated. The 15 kHz tones are out of phase. Thetime domain waveforms Figure 5a . Thefrequency content Figures 5b and 5c , respectively. - A 2:1 correlator of the type illustrated in
Figure 3 above, produces a single in-phase correlatedaudio signal 80 as shown inFigure 5d . This signal can then be mixed with either or both the left and right channels to rebalance the 5kHz tone without introducing any phase or amplitude distortions associated with the out-of-phase 15 kHz tones or mixing in any of the independent audio signals, 1kHz into the R channel or 10kHz in the L channel. - A 2:4 correlator of the type illustrated in
Figure 4 above, produces anindependent L signal 82 at 1kHz,independent R signal 84 at 10kHz, in-phase correlatedsignal 86 at 5kHz, and an out-of-phase correlated signal 88 at 15kHz as shown inFigure 5e-5h . These signals can then be independently mixed with either or both the left and right channels. In some cases only the in-phase correlatesignal 86 will be mixed and the other discarded or set to zero. Alternately, the mixer may prefer to add a small component of these other signals. For example, in a 3:2 downmix in which the C channel does not have a discrete speaker, it may be necessary to mix some of the independent signals. - As mentioned above, the correlator may be implemented using a matrix decoder. The earliest multi-channel systems matrix encoded multiple audio channels, e.g. left, right, center and surround (L,R,C,S) channels, into left and right total (Lt,Rt) channels and recorded them in the standard stereo format. The
Prologic encoder 4 matrix encodes this mix as follows: - A matrix decoder decodes the two discrete channels Lt,Rt and expands them into four discrete reconstructed channels L,R,C and S that are amplified and distributed to a five speaker system. Many different proprietary algorithms are used to perform an active decode and all are based on measuring the power of Lt+Rt (C), Lt-Rt (S), Lt (L) and Rt (R) to calculate gain factors Hi whereby,
- More specifically, Dolby Pro Logic provides a set of gain factors for a null point at the center of a five-point sound field. The Pro Logic decoder measures the absolute power of the two-channel matrix encoded signals Lt and Rt and calculates power levels for each of the L, R, C and S channels. These power levels are then used to calculate L/R and C/S dominance vectors whose vector sum defines a single dominance vector in the five-point sound field from which the single dominant signal should emanate. The power levels and dominance vectors are time averaged to improve stability. The decoder scales the set of gain coefficients at the null point according to the dominance vectors to provide gain factors Hi.
- DTS Neo:6 decoder includes a multiband filter bank, a matrix decoder and a synthesis filter, which together decode Lt and Rt and reconstruct the multi-channel output. Neo:6 computes L/R and C/S dominance vector for each subband and averages them using both a slow and fast average. Neo:6 uses the dominance vector to map the Lt, Rt subband signals into an expanded 9-point sound field. Neo:6 computes gain coefficients for the vector in each subband based on the values of the gain coefficients in the sound field. This allows the subbands to be steered independently in a sound field that observes the motion picture channel configuration.
- As shown in
Figure 6 , a 2:4matrix decoder 90 is designed to deconstruct Lt and Rt to reconstruct the L, R, C and S channels as encoded inequations 10 and 11. An analysis of these equations shows that the L and R channels are independent in Lt and Rt, the C channel is perfectly correlated and the S channel is 180° out-of-phase. - Therefore, as shown in
Figure 6 , if Lt and Rt are simply two audio channels, and not matrix encoded channels, then the reconstructed C channel will represent any in-phase correlated audio signals in Lt and Rt, the reconstructed S channel will represent any out-of-phase correlated audio signals and the reconstructed L and R channels will represent independent audio signals from the two input audio channels. Note, a 2:3 matrix decoder in which the S channel is mixed into the L and R channels can be used if only the in-phase correlated signal is required. - The specific algorithm used to calculate the gain factors Hi will determine the degree of correlation, phase shift or independence captured in each of these channels. To illustrate, consider the following idealized cases:
Case 1: Lt, Rt highly correlated (Lt = Rt)L H1 and H2 = 0.354, -0.354, C H1 and H2 = 0.707, 0.707, R H1 and H2 = -0.354, 0.354, S H1 and H2 = 0.707, -0.707,
In this case, L, R and S will be 0 and C will contain equal amounts of both L and R. As expected, in-phase contribution will be large and the other components will be zero.. Depending on where the steering vector ends up new coefficients are calculated from a grid of optimal ones using interpolation
Case 2: Lt, Rt complete out of phase (Lt = -1.0*Rt)L G1 and G2 = 0.354, 0.354, C G1 and G2 = 0.5, 0.5, R G1 and G2 = 0.354, 0.354, S H1 and H2 = 0.707, -0.707,
In this case, all of the outputs will be zero.
Case 3: Lt is dominate (Rt = 0)L H1 and H2 = 1.0, 0.0, C H1 and H2 = 0.0, 0.5, R H1 and H2 = 0.0, 0.707, S H1 and H2 = 0.0, -1,
In this case, all of the outputs are zero except for the left channel which contains the left input. - As discussed above the motivation for the present invention was to improve the surround sound experience provided by multi-channel audio such as provided by Dolby AC3 or DTS Coherent Acoustics. By mixing correlated audio signals, the multi-channel mixer provides the desired rebalanced of the multi-channel audio without producing unwanted artifacts or softening the discrete presentation of the audio.
- As shown in
Figures 7 and8 , a typical automotive sound system 100 a plurality ofspeakers 102 including at least L front and R front in thepassenger cabin 104 of the car. In this example, speaker system also includes C front, R and L side and R and L rear and may include a C rear. Amulti-channel decoder 106 decodes multi-channel encoded audio from a disk 108 (or broadcast) into multiple discrete audio input channels including at least L front, C front and R front. In this 5.1 channel format right Rs and left Ls surround channels are also provided. The .1 or low frequency channel is not shown. - A
multi-channel mixer 110 mixes the discrete R,C,L channels using correlated outputs into the R,C,L channels for the respective speakers. Each channel is passed through adelay 112. The R and C and L and C channels are input to correlators 114 and 116, respectively, which generate correlatedaudio signals audio signals gain coefficients Gi 122 and summed 124) with the adjacent channels. The mixed channels are passed throughequalizers 126 to the R,C, L output channels for playback on the R,C,L channel speakers. - In this particular application 5.1 audio is being mixed into a 7 speaker system, which is not uncommon. Because of typical home speaker configurations, 5.1 content is more common but many cars use 7 speaker systems. In this case the Rs and Ls discrete channels are mixed to the R side and R read and L side and L rear, respectively. The Rs (Ls) channel is passed through a
delay 130, split and multiplied by mixingcoefficients 132. One branch is passed through anequalizer 134 and provided to the R read (L rear). The other branch is mixed with the mixed R (L) channel (delay 136, mixingcoefficient 138, and summing node 140), passed through anequalizer 142 and provided to the R side (L side). - If the content were provided in a 7.1 format, the R, R side and R rear discrete audio channels could be mixed using correlated outputs in a manner similar to that described for the R,C,L. The left side channels could be similarly mixed. Furthermore, if the audio was available in an 8.1 format and the speaker system included a C rear speaker, all of the rear speakers could be so mixed.
- As shown in
Figure 9 , the speaker system in the car is not provided with a C front speaker. The 3 front channels (R,C,L) must be downmixed into only 2 channels (R,L). This is a common occurrence in non-automotive applications where the C channel speaker does not exist. The C channel is simply mixed into both the L and R speakers. In the automotive setting, the same approach can be taken. However, the ideal coefficients for mixing the C channel may not be the same as the desired coefficients for rebalancing and further may create unwanted artifacts do to the out-of-phase correlated signals between the input channels. - Instead, the
correlators - The capability to flexibly downmix N channels into M where N>M in this manner will have applicability outside automotive applications. For example, content is being generated for new exhibition venues with more discrete channels, e.g. 10.2. However, many of the commercial and consumer venues will have 5.1, 6.1 or 7.1 speaker configurations that will require downmixing.
- While several illustrative embodiments of the invention have been shown and described, numerous variations and alternate embodiments will occur to those skilled in the art. Such variations and alternate embodiments are contemplated, and can be made without departing from the scope of the invention as defined in the appended claims.
Claims (3)
- A method of mixing audio channels, comprising:providing first, second and third audio input channels;processing the first and second channels to provide a first in-phase correlated signal, a first out-of-phase correlated signal, and first and second independent signals;processing the second and third channels to provide a second in-phase correlated signal, a second out-of-phase correlated signal, and third and fourth independent signals;mixing the first in-phase correlated signal and the first and second independent signals with the first input channel into a first output channel; andmixing the second in-phase correlated signal and the third and fourth independent signals with the third input channel into a second output channel.
- The method of claim 1, wherein:the first out-of-phase correlated signal is also mixed with said first in-phase correlated signal, said first and second independent signals and said first input channel into said first output channel; andthe second out-of-phase correlated signal is also mixed with said second in-phase correlated signal, said third and fourth independent signals and said third input channel into said second output channel.
- The method of claim 1, wherein said processing the first and second channels and said processing the second and third channels is performed by 2:4 matrix decoding to provide the respective in-phase correlated signals, out-of-phase correlated signals and independent signals.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP11182055A EP2400783A3 (en) | 2004-08-31 | 2005-08-26 | Method of mixing audio channels using correlated outputs |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US10/930,659 US7283634B2 (en) | 2004-08-31 | 2004-08-31 | Method of mixing audio channels using correlated outputs |
PCT/US2005/030471 WO2006026463A2 (en) | 2004-08-31 | 2005-08-26 | Method of mixing audio channels using correlated outputs |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP11182055A Division-Into EP2400783A3 (en) | 2004-08-31 | 2005-08-26 | Method of mixing audio channels using correlated outputs |
Publications (3)
Publication Number | Publication Date |
---|---|
EP1790195A2 EP1790195A2 (en) | 2007-05-30 |
EP1790195A4 EP1790195A4 (en) | 2010-11-17 |
EP1790195B1 true EP1790195B1 (en) | 2015-10-28 |
Family
ID=35943100
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP05793022.4A Active EP1790195B1 (en) | 2004-08-31 | 2005-08-26 | Method of mixing audio channels using correlated outputs |
EP11182055A Withdrawn EP2400783A3 (en) | 2004-08-31 | 2005-08-26 | Method of mixing audio channels using correlated outputs |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP11182055A Withdrawn EP2400783A3 (en) | 2004-08-31 | 2005-08-26 | Method of mixing audio channels using correlated outputs |
Country Status (10)
Country | Link |
---|---|
US (1) | US7283634B2 (en) |
EP (2) | EP1790195B1 (en) |
JP (1) | JP4866354B2 (en) |
KR (1) | KR20070053305A (en) |
CN (1) | CN101036414B (en) |
HK (1) | HK1106387A1 (en) |
IL (1) | IL181449A0 (en) |
RU (1) | RU2365063C2 (en) |
TR (1) | TR200702668T2 (en) |
WO (1) | WO2006026463A2 (en) |
Families Citing this family (52)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1921606B1 (en) * | 2005-09-02 | 2011-10-19 | Panasonic Corporation | Energy shaping device and energy shaping method |
KR100888474B1 (en) * | 2005-11-21 | 2009-03-12 | 삼성전자주식회사 | Apparatus and method for encoding/decoding multichannel audio signal |
KR100829870B1 (en) * | 2006-02-03 | 2008-05-19 | 한국전자통신연구원 | Apparatus and method for measurement of Auditory Quality of Multichannel Audio Codec |
US8452427B2 (en) * | 2006-09-13 | 2013-05-28 | Savant Systems, Llc | Signal path using general-purpose computer for audio processing and audio-driven graphics |
US20100100372A1 (en) * | 2007-01-26 | 2010-04-22 | Panasonic Corporation | Stereo encoding device, stereo decoding device, and their method |
KR101336237B1 (en) | 2007-03-02 | 2013-12-03 | 삼성전자주식회사 | Method and apparatus for reproducing multi-channel audio signal in multi-channel speaker system |
JP2008312034A (en) * | 2007-06-15 | 2008-12-25 | Panasonic Corp | Sound signal reproduction device, and sound signal reproduction system |
US8385556B1 (en) * | 2007-08-17 | 2013-02-26 | Dts, Inc. | Parametric stereo conversion system and method |
DE602007004632D1 (en) * | 2007-11-12 | 2010-03-18 | Harman Becker Automotive Sys | Mix of first and second sound signals |
US20080089403A1 (en) * | 2007-11-26 | 2008-04-17 | Nokia Corporation | Chip-level or symbol-level equalizer structure for multiple transmit and receiver antenna configurations |
KR101162275B1 (en) * | 2007-12-31 | 2012-07-04 | 엘지전자 주식회사 | A method and an apparatus for processing an audio signal |
KR101328962B1 (en) * | 2008-01-01 | 2013-11-13 | 엘지전자 주식회사 | A method and an apparatus for processing an audio signal |
RU2010132201A (en) * | 2008-01-01 | 2012-02-10 | ЭлДжи ЭЛЕКТРОНИКС ИНК. (KR) | METHOD AND DEVICE FOR SIGNAL PROCESSING |
CN101911182A (en) * | 2008-01-01 | 2010-12-08 | Lg电子株式会社 | The method and apparatus that is used for audio signal |
US8295526B2 (en) | 2008-02-21 | 2012-10-23 | Bose Corporation | Low frequency enclosure for video display devices |
US8351629B2 (en) | 2008-02-21 | 2013-01-08 | Robert Preston Parker | Waveguide electroacoustical transducing |
US8351630B2 (en) | 2008-05-02 | 2013-01-08 | Bose Corporation | Passive directional acoustical radiating |
EP2327072B1 (en) * | 2008-08-14 | 2013-03-20 | Dolby Laboratories Licensing Corporation | Audio signal transformatting |
KR20100084375A (en) * | 2009-01-16 | 2010-07-26 | 삼성전자주식회사 | Audio system and method for controlling output the same |
EP2214162A1 (en) * | 2009-01-28 | 2010-08-04 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Upmixer, method and computer program for upmixing a downmix audio signal |
US8265310B2 (en) | 2010-03-03 | 2012-09-11 | Bose Corporation | Multi-element directional acoustic arrays |
US8139774B2 (en) * | 2010-03-03 | 2012-03-20 | Bose Corporation | Multi-element directional acoustic arrays |
KR20120004909A (en) * | 2010-07-07 | 2012-01-13 | 삼성전자주식회사 | Method and apparatus for 3d sound reproducing |
EP2599332B1 (en) * | 2010-07-30 | 2021-07-14 | Fraunhofer Gesellschaft zur Förderung der angewandten Forschung E.V. | Vehicle with sound wave reflector |
US8553894B2 (en) | 2010-08-12 | 2013-10-08 | Bose Corporation | Active and passive directional acoustic radiating |
CN103460282B (en) * | 2010-08-25 | 2015-08-19 | 弗兰霍菲尔运输应用研究公司 | For the device utilizing the phase information of transmission to produce decorrelated signals |
EP2614659B1 (en) | 2010-09-06 | 2016-06-08 | Dolby International AB | Upmixing method and system for multichannel audio reproduction |
CN105516723B (en) | 2010-09-30 | 2018-07-27 | 三菱电机株式会社 | Dynamic image encoding device and method, moving image decoding apparatus and method |
CN102802112B (en) * | 2011-05-24 | 2014-08-13 | 鸿富锦精密工业(深圳)有限公司 | Electronic device with audio file format conversion function |
KR101803293B1 (en) | 2011-09-09 | 2017-12-01 | 삼성전자주식회사 | Signal processing apparatus and method for providing 3d sound effect |
SG11201504368VA (en) | 2012-12-04 | 2015-07-30 | Samsung Electronics Co Ltd | Audio providing apparatus and audio providing method |
US9905231B2 (en) | 2013-04-27 | 2018-02-27 | Intellectual Discovery Co., Ltd. | Audio signal processing method |
US9769586B2 (en) | 2013-05-29 | 2017-09-19 | Qualcomm Incorporated | Performing order reduction with respect to higher order ambisonic coefficients |
PL3429233T3 (en) | 2013-07-30 | 2020-11-16 | Dts, Inc. | Matrix decoder with constant-power pairwise panning |
JP2015103881A (en) * | 2013-11-21 | 2015-06-04 | ソニー株式会社 | Audio signal processing device and audio signal processing method |
US9552819B2 (en) | 2013-11-27 | 2017-01-24 | Dts, Inc. | Multiplet-based matrix mixing for high-channel count multichannel audio |
US9489955B2 (en) | 2014-01-30 | 2016-11-08 | Qualcomm Incorporated | Indicating frame parameter reusability for coding vectors |
US9922656B2 (en) | 2014-01-30 | 2018-03-20 | Qualcomm Incorporated | Transitioning of ambient higher-order ambisonic coefficients |
US9852737B2 (en) | 2014-05-16 | 2017-12-26 | Qualcomm Incorporated | Coding vectors decomposed from higher-order ambisonics audio signals |
US10770087B2 (en) | 2014-05-16 | 2020-09-08 | Qualcomm Incorporated | Selecting codebooks for coding vectors decomposed from higher-order ambisonic audio signals |
US9747910B2 (en) | 2014-09-26 | 2017-08-29 | Qualcomm Incorporated | Switching between predictive and non-predictive quantization techniques in a higher order ambisonics (HOA) framework |
US9451355B1 (en) | 2015-03-31 | 2016-09-20 | Bose Corporation | Directional acoustic device |
US10057701B2 (en) | 2015-03-31 | 2018-08-21 | Bose Corporation | Method of manufacturing a loudspeaker |
CN105101011B (en) * | 2015-05-29 | 2018-05-25 | 福州瑞芯微电子股份有限公司 | Audio output control method and device |
RU2729603C2 (en) | 2015-09-25 | 2020-08-11 | Войсэйдж Корпорейшн | Method and system for encoding a stereo audio signal using primary channel encoding parameters for encoding a secondary channel |
KR101724320B1 (en) * | 2015-12-14 | 2017-04-10 | 광주과학기술원 | Method for Generating Surround Channel Audio |
DE102016202166A1 (en) | 2016-02-12 | 2017-08-17 | Bayerische Motoren Werke Aktiengesellschaft | Seating-optimized entertainment reproduction for autonomous driving |
US9916822B1 (en) * | 2016-10-07 | 2018-03-13 | Gopro, Inc. | Systems and methods for audio remixing using repeated segments |
CN114898761A (en) * | 2017-08-10 | 2022-08-12 | 华为技术有限公司 | Stereo signal coding and decoding method and device |
WO2019076739A1 (en) * | 2017-10-16 | 2019-04-25 | Sony Europe Limited | Audio processing |
EP3742762B1 (en) * | 2018-01-19 | 2022-10-26 | JVCKenwood Corporation | Reproducing device, reproducing method, and in-vehicle loudspeaker system |
US10904690B1 (en) * | 2019-12-15 | 2021-01-26 | Nuvoton Technology Corporation | Energy and phase correlated audio channels mixer |
Family Cites Families (17)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
GB1402320A (en) * | 1971-10-25 | 1975-08-06 | Sansui Electric Co | Decoder for use in 4-2-4 matrix playback system |
US4819269A (en) * | 1987-07-21 | 1989-04-04 | Hughes Aircraft Company | Extended imaging split mode loudspeaker system |
JP3108087B2 (en) * | 1990-10-29 | 2000-11-13 | パイオニア株式会社 | Sound field correction device |
GB9103207D0 (en) * | 1991-02-15 | 1991-04-03 | Gerzon Michael A | Stereophonic sound reproduction system |
US5757927A (en) * | 1992-03-02 | 1998-05-26 | Trifield Productions Ltd. | Surround sound apparatus |
US5610986A (en) * | 1994-03-07 | 1997-03-11 | Miles; Michael T. | Linear-matrix audio-imaging system and image analyzer |
US5870480A (en) * | 1996-07-19 | 1999-02-09 | Lexicon | Multichannel active matrix encoder and decoder with maximum lateral separation |
JP4627880B2 (en) | 1997-09-16 | 2011-02-09 | ドルビー ラボラトリーズ ライセンシング コーポレイション | Using filter effects in stereo headphone devices to enhance the spatial spread of sound sources around the listener |
US6624873B1 (en) * | 1998-05-05 | 2003-09-23 | Dolby Laboratories Licensing Corporation | Matrix-encoded surround-sound channels in a discrete digital sound format |
JP2000152396A (en) * | 1998-11-09 | 2000-05-30 | Matsushita Electric Ind Co Ltd | Method and device for converting number of voice channels |
US6760448B1 (en) * | 1999-02-05 | 2004-07-06 | Dolby Laboratories Licensing Corporation | Compatible matrix-encoded surround-sound channels in a discrete digital sound format |
EP1054575A3 (en) * | 1999-05-17 | 2002-09-18 | Bose Corporation | Directional decoding |
JP2002175097A (en) * | 2000-12-06 | 2002-06-21 | Yamaha Corp | Encoding and compressing device, and decoding and expanding device for voice signal |
US7382888B2 (en) * | 2000-12-12 | 2008-06-03 | Bose Corporation | Phase shifting audio signal combining |
WO2002063925A2 (en) * | 2001-02-07 | 2002-08-15 | Dolby Laboratories Licensing Corporation | Audio channel translation |
JP4427937B2 (en) * | 2001-10-05 | 2010-03-10 | オンキヨー株式会社 | Acoustic signal processing circuit and acoustic reproduction device |
JP4187719B2 (en) * | 2002-05-03 | 2008-11-26 | ハーマン インターナショナル インダストリーズ インコーポレイテッド | Multi-channel downmixing equipment |
-
2004
- 2004-08-31 US US10/930,659 patent/US7283634B2/en active Active
-
2005
- 2005-08-26 CN CN2005800335521A patent/CN101036414B/en active Active
- 2005-08-26 JP JP2007530176A patent/JP4866354B2/en active Active
- 2005-08-26 EP EP05793022.4A patent/EP1790195B1/en active Active
- 2005-08-26 RU RU2007111942/09A patent/RU2365063C2/en active
- 2005-08-26 EP EP11182055A patent/EP2400783A3/en not_active Withdrawn
- 2005-08-26 TR TR2007/02668T patent/TR200702668T2/en unknown
- 2005-08-26 KR KR1020077007039A patent/KR20070053305A/en not_active Application Discontinuation
- 2005-08-26 WO PCT/US2005/030471 patent/WO2006026463A2/en active Application Filing
-
2007
- 2007-02-20 IL IL181449A patent/IL181449A0/en unknown
- 2007-10-26 HK HK07111578.0A patent/HK1106387A1/en not_active IP Right Cessation
Also Published As
Publication number | Publication date |
---|---|
IL181449A0 (en) | 2007-07-04 |
TR200702668T2 (en) | 2007-09-21 |
EP1790195A2 (en) | 2007-05-30 |
US20060045291A1 (en) | 2006-03-02 |
US7283634B2 (en) | 2007-10-16 |
KR20070053305A (en) | 2007-05-23 |
RU2365063C2 (en) | 2009-08-20 |
CN101036414B (en) | 2011-09-07 |
JP4866354B2 (en) | 2012-02-01 |
WO2006026463A3 (en) | 2007-01-11 |
HK1106387A1 (en) | 2008-03-07 |
WO2006026463A2 (en) | 2006-03-09 |
JP2008512055A (en) | 2008-04-17 |
EP2400783A2 (en) | 2011-12-28 |
EP2400783A3 (en) | 2012-03-14 |
RU2007111942A (en) | 2008-10-10 |
WO2006026463B1 (en) | 2007-03-29 |
CN101036414A (en) | 2007-09-12 |
EP1790195A4 (en) | 2010-11-17 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP1790195B1 (en) | Method of mixing audio channels using correlated outputs | |
US7630500B1 (en) | Spatial disassembly processor | |
EP0966865B1 (en) | Multidirectional audio decoding | |
US7974425B2 (en) | Sound system and method of sound reproduction | |
KR101167052B1 (en) | Bass management systems | |
US6870933B2 (en) | Stereo audio processing device for deriving auxiliary audio signals, such as direction sensing and center signals | |
US6504933B1 (en) | Three-dimensional sound system and method using head related transfer function | |
KR102195586B1 (en) | Multi-channel subband spatial processing technique for loudspeakers | |
US5844993A (en) | Surround signal processing apparatus | |
JP2004507904A (en) | 5-2-5 matrix encoder and decoder system | |
US7443987B2 (en) | Discrete surround audio system for home and automotive listening | |
US9913036B2 (en) | Apparatus and method and computer program for generating a stereo output signal for providing additional output channels | |
JP2003523675A (en) | Multi-channel sound reproduction system for stereophonic sound signals | |
JP2009272849A (en) | Surround generator | |
JP2007228033A (en) | Surround generator | |
TWI305706B (en) | Audio mixer,audio system,and method of mixing audio channels | |
Choi et al. | A new digital surround processing system for general A/V sources | |
Benjamin et al. | Next Generation Automotive Sound Research and Technologies | |
JPH06335095A (en) | Acoustic reproducing device | |
JP2013126116A (en) | Audio device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20070329 |
|
AK | Designated contracting states |
Kind code of ref document: A2 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR |
|
AX | Request for extension of the european patent |
Extension state: AL BA HR MK YU |
|
DAX | Request for extension of the european patent (deleted) | ||
A4 | Supplementary search report drawn up and despatched |
Effective date: 20101018 |
|
RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: DTS, INC. |
|
17Q | First examination report despatched |
Effective date: 20140515 |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
INTG | Intention to grant announced |
Effective date: 20150519 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 758479 Country of ref document: AT Kind code of ref document: T Effective date: 20151115 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602005047798 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: FP |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 758479 Country of ref document: AT Kind code of ref document: T Effective date: 20151028 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160228 Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151028 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151028 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151028 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160229 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151028 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151028 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151028 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151028 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151028 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160129 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151028 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602005047798 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 12 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151028 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151028 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151028 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151028 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
26N | No opposition filed |
Effective date: 20160729 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151028 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151028 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151028 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20160831 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20160831 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 13 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20160826 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20050826 Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151028 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151028 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151028 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 14 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: NL Payment date: 20230825 Year of fee payment: 19 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: IE Payment date: 20230818 Year of fee payment: 19 Ref country code: GB Payment date: 20230822 Year of fee payment: 19 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20230824 Year of fee payment: 19 Ref country code: DE Payment date: 20230828 Year of fee payment: 19 |