CN100364367C - Dynamic 3D stereo effect processing system - Google Patents

Dynamic 3D stereo effect processing system Download PDF

Info

Publication number
CN100364367C
CN100364367C CNB2005100349973A CN200510034997A CN100364367C CN 100364367 C CN100364367 C CN 100364367C CN B2005100349973 A CNB2005100349973 A CN B2005100349973A CN 200510034997 A CN200510034997 A CN 200510034997A CN 100364367 C CN100364367 C CN 100364367C
Authority
CN
China
Prior art keywords
sound
unit
dynamic
signal
audio signal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CNB2005100349973A
Other languages
Chinese (zh)
Other versions
CN1703117A (en
Inventor
罗发龙
胡胜发
万享
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Ankai Microelectronics Co.,Ltd.
Original Assignee
ANKAI (GUANGZHOU) SOFTWARE TECHN Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ANKAI (GUANGZHOU) SOFTWARE TECHN Co Ltd filed Critical ANKAI (GUANGZHOU) SOFTWARE TECHN Co Ltd
Priority to CNB2005100349973A priority Critical patent/CN100364367C/en
Publication of CN1703117A publication Critical patent/CN1703117A/en
Application granted granted Critical
Publication of CN100364367C publication Critical patent/CN100364367C/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Stereophonic System (AREA)

Abstract

The present invention discloses a dynamic 3D circulating stereo effect processing system which comprises a multi-band-pass filtering unit, a sound element separating unit, a main sound element distributing unit, a double-ear filtering unit, two sound assembling units and an automatic adapting sound intensity control unit. After the left path input and the right path input of double-sound-channel audio frequencies are orderly processed by the units, the audio frequencies can be outputted to the earphone for being played with abundant and vivid stereo effects of 3D sound effects, dynamic circumambience, etc.

Description

Dynamic 3 D stereo effect processing system
Technical field
The present invention relates to a kind of stereophone treatment system, especially relate to a kind of dynamic 3 D stereo effect processing system.
Background technology
Have the stereosonic sound effect system of surrounding can to the user bring as experience in the actual life experience, sound can transmit Anywhere from three-dimensional.The surrounding sound effect normally leans on multitrack recording (a plurality of Mike) and multichannel broadcast (a plurality of loudspeaker) to finish, owing to be easy at a plurality of loudspeaker of indoor layout, surround sound has become the key character of cinema even home theater.Progress along with audio signal processing technique, surround sound can be recorded and encodes with multichannel, only appreciate with two loudspeaker or common earphone, these technology have been used psychoacoustic principle (interaural time difference IDT and two ear amount difference ILD) to two sound channels, make the audience feel sound from around all directions.In other words, produce virtual surround sound exactly.Though virtual surround sound can bring good 3-D audio to the audience be not as true to nature as the result of broadcast of a plurality of loudspeaker.Virtual in addition surround sound requirement audience is fixed on the optimum position (1 meter distance) between two loudspeaker, and this normally to the restriction of TV or PC, does not then have this constraint to using earphone.
Though above-mentioned technology both can be that a plurality of loudspeaker also can be two loudspeaker when playing, requiring usually must be multichannel when recording and encode.But in the time of many, the recording that we play on hand has only monophony or dual track when recording, and plays the recording of having only monophony or dual track with above-mentioned virtual ring around sterophonic technique, does not just have three-dimensional stereo audio.
Summary of the invention
The purpose of this invention is to provide the dynamic 3 D stereo effect processing system that a kind of complexity is low, effect is strong, can make the sound of recording based on monophony or dual track also can produce 3 D stereo effect, suitable with the effect of recording by multichannel.
The object of the invention can realize by following technical measures: dynamic 3 D stereo effect processing system comprises
Be used for each wave band input audio signal is carried out pretreated many bandpass filterings unit;
Be used for the sound component separation unit that the main sound of separation and Extraction corresponding each wave band behind the multi-bandpass filter unit becomes sub-signal;
Be used for the main sound composition signal allocation of separation and Extraction to other signal remains unchanged around the different virtual location of sphere main sound composition allocation units;
Be used for the sound that is positioned at around spherical each different virtual position above-mentioned and the ears filter unit that carries out filtering according to its virtual location with respect to the Frequency Response that the azimuth and the elevation angle determined of hearer's head;
Be used for the two-way audio signal of ears filter unit output and original stereosonic two the sound assembled units of the combined formation surrounding of input audio signal.
Because through above-mentioned processing procedure, its output signal strength can be tending towards saturated and can hear some noises, therefore, the present invention also comprises the self adaptation intensity of sound control unit that is used to limit two sound assembled unit output signal strengths.
The present invention is provided with the gain unit that is used to amplify original input audio signal between above-mentioned original input audio signal and corresponding each sound assembled unit.
The present invention is provided with the gain unit that is used to amplify through the pretreated audio signal of bandpass filtering between many bandpass filterings unit and corresponding each sound assembled unit.
Since assigning process is a simulation multichannel surround sound record in these main sound compositions be in effect on the diverse location; Same main sound composition can be assigned to the different virtual position simultaneously, dynamic assignment can be carried out on room and time simultaneously, the space dynamic assignment means that the virtual location of signal can appear at any locus around hearer's head, and the time dynamic assignment means that these virtual locations can change in time.The ears filter unit can be to the above-mentioned sound that is positioned at around spherical each different virtual position, and carry out filtering according to its virtual location with respect to the Frequency Response that the azimuth and the elevation angle determined of hearer's head.Therefore, the present invention does not write down the 3-D audio of bringing enhancing around monophony or dual-channel audio with three-dimensional information in the time of recording for those effectively, dynamically around enriching vivid effect with virtual source of sound motion etc.
Description of drawings
Fig. 1 is the processing block diagram of the present invention to the dual-channel audio input;
Fig. 2 is the processing block diagram of the present invention to the monophonic audio input;
Fig. 3 handles block diagram for the present invention to the another kind of dual-channel audio input;
Fig. 4 handles block diagram for the present invention to the another kind of monophonic audio input.
Embodiment
As shown in Figure 1, system of the present invention comprises bandpass filtering unit more than two, sound component separation unit, main sound composition allocation units, ears filter unit, two sound assembled units and self adaptation intensity of sound control unit, the left and right sides two-way input of dual-channel audio is successively after above-mentioned each component units is handled, can make to output to earphone and play and to have 3-D audio, dynamically enrich stereoeffect true to nature around waiting.For can adjust dynamically around degree and three-dimensional effect, between the original input audio signal of left and right sides two-way and corresponding each sound assembled unit, connect a gain unit that is used to amplify original input audio signal, by regulating gain, realize dynamically around degree and the adjusting of three-dimensional effect.
Many bandpass filterings unit among the figure is as a kind of preliminary treatment, and input signal will pass through predefined many bandpass filterings earlier, and the number of filter depends on the sample frequency that system supports.Monophonic audio needs the band pass filter of two wave bands at least, and dual-channel audio needs the band pass filter of three wave bands at least.The present invention supports various sample frequencys such as 96K, 48K, and 44.1K and 32K etc., to different sample frequencys, the number of multi-bandpass filter all is different with Frequency Response, the transforming function transformation function during corresponding ears filter unit is below handled also can be different.Filter can be IIR or FIR, and the exponent number of IIR and the progression of FIR can average out between its performance, speed and complexity; For simplified system realizes, the IIR serial connection on available several 2 rank is to substitute a plurality of FIR cascades or high-order IIR.
Sound component separation unit mainly is to utilize the sound source sorting technique, separates main sound composition such as chanteur's the sound and the sound of various musical instruments, and they have synthesized the audio signal of monophony and dual track just.To with corresponding each frequency range of predetermined multi-bandpass filter, have at least a main sound to become branch to be extracted out. this lock out operation can use at the output of each multi-bandpass filter, in other words, the design of multi-bandpass filter (frequency response, number) is depended on has the main sound composition of how many kinds of to extract.
Main sound composition allocation units are finished the signal allocation corresponding to main sound composition are arrived around the different orientations of sphere and the virtual location at the elevation angle, as simulate the broadcast of five loudspeaker, virtual location can be forwardly about 45 degree, about the rear 45 degree and directly over, and other signal remains unchanged.This assigning process is that these main sound compositions were in effect on the diverse location during simulation multichannel surround sound was recorded.Same main sound composition can be assigned to the different virtual position simultaneously, dynamic assignment can be carried out on room and time simultaneously, the space dynamic assignment means that the virtual location of signal can appear at any locus around hearer's head, and the time dynamic assignment means that these virtual locations can change in time.Certainly also may some virtual locations be fixed and other are changing, in other words, on some positions, have at least a kind of sound to be dispensed on the there.A kind of sound composition also can be assigned to one or be assigned to simultaneously on a plurality of virtual locations, to the different virtual position, can obtain well to expand the territory audio by same sound component distributing.But this is the cost that increases to computation complexity, each ears filter with different Frequency Responses can be handled the sound composition of diverse location simultaneously, its output can be synthesized earlier, such as weighted accumulation, and then hand over next step to synthesize and handle, certainly, these outputs also can be directly and other signal synthesize.
The ears filter unit is used for the sound that is positioned at around spherical each different virtual position above-mentioned, and carries out filtering according to its virtual location with respect to the Frequency Response that the azimuth and the elevation angle determined of hearer's head.Two sound assembled units are used for the two-way audio signal of ears filter unit output and the original combined formation surrounding of input audio signal stereo.Filtering realizes with synthetic ITD that all is based on simulation multichannel on the dual track and ILT technology.Filter can be IIR or FIR, and the exponent number of IIR and the progression of FIR can average out between its performance, speed and complexity; For simplified system realizes, the IIR serial connection on available several 2 rank is to substitute a plurality of FIR cascades or high-order IIR.
Through above-mentioned processing procedure, its output signal strength can be tending towards saturated and can hear some noises.Therefore, must the intensity of two sound assembled unit output signals be limited, follow the tracks of the external envelope of output signal after the above-mentioned processing adaptively by self adaptation intensity of sound control unit, reach level and smooth and reduce and handle the noise that brings because of the 3 D stereo sound effect; Because output signal is generally stereo, can handle respectively left and right acoustic channels.
As shown in Figure 3, the another kind of dual-channel audio input is handled situation.For can more selective and more flexible adjustment dynamically around degree and three-dimensional effect, between many bandpass filterings unit and each sound assembled unit, be connected the gain unit that is used to amplify through the pretreated audio signal of bandpass filtering.Sound assembled unit output the possibility of result is to be combined by the result of ears Filtering Processing and the output of original input signal or multi-bandpass filter.Because not only one of the virtual location that works simultaneously, add the output of ears filtering in addition etc., the input of synthetic processing procedure will be more than 3, the simplest implementation procedure is weighted accumulation to input signal exactly, the signal of these weight coefficients (gain) all should be less than 1, and gain is that the corresponding signal of 0 expression is skipped.
As Fig. 2 with Figure 4 shows that two kinds of monophonic audio input handle situations, only be the input of monophonic audio with the difference shown in above-mentioned Fig. 1 and Fig. 3.The also available I-Q orthogonal transform of monophonic input signal is produced the signal of two sound channels, then it is adopted processing situation among Fig. 1 and 3 as left and right acoustic channels, reach same effect.
Monophony among above-mentioned each figure after system handles of the present invention or dual-channel audio are to output to earphone to play.Equally also can play on two loudspeaker, in this case, the Frequency Response of ears filter unit not only depends on the azimuth and the elevation angle, also depends on the distance between hearer and loudspeaker, and the hearer preferably stands in optimum between two loudspeaker (1 meter distance).
The present invention can accept various forms such as MP3, WMA, MIDI, Digital Television, digital broadcasting and internet audio or the like of monophony and dual track.

Claims (4)

1. dynamic 3 D stereo effect processing system is characterized in that comprising:
Be used for each wave band input audio signal is carried out the pretreated many bandpass filterings of many bandpass filterings unit;
Be used for the sound component separation unit that the main sound of separation and Extraction corresponding each wave band behind the multi-bandpass filter unit becomes sub-signal;
Be used for the main sound composition signal allocation of separation and Extraction to other signal remains unchanged around the different virtual location of sphere main sound composition allocation units;
Be used for the sound that is positioned at around spherical each different virtual position above-mentioned and the ears filter unit that carries out filtering according to its virtual location with respect to the Frequency Response that the azimuth and the elevation angle determined of hearer's head;
Be used for the two-way audio signal of ears filter unit output and original stereosonic two the sound assembled units of the combined formation surrounding of input audio signal.
2. dynamic 3 D stereo effect processing system according to claim 1 is characterized in that also comprising the self adaptation intensity of sound control unit that limits two sound assembled unit output signal strengths by the external envelope of following the tracks of the output signal after handling adaptively.
3. dynamic 3 D stereo effect processing system according to claim 1 and 2 is characterized in that being provided with the gain unit that is used to amplify original input audio signal between described original input audio signal and corresponding each sound assembled unit.
4. dynamic 3 D stereo effect processing system according to claim 3 is characterized in that being provided with the gain unit that is used to amplify through the pretreated audio signal of bandpass filtering between described many bandpass filterings unit and corresponding each sound assembled unit.
CNB2005100349973A 2005-06-03 2005-06-03 Dynamic 3D stereo effect processing system Active CN100364367C (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CNB2005100349973A CN100364367C (en) 2005-06-03 2005-06-03 Dynamic 3D stereo effect processing system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CNB2005100349973A CN100364367C (en) 2005-06-03 2005-06-03 Dynamic 3D stereo effect processing system

Publications (2)

Publication Number Publication Date
CN1703117A CN1703117A (en) 2005-11-30
CN100364367C true CN100364367C (en) 2008-01-23

Family

ID=35632592

Family Applications (1)

Application Number Title Priority Date Filing Date
CNB2005100349973A Active CN100364367C (en) 2005-06-03 2005-06-03 Dynamic 3D stereo effect processing system

Country Status (1)

Country Link
CN (1) CN100364367C (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101118746B (en) * 2007-09-17 2012-03-21 腾讯科技(深圳)有限公司 Double track based audio data calibration method and multi-people voice talking system thererof
CN102883245A (en) * 2011-10-21 2013-01-16 郝立 Three-dimensional (3D) airy sound
CN103945303B (en) * 2014-04-14 2017-07-07 杨璐馨 A kind of ear effect 3D recording rings
CN105872928B (en) * 2016-04-26 2019-06-04 惠州Tcl移动通信有限公司 A kind of method and system that the virtual surround sound based on mobile terminal generates

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5528694A (en) * 1993-01-27 1996-06-18 U.S. Philips Corporation Audio signal processing arrangement for deriving a centre channel signal and also an audio visual reproduction system comprising such a processing arrangement
CN1208541A (en) * 1996-11-15 1999-02-17 菲利浦电子有限公司 A mono-stereo conversion device, an audio reproduction system using such a device and a mono-stereo conversion method
CN1256851A (en) * 1998-02-13 2000-06-14 皇家菲利浦电子有限公司 Surround sound reproduction system, sound/visual reproduction system, surround signal processing unit and method for processing input surround signal
JP2002345096A (en) * 2001-05-15 2002-11-29 Nippon Hoso Kyokai <Nhk> Diffuse sound field reproducing device
US20030053633A1 (en) * 1996-06-21 2003-03-20 Yamaha Corporation Three-dimensional sound reproducing apparatus and a three-dimensional sound reproduction method

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5528694A (en) * 1993-01-27 1996-06-18 U.S. Philips Corporation Audio signal processing arrangement for deriving a centre channel signal and also an audio visual reproduction system comprising such a processing arrangement
US20030053633A1 (en) * 1996-06-21 2003-03-20 Yamaha Corporation Three-dimensional sound reproducing apparatus and a three-dimensional sound reproduction method
CN1208541A (en) * 1996-11-15 1999-02-17 菲利浦电子有限公司 A mono-stereo conversion device, an audio reproduction system using such a device and a mono-stereo conversion method
CN1256851A (en) * 1998-02-13 2000-06-14 皇家菲利浦电子有限公司 Surround sound reproduction system, sound/visual reproduction system, surround signal processing unit and method for processing input surround signal
JP2002345096A (en) * 2001-05-15 2002-11-29 Nippon Hoso Kyokai <Nhk> Diffuse sound field reproducing device

Also Published As

Publication number Publication date
CN1703117A (en) 2005-11-30

Similar Documents

Publication Publication Date Title
EP1025743B1 (en) Utilisation of filtering effects in stereo headphone devices to enhance spatialization of source around a listener
CN102100088B (en) Apparatus and method for generating audio output signals using object based metadata
TWI532391B (en) Apparatus and method for mapping first and second input channels to at least one output channel
US7668317B2 (en) Audio post processing in DVD, DTV and other audio visual products
JP5265517B2 (en) Audio signal processing
Hacihabiboglu et al. Perceptual spatial audio recording, simulation, and rendering: An overview of spatial-audio techniques based on psychoacoustics
JP2004194315A (en) Electroacoustic transducing with low frequency emphasis device
JP2012514358A (en) Method and apparatus for encoding and optimal reproduction of a three-dimensional sound field
KR20080107422A (en) Audio encoding and decoding
CN104054126A (en) Spatial audio rendering and encoding
WO2006014449A1 (en) Audio coding/decoding
WO2006022380A1 (en) Audio reproducing system
JPH07212898A (en) Voice reproducing device
KR20180102596A (en) Synthesis of signals for immersive audio playback
WO2012094277A1 (en) Apparatus and method for a complete audio signal
WO2012163445A1 (en) Method for generating a surround audio signal from a mono/stereo audio signal
Gardner Image fusion, broadening, and displacement in sound location
MX2012002886A (en) Phase layering apparatus and method for a complete audio signal.
CN100364367C (en) Dynamic 3D stereo effect processing system
CN100539741C (en) Strengthen the audio-frequency processing method of 3-D audio
JP6236503B1 (en) Acoustic device, display device, and television receiver
CN1528105A (en) Method of generating a left modified and a right modified audio signal for a stereo system
US20240056735A1 (en) Stereo headphone psychoacoustic sound localization system and method for reconstructing stereo psychoacoustic sound signals using same
CN1244084A (en) Device and method for simulating multi-channel signals

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
C56 Change in the name or address of the patentee

Owner name: ANKAI (GUANGZHOU) MICROELECTRONICS TECHNOLOGY CO.,

Free format text: FORMER NAME: ANKAI( GUANGZHOU ) SOFTWARE TECHNOLOGY CO., LTD.

CP03 Change of name, title or address

Address after: No. 182, science Avenue, Science Town, Guangzhou hi tech Industrial Development Zone, Guangdong 301-303, 401-402, C1

Patentee after: Anyka (Guangzhou) Microelectronics Technology Co., Ltd.

Address before: Guangdong city of Guangzhou province science and Technology Park Tianhe Software Park in Gaotang New District No. 1033 building 6 high way

Patentee before: Anyka (Guangzhou) Software Technology Co., Ltd.

CP01 Change in the name or title of a patent holder
CP01 Change in the name or title of a patent holder

Address after: 510663 301-303, 401-402, area C1, 182 science Avenue, Science City, Guangzhou high tech Industrial Development Zone, Guangdong Province

Patentee after: Guangzhou Ankai Microelectronics Co.,Ltd.

Address before: 510663 301-303, 401-402, area C1, 182 science Avenue, Science City, Guangzhou high tech Industrial Development Zone, Guangdong Province

Patentee before: ANYKA (GUANGZHOU) MICROELECTRONICS TECHNOLOGY Co.,Ltd.

CP02 Change in the address of a patent holder
CP02 Change in the address of a patent holder

Address after: 510555 No. 107 Bowen Road, Huangpu District, Guangzhou, Guangdong

Patentee after: Guangzhou Ankai Microelectronics Co.,Ltd.

Address before: 510663 301-303, 401-402, area C1, 182 science Avenue, Science City, Guangzhou high tech Industrial Development Zone, Guangdong Province

Patentee before: Guangzhou Ankai Microelectronics Co.,Ltd.