CN101516055A - Method and device capable of simulating three-dimensional echo sound effect in different acoustic environments - Google Patents
Method and device capable of simulating three-dimensional echo sound effect in different acoustic environments Download PDFInfo
- Publication number
- CN101516055A CN101516055A CNA2008100577704A CN200810057770A CN101516055A CN 101516055 A CN101516055 A CN 101516055A CN A2008100577704 A CNA2008100577704 A CN A2008100577704A CN 200810057770 A CN200810057770 A CN 200810057770A CN 101516055 A CN101516055 A CN 101516055A
- Authority
- CN
- China
- Prior art keywords
- equipment
- parameter
- output
- frequency
- sound effect
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Stereophonic System (AREA)
Abstract
The invention relates to a method and a device capable of simulating three-dimensional echo sound effect in different acoustic environments. A new model is established by the three-dimensional echo sound effect method according to a human body auditory subjective perception principle. Different sound environments can be reproduced by adjusting design parameters in the model. The embodiment of the invention is based on the following two discoveries: 1) three-dimensional surrounding influences the echo effect of sounds; and 2) a low-pass filter and a comb filter are used together so that audio signals with different frequencies have different decay times. The three-dimensional echo sound effect method not only is convenient to implement, but also can reproduce an actual echo environment efficiently.
Description
Technical field
The present invention is devoted to seek to set up the echo sound effect of alternative sounds environment, is intended to improve the subjective audio quality of handheld device sound system.
Traditional three-dimensional echo sound effect as shown in Figure 1, uses the echo environment of parallel comb filter group simulation multiple spot reflection, uses serial all-pass filter group to obtain the time-domain response of temporary impact and smooth frequency domain response.
According to said method, traditional three-dimensional echo technology supposes that all audio signals in any frequency range have identical die-away time.In addition, traditional three-dimensional echo technology does not consider that three-dimensional ring rings the influence to echo yet.Thereby this method can not provide model accurately for real acoustic environment, also can't reproduce the three-dimensional echo effect of high-quality.
More particularly, as shown in Figure 1, conventional three-dimensional echo technology 100 comprises parallel comb filter group 110, signal mixer 120 and serial all-pass filter group 130.Can simulate the sound reflection effect of different distance by the delay parameter of regulating comb filter; The time-domain response that delay parameter by regulating all-pass filter and gain parameter can be obtained different temporary impacts.
If a kind of three-dimensional echo method or equipment are practical, it should possess: (1) is simple: because this method will be used for consumer-elcetronics devices, as mobile phone, PDA etc.; (2) accurate: because this method must be built real echo environment realistically again.Still there is not at present available like this three-dimensional echo method and apparatus.
The present invention relates to a kind of method and apparatus that can simulate Echo under the different acoustic environments, relate in particular to the method and apparatus that can strengthen the handheld device audio.
Summary of the invention
This present invention's first target provides a kind of three-dimensional echo sound effect method and apparatus that can simulate various audible environments.
Second target of the present invention provides a kind of any consumer-elcetronics devices that is applicable to, as mobile phone, PDA etc., and can effectively rebuild suitable all-environment three-dimensional echo sound effect method and apparatus.
The 3rd target of the present invention is under the condition that does not need a large amount of system resources, comprises CPU and memory, and a kind of all-environment three-dimensional echo method and apparatus that is applicable to accurately can be provided.
The example principle according to the present invention by the three-dimensional echo engine is provided, with its wideest form that contains, based on given acoustic environment, is determined the parameter of echo model, to realize above-mentioned target.
The audio signal utilization filtering technique that example of the present invention will import into is divided into two frequency bands of low frequency and high frequency.Cut-off frequency is determined according to the different target simulated environment.Amplitude is around being applied to low-frequency audio signal, and ring retard is around being applied to high-frequency audio signal.Low-frequency audio signal and high-frequency audio signal around output be imported into parallel correction comb filter group with simulation the echo of difference, and make the signal of different frequency have the different echo attenuation time.Afterwards, with the output weighted superposition of comb filter group, and be input to serial all-pass filter group to obtain the time-domain response of temporary impact.Through the delayed output weighted superposition of handling back and all-pass filter group and is input in loud speaker or the earphone as final audio signal with the enhancing Echo around the audio signal of handling.
Three-dimensional echo sound effect technology of the present invention can pin-point accuracy simulation three-dimensional echo effect be because, this method has been considered following two factors when setting up the model of human auditory system's subjective perception: (1) human auditory system is very responsive to echo around audio; (2) human auditory system has the different signal attenuation time when receiving low frequency with the high-frequency sound signal.
Because the present invention uses the pcm audio signal, thus can be applicable to any audio frequency and encoding and decoding speech standard, so that the three-dimensional echo sound effect that is applicable under the varying environment to be provided.
Description of drawings
The fundamental diagram of Fig. 1 conventional three-dimensional echo sound effect method;
The fundamental diagram of Fig. 2 all-pass filter;
The fundamental diagram of Fig. 3 three-dimensional echo sound effect method of the present invention;
The fundamental diagram of the correction comb filter of Fig. 4 embedding low pass filter used herein.
Embodiment
As shown in Figure 3, the present invention realizes by the three-dimensional echo engine, is applicable to any consumer-elcetronics devices.Three-dimensional echo engine 3 00 is by high pass filter 310, ring retard is around estimation device 315, low pass filter 320, amplitude is around estimation device 325, and blender 330 walks abreast and revises comb filter group 340, blender 345, serial all-pass filter group 350, delay estimator 360 and blender 370 formed. different with traditional three-dimensional echo technology, three-dimensional echo technology of the present invention to low-frequency audio signal and high-frequency audio signal use respectively amplitude around with ring retard around.
The low pass filter that is embedded into comb filter produces different die-away times at different frequency range to audio signal.Blender 440 and 450, delay estimator 460 and gain estimation device a form low pass filter jointly, and estimate that with blender 410 and 430, delay estimator 420 and gain device g constitutes the comb filter of correction, as shown in Figure 4.Gain parameter g and a, delay parameter M is determined by the concrete environment of modeling.All-pass filter shown in Figure 2 is determined by gain parameter g and delay parameter m.These two parameters are determined by the echo environment of being simulated.Therefore, three-dimensional echo method of the present invention is more more accurate than conventional method.
In order to understand three-dimensional echo sound effect technology of the present invention, be necessary to understand earlier some basic principles of some three-dimensional echo sound effects.Good echo sound effect model can be simulated different echo environment by changing perceptual parameters.One cover can provide the independent parameter group of echo qualitative character to be divided three classes fully:
1. with frequency spectrum, sound source energy and the early stage relevant sound source perceptual parameters of echo energy
● intensity of sound: determine by the sound source energy and the ratio of early stage sound source energy.
● the tone color lightness: the variation by the echo energy HFS is determined
● the tone color soften: the variation of low frequency part is determined by die-away time.
2. the perceptual parameters of sound source and environmental interaction
● echo envelope line: determine by the sound source energy;
● environment reproduces: determined by echo energy;
● echo intensity: determine the die-away time by the environmental impact response.
3. environment sensing parameter
● back echo intensity: determine the back die-away time by the environmental impact response;
● the stress effect: the variation of low frequency part is determined by die-away time;
● vivid effect: the variation of HFS is determined by die-away time.
In model, simulate different audible environments by controlling these parameters.When sound source was play, some parameters were perceived as the rich of tone color, and some other parameters are perceived from lingering sound.Echo intensity is an important environmental parameter, and its value depends on the frequency spectrum distribution characteristics of sound source, and for example, this parameter is got smaller value for voice signal (spectrum distribution is narrow), and music signal (spectrum distribution is wide) is got high value.The target of echo sound effect is being received of making that voice signal can be comfortable rather than undue strong.Yet traditional three-dimensional echo method is not considered these factors in model.
Good three-dimensional echo sound effect method should be able to be built sound source echo accurately and efficiently again in three dimensions.Three-dimensional echo sound effect technology of the present invention realizes design object through the following steps: the audio signal that (1) will be imported into is divided into high frequency band and low band audio signal; (2) high band audio signal is used the amplitude loop technique, to low band audio signal application delay loop technique; (3) use the parallel comb filter group audio signal that is embedded with low pass filter so that the audio signal of different frequency bands realizes the differential declines time; 4) input serial type all-pass filter group responds to obtain temporary impact after the output weighted superposition of comb filter; 5) by after the delayed again processing of audio signal of surrounding, with the output weighted superposition of all-pass filter group to obtain more excellent Echo.The comb filter group of surrounding, correction and the parameter of all-pass filter group are by the characteristic decision of the concrete environment of being simulated.
The insider should be as can be seen, and the primary and foremost purpose of invention three-dimensional echo sound effect is the virtual three-dimensional echo sound effect of building again under the varying environment.Because the design of entire method is all based on human auditory system's subjective sensation, so three-dimensional echo sound effect method of the present invention can vividly be reproduced real three-dimensional echo sound effect scene.
Because three-dimensional echo sound effect example of the present invention does not need special hardware supports, only can realize its function, but not get rid of special hardware implementation mode, so this technology can easily be applied on the consumption electronic product of any kind by software, as mobile phone, PDA etc.In addition, the present invention can be used for any audio frequency and encoding and decoding speech system, as AAC, and AAC+, MP3, WMA, RA, AMR etc.
The front has very described the technology that the present invention submitted in detail, make the insider can understand and use the present invention, but, what also will draw attention to is, under the prerequisite that does not depart from essence of the present invention, can also change and improve the technological invention of being submitted to, and the present invention be subjected to the restriction of above explanation or accompanying drawing, but limited according to claims.
Claims (10)
1. can simulate the three-dimensional echo sound effect method of various acoustic environments, form by following steps:
A. the audio signal with input is divided into two frequency-domain segment, and low-frequency range is carried out amplitude around processing, and high band is carried out ring retard around processing;
B. the output of step a is handled by parallel correction comb filter group;
C. serial all-pass filter group being imported in the output of step b after weighted superposition handles;
D. after the output weighted superposition of the step a of the output of step c and delayed processing, the input sound system is as loud speaker or earphone.
2. the method for claim 1, wherein step a also comprises and determines cut-off frequency audio signal being separated into high and low frequency range, with based on the ring retard of different simulated environments around parameter and amplitude determining around parameter.
3. the method for claim 1, wherein step b also comprises the parameter of determining to revise comb filter according to the concrete acoustic environment of being simulated.
4. the method for claim 1, wherein step c also comprises the parameter of determining all-pass filter according to the concrete acoustic environment of being simulated.
5. the method for claim 1, wherein steps d also comprises the delay parameter according to the concrete acoustic environment determining step a output of being simulated.
6. the device that is suitable for the three-dimensional echo sound effect method of various acoustic environments comprises following equipment:
A. one is separated into two frequency-domain segment with input audio signal, and low frequency signal is carried out amplitude around processing, and high-frequency signal is carried out ring retard around the equipment of handling;
B. one overlaps the parallel correction comb filter group equipment of treatment facility a output signal;
C. a cover is handled the serial all-pass filter group equipment through the equipment b of weighted superposition output signal;
D. a cover output of equipment a is postponed to handle and with the output weighted superposition of equipment c after import sound system, as loud speaker or earphone, equipment.
7. as equipment as described in the claim 6, equipment b also comprises the cut-off frequency of determining separating audio signals and based on the delay of the concrete environment of simulate and the amplitude unit around parameter.
8. as equipment as described in the claim 6, equipment b also comprises the unit of determining according to the definite correction of the concrete environment of simulate comb filter parameter.
9. equipment described in claim 6, equipment c also comprises according to the simulate unit that concrete environment is determined the all-pass wave filtering parameter.
10. equipment described in claim 6, equipment d also comprise the unit according to the simulate delay parameter of concrete environment determining step a output.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2008100577704A CN101516055B (en) | 2008-02-18 | 2008-02-18 | Method and device capable of simulating three-dimensional echo sound effect in different acoustic environments |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2008100577704A CN101516055B (en) | 2008-02-18 | 2008-02-18 | Method and device capable of simulating three-dimensional echo sound effect in different acoustic environments |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101516055A true CN101516055A (en) | 2009-08-26 |
| CN101516055B CN101516055B (en) | 2010-06-09 |
Family
ID=41040302
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2008100577704A Expired - Fee Related CN101516055B (en) | 2008-02-18 | 2008-02-18 | Method and device capable of simulating three-dimensional echo sound effect in different acoustic environments |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101516055B (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102523553A (en) * | 2012-01-29 | 2012-06-27 | 昊迪移通(北京)技术有限公司 | Holographic audio method and device for mobile terminal equipment based on sound source contents |
| CN102597946A (en) * | 2009-11-17 | 2012-07-18 | 高通股份有限公司 | System and method of providing three dimensional sound at a wireless device |
| CN104952455B (en) * | 2015-06-19 | 2019-03-15 | 珠海市杰理科技股份有限公司 | The method and apparatus for realizing reverberation |
| WO2021008350A1 (en) * | 2019-07-12 | 2021-01-21 | 深圳创维－Rgb电子有限公司 | Audio playback method and apparatus and computer readable storage medium |
| CN112789869A (en) * | 2018-11-19 | 2021-05-11 | 深圳市欢太科技有限公司 | Method and device for realizing three-dimensional sound effect, storage medium and electronic equipment |
| CN113852893A (en) * | 2020-06-28 | 2021-12-28 | 北京小米移动软件有限公司 | Data processing method and device, terminal and storage medium |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1216511C (en) * | 2000-07-31 | 2005-08-24 | 凌阳科技股份有限公司 | Processing circuit unit for stereo surrounding acoustic effect |
| JP2005223714A (en) * | 2004-02-06 | 2005-08-18 | Sony Corp | Acoustic reproducing apparatus, acoustic reproducing method and recording medium |
| CN1589066A (en) * | 2004-09-03 | 2005-03-02 | 威盛电子股份有限公司 | Method and relative device for producing echo effect |
-
2008
- 2008-02-18 CN CN2008100577704A patent/CN101516055B/en not_active Expired - Fee Related
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102597946A (en) * | 2009-11-17 | 2012-07-18 | 高通股份有限公司 | System and method of providing three dimensional sound at a wireless device |
| CN102523553A (en) * | 2012-01-29 | 2012-06-27 | 昊迪移通(北京)技术有限公司 | Holographic audio method and device for mobile terminal equipment based on sound source contents |
| CN102523553B (en) * | 2012-01-29 | 2014-02-19 | 昊迪移通(北京)技术有限公司 | Holographic audio method and device for mobile terminal equipment based on sound source contents |
| CN104952455B (en) * | 2015-06-19 | 2019-03-15 | 珠海市杰理科技股份有限公司 | The method and apparatus for realizing reverberation |
| CN112789869A (en) * | 2018-11-19 | 2021-05-11 | 深圳市欢太科技有限公司 | Method and device for realizing three-dimensional sound effect, storage medium and electronic equipment |
| CN112789869B (en) * | 2018-11-19 | 2022-05-17 | 深圳市欢太科技有限公司 | Method and device for realizing three-dimensional sound effect, storage medium and electronic equipment |
| WO2021008350A1 (en) * | 2019-07-12 | 2021-01-21 | 深圳创维－Rgb电子有限公司 | Audio playback method and apparatus and computer readable storage medium |
| CN113852893A (en) * | 2020-06-28 | 2021-12-28 | 北京小米移动软件有限公司 | Data processing method and device, terminal and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101516055B (en) | 2010-06-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101483797B (en) | Head-related transfer function generation method and apparatus for earphone acoustic system | |
| McCarthy | Sound systems: design and optimization: modern techniques and tools for sound system design and alignment | |
| CN110972053B (en) | Method and related apparatus for constructing a listening scene | |
| CN105874820B (en) | Binaural audio is produced by using at least one feedback delay network in response to multi-channel audio | |
| CN101516055B (en) | Method and device capable of simulating three-dimensional echo sound effect in different acoustic environments | |
| CN106572419B (en) | A kind of stereo audio enhancing system | |
| CN1816224B (en) | Apparatus for implementing 3-dimensional virtual sound and method thereof | |
| JP2017522771A (en) | Determine and use room-optimized transfer functions | |
| CN105900457A (en) | Methods and systems for designing and applying numerically optimized binaural room impulse responses | |
| CN109658935B (en) | Method and system for generating multi-channel noisy speech | |
| CN101902679A (en) | Processing method for simulating 5.1 sound-channel sound signal with stereo sound signal | |
| CN106535076A (en) | Spatial calibration method of stereo system and mobile terminal device thereof | |
| CN102354500A (en) | Virtual bass boosting method based on harmonic control | |
| CN101155440A (en) | Three-dimensional around sound effect technology aiming at double-track audio signal | |
| CN105657609A (en) | Method and device for playing control of bone conduction headsets and bone conduction headset equipment | |
| US20120101609A1 (en) | Audio Auditioning Device | |
| CN106875953A (en) | Simulation remixed audio processing method and system | |
| CN111312281B (en) | Touch vibration implementation method | |
| CN101184349A (en) | Three-dimensional ring sound effect technique aimed at dual-track earphone equipment | |
| CN106465032B (en) | The apparatus and method for manipulating input audio signal | |
| CN102802111B (en) | A kind of method and system for exporting surround sound | |
| CN102523553B (en) | Holographic audio method and device for mobile terminal equipment based on sound source contents | |
| CN102903367A (en) | Method and device for balancing frequency response of off-line iterative sound playback system | |
| Neal | Investigating the sense of listener envelopment in concert halls using third-order Ambisonic reproduction over a loudspeaker array and a hybrid room acoustics simulation method | |
| CN115604630A (en) | Sound field expansion method, audio apparatus, and computer-readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| C56 | Change in the name or address of the patentee | ||
| CP02 | Change in the address of a patent holder |
Address after: 100078 Beijing City, Fengtai District Fangzhuang Fangguyuan two District 13 Building 1206 room Co-patentee after: Gao Chengwei Patentee after: Wudi Yitong (Beijing) Technology Co., Ltd. Address before: 100084 room 409, building A, comprehensive research building, Tsinghua University, Beijing, Haidian District Co-patentee before: Gao Chengwei Patentee before: Wudi Yitong (Beijing) Technology Co., Ltd. |
|
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20100609 Termination date: 20170218 |