CN108040317A - A kind of hybrid sense of hearing sound field broadening method - Google Patents
A kind of hybrid sense of hearing sound field broadening method Download PDFInfo
- Publication number
- CN108040317A CN108040317A CN201711428955.7A CN201711428955A CN108040317A CN 108040317 A CN108040317 A CN 108040317A CN 201711428955 A CN201711428955 A CN 201711428955A CN 108040317 A CN108040317 A CN 108040317A
- Authority
- CN
- China
- Prior art keywords
- reverberator
- signal
- sound field
- stereo
- real time
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 25
- 239000003623 enhancer Substances 0.000 claims abstract description 11
- 150000001875 compounds Chemical class 0.000 claims abstract description 5
- 230000002708 enhancing effect Effects 0.000 claims abstract description 5
- 238000001914 filtration Methods 0.000 claims abstract description 5
- 230000000694 effects Effects 0.000 claims description 10
- 238000013461 design Methods 0.000 claims description 7
- 238000012545 processing Methods 0.000 claims description 7
- 238000010606 normalization Methods 0.000 claims description 2
- 238000010586 diagram Methods 0.000 description 7
- 230000006870 function Effects 0.000 description 5
- 238000000926 separation method Methods 0.000 description 2
- 230000005236 sound signal Effects 0.000 description 2
- 230000003044 adaptive effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 235000013399 edible fruits Nutrition 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 230000007935 neutral effect Effects 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
- H04S7/30—Control circuits for electronic adaptation of the sound field
- H04S7/305—Electronic adaptation of stereophonic audio signals to reverberation of the listening space
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R3/00—Circuits for transducers, loudspeakers or microphones
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
- H04S2400/13—Aspects of volume control, not necessarily automatic, in stereophonic sound systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S2420/00—Techniques used stereophonic systems covered by H04S but not provided for in its groups
- H04S2420/01—Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Stereophonic System (AREA)
Abstract
Method is widened based on the hybrid sense of hearing sound field of stereo enhancer and reverberator the invention discloses a kind of, the described method includes：The left and right passage cross-correlation coefficient of calculating binary channels input signal, the section according to where cross-correlation coefficient in real time, judge the weight factor of stereo enhancer and reverberator；Stereo enhancing computing, introduces the difference L R of left and right channel signal, and by carrying out random movement to the phase of left and right channel signal, moving range is 45 ° to 45 °, reconstructs double-channel audio frequency signal；Reverberator computing, reverberator filtering operation is carried out by double-channel signal；By weight factor, the output signal of joint stereo booster and reverberator is calculated in real time and synthesizes binary channels compound voice.Hybrid sense of hearing sound field broadening method disclosed by the invention, can effectively expand sound field width, implement simply, applied widely.
Description
First, technical field
The present invention relates to stereo and surround sound field, a kind of mixing based on stereo enhancer and reverberator is disclosed
Formula sense of hearing sound field widens method.
2nd, background technology
With reaching its maturity for electronic consumer markets, consumer requires the sound quality of electronic product higher and higher.Respectively
Class is stereo and surround sound standard is also gradually popularized, common are 5.1 passage surround sound of Doby, QSurround surround sounds,
Dobly Atmos [G.Sergi, Knocking at the door of cinematic artifice：Dolby Atmos,
Challenges and opportunities, The New Soundtrack, 3 (2)：107-121,2013] etc..These methods
Using multiple loudspeakers, can more perfect reproduced sound-field, the auditory perception on the spot in person to audience, has obtained widely recognizing
Can, but it is expensive.
In order to better conform to the demand of consumer electronics market, twin loudspeaker is reset raises one's voice around audio technology merely with two
Device, obtains broader sound field experience.There is research and utilization artificial reverberation at present, produce the environmental acoustics information of certain space, obtain
Broader spatial hearing is taken to experience [Begault D R, Trejo L J.3-D sound for virtual reality
And multimedia [J] .2000.], by carrying out acoustic reverberation simulation to acoustic surrounding, different acoustic surroundings can be built
Different reverberation effects；Component environment information is provided by introducing double-channel signal differential signal, and with this, reduces left and right passage
Correlation, can also widen sense of hearing sound field width [Cohen J M.Stereo image separation and perimeter
enhancement：U.S.Patent 4,308,423[P].1981-12-29.].As proposed in patent CN101065989
Two loudspeaker speaker stereo extended network method, by left and right channel signal after postponing, reduce, invert, it is logical to regenerate left and right
The signal in road.Patent CN202276412U also uses similar scheme, and left and right passage is mixed and is exported, and obtains sound field broadening effect
Fruit.The target of such scheme is to amplify the difference signal of left and right passage, strengthens the environment composition of audio, to single channel signal, double
The disposal ability of channel speech signal is limited.
It is also possible to use HRTF functions, reconstruction [Begault D R, Trejo the L J.3-D sound of surround sound are carried out
for virtual reality and multimedia[J].2000.].Patent CN101212843 employs HRTF function sides
Method, carries out convolution, then by the left side in original signal around signal and right surround signal and the HRTF functions of special angle feature
Exported by the twin loudspeaker in front, there is provided a kind of sound field of boombox resets scheme.This method can provide one
Fixed stereo locating effect, but it is limited and narrow there are acoustic image to the sound field broadening effect immediately ahead of binaural signal audience
Narrow, the shortcomings that versatility is low.
Finally, Adaptive Signal Processing and the method for Signal separator can also be utilized, passes through certain constraints, separation
Principal component and context components in original double-channel signal, improve context components ratio, obtain certain sound field broadening effect, but
Higher [Irwan R, Aarts the R M.Two-to-five channel sound processing [J] of algorithm complex
.Journal of the Audio Engineering Society, 2002,50 (11)：914-926.].Such as patent
CN106170991A employs this method, and the central components in left and right acoustic channels, side component and context components are separated, adjustment master
The ratio of component, side component and context components, and eliminated by space crosstalk, improve the sound field broadening effect of audio.Patent
CN106572419A also uses similar implementation, and by a series of complex computing, left and right channel signal is decomposed into directly
Up to acoustical signal and around acoustical signal, then acoustical signal will be surround and carry out decorrelation processing, and finally obtain one group of very low left side of correlation
Right channel signal.The algorithm complex of such scheme is higher, and the cost that Practical Project is implemented is higher, and to single channel signal and language
The separating effect of sound signal is limited.
3rd, the content of the invention
For existing free space twin loudspeaker sound field reproducing device acoustic image is narrow, spatial impression is insufficient and to input sound
There is the problem of limitation in frequency species, the present invention provides the hybrid sense of hearing sound that a kind of stereo enhancer and reverberator are combined
Field broadening method.
For achieving the above object, the purpose of the present invention is achieved through the following technical solutions：
The cross-correlation coefficient of input signal or so passage is calculated in real time, judges section where cross-correlation coefficient, is obtained three-dimensional
Weight factor α and the 1- α of acoustic amplifier and reverberator method；
Further, weight factor is obtained by data statistics；
Stereo enhancing computing, reconstructs left and right passage left (L), right (R) component, introduces the Magnitude Difference L-R of left-right signal
Signal, by adding random phase condition to the difference signal of left and right passage, reconstructs double-channel audio frequency signal；
Further, in stereo enhancing computing, by the way that left and right acoustic channels original signal is amplified according to a certain percentage,
Reduce, is anti-phase, reconstructing new left and right channel signal；
Further, stereo enhancer adds the difference signal of left and right passage random phase condition, designed phase-
Random movement generates between 45 ° to 45 °.
Reverberator computing, reverberation effect is produced by left and right channel signal by reverberator wave filter group, filtering；
Further, reverberator forms wave filter using four comb filter in parallel and two series connection all-pass filters
Group, space reverberation is added to left and right passage；
Further, according to target use environment, the design reverberation time is at 20 milliseconds to 1 second.
By weight factor, calculate the output signal of joint stereo booster and reverberator in real time, and according to ratio because
Sub- adjustment amplitude, carries out the anti-spilled processing of energy, synthesizes binary channels compound voice in real time；
Further, by weight factor α and 1- α, joint stereo booster is calculated in real time and the processing of reverberator is defeated
Go out signal, weighted superposition synthesized output signal；
Further, the signal after stereo enhancer and reverberator weighted superposition is multiplied by 1/ [α of normalization coefficient2+
(1-α)2]0.5Carry out energy amplitude control.
The invention has the advantages that：(1) present invention extraction environment reflected sound signals from original double-channel signal,
Simple possible, can produce good, natural subjective sound field broadening sense of hearing；(2) it is of the invention by stereo enhancer and reverberator knot
Close, applicable scope is more extensive, has sound field to widen effect to single channel signal, double-channel pronunciation signal etc.；(3) it is of the invention
General dsp hardware circuit or dedicated integrated circuit can be used to realize, can also use the software of algorithmic language on computers
Realize；(4) present invention can also be used as hardware circuit, in domestic TV, family as software application in the making of music source
Come into operation in the movie theatre of front yard.
4th, illustrate
To describe the technical solutions in the embodiments of the present invention more clearly, make required in being described below to embodiment
Attached drawing is briefly described, it should be apparent that, drawings in the following description are only some embodiments of the present invention, for
For those of ordinary skill in the art, without creative efforts, other can also be obtained according to these attached drawings
Attached drawing.
Fig. 1 is the joint stereo booster and reverberator algorithm flow frame total figure being previously mentioned in the present invention.
Fig. 2 is the flow frame diagram of neutral body acoustic amplifier of the present invention.
Fig. 3 is the flow frame diagram of reverberator in the present invention.
Fig. 4 is the comb filter flow frame diagram in reverberator in the present invention.
Fig. 5 is the all-pass filter flow frame diagram in reverberator in the present invention.
5th, embodiment
With reference to a kind of attached drawing of specific invention example, the present invention is described in detail.
Fig. 1 is the principle process block diagram of hybrid sense of hearing sound field broadening method, and double-channel signal is carried out sound field broadening
The key for the treatment of technology mainly includes：
In a step 101, the audio material that audio uses sample rate 44.1kHz is inputted, 2048 points of frame length is set.
In a step 102, weight factor α is calculated：
The cross-correlation coefficient of present frame or so 2048 point data of passage is calculated, obtains the cross-correlation coefficient of present frame；
Section where judging cross-correlation coefficient, consult table 1, obtains one group of weight factor α and 1- α；
1 correlation of table judges interval table
Weight factor in 102, carries out the selection operation of algorithm.
In step 103, stereo enhancing computing is carried out, its flow chart is shown in Fig. 2：
202-203：Reconstruct left and right channel input signal Lin、Rin：Introduce the difference L of left-right signalin-RinSignal, by left and right
Sound channel original signal is amplified, reduces, is anti-phase according to a certain percentage, synthesizes new left and right channel signal；
204：Random phase condition is added to the difference signal of left and right passage, designed phase is random between -45 ° to 45 °
Mobile generation；
Using equation below：
K in formula1、K2、K3For gain coefficient, j ω are the phase adjustment factor.The phase adjustment factor used in the present embodiment
Generated at random between -45 ° to 45 °, the gain coefficient of use is shown in Table 2：
2 amplitude of table controls gain coefficient table
207-209：K1、K2、K3Directly affect audio adjusting, under normal circumstances, K1＞ K2.10 groups of gain coefficients in table 2,
Stereo audio gradually strengthens, and is adjusted according to audition feedback；
210：Energy amplitude adjusts, and exports audio：
Balanced amplitude：Using the 1/ (K of modifying factor of corresponding gain coefficient1 2+K2 2+0.5*K3 2)0.5Into amplitude correction；
Prevent energy spilling：L to exporting audio in 205-206outAnd RoutCarry out 5% amplitude limit.
At step 104, reverberator computing is carried out, its flow chart is shown in Fig. 3：
301：Input 2048 dual-channel audio data of present frame；
302-305：Carry out comb filter 1-4 parallel filterings to calculate, the functional block diagram of comb filter is shown in Fig. 4, system
Transmission function is shown in formula (2)：
402：The delay that comb filter 1-4 is used is respectively 30ms, 35ms, 40ms and 45ms, and delay can be according to reality
Adjustment is needed, it is necessary to meet 1.5 times of the condition that wave filter maximum delay time is minimum delay time, and time delay is unsuitable
It is too short.
403：Feedback factor g is determined by formula (3)：
In formula, miFor sampling number, T is sample rate, TrFor the reverberation time.
306-307：The functional block diagram of all-pass wave filtering is shown in Fig. 5, and ssystem transfer function is shown in formula (4)：
502：The delay adjustments of two all-pass filters are in 5ms and 1.7ms.
503-504：The feedback factor of two all-pass filters is 0.7,0.34.
In step 105, output in real time is integrated：
According to the weight factor in step 102, the output signal of 103 stereo enhancers and 104 reverberators is folded
Add, and carry out energy amplitude adjustment, detailed process is shown in formula (5).
In formula, ysFor the output audio of stereo enhancer, yrFor the output audio of reverberator.
Claims (7)
1. a kind of hybrid sense of hearing sound field broadening method, the described method includes：
The left and right passage cross-correlation coefficient of binary channels input signal is calculated in real time, and section where judging cross-correlation coefficient, is stood
Weight factor α and the 1- α of body acoustic amplifier and reverberator method；
Stereo enhancing computing, reconstruct left and right passage L, R component, the difference signal L-R of introducing left and right channel signal, by a left side
The difference signal of right passage adds random phase, reconstructs double-channel audio frequency signal；
Reverberator computing, reverberation effect is produced by left and right channel signal by reverberator wave filter group, filtering；
Pass through weight factor, in real time the output signal of calculating joint stereo booster and reverberator, and according to weight factor tune
View picture degree, carries out the anti-spilled processing of energy, synthesizes binary channels compound voice in real time.
2. hybrid sense of hearing sound field broadening method design as claimed in claim 1, it is characterised in that：
The left and right passage cross-correlation coefficient of binary channels input signal, cross correlation number interval and corresponding scale factor are calculated in real time
Obtained by data statistics.
3. hybrid sense of hearing sound field broadening method design as claimed in claim 1, it is characterised in that：
By being amplified, reducing, anti-phase according to a certain percentage by left and right acoustic channels original signal, new dual-channel audio letter is reconstructed
Number.
4. hybrid sense of hearing sound field broadening method design as claimed in claim 1, it is characterised in that：
Stereo enhancer adds random phase, phase random movement between -45 ° to 45 ° to the difference signal of left and right passage
Generation.
5. hybrid sense of hearing sound field broadening method design as claimed in claim 1, it is characterised in that：
Reverberator calculates, and using four comb filter in parallel and two series connection all-pass filters, wave filter group is formed, to left and right
Passage adds space reverberation；
According to target use environment, the design reverberation time is in 20ms to 1s.
6. hybrid sense of hearing sound field broadening method design as claimed in claim 1, it is characterised in that：
By weight factor α and 1- α, joint stereo booster and the signal of reverberator processing output are calculated in real time, and weighting is folded
Adduction is into binary channels compound voice.
7. weighted superposition as claimed in claim 6 synthesizes binary channels compound voice, it is characterised in that：
Signal after stereo enhancer and reverberator weighted superposition is multiplied by 1/ [α of normalization coefficient2+(1-α)2]0.5Carry out energy
Discharge amplitude controls.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711428955.7A CN108040317B (en) | 2017-12-22 | 2017-12-22 | A kind of hybrid sense of hearing sound field broadening method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711428955.7A CN108040317B (en) | 2017-12-22 | 2017-12-22 | A kind of hybrid sense of hearing sound field broadening method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108040317A true CN108040317A (en) | 2018-05-15 |
| CN108040317B CN108040317B (en) | 2019-09-27 |
Family
ID=62101321
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711428955.7A Active CN108040317B (en) | 2017-12-22 | 2017-12-22 | A kind of hybrid sense of hearing sound field broadening method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108040317B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111798866A (en) * | 2020-07-13 | 2020-10-20 | 商汤集团有限公司 | Method and device for training audio processing network and reconstructing stereo |
| CN113115175A (en) * | 2018-09-25 | 2021-07-13 | Oppo广东移动通信有限公司 | 3D sound effect processing method and related product |
| CN114143698A (en) * | 2021-10-29 | 2022-03-04 | 北京奇艺世纪科技有限公司 | Audio signal processing method and device and computer readable storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104335606A (en) * | 2012-05-29 | 2015-02-04 | 创新科技有限公司 | Stereo widening over arbitrarily-configured loudspeakers |
| CN105336320A (en) * | 2015-09-29 | 2016-02-17 | 南通大学 | Spring reverberation model |
| CN105516881A (en) * | 2015-12-03 | 2016-04-20 | 珠海全志科技股份有限公司 | Earphone virtual surround signal processing method, device and system |
| CN107040849A (en) * | 2017-04-27 | 2017-08-11 | 广州天逸电子有限公司 | A kind of method and device for improving three-dimensional phonoreception |
-
2017
- 2017-12-22 CN CN201711428955.7A patent/CN108040317B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104335606A (en) * | 2012-05-29 | 2015-02-04 | 创新科技有限公司 | Stereo widening over arbitrarily-configured loudspeakers |
| CN105336320A (en) * | 2015-09-29 | 2016-02-17 | 南通大学 | Spring reverberation model |
| CN105516881A (en) * | 2015-12-03 | 2016-04-20 | 珠海全志科技股份有限公司 | Earphone virtual surround signal processing method, device and system |
| CN107040849A (en) * | 2017-04-27 | 2017-08-11 | 广州天逸电子有限公司 | A kind of method and device for improving three-dimensional phonoreception |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113115175A (en) * | 2018-09-25 | 2021-07-13 | Oppo广东移动通信有限公司 | 3D sound effect processing method and related product |
| CN111798866A (en) * | 2020-07-13 | 2020-10-20 | 商汤集团有限公司 | Method and device for training audio processing network and reconstructing stereo |
| CN114143698A (en) * | 2021-10-29 | 2022-03-04 | 北京奇艺世纪科技有限公司 | Audio signal processing method and device and computer readable storage medium |
| CN114143698B (en) * | 2021-10-29 | 2023-12-29 | 北京奇艺世纪科技有限公司 | Audio signal processing method and device and computer readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108040317B (en) | 2019-09-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101946526B (en) | Stereophonic widening | |
| KR100626233B1 (en) | Equalisation of the output in a stereo widening network | |
| EP3406088B1 (en) | Synthesis of signals for immersive audio playback | |
| US8605914B2 (en) | Nonlinear filter for separation of center sounds in stereophonic audio | |
| US7599498B2 (en) | Apparatus and method for producing 3D sound | |
| TW201119420A (en) | Virtual audio processing for loudspeaker or headphone playback | |
| MX2007010636A (en) | Device and method for generating an encoded stereo signal of an audio piece or audio data stream. | |
| Bai et al. | Upmixing and downmixing two-channel stereo audio for consumer electronics | |
| CN101902679A (en) | Processing method for simulating 5.1 sound-channel sound signal with stereo sound signal | |
| WO2020151837A1 (en) | Method and apparatus for processing a stereo signal | |
| CN108040317B (en) | A kind of hybrid sense of hearing sound field broadening method | |
| JP2013504837A (en) | Phase layering apparatus and method for complete audio signal | |
| JP2004023486A (en) | Method for localizing sound image at outside of head in listening to reproduced sound with headphone, and apparatus therefor | |
| KR100849030B1 (en) | 3D sound Reproduction Apparatus using Virtual Speaker Technique under Plural Channel Speaker Environments | |
| KR100802339B1 (en) | 3D sound Reproduction Apparatus and Method using Virtual Speaker Technique under Stereo Speaker Environments | |
| WO2022133128A1 (en) | Binaural signal post-processing | |
| JPH1118199A (en) | Acoustic processor | |
| JP7332745B2 (en) | Speech processing method and speech processing device | |
| US20240056735A1 (en) | Stereo headphone psychoacoustic sound localization system and method for reconstructing stereo psychoacoustic sound signals using same | |
| JP4357218B2 (en) | Headphone playback method and apparatus | |
| KR100566115B1 (en) | Apparatus and Method for Creating 3D Sound | |
| Maher | Single-ended spatial enhancement using a cross-coupled lattice equalizer | |
| Gan et al. | Elevated speaker projection for digital home entertainment system | |
| JPH0775439B2 (en) | 3D sound field playback device | |
| GB2609667A (en) | Audio rendering |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |