CN108040317B - A kind of hybrid sense of hearing sound field broadening method - Google Patents

A kind of hybrid sense of hearing sound field broadening method Download PDF

Info

Publication number
CN108040317B
CN108040317B CN201711428955.7A CN201711428955A CN108040317B CN 108040317 B CN108040317 B CN 108040317B CN 201711428955 A CN201711428955 A CN 201711428955A CN 108040317 B CN108040317 B CN 108040317B
Authority
CN
China
Prior art keywords
reverberator
signal
right channel
sound field
stereo
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201711428955.7A
Other languages
Chinese (zh)
Other versions
CN108040317A (en
Inventor
王鹏
林志斌
邱小军
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nanjing University
Original Assignee
Nanjing University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nanjing University filed Critical Nanjing University
Priority to CN201711428955.7A priority Critical patent/CN108040317B/en
Publication of CN108040317A publication Critical patent/CN108040317A/en
Application granted granted Critical
Publication of CN108040317B publication Critical patent/CN108040317B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30—Control circuits for electronic adaptation of the sound field
    • H04S7/305—Electronic adaptation of stereophonic audio signals to reverberation of the listening space
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00—Circuits for transducers, loudspeakers or microphones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
    • H04S2400/13—Aspects of volume control, not necessarily automatic, in stereophonic sound systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2420/00—Techniques used stereophonic systems covered by H04S but not provided for in its groups
    • H04S2420/01—Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Stereophonic System (AREA)

Abstract

Method is widened based on the hybrid sense of hearing sound field of stereo enhancer and reverberator the invention discloses a kind of, the described method includes: calculating the left and right channel cross-correlation coefficient of binary channels input signal in real time, according to section where cross-correlation coefficient, the weight factor of stereo enhancer and reverberator is judged；Stereo enhancing operation introduces the difference L-R of left and right channel signal, carries out random movement by the phase to left and right channel signal, and moving range is -45 ° to 45 °, reconstructs double-channel audio frequency signal；Double-channel signal is carried out reverberator filtering operation by reverberator operation；By weight factor, the output signal of joint stereo booster and reverberator is calculated in real time and synthesizes binary channels compound voice.Hybrid sense of hearing sound field disclosed by the invention widens method, can effectively expande sound field width, implements simply, applied widely.

Description

A kind of hybrid sense of hearing sound field broadening method
Technical field
The present invention relates to stereo and surround sound fields, disclose a kind of mixing based on stereo enhancer and reverberator Formula sense of hearing sound field widens method.
Background technique
With reaching its maturity for electronic consumer markets, consumer requires the sound quality of electronic product higher and higher.Respectively Class is stereo and surround sound standard is also gradually popularized, common are 5.1 channel surround sound of Doby, QSurround surround sound, Dobly Atmos [G.Sergi, Knocking at the door of cinematic artifice:Dolby Atmos, Challenges and opportunities, The New Soundtrack, 3 (2): 107-121,2013] etc..These methods Using multiple loudspeakers, can more perfect reproduced sound-field, give audience auditory perception on the spot in person, obtained widely recognizing Can, but it is expensive.
In order to better conform to the demand of consumer electronics market, twin loudspeaker is reset around audio technology merely with two loudspeakings Device obtains broader sound field experience.There is research and utilization artificial reverberation at present, generates the environmental acoustics information of certain space, obtain Broader spatial hearing is taken to experience [Begault DR, Trejo LJ.3-D sound for virtual reality and Multimedia [J] .2000.], by carrying out acoustic reverberation simulation to acoustic surrounding, different acoustic surroundings can be built different Reverberation effect；Component environment information is provided by introducing double-channel signal differential signal, and with this, reduces the phase in left and right channel Guan Xing can also widen sense of hearing sound field width [Cohen JM.Stereo image separation and perimeter Enhancement:U.S.Patent 4,308,423 [P] .1981-12-29.].As proposed in patent CN101065989 It is logical to regenerate left and right by left and right channel signal after delay, diminution, reversion for two loudspeaker speaker stereo extended network method The signal in road.Patent CN202276412U also uses similar scheme, and left and right channel is mixed and is exported, and obtains sound field broadening effect Fruit.The target of such scheme is to amplify the difference signal in left and right channel, enhances the environment composition of audio, to single channel signal, double The processing capacity of channel speech signal is limited.
It is also possible to use HRTF function, carries out reconstruction [Begault DR, the Trejo LJ.3-D sound of surround sound for virtual reality and multimedia[J].2000.].Patent CN101212843 uses the function side HRTF A left side in original signal is carried out convolution around signal and right surround signal and the HRTF function of special angle feature, then by method It is exported by the twin loudspeaker in front, the sound field for providing a kind of boombox resets scheme.This method can provide one Fixed stereo locating effect, but it is limited to the sound field broadening effect immediately ahead of binaural signal audience, and that there are acoustic images is narrow Disadvantage narrow, versatility is low.
Finally, the method that can also utilize Adaptive Signal Processing and Signal separator, passes through certain constraint condition, separation Principal component and context components in original double-channel signal improve context components ratio, obtain certain sound field broadening effect, but Higher [Irwan R, Aarts the RM.Two-to-five channel sound processing [J] of algorithm complexity .Journal of the Audio Engineering Society, 2002,50 (11): 914-926.].Such as patent CN106170991A uses this method, and central components, side component and the context components in left and right acoustic channels are separated, adjustment master The ratio of component, side component and context components, and eliminated by space crosstalk, improve the sound field broadening effect of audio.Patent CN106572419A also uses similar implementation, and by a series of complex operation, left and right channel signal is decomposed into directly Up to acoustical signal and around acoustical signal, then decorrelation processing will be carried out around acoustical signal, and finally obtain one group of very low left side of correlation Right channel signal.The algorithm complexity of such scheme is higher, and the cost that Practical Project is implemented is higher, and to single channel signal and language The separating effect of sound signal is limited.
Summary of the invention
For existing free space twin loudspeaker sound field reproducing device acoustic image is narrow, spatial impression is insufficient and to input sound There is limitation in frequency type, the present invention provides the hybrid sense of hearing sound that a kind of stereo enhancer and reverberator combine Field broadening method.
For achieving the above object, the purpose of the present invention is achieved through the following technical solutions:
The cross-correlation coefficient in the left and right channel of input signal is calculated in real time, and section where judging cross-correlation coefficient is stood Weight factor α and the 1- α of body acoustic amplifier and reverberator；
Further, weight factor is obtained by data statistics；
Stereo enhancer operation obtains left and right channel left (L), the right side (R) component of input signal, introduces input signal Random phase condition is added by the difference signal in the left and right channel to input signal in the Magnitude Difference L-R signal of left-right signal, Reconstruct double-channel audio frequency signal；
Further, in stereo enhancer operation, by the way that the left and right acoustic channels of input signal are carried out according to a certain percentage Amplification is reduced, reverse phase, and new left and right channel signal is reconstructed；
Further, random phase condition is added to the difference signal in the left and right channel of input signal in stereo enhancer, Designed phase random movement between -45 ° to 45 ° generates.
Reverberator operation, by the left and right channel of input signal by reverberator filter group, filtering generates reverberation effect；
Further, reverberator forms filter using four comb filter in parallel and two series connection all-pass filters Space reverberation is added to the left and right channel of input signal in group；
Further, according to target use environment, the reverberation time is designed at 20 milliseconds to 1 second.
By weight factor, calculate the output signal of joint stereo booster and reverberator in real time, and according to ratio because Sub- adjustment amplitude carries out the anti-spilled processing of energy, synthesizes binary channels compound voice in real time；
Further, by weight factor α and 1- α, the output letter of joint stereo booster and reverberator is calculated in real time Number, weighted superposition synthesized output signal；
Further, by the signal after stereo enhancer and the synthesis of reverberator weighted superposition multiplied by normalization coefficient 1/ [α2+(1-α)2]0.5Carry out energy amplitude control.
The invention has the following advantages: (1) present invention extraction environment reflected sound signals from original double-channel signal, Simple possible can produce good, natural subjective sound field broadening sense of hearing；(2) of the invention by stereo enhancer and reverberator knot It closes, applicable range is more extensive, has sound field to widen effect single channel signal, double-channel pronunciation signal etc.；(3) of the invention General dsp hardware circuit can be used or dedicated integrated circuit is realized, the software of algorithmic language can also be used on computers It realizes；(4) present invention can be used as software application in the production of music source, can also be used as hardware circuit, in domestic TV, family It comes into operation in the movie theatre of front yard.
Detailed description of the invention
To describe the technical solutions in the embodiments of the present invention more clearly, make required in being described below to embodiment Attached drawing is briefly described, it should be apparent that, drawings in the following description are only some embodiments of the invention, for For those of ordinary skill in the art, without creative efforts, it can also be obtained according to these attached drawings other Attached drawing.
Fig. 1 is joint stereo booster and reverberator algorithm process frame total figure mentioned in the present invention.
Fig. 2 is the process frame diagram of neutral body acoustic amplifier of the present invention.
Fig. 3 is the process frame diagram of reverberator in the present invention.
Fig. 4 is the comb filter process frame diagram in the present invention in reverberator.
Fig. 5 is the all-pass filter process frame diagram in the present invention in reverberator.
Specific embodiment
Below with reference to a kind of attached drawing of specific invention example, the present invention is described in detail.
Fig. 1 is the principle process block diagram of hybrid sense of hearing sound field broadening method, and double-channel signal is carried out sound field broadening The key of processing technique specifically includes that
In a step 101, input audio uses the audio material of sample rate 44.1kHz, is arranged 2048 points of frame length.
In a step 102, weight factor α is calculated:
The cross-correlation coefficient for calculating present frame or so 2048 point data of channel, obtains the cross-correlation coefficient of present frame；
Section where judging cross-correlation coefficient, consult table 1 obtain one group of weight factor α and 1- α；
1 correlation of table judges interval table
According to the weight factor in 102, the selection operation of algorithm is carried out.
In step 103, stereo enhancer operation is carried out, flow chart is shown in Fig. 2:
202-203: the left and right channel input signal L of input signal is obtainedin、Rin: introduce the left-right signal of input signal Difference Lin-RinThe left and right acoustic channels of input signal are amplified according to a certain percentage, are reduced, reverse phase by signal, synthesize a new left side Right channel signal；
204: random phase condition is added to the difference signal in the left and right channel of input signal, designed phase at -45 ° extremely Random movement generates between 45 °；
Using following formula:
K in formula1、K2、K3For gain coefficient, j ω is the phase adjustment factor.The phase adjustment factor used in the present embodiment It is generated at random between -45 ° to 45 °, the gain coefficient of use is shown in Table 2:
2 amplitude of table controls gain coefficient table
207-209:K1、K2、K3Directly affect audio adjusting, under normal circumstances, K1> K2.10 groups of gain coefficients in table 2, Stereo audio gradually increases, and is adjusted according to audition feedback；
210: energy amplitude adjustment exports audio:
Balanced amplitude: using the 1/ (K of modifying factor of corresponding gain coefficient1 2+K2 2+0.5*K3 2)0.5Into amplitude correction；
Prevent energy spilling: to the L for exporting audio in 205-206outAnd RoutCarry out 5% clipping.
At step 104, reverberator operation is carried out, flow chart is shown in Fig. 3:
301: input 2048 dual-channel audio data of present frame；
302-305: it carries out comb filter 1-4 parallel filtering and calculates, the functional block diagram of comb filter is shown in Fig. 4, system Transmission function is shown in formula (2):
402: the comb filter 1-4 delay used is respectively 30ms, 35ms, 40ms and 45ms, and delay can be according to reality It needs to adjust, needs to meet 1.5 times of the condition that filter maximum delay time is minimum delay time, and delay time is unsuitable It is too short.
403: feedback factor g is determined by formula (3):
In formula, miFor sampling number, T is sample rate, TrFor the reverberation time.
306-307: the functional block diagram of all-pass wave filtering is shown in that Fig. 5, ssystem transfer function are shown in formula (4):
The delay of 502: two all-pass filters is set in 5ms and 1.7ms.
The feedback factor of 503-504: two all-pass filters is 0.7,0.34.
In step 105, integration output in real time:
According to the weight factor in step 102, the output signal of 103 stereo enhancers and 104 reverberators is folded Add, and carry out energy amplitude adjustment, detailed process is shown in formula (5).
In formula, ysFor the output audio of stereo enhancer, yrFor the output audio of reverberator.

Claims (3)

1. a kind of hybrid sense of hearing sound field widens method, which comprises
The left and right channel cross-correlation coefficient of binary channels input signal is calculated in real time, and section where judging cross-correlation coefficient is stood Weight factor α and the 1- α of body acoustic amplifier and reverberator；
Stereo enhancer operation, which is characterized in that according to following expression re-formation double-channel audio frequency signal:
Lout=K1·Lin-K2·Rin+K3·(Lin-Rin)·ejω
Rout=K1·Rin-K2·Lin+K3·(Rin-Lin)·e-jω
Wherein, LoutAnd RoutIndicate the left and right channel of reconstruction signal, LinAnd RinIndicate the left and right channel of input signal, K1、K2And K3 Expression amplitude controls gain coefficient, ejωAnd e-jωIndicate that random phase, phase random movement between -45 ° to 45 ° generate；
Reverberator operation, by the left and right channel of input signal by reverberator filter group, filtering generates reverberation effect；
By weight factor, the output signal of joint stereo booster and reverberator is calculated in real time, and according to weight factor tune Whole picture degree carries out the anti-spilled processing of energy, synthesizes binary channels compound voice in real time；
Wherein reverberator operation forms filter group using four comb filter in parallel and two series connection all-pass filters, right Space reverberation is added in the left and right channel of input signal；
According to target use environment, the reverberation time is designed in 20ms to 1s；
By weight factor α and 1- α, the output signal of joint stereo booster and reverberator is calculated in real time, and weighted superposition is closed At binary channels compound voice.
2. hybrid sense of hearing sound field as described in claim 1 widens method, it is characterised in that:
The left and right channel cross-correlation coefficient of binary channels input signal, cross correlation number interval and corresponding scale factor are calculated in real time It is obtained by data statistics.
3. hybrid sense of hearing sound field as described in claim 1 widens method, it is characterised in that:
By the signal after stereo enhancer and the synthesis of reverberator weighted superposition multiplied by 1/ [α of normalization coefficient2+(1-α)2]0.5Into The control of row energy amplitude.
CN201711428955.7A 2017-12-22 2017-12-22 A kind of hybrid sense of hearing sound field broadening method Active CN108040317B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201711428955.7A CN108040317B (en) 2017-12-22 2017-12-22 A kind of hybrid sense of hearing sound field broadening method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201711428955.7A CN108040317B (en) 2017-12-22 2017-12-22 A kind of hybrid sense of hearing sound field broadening method

Publications (2)

Publication Number Publication Date
CN108040317A CN108040317A (en) 2018-05-15
CN108040317B true CN108040317B (en) 2019-09-27

Family

ID=62101321

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201711428955.7A Active CN108040317B (en) 2017-12-22 2017-12-22 A kind of hybrid sense of hearing sound field broadening method

Country Status (1)

Country Link
CN (1) CN108040317B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113115175B (en) * 2018-09-25 2022-05-10 Oppo广东移动通信有限公司 3D sound effect processing method and related product
CN111798866A (en) * 2020-07-13 2020-10-20 商汤集团有限公司 Method and device for training audio processing network and reconstructing stereo
CN114143698B (en) * 2021-10-29 2023-12-29 北京奇艺世纪科技有限公司 Audio signal processing method and device and computer readable storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104335606A (en) * 2012-05-29 2015-02-04 创新科技有限公司 Stereo widening over arbitrarily-configured loudspeakers
CN105336320A (en) * 2015-09-29 2016-02-17 南通大学 Spring reverberation model
CN105516881A (en) * 2015-12-03 2016-04-20 珠海全志科技股份有限公司 Earphone virtual surround signal processing method, device and system
CN107040849A (en) * 2017-04-27 2017-08-11 广州天逸电子有限公司 A kind of method and device for improving three-dimensional phonoreception

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104335606A (en) * 2012-05-29 2015-02-04 创新科技有限公司 Stereo widening over arbitrarily-configured loudspeakers
CN105336320A (en) * 2015-09-29 2016-02-17 南通大学 Spring reverberation model
CN105516881A (en) * 2015-12-03 2016-04-20 珠海全志科技股份有限公司 Earphone virtual surround signal processing method, device and system
CN107040849A (en) * 2017-04-27 2017-08-11 广州天逸电子有限公司 A kind of method and device for improving three-dimensional phonoreception

Also Published As

Publication number Publication date
CN108040317A (en) 2018-05-15

Similar Documents

Publication Publication Date Title
KR100626233B1 (en) Equalisation of the output in a stereo widening network
KR101639099B1 (en) Virtual audio processing for loudspeaker or headphone playback
US8605909B2 (en) Method and device for efficient binaural sound spatialization in the transformed domain
US8605914B2 (en) Nonlinear filter for separation of center sounds in stereophonic audio
EP3406088B1 (en) Synthesis of signals for immersive audio playback
MX2007010636A (en) Device and method for generating an encoded stereo signal of an audio piece or audio data stream.
CN108040317B (en) A kind of hybrid sense of hearing sound field broadening method
Bai et al. Upmixing and downmixing two-channel stereo audio for consumer electronics
WO2000019415A2 (en) Method and apparatus for three-dimensional audio display
JP2013504837A (en) Phase layering apparatus and method for complete audio signal
AU2012257865B2 (en) Apparatus and method and computer program for generating a stereo output signal for providing additional output channels
KR101546849B1 (en) Method and apparatus for sound externalization in frequency domain
CN113347551B (en) Method and device for processing single-sound-channel audio signal and readable storage medium
KR100849030B1 (en) 3D sound Reproduction Apparatus using Virtual Speaker Technique under Plural Channel Speaker Environments
Yuan et al. Externalization improvement in a real-time binaural sound image rendering system
US20240056735A1 (en) Stereo headphone psychoacoustic sound localization system and method for reconstructing stereo psychoacoustic sound signals using same
JP4357218B2 (en) Headphone playback method and apparatus
Doukhan et al. CW_binaural~: A binaural synthesis external for Pure Data
GB2609667A (en) Audio rendering
Maher Single-ended spatial enhancement using a cross-coupled lattice equalizer
CN117119369A (en) Audio generation method, computer device, and computer-readable storage medium
Jot et al. Center-Channel Processing in Virtual 3-D Audio Reproduction over Headphones or Loudspeakers
JPH0775439B2 (en) 3D sound field playback device
Gan et al. ELEVATED sPEAKER PROJECToN FoR DiarraL Hon= ENTERTAINMENT svsrɛ

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant