CN104853283A - Audio signal processing method and apparatus - Google Patents

Abstract

The application provides an audio signal processing method and apparatus. The features of a front sound source in left and right channel output signals are improved, so it is less possible that a user may misjudge that the front sound source comes from the back. The method includes the steps of receiving a left input channel signal, a middle channel signal and a right input channel signal collected by a binaural audio collecting device; determining a source azimuth between a sound source and a head die of the binaural audio collecting device; performing convolution of head related impulse response (HRIR) on the middle channel signal and a left ear of exaggerated ears corresponding to the source azimuth so as to obtain an auxiliary left channel signal; performing convolution of head related impulse response (HRIR) on the middle channel signal and a right ear of the exaggerated ears corresponding to the source azimuth so as to obtain an auxiliary right channel signal; and obtaining a left output channel signal through the left input channel signal and the auxiliary left channel signal, and obtaining a right output channel signal through the right input channel signal and the auxiliary right channel signal.

Description

A kind of method and apparatus of Audio Signal Processing

Technical field

The present invention relates to electronic technology field, espespecially relate to a kind of method and apparatus of Audio Signal Processing.

Background technology

Double-ear type sound-recording reproducing process adopts a pair micro microphone being placed on dummy head (or true man experimenter) ears place to carry out gathering original sound field.The binaural signal of gained after treatment, then is reset with a pair earphone, thus produces the main space information consistent with original sound field at user's ears place, realizes the playback of acoustic space information.Double-ear type sound-recording reproducing process can make user produce impression on the spot in person.

The mankind judge the orientation of this sound source at the signal difference that left and right ear receives according to same sound source.But Double-ear type sound-recording reproducing process of the prior art, when Headphone reproducing binaural signal, can be lost the auxiliary cognitive information being judged front and back position by the sense of hearing, occur that certain front and back acoustic image is obscured.Namely user is according to the voice signal heard, the sound from front can be judged into from rear, or judges into the sound from rear from front.And judge into the sound from front from rear by accident possibility is higher.

Summary of the invention

This application provides a kind of method and apparatus of audio frequency process, enhance the front sound source characteristics in the multi-channel output signal of left and right, thus reduce user and front sound source is mistaken for possibility from rear according to the voice signal heard.

The application's first aspect provides a kind of method of Audio Signal Processing, comprising:

Receive the left input channel signal of the collection of binaural audio collecting device, mid-channel signal and right input channel signal, wherein, described left input channel signal, described mid-channel signal and described right input channel signal are corresponding with the left ear passage of described binaural audio collecting device, mid-passage and auris dextra passage respectively, and described mid-passage is between described left ear passage and described auris dextra passage;

According to described left input channel signal, described mid-channel signal and described right input channel signal, the angle, sound bearing between the head mould determining sound source and described binaural audio collecting device;

Exaggeration ear left ear head coherent pulse corresponding with angle, described sound bearing for described mid-channel signal is responded HRIR and carries out convolution, thus obtain auxiliary left-channel signal;

Exaggeration ear auris dextra HRIR corresponding with angle, described sound bearing for described mid-channel signal is carried out convolution, thus obtains auxiliary right channel signal;

Utilize described left input channel signal and described auxiliary left-channel signal to obtain left output channel signal, utilize described right input channel signal and described auxiliary right channel signal to obtain right output channel signal.

In conjunction with the first possible implementation of first aspect, in the implementation that the second of first aspect is possible, convolution is carried out at the left ear HRIR of the described exaggeration ear that described mid-channel signal is corresponding with angle, described sound bearing, and before the described exaggeration ear auris dextra HRIR that described mid-channel signal is corresponding with angle, described sound bearing carries out convolution, described method also comprises:

According to described left input channel signal, described mid-channel signal and described right input channel signal, determine the orientation of described sound source;

When determining that the orientation of described sound source is positioned at the front of described head mould, just the left ear HRIR of exaggeration ear that described mid-channel signal is corresponding with angle, described sound bearing is carried out convolution, and exaggeration ear auris dextra HRIR corresponding with angle, described sound bearing for described mid-channel signal is carried out convolution.

In conjunction with the implementation that the second of first aspect is possible, in the third possible implementation of first aspect, described according to described left input channel signal, described mid-channel signal and described right input channel signal, determine the orientation of described sound source, comprising:

Determine the first delay inequality between described left input channel signal and described right input channel signal, the second delay inequality between described left input channel signal and described mid-channel signal, and the 3rd delay inequality between described right input channel signal and described mid-channel signal;

Size according to described first delay inequality and described head mould is determined to judge the factor, according to the scope at the value place of the described judgement factor, described second delay inequality and described 3rd delay inequality, determines the orientation of described sound source.

In conjunction with the first possible implementation of first aspect or first aspect to any one in the possible implementation of the second of first aspect, in the third possible implementation of first aspect, described described left input channel signal and the described auxiliary left-channel signal of utilizing obtains left output channel signal, utilize described right input channel signal and described auxiliary right channel signal to obtain right output channel signal, comprising:

Time delay adjustment is carried out to described auxiliary left-channel signal and described auxiliary right channel signal, obtains the auxiliary right channel signal after the auxiliary left-channel signal after time delay adjustment and time delay adjustment;

Auxiliary left-channel signal after described time delay adjustment and described left input channel signal are synthesized, thus obtain described left output channel signal, auxiliary right channel signal after described time delay adjustment and described right input signal are synthesized, thus obtains described right output channel signal.

In conjunction with the third possible implementation of first aspect, in the 4th kind of possible implementation of first aspect, described time delay adjustment is carried out to described auxiliary left-channel signal and described auxiliary right channel signal, obtain the auxiliary right channel signal after the auxiliary left-channel signal after time delay adjustment and time delay adjustment, comprising:

Obtain the 4th delay inequality and the 5th delay inequality, described 4th delay inequality is delay inequality between described auxiliary left-channel signal and described left input channel signal, and described 5th delay inequality is delay inequality between described auxiliary right channel signal and described right input channel signal;

When the orientation of described sound source is positioned at the left side of described head mould, determine that described 4th delay inequality is for alignment delay inequality; When the orientation of described sound source is positioned at the right side of described head mould, determine that described 5th delay inequality is for alignment delay inequality;

The default strengthening location time delay time difference is deducted the difference of described alignment delay inequality as finally compensating the time difference;

The described final compensation time difference is utilized to carry out time delay adjustment to described auxiliary left-channel signal and described auxiliary right channel signal, thus obtain described time delay adjustment after auxiliary left-channel signal and described time delay adjustment after auxiliary right channel signal, in auxiliary left-channel signal sequential after described time delay adjustment, the time difference of leading described left input channel signal is the described final compensation time difference, and in the auxiliary right channel signal sequential after described time delay adjustment, the time difference of leading described right input channel signal is the described final compensation time difference; Or

The difference that the described strengthening location time delay time difference deducts described 4th delay inequality is compensated the time difference as final left side; The difference that the described strengthening location time delay time difference deducts described 5th delay inequality is compensated the time difference as final right side;

The described final left side compensation time difference is utilized to carry out time delay adjustment to described auxiliary left-channel signal, thus the auxiliary left-channel signal obtained after the adjustment of described time delay, and utilize the described final right side compensation time difference to carry out time delay adjustment to described auxiliary right channel signal, the auxiliary right channel signal after the adjustment of described time delay is obtained from ear, in auxiliary left-channel signal sequential after described time delay is adjusted, the time difference of leading described left input channel signal is that described final left side compensates the time difference, in auxiliary right channel signal sequential after described time delay adjustment, the time difference of leading described right input channel signal is that described final right side compensates the time difference.

In conjunction with the 4th kind of possible implementation of first aspect, in the 5th kind of possible implementation of first aspect, described auxiliary left-channel signal after the adjustment of described time delay and described left input channel signal to be synthesized, thus obtain described left output signal, auxiliary right channel signal after described time delay adjustment and described right input signal are synthesized, thus obtain described right output signal, comprising:

By the auxiliary left-channel signal after described time delay processing and described left input channel signal, synthesize in the mode of weighted sum, thus obtain described left output channel signal, by the auxiliary right channel signal after described time delay processing and described right input channel signal, synthesize in the mode of weighted sum, and then obtain described right output channel signal.

In conjunction with the first possible implementation of first aspect or first aspect to any one in the possible implementation of the second of first aspect, in the 6th kind of possible implementation of first aspect, described described left input channel signal and the described auxiliary left-channel signal of utilizing obtains left output channel signal, utilize described right input channel signal and described auxiliary right channel signal to obtain right output channel signal, comprising:

Time delay adjustment is carried out to described left input channel signal and described right input channel signal, obtains the right input channel signal after the left input channel signal after time delay adjustment and time delay adjustment;

Left-channel signal after described time delay adjustment and described auxiliary left input channel signal are synthesized, thus obtain described left output signal, right channel signal after described time delay adjustment and described auxiliary right input signal are synthesized, thus obtains described right output signal.

In conjunction with the first possible implementation of first aspect or first aspect to any one in the 6th kind of possible implementation of first aspect, in the 7th kind of possible implementation of first aspect, described according to described left input channel signal, described mid-channel signal and described right input channel signal, determine the angle, sound bearing between the head mould that sound source is corresponding with described binaural audio collecting device, comprising:

Size according to the first delay inequality and described head mould determines the first possibility angle, sound bearing, size according to the second delay inequality and described head mould determines the second possibility angle, sound bearing, and the size according to the 3rd delay inequality and described head mould determines the 3rd possibility angle, sound bearing;

Described first delay inequality is the time difference between described left input channel signal and described right input channel signal, described second delay inequality is the time difference between described left input channel signal and described mid-channel signal, and the 3rd delay inequality is the time difference between described right input channel signal and described mid-channel signal;

Size according to described first delay inequality and described head mould is determined to judge the factor, according to the scope at the value place of the described judgement factor, angle, described sound bearing may may may be determined angle, sound bearing in angle, sound bearing or the described 3rd in angle, sound bearing, described second from described first.

The application's second aspect provides a kind of device exporting sound-source signal, comprising:

Receiving element, for receiving the left input channel signal of the collection of binaural audio collecting device, mid-channel signal and right input channel signal, wherein, described left input channel signal, described mid-channel signal and described right input channel signal are corresponding with the left ear passage of described binaural audio collecting device, mid-passage and auris dextra passage respectively, and described mid-passage is between described left ear passage and described auris dextra passage;

Determining unit, for the described left input channel signal received according to described receiving element, described mid-channel signal and described right input channel signal, the angle, sound bearing between the head mould determining sound source and described binaural audio collecting device;

Convolution unit, the exaggeration ear left ear head coherent pulse that the described mid-channel signal for being received by described receiving element is corresponding with angle, described determining unit determined described sound bearing responds HRIR and carries out convolution, thus obtains auxiliary left-channel signal; Exaggeration ear auris dextra HRIR corresponding with angle, described sound bearing for described mid-channel signal is carried out convolution, thus obtains auxiliary right channel signal;

Output signal obtains unit, the described auxiliary left-channel signal that the described left input channel signal received for utilizing described receiving element and described convolution unit provide obtains left output channel signal, and the described auxiliary right channel signal that the described right input channel signal utilizing described receiving element to receive and described convolution unit provide obtains right output channel signal.

In conjunction with the first possible implementation of second aspect, in the implementation that the second of second aspect is possible, described determining unit also for:

In institute's convolution unit, the left ear HRIR of exaggeration ear that described mid-channel signal is corresponding with angle, described sound bearing is carried out convolution, and before the described exaggeration ear auris dextra HRIR that described mid-channel signal is corresponding with angle, described sound bearing carries out convolution, according to described left input channel signal, described mid-channel signal and described right input channel signal that described receiving element receives, determine the orientation of described sound source; When described determining unit determines that the orientation of described sound source is positioned at the front of described head mould, notify that the left ear HRIR of exaggeration ear that described mid-channel signal is corresponding with angle, described sound bearing is carried out convolution by described convolution unit, and exaggeration ear auris dextra HRIR corresponding with angle, described sound bearing for described mid-channel signal is carried out convolution.

In conjunction with the implementation that the second of second aspect is possible, in the third possible implementation of second aspect, described determining unit is used for:

Determine the first delay inequality between described left input channel signal and described right input channel signal, the second delay inequality between described left input channel signal and described mid-channel signal, and the 3rd delay inequality between described right input channel signal and described mid-channel signal;

Size according to described first delay inequality and described head mould is determined to judge the factor, according to the scope at the value place of the described judgement factor, described second delay inequality and described 3rd delay inequality, determines the orientation of described sound source.

In conjunction with the first possible implementation of second aspect or second aspect to any one in the possible implementation of the second of second aspect, in the third possible implementation of second aspect, described output signal obtains unit and is used for:

The described auxiliary left-channel signal provide described convolution unit and described auxiliary right channel signal carry out time delay adjustment, obtain the auxiliary right channel signal after the auxiliary left-channel signal after time delay adjustment and time delay adjustment;

The described left input channel signal that auxiliary left-channel signal after described time delay adjustment and described receiving element receive is synthesized, thus obtain described left output channel signal, the described right input signal that auxiliary right channel signal after described time delay adjustment and described receiving element receive is synthesized, thus obtains described right output channel signal.

In conjunction with the third possible implementation of second aspect, in the 4th kind of possible implementation of second aspect, described output signal obtains unit and is used for:

Obtain the 4th delay inequality and the 5th delay inequality, described 4th delay inequality is delay inequality between described auxiliary left-channel signal and described left input channel signal, and described 5th delay inequality is delay inequality between described auxiliary right channel signal and described right input channel signal;

When the orientation of described sound source is positioned at the left side of described head mould, determine that described 4th delay inequality is for alignment delay inequality; When the orientation of described sound source is positioned at the right side of described head mould, determine that described 5th delay inequality is for alignment delay inequality;

The default strengthening location time delay time difference is deducted the difference of described alignment delay inequality as finally compensating the time difference;

The described auxiliary left-channel signal utilizing the described final compensation time difference to provide described convolution unit and described auxiliary right channel signal carry out time delay adjustment, thus obtain described time delay adjustment after auxiliary left-channel signal and described time delay adjustment after auxiliary right channel signal, in auxiliary left-channel signal sequential after described time delay adjustment, the time difference of leading described left input channel signal is the described final compensation time difference, and in the auxiliary right channel signal sequential after described time delay adjustment, the time difference of leading described right input channel signal is the described final compensation time difference; Or

The difference that the described strengthening location time delay time difference deducts described 4th delay inequality is compensated the time difference as final left side; The difference that the described strengthening location time delay time difference deducts described 5th delay inequality is compensated the time difference as final right side;

The described final left side compensation time difference is utilized to carry out time delay adjustment to the described auxiliary left-channel signal that described convolution unit provides, thus the auxiliary left-channel signal obtained after the adjustment of described time delay, and utilize the described final right side compensation time difference to carry out time delay adjustment to the described auxiliary right channel signal that described convolution unit provides, the auxiliary right channel signal after the adjustment of described time delay is obtained from ear, in auxiliary left-channel signal sequential after described time delay is adjusted, the time difference of leading described left input channel signal is that described final left side compensates the time difference, in auxiliary right channel signal sequential after described time delay adjustment, the time difference of leading described right input channel signal is that described final right side compensates the time difference.

In conjunction with the 4th kind of possible implementation of second aspect, in the 5th kind of possible implementation of second aspect, described output signal obtains unit and is used for:

By the described left input channel signal that the auxiliary left-channel signal after described time delay processing and described receiving element receive, synthesize in the mode of weighted sum, thus obtain described left output channel signal, by the described right input channel signal that the auxiliary right channel signal after described time delay processing and described receiving element receive, synthesize in the mode of weighted sum, and then obtain described right output channel signal.

In conjunction with the first possible implementation of second aspect or second aspect to any one in the possible implementation of the second of second aspect, in the 6th kind of possible implementation of second aspect, described output signal obtains unit and is used for:

The described left input channel signal receive described receiving element and described right input channel signal carry out time delay adjustment, obtain the right input channel signal after the left input channel signal after time delay adjustment and time delay adjustment;

The described auxiliary left input channel signal that left-channel signal after described time delay adjustment and described convolution unit provide is synthesized, thus obtain described left output signal, the described auxiliary right input signal that right channel signal after described time delay adjustment and described convolution unit provide is synthesized, thus obtains described right output signal.

In conjunction with the first possible implementation of second aspect or second aspect to any one in the 6th kind of possible implementation of second aspect, in the 7th kind of possible implementation of second aspect, described determining unit is used for:

Size according to the first delay inequality and described head mould determines the first possibility angle, sound bearing, size according to the second delay inequality and described head mould determines the second possibility angle, sound bearing, and the size according to the 3rd delay inequality and described head mould determines the 3rd possibility angle, sound bearing;

Described first delay inequality is the time difference between described left input channel signal and described right input channel signal, described second delay inequality is the time difference between described left input channel signal and described mid-channel signal, and the 3rd delay inequality is the time difference between described right input channel signal and described mid-channel signal;

Size according to described first delay inequality and described head mould is determined to judge the factor, according to the scope at the value place of the described judgement factor, angle, described sound bearing may may may be determined angle, sound bearing in angle, sound bearing or the described 3rd in angle, sound bearing, described second from described first.

The application's third aspect provides a kind of audio signal processing apparatus, comprising:

Receiver, for receiving the left input channel signal of the collection of binaural audio collecting device, mid-channel signal and right input channel signal, wherein, described left input channel signal, described mid-channel signal and described right input channel signal are corresponding with the left ear passage of described binaural audio collecting device, mid-passage and auris dextra passage respectively, and described mid-passage is between described left ear passage and described auris dextra passage;

Processor, for the described left input channel signal received according to described receiver, described mid-channel signal and described right input channel signal, the angle, sound bearing between the head mould determining sound source and described binaural audio collecting device; Exaggeration ear left ear head coherent pulse corresponding with angle, described sound bearing for described mid-channel signal is responded HRIR and carries out convolution, thus obtain auxiliary left-channel signal; Exaggeration ear auris dextra HRIR corresponding with angle, described sound bearing for described mid-channel signal is carried out convolution, thus obtains auxiliary right channel signal; Utilize described left input channel signal and described auxiliary left-channel signal to obtain left output channel signal, utilize described right input channel signal and described auxiliary right channel signal to obtain right output channel signal.

In conjunction with the first possible implementation of the third aspect, in the implementation that the second of the third aspect is possible, described processor also for:

Convolution is carried out at the left ear HRIR of the described exaggeration ear that described mid-channel signal is corresponding with angle, described sound bearing, and before the described exaggeration ear auris dextra HRIR that described mid-channel signal is corresponding with angle, described sound bearing carries out convolution, according to described left input channel signal, described mid-channel signal and described right input channel signal, determine the orientation of described sound source; When determining that the orientation of described sound source is positioned at the front of described head mould, the left ear HRIR of exaggeration ear that described mid-channel signal is corresponding with angle, described sound bearing is just carried out convolution by described processor, and exaggeration ear auris dextra HRIR corresponding with angle, described sound bearing for described mid-channel signal is carried out convolution.

In conjunction with the implementation that the second of the third aspect is possible, in the third possible implementation of the third aspect, described processor is used for:

Determine the first delay inequality between described left input channel signal and described right input channel signal, the second delay inequality between described left input channel signal and described mid-channel signal, and the 3rd delay inequality between described right input channel signal and described mid-channel signal;

Size according to described first delay inequality and described head mould is determined to judge the factor, according to the scope at the value place of the described judgement factor, described second delay inequality and described 3rd delay inequality, determines the orientation of described sound source.

In conjunction with the first possible implementation of the third aspect or the third aspect to any one in the possible implementation of the second of the third aspect, in the third possible implementation of the third aspect, described processor is used for:

Time delay adjustment is carried out to described auxiliary left-channel signal and described auxiliary right channel signal, obtains the auxiliary right channel signal after the auxiliary left-channel signal after time delay adjustment and time delay adjustment;

Auxiliary left-channel signal after described time delay adjustment and described left input channel signal are synthesized, thus obtain described left output channel signal, auxiliary right channel signal after described time delay adjustment and described right input signal are synthesized, thus obtains described right output channel signal.

In conjunction with the third possible implementation of the third aspect, in the 4th kind of possible implementation of the third aspect, described processor is used for:

Obtain the 4th delay inequality and the 5th delay inequality, described 4th delay inequality is delay inequality between described auxiliary left-channel signal and described left input channel signal, and described 5th delay inequality is delay inequality between described auxiliary right channel signal and described right input channel signal;

When the orientation of described sound source is positioned at the left side of described head mould, determine that described 4th delay inequality is for alignment delay inequality; When the orientation of described sound source is positioned at the right side of described head mould, determine that described 5th delay inequality is for alignment delay inequality;

The default strengthening location time delay time difference is deducted the difference of described alignment delay inequality as finally compensating the time difference;

The described final compensation time difference is utilized to carry out time delay adjustment to described auxiliary left-channel signal and described auxiliary right channel signal, thus obtain described time delay adjustment after auxiliary left-channel signal and described time delay adjustment after auxiliary right channel signal, in auxiliary left-channel signal sequential after described time delay adjustment, the time difference of leading described left input channel signal is the described final compensation time difference, and in the auxiliary right channel signal sequential after described time delay adjustment, the time difference of leading described right input channel signal is the described final compensation time difference; Or

The difference that the described strengthening location time delay time difference deducts described 4th delay inequality is compensated the time difference as final left side; The difference that the described strengthening location time delay time difference deducts described 5th delay inequality is compensated the time difference as final right side;

The described final left side compensation time difference is utilized to carry out time delay adjustment to described auxiliary left-channel signal, thus the auxiliary left-channel signal obtained after the adjustment of described time delay, and utilize the described final right side compensation time difference to carry out time delay adjustment to described auxiliary right channel signal, the auxiliary right channel signal after the adjustment of described time delay is obtained from ear, in auxiliary left-channel signal sequential after described time delay is adjusted, the time difference of leading described left input channel signal is that described final left side compensates the time difference, in auxiliary right channel signal sequential after described time delay adjustment, the time difference of leading described right input channel signal is that described final right side compensates the time difference.

In conjunction with the 4th kind of possible implementation of the third aspect, in the 5th kind of possible implementation of the third aspect, described processor is used for:

By the auxiliary left-channel signal after described time delay processing and described left input channel signal, synthesize in the mode of weighted sum, thus obtain described left output channel signal, by the auxiliary right channel signal after described time delay processing and described right input channel signal, synthesize in the mode of weighted sum, and then obtain described right output channel signal.

In conjunction with the first possible implementation of the third aspect or the third aspect to any one in the possible implementation of the second of the third aspect, in the 6th kind of possible implementation of the third aspect, described processor is used for:

Time delay adjustment is carried out to described left input channel signal and described right input channel signal, obtains the right input channel signal after the left input channel signal after time delay adjustment and time delay adjustment;

Left-channel signal after described time delay adjustment and described auxiliary left input channel signal are synthesized, thus obtain described left output signal, right channel signal after described time delay adjustment and described auxiliary right input signal are synthesized, thus obtains described right output signal.

In conjunction with the first possible implementation of the third aspect or the third aspect to any one in the 6th kind of possible implementation of the third aspect, in the 7th kind of possible implementation of the third aspect, described processor is used for:

Size according to the first delay inequality and described head mould determines the first possibility angle, sound bearing, size according to the second delay inequality and described head mould determines the second possibility angle, sound bearing, and the size according to the 3rd delay inequality and described head mould determines the 3rd possibility angle, sound bearing;

Described first delay inequality is the time difference between described left input channel signal and described right input channel signal, described second delay inequality is the time difference between described left input channel signal and described mid-channel signal, and the 3rd delay inequality is the time difference between described right input channel signal and described mid-channel signal;

Size according to described first delay inequality and described head mould is determined to judge the factor, according to the scope at the value place of the described judgement factor, angle, described sound bearing may may may be determined angle, sound bearing in angle, sound bearing or the described 3rd in angle, sound bearing, described second from described first.

The one or more technical schemes provided in the embodiment of the present invention, at least have following technique effect or advantage:

In the technical scheme of the embodiment of the present invention, receive the left input channel signal of the collection of binaural audio collecting device, mid-channel signal and right input channel signal, wherein, described left input channel signal, described mid-channel signal and described right input channel signal are corresponding with the left ear passage of described binaural audio collecting device, mid-passage and auris dextra passage respectively, and described mid-passage is between described left ear passage and described auris dextra passage; According to described left input channel signal, described mid-channel signal and described right input channel signal, the angle, sound bearing between the head mould determining sound source and described binaural audio collecting device; Exaggeration ear left ear head coherent pulse corresponding with angle, described sound bearing for described mid-channel signal is responded HRIR and carries out convolution, thus obtain auxiliary left-channel signal; Exaggeration ear auris dextra HRIR corresponding with angle, described sound bearing for described mid-channel signal is carried out convolution, thus obtains auxiliary right channel signal; Utilize described left input channel signal and described auxiliary left-channel signal to obtain left output channel signal, utilize described right input channel signal and described auxiliary right channel signal to obtain right output channel signal.Because mid-passage is between the ear passage of left and right, mid-channel signal is with the auditory localization characteristic information in more fronts, therefore by mid-channel signal and left input channel signal and right input channel signal convolution respectively, and then also can with the auditory localization characteristic signal in front in the auxiliary left-channel signal obtained and auxiliary right channel signal.Further utilization assists left-channel signal and left input channel signal to obtain left output channel signal, and utilizes auxiliary right channel signal and right input channel signal to obtain right output channel signal.Thus left output channel signal in the embodiment of the present invention and right output channel signal comparatively prior art, with the auditory localization characteristic information in more fronts.So, after user hears the audio signal that the embodiment of the present invention exports, will judge that sound source is positioned at front more exactly, and then reduce possibility front sound source being mistaken for rear sound source.

Accompanying drawing explanation

Fig. 1-Fig. 2 is the flow chart of the acoustic signal processing method in the embodiment of the present invention;

Fig. 3 is the rough schematic view of head mould in the embodiment of the present invention;

Fig. 4 is the structural representation of embodiment of the present invention sound intermediate frequency signal processing apparatus;

Fig. 5 is the structural representation of embodiment of the present invention sound intermediate frequency signal handling equipment.

Embodiment

This application provides a kind of method and apparatus of Audio Signal Processing, enhance the front sound source characteristics in the multi-channel output signal of left and right, thus reduce user and front sound source is mistaken for possibility from rear according to the voice signal heard.

In order to solve the problems of the technologies described above, the resolving ideas of the technical scheme that the application provides comprises:

In the technical scheme of the embodiment of the present invention, receive the left input channel signal of the collection of binaural audio collecting device, mid-channel signal and right input channel signal, wherein, described left input channel signal, described mid-channel signal and described right input channel signal are corresponding with the left ear passage of described binaural audio collecting device, mid-passage and auris dextra passage respectively, and described mid-passage is between described left ear passage and described auris dextra passage; According to described left input channel signal, described mid-channel signal and described right input channel signal, the angle, sound bearing between the head mould determining sound source and described binaural audio collecting device; Exaggeration ear left ear head coherent pulse corresponding with angle, described sound bearing for described mid-channel signal is responded HRIR and carries out convolution, thus obtain auxiliary left-channel signal; Exaggeration ear auris dextra HRIR corresponding with angle, described sound bearing for described mid-channel signal is carried out convolution, thus obtains auxiliary right channel signal; Utilize described left input channel signal and described auxiliary left-channel signal to obtain left output channel signal, utilize described right input channel signal and described auxiliary right channel signal to obtain right output channel signal.Because mid-passage is between the ear passage of left and right, mid-channel signal is with the auditory localization characteristic information in more fronts, therefore by mid-channel signal and left input channel signal and right input channel signal convolution respectively, and then also can with the auditory localization characteristic signal in front in the auxiliary left-channel signal obtained and auxiliary right channel signal.Further utilization assists left-channel signal and left input channel signal to obtain left output channel signal, and utilizes auxiliary right channel signal and right input channel signal to obtain right output channel signal.Thus left output channel signal in the embodiment of the present invention and right output channel signal comparatively prior art, with the auditory localization characteristic information in more fronts.So, after user hears the audio signal that the embodiment of the present invention exports, will judge that sound source is positioned at front more exactly, and then reduce possibility front sound source being mistaken for rear sound source.

For making the object of the embodiment of the present invention, technical scheme and advantage clearly, below in conjunction with the accompanying drawing in the embodiment of the present invention, technical scheme in the embodiment of the present invention is clearly and completely described, obviously, described embodiment is the present invention's part embodiment, instead of whole embodiments.Based on the embodiment in the present invention, those of ordinary skill in the art, not making the every other embodiment obtained under creative work prerequisite, belong to the scope of protection of the invention.

Term "and/or" herein, being only a kind of incidence relation describing affiliated partner, can there are three kinds of relations in expression, and such as, A and/or B, can represent: individualism A, exists A and B simultaneously, these three kinds of situations of individualism B.In addition, character "/" herein, general expression forward-backward correlation is to the relation liking a kind of "or".

Below in conjunction with accompanying drawing, embodiments of the present invention are described in detail.

The application's first aspect provides a kind of method of Audio Signal Processing, please refer to Fig. 1 and Fig. 2, comprising:

S101: receive the left input channel signal of the collection of binaural audio collecting device, mid-channel signal and right input channel signal.

S102: according to described left input channel signal, described mid-channel signal and described right input channel signal, the angle, sound bearing between the head mould determining sound source and described binaural audio collecting device.

S103: exaggeration ear left ear head coherent pulse corresponding with angle, described sound bearing for described mid-channel signal is responded HRIR and carries out convolution, thus obtain auxiliary left-channel signal; Exaggeration ear auris dextra HRIR corresponding with angle, described sound bearing for described mid-channel signal is carried out convolution, thus obtains auxiliary right channel signal.

S104: utilize described left input channel signal and described auxiliary left-channel signal to obtain left output channel signal, utilizes described right input channel signal and described auxiliary right channel signal to obtain right output channel signal.

Specifically, in the embodiment of the present application, binaural audio collecting device can be wear-type multimedia equipment.Or be placed in the micro microphone at the left ear of head mould, auris dextra and mid-position.In specific implementation process, when binaural audio collecting device is wear-type multimedia equipment, head mould can be actual head mould, also can be virtual head mould.The size of this virtual head mould is mated with wear-type multimedia equipment, and in other words, wear-type multimedia equipment can be worn on the actual head mould according to virtual head mould size making.Head mould in the embodiment of the present application is standard Chinese acoustics head mould, certainly, can be also westerner's acoustics head mould etc., not limit this application.

In the embodiment of the present application, the voice signal adopting three recording channels collection sound sources to send, is respectively left input channel, mid-passage and right input channel.Wherein, left ear passage is placed in the left ear position of head mould, or is positioned at the position of corresponding virtual head mould left ear position.Auris dextra passage is placed in the auris dextra position of head mould, or is positioned at the position at corresponding virtual head mould auris dextra position.And mid-passage is between left ear passage and auris dextra passage, the position in head mould dead ahead.

In addition, the auricle of the mankind mainly plays the effect such as scattering, reflection to high frequency sound wave, can strengthen front and back location feature difference, makes the front and back position of mankind's localization of sound source better.And the size of common auricle is about 6.5cm, auricle mainly works in the frequency range of 5 ~ more than 6kHz to auditory localization.

In the embodiment of the present application, in order to strengthen the effect of auricle to auditory localization, on the basis of compatriots' acoustics head mould in a standard, have employed exaggeration ears.Specifically, the exaggeration ears size adopted in the embodiment of the present application is about 13cm, is similar to two of common ears.After adopting exaggeration ears, the auricle of exaggeration ears can work with super band to 2 ~ 3kHz, and then makes the effect of auricle to auditory localization extend to lower frequency range.

From left ear channel reception to audio signal be left input channel signal, from auris dextra channel reception to audio signal be right input channel signal, the audio signal received from mid-channel signal is mid-channel signal.

For convenience of description, suppose that left input channel signal is x _lt (), mid-channel signal is x _ct (), right input channel signal is x _r(t).Have received x _l(t), x _c(t) and x _rafter (t), perform S102, determine the angle, sound bearing between sound source and head mould.And then according to angle, sound bearing, in S103, exaggeration ear left ear head coherent pulse corresponding with angle, sound bearing respectively for mid-channel signal is responded (English: HeadRelated Impulse Response; HRIR) and exaggerate ear auris dextra HRIR and carry out convolution be called for short:.

Optionally, in the embodiment of the present application, before S103, also comprise:

According to described left input channel signal, described mid-channel signal and described right input channel signal, determine the orientation of described sound source;

When determining that the orientation of described sound source is positioned at the front of described head mould, just the left ear HRIR of exaggeration ear that described mid-channel signal is corresponding with angle, described sound bearing is carried out convolution, and exaggeration ear auris dextra HRIR corresponding with angle, described sound bearing for described mid-channel signal is carried out convolution.

Specifically, owing to front sound source to be mistaken for the possibility of rear sound source, higher than possibility rear sound source being mistaken for front sound source, therefore, in the embodiment of the present application, before execution S103, the orientation of sound source first can be determined.

For introducing the orientation of the sound source in the embodiment of the present application, please refer to Fig. 3, is the rough schematic view (overlooking) of head mould in the embodiment of the present application.Circle in Fig. 3 represents head mould, and suppose that the radius of head mould is a, angle, sound bearing is θ.In Fig. 3, L represents the position of left ear passage, and R represents the position of auris dextra passage, and C represents the position of mid-passage.With the center of head mould for initial point, set up rectangular coordinate system clockwise.So, when the orientation of sound source is positioned at the dead ahead of head mould, θ=0 ° (or 360 °); When the orientation of sound source is positioned at the front-right of head mould, θ=90 °; When the orientation of sound source is positioned at the dead astern of head mould, θ=180 °; When the orientation of sound source is positioned at the front-left of head mould, θ=270 °.

When determining that the orientation of sound source is positioned at the front of head mould, namely sound source is at [0 °, 90 °], or [270 °, 360 °) scope in just can perform S103.And when the orientation of sound source is positioned at the rear of head mould, namely sound source is at [90 °, 180 °], or (180 °, 270 °] scope in, the acoustic signal processing method in the embodiment of the present application can be adopted to process, method of the prior art also can be adopted to process, concrete restriction is not done to this application.

Wherein, according to the orientation of left input channel, mid-channel signal and right input channel signal determination sound source, comprising:

Determine the first delay inequality between described left input channel signal and described right input channel signal, the second delay inequality between described left input channel signal and described mid-channel signal, and the 3rd delay inequality between described right input channel signal and described mid-channel signal;

Size according to described first delay inequality and described head mould is determined to judge the factor, according to the scope at the value place of the described judgement factor, described second delay inequality and described 3rd delay inequality, determines the orientation of described sound source.

Specifically, when determining the orientation harmony source azimuth angle of sound source, need first to obtain left input channel signal, time difference between right input channel signal and mid-channel signal between every two signals.

Be positioned at the diverse location on head mould due to left ear passage, auris dextra passage and mid-passage, therefore, the voice signal that sound source sends arrives time of three passages will be different, and then the audio signal life period causing every two passages to gather is poor.In the embodiment of the present application, determine that the time difference of two channel signals adopts frequency domain correlation method to calculate.The the first delay inequality ITD how determined between left input channel signal and right input channel signal will be introduced in detail below _lR.And determine the second delay inequality ITD between left input channel signal and mid-channel signal _lC, and the 3rd delay inequality ITD between right input channel signal and mid-channel signal _rCmethod with determine ITD _lRmethod similar, therefore just repeated no longer one by one.

First, to left input channel signal x _lt () carries out Fourier's change, obtain Fourier's letter coefficient H of left input channel signal _l(f).To right input channel signal x _rt () carries out Fourier's change, obtain the Fourier coefficient H of right input channel _r(f).And calculate acquisition H further _rthe conjugation of (f)

Then, ears head related transfer function is obtained by formula 1 (English: Head Related TransferFunction; Be called for short: the cross-correlation function Φ HRTF) _lR(τ):

${\mathrm{\Φ}}_{\mathrm{LR}}\left(\mathrm{\τ}\right)=\frac{{\∫}_{-\∞}^{+\∞}{H}_L\left(f\right)H_R^{*}\left(f\right)\exp \left(j2\mathrm{\πf\τ}\right)\mathrm{df}}{{\left\{\right[{\∫}_{-\∞}^{+\∞}{\left|H_L\left(f\right)\right|}^2\mathrm{df}\left]\right[{\∫}_{-\∞}^{+\∞}{\left|H_R\left(f\right)\right|}^2\mathrm{df}\left]\right\}}^{1/2}}$ (formula 1)

The Φ finally obtained _lR(τ) absolute value equals greatly 0 and littlely equals 1.

Because two interchannel time differences are to auditory localization role, mainly in low-frequency range, therefore obtain low-frequency range in the embodiment of the present application, as f≤3kHz, | τ |≤1ms, or f≤4kHz, | τ | the Φ in≤1.2ms _lR(τ) maximum Φ _lR(τ _max).Finally, maximum Φ is determined _lR(τ _max) corresponding τ=τ _maxbe the first time difference ITD _lR.In other words, ITD _lR=τ _max.Wherein, low-frequency range is defined as f≤2.24kHz and | τ |≤1ms is for better selection.

With determine ITD _lRmethod similar, the application those of ordinary skill in the field can determine the second delay inequality ITD according to said process disclosed in the present application _lCwith the 3rd delay inequality ITD _rC.

Next, in order to determine the orientation of sound source, need to determine to judge the factor according to the size of the first delay inequality and head mould.In the embodiment of the present application, the size of head mould can be the radius of head mould, girth, and volume etc., do not do concrete restriction to this application.Be introduced for radius hereinafter.Specifically, the factor is judged according to following formula acquisition:

$m=\frac{c\·{\mathrm{ITD}}_{\mathrm{LR}}}{2a};$

Wherein, m is for judge the factor, and c is the velocity of sound, and a is the radius of head mould.

Accordingly, the described scope at value place according to judging the factor, determine that the orientation of described sound source comprises:

When m>=0, and ITD _lCbe greater than ITD _rCtime, determine that the orientation of described sound source is the front being positioned at described head mould;

When m>=0, and ITD _lCbe less than or equal to ITD _rCtime, determine that the orientation of described sound source is the rear being positioned at described head mould;

As m < 0, and ITD _lCbe less than ITD _rCtime, determine that the orientation of described sound source is the front being positioned at described head mould;

As m < 0, and ITD _lCbe more than or equal to ITD _rCtime, determine that the orientation of described sound source is the rear being positioned at described head mould.

In the embodiment of the present application, when determining the orientation of sound source, be specially and compare ITD _lCand ITD _rCorder of magnitude.

M >=0, the orientation of sound source is positioned at the right side of head mould, is specially the azimuth of sound source in the region of [0 °, 180 °]; M < 0, the orientation of sound source is positioned at the left side of head mould, is specially the azimuth of sound source in the range areas of [180 °, 360 °].

And according to left input channel signal, mid-channel signal and angle, right input channel signal determination sound bearing in S102, comprising:

Size according to the first delay inequality and described head mould determines the first possibility angle, sound bearing, size according to the second delay inequality and described head mould determines the second possibility angle, sound bearing, and the size according to the 3rd delay inequality and described head mould determines the 3rd possibility angle, sound bearing;

Described first delay inequality is the time difference between described left input channel signal and described right input channel signal, described second delay inequality is the time difference between described left input channel signal and described mid-channel signal, and the 3rd delay inequality is the time difference between described right input channel signal and described mid-channel signal;

Size according to described first delay inequality and described head mould is determined to judge the factor, according to the scope at the value place of the described judgement factor, angle, described sound bearing may may may be determined angle, sound bearing in angle, sound bearing or the described 3rd in angle, sound bearing, described second from described first.

Specifically, in the embodiment of the present application, calculating first by formula (2) may angle, sound bearing θ _lR, calculating the second sound source by formula (3) may azimuth angle theta _lC, calculating the 3rd by formula (4) may angle, sound bearing θ _lC:

${\mathrm{\&theta;}}_{\mathrm{LR}}=\arcsin \left(\frac{c\&CenterDot;{\mathrm{ITD}}_{\mathrm{LR}}}{2a}\right)$ (formula 2)

${\mathrm{\&theta;}}_{\mathrm{Lc}}=\arcsin \left(\frac{c\&CenterDot;{\mathrm{ITD}}_{\mathrm{LC}}}{\sqrt{2}a}\right)-45$ (formula 3)

${\mathrm{\&theta;}}_{\mathrm{Rc}}=45-\arcsin \left(\frac{c\&CenterDot;{\mathrm{ITD}}_{\mathrm{RC}}}{\sqrt{2}a}\right)$ (formula 4)

The first possibility angle, the sound bearing θ obtained is calculated by formula (2)-formula (4) _lR, second may angle, sound bearing θ _lCmay angle, sound bearing θ with the 3rd _rCbe all likely actual angle, sound bearing θ _e.Next so, by according to the size of head mould and ITD _lRthe judgement factor m determined.Then, according to the scope at the value place of m from θ _lR, θ _lCand θ _rCin determine angle, sound bearing θ _e.

Wherein, determine that the mode judging factor m is similar as above, namely here just repeated no more.According to the value in-scope of m, from θ _lR, θ _lCor θ _rCin determine angle, sound bearing θ _e, comprise following 4 kinds of situations:

(1) when time, determine that first may angle, sound bearing be angle, sound bearing, namely determine θ _e=θ _lR;

(2) when time, determine that the 3rd may angle, sound bearing be angle, sound bearing, namely determine θ _e=θ _rC;

(3) when time, determine that first may angle, sound bearing be angle, sound bearing, namely determine θ _e=θ _lR;

(4) when time, determine that described second may angle, sound bearing be angle, described sound bearing, namely determine θ _e=θ _lC.

Because mid-passage is positioned at the front of head mould, therefore mid-channel signal carries more at front auditory localization characteristic information.In order to make left output channel signal and right output channel signal carry more front auditory localization characteristic information, in the embodiment of the present application, if when judging that sound source is positioned at the front of head mould, S103 will be performed.

Specifically, different angles, sound bearing correspond to different HRIR.So, when determining angle, sound bearing θ _eafter, then read θ _ecorresponding exaggeration ear left ear HRIR signal h _{e_l}(θ _e, t) with exaggeration ear auris dextra HRIR signal h _{e_R}(θ _e, t).Wherein, ear left ear HRIR signal h is exaggerated _{e_l}(θ _e, t) with exaggeration ear auris dextra HRIR signal h _{e_l}(θ _e, t) be time-domain signal.And the exaggeration ear left ear HRIR signal h in the embodiment of the present application _{e_l}(θ _e, t) with 2 times that the data of exaggeration ear auris dextra HRIR signal are standard head mould left and right ear HRIR.

Read h _{e_l}(θ _e, t) and h _{e_R}(θ _e, t), according to formula (5) by left input channel signal x _l(t) and h _{e_l}(θ _e, t) carry out convolution, thus obtain auxiliary left-channel signal x _cL(t).And according to formula (6) by right input channel signal x _r(t) and h _{e_R}(θ _e, t) carry out convolution, thus obtain auxiliary right channel signal x _cR(t).

Be specially:

$x_{\mathrm{CL}}\left(t\right)=x_C\left(t\right)\&CircleTimes;h_{e\_l}({\mathrm{\&theta;}}_e,t)$ (formula 5)

$x_{\mathrm{CR}}\left(t\right)=x_C\left(t\right)\&CircleTimes;h_{e\_r}({\mathrm{\&theta;}}_e,t)$ (formula 6).

In specific implementation process, x can be obtained simultaneously _cL(t) and x _cRt (), also first can obtain x _cLt (), reentry x _cR(t), or first obtain x _cRt (), reentry x _cLt (), the application does not do concrete restriction to this.

Next, in S104, utilize left input channel signal and auxiliary left-channel signal, obtain left output channel information.And utilize right input channel signal and auxiliary right channel signal, obtain right output channel information.And then just the front auditory localization characteristic information entrained by auxiliary left-channel signal is added left output channel signal, the front auditory localization characteristic information entrained by auxiliary right channel signal is added left and right output channel signal.

Specifically, in the embodiment of the present application, the mode obtaining left output channel signal and right output channel signal has multiple, will enumerate five kinds below.In specific implementation process, include but not limited to following five kinds.

The first:

According to formula (7), by left input channel signal and auxiliary left input by signal syntheses, and then obtain left output channel signal x _lout(t), and by right input channel signal and the synthesis of auxiliary right channel signal, and then obtain right output channel signal x _rout(t).

X _lout(t)=x _l(t)+x _cL(t), x _rout(t)=x _r(t)+x _cR(t) formula (7).

The second:

Time delay adjustment is carried out to described auxiliary left-channel signal and described auxiliary right channel signal, obtains the auxiliary right channel signal after the auxiliary left-channel signal after time delay adjustment and time delay adjustment;

Auxiliary left-channel signal after described time delay adjustment and described left input channel signal are synthesized, thus obtain described left output channel signal, auxiliary right channel signal after described time delay adjustment and described right input signal are synthesized, thus obtains described right output channel signal.

Wherein, described time delay adjustment is carried out to described auxiliary left-channel signal and described auxiliary right channel signal, obtains the auxiliary right channel signal after the auxiliary left-channel signal after time delay adjustment and time delay adjustment, comprising:

Obtain the 4th delay inequality and the 5th delay inequality, described 4th delay inequality is delay inequality between described auxiliary left-channel signal and described left input channel signal, and described 5th delay inequality is delay inequality between described auxiliary right channel signal and described right input channel signal;

When the orientation of described sound source is positioned at the left side of described head mould, determine that described 4th delay inequality is for alignment delay inequality; When the orientation of described sound source is positioned at the right side of described head mould, determine that described 5th delay inequality is for alignment delay inequality;

The default strengthening location time delay time difference is deducted the difference of described alignment delay inequality as finally compensating the time difference;

The described final compensation time difference is utilized to carry out time delay adjustment to described auxiliary left-channel signal and described auxiliary right channel signal, thus obtain described time delay adjustment after auxiliary left-channel signal and described time delay adjustment after auxiliary right channel signal, in auxiliary left-channel signal sequential after described time delay adjustment, the time difference of leading described left input channel signal is the described final compensation time difference, and in the auxiliary right channel signal sequential after described time delay adjustment, the time difference of leading described right input channel signal is the described final compensation time difference; Or

The difference that the described strengthening location time delay time difference deducts described 4th delay inequality is compensated the time difference as final left side; The difference that the described strengthening location time delay time difference deducts described 5th delay inequality is compensated the time difference as final right side;

The described final left side compensation time difference is utilized to carry out time delay adjustment to described auxiliary left-channel signal, thus the auxiliary left-channel signal obtained after the adjustment of described time delay, and utilize the described final right side compensation time difference to carry out time delay adjustment to described auxiliary right channel signal, the auxiliary right channel signal after the adjustment of described time delay is obtained from ear, in auxiliary left-channel signal sequential after described time delay is adjusted, the time difference of leading described left input channel signal is that described final left side compensates the time difference, in auxiliary right channel signal sequential after described time delay adjustment, the time difference of leading described right input channel signal is that described final right side compensates the time difference.

Specifically, because mid-channel signal and left input channel signal exist the time difference, therefore also may there is the time difference between the auxiliary left-channel signal that obtains of mid-channel signal and left input channel signal convolution and left input channel signal, therefore obtain auxiliary the 4th delay inequality τ ' between left-channel signal and left input channel signal before the synthesis _lmax.Wherein, acquisition the 4th delay inequality τ ' is calculated _lmaxmode and to calculate the mode of the first delay inequality obtained between the input channel signal of left and right by formula 1 similar.And obtain the 5th delay inequality τ ' between auxiliary right channel signal and right input channel signal by similar mode _rmax.

Then, when the orientation of sound source is positioned at the left side of head mould, determine the 4th delay inequality τ ' _lmaxfor the alignment time difference, and when the orientation of sound source is positioned at the right side of head mould, then determine the 5th delay inequality τ ' _rmaxfor the alignment time difference, as shown in formula (8).

Specifically, the orientation due to the sound source in the embodiment of the present application is positioned at the front of head mould, so when [270 °, 360 °], the orientation of the sound source in the embodiment of the present application had both been positioned at the front of head mould, was positioned at again the left side of head mould; When [0 °, 90 °], the orientation of the sound source in the embodiment of the present application had both been positioned at the front of head mould, was positioned at again the right side of head mould.

(formula 8);

Wherein, τ ' _maxfor alignment delay inequality.

Further, according to precedence effect, when between two voice signals, the leading and delayed time difference is more than 1ms, within the relatively short time, these two sound are still a sound on the Auditory Perception of the mankind.But leading voice signal is depended in the position of the sound source of perception.This effect is called as precedence effect, is also Haas effect.Therefore, in order to user is when hearing left output channel signal and right output channel signal, user is judged more accurately, and sound source is positioned at front, and will align time difference τ ' _maxwith strengthening location time delay time difference τ ₀difference compensate time difference τ ' as final.And utilize the final compensation time difference to carry out time delay adjustment to auxiliary left-channel signal and auxiliary right channel signal.Determine finally to compensate time difference τ ' by formula (9) in the embodiment of the present application.

τ '=τ ₀-τ ' _max(formula 9)

Namely the final time difference τ ' that compensates is for strengthening location time delay time difference τ ₀deduct alignment time difference τ ' _maxdifference.According to precedence effect, there will be precedence effect when the time difference of two signals more than during 1ms, therefore, 0 < τ in the embodiment of the present invention ₀< 10ms, such as 1ms, 1.2ms, 1.21ms etc.

Finally, the final compensation time difference is utilized to carry out identical time delay adjustment to auxiliary left-channel signal and auxiliary right channel signal.In the embodiment of the present application, be specially and assist the sequential of right channel signal to shift to an earlier date τ ' auxiliary left-channel signal according to formula (10).So, leading left input channel signal τ ' in the auxiliary left-channel signal sequential after the time delay adjustment obtained, leading right input channel signal τ ' in the auxiliary right channel signal sequential after time delay adjustment.

X' _cL(t)=x _cL(t+ τ '), x' _cR(t)=x _cR(t+ τ ') (formula 10);

X' _cLt () is the auxiliary left-channel signal after time delay adjustment, x' _rLt () is the auxiliary right channel signal after time delay adjustment.

In addition, different time delay adjustment can also be carried out to auxiliary left passage and auxiliary right passage.Specifically, by strengthening location time delay time difference τ ₀deduct described 4th delay inequality τ ' _lmaxdifference compensate time difference τ ' as final left side _l; By strengthening location time delay time difference τ ₀deduct the 5th delay inequality τ ' _rmaxdifference compensate time difference τ ' as final right side _r, namely

τ ' _r=τ ₀-τ ' _rmax, τ ' _l=τ ₀-τ ' _lmax(formula 11),

Wherein, 0 < τ ₀< 10ms.

Then, time delay adjustment can be carried out according to formula (12) to auxiliary left-channel signal, the auxiliary left-channel signal sequential after time delay adjustment is ahead of left input channel signal τ ' _l; And time delay adjustment is carried out to auxiliary right channel signal, the auxiliary right channel signal sequential after time delay adjustment is ahead of right input channel signal τ ' _r.

X' _cL(t)=x _cL(t+ τ ' _l), x' _cR(t)=x _cR(t+ τ ' _r) (formula 12);

Finally, according to formula (13), by the auxiliary left-channel signal synthesis after left input channel signal and time delay adjustment, and then obtain left output channel signal, and by the auxiliary right channel signal synthesis after right input channel signal and time delay adjustment, and then obtain right output channel signal.Wherein, the x' in formula (13) _cL(t) and x' _cRt () is obtained by formula (11) or formula (12).

X _lout(t)=x _l(t)+x' _cL(t), x _rout(t)=x _r(t)+x' _cR(t) (formula 13)

The third:

After obtaining the auxiliary right channel signal after the auxiliary left-channel signal after time delay adjustment and time delay adjustment, auxiliary left-channel signal after described time delay adjustment and described left input channel signal are synthesized, thus obtain described left output signal, auxiliary right channel signal after described time delay adjustment and described right input signal are synthesized, thus obtain described right output signal, comprising:

By the auxiliary left-channel signal after described time delay processing and described left input channel signal, synthesize in the mode of weighted sum, thus obtain described left output channel signal, by the auxiliary right channel signal after described time delay processing and described right input channel signal, synthesize in the mode of weighted sum, and then obtain described right output channel signal.

Specifically, adjust similar to time delay in the time delay adjustment of auxiliary left-channel signal and auxiliary right channel signal and the second way, just repeated no more here.

In the embodiment of the present application, in order to avoid an auxiliary left side (right side) channel signal too exaggerates front and back location feature difference and cause the obvious distortion in tone color, therefore in the embodiment of the present application, the mode according to weighted sum is synthesized.

Specifically, can according to formula (14), auxiliary right channel signal after auxiliary left-channel signal after time delay being adjusted and time delay adjustment is all multiplied by the first weight coefficient, and then obtains the auxiliary left-channel signal after weighting and the auxiliary right channel signal after weighting.Wherein, the application implement in the first weight coefficient be greater than 0 to be less than arbitrary constant between 1.

X " _cL(t)=M ₁× x' _cL(t), x " _cR(t)=M ₁× x' _cR(t) (formula 14);

Wherein, x " _cLt () is the auxiliary left-channel signal after weighting, x " _cRt () is the auxiliary right channel signal after weighting, M ₁be the first weight coefficient, and 0 < M ₁< 1.

Then by the auxiliary left-channel signal synthesis after left input channel signal and weighting, thus obtain left output channel signal, by the auxiliary right channel signal synthesis after right input channel signal and weighting, thus obtain right output channel signal.Namely

X _lout(t)=x _l(t)+x " _cL(t), x _rout(t)=x _r(t)+x " _cR(t) (formula 15).

Optionally, after left input channel signal and right input channel signal also can be multiplied by the second weight coefficient, then synthesize left output channel signal and right output channel signal.Specifically, according to formula 16, left input channel signal and right input channel signal are all multiplied by the second weight coefficient, and then obtain the left input channel signal after weighting and the right input channel signal after weighting.Wherein, the second weight coefficient during the application implements is be greater than 0 to be less than arbitrary constant between 1, and the second weight coefficient and the first weight coefficient can equal also can be unequal.

X " _l(t)=M ₂× x _l(t), x " _r(t)=M ₂× x _r(t) (formula 16).

Wherein, x " _lt () is the left input channel signal after weighting, x " _rt () is the right input channel signal after weighting, M ₂be the second weight coefficient, and 0 < M ₂< 1.

Finally according to formula (17), the auxiliary left-channel signal after the left input channel signal after weighting and weighting is synthesized, thus obtain left output channel signal, by the auxiliary right channel signal synthesis after the right input channel signal after weighting and weighting, thus obtain right output channel signal.Namely

X _lout(t)=x " _l(t)+x " _cL(t), x _rout(t)=x " _r(t)+x " _cR(t) (formula 17).

4th kind:

Time delay adjustment is carried out to described left input channel signal and described right input channel signal, obtains the right input channel signal after the left input channel signal after time delay adjustment and time delay adjustment;

Left-channel signal after described time delay adjustment and described auxiliary left input channel signal are synthesized, thus obtain described left output signal, right channel signal after described time delay adjustment and described auxiliary right input signal are synthesized, thus obtains described right output signal.

Wherein, described time delay adjustment is carried out to described left input channel signal and described right input channel signal, obtains the right input channel signal after the left input channel signal after time delay adjustment and time delay adjustment, comprising:

Obtain the 4th delay inequality and the 5th delay inequality; Wherein, described 4th delay inequality is delay inequality between described auxiliary left-channel signal and described left input channel signal, and described 5th delay inequality is delay inequality between described auxiliary right channel signal and described right input channel signal;

When the orientation of described sound source is positioned at the left side of described head mould, determine that described 4th delay inequality is described alignment delay inequality; When the orientation of described sound source is positioned at the right side of described head mould, determine that described 5th delay inequality is described alignment delay inequality;

The default strengthening location time delay time difference is deducted the difference of described alignment delay inequality as finally compensating the time difference;

The described final compensation time difference is utilized to carry out time delay adjustment to described left input channel signal and described right input channel signal, obtain the right input channel signal after the left input channel signal after the adjustment of described time delay and the adjustment of described time delay, the time difference left input channel signal sequential after described time delay is adjusted lagging behind described auxiliary left-channel signal is the described final compensation time difference, and the time difference right input channel signal sequential after described time delay adjustment lagging behind described auxiliary right channel signal is the described final compensation time difference; Or

The difference that the described strengthening location time delay time difference deducts described 4th delay inequality is compensated the time difference as described final left side; The difference that the described strengthening location time delay time difference deducts described 5th delay inequality is compensated the time difference as described final right side;

The described final left side compensation time difference is utilized to carry out time delay adjustment to described left input channel signal, obtain the left input channel signal after the adjustment of described time delay, and utilize the described final right side compensation time difference to carry out time delay adjustment to described right input channel signal, obtain the right input channel signal after the adjustment of described time delay, the time difference left input channel signal sequential after described time delay is adjusted lagging behind described auxiliary left-channel signal is that described final left side compensates the time difference, the time difference right input channel signal sequential after described time delay adjustment lagging behind described auxiliary right channel signal is that described final right side compensates the time difference.

In the 4th kind of mode, obtain and finally compensate the time difference, or obtain final left side and compensate the mode that the time difference and final right side compensate the time difference, with above in the third mode similar, just repeated no more here.

Next, according to formula (18), time delay adjustment is carried out to left aqueduct signal and right input channel signal, left input channel signal after time delay adjustment lags behind auxiliary left-channel signal τ ' in sequential, and the right input channel signal sequential after time delay adjustment lags behind auxiliary right channel signal τ '.

X ' _l(t)=x _l(t-τ '), x ' _r(t)=x _r(t-τ ') (formula 18);

X ' _lt () is the left input channel signal after time delay adjustment, x ' _rt () is the right input channel signal after time delay adjustment.

Or carry out time delay adjustment according to formula (19) to left aqueduct signal and right input channel signal, the left input channel signal after time delay adjustment lags behind auxiliary left-channel signal τ ' in sequential _l, the right input channel signal sequential after time delay adjustment lags behind auxiliary right channel signal τ ' _r.

X ' _l(t)=x _l(t-τ ' _l), x ' _r(t)=x _r(t-τ ' _r) (formula 19).

Finally, according to formula (20), left input channel signal after time delay is adjusted and auxiliary left input channel signal synthesis, and then obtain left output channel signal, and by the right input channel signal after time delay adjustment and the synthesis of auxiliary right channel signal, and then obtain right output channel signal.

X _lout(t)=x _l' (t)+x _cL(t), x _rout(t)=x' _r(t)+x _cR(t) (formula 20).

5th kind:

After obtaining the right input channel signal after the left input channel signal after time delay adjustment and time delay adjustment, auxiliary left-channel signal after described time delay adjustment and described left input channel signal are synthesized, thus obtain described left output signal, auxiliary right channel signal after described time delay adjustment and described right input signal are synthesized, thus obtain described right output signal, comprising:

By the left input channel signal after described auxiliary left-channel signal and described time delay processing, synthesize in the mode of weighted sum, thus obtain described left output channel signal, by the right input channel signal after described auxiliary right channel signal and described time delay processing, synthesize in the mode of weighted sum, and then obtain described right output channel signal.

Specifically, auxiliary left-channel signal and auxiliary right channel signal all can be multiplied by the 3rd weight coefficient, and then obtain the auxiliary left-channel signal after weighting and the auxiliary right channel signal after weighting.Wherein, the application implement in the 3rd weight coefficient be greater than 0 to be less than arbitrary constant between 1.

Namely

X " _cL(t)=M ₃× x _cL(t), x " _cR(t)=M ₃× x _cR(t) (formula 21)

Wherein, x " _cLt () is the auxiliary left-channel signal after weighting, x " _cRt () is the auxiliary right channel signal after weighting, M ₃be the 3rd weight coefficient, and 0 < M ₃< 1.

Then according to formula (22), left input channel signal after time delay being adjusted and the auxiliary left-channel signal after weighting synthesize, thus obtain left output channel signal, right input channel signal after time delay being adjusted and the auxiliary right channel signal after weighting synthesize, thus obtain right output channel signal, namely

X _lout(t)=x' _l(t)+x " _cL(t), x _rout(t)=x' _r(t)+x " _cR(t) (formula 22).

Optionally, after the right input channel signal after the left input channel signal after time delay adjustment and time delay adjust also can be multiplied by the 4th weight coefficient, more left output channel signal and right output channel signal is synthesized.Specifically, according to formula (23), right input channel signal after left input channel signal after time delay being adjusted and time delay adjustment is all multiplied by the 4th weight coefficient, and then obtains the left input channel signal after weighting and the right input channel signal after weighting.Wherein, the 4th weight coefficient during the application implements is be greater than 0 to be less than arbitrary constant between 1, and the 3rd weight coefficient and the 4th weight coefficient can equal also can be unequal.

X " _l(t)=M ₄× x' _l(t), x " _r(t)=M ₄× x' _r(t) (formula 23).

Wherein, x " _lt () is the left input channel signal after weighting, x " _rt () is the right input channel signal after weighting, M ₂be the second weight coefficient, and 0 < M ₂< 1.

Finally, according to formula (24) by the auxiliary left-channel signal synthesis after the left input channel signal after weighting and weighting, thus obtain left output channel signal, by the auxiliary right channel signal synthesis after the right input channel signal after weighting and weighting, thus obtain right output channel signal, namely

X _lout(t)=x " _l(t)+x " _cL(t), x _rout(t)=x " _r(t)+x " _cR(t) (formula 24).

The application's second aspect provides a kind of device of Audio Signal Processing, as shown in Figure 4, comprising:

Receiving element 401, for receiving the left input channel signal of the collection of binaural audio collecting device, mid-channel signal and right input channel signal, wherein, described left input channel signal, described mid-channel signal and described right input channel signal are corresponding with the left ear passage of described binaural audio collecting device, mid-passage and auris dextra passage respectively, and described mid-passage is between described left ear passage and described auris dextra passage;

Determining unit 402, for the described left input channel signal received according to described receiving element 401, described mid-channel signal and described right input channel signal, the angle, sound bearing between the head mould determining sound source and described binaural audio collecting device;

Convolution unit 403, respond HRIR for the exaggeration ear left ear head coherent pulse that the described mid-channel signal received by described receiving element 401 is corresponding with angle, described determining unit 402 determined described sound bearing and carry out convolution, thus obtain auxiliary left-channel signal; Exaggeration ear auris dextra HRIR corresponding with angle, described sound bearing for described mid-channel signal is carried out convolution, thus obtains auxiliary right channel signal;

Output signal obtains unit 404, the described auxiliary left-channel signal that the described left input channel signal received for utilizing described receiving element 401 and described convolution unit 403 provide obtains left output channel signal, and the described auxiliary right channel signal that the described right input channel signal utilizing described receiving element 401 to receive and described convolution unit 403 provide obtains right output channel signal.

Optionally, described determining unit 402 also for:

In institute's convolution unit 403, the left ear HRIR of exaggeration ear that described mid-channel signal is corresponding with angle, described sound bearing is carried out convolution, and before the described exaggeration ear auris dextra HRIR that described mid-channel signal is corresponding with angle, described sound bearing carries out convolution, according to described left input channel signal, described mid-channel signal and described right input channel signal that described receiving element 401 receives, determine the orientation of described sound source; When described determining unit 402 determines that the orientation of described sound source is positioned at the front of described head mould, notify that the left ear HRIR of exaggeration ear that described mid-channel signal is corresponding with angle, described sound bearing is carried out convolution by described convolution unit 403, and exaggeration ear auris dextra HRIR corresponding with angle, described sound bearing for described mid-channel signal is carried out convolution.

Optionally, described determining unit 402 for:

Determine the first delay inequality between described left input channel signal and described right input channel signal, the second delay inequality between described left input channel signal and described mid-channel signal, and the 3rd delay inequality between described right input channel signal and described mid-channel signal; Size according to described first delay inequality and described head mould is determined to judge the factor, according to the scope at the value place of the described judgement factor, described second delay inequality and described 3rd delay inequality, determines the orientation of described sound source.

Optionally, described output signal obtain unit 404 for:

The described auxiliary left-channel signal provide described convolution unit 403 and described auxiliary right channel signal carry out time delay adjustment, obtain the auxiliary right channel signal after the auxiliary left-channel signal after time delay adjustment and time delay adjustment; The described left input channel signal that auxiliary left-channel signal after described time delay adjustment and described receiving element 401 receive is synthesized, thus obtain described left output channel signal, auxiliary right channel signal after described time delay adjustment and described right input signal are synthesized, thus obtains described right output channel signal.

Optionally, described output signal obtain unit 404 for:

Obtain the 4th delay inequality and the 5th delay inequality, described 4th delay inequality is delay inequality between described auxiliary left-channel signal and described left input channel signal, and described 5th delay inequality is delay inequality between described auxiliary right channel signal and described right input channel signal;

When the orientation of described sound source is positioned at the left side of described head mould, determine that described 4th delay inequality is for alignment delay inequality; When the orientation of described sound source is positioned at the right side of described head mould, determine that described 5th delay inequality is for alignment delay inequality;

The default strengthening location time delay time difference is deducted the difference of described alignment delay inequality as finally compensating the time difference;

The described auxiliary left-channel signal utilizing the described final compensation time difference to provide described convolution unit 403 and described auxiliary right channel signal carry out time delay adjustment, thus obtain described time delay adjustment after auxiliary left-channel signal and described time delay adjustment after auxiliary right channel signal, in auxiliary left-channel signal sequential after described time delay adjustment, the time difference of leading described left input channel signal is the described final compensation time difference, and in the auxiliary right channel signal sequential after described time delay adjustment, the time difference of leading described right input channel signal is the described final compensation time difference; Or

The difference that the described strengthening location time delay time difference deducts described 4th delay inequality is compensated the time difference as final left side; The difference that the described strengthening location time delay time difference deducts described 5th delay inequality is compensated the time difference as final right side;

The described final left side compensation time difference is utilized to carry out time delay adjustment to the described auxiliary left-channel signal that described convolution unit 403 provides, thus the auxiliary left-channel signal obtained after the adjustment of described time delay, and the described final right side utilizing described convolution unit 403 to provide compensates the time difference and carries out time delay adjustment to described auxiliary right channel signal, the auxiliary right channel signal after the adjustment of described time delay is obtained from ear, in auxiliary left-channel signal sequential after described time delay is adjusted, the time difference of leading described left input channel signal is that described final left side compensates the time difference, in auxiliary right channel signal sequential after described time delay adjustment, the time difference of leading described right input channel signal is that described final right side compensates the time difference.

Optionally, described output signal obtain unit 404 for:

By the described left input channel signal that the auxiliary left-channel signal after described time delay processing and described receiving element 401 receive, synthesize in the mode of weighted sum, thus obtain described left output channel signal, by the described right input channel signal that the auxiliary right channel signal after described time delay processing and described receiving element 401 receive, synthesize in the mode of weighted sum, and then obtain described right output channel signal.

Optionally, described output signal obtain unit 404 for:

The described left input channel signal receive described receiving element 401 and described right input channel signal carry out time delay adjustment, obtain the right input channel signal after the left input channel signal after time delay adjustment and time delay adjustment;

The described auxiliary left input channel signal that left-channel signal after described time delay adjustment and described convolution unit 403 provide is synthesized, thus obtain described left output signal, the described auxiliary right input signal that right channel signal after described time delay adjustment and described convolution unit 403 provide is synthesized, thus obtains described right output signal.

Optionally, described output signal obtain unit 404 for:

Obtain the 4th delay inequality and the 5th delay inequality; Wherein, described 4th delay inequality is delay inequality between described auxiliary left-channel signal and described left input channel signal, and described 5th delay inequality is delay inequality between described auxiliary right channel signal and described right input channel signal;

When the orientation of described sound source is positioned at the left side of described head mould, determine that described 4th delay inequality is described alignment delay inequality; When the orientation of described sound source is positioned at the right side of described head mould, determine that described 5th delay inequality is described alignment delay inequality;

The default strengthening location time delay time difference is deducted the difference of described alignment delay inequality as finally compensating the time difference;

The described left input channel signal utilizing the described final compensation time difference to receive described receiving element 401 and described right input channel signal carry out time delay adjustment, obtain the right input channel signal after the left input channel signal after the adjustment of described time delay and the adjustment of described time delay, the time difference left input channel signal sequential after described time delay is adjusted lagging behind described auxiliary left-channel signal is the described final compensation time difference, and the time difference right input channel signal sequential after described time delay adjustment lagging behind described auxiliary right channel signal is the described final compensation time difference; Or

The difference that the described strengthening location time delay time difference deducts described 4th delay inequality is compensated the time difference as described final left side; The difference that the described strengthening location time delay time difference deducts described 5th delay inequality is compensated the time difference as described final right side;

The described final left side compensation time difference is utilized to carry out time delay adjustment to the described left input channel signal that described receiving element 401 receives, obtain the left input channel signal after the adjustment of described time delay, and utilize the described final right side compensation time difference to carry out time delay adjustment to the described right input channel signal that described receiving element 401 receives, obtain the right input channel signal after the adjustment of described time delay, the time difference left input channel signal sequential after described time delay is adjusted lagging behind described auxiliary left-channel signal is that described final left side compensates the time difference, the time difference right input channel signal sequential after described time delay adjustment lagging behind described auxiliary right channel signal is that described final right side compensates the time difference.

Optionally, described output signal obtain unit 404 for:

Left input channel signal after the described auxiliary left-channel signal that described convolution unit 403 is provided and described time delay processing, synthesize in the mode of weighted sum, thus obtain described left output channel signal, right input channel signal after the described auxiliary right channel signal that described convolution unit 403 is provided and described time delay processing, synthesize in the mode of weighted sum, and then obtain described right output channel signal.

Optionally, described determining unit 402 for:

Size according to the first delay inequality and described head mould determines the first possibility angle, sound bearing, size according to the second delay inequality and described head mould determines the second possibility angle, sound bearing, and the size according to the 3rd delay inequality and described head mould determines the 3rd possibility angle, sound bearing; Described first delay inequality is the time difference between described left input channel signal and described right input channel signal, described second delay inequality is the time difference between described left input channel signal and described mid-channel signal, and the 3rd delay inequality is the time difference between described right input channel signal and described mid-channel signal; Size according to described first delay inequality and described head mould is determined to judge the factor, according to the scope at the value place of the described judgement factor, angle, described sound bearing may may may be determined angle, sound bearing in angle, sound bearing or the described 3rd in angle, sound bearing, described second from described first.

The application's third aspect provides a kind of electronic equipment, the implication of the term that the electronic equipment shown in Fig. 5 relates to and specific implementation, can with reference to the associated description of earlier figures 1 to Fig. 4 and embodiment.

Please refer to Fig. 5, this equipment comprises:

Receiver 501, for receiving the left input channel signal of the collection of binaural audio collecting device, mid-channel signal and right input channel signal, wherein, described left input channel signal, described mid-channel signal and described right input channel signal are corresponding with the left ear passage of described binaural audio collecting device, mid-passage and auris dextra passage respectively, and described mid-passage is between described left ear passage and described auris dextra passage;

Processor 503, for the described left input channel signal received according to described receiver 501, described mid-channel signal and described right input channel signal, the angle, sound bearing between the head mould determining sound source and described binaural audio collecting device; Exaggeration ear left ear head coherent pulse corresponding with angle, described sound bearing for described mid-channel signal is responded HRIR and carries out convolution, thus obtain auxiliary left-channel signal; Exaggeration ear auris dextra HRIR corresponding with angle, described sound bearing for described mid-channel signal is carried out convolution, thus obtains auxiliary right channel signal; Utilize described left input channel signal and described auxiliary left-channel signal to obtain left output channel signal, utilize described right input channel signal and described auxiliary right channel signal to obtain right output channel signal.

Optionally, processor 503 also for:

Convolution is carried out at the left ear HRIR of the described exaggeration ear that described mid-channel signal is corresponding with angle, described sound bearing, and before the described exaggeration ear auris dextra HRIR that described mid-channel signal is corresponding with angle, described sound bearing carries out convolution, according to described left input channel signal, described mid-channel signal and described right input channel signal, determine the orientation of described sound source; When determining that the orientation of described sound source is positioned at the front of described head mould, the left ear HRIR of exaggeration ear that described mid-channel signal is corresponding with angle, described sound bearing is just carried out convolution by described processor, and exaggeration ear auris dextra HRIR corresponding with angle, described sound bearing for described mid-channel signal is carried out convolution.

Optionally, described processor 503 for:

Determine the first delay inequality between described left input channel signal and described right input channel signal, the second delay inequality between described left input channel signal and described mid-channel signal, and the 3rd delay inequality between described right input channel signal and described mid-channel signal;

Size according to described first delay inequality and described head mould is determined to judge the factor, according to the scope at the value place of the described judgement factor, described second delay inequality and described 3rd delay inequality, determines the orientation of described sound source.

Optionally, described processor 503 for:

Time delay adjustment is carried out to described auxiliary left-channel signal and described auxiliary right channel signal, obtains the auxiliary right channel signal after the auxiliary left-channel signal after time delay adjustment and time delay adjustment;

Auxiliary left-channel signal after described time delay adjustment and described left input channel signal are synthesized, thus obtain described left output channel signal, auxiliary right channel signal after described time delay adjustment and described right input signal are synthesized, thus obtains described right output channel signal.

Optionally, described processor 503 for:

Obtain the 4th delay inequality and the 5th delay inequality, described 4th delay inequality is delay inequality between described auxiliary left-channel signal and described left input channel signal, and described 5th delay inequality is delay inequality between described auxiliary right channel signal and described right input channel signal;

When the orientation of described sound source is positioned at the left side of described head mould, determine that described 4th delay inequality is for alignment delay inequality; When the orientation of described sound source is positioned at the right side of described head mould, determine that described 5th delay inequality is for alignment delay inequality;

The default strengthening location time delay time difference is deducted the difference of described alignment delay inequality as finally compensating the time difference;

The described final compensation time difference is utilized to carry out time delay adjustment to described auxiliary left-channel signal and described auxiliary right channel signal, thus obtain described time delay adjustment after auxiliary left-channel signal and described time delay adjustment after auxiliary right channel signal, in auxiliary left-channel signal sequential after described time delay adjustment, the time difference of leading described left input channel signal is the described final compensation time difference, and in the auxiliary right channel signal sequential after described time delay adjustment, the time difference of leading described right input channel signal is the described final compensation time difference; Or

The difference that the described strengthening location time delay time difference deducts described 4th delay inequality is compensated the time difference as final left side; The difference that the described strengthening location time delay time difference deducts described 5th delay inequality is compensated the time difference as final right side;

The described final left side compensation time difference is utilized to carry out time delay adjustment to described auxiliary left-channel signal, thus the auxiliary left-channel signal obtained after the adjustment of described time delay, and utilize the described final right side compensation time difference to carry out time delay adjustment to described auxiliary right channel signal, the auxiliary right channel signal after the adjustment of described time delay is obtained from ear, in auxiliary left-channel signal sequential after described time delay is adjusted, the time difference of leading described left input channel signal is that described final left side compensates the time difference, in auxiliary right channel signal sequential after described time delay adjustment, the time difference of leading described right input channel signal is that described final right side compensates the time difference.

Optionally, described processor 503 for:

By the auxiliary left-channel signal after described time delay processing and described left input channel signal, synthesize in the mode of weighted sum, thus obtain described left output channel signal, by the auxiliary right channel signal after described time delay processing and described right input channel signal, synthesize in the mode of weighted sum, and then obtain described right output channel signal.

Optionally, described processor 503 for:

Time delay adjustment is carried out to described left input channel signal and described right input channel signal, obtains the right input channel signal after the left input channel signal after time delay adjustment and time delay adjustment;

Left-channel signal after described time delay adjustment and described auxiliary left input channel signal are synthesized, thus obtain described left output signal, right channel signal after described time delay adjustment and described auxiliary right input signal are synthesized, thus obtains described right output signal.

Optionally, described processor 503 for:

Obtain the 4th delay inequality and the 5th delay inequality; Wherein, described 4th delay inequality is delay inequality between described auxiliary left-channel signal and described left input channel signal, and described 5th delay inequality is delay inequality between described auxiliary right channel signal and described right input channel signal;

When the orientation of described sound source is positioned at the left side of described head mould, determine that described 4th delay inequality is described alignment delay inequality; When the orientation of described sound source is positioned at the right side of described head mould, determine that described 5th delay inequality is described alignment delay inequality;

The default strengthening location time delay time difference is deducted the difference of described alignment delay inequality as finally compensating the time difference;

The described final compensation time difference is utilized to carry out time delay adjustment to described left input channel signal and described right input channel signal, obtain the right input channel signal after the left input channel signal after the adjustment of described time delay and the adjustment of described time delay, the time difference left input channel signal sequential after described time delay is adjusted lagging behind described auxiliary left-channel signal is the described final compensation time difference, and the time difference right input channel signal sequential after described time delay adjustment lagging behind described auxiliary right channel signal is the described final compensation time difference; Or

The difference that the described strengthening location time delay time difference deducts described 4th delay inequality is compensated the time difference as described final left side; The difference that the described strengthening location time delay time difference deducts described 5th delay inequality is compensated the time difference as described final right side;

The described final left side compensation time difference is utilized to carry out time delay adjustment to described left input channel signal, obtain the left input channel signal after the adjustment of described time delay, and utilize the described final right side compensation time difference to carry out time delay adjustment to described right input channel signal, obtain the right input channel signal after the adjustment of described time delay, the time difference left input channel signal sequential after described time delay is adjusted lagging behind described auxiliary left-channel signal is that described final left side compensates the time difference, the time difference right input channel signal sequential after described time delay adjustment lagging behind described auxiliary right channel signal is that described final right side compensates the time difference.

Optionally, described processor 503 for:

By the left input channel signal after described auxiliary left-channel signal and described time delay processing, synthesize in the mode of weighted sum, thus obtain described left output channel signal, by the right input channel signal after described auxiliary right channel signal and described time delay processing, synthesize in the mode of weighted sum, and then obtain described right output channel signal.

Optionally, described processor 503 for:

Size according to the first delay inequality and described head mould determines the first possibility angle, sound bearing, size according to the second delay inequality and described head mould determines the second possibility angle, sound bearing, and the size according to the 3rd delay inequality and described head mould determines the 3rd possibility angle, sound bearing;

Described first delay inequality is the time difference between described left input channel signal and described right input channel signal, described second delay inequality is the time difference between described left input channel signal and described mid-channel signal, and the 3rd delay inequality is the time difference between described right input channel signal and described mid-channel signal;

Size according to described first delay inequality and described head mould is determined to judge the factor, according to the scope at the value place of the described judgement factor, angle, described sound bearing may may may be determined angle, sound bearing in angle, sound bearing or the described 3rd in angle, sound bearing, described second from described first.

Wherein, in Figure 5, bus architecture (representing by bus 500), bus 500 can comprise interconnected bus and the bridge of any amount, and the various electrical chains comprising the memory that one or more processor of being represented by processor 503 and memory 504 represent are connected together by bus 500.Other electrical chains various of such as ancillary equipment, pressurizer and management circuit etc. and so on can also be connected together by bus 500, and these are all known in the field, therefore, are no longer described further it herein.Bus interface 505 provides interface in bus 500 with between receiver 501 and transmitter 502.Receiver 501 and transmitter 502 can be same element, i.e. transceiver, are provided for the unit communicated with other devices various over a transmission medium.

Processor 503 is in charge of bus 500 and common process, and memory 504 can be used to the data that storage of processor 503 uses when executable operations.

The various variation pattern of the audio-frequency information processing method described in previous embodiment and instantiation are equally applicable to the audio-frequency information treatment facility of the present embodiment, by the aforementioned detailed description to audio-frequency information processing method and audio-frequency information processing unit implementation, those skilled in the art clearly can know the implementation method of the present embodiment sound intermediate frequency information equipment, so succinct in order to specification, be not described in detail in this.

The one or more technical schemes provided in the embodiment of the present invention, at least have following technique effect or advantage:

In the technical scheme of the embodiment of the present invention, receive the left input channel signal of the collection of binaural audio collecting device, mid-channel signal and right input channel signal, wherein, described left input channel signal, described mid-channel signal and described right input channel signal are corresponding with the left ear passage of described binaural audio collecting device, mid-passage and auris dextra passage respectively, and described mid-passage is between described left ear passage and described auris dextra passage; According to described left input channel signal, described mid-channel signal and described right input channel signal, the angle, sound bearing between the head mould determining sound source and described binaural audio collecting device; Exaggeration ear left ear head coherent pulse corresponding with angle, described sound bearing for described mid-channel signal is responded HRIR and carries out convolution, thus obtain auxiliary left-channel signal; Exaggeration ear auris dextra HRIR corresponding with angle, described sound bearing for described mid-channel signal is carried out convolution, thus obtains auxiliary right channel signal; Utilize described left input channel signal and described auxiliary left-channel signal to obtain left output channel signal, utilize described right input channel signal and described auxiliary right channel signal to obtain right output channel signal.Because mid-passage is between the ear passage of left and right, mid-channel signal is with the auditory localization characteristic information in more fronts, therefore by mid-channel signal and left input channel signal and right input channel signal convolution respectively, and then also can with the auditory localization characteristic signal in front in the auxiliary left-channel signal obtained and auxiliary right channel signal.Further utilization assists left-channel signal and left input channel signal to obtain left output channel signal, and utilizes auxiliary right channel signal and right input channel signal to obtain right output channel signal.Thus left output channel signal in the embodiment of the present invention and right output channel signal comparatively prior art, with the auditory localization characteristic information in more fronts.So, after user hears the audio signal that the embodiment of the present invention exports, will judge that sound source is positioned at front more exactly, and then reduce possibility front sound source being mistaken for rear sound source.

Those skilled in the art should understand, embodiments of the invention can be provided as method, system or computer program.Therefore, the present invention can adopt the form of complete hardware embodiment, completely software implementation or the embodiment in conjunction with software and hardware aspect.And the present invention can adopt in one or more form wherein including the upper computer program implemented of computer-usable storage medium (including but not limited to magnetic disc store and optical memory etc.) of computer usable program code.

The present invention describes with reference to according to the flow chart of the method for the embodiment of the present invention, equipment (system) and computer program and/or block diagram.Should understand can by the combination of the flow process in each flow process in computer program instructions realization flow figure and/or block diagram and/or square frame and flow chart and/or block diagram and/or square frame.These computer program instructions can being provided to the processor of all-purpose computer, special-purpose computer, Embedded Processor or other programmable data processing device to produce a machine, making the instruction performed by the processor of computer or other programmable data processing device produce device for realizing the function of specifying in flow chart flow process or multiple flow process and/or block diagram square frame or multiple square frame.

These computer program instructions also can be stored in can in the computer-readable memory that works in a specific way of vectoring computer or other programmable data processing device, the instruction making to be stored in this computer-readable memory produces the manufacture comprising command device, and this command device realizes the function of specifying in flow chart flow process or multiple flow process and/or block diagram square frame or multiple square frame.

These computer program instructions also can be loaded in computer or other programmable data processing device, make on computer or other programmable devices, to perform sequence of operations step to produce computer implemented process, thus the instruction performed on computer or other programmable devices is provided for the step realizing the function of specifying in flow chart flow process or multiple flow process and/or block diagram square frame or multiple square frame.

Obviously, those skilled in the art can carry out various change and modification to the present invention and not depart from the spirit and scope of the present invention.Like this, if these amendments of the present invention and modification belong within the scope of the claims in the present invention and equivalent technologies thereof, then the present invention is also intended to comprise these change and modification.

Claims (16)

1. a method for Audio Signal Processing, is characterized in that, comprising:

Receive the left input channel signal of the collection of binaural audio collecting device, mid-channel signal and right input channel signal, wherein, described left input channel signal, described mid-channel signal and described right input channel signal are corresponding with the left ear passage of described binaural audio collecting device, mid-passage and auris dextra passage respectively, and described mid-passage is between described left ear passage and described auris dextra passage;

According to described left input channel signal, described mid-channel signal and described right input channel signal, the angle, sound bearing between the head mould determining sound source and described binaural audio collecting device;

Exaggeration ear left ear head coherent pulse corresponding with angle, described sound bearing for described mid-channel signal is responded HRIR and carries out convolution, thus obtain auxiliary left-channel signal;

Exaggeration ear auris dextra HRIR corresponding with angle, described sound bearing for described mid-channel signal is carried out convolution, thus obtains auxiliary right channel signal;

Utilize described left input channel signal and described auxiliary left-channel signal to obtain left output channel signal, utilize described right input channel signal and described auxiliary right channel signal to obtain right output channel signal.

2. the method for claim 1, it is characterized in that, convolution is carried out at the left ear HRIR of the described exaggeration ear that described mid-channel signal is corresponding with angle, described sound bearing, and before the described exaggeration ear auris dextra HRIR that described mid-channel signal is corresponding with angle, described sound bearing carries out convolution, described method also comprises:

According to described left input channel signal, described mid-channel signal and described right input channel signal, determine the orientation of described sound source;

When determining that the orientation of described sound source is positioned at the front of described head mould, just the left ear HRIR of exaggeration ear that described mid-channel signal is corresponding with angle, described sound bearing is carried out convolution, and exaggeration ear auris dextra HRIR corresponding with angle, described sound bearing for described mid-channel signal is carried out convolution.

3. method as claimed in claim 2, is characterized in that, described according to described left input channel signal, described mid-channel signal and described right input channel signal, determines the orientation of described sound source, comprising:

Determine the first delay inequality between described left input channel signal and described right input channel signal, the second delay inequality between described left input channel signal and described mid-channel signal, and the 3rd delay inequality between described right input channel signal and described mid-channel signal;

Size according to described first delay inequality and described head mould is determined to judge the factor, according to the scope at the value place of the described judgement factor, described second delay inequality and described 3rd delay inequality, determines the orientation of described sound source.

4. the method as described in any one of claim 1-3, it is characterized in that, described described left input channel signal and the described auxiliary left-channel signal of utilizing obtains left output channel signal, utilizes described right input channel signal and described auxiliary right channel signal to obtain right output channel signal, comprising:

Time delay adjustment is carried out to described auxiliary left-channel signal and described auxiliary right channel signal, obtains the auxiliary right channel signal after the auxiliary left-channel signal after time delay adjustment and time delay adjustment;

Auxiliary left-channel signal after described time delay adjustment and described left input channel signal are synthesized, thus obtain described left output channel signal, auxiliary right channel signal after described time delay adjustment and described right input signal are synthesized, thus obtains described right output channel signal.

5. method as claimed in claim 4, is characterized in that, describedly carries out time delay adjustment to described auxiliary left-channel signal and described auxiliary right channel signal, obtains the auxiliary right channel signal after the auxiliary left-channel signal after time delay adjustment and time delay adjustment, comprising:

Obtain the 4th delay inequality and the 5th delay inequality, described 4th delay inequality is delay inequality between described auxiliary left-channel signal and described left input channel signal, and described 5th delay inequality is delay inequality between described auxiliary right channel signal and described right input channel signal;

When the orientation of described sound source is positioned at the left side of described head mould, determine that described 4th delay inequality is for alignment delay inequality; When the orientation of described sound source is positioned at the right side of described head mould, determine that described 5th delay inequality is for alignment delay inequality;

The default strengthening location time delay time difference is deducted the difference of described alignment delay inequality as finally compensating the time difference;

The described final compensation time difference is utilized to carry out time delay adjustment to described auxiliary left-channel signal and described auxiliary right channel signal, thus obtain described time delay adjustment after auxiliary left-channel signal and described time delay adjustment after auxiliary right channel signal, in auxiliary left-channel signal sequential after described time delay adjustment, the time difference of leading described left input channel signal is the described final compensation time difference, and in the auxiliary right channel signal sequential after described time delay adjustment, the time difference of leading described right input channel signal is the described final compensation time difference; Or

The difference that the described strengthening location time delay time difference deducts described 4th delay inequality is compensated the time difference as final left side; The difference that the described strengthening location time delay time difference deducts described 5th delay inequality is compensated the time difference as final right side;

The described final left side compensation time difference is utilized to carry out time delay adjustment to described auxiliary left-channel signal, thus the auxiliary left-channel signal obtained after the adjustment of described time delay, and utilize the described final right side compensation time difference to carry out time delay adjustment to described auxiliary right channel signal, the auxiliary right channel signal after the adjustment of described time delay is obtained from ear, in auxiliary left-channel signal sequential after described time delay is adjusted, the time difference of leading described left input channel signal is that described final left side compensates the time difference, in auxiliary right channel signal sequential after described time delay adjustment, the time difference of leading described right input channel signal is that described final right side compensates the time difference.

6. method as claimed in claim 5, it is characterized in that, described auxiliary left-channel signal after the adjustment of described time delay and described left input channel signal to be synthesized, thus obtain described left output signal, auxiliary right channel signal after described time delay adjustment and described right input signal are synthesized, thus obtain described right output signal, comprising:

By the auxiliary left-channel signal after described time delay processing and described left input channel signal, synthesize in the mode of weighted sum, thus obtain described left output channel signal, by the auxiliary right channel signal after described time delay processing and described right input channel signal, synthesize in the mode of weighted sum, and then obtain described right output channel signal.

7. the method as described in any one of claim 1-3, it is characterized in that, described described left input channel signal and the described auxiliary left-channel signal of utilizing obtains left output channel signal, utilizes described right input channel signal and described auxiliary right channel signal to obtain right output channel signal, comprising:

Time delay adjustment is carried out to described left input channel signal and described right input channel signal, obtains the right input channel signal after the left input channel signal after time delay adjustment and time delay adjustment;

Left-channel signal after described time delay adjustment and described auxiliary left input channel signal are synthesized, thus obtain described left output signal, right channel signal after described time delay adjustment and described auxiliary right input signal are synthesized, thus obtains described right output signal.

8. the method as described in any one of claim 1-7, it is characterized in that, described according to described left input channel signal, described mid-channel signal and described right input channel signal, determine the angle, sound bearing between the head mould that sound source is corresponding with described binaural audio collecting device, comprising:

Size according to the first delay inequality and described head mould determines the first possibility angle, sound bearing, size according to the second delay inequality and described head mould determines the second possibility angle, sound bearing, and the size according to the 3rd delay inequality and described head mould determines the 3rd possibility angle, sound bearing;

Described first delay inequality is the time difference between described left input channel signal and described right input channel signal, described second delay inequality is the time difference between described left input channel signal and described mid-channel signal, and the 3rd delay inequality is the time difference between described right input channel signal and described mid-channel signal;

Size according to described first delay inequality and described head mould is determined to judge the factor, according to the scope at the value place of the described judgement factor, angle, described sound bearing may may may be determined angle, sound bearing in angle, sound bearing or the described 3rd in angle, sound bearing, described second from described first.

9. a device for Audio Signal Processing, is characterized in that, comprising:

Receiving element, for receiving the left input channel signal of the collection of binaural audio collecting device, mid-channel signal and right input channel signal, wherein, described left input channel signal, described mid-channel signal and described right input channel signal are corresponding with the left ear passage of described binaural audio collecting device, mid-passage and auris dextra passage respectively, and described mid-passage is between described left ear passage and described auris dextra passage;

Determining unit, for the described left input channel signal received according to described receiving element, described mid-channel signal and described right input channel signal, the angle, sound bearing between the head mould determining sound source and described binaural audio collecting device;

Convolution unit, the exaggeration ear left ear head coherent pulse that the described mid-channel signal for being received by described receiving element is corresponding with angle, described determining unit determined described sound bearing responds HRIR and carries out convolution, thus obtains auxiliary left-channel signal; Exaggeration ear auris dextra HRIR corresponding with angle, described sound bearing for described mid-channel signal is carried out convolution, thus obtains auxiliary right channel signal;

Output signal obtains unit, the described auxiliary left-channel signal that the described left input channel signal received for utilizing described receiving element and described convolution unit provide obtains left output channel signal, and the described auxiliary right channel signal that the described right input channel signal utilizing described receiving element to receive and described convolution unit provide obtains right output channel signal.

10. device as claimed in claim 9, is characterized in that, described determining unit also for:

In institute's convolution unit, the left ear HRIR of exaggeration ear that described mid-channel signal is corresponding with angle, described sound bearing is carried out convolution, and before the described exaggeration ear auris dextra HRIR that described mid-channel signal is corresponding with angle, described sound bearing carries out convolution, according to described left input channel signal, described mid-channel signal and described right input channel signal that described receiving element receives, determine the orientation of described sound source; When described determining unit determines that the orientation of described sound source is positioned at the front of described head mould, notify that the left ear HRIR of exaggeration ear that described mid-channel signal is corresponding with angle, described sound bearing is carried out convolution by described convolution unit, and exaggeration ear auris dextra HRIR corresponding with angle, described sound bearing for described mid-channel signal is carried out convolution.

11. devices as claimed in claim 10, it is characterized in that, described determining unit is used for:

Determine the first delay inequality between described left input channel signal and described right input channel signal, the second delay inequality between described left input channel signal and described mid-channel signal, and the 3rd delay inequality between described right input channel signal and described mid-channel signal; Size according to described first delay inequality and described head mould is determined to judge the factor, according to the scope at the value place of the described judgement factor, described second delay inequality and described 3rd delay inequality, determines the orientation of described sound source.

12. devices as described in any one of claim 9-11, is characterized in that, described output signal obtains unit and is used for:

The described auxiliary left-channel signal provide described convolution unit and described auxiliary right channel signal carry out time delay adjustment, obtain the auxiliary right channel signal after the auxiliary left-channel signal after time delay adjustment and time delay adjustment; The described left input channel signal that auxiliary left-channel signal after described time delay adjustment and described receiving element receive is synthesized, thus obtain described left output channel signal, the described right input signal that auxiliary right channel signal after described time delay adjustment and described receiving element receive is synthesized, thus obtains described right output channel signal.

13. devices as claimed in claim 12, is characterized in that, described output signal obtains unit and is used for:

Obtain the 4th delay inequality and the 5th delay inequality, described 4th delay inequality is delay inequality between described auxiliary left-channel signal and described left input channel signal, and described 5th delay inequality is delay inequality between described auxiliary right channel signal and described right input channel signal;

When the orientation of described sound source is positioned at the left side of described head mould, determine that described 4th delay inequality is for alignment delay inequality; When the orientation of described sound source is positioned at the right side of described head mould, determine that described 5th delay inequality is for alignment delay inequality;

The default strengthening location time delay time difference is deducted the difference of described alignment delay inequality as finally compensating the time difference;

The described auxiliary left-channel signal utilizing the described final compensation time difference to provide described convolution unit and described auxiliary right channel signal carry out time delay adjustment, thus obtain described time delay adjustment after auxiliary left-channel signal and described time delay adjustment after auxiliary right channel signal, in auxiliary left-channel signal sequential after described time delay adjustment, the time difference of leading described left input channel signal is the described final compensation time difference, and in the auxiliary right channel signal sequential after described time delay adjustment, the time difference of leading described right input channel signal is the described final compensation time difference; Or

The difference that the described strengthening location time delay time difference deducts described 4th delay inequality is compensated the time difference as final left side; The difference that the described strengthening location time delay time difference deducts described 5th delay inequality is compensated the time difference as final right side;

The described final left side compensation time difference is utilized to carry out time delay adjustment to the described auxiliary left-channel signal that described convolution unit provides, thus the auxiliary left-channel signal obtained after the adjustment of described time delay, and utilize the described final right side compensation time difference to carry out time delay adjustment to the described auxiliary right channel signal that described convolution unit provides, the auxiliary right channel signal after the adjustment of described time delay is obtained from ear, in auxiliary left-channel signal sequential after described time delay is adjusted, the time difference of leading described left input channel signal is that described final left side compensates the time difference, in auxiliary right channel signal sequential after described time delay adjustment, the time difference of leading described right input channel signal is that described final right side compensates the time difference.

14. devices as claimed in claim 13, is characterized in that, described output signal obtains unit and is used for:

By the described left input channel signal that the auxiliary left-channel signal after described time delay processing and described receiving element receive, synthesize in the mode of weighted sum, thus obtain described left output channel signal, by the described right input channel signal that the auxiliary right channel signal after described time delay processing and described receiving element receive, synthesize in the mode of weighted sum, and then obtain described right output channel signal.

15. devices as described in any one of claim 9-11, is characterized in that, described output signal obtains unit and is used for:

The described left input channel signal receive described receiving element and described right input channel signal carry out time delay adjustment, obtain the right input channel signal after the left input channel signal after time delay adjustment and time delay adjustment; The described auxiliary left input channel signal that left-channel signal after described time delay adjustment and described convolution unit provide is synthesized, thus obtain described left output signal, the described auxiliary right input signal that right channel signal after described time delay adjustment and described convolution unit provide is synthesized, thus obtains described right output signal.

16. devices as described in any one of claim 9-15, it is characterized in that, described determining unit is used for:

Size according to the first delay inequality and described head mould determines the first possibility angle, sound bearing, size according to the second delay inequality and described head mould determines the second possibility angle, sound bearing, and the size according to the 3rd delay inequality and described head mould determines the 3rd possibility angle, sound bearing;

Described first delay inequality is the time difference between described left input channel signal and described right input channel signal, described second delay inequality is the time difference between described left input channel signal and described mid-channel signal, and the 3rd delay inequality is the time difference between described right input channel signal and described mid-channel signal;

Size according to described first delay inequality and described head mould is determined to judge the factor, according to the scope at the value place of the described judgement factor, angle, described sound bearing may may may be determined angle, sound bearing in angle, sound bearing or the described 3rd in angle, sound bearing, described second from described first.