CN105142094A - Audio signal processing method and device - Google Patents

Audio signal processing method and device Download PDF

Info

Publication number
CN105142094A
CN105142094A CN201510591332.6A CN201510591332A CN105142094A CN 105142094 A CN105142094 A CN 105142094A CN 201510591332 A CN201510591332 A CN 201510591332A CN 105142094 A CN105142094 A CN 105142094A
Authority
CN
China
Prior art keywords
signal
audio signal
channel signal
sub
band audio
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201510591332.6A
Other languages
Chinese (zh)
Other versions
CN105142094B (en
Inventor
徐德著
江藤雅弘
赵翔宇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to CN201510591332.6A priority Critical patent/CN105142094B/en
Publication of CN105142094A publication Critical patent/CN105142094A/en
Application granted granted Critical
Publication of CN105142094B publication Critical patent/CN105142094B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Stereophonic System (AREA)

Abstract

The embodiment of the invention discloses an audio signal processing method and device. The device includes an input module, a centrally-arranged sound channel extraction module, a virtual filtering processing module, a gain control module, an output module, a centrally-arranged sound channel enhancement processing module and a volume enhancement processing module; and a virtual processor in the virtual filtering processing module directly utilizes two-ear time difference information of and/or two-ear sound intensity difference information. With the audio signal processing method and device provided by the embodiment of the invention adopted, the virtual expansion degree and sound quality of a loudspeaker can be improved under the situation that a loudspeaker embedding gap is small.

Description

A kind of processing method of audio signal and device
Technical field
The present invention relates to embedded loudspeaker techniques field, particularly relate to a kind of processing method and device of audio signal.
Background technology
Along with the development of Intel Virtualization Technology, virtual audio also more and more receives the concern of people, obtains study widely in nearest decades.Popularizing along with mobile terminal (as panel computer, MP3 player, smart mobile phone etc.), people are also more and more higher to the demand obtaining high-quality media entertainment on mobile terminals.Because the space of mobile terminal and Size-dependent are in the size of shell and physical restriction, the embedded loud speaker therefore in mobile terminal is spaced narrower.In such mobile terminal, audio frequency is play usually to make and is compromised or be limited, such that the sound field of loud speaker (soundstage) virtual extended range is lower, tonequality is poor.
Summary of the invention
The embodiment of the present invention provides a kind of processing method and device of audio signal, when embedded loud speaker interval is narrower, can improves the virtual extended range of loud speaker and promote tonequality.
First aspect present invention provides a kind of processing method of audio signal, comprising:
Receive at least one audio signal, described audio signal comprises left channel signal and right channel signal;
Process described audio signal, to extract centre gangway signal and distinguishing left channel signal and right channel signal;
Virtualization processor process is used to extract the described left channel signal and described right channel signal that obtain, to obtain the virtual channel signal of left virtual channel signal and the right side;
Wherein, described virtualization processor comprises by T 1the first hrtf filter represented and T 2the second hrtf filter represented, T 1and T 2comprise following transfer function, and H 1and H 2meet following relation:
[T 1,T 2;T 2,T 1]=[H 1,H 2;H 2,H 1]*[G 1,G 2;G 2,G 1]
[H 1,H 2;H 2,H 1]*[C 1,C 2;C 2,C 1]=[I,0;0,I]
G 1the offside HRTF that to be the homonymy HRTF for left virtual loudspeaker positions or right virtual loudspeaker positions, G2 be for left virtual loudspeaker positions or right virtual loudspeaker positions, C 1the homonymy HRTF for left actual loudspeaker position or right actual loudspeaker position, C 2the offside HRTF for left actual loudspeaker position or right actual loudspeaker position, and C 1and C 2only comprise ears time difference information and/or binaural sound strong difference information;
Respectively gain control is carried out to the virtual channel signal of the virtual channel signal in a described left side and the described right side by described centre gangway signal;
The virtual channel signal of the virtual channel signal in a described left side after gain being controlled and the described right side exports.
In the first possible implementation of first aspect, the described audio signal of described process, comprises to extract centre gangway signal and distinguishing left channel signal and right channel signal:
Described audio signal is filtered into multiple sub-band audio signal of different frequency bands according to pre-set frequency band, each described sub-band audio signal comprises left sub-band audio signal and right sub-band audio signal;
Extract the subband centre gangway signal in each described sub-band audio signal;
The described subband centre gangway signal subtraction described left sub-band audio signal in each described sub-band audio signal and described right sub-band audio signal extracted with it respectively, obtains the left sub-band audio signal after adjustment and right sub-band audio signal respectively;
Left sub-band audio signal described in each after adjustment is reconfigured to obtain described left channel signal;
Right sub-band audio signal described in each after adjustment is reconfigured to obtain described left channel signal;
By subband centre gangway signal combination described in each to obtain the described centre gangway signal of Whole frequency band.
In conjunction with the first possible implementation of first aspect, in the implementation that the second is possible, the subband centre gangway signal in each described sub-band audio signal of described extraction comprises:
The described subband centre gangway signal in each described sub-band audio signal is determined according to formula M=K* (L+R), wherein, M is described subband centre gangway signal, L is the described left sub-band audio signal in its sub-band audio signal, R is the described right sub-band audio signal in its sub-band audio signal, and K is pre-set zoom coefficient.
In conjunction with the implementation that the first or the second of first aspect or first aspect are possible, in the implementation that the third is possible, described method also comprises:
By Predetermined filter, enhancing process is carried out to the described centre gangway signal extracted;
Described by described centre gangway signal respectively to the virtual channel signal of the virtual channel signal in a described left side and the described right side carry out gain control comprise:
Respectively gain control is carried out to the virtual channel signal of the virtual channel signal in a described left side and the described right side by the described centre gangway signal after strengthening process.
In conjunction with the third possible implementation of first aspect, in the 4th kind of possible implementation, the described described centre gangway signal to extracting carries out enhancing process by Predetermined filter and comprises:
Adopt cascade N number of iir filter to extract described centre gangway signal carry out enhancings process, wherein N be more than or equal to 2 positive integer.
In conjunction with the first of first aspect or first aspect to any one possible implementation in the 4th kind, in the 5th kind of possible implementation, described by described centre gangway signal respectively to the virtual channel signal of the virtual channel signal in a described left side and the described right side carry out gain control comprise:
Described centre gangway signal is added to carry out gain control with the virtual channel signal of the virtual channel signal in a described left side and the described right side respectively.
In conjunction with the first of first aspect or first aspect to any one possible implementation in the 5th kind, in the 6th kind of possible implementation, described method also comprises:
The virtual channel signal of the virtual channel signal in a described left side and the described right side after being controlled by real-time gain compensation deals gain, and the virtual channel signal of the virtual channel signal in a described left side after gain compensation process and the described right side is exported.
Correspondingly, embodiment of the present invention second aspect additionally provides a kind of processing unit of audio signal, comprising:
Input module, for receiving at least one audio signal, described audio signal comprises left channel signal and right channel signal;
Center channels extraction module, for the treatment of described audio signal, to extract centre gangway signal and distinguishing left channel signal and right channel signal;
Virtual filtering processing module, extracts the described left channel signal and described right channel signal that obtain, to obtain the virtual channel signal of left virtual channel signal and the right side for using virtualization processor process;
Wherein, described virtualization processor comprises by T 1the first hrtf filter represented and T 2the second hrtf filter represented, T 1and T 2comprise following transfer function, and H 1and H 2meet following relation:
[T 1,T 2;T 2,T 1]=[H 1,H 2;H 2,H 1]*[G 1,G 2;G 2,G 1]
[H 1,H 2;H 2,H 1]*[C 1,C 2;C 2,C 1]=[I,0;0,I]
G 1the offside HRTF that to be the homonymy HRTF for left virtual loudspeaker positions or right virtual loudspeaker positions, G2 be for left virtual loudspeaker positions or right virtual loudspeaker positions, C 1the homonymy HRTF for left actual loudspeaker position or right actual loudspeaker position, C 2the offside HRTF for left actual loudspeaker position or right actual loudspeaker position, and C 1and C 2only comprise ears time difference information and/or binaural sound strong difference information;
Gain control module, for carrying out gain control to the virtual channel signal of the virtual channel signal in a described left side and the described right side respectively by described centre gangway signal;
Output module, exports for the virtual channel signal of the virtual channel signal in a described left side and the described right side after gain being controlled.
In the first possible implementation of second aspect, described center channels extraction module comprises:
Filter unit, for described audio signal to be filtered into multiple sub-band audio signal of different frequency bands according to pre-set frequency band, each described sub-band audio signal comprises left sub-band audio signal and right sub-band audio signal;
Extraction unit, for extracting the subband centre gangway signal in each described sub-band audio signal;
Processing unit, for the described subband centre gangway signal subtraction described left sub-band audio signal in each described sub-band audio signal and described right sub-band audio signal extracted with it respectively, obtain the left sub-band audio signal after adjustment and right sub-band audio signal respectively;
Assembled unit, for left sub-band audio signal described in each after adjustment is reconfigured to obtain described left channel signal, and right sub-band audio signal described in each after adjustment is reconfigured to obtain described left channel signal, and by subband centre gangway signal combination described in each to obtain the described centre gangway signal of Whole frequency band.
In conjunction with the first possible implementation of second aspect, in the implementation that the second is possible, described extraction unit specifically for:
The described subband centre gangway signal in each described sub-band audio signal is determined according to formula M=K* (L+R), wherein, M is described subband centre gangway signal, L is the described left sub-band audio signal in its sub-band audio signal, R is the described right sub-band audio signal in its sub-band audio signal, and K is pre-set zoom coefficient.
In conjunction with the implementation that the first or the second of second aspect or second aspect are possible, in the implementation that the third is possible, also comprise:
Center channels strengthens processing module, for carrying out enhancing process to the described centre gangway signal extracted by Predetermined filter;
Described gain control module also for:
Respectively gain control is carried out to the virtual channel signal of the virtual channel signal in a described left side and the described right side by the described centre gangway signal after strengthening process.
In conjunction with the third possible implementation of second aspect, in the 4th kind of possible implementation, described center channels strengthen processing module specifically for:
Adopt cascade N number of iir filter to extract described centre gangway signal carry out enhancings process, wherein N be more than or equal to 2 positive integer.
In conjunction with the first of second aspect or second aspect to any one possible implementation in the 4th kind, in the 5th kind of possible implementation, described gain control module specifically for:
Described centre gangway signal is added to carry out gain control with the virtual channel signal of the virtual channel signal in a described left side and the described right side respectively.
In conjunction with the first of second aspect or second aspect to any one possible implementation in the 5th kind, in the 6th kind of possible implementation, also comprise:
Volume strengthens processing module, for passing through the virtual channel signal of the virtual channel signal in a described left side and the described right side after real-time gain compensation deals gain control;
Described output module also for: the virtual channel signal of the virtual channel signal in a described left side after gain compensation process and the described right side is exported.
Implement the embodiment of the present invention, there is following beneficial effect:
The audio signal that process receives is to extract centre gangway signal and distinguishing left and right side channel signal, the left and right side channel signal using virtualization processor process to extract to obtain is to obtain the virtual channel signal of left virtual channel signal and the right side, this virtualization processor directly make use of ears time difference information and/or binaural sound strong difference information, when embedded loud speaker interval is narrower, improve the virtual extended range of loud speaker, and improve tonequality.
Accompanying drawing explanation
In order to be illustrated more clearly in the technical scheme in the embodiment of the present invention, be briefly described to the accompanying drawing used required in embodiment below, apparently, accompanying drawing in the following describes is some embodiments of the present invention, for those of ordinary skill in the art, under the prerequisite not paying creative work, other accompanying drawing can also be obtained according to these accompanying drawings.
Fig. 1 is the schematic diagram of the application scenarios of a kind of electric terminal that the embodiment of the present invention provides;
Fig. 2 is the structural representation of the processing unit of a kind of audio signal that the embodiment of the present invention provides;
Fig. 3 is the structural representation of the center channels extraction module that the embodiment of the present invention provides;
Fig. 4 is the structural representation that the embodiment of the present invention provides the processing unit of another kind of audio signal;
Fig. 5 is the circuit diagram of a kind of center channels enhancing processing module that the embodiment of the present invention provides;
Fig. 6 is the schematic flow sheet of the processing method of a kind of audio signal that the embodiment of the present invention provides.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, be clearly and completely described the technical scheme in the embodiment of the present invention, obviously, described embodiment is the present invention's part embodiment, instead of whole embodiments.Based on the embodiment in the present invention, those of ordinary skill in the art, not making the every other embodiment obtained under creative work prerequisite, belong to the scope of protection of the invention.
In this part, first the concept that the embodiment of the present invention all relates to is described.
The processing method of the audio signal of the embodiment of the present invention is applied to electric terminal, described electric terminal in conjunction with particular hardware application scenarios figure as shown in Figure 1, virtual speaker is combined with entity loud speaker, when embedded loud speaker interval is narrower, the virtual extended range of loud speaker can be improved.Wherein, described electric terminal can such as panel computer, MP3 player, smart mobile phone, television set etc.
Virtual reproducing system in Fig. 1 is the processing unit of the audio signal in the embodiment of the present invention.The embodiment of lower mask body composition graphs 2 describes the function of modules in the processing unit of audio signal in detail.
Refer to Fig. 2, Fig. 2 is the structural representation of the processing unit of a kind of audio signal that the embodiment of the present invention provides.The processing unit 2 of described audio signal at least can comprise input module 21, center channels extraction module 22, virtual filtering processing module 23, gain control module 24 and output module 25 as shown in Figure 2, wherein:
Input module 21, for receiving at least one audio signal, described audio signal comprises left channel signal and right channel signal.Described audio signal can be any double-channel audio frequency signal.Described double-channel audio frequency signal comprises two wing passages signal LF (t), the RF (t) that expection is undertaken playing by a pair front loudspeakers LF, RF.
Center channels extraction module 22, for the treatment of described audio signal, to extract centre gangway signal and distinguishing left channel signal and right channel signal.
As shown in Figure 3, described center channels extraction module 22 specifically can comprise:
Filter unit 221, for described audio signal to be filtered into multiple sub-band audio signal of different frequency bands according to pre-set frequency band, each described sub-band audio signal comprises left sub-band audio signal and right sub-band audio signal.In specific implementation, filter unit 221 can be sampled to described audio signal, re-use FFT (FastFourierTransformation, fast Fourier transform) to calculate, result of calculation is filtered into multiple sub-band audio signal of different frequency bands according to pre-set frequency band.Limited by pre-set frequency band antithetical phrase band, then can control the frequency band range that center channels is extracted.
Wherein, described left sub-band audio signal is that left channel signal in described sub-band audio signal is by obtaining after filtering; Described right sub-band audio signal is that right channel signal in described sub-band audio signal is by obtaining after filtering.
Extraction unit 222, for extracting the subband centre gangway signal in each described sub-band audio signal.
Wherein, described extraction unit 222 specifically may be used for:
The described subband centre gangway signal in each described sub-band audio signal is determined according to formula M=K* (L+R), wherein, M is described subband centre gangway signal, L is the described left sub-band audio signal in its sub-band audio signal, R is the described right sub-band audio signal in its sub-band audio signal, and K is pre-set zoom coefficient.
Described panntographic system K is predefined, or, determined by the interchannel similarity index constantly assessed between described left channel signal and described right channel signal, wherein, the size of described interchannel similarity index and described left channel signal and the common signal component of described right channel signal is relevant.
Optionally, described interchannel similarity index is by described left channel signal and described right channel signal and comparing with the power of difference being determined.
Processing unit 223, for the described subband centre gangway signal subtraction described left sub-band audio signal in each described sub-band audio signal and described right sub-band audio signal extracted with it respectively, obtain the left sub-band audio signal after adjustment and right sub-band audio signal respectively.
Concrete, can determine the left sub-band audio signal after the adjustment in each sub-band audio signal according to formula L '=L – M, wherein, L ' is the left sub-band audio signal after adjustment, and L is the left sub-band audio signal before adjustment, and M is subband centre gangway signal; In like manner, can determine the right sub-band audio signal after the adjustment in each sub-band audio signal according to formula R '=R – M, wherein, L ' is the right sub-band audio signal after adjustment, and L is the right sub-band audio signal before adjustment, and M is subband centre gangway signal;
Assembled unit 224, for left sub-band audio signal described in each after adjustment is reconfigured to obtain described left channel signal, and right sub-band audio signal described in each after adjustment is reconfigured to obtain described left channel signal, and by subband centre gangway signal combination described in each to obtain the described centre gangway signal of Whole frequency band.
Virtual filtering processing module 23, extracts the described left channel signal and described right channel signal that obtain, to obtain the virtual channel signal of left virtual channel signal and the right side for using virtualization processor process.
This virtualization processor directly make use of ears time difference information and/or binaural sound strong difference information, when embedded loud speaker interval is narrower, improves the virtual extended range of loud speaker.
Wherein, described virtualization processor comprises by T 1the first hrtf filter represented and T 2the second hrtf filter represented, T 1and T 2comprise following transfer function, and H 1and H 2meet following relation:
[T 1,T 2;T 2,T 1]=[H 1,H 2;H 2,H 1]*[G 1,G 2;G 2,G 1]
[H 1,H 2;H 2,H 1]*[C 1,C 2;C 2,C 1]=[I,0;0,I]
G 1the homonymy HRTF for left virtual loudspeaker positions or right virtual loudspeaker positions;
G2 is the offside HRTF for left virtual loudspeaker positions or right virtual loudspeaker positions;
C 1the homonymy HRTF for left actual loudspeaker position or right actual loudspeaker position;
C 2the offside HRTF for left actual loudspeaker position or right actual loudspeaker position;
And C 1and C 2only comprise ears time difference information and/or binaural sound strong difference information;
Gain control module 24, for carrying out gain control to the virtual channel signal of the virtual channel signal in a described left side and the described right side respectively by described centre gangway signal.
Described gain control module 24 specifically may be used for:
Described centre gangway signal is added to carry out gain control with the virtual channel signal of the virtual channel signal in a described left side and the described right side respectively.Controlled to reduce the difference of maximum in the frequency band caused due to virtualization process, most descending gain by gain, overall reproduced is balanced more, simultaneously in the lifting volume ensureing distortionless prerequisite, enhances Consumer's Experience.
Output module 25, exports for the virtual channel signal of the virtual channel signal in a described left side and the described right side after gain being controlled.
Further, as shown in Figure 4, the processing unit 2 of described audio signal can also comprise center channels and strengthen processing module 26, for carrying out enhancing process to the described centre gangway signal extracted by Predetermined filter; Gain control module 24 can also carry out gain control to the virtual channel signal of the virtual channel signal in a described left side and the described right side respectively by strengthening the described centre gangway signal after processing.
Wherein, described center channels strengthen processing module 26 specifically for:
Adopt cascade N number of iir filter to extract described centre gangway signal carry out enhancings process, wherein N be more than or equal to 2 positive integer.The effect strengthening process is identical with the type of filter with the quantity of filter, as shown in table 1, and it should be noted that, the quantity of filter and type can adjust according to practical application, and the present invention does not limit.Suppose, the present invention adopts iir digital filter, and N=3, the circuit diagram of described center channels enhancing processing module 26 can with reference to Fig. 5.
Filter data 1 2 3
Type PEQ PEQ LSV
Frequency[Hz] 1.6k 8k 800
Level[dB] 2.0 3.0 -0.1
Q value 0.5 0.6 0.707
Particularly important in some scene center channels, as the dialogue of film scene, this programme center channels strengthens processing module 26 and carries out gain at specific frequency, independently control volume gain, obtains voice more clearly, promotes overall experience.
Further, as shown in Figure 4, the processing unit 2 of described audio signal can also comprise volume and strengthen processing module 27, for passing through the virtual channel signal of the virtual channel signal in a described left side and the described right side after real-time gain compensation deals gain control; The virtual channel signal of the virtual channel signal in a described left side after gain compensation process and the described right side can also export by described output module 25.
Implement the embodiment of the present invention, the audio signal that the process of center channels extraction module receives is to extract centre gangway signal and distinguishing left and right side channel signal, the left and right side channel signal that virtual filtering processing module uses virtualization processor process to extract to obtain is to obtain the virtual channel signal of left virtual channel signal and the right side, this virtualization processor directly make use of ears time difference information and/or binaural sound strong difference information, when embedded loud speaker interval is narrower, improve the virtual extended range of loud speaker, and improve tonequality.
Refer to Fig. 6, Fig. 6 is the schematic flow sheet of the processing method of a kind of audio signal that the embodiment of the present invention provides.Described method can comprise as shown in Figure 6:
Step S61, receives at least one audio signal, and described audio signal comprises left channel signal and right channel signal.Described audio signal can be any double-channel audio frequency signal.Described double-channel audio frequency signal comprises two wing passages signal LF (t), the RF (t) that expection is undertaken playing by a pair front loudspeakers LF, RF.
Step S62, processes described audio signal, to extract centre gangway signal and distinguishing left channel signal and right channel signal.
Described audio signal is filtered into multiple sub-band audio signal of different frequency bands according to pre-set frequency band, each described sub-band audio signal comprises left sub-band audio signal and right sub-band audio signal.In specific implementation, can sample to described audio signal, re-use FFT (FastFourierTransformation, fast Fourier transform) to calculate, result of calculation is filtered into multiple sub-band audio signal of different frequency bands according to pre-set frequency band.Wherein, described left sub-band audio signal is that left channel signal in described sub-band audio signal is by obtaining after filtering; Described right sub-band audio signal is that right channel signal in described sub-band audio signal is by obtaining after filtering.
Extract the subband centre gangway signal in each described sub-band audio signal.In specific implementation, the described subband centre gangway signal in each described sub-band audio signal can be determined according to formula M=K* (L+R), wherein, M is described subband centre gangway signal, L is the described left sub-band audio signal in its sub-band audio signal, R is the described right sub-band audio signal in its sub-band audio signal, and K is pre-set zoom coefficient.
Wherein, described panntographic system K is predefined, or, determined by the interchannel similarity index constantly assessed between described left channel signal and described right channel signal, wherein, the size of described interchannel similarity index and described left channel signal and the common signal component of described right channel signal is relevant.Optionally, described interchannel similarity index is by described left channel signal and described right channel signal and comparing with the power of difference being determined.
The described subband centre gangway signal subtraction described left sub-band audio signal in each described sub-band audio signal and described right sub-band audio signal extracted with it respectively, obtains the left sub-band audio signal after adjustment and right sub-band audio signal respectively.
Left sub-band audio signal described in each after adjustment is reconfigured to obtain described left channel signal, right sub-band audio signal described in each after adjustment is reconfigured to obtain described left channel signal, by subband centre gangway signal combination described in each to obtain the described centre gangway signal of Whole frequency band.Reconfigure the left channel signal of acquisition and the correlation of right channel signal lower than the correlation of original left channel signal and right channel signal.
Step S63, uses virtualization processor process to extract the described left channel signal and described right channel signal that obtain, to obtain the virtual channel signal of left virtual channel signal and the right side.
This virtualization processor directly make use of ears time difference information and/or binaural sound strong difference information, when embedded loud speaker interval is narrower, improves the virtual extended range of loud speaker.
Wherein, described virtualization processor comprises by T 1the first hrtf filter represented and T 2the second hrtf filter represented, T 1and T 2comprise following transfer function, and H 1and H 2meet following relation:
[T 1,T 2;T 2,T 1]=[H 1,H 2;H 2,H 1]*[G 1,G 2;G 2,G 1]
[H 1,H 2;H 2,H 1]*[C 1,C 2;C 2,C 1]=[I,0;0,I]
G 1the homonymy HRTF for left virtual loudspeaker positions or right virtual loudspeaker positions;
G2 is the offside HRTF for left virtual loudspeaker positions or right virtual loudspeaker positions;
C 1the homonymy HRTF for left actual loudspeaker position or right actual loudspeaker position;
C 2the offside HRTF for left actual loudspeaker position or right actual loudspeaker position;
C 1and C 2only comprise ears time difference information and/or binaural sound strong difference information;
Step S64, carries out gain control to the virtual channel signal of the virtual channel signal in a described left side and the described right side respectively by described centre gangway signal.
Optionally, described centre gangway signal can be added to carry out gain control with the virtual channel signal of the virtual channel signal in a described left side and the described right side respectively.
Controlled to reduce the difference of maximum in the frequency band caused due to virtualization process, most descending gain by gain, overall reproduced is balanced more, simultaneously in the lifting volume ensureing distortionless prerequisite, enhances Consumer's Experience.
Further, enhancing process can also be carried out to the described centre gangway signal extracted by Predetermined filter, and respectively gain control be carried out to the virtual channel signal of the virtual channel signal in a described left side and the described right side by the described centre gangway signal after strengthening process.In specific implementation, can adopt N number of iir filter of cascade to extract described centre gangway signal carry out enhancings process, wherein N be more than or equal to 2 positive integer.Particularly important in some scene center channels, as the dialogue of film scene, this programme, by carrying out gain at specific frequency, independently control volume gain, obtains voice more clearly, promotes overall experience.
Step S65, the virtual channel signal of the virtual channel signal in a described left side after gain being controlled and the described right side exports.Further, the virtual channel signal of the virtual channel signal in a described left side and the described right side after can also being controlled by real-time gain compensation deals gain, and the virtual channel signal of the virtual channel signal in a described left side after gain compensation process and the described right side is exported.
Implement the embodiment of the present invention, the audio signal that receives can be processed to extract centre gangway signal and distinguishing left and right side channel signal, and the left and right side channel signal using virtualization processor process to extract to obtain is to obtain the virtual channel signal of left virtual channel signal and the right side, this virtualization processor directly make use of ears time difference information and/or binaural sound strong difference information, when embedded loud speaker interval is narrower, improve the virtual extended range of loud speaker, and improve tonequality.
It should be noted that, in the above-described embodiments, the description of each embodiment is all emphasized particularly on different fields in certain embodiment, there is no the part described in detail, can see the associated description of other embodiments.Secondly, those skilled in the art also should know, the embodiment described in specification all belongs to preferred embodiment, and involved action and module might not be that the embodiment of the present invention is necessary.
Step in embodiment of the present invention method can be carried out order according to actual needs and be adjusted, merges and delete.
Module in embodiment of the present invention device or unit can carry out merging, divide and deleting according to actual needs.
Module described in the embodiment of the present invention or unit, universal integrated circuit can be passed through, such as CPU (CentralProcessingUnit, central processing unit), or realized by ASIC (ApplicationSpecificIntegratedCircuit, application-specific integrated circuit (ASIC)).
One of ordinary skill in the art will appreciate that all or part of flow process realized in above-described embodiment method, that the hardware that can carry out instruction relevant by computer program has come, described program can be stored in a computer read/write memory medium, this program, when performing, can comprise the flow process of the embodiment as above-mentioned each side method.Wherein, described storage medium can be magnetic disc, CD, read-only store-memory body (Read-OnlyMemory, ROM) or random store-memory body (RandomAccessMemory, RAM) etc.
Above disclosedly be only present pre-ferred embodiments, certainly can not limit the interest field of the present invention with this, therefore according to the equivalent variations that the claims in the present invention are done, still belong to the scope that the present invention is contained.

Claims (14)

1. a processing method for audio signal, is characterized in that, comprising:
Receive at least one audio signal, described audio signal comprises left channel signal and right channel signal;
Process described audio signal, to extract centre gangway signal and distinguishing left channel signal and right channel signal;
Virtualization processor process is used to extract the described left channel signal and described right channel signal that obtain, to obtain the virtual channel signal of left virtual channel signal and the right side;
Wherein, described virtualization processor comprises by T 1the first hrtf filter represented and T 2the second hrtf filter represented, T 1and T 2comprise following transfer function, and H 1and H 2meet following relation:
[T 1,T 2;T 2,T 1]=[H 1,H 2;H 2,H 1]*[G 1,G 2;G 2,G 1]
[H 1,H 2;H 2,H 1]*[C 1,C 2;C 2,C 1]=[I,0;0,I]
G 1the offside HRTF that to be the homonymy HRTF for left virtual loudspeaker positions or right virtual loudspeaker positions, G2 be for left virtual loudspeaker positions or right virtual loudspeaker positions, C 1the homonymy HRTF for left actual loudspeaker position or right actual loudspeaker position, C 2the offside HRTF for left actual loudspeaker position or right actual loudspeaker position, and C 1and C 2only comprise ears time difference information and/or binaural sound strong difference information;
Respectively gain control is carried out to the virtual channel signal of the virtual channel signal in a described left side and the described right side by described centre gangway signal;
The virtual channel signal of the virtual channel signal in a described left side after gain being controlled and the described right side exports.
2. the method for claim 1, is characterized in that, the described audio signal of described process, comprises to extract centre gangway signal and distinguishing left channel signal and right channel signal:
Described audio signal is filtered into multiple sub-band audio signal of different frequency bands according to pre-set frequency band, each described sub-band audio signal comprises left sub-band audio signal and right sub-band audio signal;
Extract the subband centre gangway signal in each described sub-band audio signal;
The described subband centre gangway signal subtraction described left sub-band audio signal in each described sub-band audio signal and described right sub-band audio signal extracted with it respectively, obtains the left sub-band audio signal after adjustment and right sub-band audio signal respectively;
Left sub-band audio signal described in each after adjustment is reconfigured to obtain described left channel signal;
Right sub-band audio signal described in each after adjustment is reconfigured to obtain described left channel signal;
By subband centre gangway signal combination described in each to obtain the described centre gangway signal of Whole frequency band.
3. method as claimed in claim 2, it is characterized in that, the subband centre gangway signal in each described sub-band audio signal of described extraction comprises:
The described subband centre gangway signal in each described sub-band audio signal is determined according to formula M=K* (L+R), wherein, M is described subband centre gangway signal, L is the described left sub-band audio signal in its sub-band audio signal, R is the described right sub-band audio signal in its sub-band audio signal, and K is pre-set zoom coefficient.
4. the method according to any one of claim 1-3, is characterized in that, described method also comprises:
By Predetermined filter, enhancing process is carried out to the described centre gangway signal extracted;
Described by described centre gangway signal respectively to the virtual channel signal of the virtual channel signal in a described left side and the described right side carry out gain control comprise:
Respectively gain control is carried out to the virtual channel signal of the virtual channel signal in a described left side and the described right side by the described centre gangway signal after strengthening process.
5. method as claimed in claim 4, is characterized in that, the described described centre gangway signal to extracting carries out enhancing process by Predetermined filter and comprises:
Adopt cascade N number of iir filter to extract described centre gangway signal carry out enhancings process, wherein N be more than or equal to 2 positive integer.
6. the method according to any one of claim 1-5, is characterized in that,
Described by described centre gangway signal respectively to the virtual channel signal of the virtual channel signal in a described left side and the described right side carry out gain control comprise:
Described centre gangway signal is added to carry out gain control with the virtual channel signal of the virtual channel signal in a described left side and the described right side respectively.
7. the method according to any one of claim 1-6, is characterized in that, described method also comprises:
The virtual channel signal of the virtual channel signal in a described left side and the described right side after being controlled by real-time gain compensation deals gain, and the virtual channel signal of the virtual channel signal in a described left side after gain compensation process and the described right side is exported.
8. a processing unit for audio signal, is characterized in that, comprising:
Input module, for receiving at least one audio signal, described audio signal comprises left channel signal and right channel signal;
Center channels extraction module, for the treatment of described audio signal, to extract centre gangway signal and distinguishing left channel signal and right channel signal;
Virtual filtering processing module, extracts the described left channel signal and described right channel signal that obtain, to obtain the virtual channel signal of left virtual channel signal and the right side for using virtualization processor process;
Wherein, described virtualization processor comprises by T 1the first hrtf filter represented and T 2the second hrtf filter represented, T 1and T 2comprise following transfer function, and H 1and H 2meet following relation:
[T 1,T 2;T 2,T 1]=[H 1,H 2;H 2,H 1]*[G 1,G 2;G 2,G 1]
[H 1,H 2;H 2,H 1]*[C 1,C 2;C 2,C 1]=[I,0;0,I]
G 1the offside HRTF that to be the homonymy HRTF for left virtual loudspeaker positions or right virtual loudspeaker positions, G2 be for left virtual loudspeaker positions or right virtual loudspeaker positions, C 1the homonymy HRTF for left actual loudspeaker position or right actual loudspeaker position, C 2the offside HRTF for left actual loudspeaker position or right actual loudspeaker position, and C 1and C 2only comprise ears time difference information and/or binaural sound strong difference information;
Gain control module, for carrying out gain control to the virtual channel signal of the virtual channel signal in a described left side and the described right side respectively by described centre gangway signal;
Output module, exports for the virtual channel signal of the virtual channel signal in a described left side and the described right side after gain being controlled.
9. device as claimed in claim 8, it is characterized in that, described center channels extraction module comprises:
Filter unit, for described audio signal to be filtered into multiple sub-band audio signal of different frequency bands according to pre-set frequency band, each described sub-band audio signal comprises left sub-band audio signal and right sub-band audio signal;
Extraction unit, for extracting the subband centre gangway signal in each described sub-band audio signal;
Processing unit, for the described subband centre gangway signal subtraction described left sub-band audio signal in each described sub-band audio signal and described right sub-band audio signal extracted with it respectively, obtain the left sub-band audio signal after adjustment and right sub-band audio signal respectively;
Assembled unit, for left sub-band audio signal described in each after adjustment is reconfigured to obtain described left channel signal, and right sub-band audio signal described in each after adjustment is reconfigured to obtain described left channel signal, and by subband centre gangway signal combination described in each to obtain the described centre gangway signal of Whole frequency band.
10. device as claimed in claim 9, is characterized in that, described extraction unit specifically for:
The described subband centre gangway signal in each described sub-band audio signal is determined according to formula M=K* (L+R), wherein, M is described subband centre gangway signal, L is the described left sub-band audio signal in its sub-band audio signal, R is the described right sub-band audio signal in its sub-band audio signal, and K is pre-set zoom coefficient.
11. devices according to any one of claim 8-10, is characterized in that, also comprise:
Center channels strengthens processing module, for carrying out enhancing process to the described centre gangway signal extracted by Predetermined filter;
Described gain control module also for:
Respectively gain control is carried out to the virtual channel signal of the virtual channel signal in a described left side and the described right side by the described centre gangway signal after strengthening process.
12. devices as claimed in claim 11, is characterized in that,
Described center channels strengthen processing module specifically for:
Adopt cascade N number of iir filter to extract described centre gangway signal carry out enhancings process, wherein N be more than or equal to 2 positive integer.
13. devices according to any one of claim 8-12, is characterized in that,
Described gain control module specifically for:
Described centre gangway signal is added to carry out gain control with the virtual channel signal of the virtual channel signal in a described left side and the described right side respectively.
14. devices according to any one of claim 8-12, is characterized in that, also comprise:
Volume strengthens processing module, for passing through the virtual channel signal of the virtual channel signal in a described left side and the described right side after real-time gain compensation deals gain control;
Described output module also for: the virtual channel signal of the virtual channel signal in a described left side after gain compensation process and the described right side is exported.
CN201510591332.6A 2015-09-16 2015-09-16 A kind for the treatment of method and apparatus of audio signal Active CN105142094B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510591332.6A CN105142094B (en) 2015-09-16 2015-09-16 A kind for the treatment of method and apparatus of audio signal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510591332.6A CN105142094B (en) 2015-09-16 2015-09-16 A kind for the treatment of method and apparatus of audio signal

Publications (2)

Publication Number Publication Date
CN105142094A true CN105142094A (en) 2015-12-09
CN105142094B CN105142094B (en) 2018-07-13

Family

ID=54727276

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510591332.6A Active CN105142094B (en) 2015-09-16 2015-09-16 A kind for the treatment of method and apparatus of audio signal

Country Status (1)

Country Link
CN (1) CN105142094B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105792090A (en) * 2016-04-27 2016-07-20 华为技术有限公司 Method and device of increasing reverberation
CN105933818A (en) * 2016-07-07 2016-09-07 音曼(北京)科技有限公司 Method and system for implementing phantom centrally-mounted channel in three-dimensional acoustic field reconstruction of earphone

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1630434A (en) * 2003-12-17 2005-06-22 三星电子株式会社 Apparatus and method of reproducing virtual sound
CN102597987A (en) * 2009-06-01 2012-07-18 Dts(英属维尔京群岛)有限公司 Virtual audio processing for loudspeaker or headphone playback
WO2014035728A2 (en) * 2012-08-31 2014-03-06 Dolby Laboratories Licensing Corporation Virtual rendering of object-based audio

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1630434A (en) * 2003-12-17 2005-06-22 三星电子株式会社 Apparatus and method of reproducing virtual sound
CN102597987A (en) * 2009-06-01 2012-07-18 Dts(英属维尔京群岛)有限公司 Virtual audio processing for loudspeaker or headphone playback
WO2014035728A2 (en) * 2012-08-31 2014-03-06 Dolby Laboratories Licensing Corporation Virtual rendering of object-based audio

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105792090A (en) * 2016-04-27 2016-07-20 华为技术有限公司 Method and device of increasing reverberation
CN105792090B (en) * 2016-04-27 2018-06-26 华为技术有限公司 A kind of method and apparatus for increasing reverberation
CN105933818A (en) * 2016-07-07 2016-09-07 音曼(北京)科技有限公司 Method and system for implementing phantom centrally-mounted channel in three-dimensional acoustic field reconstruction of earphone
CN105933818B (en) * 2016-07-07 2018-10-16 音曼(北京)科技有限公司 The realization method and system for the mirage center channels that earphone three-dimensional sound field is rebuild

Also Published As

Publication number Publication date
CN105142094B (en) 2018-07-13

Similar Documents

Publication Publication Date Title
US10210883B2 (en) Signal processing apparatus for enhancing a voice component within a multi-channel audio signal
US9398391B2 (en) Stereo widening over arbitrarily-configured loudspeakers
CN104053120B (en) A kind of processing method of stereo audio and device
KR20180075610A (en) Apparatus and method for sound stage enhancement
CN107005778A (en) The audio signal processing apparatus and method rendered for ears
CN106878866A (en) Acoustic signal processing method, device and terminal
CN107979796A (en) System and method for the stereo field domain enhancing in two-channel audio system
MX2010011305A (en) Method and apparatus for maintaining speech audibility in multi-channel audio with minimal impact on surround experience.
EP3785453B1 (en) Blind detection of binauralized stereo content
CN109036446B (en) Audio data processing method and related equipment
CN105450193A (en) Volume adjusting method and volume adjusting device
JP6785907B2 (en) How to arrange wireless speakers, wireless speakers and terminal devices
CN106886387A (en) A kind of audio data processing method and its equipment
US20170213565A1 (en) Apparatus, Methods and Computer Programs for Encoding and Decoding Audio Signals
CN105142094A (en) Audio signal processing method and device
CN103489461B (en) Audio file play method and system, player
CN103812462A (en) Loudness control method and device
CN109074813A (en) Handle high definition audio data
CN108495235A (en) A kind of separation method of supper bass, device, computer equipment and storage medium
CN112053669A (en) Method, device, equipment and medium for eliminating human voice
CN112840678B (en) Stereo playing method, device, storage medium and electronic equipment
CN108769864B (en) Audio equalization processing method and device and electronic equipment
CN104392744A (en) Method and apparatus for recording voice frequency
CN106170114A (en) Control method, device and the audio-frequence player device of a kind of audio frequency output
CN114067817A (en) Bass enhancement method, bass enhancement device, electronic equipment and storage medium

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant