WO2019023853A1 - 一种音频处理方法以及音频处理设备 - Google Patents

一种音频处理方法以及音频处理设备 Download PDF

Info

Publication number
WO2019023853A1
WO2019023853A1 PCT/CN2017/095187 CN2017095187W WO2019023853A1 WO 2019023853 A1 WO2019023853 A1 WO 2019023853A1 CN 2017095187 W CN2017095187 W CN 2017095187W WO 2019023853 A1 WO2019023853 A1 WO 2019023853A1
Authority
WO
WIPO (PCT)
Prior art keywords
speaker
audio signal
sound source
target
speakers
Prior art date
Application number
PCT/CN2017/095187
Other languages
English (en)
French (fr)
Inventor
白鹤群
徐德著
赵翔宇
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to CN201780092977.2A priority Critical patent/CN110892735B/zh
Priority to PCT/CN2017/095187 priority patent/WO2019023853A1/zh
Publication of WO2019023853A1 publication Critical patent/WO2019023853A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R5/00—Stereophonic arrangements
    • H04R5/02—Spatial or constructional arrangements of loudspeakers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control

Definitions

  • the embodiments of the present application relate to the field of communications, and in particular, to an audio processing method and an audio processing device.
  • Virtual audio technology enhances the user experience in virtual reality scenes, enhancing realism and immersion.
  • virtual audio technology in addition to rendering the reverberation effect of the virtual environment, the most important basic requirement is to be able to accurately simulate the orientation of the virtual sound source in 3D (3D) space.
  • the mainstream 3D audio technology usually uses left and right two-channel earphones, and according to the position information of the sound source set by the head tracking or the virtual scene, the corresponding head related transfer function (HRTF) data is selected. Then, according to the principle that the time domain convolution is equivalent to the frequency domain convolution, the HRTF data is multiplied by the fast Fourier transform FFT of the input time domain audio signal to obtain the final audio signal.
  • HRTF head related transfer function
  • the final audio signal is calculated according to the HRTF data corresponding to the orientation information of the sound source, and in actual application, when the HRTF data is selected for each individual for calculation, The direction of the sound is distorted, so only relying on the orientation information of the sound source is inaccurate for the orientation of the sound source in the 3D space.
  • the embodiment of the present application provides an audio processing method and an audio processing device for improving the azimuth positioning accuracy of a virtual sound source in a 3D space.
  • an embodiment of the present application provides an audio processing method, including:
  • the audio playing environment includes an audio processing device and four speakers; the plane in which the four speakers are located is a target plane, and the four speakers form a quadrilateral, wherein the first speaker is located on the opposite side of the fourth speaker.
  • the second speaker is located on the opposite side of the third speaker, that is, the position parameters of the four speakers may be as follows: the first speaker and the second speaker are located in front of the target plane, and the third speaker is located at the fourth speaker Behind the target plane, the first speaker and the third speaker are located to the left of the target plane, and the second speaker and the fourth speaker are located to the right of the target plane; the audio processing device determines the four speakers Location parameter.
  • the source location parameter of the original audio signal is then simultaneously determined while the audio processing device is receiving the original audio signal.
  • the audio processing device processes the original audio signal according to the sound source position of the original audio signal to obtain a target two-channel audio signal; and then the audio processing device processes the target according to the position parameters of the four speakers and the sound source position parameter.
  • the two-channel audio signal obtains a four-channel audio signal that is in one-to-one correspondence with the four speakers; finally, the audio processing device transmits the four-channel audio signal to the four speakers for playback.
  • the target two-channel audio signal includes a left channel audio signal, a left front audio signal, a right front audio signal, a left rear audio signal, and a right rear. audio signal.
  • the delay of the target two-channel audio signal is used to indicate the left and right direction of the sound source indicated by the sound source position parameter, and the frequency domain characteristic of the target two-channel audio signal is used to indicate the up and down direction of the sound source; the four-channel audio signal
  • the amplitude of the four-channel audio signal is used to indicate the left and right direction of the sound source, and the frequency domain characteristic of the four-channel audio signal is used to indicate the up and down direction of the sound source.
  • the delay of the target two-channel audio signal is The delay of the left channel audio signal and the right channel audio signal; the delay of the four channel audio signal refers to the delay of the left front audio signal and the right front audio signal and the time of the left rear audio signal and the right rear audio signal.
  • the amplitude of the target two-channel audio signal and the four-channel audio signal is the waveform amplitude of each channel, and the frequency characteristics of the target two-channel audio signal and the four-channel audio signal are the frequencies of the respective signals. Feature and amplitude characteristics.
  • the audio processing device simulates the orientation information of the sound source position of the original audio signal
  • the position parameters of the four speakers are simultaneously considered, and the sound source position of the original audio signal is
  • the front and rear orientations are simulated to ensure that the audio processing device is more accurate in determining the position information of the source position of the original audio signal.
  • the audio processing device may specifically adopt the following scheme:
  • the audio processing device obtains a low frequency signal corresponding to the original audio signal and a high frequency signal corresponding to the original audio signal according to the original audio signal; and the audio processing device can also follow the sound source position parameter of the original audio signal. Determining, in the saved HRTF database, a target HRTF that matches the sound source location parameter; then the audio processing device convolves the low frequency signal with the target HRTF to obtain a first two-channel audio signal; and the audio processing device acquires the sound source a height characteristic response corresponding to the height parameter in the position parameter; then the audio processing device convolves the high frequency signal with the height feature response to obtain a target audio signal; and the audio processing device passes the sound source position indicated by the sound source position parameter
  • the rigid ball model calculates a frequency domain response of the sound source position to the left ear position and a frequency domain response of the sound source position to the right ear position; the audio processing device then uses the inverse fast Fourier transform (inverse fast Fourier) Transfer, IFFT) get the time domain response; the audio processing Preparing
  • the left ear position is a position between the first speaker and the third speaker
  • the right ear position is a position between the second speaker and the fourth speaker
  • the sound source position is according to The sound source position parameter determines that the four speakers form a quadrilateral, wherein the first speaker is located on the opposite side of the fourth speaker, and the second speaker is located on the opposite side of the third speaker.
  • the audio processing device can also obtain a low frequency signal of the original audio signal by low pass filtering, and obtain a high frequency signal of the original audio signal by high pass filtering.
  • the audio processing device obtains a low frequency signal and a high frequency signal corresponding to the original audio signal.
  • the specific manner is not limited herein.
  • the audio processing device when the audio processing device acquires the height feature response corresponding to the height parameter in the sound source location parameter, the following scheme may be adopted:
  • the audio processing device calculates the height feature response according to the first formula
  • the audio processing device calculates the height feature response according to the second formula
  • the second formula is:
  • ⁇ is height information of the sound source position relative to the horizontal plane
  • the H F_elve is a sound source position corresponding to the sound source position when the first speaker and the second speaker are located on one side of the four speakers a height characteristic response
  • the H B_elve is a height characteristic response corresponding to the sound source position when the sound source position is located at one side of the fourth speaker and the fourth speaker of the four speakers
  • the HRTF ( ⁇ , 0) is The HRTF data with an elevation angle of ⁇ and an azimuth angle of 0 degrees
  • the HRTF (0, 0) is a front-facing HRTF data with an elevation angle of 0 degrees and an azimuth angle of 0 degrees
  • the HRTF ( ⁇ , 180) is an elevation angle of ⁇ .
  • the azimuth angle is 180 degrees corresponding to the HRTF data
  • the HRTF (0, 180) is a direct rear HRTF data with an elevation angle of 0 degrees and an azimuth angle of 180 degrees.
  • the H F_elve may also be a height feature response corresponding to the sound source position when the distance of the sound source position from the first midpoint is less than the distance of the sound source position from the second midpoint.
  • H B_elve is a height characteristic response corresponding to the position of the sound source when the distance from the first midpoint is greater than the distance from the sound source position to the second midpoint, and the first midpoint is the first speaker and the second speaker The midpoint between the second midpoint is the midpoint between the third speaker and the fourth speaker.
  • the distance of the sound source position from the first midpoint is smaller than the distance of the sound source position from the second midpoint and is located at a position directly opposite the first midpoint or the sound source position a position of the first speaker and the second speaker facing the first midpoint of the four speakers, and the distance of the sound source position from the first midpoint when the azimuth angle is 180 degrees a position greater than a distance of the sound source position from the second midpoint and facing the second midpoint or the sound source position is located on a side of the fourth speaker and the fourth speaker of the four speakers and facing The position of the second midpoint.
  • the height parameter includes height information for indicating the position of the sound source relative to a horizontal plane
  • the horizontal plane is a line connecting the left ear position and the right ear position and parallel to the target plane.
  • the audio processing device processes the low frequency signal of the original audio signal and the high frequency signal separately, which can be more accurately simulated. Azimuth information of the sound source position of the original audio signal.
  • the time domain response is transformed by a frequency domain response of the sound source location to the left ear position and a frequency domain response of the sound source location to the right ear position, the frequency domain response being determined by the audio processing device according to the sound source
  • the position is obtained using the rigid ball model, wherein the rigid ball model includes:
  • the ⁇ is a normalized distance from the center of the spherical ball to the position of the sound source
  • r is the distance from the center of the ball to the position of the sound source.
  • a is the radius of the sphere corresponding to the rigid ball model
  • the ⁇ is a normalized angular frequency
  • the f is a preset frequency
  • c is a sound propagation speed
  • the ⁇ L is the spherical center position and the sound source position
  • An angle of a line connecting the heart position to the position of the right ear, the sphere being determined according to a positional parameter of the four speakers
  • the horizontal plane being a plane passing through the line connecting the left ear position and the right ear position and parallel to the target plane
  • the target plane is the plane in which the four speakers are located.
  • the preset frequency is the frequency of the sound that can be heard by the human ear.
  • the audio processing device processes the target two-channel audio signal according to the position parameters of the four speakers and the sound source position parameter to obtain a four-channel audio signal
  • the following scheme may be adopted:
  • the audio processing device determines a first weight value of the first speaker and the second speaker of the four speakers according to the sound source position parameter and a position parameter of the four speakers, and the third speaker and the fourth of the four speakers a second weight value of the speaker; the audio processing device calculates the left front audio signal according to the first weight value and the left channel audio signal in the target two-channel audio signal, according to the first weight value and the target double Calculating the right front audio signal by the right channel audio signal in the channel audio signal, and calculating the left rear audio signal according to the second weight value and the left channel audio signal in the target two-channel audio signal, according to the The second weight value and the right channel audio signal in the target two-channel audio signal are calculated to obtain the right rear audio signal.
  • the audio processing determines the weight value of each of the four speakers according to the position parameters of the four speakers and the sound source position parameter, and the following scheme may be adopted:
  • the audio processing device determines that the first weight value is 1, and the second weight value is 0, and the target plane is the target plane The plane in which the four speakers are located;
  • the audio processing device determines that the first weight value is 0, and the second weight value is 1;
  • the audio processing device determines the first weight value and the second according to the first angle and the second angle a weight value
  • the first angle is an angle between a line connecting the position of the sound source and a position of the center position on the target plane and a front plane
  • the second angle is a line connecting the first speaker and the fourth speaker
  • the angle with the front plane or the second angle is the angle between the line connecting the second speaker and the third speaker and the front plane
  • the center position is the connection between the second speaker and the third speaker An intersection with a line connecting the first speaker and the fourth speaker, the front plane being a plane passing through the center position and perpendicular to the target plane;
  • the target plane is divided into four quadrants by a line connecting the first speaker and the fourth speaker and a line connecting the second speaker and the third speaker, and a quadrant between the first speaker and the second speaker is In the first quadrant, a quadrant between the third speaker and the fourth speaker is the second quadrant, a quadrant between the first speaker and the third speaker, and between the second speaker and the fourth speaker The quadrant is the third quadrant.
  • the audio processing device calculates the first weight according to the first angle and the second angle by using a third formula. Value and the second weight value;
  • the third formula includes:
  • the third formula is derived by the following formula:
  • the audio processing device calculates the left front audio signal according to the first weight value and the left channel audio signal in the target two-channel audio signal, according to the first weight value and the Calculating the right front audio signal of the right channel audio signal in the target two-channel audio signal, and calculating the left channel audio signal according to the second weight value and the target two-channel audio signal
  • the left rear audio signal may be calculated by using the fourth formula when calculating the right rear audio signal according to the second weight value and the right channel audio signal in the target two-channel audio signal;
  • the fourth formula includes:
  • the FL' is the left front audio signal
  • the FR' is a right front audio signal
  • the BL' is the left rear audio signal
  • the BR' is the right rear audio signal
  • the L is the target two-channel audio a left channel audio signal in the signal
  • the R being a right channel audio signal in the target two channel audio signal
  • the g 1 being the first weight value
  • the g 2 being the second weight value.
  • the audio processing device determines the weight values of the four speakers according to the position parameters of the speakers in the four speakers, and then calculates the audio signal corresponding to each speaker according to the weight value, which can be effective. Improving the azimuth positioning accuracy of the audio processing device for the sound source position of the original audio signal.
  • the audio processing device can obtain the four-channel audio signal according to the original audio signal, and the following method can also be adopted:
  • the audio processing device processes the target two-channel audio signal according to the position parameters of the four speakers and the sound source position parameter to obtain an intermediate four-channel audio signal;
  • the audio processing device acquires a near field compensation response of the four speaker to left ear positions and the four speaker to right ear positions according to positional parameters of the four speakers, the left ear position being the first speaker and the third speaker a position between the second speaker and a fourth speaker; the audio processing device utilizing the time domain response according to the intermediate four-channel audio signal and the near-field compensation response
  • the five formula obtains the four-channel audio signal, and the time domain response of the near-field compensation response is obtained by transforming the frequency-domain response of the near-field compensation;
  • the fifth formula is:
  • BR BR'*h BR ;
  • the FL is a left front audio signal
  • the FR is a right front audio signal
  • the BL is a left rear audio signal
  • the BR is a right rear audio signal
  • the h FL is the near field compensation of the first speaker to the left ear position.
  • a time domain response of the response the h FR being a time domain response of the near field compensation response from the second speaker to the right ear position
  • the h BL being a time domain of the near field compensation response of the third speaker to the left ear position in response
  • the right ear position h BR to the compensation of the near-field response for the domain in response to the fourth speaker.
  • the near sound compensation response is expressed as:
  • the E L (jw) is a Fourier transform of the sound signal heard at the position of the left ear
  • the E R (jw) is a Fourier transform of the sound signal heard at the position of the right ear
  • the X FL (jw) a Fourier transform of the sound played for the first speaker
  • the X FR (jw) being a Fourier transform of the sound played by the second speaker
  • the X BL (jw) being the sum of the sound played by the third speaker a Fourier transform
  • the X BR (jw) is a Fourier transform of the sound played by the fourth speaker
  • the G FL_L (jw) being a transfer function of the first speaker to the left ear position
  • the G FL_R (jw) a transfer function of the first speaker to the right ear position
  • the G FR — L (jw) being a transfer function of the second speaker to the left ear position
  • the G FR — R (jw) being the second speaker to the right
  • a more perfect audio signal can be provided, thereby improving the user experience.
  • the four speakers form a quadrilateral, wherein the first speaker is located on the opposite side of the fourth speaker, and the second speaker is located on the opposite side of the third speaker, and the position parameters of the four speakers include the sound of the first speaker Right The ear canal of the left ear position, the horizontal distance between the first speaker and the ear canal of the left ear position is a first preset value, and the vertical distance between the first speaker and the ear canal of the left ear position is a second preset value. ;
  • the sound outlet of the second speaker is opposite to the ear canal of the right ear position, and the horizontal distance between the second speaker and the ear canal of the right ear position is the first preset value, the second speaker and the right ear position
  • the vertical distance of the ear canal is the second preset value
  • the sound outlet of the third speaker is facing the ear canal of the left ear position, and the horizontal distance between the third speaker and the ear canal of the left ear position is the first preset value, the third speaker and the left ear position The vertical distance of the ear canal is the second preset value;
  • the sound outlet of the fourth speaker is opposite to the ear canal of the right ear position, and the horizontal distance between the fourth speaker and the ear canal of the right ear position is the first preset value, the fourth speaker and the right ear position The vertical distance of the ear canal is the second preset value.
  • the first preset value is greater than or equal to 1 cm and less than or equal to 5 cm; the second predetermined value is greater than or equal to 0.5 cm and less than or equal to 1 cm.
  • the positioning of the audio signal can be effectively improved.
  • an embodiment of the present application provides an audio processing device having a function of implementing an audio processing device in the foregoing method.
  • This function can be implemented in hardware or in hardware by executing the corresponding software.
  • the hardware or software includes one or more modules corresponding to the functions described above.
  • the audio processing device includes:
  • An acquiring module configured to acquire an original audio signal, a sound source position parameter corresponding to the original audio signal, and position parameters of four speakers;
  • a processing module configured to process the original audio signal according to the sound source position parameter to obtain a target two-channel audio signal; and process the target two-channel audio signal according to the position parameters of the four speakers and the sound source position parameter A four-channel audio signal, the four-channel audio signal being in one-to-one correspondence with the four speakers, wherein the four speakers are used to play a corresponding channel signal of the four-channel audio signal.
  • the audio processing device includes:
  • Transceiver processor and bus
  • the transceiver is coupled to the processor via the bus;
  • the transceiver performs the following steps:
  • the processor performs the following steps:
  • a sound source position parameter corresponding to the original audio signal and a position parameter of four speakers to process the original audio signal according to the sound source position parameter to obtain a target two-channel audio signal; according to the position parameters of the four speakers and the The source position parameter processes the target two-channel audio signal to obtain a four-channel audio signal, the four-channel audio signal is in one-to-one correspondence with the four speakers, and the four speakers are used to play the four-channel audio The corresponding channel signal in the signal.
  • an embodiment of the present application provides a virtual reality (VR) glasses, including: the four speakers and the audio processing device;
  • VR virtual reality
  • the four speakers are connected to the audio processing device
  • the four speakers are distributed on two frames on the VR glasses, wherein the position distribution of the four speakers is further Meet the following rules:
  • the four speakers form a quadrilateral, wherein the first speaker is located on the opposite side of the fourth speaker, the second speaker is located on the opposite side of the third speaker, and the first speaker of the four speakers is located on the plane where the four speakers are located
  • the sound outlet of the first speaker is facing the ear canal of the left ear position
  • the horizontal distance between the first speaker and the ear canal of the left ear position is a first preset value
  • the first speaker and the left speaker The vertical distance of the ear canal of the ear position is a second preset value
  • the second speaker of the four speakers is located at the right front of the plane where the four speakers are located, the sound outlet of the second speaker is the ear canal of the right ear position, and the ear of the second speaker and the right ear position
  • the horizontal distance of the track is the first preset value, and the vertical distance between the second speaker and the ear canal of the right ear position is the second preset value;
  • the third speaker of the four speakers is located at the left rear of the plane where the four speakers are located, the sound outlet of the third speaker is the ear canal of the left ear position, and the ear of the third speaker and the left ear position
  • the horizontal distance of the track is the first preset value, and the vertical distance between the third speaker and the ear canal of the left ear position is the second preset value;
  • the fourth speaker of the four speakers is located at the right rear of the plane where the four speakers are located, the sound outlet of the fourth speaker is the ear canal of the right ear position, and the ear of the fourth speaker and the right ear position
  • the horizontal distance of the track is the first preset value, and the vertical distance between the fourth speaker and the ear canal of the right ear position is the second preset value.
  • the first preset value is greater than or equal to 1 cm and less than or equal to 5 cm; the second predetermined value is greater than or equal to 0.5 cm and less than or equal to 1 cm.
  • the audio processing device is provided with all the functions of the audio processing device in the above embodiment.
  • the four speakers and the audio processing device may also be included in other possible devices, such as augmented reality (AR) glasses or other wearable devices. This is not limited here.
  • AR augmented reality
  • an embodiment of the present application provides a computer readable storage medium, including instructions, when the instruction is run on a computer, the computer executes the foregoing methods.
  • an embodiment of the present application provides a computer program product comprising instructions, when the computer program product runs on a computer, the computer executes the foregoing methods.
  • the audio processing device simulates the orientation information of the original audio signal
  • the position parameters of the four speakers are simultaneously considered, and the front and rear orientations of the original audio signal are simulated, thereby It is ensured that the audio processing device is more accurate in determining the orientation information of the sound source position of the original audio signal.
  • FIG. 1 is a schematic diagram of processing audio signals by left and right stereo headphones in 3D audio technology according to an embodiment of the present application
  • FIG. 2 is a schematic diagram of an embodiment of an audio processing method according to an embodiment of the present application.
  • FIG. 3 is a schematic diagram of an embodiment of a distribution manner of four speakers in an embodiment of the present application.
  • FIG. 4 is a flowchart of a method for processing a raw audio signal to obtain a target two-channel audio signal according to an embodiment of the present application
  • Figure 5 is a schematic front view of the embodiment of the present application.
  • FIG. 6 is a schematic diagram of a rigid ball model in an embodiment of the present application.
  • FIG. 7 is a schematic diagram showing the position and sound source position distribution of four speakers in the embodiment of the present application.
  • FIG. 8 is a schematic diagram of another embodiment of an audio processing method according to an embodiment of the present application.
  • FIG. 9 is a schematic diagram of an embodiment of a sound source position in an embodiment of the present application.
  • FIG. 10 is a schematic diagram of signals of an original audio signal in an embodiment of the present application.
  • FIG. 11 is a schematic diagram of high frequency components of an original audio signal in an embodiment of the present application.
  • FIG. 12 is a schematic diagram of low frequency components of an original audio signal in an embodiment of the present application.
  • FIG. 13 is a schematic diagram of a high frequency output signal carrying a height feature in an embodiment of the present application.
  • FIG. 14 is a schematic diagram of a high frequency output signal carrying a height feature and left and right information in an embodiment of the present application
  • 15 is a schematic diagram of low frequency components after processing in the embodiment of the present application.
  • 16 is a schematic diagram of a target two-channel audio signal obtained in an embodiment of the present application.
  • 17 is a schematic diagram of a four-channel audio signal in an embodiment of the present application.
  • FIG. 18 is a schematic diagram of a time domain response of a near field compensation filter in an embodiment of the present application.
  • FIG. 19 is a schematic diagram of a method for performing overlap and smoothing of a frame length of two adjacent frames in an embodiment of the present application.
  • 20 is a schematic diagram of an embodiment of an audio processing device according to an embodiment of the present application.
  • FIG. 21 is a schematic diagram of another embodiment of an audio processing device according to an embodiment of the present application.
  • FIG. 22 is a schematic diagram of an embodiment of VR glasses according to an embodiment of the present application.
  • the embodiment of the present application provides an audio processing method and an audio processing device, which are used to improve the azimuth positioning accuracy of a virtual sound source in a 3D space.
  • the HRTF data is multiplied by the FFT transform result of the input time domain audio signal to obtain the final audio signal.
  • the final audio signal is calculated according to the HRTF data corresponding to the orientation information of the sound source, and in actual application, when the HRTF data is selected for each individual for calculation, The direction of the sound is distorted, so only relying on the orientation information of the sound source is inaccurate for the orientation of the sound source in the 3D space.
  • the audio playing environment includes an audio processing device and four speakers; setting a plane in which the four speakers are located as a target plane, the four speakers forming a quadrangle, The first speaker is located on the opposite side of the fourth speaker, and the second speaker is located on the opposite side of the third speaker, that is, the positional parameters of the four speakers may be as follows: the first speaker and the second speaker are located at the In front of the target plane, the third speaker and the fourth speaker are located behind the target plane, the first speaker and the third speaker are located to the left of the target plane, and the second speaker and the fourth speaker are located at the target flat Right; the audio processing device determines the positional parameters of the four speakers.
  • the source location parameter of the original audio signal is then simultaneously determined while the audio processing device is receiving the original audio signal.
  • the audio processing device processes the original audio signal according to the sound source position of the original audio signal to obtain a target two-channel audio signal; and then the audio processing device processes the target according to the position parameters of the four speakers and the sound source position parameter.
  • the two-channel audio signal obtains a four-channel audio signal that is in one-to-one correspondence with the four speakers; finally, the audio processing device transmits the four-channel audio signal to the four speakers for playback.
  • the target two-channel audio signal includes a left channel audio signal, a left front audio signal, a right front audio signal, a left rear audio signal, and a right rear. audio signal.
  • the delay of the target two-channel audio signal is used to indicate the left and right direction of the sound source indicated by the sound source position parameter, and the frequency domain characteristic of the target two-channel audio signal is used to indicate the up and down direction of the sound source; the four-channel audio signal
  • the amplitude of the four-channel audio signal is used to indicate the left and right direction of the sound source, and the frequency domain characteristic of the four-channel audio signal is used to indicate the up and down direction of the sound source.
  • the delay of the target two-channel audio signal is the delay of the left channel audio signal and the right channel audio signal; the delay of the four-channel audio signal refers to the delay of the left front audio signal and the right front audio signal And a delay of the left rear audio signal and the right rear audio signal, the amplitude of the target two-channel audio signal and the four-channel audio signal being the waveform amplitude of each signal, the target two-channel audio signal and the four channels
  • the frequency domain characteristics of the audio signal are the frequency characteristics and amplitude characteristics of the respective signals.
  • the audio processing device and the four speakers may be integrated into one device, and the audio processing device and the four speakers may be integrated on the VR glasses or the AR glasses.
  • the specific situation is not limited here.
  • the definitions of the target plane, the horizontal plane, the front plane, the left ear position, the right ear position, the sphere, and the center of the sphere are as follows:
  • the plane in which the four speakers are located is the target plane, wherein the four speakers form a quadrilateral, wherein the first speaker is located on the opposite side of the fourth speaker, and the second speaker is located on the opposite side of the third speaker; That is, the positional parameters of the four speakers may be as follows: the first speaker and the second speaker are located in front of the target plane, the third speaker and the fourth speaker are located behind the target plane, and the first speaker is located at the third speaker To the left of the target plane, the second speaker and the fourth speaker are located to the right of the target plane (ie, the first speaker is located to the left front of the target plane, and the second speaker is located to the right front of the target plane, The third speaker is located at the left rear of the target plane, and the fourth speaker is located at the right rear of the target plane);
  • the left ear position is a position between the first speaker and the third speaker
  • the right ear position is a position between the second speaker and the fourth speaker
  • the front plane passes through a center position of the four speakers and is perpendicular to a plane of the target plane, wherein a center position of the four speakers is a line connecting the second speaker and the third speaker with the first speaker and the first The intersection of the wiring of the four speakers;
  • the horizontal plane is a plane passing through the line connecting the left ear position and the right ear position and parallel to the target plane;
  • the sphere is determined according to positional parameters of the four speakers
  • the center of the sphere is the center of the sphere.
  • an embodiment of the audio signal processing method in the embodiment of the present application includes:
  • the audio processing device acquires an original audio signal, a sound source position parameter of the original audio signal, and positional parameters of the four speakers.
  • the audio processing device receives the original audio signal; then obtains the sound source position parameter of the original audio signal according to the sound source position set by the head tracking or the virtual scene; and simultaneously acquires the position parameters of the four speakers in the audio processing scene.
  • the plane where the four speakers are located is a target plane, wherein the first speaker and the second speaker are located in front of the target plane, and the third speaker and the fourth speaker are located behind the target plane. The first speaker and the third speaker are located to the left of the target plane, and the second speaker and the fourth speaker are located to the right of the target plane. As shown in FIG.
  • the first speaker of the four speakers is located at the left front of the target plane
  • the second speaker is located at the right front of the target plane
  • the third speaker is located at the left rear of the target plane
  • the third speaker is located to the right of the target plane.
  • the positions of the four speakers may be distributed: the first speaker is distributed in front of the left ear of the human body; the second speaker is distributed behind the left ear; the third speaker is distributed in front of the right ear of the human body; The fourth speaker is distributed behind the right ear of the human body; in this scene, the human body face is oriented forward.
  • the position parameters of the four speakers include: the ear channel of the first speaker is the ear canal of the left ear position, and the horizontal distance between the first speaker and the ear canal of the left ear position is a preset value, the vertical distance between the first speaker and the ear canal of the left ear position is a second preset value;
  • the sound outlet of the second speaker is opposite to the ear canal of the right ear position, and the horizontal distance between the second speaker and the ear canal of the right ear position is the first preset value, the second speaker and the right ear position
  • the vertical distance of the ear canal is the second preset value
  • the sound outlet of the third speaker is facing the ear canal of the left ear position, and the horizontal distance between the third speaker and the ear canal of the left ear position is the first preset value, the third speaker and the left ear position The vertical distance of the ear canal is the second preset value;
  • the sound outlet of the fourth speaker is opposite to the ear canal of the right ear position, and the horizontal distance between the fourth speaker and the ear canal of the right ear position is the first preset value, the fourth speaker and the right ear position The vertical distance of the ear canal is the second preset value.
  • the first preset value is greater than or equal to 1 cm and less than or equal to 5 cm; the second predetermined value is greater than or equal to 0.5 cm and less than or equal to 1 cm.
  • the position parameters of the four speakers may be specifically as follows: the first speaker is located in front of the left ear, and the sound outlet of the first speaker is facing the ear canal of the user's left ear, and the first speaker is The horizontal distance of the ear canal of the left ear of the user is 2 cm, the vertical distance between the first speaker and the ear canal of the left ear of the user is 0.6 cm; the third speaker is located behind the left ear of the user, and the first The sound outlet of the three speakers is facing the ear canal of the user's left ear, and the horizontal distance between the third speaker and the ear canal of the user's left ear is 2 cm, the third speaker and the ear of the user's left ear
  • the vertical distance of the track is 0.6 cm; the second speaker is located in front of the right ear of the user, and the sound outlet of the second speaker is facing the ear canal of the right ear of the user, while the second speaker is right with the user
  • the horizontal distance of the ear canal of the ear is
  • the audio processing device processes the original audio signal according to the sound source position parameter to obtain a target two-channel audio signal.
  • the audio processing device After acquiring the sound source position parameter and the position parameters of the four speakers, the audio processing device processes the original audio signal by using an azimuth rendering algorithm according to the sound source position parameter to obtain a target two-channel audio signal, the target two-channel
  • the delay of the audio signal is used to indicate the left and right orientation of the sound source indicated by the sound source position parameter
  • the frequency domain characteristic of the target two-channel audio signal is used to indicate the up and down orientation of the sound source.
  • the audio processing device may specifically adopt the following solution, and the specific process is as shown in FIG. 4:
  • the audio processing device obtains a low frequency signal corresponding to the original audio signal and a high frequency signal corresponding to the original audio signal according to the original audio signal; and the audio processing device can also follow the sound source position parameter of the original audio signal. Determining, in the saved HRTF database, a target HRTF that matches the sound source location parameter; then the audio processing device convolves the low frequency signal with the target HRTF to obtain a first two-channel audio signal; and the audio processing device acquires the sound source a height characteristic response corresponding to the height parameter in the position parameter; then the audio processing device convolves the high frequency signal with the height feature response to obtain a target audio signal; and the audio processing device passes the sound source position indicated by the sound source position parameter
  • the rigid ball model calculates a frequency domain response of the sound source position to the left ear position and a frequency domain response of the sound source position to the right ear position; the audio processing device then uses the inverse fast Fourier transform (inverse fast Fourier) Transfer, IFFT) get the time domain response; the audio processing Preparing
  • the left ear position is a position between the first speaker and the third speaker
  • the right ear position is a position between the second speaker and the fourth speaker
  • the sound source position is according to The sound source position parameter determines that the four speakers form a quadrilateral, wherein the first speaker is located on the opposite side of the fourth speaker, and the second speaker is located on the opposite side of the third speaker.
  • the audio processing device can also obtain a low frequency signal of the original audio signal by low pass filtering, and obtain a high frequency signal of the original audio signal by high pass filtering.
  • the audio processing device obtains a low frequency signal and a high frequency signal corresponding to the original audio signal.
  • the specific manner is not limited herein. According to the above solution, in the embodiment of the present application, when the audio processing device acquires the height feature response corresponding to the height parameter in the sound source location parameter, the following scheme may be adopted:
  • the audio processing device calculates the height feature response according to the first formula, where the first midpoint is a midpoint between the first speaker and the second speaker, the second midpoint being a midpoint between the third speaker and the fourth speaker;
  • the audio processing device calculates the height feature response according to the second formula
  • the second formula is:
  • the ⁇ is height information of the sound source position relative to the horizontal plane
  • the H F_elve is a height corresponding to the sound source position when the distance of the sound source position from the first midpoint is smaller than the distance of the sound source position from the second midpoint a characteristic response
  • the H B_elve is a height characteristic response corresponding to the sound source position when the distance of the sound source position from the first midpoint is greater than the distance of the sound source position from the second midpoint
  • the HRTF ( ⁇ , 0) is an elevation angle of ⁇
  • the HRTF data corresponding to the azimuth angle is 0 degrees
  • the HRTF (0, 0) is the front HRTF data with an elevation angle of 0 degrees and an azimuth angle of 0 degrees.
  • the HRTF ( ⁇ , 180) is an elevation angle of ⁇ , and the azimuth angle is
  • the HRTF data corresponding to 180 degrees, the HRTF (0, 180) is a direct rear HRTF data with an elevation angle of 0 degrees and an azimuth angle of 180 degrees.
  • the height parameter includes height information for indicating the position of the sound source relative to a horizontal plane
  • the horizontal plane is a line connecting the left ear position and the right ear position and parallel to the target plane.
  • the target plane is a plane in which the four speakers are located
  • the time domain responds to a frequency domain response from the sound source position to the left ear position and a frequency domain response of the sound source position to the right ear position is transformed
  • the frequency domain response is obtained by the audio processing device by using the rigid ball model according to the sound source position, wherein the rigid ball model comprises:
  • the ⁇ is a normalized distance from the center of the spherical ball to the position of the sound source
  • r is the distance from the center of the ball to the position of the sound source.
  • a is the radius of the sphere corresponding to the rigid ball model
  • the ⁇ is a normalized angular frequency
  • the f is a preset frequency
  • c is a sound propagation speed
  • the ⁇ L is the spherical center position and the sound source position
  • An angle of a line connecting the heart position to the position of the right ear, the sphere being determined according to a positional parameter of the four speakers
  • the horizontal plane being a plane passing through the line connecting the left ear position and the right ear position and parallel to the target plane
  • the target plane is the plane in which the four speakers are located.
  • the preset frequency is the frequency of the sound that can be heard by the human ear.
  • the audio processing device processes the target two-channel audio signal according to the position parameters of the four speakers and the sound source position parameter to obtain a four-channel audio signal.
  • the audio processing device determines a weight value of each of the four speakers according to the sound source position parameter and a position parameter of the four speakers; and then the audio processing device is first according to the first speaker and the second speaker of the four speakers Calculating a left front audio signal with a weight value and a left channel audio signal of the target two-channel audio signal, according to a first weight value of the first speaker and the second speaker of the four speakers and the target two-channel audio signal.
  • the right channel audio signal is calculated to obtain a right front audio signal
  • the left rear audio signal is calculated according to the second weight value of the third speaker and the fourth speaker of the four speakers and the left channel audio signal of the target two channel audio signal.
  • the audio processing device determines the weight value of each of the four speakers according to the position parameters of the four speakers and the sound source position parameter, and the following scheme may be adopted:
  • the target plane is a plane in which the four speakers are located;
  • the first angle is an angle between a line connecting the position of the sound source and a position of the center position on the target plane and the front plane (as shown in FIG. middle
  • the second angle is an angle between the line connecting the first speaker and the fourth speaker and the front plane or the second angle is a line connecting the second speaker and the third speaker with the front plane Angle of the picture );
  • the target plane is divided into four quadrants by a line connecting the first speaker and the fourth speaker and a line connecting the second speaker and the third speaker, and a quadrant between the first speaker and the second speaker is In the first quadrant, a quadrant between the third speaker and the fourth speaker is the second quadrant, a quadrant between the first speaker and the third speaker, and between the second speaker and the fourth speaker The quadrant is the third quadrant.
  • the audio processing device determines that the first weight value is 1, and the second weight value is 0, and the target plane is the target plane The plane in which the four speakers are located;
  • the audio processing device determines that the first weight value is 0, and the second weight value is 1;
  • the audio processing device determines the first weight value and the second according to the first angle and the second angle a weight value
  • the first angle is an angle between a line connecting the position of the sound source and a position of the center position on the target plane and a front plane
  • the second angle is a line connecting the first speaker and the fourth speaker
  • the angle with the front plane or the second angle is the angle between the line connecting the second speaker and the third speaker and the front plane
  • the center position is the connection between the second speaker and the third speaker An intersection with a line connecting the first speaker and the fourth speaker, the front plane being a plane passing through the center position and perpendicular to the target plane;
  • the audio processing device calculates the first weight according to the first angle and the second angle according to the third formula. Value and the second weight value;
  • the third formula includes:
  • the g 1 is the first weight value
  • the g 2 is the second weight value
  • the audio processing device calculates a left front audio signal according to a first weight value of the first speaker and the second speaker of the four speakers and a left channel audio signal of the target two-channel audio signal, according to the fourth Calculating a right front audio signal from a first weight value of the first speaker and the second speaker and a right channel audio signal of the target two-channel audio signal, according to the third speaker and the fourth speaker of the four speakers
  • the second weight value and the left channel audio signal of the target two-channel audio signal are calculated to obtain a left rear audio signal, according to the second weight value of the third speaker and the fourth speaker of the four speakers and the target two-channel audio
  • the fourth formula can be used for calculation;
  • the fourth formula includes:
  • the FL' is the left front audio signal
  • the FR' is a right front audio signal
  • the BL' is the left rear audio signal
  • the BR' is the right rear audio signal
  • the L is the target two-channel audio a left channel audio signal in the signal
  • the R being a right channel audio signal in the target two channel audio signal
  • the g 1 being the first weight value
  • the g 2 being the second weight value.
  • the audio processing device sends the four-channel audio signal to the four speakers for playing.
  • the audio processing device transmits the left front audio signal to the first speaker, transmits the right front audio signal to the first speaker, transmits the left rear audio signal to the third speaker, and sends the right rear audio signal
  • the fourth speaker is then played, and then each speaker plays the respective received audio signal.
  • the audio processing device simulates the orientation information of the original audio signal
  • the position parameters of the four speakers are simultaneously considered, and the front and rear orientations of the sound source position of the original audio signal are simulated, thereby ensuring the The audio processing device is more accurate in determining the orientation information of the source position of the original audio signal.
  • FIG. 8 another embodiment of the audio processing method in this embodiment of the present application includes:
  • the audio processing device acquires an original audio signal, a sound source position parameter of the original audio signal, and position parameters of four speakers.
  • the audio processing device receives the original audio signal; then obtains the sound source position parameter of the original audio signal according to the sound source position set by the head tracking or the virtual scene; and simultaneously acquires the position parameters of the four speakers in the audio processing scene.
  • the plane where the four speakers are located is a target plane, wherein the first speaker and the second speaker are located in front of the target plane, and the third speaker and the fourth speaker are located behind the target plane. The first speaker and the third speaker are located to the left of the target plane, and the second speaker and the fourth speaker are located to the right of the target plane. As shown in FIG.
  • the first speaker of the four speakers is located at the left front of the target plane
  • the second speaker is located at the right front of the target plane
  • the third speaker is located at the left rear of the target plane
  • the third speaker is located to the right of the target plane.
  • the positions of the four speakers may be distributed: the first speaker is distributed in front of the left ear of the human body; the second speaker is distributed behind the left ear; the third speaker is distributed in front of the right ear of the human body; The fourth speaker is distributed behind the right ear of the human body; in this scene, the human body face is oriented forward.
  • the position parameters of the four speakers include: the ear channel of the first speaker is the ear canal of the left ear position, and the horizontal distance between the first speaker and the ear canal of the left ear position is a preset value, the vertical distance between the first speaker and the ear canal of the left ear position is a second preset value;
  • the sound outlet of the second speaker is opposite to the ear canal of the right ear position, and the horizontal distance between the second speaker and the ear canal of the right ear position is the first preset value, the second speaker and the right ear position
  • the vertical distance of the ear canal is the second preset value
  • the sound outlet of the third speaker is facing the ear canal of the left ear position, and the horizontal distance between the third speaker and the ear canal of the left ear position is the first preset value, the third speaker and the left ear position The vertical distance of the ear canal is the second preset value;
  • the sound outlet of the fourth speaker is opposite to the ear canal of the right ear position, and the horizontal distance between the fourth speaker and the ear canal of the right ear position is the first preset value, the fourth speaker and the right ear position The vertical distance of the ear canal is the second preset value.
  • the first preset value is greater than or equal to 1 cm and less than or equal to 5 cm; the second predetermined value is greater than or equal to 0.5 cm and less than or equal to 1 cm.
  • the position parameters of the four speakers may be specifically as follows: the first speaker is located in front of the left ear, and the sound outlet of the first speaker is facing the ear canal of the user's left ear, and the first speaker is The horizontal distance of the ear canal of the left ear of the user is 2 cm, the vertical distance between the first speaker and the ear canal of the left ear of the user is 0.6 cm; the third speaker is located behind the left ear of the user, and the first The sound outlet of the three speakers is facing the ear canal of the user's left ear, and the horizontal distance between the third speaker and the ear canal of the user's left ear is 2 cm, the third speaker and the ear of the user's left ear
  • the vertical distance of the track is 0.6 cm; the second speaker is located in front of the right ear of the user, and the sound outlet of the second speaker is facing the ear canal of the right ear of the user, while the second speaker is right with the user
  • the horizontal distance of the ear canal of the ear is
  • the audio processing device processes the original audio signal according to the sound source position parameter to obtain a target two-channel audio signal.
  • the audio processing device After acquiring the sound source position parameter and the position parameters of the four speakers, the audio processing device processes the original audio signal by using an azimuth rendering algorithm according to the sound source position parameter to obtain a target two-channel audio signal, the target two-channel
  • the delay of the audio signal is used to indicate the left and right orientation of the sound source indicated by the sound source position parameter
  • the frequency domain characteristic of the target two-channel audio signal is used to indicate the up and down orientation of the sound source.
  • the audio processing device may specifically adopt the following solution, and the specific process is as shown in FIG. 4:
  • the audio processing device obtains a low frequency signal corresponding to the original audio signal and a high frequency signal corresponding to the original audio signal according to the original audio signal; and the audio processing device can also follow the sound source position parameter of the original audio signal. Determining, in the saved HRTF database, a target HRTF that matches the sound source location parameter; then the audio processing device convolves the low frequency signal with the target HRTF to obtain a first two-channel audio signal; and the audio processing device acquires the sound source a height characteristic response corresponding to the height parameter in the position parameter; then the audio processing device convolves the high frequency signal with the height feature response to obtain a target audio signal; and the audio processing device passes the sound source position indicated by the sound source position parameter
  • the rigid ball model calculates a frequency domain response of the sound source position to the left ear position and a frequency domain response of the sound source position to the right ear position; the audio processing device then uses the inverse fast Fourier transform (inverse fast Fourier) Transfer, IFFT) get the time domain response; the audio processing Preparing
  • the left ear position is a position between the first speaker and the third speaker
  • the right ear position is a position between the second speaker and the fourth speaker
  • the sound source position is according to The sound source position parameter determines that the four speakers form a quadrilateral, wherein the first speaker is located on the opposite side of the fourth speaker, The second speaker is located on the opposite side of the third speaker.
  • the audio processing device can also obtain a low frequency signal of the original audio signal by low pass filtering, and obtain a high frequency signal of the original audio signal by high pass filtering.
  • the audio processing device obtains a low frequency signal and a high frequency signal corresponding to the original audio signal.
  • the specific manner is not limited herein. According to the above solution, in the embodiment of the present application, when the audio processing device acquires the height feature response corresponding to the height parameter in the sound source location parameter, the following scheme may be adopted:
  • the audio processing device calculates the height feature response according to the first formula, where the first midpoint is a midpoint between the first speaker and the second speaker, the second midpoint being a midpoint between the third speaker and the fourth speaker
  • the audio processing device calculates the height feature response according to the second formula.
  • the second formula is:
  • the ⁇ is height information of the sound source position relative to the horizontal plane
  • the H F_elve is a height corresponding to the sound source position when the distance of the sound source position from the first midpoint is smaller than the distance of the sound source position from the second midpoint a characteristic response
  • the H B_elve is a height characteristic response corresponding to the sound source position when the distance of the sound source position from the first midpoint is greater than the distance of the sound source position from the second midpoint
  • the HRTF ( ⁇ , 0) is an elevation angle of ⁇
  • the HRTF (0,0) is an HRTF data corresponding to an azimuth angle of 0 degrees
  • the HRTF ( ⁇ , 180) is an elevation angle ⁇
  • the azimuth is an elevation angle of 0 degrees.
  • the HRTF (0, 180) is a direct rear HRTF data with an elevation angle of 0 degrees and an azimuth angle of 180 degrees.
  • the height parameter includes height information for indicating the position of the sound source relative to a horizontal plane
  • the horizontal plane is a line connecting the left ear position and the right ear position and parallel to the target plane.
  • the target plane is a plane in which the four speakers are located
  • the time domain responds to a frequency domain response from the sound source position to the left ear position and a frequency domain response of the sound source position to the right ear position is transformed
  • the frequency domain response is obtained by the audio processing device by using the rigid ball model according to the sound source position, wherein the rigid ball model comprises:
  • the ⁇ is a normalized distance from the center of the spherical ball to the position of the sound source
  • r is the distance from the center of the ball to the position of the sound source.
  • a is the radius of the sphere corresponding to the rigid ball model
  • the ⁇ is a normalized angular frequency
  • the f is a preset frequency
  • c is a sound propagation speed
  • the ⁇ L is the spherical center position and the sound source position
  • An angle of a line connecting the heart position to the position of the right ear, the sphere being determined according to a positional parameter of the four speakers
  • the horizontal plane being a plane passing through the line connecting the left ear position and the right ear position and parallel to the target plane
  • the target plane is the plane in which the four speakers are located.
  • the preset frequency is the frequency of the sound that can be heard by the human ear.
  • the audio processing device processes the target two-channel audio signal according to the position parameters of the four speakers and the sound source position parameter to obtain an intermediate four-channel audio signal.
  • the audio processing device determines a weight value of each of the four speakers according to the sound source position parameter and a position parameter of the four speakers; and then the audio processing device is first according to the first speaker and the second speaker of the four speakers Calculating a left front audio signal with a weight value and a left channel audio signal of the target two-channel audio signal, according to a first weight value of the first speaker and the second speaker of the four speakers and the target two-channel audio signal.
  • the right channel audio signal is calculated to obtain a right front audio signal
  • the left rear audio signal is calculated according to the second weight value of the third speaker and the fourth speaker of the four speakers and the left channel audio signal of the target two channel audio signal.
  • the audio processing device determines the weight value of each of the four speakers according to the position parameters of the four speakers and the sound source position parameter, and the following scheme may be adopted:
  • the target plane is a plane in which the four speakers are located;
  • the first angle is an angle between a line connecting the position of the sound source and a position of the center position on the target plane and the front plane (as shown in FIG. middle
  • the second angle is an angle between the line connecting the first speaker and the fourth speaker and the front plane or the second angle is a line connecting the second speaker and the third speaker with the front plane Angle of the picture );
  • the target plane is divided into four quadrants by a line connecting the first speaker and the fourth speaker and a line connecting the second speaker and the third speaker, and a quadrant between the first speaker and the second speaker is In the first quadrant, a quadrant between the third speaker and the fourth speaker is the second quadrant, a quadrant between the first speaker and the third speaker, and between the second speaker and the fourth speaker The quadrant is the third quadrant.
  • the audio processing device determines that the first weight value is 1, and the second weight value is 0, and the target plane is the target plane The plane in which the four speakers are located;
  • the audio processing device determines that the first weight value is 0, and the second weight value is 1;
  • the audio processing device determines the first weight value and the second according to the first angle and the second angle a weight value
  • the first angle is an angle between a line connecting the position of the sound source and a position of the center position on the target plane and a front plane
  • the second angle is a line connecting the first speaker and the fourth speaker
  • the angle with the front plane or the second angle is the angle between the line connecting the second speaker and the third speaker and the front plane
  • the center position is the connection between the second speaker and the third speaker An intersection with a line connecting the first speaker and the fourth speaker, the front plane being a plane passing through the center position and perpendicular to the target plane;
  • the audio processing device calculates the first weight according to the first angle and the second angle according to the third formula. Value and the second weight value;
  • the third formula includes:
  • the g 1 is the first weight value
  • the g 2 is the second weight value
  • the audio processing device calculates a left front audio signal according to a first weight value of the first speaker and the second speaker of the four speakers and a left channel audio signal of the target two-channel audio signal, according to the fourth Calculating a right front audio signal from a first weight value of the first speaker and the second speaker and a right channel audio signal of the target two-channel audio signal, according to the third speaker and the fourth speaker of the four speakers
  • the second weight value and the left channel audio signal of the target two-channel audio signal are calculated to obtain a left rear audio signal, according to the second weight value of the third speaker and the fourth speaker of the four speakers and the target two-channel audio
  • the fourth formula can be used for calculation;
  • the fourth formula includes:
  • the FL' is the left front audio signal
  • the FR' is a right front audio signal
  • the BL' is the left rear audio signal
  • the BR' is the right rear audio signal
  • the L is the target two-channel audio a left channel audio signal in the signal
  • the R being a right channel audio signal in the target two channel audio signal
  • the g 1 being the first weight value
  • the g 2 being the second weight value.
  • the audio processing device performs near field compensation on the intermediate four-channel audio signal to obtain the four-channel audio signal.
  • the audio processing device acquires a near field compensation response of the four speaker to left ear positions and the four speaker to right ear positions according to positional parameters of the four speakers, the left ear position being the first speaker and the third speaker a position between the second speaker and a fourth speaker; the audio processing device utilizing a fifth time based on the intermediate four-channel audio signal and the time-domain response of the near-acoustic compensation response
  • the formula gets the four-channel audio signal.
  • the fifth formula is:
  • BR BR'*h BR ;
  • the FL is a left front audio signal
  • the FR is a right front audio signal
  • the BL is a left rear audio signal
  • the BR is a right rear audio signal
  • the h FL is the near field compensation of the first speaker to the left ear position.
  • a time domain response of the response the h FR is a time domain response of the near field compensation response of the second speaker to the right ear position
  • the h BL is a time domain response of the near field compensation response of the third speaker to the left ear position h BR for the fourth speaker should be to the right ear position in response to the time domain response of the near-field compensating time-domain response of the near-field compensation in response to the transformed response to the compensation obtained by the frequency domain response of the near-field.
  • the near sound compensation response is expressed as:
  • the E L (jw) is a Fourier transform of the sound signal heard at the position of the left ear
  • the E R (jw) is a Fourier transform of the sound signal heard at the position of the right ear
  • the X FL (jw) a Fourier transform of the sound played for the first speaker
  • the X FR (jw) being a Fourier transform of the sound played by the second speaker
  • the X BL (jw) being the sum of the sound played by the third speaker a Fourier transform
  • the X BR (jw) is a Fourier transform of the sound played by the fourth speaker
  • the G FL_L (jw) being a transfer function of the first speaker to the left ear position
  • the G FL_R (jw) a transfer function of the first speaker to the right ear position
  • the G FR — L (jw) being a transfer function of the second speaker to the left ear position
  • the G FR — R (jw) being the second speaker to the right
  • the audio processing device sends the four-channel audio signal to the four speakers for playing.
  • the audio processing device transmits the left front audio signal to the first speaker, and sends the right front audio signal To the first speaker, the left rear audio signal is sent to the third speaker, the right rear audio signal is sent to the fourth speaker, and then each speaker plays the respective received audio signal.
  • the audio processing device simulates the orientation information of the sound source position of the original audio signal
  • the position parameters of the four speakers are simultaneously considered, and the front and rear orientations of the sound source position of the original audio signal are simulated.
  • the audio processing device performs near-field compensation on the four-channel audio signal to ensure the sound quality of the four-channel audio signal is more perfect, thereby improving the user experience.
  • four speakers headphone playback (high fidelity) surround sound Ambisonic audio is used to decode Ambisonic B-format four-channel data to eight virtual speakers, ie eight virtual sound sources.
  • the position of the eight virtual sound sources is shown in Figure 9.
  • the eight virtual sound sources are placed at the eight vertices of the positive cube, and the side length is unit length.
  • the position of each virtual sound source can be found by the geometric relationship of the positive cube. Take one of the virtual sound sources (coordinates ⁇ 1, 1, 1 ⁇ ) as an example.
  • the other seven virtual sources are processed in the same way as the virtual source of the coordinates ⁇ 1, 1, 1 ⁇ .
  • the azimuth and elevation of the virtual sound source of the coordinate ⁇ 1,1,1 ⁇ can be calculated:
  • the original audio signal is an audio signal as shown in FIG. 10
  • the original audio signal is passed through the high-pass filter module and the low-pass filter module to obtain a high-frequency component of the original audio signal as shown in FIG.
  • the low frequency component of the original audio signal is shown.
  • the audio processing device extracts the height feature of the corresponding HRTF according to the orientation information of the sound source, processes the high frequency component of the original audio signal, and obtains an output signal as shown in FIG. 13; and outputs the output signal shown in FIG. 13 through the rigid ball model. Processing, a high frequency component signal (i.e., a second two-channel audio signal) as shown in Fig. 14 is obtained.
  • the low frequency portion is processed by the corresponding angle of the well-known HRTF library to obtain a low frequency component signal (ie, the first two channel audio signal) as shown in FIG. 15; then the high frequency component signal as shown in FIG.
  • the low-frequency component signals shown in FIG. 15 are superimposed to obtain an output signal (ie, a target two-channel audio signal) as shown in FIG. 16 after being processed by the azimuth rendering module.
  • the four-channel audio signal as shown in Fig. 17 is calculated (i.e., in the case of the azimuth, only the front speaker is used for sounding, and the rear speaker output is 0). Then when the audio processing device performs near field compensation on the four-channel audio signal, the tone The frequency processing device obtains the time domain response of the near field compensation filter as shown in FIG. 18, and then frequency-domain convolves the time domain response of the near field compensation filter with the corresponding speaker output signal to obtain that the four speakers should be played.
  • Target four-channel audio signal if the audio processing device is integrated on the VR glasses, in the application scenario of the VR lens head tracking, the virtual speaker corresponding to each frame of audio input is input based on the current player's head rotation angle information transmitted by the sensor. The orientation information to the listener is simulated. Then, the overlapping of the frame lengths of the adjacent two frames is performed, as shown in FIG. 19, to reduce the discontinuity between frames caused by the rotation of the human head.
  • the audio processing method in the embodiment of the present application has been described above.
  • the audio processing device and the VR glasses in the embodiment of the present application are described below.
  • an embodiment of an audio processing device in this embodiment of the present application includes:
  • the acquiring module 2001 is configured to acquire an original audio signal, a sound source position parameter corresponding to the original audio signal, and position parameters of four speakers;
  • the processing module 2002 is configured to process the original audio signal according to the sound source position parameter to obtain a target two-channel audio signal; and process the target two-channel audio signal according to the position parameters of the four speakers and the sound source position parameter.
  • a four-channel audio signal is obtained, the four-channel audio signal being in one-to-one correspondence with the four speakers, the four speakers being used to play a corresponding channel signal of the four-channel audio signal.
  • the processing module 2002 is configured to obtain, according to the original audio signal, a low frequency signal corresponding to the original audio signal and a high frequency signal corresponding to the original audio signal;
  • the low-frequency signal is convoluted with the target-head related transfer function HRTF to obtain a first two-channel audio signal, and the target HRTF is a head-related transfer function HRTF corresponding to the sound source position parameter;
  • the audio processing device is obtained by using a rigid ball model according to the sound source position, the left ear position is a position between the first speaker and the third speaker, and the right ear position is between the second speaker and the fourth speaker.
  • a position of the sound source determined according to the sound source position parameter, wherein the four speakers form a quadrilateral, wherein a line connecting the first speaker and the fourth speaker is a diagonal of the quadrilateral, a line connecting the second speaker and the third speaker is a diagonal of the quadrilateral;
  • the height parameter includes height information indicating a position of the sound source relative to a horizontal plane, wherein the horizontal plane is a plane passing through a line connecting the left ear position and the right ear position and parallel to the target plane.
  • the target plane is a plane in which the four speakers are located, and the processing module 2002 is specifically configured to: if the sound source position parameter indicates that the sound source position is located in the four speakers, the first speaker and the second speaker One side of the speaker, the height characteristic response is calculated according to the first formula;
  • the height characteristic response is calculated according to the second formula
  • the second formula is:
  • ⁇ is height information of the sound source position relative to the horizontal plane
  • the H F_elve is when the sound source position is located at one side of the first speaker and the second speaker of the four speakers a height characteristic response corresponding to the sound source position
  • the H B_elve is a height characteristic response corresponding to the sound source position when the sound source position is located at one side of the fourth speaker and the fourth speaker of the four speakers
  • the HRTF ( ⁇ , 0) is HRTF data corresponding to an elevation angle of ⁇ and an azimuth angle of 0 degrees
  • the HRTF (0, 0) is an HRTF data with an elevation angle of 0 degrees and an azimuth angle of 0 degrees.
  • the HRTF ( ⁇ , 180) is HRTF data corresponding to an elevation angle of ⁇ and an azimuth angle of 180 degrees
  • the HRTF (0, 180) is a direct rear HRTF data with an elevation angle of 0 degrees and an azimuth angle of 180 degrees.
  • the time domain response is obtained by transforming a frequency domain response of the sound source position to the left ear position and a frequency domain response of the sound source position to the right ear position, where the frequency domain response is
  • the audio processing device is obtained by using the rigid ball model according to the sound source position, wherein the rigid ball model includes:
  • ⁇ is a normalized distance from a spherical center position of the rigid ball model to the sound source position, where r is the center of the sphere a distance from the position of the sound source, the a is the radius of the sphere corresponding to the rigid ball model, the ⁇ is a normalized angular frequency, the f is a preset frequency, and the c is a sound propagation speed
  • ⁇ L is an angle between a line connecting the position of the center of the sphere and a position of the sound source position on the horizontal plane, and a line connecting the position of the center of the ball and the position of the left ear
  • ⁇ R is An angle between a line center position and a line connecting the position of the sound source at a position of the horizontal plane and a line connecting the center of the ball to the position of the right ear, the sphere being
  • the four-channel audio signal includes a left front audio signal, a right front audio signal, a left rear audio signal, and a right rear audio signal
  • the processing module 2002 is specifically configured to:
  • the left rear audio signal is calculated according to the second weight value and the right channel audio signal in the target two-channel audio signal.
  • processing module 2002 is specifically configured to:
  • the first weight value is determined to be 1, the second weight value is 0, and the target plane is a plane where the four speakers are located;
  • the sound source location parameter indicates that the sound source location of the original audio signal is located in the second quadrant in the target plane, determining that the first weight value is 0, and the second weight value is 1;
  • the first angle is an angle between a line connecting the position of the sound source and a position of the center position at the target plane and a front plane
  • the second angle is the first speaker and the The angle between the line connecting the fourth speaker and the front plane or the second angle is the angle between the line connecting the second speaker and the third speaker and the front plane, the center position a intersection of a line connecting the second speaker and the third speaker with a line connecting the first speaker and the fourth speaker, the front plane passing through the center position and perpendicular to the target plane Plane
  • the target plane is divided into four quadrants by a line connecting the first speaker and the fourth speaker and a line connecting the second speaker and the third speaker, the first speaker and the first speaker a quadrant between the two speakers is the first quadrant, a quadrant between the third speaker and the fourth speaker is the second quadrant, and a quadrant between the first speaker and the third speaker And a quadrant between the second speaker and the fourth speaker is the third quadrant.
  • the processing module 2002 is configured to calculate, according to the first angle and the second angle, the first weight value and the second weight value by using a third formula
  • the third formula includes:
  • the g 1 is the first weight value
  • the g 2 is the second weight value
  • the processing module 2002 is configured to calculate, by using a fourth formula, the left front audio signal according to the first weight value and the left channel audio signal in the target two-channel audio signal, according to the The first weight value and the right channel audio signal in the target two-channel audio signal are calculated by the fourth formula to obtain the right front audio signal, according to the second weight value and the target two-channel audio
  • the left channel audio signal in the signal is calculated by the fourth formula to obtain the left rear audio signal
  • the second channel weight signal is used according to the second weight value and the right channel audio signal in the target two channel audio signal.
  • the fourth formula calculates the right rear audio signal
  • the FL' is the left front audio signal
  • the FR' is a right front audio signal
  • the BL' is the left rear audio signal
  • the BR' is the right rear audio signal
  • L is a left channel audio signal in the target two-channel audio signal
  • the R is a right channel audio signal in the target two-channel audio signal
  • the g 1 is the first weight value
  • the g 2 is the second weight value.
  • the processing module 2002 is configured to process the target two-channel audio signal according to the position parameters of the four speakers and the sound source position parameter to obtain an intermediate four-channel audio signal; according to the four speakers Position parameters acquire a near field compensation response of the four speakers to a left ear position and a right ear position, the left ear position being a position between the first speaker and the third speaker, the right ear position being a position between the second speaker and the fourth speaker;
  • the four-channel audio signal is derived from the intermediate four-channel audio signal and the time domain response of the near-field compensation response.
  • the processing module 2002 is configured to obtain the four-channel audio signal by using a fifth formula according to the intermediate four-channel audio signal and a time domain response of the near-field compensation response;
  • the fifth formula is:
  • BR BR'*h BR ;
  • the FL is a left front audio signal
  • the FR is a right front audio signal
  • the BL is a left rear audio signal
  • the BR is a right rear audio signal
  • the h FL is the first speaker to the a time domain response of the near field compensation response of the left ear position
  • the h FR being a time domain response of the near field compensation response of the second speaker to the right ear position
  • the h BL being the third a time domain response of the near field compensation response from the speaker to the left ear position
  • the hBR being a time domain response of the near field compensation response of the fourth speaker to the right ear position.
  • the four speakers form a quadrilateral, wherein the first speaker is located on the opposite side of the fourth speaker, the second speaker is located on the opposite side of the third speaker, and the position parameters of the four speakers include the first speaker
  • the sound outlet is opposite to the ear canal of the left ear position, the horizontal distance between the first speaker and the ear canal of the left ear position is a first preset value, the first speaker and the left ear position The vertical distance of the ear canal is a second preset value;
  • the sound outlet of the second speaker is opposite to the ear canal of the right ear position, and the horizontal distance between the second speaker and the ear canal of the right ear position is the first preset value, the second The vertical distance between the speaker and the ear canal of the right ear position is the second preset value;
  • the sound outlet of the third speaker is opposite to the ear canal of the left ear position, and the horizontal distance between the third speaker and the ear canal of the left ear position is the first preset value, the third The vertical distance between the speaker and the ear canal of the left ear position is the second preset value;
  • the sound outlet of the fourth speaker is opposite to the ear canal of the right ear position, and the horizontal distance between the fourth speaker and the ear canal of the right ear position is the first preset value, The vertical distance between the fourth speaker and the ear canal of the right ear position is the second preset value.
  • the first preset value is greater than or equal to 1 cm and less than or equal to 5 cm; the second preset value is greater than or equal to 0.5 cm and less than or equal to 1 cm.
  • the processing module 2002 simulates the orientation information of the sound source position of the original audio signal
  • the position parameters of the four speakers are simultaneously considered, and the front and rear orientations of the sound source position of the original audio signal are simulated. It is intended to ensure that the audio processing device is more accurate in determining the position information of the sound source position of the original audio signal.
  • another embodiment of the audio processing device in this embodiment of the present application includes:
  • the transceiver 2101 is connected to the processor 2102 via the bus 2103;
  • the bus 2103 may be a peripheral component interconnect (PCI) bus or an extended industry standard architecture (EISA) bus.
  • PCI peripheral component interconnect
  • EISA extended industry standard architecture
  • the bus can be divided into an address bus, a data bus, a control bus, and the like. For ease of representation, only one thick line is shown in FIG. 21, but it does not mean that there is only one bus or one type of bus.
  • the processor 2102 can be a central processing unit (CPU), a network processor (NP) or a combination of a CPU and an NP.
  • CPU central processing unit
  • NP network processor
  • the processor 2102 can also further include a hardware chip.
  • the hardware chip may be an application-specific integrated circuit (ASIC), a programmable logic device (PLD) or a combination thereof.
  • the PLD may be a complex programmable logic device (CPLD), a field-programmable gate array (FPGA), a general array logic (GAL) or any combination.
  • the audio processing device may further include a memory 2104.
  • the memory 2104 may include a volatile memory, such as a random-access memory (RAM); the memory may also include a non-volatile memory, such as a flash memory ( A flash memory, a hard disk drive (HDD) or a solid-state drive (SSD); the memory 2104 may also include a combination of the above types of memories.
  • RAM random-access memory
  • non-volatile memory such as a flash memory
  • HDD hard disk drive
  • SSD solid-state drive
  • the memory 2104 may also include a combination of the above types of memories.
  • the memory 2104 can also be used to store program instructions, and the processor 2102 can call the program instructions stored in the memory 2104, and can perform one or more steps in the embodiment shown in FIG. 2 to FIG. 8, or The selected embodiment implements the function of the audio processing device in the above method.
  • the transceiver performs the following steps:
  • the processor performs the following steps:
  • a sound source position parameter corresponding to the original audio signal and a position parameter of four speakers to process the original audio signal according to the sound source position parameter to obtain a target two-channel audio signal; according to the position parameters of the four speakers and the The source position parameter processes the target two-channel audio signal to obtain a four-channel audio signal, the four-channel audio signal is in one-to-one correspondence with the four speakers, and the four speakers are used to play the four-channel audio The corresponding channel signal in the signal.
  • the processor 2102 is configured to obtain, according to the original audio signal, a low frequency signal corresponding to the original audio signal and a high frequency signal corresponding to the original audio signal;
  • the low-frequency signal is convoluted with the target-head related transfer function HRTF to obtain a first two-channel audio signal, and the target HRTF is a head-related transfer function HRTF corresponding to the sound source position parameter;
  • the audio processing device is obtained by using a rigid ball model according to the sound source position, the left ear position is a position between the first speaker and the third speaker, and the right ear position is between the second speaker and the fourth speaker.
  • a position of the sound source determined according to the sound source position parameter, wherein the four speakers form a quadrilateral, wherein a line connecting the first speaker and the fourth speaker is a diagonal of the quadrilateral, a line connecting the second speaker and the third speaker is a diagonal of the quadrilateral;
  • the height parameter includes height information indicating a position of the sound source relative to a horizontal plane, wherein the horizontal plane is a plane passing through a line connecting the left ear position and the right ear position and parallel to the target plane.
  • the target plane is a plane in which the four speakers are located, and the processor 2102 is specifically configured to: if the sound source position parameter indicates that the sound source position is located in the four speakers, the first speaker and the second speaker One side of the speaker, the height characteristic response is calculated according to the first formula;
  • the sound source position parameter indicates that the sound source position is located on one side of the fourth speaker and the fourth speaker among the four speakers, calculating the height feature response according to a second formula
  • the second formula is:
  • ⁇ is height information of the sound source position relative to the horizontal plane
  • the H F_elve is when the sound source position is located at one side of the first speaker and the second speaker of the four speakers a height characteristic response corresponding to the sound source position
  • the H B_elve is a height characteristic response corresponding to the sound source position when the sound source position is located at one side of the fourth speaker and the fourth speaker of the four speakers
  • the HRTF ( ⁇ , 0) is HRTF data corresponding to an elevation angle of ⁇ and an azimuth angle of 0 degrees
  • the HRTF (0, 0) is an HRTF data with an elevation angle of 0 degrees and an azimuth angle of 0 degrees.
  • the HRTF ( ⁇ , 180) is HRTF data corresponding to an elevation angle of ⁇ and an azimuth angle of 180 degrees
  • the HRTF (0, 180) is a direct rear HRTF data with an elevation angle of 0 degrees and an azimuth angle of 180 degrees.
  • the time domain response is transformed from a frequency domain response of the sound source location to the left ear position and a frequency domain response of the sound source location to the right ear position, the frequency domain response being by the audio processing device
  • ⁇ is a normalized distance from a spherical center position of the rigid ball model to the sound source position, where r is the center of the sphere a distance from the position of the sound source, the a is the radius of the sphere corresponding to the rigid ball model, the ⁇ is a normalized angular frequency, the f is a preset frequency, and the c is a sound propagation speed
  • ⁇ L is an angle between a line connecting the position of the center of the sphere and a position of the sound source position on the horizontal plane, and a line connecting the position of the center of the ball and the position of the left ear
  • ⁇ R is An angle between a line center position and a line connecting the position of the sound source at a position of the horizontal plane and a line connecting the center of the ball to the position of the right ear, the sphere being
  • the four-channel audio signal includes a left front audio signal, a right front audio signal, a left rear audio signal, and a right rear audio signal
  • the processor 2102 is specifically configured to use the sound source position parameter and the fourth Position parameters of the speakers determine a first weight value of the first speaker and the second speaker of the four speakers and a second weight value of the third speaker and the fourth speaker of the four speakers; Calculating the left front audio signal according to the first weight value and the left channel audio signal in the target two-channel audio signal, according to the first weight value and the target two-channel audio signal Calculating, by the right channel audio signal, the right front audio signal, and calculating the left rear audio signal according to the second weight value and the left channel audio signal in the target two-channel audio signal, according to the The right rear audio signal is calculated by calculating a weight value and a right channel audio signal in the target two-channel audio signal.
  • the processor 2102 is configured to determine that the first weight value is 1 if the sound source location parameter indicates that the sound source location of the original audio signal is located in a first quadrant within the target plane.
  • the second weight value is 0, and the target plane is a plane where the four speakers are located;
  • the sound source location parameter indicates that the sound source location of the original audio signal is located in the second quadrant in the target plane, determining that the first weight value is 0, and the second weight value is 1;
  • the first angle is an angle between a line connecting the position of the sound source and a position of the center position at the target plane and a front plane
  • the second angle is the first speaker and the The angle between the line connecting the fourth speaker and the front plane or the second angle is the angle between the line connecting the second speaker and the third speaker and the front plane, the center position a intersection of a line connecting the second speaker and the third speaker with a line connecting the first speaker and the fourth speaker, the front plane passing through the center position and perpendicular to the target plane Plane
  • the target plane is divided into four quadrants by a line connecting the first speaker and the fourth speaker and a line connecting the second speaker and the third speaker, the first speaker and the first speaker a quadrant between the two speakers is the first quadrant, a quadrant between the third speaker and the fourth speaker is the second quadrant, and a quadrant between the first speaker and the third speaker And a quadrant between the second speaker and the fourth speaker is the third quadrant.
  • the processor 2102 is configured to calculate, according to the first angle and the second angle, the first weight value and the second weight value by using a third formula
  • the third formula includes:
  • the g 1 is the first weight value
  • the g 2 is the second weight value
  • the processor 2102 is configured to calculate, by using a fourth formula, the left front audio signal according to the first weight value and the left channel audio signal in the target two-channel audio signal, according to the The first weight value and the right channel audio signal in the target two-channel audio signal are calculated by the fourth formula to obtain the right front audio signal, according to the second weight value and the target two-channel audio
  • the left channel audio signal in the signal is calculated by the fourth formula to obtain the left rear audio signal
  • the second channel weight signal is used according to the second weight value and the right channel audio signal in the target two channel audio signal.
  • the fourth formula calculates the right rear audio signal
  • the FL' is the left front audio signal
  • the FR' is a right front audio signal
  • the BL' is the left rear audio signal
  • the BR' is the right rear audio signal
  • L is a left channel audio signal in the target two-channel audio signal
  • the R is a right channel audio signal in the target two-channel audio signal
  • the g 1 is the first weight value
  • the g 2 is the second weight value.
  • the processor 2102 is configured to process the target two-channel audio signal according to the position parameters of the four speakers and the sound source position parameter to obtain an intermediate four-channel audio signal; according to the four speakers Position parameters acquire a near field compensation response of the four speakers to a left ear position and a right ear position, the left ear position being a position between the first speaker and the third speaker, the right ear position being a position between the second speaker and the fourth speaker;
  • the four-channel audio signal is derived from the intermediate four-channel audio signal and the time domain response of the near-field compensation response.
  • the processor 2102 is configured to obtain the four-channel audio signal by using a fifth formula according to the intermediate four-channel audio signal and a time domain response of the near-field compensation response;
  • the fifth formula is:
  • BR BR'*h BR ;
  • the FL is a left front audio signal
  • the FR is a right front audio signal
  • the BL is a left rear audio signal
  • the BR is a right rear audio signal
  • the h FL is the first speaker to the a time domain response of the near field compensation response of the left ear position
  • the h FR being a time domain response of the near field compensation response of the second speaker to the right ear position
  • the h BL being the third a time domain response of the near field compensation response from the speaker to the left ear position
  • the hBR being a time domain response of the near field compensation response of the fourth speaker to the right ear position.
  • the four speakers form a quadrilateral, wherein the first speaker is located on the opposite side of the fourth speaker, The two speakers are located on opposite sides of the third speaker, and the position parameters of the four speakers include an ear canal of the first speaker with the sound outlet facing the left ear position, the first speaker and the left ear position
  • the horizontal distance of the ear canal is a first preset value
  • the vertical distance between the first speaker and the ear canal of the left ear position is a second preset value
  • the sound outlet of the second speaker is opposite to the ear canal of the right ear position, and the horizontal distance between the second speaker and the ear canal of the right ear position is the first preset value, the second The vertical distance between the speaker and the ear canal of the right ear position is the second preset value;
  • the sound outlet of the third speaker is opposite to the ear canal of the left ear position, and the horizontal distance between the third speaker and the ear canal of the left ear position is the first preset value, the third The vertical distance between the speaker and the ear canal of the left ear position is the second preset value;
  • the sound outlet of the fourth speaker is opposite to the ear canal of the right ear position, and the horizontal distance between the fourth speaker and the ear canal of the right ear position is the first preset value, The vertical distance between the fourth speaker and the ear canal of the right ear position is the second preset value.
  • the first preset value is greater than or equal to 1 cm and less than or equal to 5 cm; the second preset value is greater than or equal to 0.5 cm and less than or equal to 1 cm.
  • the processor 2102 simulates the orientation information of the sound source position of the original audio signal, the position parameters of the four speakers are simultaneously considered, and the front and rear orientations of the sound source position of the original audio signal are simulated. Thereby, it is ensured that the audio processing device is more accurate in determining the orientation information of the sound source position of the original audio signal.
  • an embodiment of the VR glasses in the embodiment of the present application includes:
  • the four speakers 2201 are connected to the audio processing device 2202;
  • the four speakers 2201 are distributed on two frames on the VR glasses, wherein the position distribution of the four speakers also satisfies the following rules:
  • the four speakers form a quadrilateral, wherein the first speaker is located on the opposite side of the fourth speaker, the second speaker is located on the opposite side of the third speaker, and the first speaker of the four speakers is located on the plane where the four speakers are located
  • the sound outlet of the first speaker is facing the ear canal of the left ear position
  • the horizontal distance between the first speaker and the ear canal of the left ear position is a first preset value
  • the first speaker and the left speaker The vertical distance of the ear canal of the ear position is a second preset value
  • the second speaker of the four speakers is located at the right front of the plane where the four speakers are located, the sound outlet of the second speaker is the ear canal of the right ear position, and the ear of the second speaker and the right ear position
  • the horizontal distance of the track is the first preset value, and the vertical distance between the second speaker and the ear canal of the right ear position is the second preset value;
  • the third speaker of the four speakers is located at the left rear of the plane where the four speakers are located, the sound outlet of the third speaker is the ear canal of the left ear position, and the ear of the third speaker and the left ear position
  • the horizontal distance of the track is the first preset value, and the vertical distance between the third speaker and the ear canal of the left ear position is the second preset value;
  • the fourth speaker of the four speakers is located at the right rear of the plane where the four speakers are located, the sound outlet of the fourth speaker is the ear canal of the right ear position, and the ear of the fourth speaker and the right ear position
  • the horizontal distance of the track is the first preset value, and the vertical distance between the fourth speaker and the ear canal of the right ear position is the second preset value.
  • the first preset value is greater than or equal to 1 cm and less than or equal to 5 cm; the second predetermined value is greater than or equal to 0.5 cm and less than or equal to 1 cm.
  • the VR glasses further include other parts, which are not described herein.
  • the audio processing device 2202 is provided with all the functions of the audio processing device in the above embodiment.
  • the four speakers 2201 and the audio processing device 2202 may also be included in other possible devices, such as augmented reality (AR) glasses or other wearable devices. This is not limited here.
  • AR augmented reality
  • the audio processing device 2202 simulates the orientation information of the sound source position of the original audio signal
  • the position parameters of the four speakers 2201 are simultaneously considered, and the front and rear orientations of the sound source position of the original audio signal are performed.
  • the simulation ensures that the audio processing device is more accurate in determining the position information of the source position of the original audio signal. Simultaneously integrating the four speakers with the audio processing device on the VR glasses can improve the user experience.
  • the disclosed system, apparatus, and method may be implemented in other manners.
  • the device embodiments described above are merely illustrative.
  • the division of the unit is only a logical function division.
  • there may be another division manner for example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored or not executed.
  • the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be in an electrical, mechanical or other form.
  • the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
  • each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
  • the above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.
  • the integrated unit if implemented in the form of a software functional unit and sold or used as a standalone product, may be stored in a computer readable storage medium.
  • a computer readable storage medium A number of instructions are included to cause a computer device (which may be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods described in various embodiments of the present application.
  • the foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and the like. .

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Stereophonic System (AREA)

Abstract

一种音频处理方法以及音频处理设备，用于提高3D空间中虚拟音源的方位定位准确度。方法包括：音频处理设备获取原始音频信号，原始音频信号对应的音源位置参数以及四个扬声器的位置参数（201）；音频处理设备根据音源位置参数处理原始音频信号得到目标双声道音频信号（202）；音频处理设备根据四个扬声器的位置参数和音源位置参数处理目标双声道音频信号得到四声道音频信号（203）；音频处理设备将四声道音频信号发送给四个扬声器进行播放（204）。

Description

一种音频处理方法以及音频处理设备 技术领域
本申请实施例涉及通信领域，尤其涉及一种音频处理方法以及音频处理设备。
背景技术
当前虚拟现实领域研究非常广泛，其中虚拟音频方面的体验也越来越被重视。虚拟音频技术能够提高用户在虚拟现实场景中的体验，增强真实感和沉浸感。在虚拟音频技术中，除了要对虚拟环境的混响效果进行渲染之外，最重要的基础需求是能够对虚拟音源在三维(3dimension，3D)空间中的方位进行准确模拟。
目前主流的3D音频技术通常使用左右双声道耳机，根据头部跟踪或者虚拟场景设定的声源位置得到声源的方位信息选取对应的头相关传递函数(head related transfer function，HRTF)数据，然后再根据时域卷积等价于频域卷积的原理，将HRTF数据与输入的时域音频信号的快速傅里叶变换FFT的变换结果相乘得到最终音频信号。
在这种方式中，仅参考声源的方位信息，并根据声源的方位信息对应的HRTF数据计算得到最终的音频信号，而在实际应用中在对每个个体选取HRTF数据进行计算时会造成声音方向发生畸变，因此仅依靠声源的方位信息对于音源在3D空间的方位定位不准确。
发明内容
本申请实施例提供了一种音频处理方法以及音频处理设备，用于提高3D空间中虚拟音源的方位定位准确度。
第一方面，本申请实施例提供一种音频处理方法，包括：
该音频播放环境中包括音频处理设备和四个扬声器；设定该四个扬声器所处的平面为目标平面，该四个扬声器构成四边形，其中，该第一扬声器位于该第四扬声器的对侧，该第二扬声器位于该第三扬声器的对侧，即该四个扬声器的位置参数可以如下：该第一扬声器与该第二扬声器位于该目标平面的前方，该第三扬声器与该第四扬声器位于该目标平面的后方，该第一扬声器与该第三扬声器位于该目标平面的左方，该第二扬声器与该第四扬声器位于该目标平面的右方；该音频处理设备确定该四个扬声器的位置参数。然后在该音频处理设备在接收到原始音频信号的时候，同时确定该原始音频信号的音源位置参数。这时该音频处理设备根据该原始音频信号的音源位置参处理该原始音频信号得到目标双声道音频信号；然后该音频处理设备再根据该四个扬声器的位置参数和该音源位置参数处理该目标双声道音频信号得到四声道音频信号，该四声道音频信号与该四个扬声器一一对应；最后该音频处理设备将该四声道音频信号发送给该四个扬声器进行播放。
本申请实施例中，该目标双声道音频信号包括左声道音频信号和右声道音频信号，该四声道音频信号包括左前方音频信号，右前方音频信号，左后方音频信号以及右后方音频信号。该目标双声道音频信号的时延用于指示该音源位置参数指示的音源的左右方位，该目标双声道音频信号的频域特征用于指示该音源的上下方位；该四声道音频信号的振幅用于指示该音源的前后方位，该四声道音频信号的时延用于指示该音源的左右方位，该四声道音频信号的频域特征用于指示该音源的上下方位。其中该目标双声道音频信号的时延为 其左声道音频信号与右声道音频信号的时延；该四声道音频信号的时延指左前方音频信号与右前方音频信号的时延以及左后方音频信号与右后方音频信号的时延，该目标双声道音频信号与该四声道音频信号的振幅为各路信号的波形振幅，该目标双声道音频信号与该四声道音频信号的频域特征为各路信号的频率特征和幅度特征。
本申请实施例提供的技术方案中，该音频处理设备在模拟该原始音频信号的音源位置的方位信息时，将该四个扬声器的位置参数同时进行考虑，并对该原始音频信号的音源位置的前后方位进行模拟，从而保证了该音频处理设备在确定该原始音频信号的音源位置的方位信息时更精确。
可选的，该音频处理设备在根据该音源位置参数对该原始音频信号进行处理时，该音频处理设备可以具体采用如下方案：
首先，该音频处理设备根据该原始音频信号，得到该原始音频信号对应的低频信号和该原始音频信号对应的高频信号；同时该音频处理设备还可以根据该原始音频信号的音源位置参数从已保存的HRTF数据库中确定与该音源位置参数相匹配的目标HRTF；然后该音频处理设备将该低频信号与该目标HRTF进行卷积得到第一双声道音频信号；同时该音频处理设备获取该音源位置参数中的高度参数对应的高度特征响应；然后该音频处理设备将该高频信号与该高度特征响应进行卷积得到目标音频信号；同时该音频处理设备根据该音源位置参数指示的音源位置通过刚球模型计算得到该音源位置到左耳位置的频域响应以及该音源位置到右耳位置的频域响应；该音频处理设备再将该频域响应根据逆快速傅里叶变换(inverse fast fourier transfer，IFFT)得到时域响应；该音频处理设备再将该目标音频信号的时域响应与该高频信号进行卷积得到第二双声道音频信号；最后该音频信号将该第一双声道音频信号与该第二双声道音频信号合并得到该目标双声道音频信号。
本申请实施例提供的技术方案中，该左耳位置为位于第一扬声器与第三扬声器之间的位置，该右耳位置为位于第二扬声器与第四扬声器之间的位置，该音源位置根据该音源位置参数确定，该四个扬声器构成四边形，其中，该第一扬声器位于该第四扬声器的对侧，该第二扬声器位于该第三扬声器的对侧。本实施例中，该音频处理设备还可以通过低通滤波得到该原始音频信号的低频信号，通过高通滤波得到该原始音频信号的高频信号。本实施例中该音频处理设备获取该原始音频信号对应的低频信号和高频信号的方法很多，具体方式，此处不做限定。
根据上述方案，本申请实施例中，该音频处理设备获取该音源位置参数中的高度参数对应的高度特征响应时可以采用如下方案：
若该音源位置参数指示该音源位置位于所述四个扬声器中所述第一扬声器与所述第二扬声器的一侧，则该音频处理设备根据第一公式计算该高度特征响应；
若该音源位置参数指示指示该音源位置位于所述四个扬声器中所述第三扬声器与所述第四扬声器的一侧，则该音频处理设备根据第二公式计算该高度特征响应；
其中，该第一公式为：
Figure PCTCN2017095187-appb-000001
该第二公式为：
Figure PCTCN2017095187-appb-000002
其中，该θ为该音源位置相对于该水平面的高度信息，该HF_elve为该音源位置位于所述四个扬声器中所述第一扬声器与所述第二扬声器的一侧时该音源位置对应的高度特征响应，该HB_elve为该音源位置位于所述四个扬声器中所述第三扬声器与所述第四扬声器的一侧时该音源位置对应的高度特征响应，该HRTF(θ,0)为仰角为θ，方位角为0度对应的HRTF数据，该HRTF(0,0)为仰角为0度，方位角为0度对应的正前方HRTF数据，该HRTF(θ,180)为仰角为θ，方位角为180度对应的HRTF数据，该HRTF(0,180)为仰角为0度，方位角为180度对应的正后方HRTF数据。
本申请实施例提供的技术方案中，该HF_elve也可以为该音源位置距离该第一中点的距离小于该音源位置距离该第二中点的距离时该音源位置对应的高度特征响应，该HB_elve为该音源位置距离第一中点的距离大于该音源位置距离第二中点的距离时该音源位置对应的高度特征响应，该第一中点为该第一扬声器与该第二扬声器之间的中点，该第二中点为该第三扬声器与该第四扬声器之间的中点。同时，该方位角为0度时，该音源位置距离该第一中点的距离小于该音源位置距离该第二中点的距离且处于正对着该第一中点的位置或者该音源位置位于所述四个扬声器中所述第一扬声器与所述第二扬声器的一侧且正对着该第一中点的位置，该方位角为180度时，该音源位置距离第一中点的距离大于该音源位置距离第二中点的距离且正对着该第二中点的位置或者该音源位置位于所述四个扬声器中所述第三扬声器与所述第四扬声器的一侧且正对着该第二中点的位置。
在本申请实施例提供的技术方案中，该高度参数包括用于指示该音源位置相对于水平面的高度信息，该水平面为经过该左耳位置与该右耳位置的连线且平行于目标平面的平面，该目标平面为该四个扬声器所在的平面，本申请实施例提供的技术方案中，该音频处理设备将该原始音频信号的低频信号与该高频信号分别进行处理，可以更准确的模拟该原始音频信号的音源位置的方位信息。
可选的，该时域响应由该音源位置至该左耳位置的频域响应以及该音源位置至该右耳位置的频域响应经变换得到，该频域响应由该音频处理设备根据该音源位置利用该刚球模型得到，其中该刚球模型包括：
Figure PCTCN2017095187-appb-000003
其中，该
Figure PCTCN2017095187-appb-000004
该
Figure PCTCN2017095187-appb-000005
其中该
Figure PCTCN2017095187-appb-000006
为该音源位置至该左耳位置的频域响应，该
Figure PCTCN2017095187-appb-000007
为该音源位置至该右耳位置的频域响应，该ρ为归一化的该刚球模型对应的球心位置至该音源位置的距离，该r为该球心位置到该音源位置的距离，该a为该刚球模型对应的球体的半径，该μ为归一化的角频率，该f为预设频率，该c为声音传播速度，该θL为该球心位置与该音源位置映射在该水平面的位置的连线与该球心位置与该左耳位置的连线的夹角，该θR为该球心位置与该音源位置映射在该水平面的位置的连线与该球心位置到该右耳位置的连线的夹角，该球体根据该四个扬声器的位置参数确定，该水平面为经过该左耳位置与该右耳位置的连线且平行于目标平面的平面，该目标平面为该四个扬声器所在的平面。
本申请提供的技术方案中，该预设频率为该人耳可听到的声音的频率。
可选的，该音频处理设备根据该四个扬声器的位置参数和该音源位置参数处理该目标双声道音频信号得到四声道音频信号时，可以采用如下方案：
该音频处理设备根据该音源位置参数和该四个扬声器的位置参数确定该四个扬声器中该第一扬声器和该第二扬声器的第一权重值以及该四个扬声器中该第三扬声器和第四扬声器的第二权重值；该音频处理设备根据该第一权重值与该目标双声道音频信号中的左声道音频信号计算得到该左前方音频信号，根据该第一权重值与该目标双声道音频信号中的右声道音频信号计算得到该右前方音频信号，根据该第二权重值与该目标双声道音频信号中的左声道音频信号计算得到该左后方音频信号，根据该第二权重值与该目标双声道音频信号中的右声道音频信号计算得到该右后方音频信号。
同时，在上述方案中，该音频处理务根据该四个扬声器的位置参数和该音源位置参数确定该四个扬声器中各扬声器的权重值可以采用如下方案：
若该音源位置参数指示该原始音频信号的音源位置位于目标平面内的第一象限内，则该音频处理设备确定该第一权重值为1，该第二权重值为0，该目标平面为该四个扬声器所在的平面；
若该音源位置参数指示该原始音频信号的音源位置位于该目标平面内的第二象限内，则该音频处理设备确定该第一权重值为0，该第二权重值为1；
若该音源位置参数指示该原始音频信号的音源位置的位于该目标平面内的第三象限内，则该音频处理设备根据第一夹角和第二夹角确定该第一权重值和该第二权重值，该第一夹角为该音源位置与中心位置映射在该目标平面的位置的连线与前平面的夹角，该第二夹角为该第一扬声器与该第四扬声器的连线与该前平面的夹角或者该第二夹角为该第二扬声器与该第三扬声器的连线与该前平面的夹角，该中心位置为该第二扬声器与该第三扬声器的连线与该第一扬声器与该第四扬声器的连线的交点，该前平面为通过该中心位置且垂直于该目标平面的平面；
其中，该目标平面被该第一扬声器与该第四扬声器的连线和该第二扬声器与该第三扬声器的连线分成四个象限，该第一扬声器与该第二扬声器之间的象限为该第一象限，该第三扬声器与该第四扬声器之间的象限为该第二象限，该第一扬声器与该第三扬声器之间的象限以及该第二扬声器与该第四扬声器之间的象限为该第三象限。
在上述方案中，当该音源位置参数指示该原始音频信号的音源位置位于该第三象限时，该音频处理设备根据该第一夹角和该第二夹角利用第三公式计算该第一权重值和该第二权重值；
该第三公式包括：
Figure PCTCN2017095187-appb-000008
其中，该
Figure PCTCN2017095187-appb-000009
为该第一夹角，该
Figure PCTCN2017095187-appb-000010
为该第二夹角，该g1为该第二权重值，该g2为该第二权重值。其中，该第三公式由如下公式推导得到：
Figure PCTCN2017095187-appb-000011
g1 2+g2 2＝1
基于上述方案，所述音频处理设备根据所述第一权重值与所述目标双声道音频信号中的左声道音频信号计算得到所述左前方音频信号，根据所述第一权重值与所述目标双声道音频信号中的右声道音频信号计算得到所述右前方音频信号，根据所述第二权重值与所述目标双声道音频信号中的左声道音频信号计算得到所述左后方音频信号，根据所述第二权重值与所述目标双声道音频信号中的右声道音频信号计算得到所述右后方音频信号时可以利用第四公式进行计算；
其中，该第四公式包括：
Figure PCTCN2017095187-appb-000012
其中，该FL'为该左前方音频信号，该FR'为右前方音频信号，该BL'为该左后方音频信号，该BR'为该右后方音频信号，该L为该目标双声道音频信号中的左声道音频信号，该R为该目标双声道音频信号中的右声道音频信号，该g1为该第一权重值，该g2为该第二权重值。
本申请实施例提供的技术方案中，该音频处理设备根据该四个扬声器中各扬声器的位置参数确定该四个扬声器的权重值，然后再根据该权重值计算各扬声器对应的音频信号，可以有效的提高该音频处理设备对于该原始音频信号的音源位置的方位定位准确度。
可选的，在实际应用中，该音频处理设备在根据该原始音频信号得到四声道音频信号还可以采用如下方法：
该音频处理设备根据该四个扬声器的位置参数和该音源位置参数处理该目标双声道音频信号得到中间四声道音频信号；
该音频处理设备根据该四个扬声器的位置参数获取该四个扬声器到左耳位置以及该四个扬声器到右耳位置的近场补偿响应，该左耳位置为该第一扬声器与该第三扬声器之间的位置，该右耳位置为该第二扬声器与的第四个扬声器的之间的位置；该音频处理设备根据该中间四声道音频信号和该近场补偿响应的时域响应利用第五公式得到该四声道音频信号，该近场补偿响应的时域响应为该近场补偿的频域响应经变换得到；
其中，该第五公式为：
FL＝FL′*hFL；
FR＝FR′*hFR；
BL＝BL′*hBL；
BR＝BR′*hBR；
该FL为左前方音频信号，该FR为右前方音频信号，该BL为左后后音频信号，该BR为右后方音频信号，该hFL为该第一扬声器到该左耳位置该近场补偿响应的时域响应，该hFR为 该第二扬声器到该右耳位置该近场补偿响应的时域响应，该hBL为该第三扬声器到该左耳位置该近场补偿响应的时域响应，该hBR为该第四扬声器到该右耳位置该近场补偿响应的时域响应。
该近声补偿响应表示为：
Figure PCTCN2017095187-appb-000013
其中，
Figure PCTCN2017095187-appb-000014
Figure PCTCN2017095187-appb-000015
Figure PCTCN2017095187-appb-000016
Figure PCTCN2017095187-appb-000017
由此推导得到该近场补偿响应的频域响应为：
Figure PCTCN2017095187-appb-000018
Figure PCTCN2017095187-appb-000019
Figure PCTCN2017095187-appb-000020
Figure PCTCN2017095187-appb-000021
其中，该EL(jw)为左耳位置听到的声音信号的傅里叶变换，该ER(jw)为右耳位置听到的声音信号的傅里叶变换，该XFL(jw)为该第一扬声器播放的声音的傅里叶变换，该XFR(jw)为该第二扬声器播放的声音的傅里叶变换，该XBL(jw)为该第三扬声器播放的声音的傅里叶变换，该XBR(jw)为该第四扬声器播放的声音的傅里叶变换，该GFL_L(jw)为该第一扬声器到该左耳位置的传递函数，该GFL_R(jw)为该第一扬声器到该右耳位置的传递函数，该GFR_L(jw)为该第二扬声器到该左耳位置的传递函数，该GFR_R(jw)为该第二扬声器到该右耳位置的传递函数，该GBL_L(jw)为该第三扬声器到该左耳位置的传递函数，该GBL_R(jw)为该第三扬声器到该右耳位置的传递函数，该GBR_L(jw)为该第四扬声器到该左耳位置的传递函数，该GBR_R(jw)为该第四扬声器到该右耳位置的传递函数。
本申请实施例提供的技术方案中，可以提供更完美的音频信号，从而提高用户体验。
可选的，该四个扬声器构成四边形，其中，第一扬声器位于第四扬声器的对侧，第二扬声器位于第三扬声器的对侧，该四个扬声器的位置参数包括该第一扬声器的出声口正对 该左耳位置的耳道，该第一扬声器与该左耳位置的耳道的水平距离为第一预设值，该第一扬声器与该左耳位置的耳道垂直距离为第二预设值；
该第二扬声器的出声口正对该右耳位置的耳道，该第二扬声器与该右耳位置的耳道的水平距离为该第一预设值，该第二扬声器与该右耳位置的耳道垂直距离为该第二预设值；
该第三扬声器的出声口正对该左耳位置的耳道，该第三扬声器与该左耳位置的耳道的水平距离为该第一预设值，该第三扬声器与该左耳位置的耳道垂直距离为该第二预设值；
该第四扬声器的出声口正对该右耳位置的耳道，该第四扬声器与该右耳位置的耳道的水平距离为该第一预设值，该第四扬声器与该右耳位置的耳道垂直距离为该第二预设值。
其中，该第一预设值大于或等于1厘米且小于或等于5厘米；该第二预设值大于或等于0.5厘米且小于或等于1厘米。
本申请实施例提供的技术方案中，通过调整该四个扬声器的对于双耳的位置，可以有效的提高对音频信号的定位。
第二方面，本申请实施例提供一种音频处理设备，该音频处理设备具有实现上述方法中音频处理设备的功能。该功能可以通过硬件实现，也可以通过硬件执行相应的软件实现。该硬件或软件包括一个或多个与上述功能相对应的模块。
一种可能实现方式中，该音频处理设备包括：
获取模块，用于获取原始音频信号，所述原始音频信号对应的音源位置参数以及四个扬声器的位置参数；
处理模块，用于根据所述音源位置参数处理所述原始音频信号得到目标双声道音频信号；根据所述四个扬声器的位置参数和所述音源位置参数处理所述目标双声道音频信号得到四声道音频信号，所述四声道音频信号与所述四个扬声器一一对应，所述四个扬声器用于播放所述四声道音频信号中对应的声道信号。
另一种可能实现方式中，该音频处理设备包括：
收发器，处理器以及总线；
该收发器与该处理器通过该总线相连；
该收发器，执行如下步骤：
获取原始音频信号；
该处理器，执行如下步骤：
获取所述原始音频信号对应的音源位置参数以及四个扬声器的位置参数根据所述音源位置参数处理所述原始音频信号得到目标双声道音频信号；根据所述四个扬声器的位置参数和所述音源位置参数处理所述目标双声道音频信号得到四声道音频信号，所述四声道音频信号与所述四个扬声器一一对应，所述四个扬声器用于播放所述四声道音频信号中对应的声道信号。
第三方面，本申请实施例提供一种虚拟现实(virtual reality，VR)眼镜，包括：该四个扬声器和该音频处理设备；
该四个扬声器与该音频处理设备相连；
该四个扬声器分布在该VR眼镜上的两个眼镜架上，其中，该四个扬声器的位置分布还 满足如下规则：
所述四个扬声器构成四边形，其中，第一扬声器位于第四扬声器的对侧，第二扬声器位于第三扬声器的对侧，该四个扬声器中的第一扬声器位于该四个扬声器所处平面的左前方，该第一扬声器的出声口正对该左耳位置的耳道，该第一扬声器与该左耳位置的耳道的水平距离为第一预设值，该第一扬声器与该左耳位置的耳道垂直距离为第二预设值；
该四个扬声器中的第二扬声器位于该四个扬声器所处平面的右前方，该第二扬声器的出声口正对该右耳位置的耳道，该第二扬声器与该右耳位置的耳道的水平距离为该第一预设值，该第二扬声器与该右耳位置的耳道垂直距离为该第二预设值；
该四个扬声器中的第三扬声器位于该四个扬声器所处平面的左后方，该第三扬声器的出声口正对该左耳位置的耳道，该第三扬声器与该左耳位置的耳道的水平距离为该第一预设值，该第三扬声器与该左耳位置的耳道垂直距离为该第二预设值；
该四个扬声器中的第四扬声器位于该四个扬声器所处平面的右后方，该第四扬声器的出声口正对该右耳位置的耳道，该第四扬声器与该右耳位置的耳道的水平距离为该第一预设值，该第四扬声器与该右耳位置的耳道垂直距离为该第二预设值。
其中，该第一预设值大于或等于1厘米且小于或等于5厘米；该第二预设值大于或等于0.5厘米且小于或等于1厘米。
该音频处理设备具备上述实施例中音频处理设备的全部功能。
本实施例中，该四个扬声器与该音频处理设备还可以包含于其他可能的设备上，比如增强现实(augmented reality，AR)眼镜或者其他可穿戴设备。具体此处不做限定。
第四方面，本申请实施例提供一种计算机可读存储介质，包括指令，当该指令在计算机上运行时，该计算机执行上述各项方法。
第五方面，本申请实施例提供一种包含指令的计算机程序产品，当该计算机程序产品在计算机上运行时，该计算机执行上述各项方法。
本申请实施例提供的技术方案中，该音频处理设备在模拟该原始音频信号的方位信息时，将该四个扬声器的位置参数同时进行考虑，并对该原始音频信号的前后方位进行模拟，从而保证了该音频处理设备在确定该原始音频信号的音源位置的方位信息时更精确。
附图说明
图1为本申请实施例中3D音频技术中左右双声道耳机处理音频信号的示意图；
图2为本申请实施例中音频处理方法的一个实施例示意图；
图3为本申请实施例中四个扬声器的分布方式的一个实施例示意图；
图4为本申请实施例中根处理原始音频信号得到目标双声道音频信号的方法流程图；
图5为本申请实施例中前平面示意图；
图6为本申请实施例中刚球模型示意图；
图7为本申请实施例中四个扬声器的位置和音源位置分布示意图；
图8为本申请实施例中音频处理方法的另一个实施例示意图；
图9为本申请实施例中音源位置一个实施例示意图；
图10为本申请实施例中原始音频信号的信号示意图；
图11为本申请实施例中原始音频信号的高频分量示意图；
图12为本申请实施例中原始音频信号的低频分量示意图；
图13为本申请实施例中携带高度特征的高频输出信号示意图；
图14为本申请实施例中携带高度特征和左右信息的高频输出信号示意图；
图15为本申请实施例中处理后的低频分量示意图；
图16为本申请实施例中得到的目标双声道音频信号的示意图；
图17为本申请实施例中四声道音频信号的示意图；
图18为本申请实施例中近场补偿滤波器的时域响应示意图；
图19为本申请实施例中相邻两帧做二分之一帧长的交叠平滑的方法示意图；
图20为本申请实施例中音频处理设备的一个实施例示意图；
图21为本申请实施例中音频处理设备的另一个实施例示意图；
图22为本申请实施例中VR眼镜的一个实施例示意图。
具体实施方式
本申请实施例提供一种音频处理方法以及音频处理设备，用于提高3D空间中虚拟音源的方位定位准确度。
本申请的说明书和权利要求书及上述附图中的术语“第一”、“第二”、“第三”、“第四”等(如果存在)是用于区别类似的对象，而不必用于描述特定的顺序或先后次序。应该理解这样使用的数据在适当情况下可以互换，以便这里描述的实施例能够以除了在这里图示或描述的内容以外的顺序实施。此外，术语“包括”和“具有”以及他们的任何变形，意图在于覆盖不排他的包含，例如，包含了一系列步骤或单元的过程、方法、系统、产品或设备不必限于清楚地列出的那些步骤或单元，而是可包括没有清楚地列出的或对于这些过程、方法、产品或设备固有的其它步骤或单元。
当前虚拟现实领域研究非常广泛，其中虚拟音频方面的体验也越来越被重视。虚拟音频技术能够提高用户在虚拟现实场景中的体验，增强真实感和沉浸感。在虚拟音频技术中，除了要对虚拟环境的混响效果进行渲染之外，最重要的基础需求是能够对虚拟音源在3D空间中的方位进行准确模拟。目前主流的3D音频技术通常使用左右双声道耳机，具体流程如图1所示，首先根据头部跟踪或者虚拟场景设定的声源位置选取对应的HRTF数据，然后再根据时域卷积等价于频域卷积的原理，将HRTF数据与输入的时域音频信号的FFT变换结果相乘得到最终音频信号。在这种方式中，仅参考声源的方位信息，并根据声源的方位信息对应的HRTF数据计算得到最终的音频信号，而在实际应用中在对每个个体选取HRTF数据进行计算时会造成声音方向发生畸变，因此仅依靠声源的方位信息对于音源在3D空间的方位定位不准确。为了解决这一问题，本申请实施例提供如下技术方案：该音频播放环境中包括音频处理设备和四个扬声器；设定该四个扬声器所处的平面为目标平面，该四个扬声器构成四边形，其中，该第一扬声器位于该第四扬声器的对侧，该第二扬声器位于该第三扬声器的对侧，即该四个扬声器的位置参数可以如下：该第一扬声器与该第二扬声器位于该目标平面的前方，该第三扬声器与该第四扬声器位于该目标平面的后方，该第一扬声器与该第三扬声器位于该目标平面的左方，该第二扬声器与该第四扬声器位于该目标平面的 右方；该音频处理设备确定该四个扬声器的位置参数。然后在该音频处理设备在接收到原始音频信号的时候，同时确定该原始音频信号的音源位置参数。这时该音频处理设备根据该原始音频信号的音源位置参处理该原始音频信号得到目标双声道音频信号；然后该音频处理设备再根据该四个扬声器的位置参数和该音源位置参数处理该目标双声道音频信号得到四声道音频信号，该四声道音频信号与该四个扬声器一一对应；最后该音频处理设备将该四声道音频信号发送给该四个扬声器进行播放。
本申请实施例中，该目标双声道音频信号包括左声道音频信号和右声道音频信号，该四声道音频信号包括左前方音频信号，右前方音频信号，左后方音频信号以及右后方音频信号。该目标双声道音频信号的时延用于指示该音源位置参数指示的音源的左右方位，该目标双声道音频信号的频域特征用于指示该音源的上下方位；该四声道音频信号的振幅用于指示该音源的前后方位，该四声道音频信号的时延用于指示该音源的左右方位，该四声道音频信号的频域特征用于指示该音源的上下方位。其中该目标双声道音频信号的时延为其左声道音频信号与右声道音频信号的时延；该四声道音频信号的时延指左前方音频信号与右前方音频信号的时延以及左后方音频信号与右后方音频信号的时延，该目标双声道音频信号与该四声道音频信号的振幅为各路信号的波形振幅，该目标双声道音频信号与该四声道音频信号的频域特征为各路信号的频率特征和幅度特征。
本申请实施例中，该音频处理设备与该四个扬声器中可以集成一个设备上也可以直接各自独立，比如该音频处理设备与该四个扬声器可以集成在VR眼镜或者AR眼镜上。具体情况此处不做限定。
本申请实施例中，涉及到的目标平面、水平面、前平面、左耳位置、右耳位置、球体以及球心的定义如下：
该四个扬声器所处的平面为该目标平面，其中，该四个扬声器构成四边形，其中，该第一扬声器位于该第四扬声器的对侧，该第二扬声器位于该第三扬声器的对侧；即该四个扬声器的位置参数可以如下：第一扬声器与第二扬声器位于该目标平面的前方，第三扬声器与第四个扬声器位于该目标平面的后方，该第一扬声器与该第三扬声器位于该目标平面的左方，该第二扬声器与该第四个扬声器位于该目标平面的右方(即该第一扬声器位于该目标平面的左前方，该第二扬声器位于该目标平面的右前方，该第三扬声器位于该目标平面的左后方，该第四个扬声器位于该目标平面的右后方)；
该左耳位置为该第一扬声器与该第三扬声器之间的位置；
该右耳位置为该第二扬声器与该第四扬声器之间的位置；
该前平面通过该四个扬声器的中心位置且垂直于该目标平面的平面，其中，该四个扬声器的中心位置为该第二扬声器与该第三扬声器的连线与该第一扬声器与该第四扬声器的连线的交点；
该水平面为经过左耳位置与右耳位置的连线且平行该目标平面的平面；
该球体根据该四个扬声器的位置参数确定；
该球心为该球体的中心。
具体情况请参阅图2所示，本申请实施例中音频信号处理方法的一个实施例包括：
201、音频处理设备获取原始音频信号，该原始音频信号的音源位置参数以及四个扬声器的位置参数。
该音频处理设备接收到该原始音频信号；然后根据头部跟踪或虚拟场景设定的声源位置得到该原始音频信号的音源位置参数；同时获取该音频处理场景下的四个扬声器的位置参数。在本实施例中，设定该四个扬声器所处的平面为目标平面，其中第一扬声器与第二扬声器位于该目标平面的前方，第三扬声器与第四个扬声器位于该目标平面的后方，该第一扬声器与该第三扬声器位于该目标平面的左方，该第二扬声器与该第四个扬声器位于该目标平面的右方。如图3所示，该四个扬声器中的该第一扬声器位于该目标平面的左前方，该第二扬声器位于该目标平面的右前方，该第三扬声器位于该目标平面的左后方，该第四个扬声器位于该目标平面的右后方。在实际场景中，这四个扬声器分布的位置可以为：该第一扬声器分布在人体左耳前方；该第二扬声器分布在该左耳后方；该第三扬声器分布在该人体右耳前方；该第四个扬声器分布在该人体右耳后方；本场景中，以人体面部朝向为前方。
在实际应用场景中，该四个扬声器的位置参数包括：该第一扬声器的出声口正对该左耳位置的耳道，该第一扬声器与该左耳位置的耳道的水平距离为第一预设值，该第一扬声器与该左耳位置的耳道垂直距离为第二预设值；
该第二扬声器的出声口正对该右耳位置的耳道，该第二扬声器与该右耳位置的耳道的水平距离为该第一预设值，该第二扬声器与该右耳位置的耳道垂直距离为该第二预设值；
该第三扬声器的出声口正对该左耳位置的耳道，该第三扬声器与该左耳位置的耳道的水平距离为该第一预设值，该第三扬声器与该左耳位置的耳道垂直距离为该第二预设值；
该第四扬声器的出声口正对该右耳位置的耳道，该第四扬声器与该右耳位置的耳道的水平距离为该第一预设值，该第四扬声器与该右耳位置的耳道垂直距离为该第二预设值。
其中，该第一预设值大于或等于1厘米且小于或等于5厘米；该第二预设值大于或等于0.5厘米且小于或等于1厘米。
在实际应用中该四个扬声器的位置参数具体可以如下：该第一扬声器位于左耳的前方，并且该第一扬声器的出声口正对用户的左耳的耳道，同时该第一扬声器与该用户的左耳的耳道的水平距离为2厘米，该第一扬声器与该用户的左耳的耳道的垂直距离为0.6厘米；该第三扬声器位于该用户左耳的后方，并且该第三扬声器的出声口正对该用户的左耳的耳道，同时该第三扬声器与该用户的左耳的耳道的水平距离为2厘米，该第三扬声器与该用户的左耳的耳道的垂直距离为0.6厘米；该第二扬声器位于该用户右耳的前方，并且该第二扬声器的出声口正对该用户的右耳的耳道，同时该第二扬声器与该用户的右耳的耳道的水平距离为2厘米，该第二扬声器与该用户的右耳的耳道的垂直距离为0.6厘米；该第四扬声器位于该用户的右耳的后方，并且该第四扬声器的出声口正对该用户的右耳的耳道，同时该第四扬声器与该用户右耳的耳道的水平距离为2厘米，该第四扬声器与该用户的右耳的耳道的垂直距离为0.6厘米。
202、该音频处理设备根据该音源位置参数处理该原始音频信号得到目标双声道音频信号。
该音频处理设备在获取到该音源位置参数和该四个扬声器的位置参数之后，根据该音源位置参数利用方位渲染算法对该原始音频信号进行处理得到目标双声道音频信号，该目标双声道音频信号的时延用于指示该音源位置参数指示的音源的左右方位，该目标双声道音频信号的频域特征用于指示该音源的上下方位。
在实际应用中，该音频处理设备在利用方位渲染算法对该原始音频信号进行处理时，该音频处理设备可以具体采用如下方案，具体流程如图4所示：
首先，该音频处理设备根据该原始音频信号，得到该原始音频信号对应的低频信号和该原始音频信号对应的高频信号；同时该音频处理设备还可以根据该原始音频信号的音源位置参数从已保存的HRTF数据库中确定与该音源位置参数相匹配的目标HRTF；然后该音频处理设备将该低频信号与该目标HRTF进行卷积得到第一双声道音频信号；同时该音频处理设备获取该音源位置参数中的高度参数对应的高度特征响应；然后该音频处理设备将该高频信号与该高度特征响应进行卷积得到目标音频信号；同时该音频处理设备根据该音源位置参数指示的音源位置通过刚球模型计算得到该音源位置到左耳位置的频域响应以及该音源位置到右耳位置的频域响应；该音频处理设备再将该频域响应根据逆快速傅里叶变换(inverse fast fourier transfer，IFFT)得到时域响应；该音频处理设备再将该目标音频信号的时域响应与该高频信号进行卷积得到第二双声道音频信号；最后该音频信号将该第一双声道音频信号与该第二双声道音频信号合并得到该目标双声道音频信号。
本申请实施例提供的技术方案中，该左耳位置为位于第一扬声器与第三扬声器之间的位置，该右耳位置为位于第二扬声器与第四扬声器之间的位置，该音源位置根据该音源位置参数确定，该四个扬声器构成四边形，其中，该第一扬声器位于该第四扬声器的对侧，该第二扬声器位于该第三扬声器的对侧。本实施例中，该音频处理设备还可以通过低通滤波得到该原始音频信号的低频信号，通过高通滤波得到该原始音频信号的高频信号。本实施例中该音频处理设备获取该原始音频信号对应的低频信号和高频信号的方法很多，具体方式，此处不做限定。根据上述方案，本申请实施例中，该音频处理设备获取该音源位置参数中的高度参数对应的高度特征响应时可以采用如下方案：
若该音源位置参数指示该音源位置距离第一中点的距离小于该音源位置距离第二中点的距离，则该音频处理设备根据第一公式计算该高度特征响应，该第一中点为该第一扬声器与该第二扬声器之间的中点，该第二中点为该第三扬声器与该第四扬声器之间的中点；
若该音源位置参数指示指示该音源位置距离该第一中点的距离大于该音源位置距离该第二中点的距离，则该音频处理设备根据第二公式计算该高度特征响应；
其中，该第一公式为：
Figure PCTCN2017095187-appb-000022
该第二公式为：
Figure PCTCN2017095187-appb-000023
其中，该θ为该音源位置相对于该水平面的高度信息，该HF_elve为该音源位置距离该第一中点的距离小于该音源位置距离该第二中点的距离时该音源位置对应的高度特征响应，该HB_elve为该音源位置距离第一中点的距离大于该音源位置距离第二中点的距离时该音源位置对应的高度特征响应，该HRTF(θ,0)为仰角为θ，方位角为0度对应的HRTF数据， 该HRTF(0,0)为仰角为0度，方位角为0度对应的正前方HRTF数据，该HRTF(θ,180)为仰角为θ，方位角为180度对应的HRTF数据，该HRTF(0,180)为仰角为0度，方位角为180度对应的正后方HRTF数据。
在本申请实施例提供的技术方案中，该高度参数包括用于指示该音源位置相对于水平面的高度信息，该水平面为经过该左耳位置与该右耳位置的连线且平行于目标平面的平面，该目标平面为该四个扬声器所在的平面，可选的，该时域响应由该音源位置至该左耳位置的频域响应以及该音源位置至该右耳位置的频域响应经变换得到，该频域响应由该音频处理设备根据该音源位置利用该刚球模型得到，其中该刚球模型包括：
Figure PCTCN2017095187-appb-000024
其中，该
Figure PCTCN2017095187-appb-000025
该
Figure PCTCN2017095187-appb-000026
其中该
Figure PCTCN2017095187-appb-000027
为该音源位置至该左耳位置的频域响应，该
Figure PCTCN2017095187-appb-000028
为该音源位置至该右耳位置的频域响应，该ρ为归一化的该刚球模型对应的球心位置至该音源位置的距离，该r为该球心位置到该音源位置的距离，该a为该刚球模型对应的球体的半径，该μ为归一化的角频率，该f为预设频率，该c为声音传播速度，该θL为该球心位置与该音源位置映射在该水平面的位置的连线与该球心位置与该左耳位置的连线的夹角，该θR为该球心位置与该音源位置映射在该水平面的位置的连线与该球心位置到该右耳位置的连线的夹角，该球体根据该四个扬声器的位置参数确定，该水平面为经过该左耳位置与该右耳位置的连线且平行于目标平面的平面，该目标平面为该四个扬声器所在的平面。
本申请提供的技术方案中，该预设频率为该人耳可听到的声音的频率。
203、该音频处理设备根据该四个扬声器的位置参数和该音源位置参数处理该目标双声道音频信号得到四声道音频信号。
该音频处理设备根据该音源位置参数与该四个扬声器的位置参数确定该四个扬声器中各扬声器的权重值；然后该音频处理设备根据该四个扬声器中第一扬声器和第二扬声器的第一权重值与该目标双声道音频信号的左声道音频信号计算得到左前方音频信号，根据该四个扬声器中第一扬声器和第二扬声器的第一权重值与该目标双声道音频信号的右声道音频信号计算得到右前方音频信号，根据该四个扬声器中第三扬声器和第四扬声器的第二权重值与该目标双声道音频信号的左声道音频信号计算得到左后方音频信号，根据该四个扬声器中第三扬声器和第四扬声器的第二权重值与该目标双声道音频信号的右声道音频信号计算得到右后方音频信号，其中，该左前方音频信号，该右前方音频信号，该左后方音频信号和该右后方音频信号为该四声道音频信号。同时，在上述方案中，该音频处理设备根据该四个扬声器的位置参数和该音源位置参数确定该四个扬声器中各扬声器的权重值可以采用如下方案：
如图7所示，该目标平面为该四个扬声器所处的平面；该第一夹角为该音源位置与中心位置映射在该目标平面的位置的连线与前平面的夹角(如图中的
Figure PCTCN2017095187-appb-000029
)，该第二夹角为该第一扬声器与该第四扬声器的连线与该前平面的夹角或者该第二夹角为该第二扬声器与该第三扬声器的连线与该前平面的夹角(如图中的
Figure PCTCN2017095187-appb-000030
)；
其中，该目标平面被该第一扬声器与该第四扬声器的连线和该第二扬声器与该第三扬声器的连线分成四个象限，该第一扬声器与该第二扬声器之间的象限为该第一象限，该第三扬声器与该第四扬声器之间的象限为该第二象限，该第一扬声器与该第三扬声器之间的象限以及该第二扬声器与该第四扬声器之间的象限为该第三象限。
若该音源位置参数指示该原始音频信号的音源位置位于目标平面内的第一象限内，则该音频处理设备确定该第一权重值为1，该第二权重值为0，该目标平面为该四个扬声器所在的平面；
若该音源位置参数指示该原始音频信号的音源位置位于该目标平面内的第二象限内，则该音频处理设备确定该第一权重值为0，该第二权重值为1；
若该音源位置参数指示该原始音频信号的音源位置的位于该目标平面内的第三象限内，则该音频处理设备根据第一夹角和第二夹角确定该第一权重值和该第二权重值，该第一夹角为该音源位置与中心位置映射在该目标平面的位置的连线与前平面的夹角，该第二夹角为该第一扬声器与该第四扬声器的连线与该前平面的夹角或者该第二夹角为该第二扬声器与该第三扬声器的连线与该前平面的夹角，该中心位置为该第二扬声器与该第三扬声器的连线与该第一扬声器与该第四扬声器的连线的交点，该前平面为通过该中心位置且垂直于该目标平面的平面；
在上述方案中，当该音源位置参数指示该原始音频信号的音源位置位于该第三象限时，该音频处理设备根据该第一夹角与该第二夹角利用第三公式计算该第一权重值和该第二权重值；
该第三公式包括：
Figure PCTCN2017095187-appb-000031
其中，该第三公式由如下公式推导得到：
Figure PCTCN2017095187-appb-000032
g1 2+g2 2＝1
其中，该
Figure PCTCN2017095187-appb-000033
为该第一夹角，该
Figure PCTCN2017095187-appb-000034
为该第二夹角，该g1为该第一权重值，该g2为该第二权重值。
基于上述方案，该音频处理设备根据该四个扬声器中第一扬声器和第二扬声器的第一权重值与该目标双声道音频信号的左声道音频信号计算得到左前方音频信号，根据该四个扬声器中第一扬声器和第二扬声器的第一权重值与该目标双声道音频信号的右声道音频信号计算得到右前方音频信号，根据该四个扬声器中第三扬声器和第四扬声器的第二权重值与该目标双声道音频信号的左声道音频信号计算得到左后方音频信号，根据该四个扬声器中第三扬声器和第四扬声器的第二权重值与该目标双声道音频信号的右声道音频信号计算得到右后方音频信号时可以利用第四公式进行计算；
其中，该第四公式包括：
Figure PCTCN2017095187-appb-000035
其中，该FL'为该左前方音频信号，该FR'为右前方音频信号，该BL'为该左后方音频信号，该BR'为该右后方音频信号，该L为该目标双声道音频信号中的左声道音频信号，该R为该目标双声道音频信号中的右声道音频信号，该g1为该第一权重值，该g2为该第二权重值。
204、该音频处理设备将该四声道音频信号发送给该四个扬声器进行播放。
该音频处理设备将该左前方音频信号发送给该第一扬声器，将该右前方音频信号发送给该第一扬声器，将该左后方音频信号发送给该第三扬声器，将该右后方音频信号发送给该第四扬声器，然后各扬声器播放各自接收到的音频信号。
本实施例中，该音频处理设备在模拟该原始音频信号的方位信息时，将该四个扬声器的位置参数同时进行考虑，并该原始音频信号的音源位置的前后方位进行模拟，从而保证了该音频处理设备在确定该原始音频信号的音源位置的方位信息时更精确。
具体请参阅图8所示，本申请实施例中音频处理方法的另一个实施例包括：
801、音频处理设备获取原始音频信号，该原始音频信号的音源位置参数以及四个扬声器的位置参数。
该音频处理设备接收到该原始音频信号；然后根据头部跟踪或虚拟场景设定的声源位置得到该原始音频信号的音源位置参数；同时获取该音频处理场景下的四个扬声器的位置参数。在本实施例中，设定该四个扬声器所处的平面为目标平面，其中第一扬声器与第二扬声器位于该目标平面的前方，第三扬声器与第四个扬声器位于该目标平面的后方，该第一扬声器与该第三扬声器位于该目标平面的左方，该第二扬声器与该第四个扬声器位于该目标平面的右方。如图3所示，该四个扬声器中的该第一扬声器位于该目标平面的左前方，该第二扬声器位于该目标平面的右前方，该第三扬声器位于该目标平面的左后方，该第四个扬声器位于该目标平面的右后方。在实际场景中，这四个扬声器分布的位置可以为：该第一扬声器分布在人体左耳前方；该第二扬声器分布在该左耳后方；该第三扬声器分布在该人体右耳前方；该第四个扬声器分布在该人体右耳后方；本场景中，以人体面部朝向为前方。
在实际应用场景中，该四个扬声器的位置参数包括：该第一扬声器的出声口正对该左耳位置的耳道，该第一扬声器与该左耳位置的耳道的水平距离为第一预设值，该第一扬声器与该左耳位置的耳道垂直距离为第二预设值；
该第二扬声器的出声口正对该右耳位置的耳道，该第二扬声器与该右耳位置的耳道的水平距离为该第一预设值，该第二扬声器与该右耳位置的耳道垂直距离为该第二预设值；
该第三扬声器的出声口正对该左耳位置的耳道，该第三扬声器与该左耳位置的耳道的水平距离为该第一预设值，该第三扬声器与该左耳位置的耳道垂直距离为该第二预设值；
该第四扬声器的出声口正对该右耳位置的耳道，该第四扬声器与该右耳位置的耳道的水平距离为该第一预设值，该第四扬声器与该右耳位置的耳道垂直距离为该第二预设值。
其中，该第一预设值大于或等于1厘米且小于或等于5厘米；该第二预设值大于或等于0.5厘米且小于或等于1厘米。
在实际应用中该四个扬声器的位置参数具体可以如下：该第一扬声器位于左耳的前方，并且该第一扬声器的出声口正对用户的左耳的耳道，同时该第一扬声器与该用户的左耳的耳道的水平距离为2厘米，该第一扬声器与该用户的左耳的耳道的垂直距离为0.6厘米；该第三扬声器位于该用户左耳的后方，并且该第三扬声器的出声口正对该用户的左耳的耳道，同时该第三扬声器与该用户的左耳的耳道的水平距离为2厘米，该第三扬声器与该用户的左耳的耳道的垂直距离为0.6厘米；该第二扬声器位于该用户右耳的前方，并且该第二扬声器的出声口正对该用户的右耳的耳道，同时该第二扬声器与该用户的右耳的耳道的水平距离为2厘米，该第二扬声器与该用户的右耳的耳道的垂直距离为0.6厘米；该第四扬声器位于该用户的右耳的后方，并且该第四扬声器的出声口正对该用户的右耳的耳道，同时该第四扬声器与该用户右耳的耳道的水平距离为2厘米，该第四扬声器与该用户的右耳的耳道的垂直距离为0.6厘米。
802、该音频处理设备根据该音源位置参数处理该原始音频信号得到目标双声道音频信号。
该音频处理设备在获取到该音源位置参数和该四个扬声器的位置参数之后，根据该音源位置参数利用方位渲染算法对该原始音频信号进行处理得到目标双声道音频信号，该目标双声道音频信号的时延用于指示该音源位置参数指示的音源的左右方位，该目标双声道音频信号的频域特征用于指示该音源的上下方位。
在实际应用中，该音频处理设备在利用方位渲染算法对该原始音频信号进行处理时，该音频处理设备可以具体采用如下方案，具体流程如图4所示：
首先，该音频处理设备根据该原始音频信号，得到该原始音频信号对应的低频信号和该原始音频信号对应的高频信号；同时该音频处理设备还可以根据该原始音频信号的音源位置参数从已保存的HRTF数据库中确定与该音源位置参数相匹配的目标HRTF；然后该音频处理设备将该低频信号与该目标HRTF进行卷积得到第一双声道音频信号；同时该音频处理设备获取该音源位置参数中的高度参数对应的高度特征响应；然后该音频处理设备将该高频信号与该高度特征响应进行卷积得到目标音频信号；同时该音频处理设备根据该音源位置参数指示的音源位置通过刚球模型计算得到该音源位置到左耳位置的频域响应以及该音源位置到右耳位置的频域响应；该音频处理设备再将该频域响应根据逆快速傅里叶变换(inverse fast fourier transfer，IFFT)得到时域响应；该音频处理设备再将该目标音频信号的时域响应与该高频信号进行卷积得到第二双声道音频信号；最后该音频信号将该第一双声道音频信号与该第二双声道音频信号合并得到该目标双声道音频信号。
本申请实施例提供的技术方案中，该左耳位置为位于第一扬声器与第三扬声器之间的位置，该右耳位置为位于第二扬声器与第四扬声器之间的位置，该音源位置根据该音源位置参数确定，该四个扬声器构成四边形，其中，该第一扬声器位于该第四扬声器的对侧， 该第二扬声器位于该第三扬声器的对侧。本实施例中，该音频处理设备还可以通过低通滤波得到该原始音频信号的低频信号，通过高通滤波得到该原始音频信号的高频信号。本实施例中该音频处理设备获取该原始音频信号对应的低频信号和高频信号的方法很多，具体方式，此处不做限定。根据上述方案，本申请实施例中，该音频处理设备获取该音源位置参数中的高度参数对应的高度特征响应时可以采用如下方案：
若该音源位置参数指示该音源位置距离第一中点的距离小于该音源位置距离第二中点的距离，则该音频处理设备根据第一公式计算该高度特征响应，该第一中点为该第一扬声器与该第二扬声器之间的中点，该第二中点为该第三扬声器与该第四扬声器之间的中点
若该音源位置参数指示指示该音源位置距离该第一中点的距离大于该音源位置距离该第二中点的距离，则该音频处理设备根据第二公式计算该高度特征响应
其中，该第一公式为：
Figure PCTCN2017095187-appb-000036
该第二公式为：
Figure PCTCN2017095187-appb-000037
其中，该θ为该音源位置相对于该水平面的高度信息，该HF_elve为该音源位置距离该第一中点的距离小于该音源位置距离该第二中点的距离时该音源位置对应的高度特征响应，该HB_elve为该音源位置距离第一中点的距离大于该音源位置距离第二中点的距离时该音源位置对应的高度特征响应，该HRTF(θ,0)为仰角为θ，方位角为0度对应的HRTF数据，该HRTF(0,0)为仰角为0度，方位角为0度对应的正前方HRTF数据，该HRTF(θ,180)为仰角为θ，方位角为180度对应的HRTF数据，该HRTF(0,180)为仰角为0度，方位角为180度对应的正后方HRTF数据。
在本申请实施例提供的技术方案中，该高度参数包括用于指示该音源位置相对于水平面的高度信息，该水平面为经过该左耳位置与该右耳位置的连线且平行于目标平面的平面，该目标平面为该四个扬声器所在的平面，可选的，该时域响应由该音源位置至该左耳位置的频域响应以及该音源位置至该右耳位置的频域响应经变换得到，该频域响应由该音频处理设备根据该音源位置利用该刚球模型得到，其中该刚球模型包括：
Figure PCTCN2017095187-appb-000038
其中，该
Figure PCTCN2017095187-appb-000039
该
Figure PCTCN2017095187-appb-000040
其中该
Figure PCTCN2017095187-appb-000041
为该音源位置至该左耳位置的频域响应，该
Figure PCTCN2017095187-appb-000042
为该音源位置至该右耳位置的频域响应，该ρ为归一化的该刚球模型对应的球心位置至该音源位置的距离，该r为该球心位置到该音源位置的距离，该a为该刚球模型对应的球体的半径，该μ为归一化的角频率，该f为预设频率，该c为声音传播速度，该θL为该球心位置与该音源位置映射在该水平面的位置的连线与该球心位置与该左耳位置的连线的夹角，该θR为该球心位置与该音源位置映射在该水平面的位置的连线与该球心位置到该右耳位置的连线的夹角，该球体根据该四个扬声器的位置参数确定，该水平面为经过该左耳位置与该右耳位置的连线且平行于目标平面的平面，该目标平面为该四个扬声器所在的平面。
本申请提供的技术方案中，该预设频率为该人耳可听到的声音的频率。
803、该音频处理设备根据该四个扬声器的位置参数和该音源位置参数处理该目标双声道音频信号得到中间四声道音频信号。
该音频处理设备根据该音源位置参数与该四个扬声器的位置参数确定该四个扬声器中各扬声器的权重值；然后该音频处理设备根据该四个扬声器中第一扬声器和第二扬声器的第一权重值与该目标双声道音频信号的左声道音频信号计算得到左前方音频信号，根据该四个扬声器中第一扬声器和第二扬声器的第一权重值与该目标双声道音频信号的右声道音频信号计算得到右前方音频信号，根据该四个扬声器中第三扬声器和第四扬声器的第二权重值与该目标双声道音频信号的左声道音频信号计算得到左后方音频信号，根据该四个扬声器中第三扬声器和第四扬声器的第二权重值与该目标双声道音频信号的右声道音频信号计算得到右后方音频信号，其中，该左前方音频信号，该右前方音频信号，该左后方音频信号和该右后方音频信号为该中间四声道音频信号。同时，在上述方案中，该音频处理设备根据该四个扬声器的位置参数和该音源位置参数确定该四个扬声器中各扬声器的权重值可以采用如下方案：
如图7所示，该目标平面为该四个扬声器所处的平面；该第一夹角为该音源位置与中心位置映射在该目标平面的位置的连线与前平面的夹角(如图中的
Figure PCTCN2017095187-appb-000043
)，该第二夹角为该第一扬声器与该第四扬声器的连线与该前平面的夹角或者该第二夹角为该第二扬声器与该第三扬声器的连线与该前平面的夹角(如图中的
Figure PCTCN2017095187-appb-000044
)；
其中，该目标平面被该第一扬声器与该第四扬声器的连线和该第二扬声器与该第三扬声器的连线分成四个象限，该第一扬声器与该第二扬声器之间的象限为该第一象限，该第三扬声器与该第四扬声器之间的象限为该第二象限，该第一扬声器与该第三扬声器之间的象限以及该第二扬声器与该第四扬声器之间的象限为该第三象限。
若该音源位置参数指示该原始音频信号的音源位置位于目标平面内的第一象限内，则该音频处理设备确定该第一权重值为1，该第二权重值为0，该目标平面为该四个扬声器所在的平面；
若该音源位置参数指示该原始音频信号的音源位置位于该目标平面内的第二象限内，则该音频处理设备确定该第一权重值为0，该第二权重值为1；
若该音源位置参数指示该原始音频信号的音源位置的位于该目标平面内的第三象限内，则该音频处理设备根据第一夹角和第二夹角确定该第一权重值和该第二权重值，该第一夹角为该音源位置与中心位置映射在该目标平面的位置的连线与前平面的夹角，该第二夹角为该第一扬声器与该第四扬声器的连线与该前平面的夹角或者该第二夹角为该第二扬声器与该第三扬声器的连线与该前平面的夹角，该中心位置为该第二扬声器与该第三扬声器的连线与该第一扬声器与该第四扬声器的连线的交点，该前平面为通过该中心位置且垂直于该目标平面的平面；
在上述方案中，当该音源位置参数指示该原始音频信号的音源位置位于该第三象限时，该音频处理设备根据该第一夹角与该第二夹角利用第三公式计算该第一权重值和该第二权重值；
该第三公式包括：
Figure PCTCN2017095187-appb-000045
其中，该第三公式由如下公式推导得到：
Figure PCTCN2017095187-appb-000046
g1 2+g2 2＝1
其中，该
Figure PCTCN2017095187-appb-000047
为该第一夹角，该
Figure PCTCN2017095187-appb-000048
为该第二夹角，该g1为该第一权重值，该g2为该第二权重值。
基于上述方案，该音频处理设备根据该四个扬声器中第一扬声器和第二扬声器的第一权重值与该目标双声道音频信号的左声道音频信号计算得到左前方音频信号，根据该四个扬声器中第一扬声器和第二扬声器的第一权重值与该目标双声道音频信号的右声道音频信号计算得到右前方音频信号，根据该四个扬声器中第三扬声器和第四扬声器的第二权重值与该目标双声道音频信号的左声道音频信号计算得到左后方音频信号，根据该四个扬声器中第三扬声器和第四扬声器的第二权重值与该目标双声道音频信号的右声道音频信号计算得到右后方音频信号时可以利用第四公式进行计算；
其中，该第四公式包括：
Figure PCTCN2017095187-appb-000049
其中，该FL'为该左前方音频信号，该FR'为右前方音频信号，该BL'为该左后方音频信号，该BR'为该右后方音频信号，该L为该目标双声道音频信号中的左声道音频信号，该R为该目标双声道音频信号中的右声道音频信号，该g1为该第一权重值，该g2为该第二权重值。
804、该音频处理设备对该中间四声道音频信号进行近场补偿得到该四声道音频信号。
该音频处理设备根据该四个扬声器的位置参数获取该四个扬声器到左耳位置以及该四个扬声器到右耳位置的近场补偿响应，该左耳位置为该第一扬声器与该第三扬声器之间的位置，该右耳位置为该第二扬声器与的第四个扬声器的之间位置；该音频处理设备根据该中间四声道音频信号和该近声补偿响应的时域响应利用第五公式得到该四声道音频信号。其中，该第五公式为：
FL＝FL′*hFL；
FR＝FR′*hFR；
BL＝BL′*hBL；
BR＝BR′*hBR；
该FL为左前方音频信号，该FR为右前方音频信号，该BL为左后后音频信号，该BR为 右后方音频信号，该hFL为该第一扬声器到该左耳位置该近场补偿响应的时域响应，该hFR为该第二扬声器到该右耳位置该近场补偿响应的时域响应该hBL为该第三扬声器到该左耳位置该近场补偿响应的时域响应该hBR为该第四扬声器到该右耳位置该近场补偿响应的时域响应，该近场补偿响应的时域响应由该近场补偿响应的频域响应经变换得到。
该近声补偿响应表示为：
Figure PCTCN2017095187-appb-000050
其中，
Figure PCTCN2017095187-appb-000051
Figure PCTCN2017095187-appb-000052
Figure PCTCN2017095187-appb-000053
Figure PCTCN2017095187-appb-000054
由此推导得到该近场补偿响应的频域响应为：
Figure PCTCN2017095187-appb-000055
Figure PCTCN2017095187-appb-000056
Figure PCTCN2017095187-appb-000057
Figure PCTCN2017095187-appb-000058
其中，该EL(jw)为左耳位置听到的声音信号的傅里叶变换，该ER(jw)为右耳位置听到的声音信号的傅里叶变换，该XFL(jw)为该第一扬声器播放的声音的傅里叶变换，该XFR(jw)为该第二扬声器播放的声音的傅里叶变换，该XBL(jw)为该第三扬声器播放的声音的傅里叶变换，该XBR(jw)为该第四扬声器播放的声音的傅里叶变换，该GFL_L(jw)为该第一扬声器到该左耳位置的传递函数，该GFL_R(jw)为该第一扬声器到该右耳位置的传递函数，该GFR_L(jw)为该第二扬声器到该左耳位置的传递函数，该GFR_R(jw)为该第二扬声器到该右耳位置的传递函数，该GBL_L(jw)为该第三扬声器到该左耳位置的传递函数，该GBL_R(jw)为该第三扬声器到该右耳位置的传递函数，该GBR_L(jw)为该第四扬声器到该左耳位置的传递函数，该GBR_R(jw)为该第四扬声器到该右耳位置的传递函数。
805、该音频处理设备将该四声道音频信号发送给该四个扬声器进行播放。
该音频处理设备将该左前方音频信号发送给该第一扬声器，将该右前方音频信号发送 给该第一扬声器，将该左后方音频信号发送给该第三扬声器，将该右后方音频信号发送给该第四扬声器，然后各扬声器播放各自接收到的音频信号。
本实施例中，该音频处理设备在模拟该原始音频信号的音源位置的方位信息时，将该四个扬声器的位置参数同时进行考虑，并对该原始音频信号的音源位置的前后方位进行模拟，从而保证了该音频处理设备在确定该原始音频信号的音源位置的方位信息时更精确。同时，该音频处理设备对该四声道音频信号进行近场补偿从而保证该四声道音频信号音质更加完美，提高了用户的使用体验。
下面以一个实际应用场景对音频处理方法进行描述，具体如下：
通过四个扬声器耳机回放(高保真)环绕声Ambisonic音频作为示例，将Ambisonic B-format四声道数据解码到8个虚拟扬声器，即8个虚声源。其中该8个虚声源的位置示意图如图9所示，8个虚声源的放置在正立方体的8个顶点，边长为单位长度。每个虚声源的位置通过正立方体的几何关系可以求出。以其中一个虚声源(坐标{1，1，1})为例。其他的七个虚声源的处理方式与该坐标{1，1，1}的虚声源的处理方式相同。
该坐标{1，1，1}的虚声源的方位角和仰角可计算得到：
Figure PCTCN2017095187-appb-000059
Figure PCTCN2017095187-appb-000060
即为声源的位置信息。若该原始音频信号为一段如图10所示的音频信号，则将原始音频信号通过高通滤波模块和低通滤波模块之后得到如图11所示的该原始音频信号的高频分量和如图12所示该原始音频信号的低频分量。然后该音频处理设备根据声源的方位信息，提取对应的HRTF的高度特征，对原始音频信号的高频分量做处理，得到输出信号如图13；将图13所示输出信号通过刚球模型的处理，得到如图14所示的高频分量信号(即第二双声道音频信号)。同时将该低频部分通过公知HRTF库的对应角度处理，得到如图15所示的低频分量信号(即第一双声道音频信号)；然后将如图14所示的高频分量信号与如图15所示的低频分量信号进行叠加，得到经过方位渲染模块处理后如图16所示输出信号(即目标双声道音频信号)。然后将该如图16所示的目标双声道音频信号通过扬声器调度算法处理，由于方位角(Azimuth＝45度，Elevation＝45度)处于I象限，所以g1＝1,g2＝0。利用如下公式：
FL′＝L*g1
FR′＝R*g1
BL′＝L*g2
BR′＝R*g2
计算得到如图17所示的四声道音频信号(即该方位角情况下，仅用前置扬声器发声，后置扬声器输出为0)。然后当该音频处理设备对该四声道音频信号进行近场补偿时，该音 频处理设备获取到如图18所示的近场补偿滤波器的时域响应，然后将近场补偿滤波器的时域响应与对应的扬声器输出信号进行频域卷积得到该四个扬声器应播放的目标四声道音频信号。本实施例中，若该音频处理设备集成在VR眼镜上，在VR眼镜头动跟踪的应用场景下，基于传感器传递的当前听者的头部转动角度信息，对每帧音频输入对应的虚拟扬声器到听者的方位信息进行模拟。然后对相邻两帧做帧长的交叠平滑，如图19所示，来降低人头转动的过程中引起的帧间不连续的现象.
上面对本申请实施例中的音频处理方法进行了描述，下面对本申请实施例中的音频处理设备和VR眼镜进行描述。
具体请参阅图20，本申请实施例中的音频处理设备的一个实施例包括：
获取模块2001，用于获取原始音频信号，所述原始音频信号对应的音源位置参数以及四个扬声器的位置参数；
处理模块2002，用于根据所述音源位置参数处理所述原始音频信号得到目标双声道音频信号；根据所述四个扬声器的位置参数和所述音源位置参数处理所述目标双声道音频信号得到四声道音频信号，所述四声道音频信号与所述四个扬声器一一对应，所述四个扬声器用于播放所述四声道音频信号中对应的声道信号。
可选的，该处理模块2002，具体用于根据所述原始音频信号，得到所述原始音频信号对应的低频信号和所述原始音频信号对应的高频信号；
将所述低频信号与目标头相关传递函数HRTF进行卷积得到第一双声道音频信号，所述目标HRTF为所述音源位置参数对应的头相关传递函数HRTF；
获取所述音源位置参数中的高度参数对应的高度特征响应；
将所述高频信号与所述高度特征响应进行卷积得到目标音频信号；
将所述目标音频信号分别与音源位置至左耳位置的时域响应以及所述音源位置至右耳位置的时域响应进行卷积得到第二双声道音频信号，所述时域响应由所述音频处理设备根据所述音源位置利用刚球模型获得，所述左耳位置为位于第一扬声器与第三扬声器之间的位置，所述右耳位置为位于第二扬声器与第四扬声器之间的位置，所述音源位置根据所述音源位置参数确定，所述四个扬声器构成四边形，其中，所述第一扬声器与所述第四扬声器的连线为所述四边形的对角线，所述第二扬声器与所述第三扬声器的连线为所述四边形的对角线；
将所述第一双声道音频信号与所述第二双声道音频信号合并得到所述目标双声道音频信号。
可选的，所述高度参数包括用于指示所述音源位置相对于水平面的高度信息，所述水平面为经过所述左耳位置与所述右耳位置的连线且平行于目标平面的平面，所述目标平面为所述四个扬声器所在的平面，该处理模块2002，具体用于若所述音源位置参数指示所述音源位置位于所述四个扬声器中所述第一扬声器与所述第二扬声器的一侧，则根据第一公式计算所述高度特征响应；
若所述音源位置参数指示所述音源位置位于所述四个扬声器中所述第三扬声器与所述 第四扬声器的一侧，则根据第二公式计算所述高度特征响应；
其中，所述第一公式为：
Figure PCTCN2017095187-appb-000061
所述第二公式为：
Figure PCTCN2017095187-appb-000062
其中，所述θ为所述音源位置相对于所述水平面的高度信息，所述HF_elve为所述音源位置位于所述四个扬声器中所述第一扬声器与所述第二扬声器的一侧时所述音源位置对应的高度特征响应，所述HB_elve为所述音源位置位于所述四个扬声器中所述第三扬声器与所述第四扬声器的一侧时所述音源位置对应的高度特征响应，所述HRTF(θ,0)为仰角为θ，方位角为0度对应的HRTF数据，所述HRTF(0,0)为仰角为0度，方位角为0度对应的正前方HRTF数据，所述HRTF(θ,180)为仰角为θ，方位角为180度对应的HRTF数据，所述HRTF(0,180)为仰角为0度，方位角为180度对应的正后方HRTF数据。
可选的，所述时域响应由所述音源位置至所述左耳位置的频域响应以及所述音源位置至所述右耳位置的频域响应经变换得到，所述频域响应由所述音频处理设备根据所述音源位置利用所述刚球模型得到，其中所述刚球模型包括：
Figure PCTCN2017095187-appb-000063
其中，所述
Figure PCTCN2017095187-appb-000064
所述
Figure PCTCN2017095187-appb-000065
其中所述
Figure PCTCN2017095187-appb-000066
为所述音源位置至所述左耳位置的频域响应，所述
Figure PCTCN2017095187-appb-000067
为所述音源位置至所述右耳位置的频域响应，所述ρ为归一化的所述刚球模型对应的球心位置至所述音源位置的距离，所述r为所述球心位置到所述音源位置的距离，所述a为所述刚球模型对应的球体的半径，所述μ为归一化的角频率，所述f为预设频率，所述c为声音传播速度，所述θL为所述球心位置与所述音源位置映射在所述水平面的位置的连线与所述球心位置与所述左耳位置的连线的夹角，所述θR为所述球心位置与所述音源位置映射在所述水平面的位置的连线与所述球心位置到所述右耳位置的连线的夹角，所述球体根据所述四个扬声器的位置参数确定，所述水平面为经过所述左耳位置与所述右耳位置的连线且平行于目标平面的平面，所述目标平面为所述四个扬声器所在的平面。
可选的，所述四声道音频信号包括左前方音频信号，右前方音频信号，左后方音频信号和右后方音频信号，该处理模块2002，具体用于
根据所述音源位置参数和所述四个扬声器的位置参数确定所述四个扬声器中所述第一扬声器和所述第二扬声器的第一权重值以及所述四个扬声器中所述第三扬声器和第四扬声器的第二权重值；根据所述第一权重值与所述目标双声道音频信号中的左声道音频信号计算得到所述左前方音频信号，根据所述第一权重值与所述目标双声道音频信号中的右声道音频信号计算得到所述右前方音频信号，根据所述第二权重值与所述目标双声道音频信号中的左声道音频信号计算得到所述左后方音频信号，根据所述第二权重值与所述目标双声道音频信号中的右声道音频信号计算得到所述右后方音频信号。
可选的，该处理模块2002，具体用于
若所述音源位置参数指示所述原始音频信号的音源位置位于目标平面内的第一象限 内，则确定所述第一权重值为1，所述第二权重值为0，所述目标平面为所述四个扬声器所在的平面；
若所述音源位置参数指示所述原始音频信号的音源位置位于所述目标平面内的第二象限内，则确定所述第一权重值为0，所述第二权重值为1；
若所述音源位置参数指示所述原始音频信号的音源位置的位于所述目标平面内的第三象限内，则根据第一夹角和第二夹角确定所述第一权重值和所述第二权重值，所述第一夹角为所述音源位置与中心位置映射在所述目标平面的位置的连线与前平面的夹角，所述第二夹角为所述第一扬声器与所述第四扬声器的连线与所述前平面的夹角或者所述第二夹角为所述第二扬声器与所述第三扬声器的连线与所述前平面的夹角，所述中心位置为所述第二扬声器与所述第三扬声器的连线与所述第一扬声器与所述第四扬声器的连线的交点，所述前平面为通过所述中心位置且垂直于所述目标平面的平面；
其中，所述目标平面被所述第一扬声器与所述第四扬声器的连线和所述第二扬声器与所述第三扬声器的连线分成四个象限，所述第一扬声器与所述第二扬声器之间的象限为所述第一象限，所述第三扬声器与所述第四扬声器之间的象限为所述第二象限，所述第一扬声器与所述第三扬声器之间的象限以及所述第二扬声器与所述第四扬声器之间的象限为所述第三象限。
可选的，该处理模块2002，具体用于根据所述第一夹角和所述第二夹角利用第三公式计算位于所述第一权重值和所述第二权重值；
所述第三公式包括：
Figure PCTCN2017095187-appb-000068
其中，所述
Figure PCTCN2017095187-appb-000069
为所述第一夹角，所述
Figure PCTCN2017095187-appb-000070
为所述第二夹角，所述g1为所述第一权重值，所述g2为所述第二权重值。
可选的，该处理模块2002，用于根据所述第一权重值与所述目标双声道音频信号中的左声道音频信号利用第四公式计算得到所述左前方音频信号，根据所述第一权重值与所述目标双声道音频信号中的右声道音频信号利用所述第四公式计算得到所述右前方音频信号，根据所述第二权重值与所述目标双声道音频信号中的左声道音频信号利用所述第四公式计算得到所述左后方音频信号，根据所述第二权重值与所述目标双声道音频信号中的右声道音频信号利用所述第四公式计算得到所述右后方音频信号；
其中，所述第四公式包括：
Figure PCTCN2017095187-appb-000071
其中，所述FL'为所述左前方音频信号，所述FR'为右前方音频信号，所述BL'为所述左后方音频信号，所述BR'为所述右后方音频信号，所述L为所述目标双声道音频信号中的 左声道音频信号，所述R为所述目标双声道音频信号中的右声道音频信号，所述g1为所述第一权重值，所述g2为所述第二权重值。
可选的，该处理模块2002，用于根据所述四个扬声器的位置参数和所述音源位置参数处理所述目标双声道音频信号得到中间四声道音频信号；根据所述四个扬声器的位置参数获取所述四个扬声器到左耳位置以及右耳位置的近场补偿响应，所述左耳位置为所述第一扬声器与所述第三扬声器之间的位置，所述右耳位置为所述第二扬声器与所述第四扬声器之间的位置；
根据所述中间四声道音频信号和所述近场补偿响应的时域响应得到所述四声道音频信号。可选的，该处理模块2002，具体用于根据所述中间四声道音频信号和所述近场补偿响应的时域响应利用第五公式得到所述四声道音频信号；
所述第五公式为：
FL＝FL′*hFL；
FR＝FR′*hFR；
BL＝BL′*hBL；
BR＝BR′*hBR；
所述FL为左前方音频信号，所述FR为右前方音频信号，所述BL为左后后音频信号，所述BR为右后方音频信号，所述hFL为所述第一扬声器到所述左耳位置所述近场补偿响应的时域响应，所述hFR为所述第二扬声器到所述右耳位置所述近场补偿响应的时域响应，所述hBL为所述第三扬声器到所述左耳位置所述近场补偿响应的时域响应，所述hBR为所述第四扬声器到所述右耳位置所述近场补偿响应的时域响应。
可选的，所述四个扬声器构成四边形，其中，第一扬声器位于第四扬声器的对侧，第二扬声器位于第三扬声器的对侧，所述四个扬声器的位置参数包括所述第一扬声器的出声口正对所述左耳位置的耳道，所述第一扬声器与所述左耳位置的耳道的水平距离为第一预设值，所述第一扬声器与所述左耳位置的耳道垂直距离为第二预设值；
所述第二扬声器的出声口正对所述右耳位置的耳道，所述第二扬声器与所述右耳位置的耳道的水平距离为所述第一预设值，所述第二扬声器与所述右耳位置的耳道垂直距离为所述第二预设值；
所述第三扬声器的出声口正对所述左耳位置的耳道，所述第三扬声器与所述左耳位置的耳道的水平距离为所述第一预设值，所述第三扬声器与所述左耳位置的耳道垂直距离为所述第二预设值；
所述第四个扬声器的出声口正对所述右耳位置的耳道，所述第四个扬声器与所述右耳位置的耳道的水平距离为所述第一预设值，所述第四个扬声器与所述右耳位置的耳道垂直距离为所述第二预设值。
可选的，该第一预设值大于或等于1厘米且小于或等于5厘米；该第二预设值大于或等于0.5厘米且小于或等于1厘米。
本实施例中，该处理模块2002在模拟该原始音频信号的音源位置的方位信息时，将该四个扬声器的位置参数同时进行考虑，并对该原始音频信号的音源位置的前后方位进行模 拟，从而保证了该音频处理设备在确定该原始音频信号的音源位置的方位信息时更精确。
具体请参阅图21，本申请实施例中音频处理设备的另一个实施例包括：
收发器2101，处理器2102，总线2103；
该收发器2101与该处理器2102通过该总线2103相连；
该总线2103可以是外设部件互连标准(peripheral component interconnect，简称PCI)总线或扩展工业标准结构(extended industry standard architecture，简称EISA)总线等。该总线可以分为地址总线、数据总线、控制总线等。为便于表示，图21中仅用一条粗线表示，但并不表示仅有一根总线或一种类型的总线。
处理器2102可以是中央处理器(central processing unit，简称CPU)，网络处理器(network processor，简称NP)或者CPU和NP的组合。
处理器2102还可以进一步包括硬件芯片。上述硬件芯片可以是专用集成电路(application-specific integrated circuit，简称ASIC)，可编程逻辑器件(programmable logic device，简称PLD)或其组合。上述PLD可以是复杂可编程逻辑器件(complex programmable logic device，简称CPLD)，现场可编程逻辑门阵列(field-programmable gate array，简称FPGA)，通用阵列逻辑(generic array logic,简称GAL)或其任意组合。
参见图21所示，该音频处理设备还可以包括存储器2104。该存储器2104可以包括易失性存储器(volatile memory)，例如随机存取存储器(random-access memory，简称RAM)；存储器也可以包括非易失性存储器(non-volatile memory)，例如快闪存储器(flash memory)，硬盘(hard disk drive，简称HDD)或固态硬盘(solid-state drive，简称SSD)；存储器2104还可以包括上述种类的存储器的组合。
可选地，存储器2104还可以用于存储程序指令，处理器2102调用该存储器2104中存储的程序指令，可以执行图2至图8中所示实施例中的一个或多个步骤，或其中可选的实施方式，实现上述方法中音频处理设备行为的功能。
该收发器，执行如下步骤：
获取原始音频信号；
该处理器，执行如下步骤：
获取所述原始音频信号对应的音源位置参数以及四个扬声器的位置参数根据所述音源位置参数处理所述原始音频信号得到目标双声道音频信号；根据所述四个扬声器的位置参数和所述音源位置参数处理所述目标双声道音频信号得到四声道音频信号，所述四声道音频信号与所述四个扬声器一一对应，所述四个扬声器用于播放所述四声道音频信号中对应的声道信号。
可选的，该处理器2102，具体用于根据所述原始音频信号，得到所述原始音频信号对应的低频信号和所述原始音频信号对应的高频信号；
将所述低频信号与目标头相关传递函数HRTF进行卷积得到第一双声道音频信号，所述目标HRTF为所述音源位置参数对应的头相关传递函数HRTF；
获取所述音源位置参数中的高度参数对应的高度特征响应；
将所述高频信号与所述高度特征响应进行卷积得到目标音频信号；
将所述目标音频信号分别与音源位置至左耳位置的时域响应以及所述音源位置至右耳位置的时域响应进行卷积得到第二双声道音频信号，所述时域响应由所述音频处理设备根据所述音源位置利用刚球模型获得，所述左耳位置为位于第一扬声器与第三扬声器之间的位置，所述右耳位置为位于第二扬声器与第四扬声器之间的位置，所述音源位置根据所述音源位置参数确定，所述四个扬声器构成四边形，其中，所述第一扬声器与所述第四扬声器的连线为所述四边形的对角线，所述第二扬声器与所述第三扬声器的连线为所述四边形的对角线；
将所述第一双声道音频信号与所述第二双声道音频信号合并得到所述目标双声道音频信号。
可选的，所述高度参数包括用于指示所述音源位置相对于水平面的高度信息，所述水平面为经过所述左耳位置与所述右耳位置的连线且平行于目标平面的平面，所述目标平面为所述四个扬声器所在的平面，该处理器2102，具体用于若所述音源位置参数指示所述音源位置位于所述四个扬声器中所述第一扬声器与所述第二扬声器的一侧，则根据第一公式计算所述高度特征响应；
若所述音源位置参数指示所述音源位置位于所述四个扬声器中所述第三扬声器与所述第四扬声器的一侧，则根据第二公式计算所述高度特征响应；
其中，所述第一公式为：
Figure PCTCN2017095187-appb-000072
所述第二公式为：
Figure PCTCN2017095187-appb-000073
其中，所述θ为所述音源位置相对于所述水平面的高度信息，所述HF_elve为所述音源位置位于所述四个扬声器中所述第一扬声器与所述第二扬声器的一侧时所述音源位置对应的高度特征响应，所述HB_elve为所述音源位置位于所述四个扬声器中所述第三扬声器与所述第四扬声器的一侧时所述音源位置对应的高度特征响应，所述HRTF(θ,0)为仰角为θ，方位角为0度对应的HRTF数据，所述HRTF(0,0)为仰角为0度，方位角为0度对应的正前方HRTF数据，所述HRTF(θ,180)为仰角为θ，方位角为180度对应的HRTF数据，所述HRTF(0,180)为仰角为0度，方位角为180度对应的正后方HRTF数据。可选的，
所述时域响应由所述音源位置至所述左耳位置的频域响应以及所述音源位置至所述右耳位置的频域响应经变换得到，所述频域响应由所述音频处理设备根据所述音源位置利用所述刚球模型得到，其中所述刚球模型包括：
其中，所述
Figure PCTCN2017095187-appb-000075
所述
Figure PCTCN2017095187-appb-000076
其中所述
Figure PCTCN2017095187-appb-000077
为所述音源位置至所述左耳位置的频域响应，所述
Figure PCTCN2017095187-appb-000078
为所述音源位置至所述右耳位置的频域响应，所述ρ为归一化的所述刚球模型对应的球心位置至所述音源位置的距离，所述r为所述球心位置到所述音源位置的距离，所述a为所述刚球模型对 应的球体的半径，所述μ为归一化的角频率，所述f为预设频率，所述c为声音传播速度，所述θL为所述球心位置与所述音源位置映射在所述水平面的位置的连线与所述球心位置与所述左耳位置的连线的夹角，所述θR为所述球心位置与所述音源位置映射在所述水平面的位置的连线与所述球心位置到所述右耳位置的连线的夹角，所述球体根据所述四个扬声器的位置参数确定，所述水平面为经过所述左耳位置与所述右耳位置的连线且平行于目标平面的平面，所述目标平面为所述四个扬声器所在的平面。
可选的，所述四声道音频信号包括左前方音频信号，右前方音频信号，左后方音频信号和右后方音频信号，该处理器2102，具体用于根据所述音源位置参数和所述四个扬声器的位置参数确定所述四个扬声器中所述第一扬声器和所述第二扬声器的第一权重值以及所述四个扬声器中所述第三扬声器和第四扬声器的第二权重值；根据所述第一权重值与所述目标双声道音频信号中的左声道音频信号计算得到所述左前方音频信号，根据所述第一权重值与所述目标双声道音频信号中的右声道音频信号计算得到所述右前方音频信号，根据所述第二权重值与所述目标双声道音频信号中的左声道音频信号计算得到所述左后方音频信号，根据所述第二权重值与所述目标双声道音频信号中的右声道音频信号计算得到所述右后方音频信号。
可选的，该处理器2102，具体用于若所述音源位置参数指示所述原始音频信号的音源位置位于目标平面内的第一象限内，则确定所述第一权重值为1，所述第二权重值为0，所述目标平面为所述四个扬声器所在的平面；
若所述音源位置参数指示所述原始音频信号的音源位置位于所述目标平面内的第二象限内，则确定所述第一权重值为0，所述第二权重值为1；
若所述音源位置参数指示所述原始音频信号的音源位置的位于所述目标平面内的第三象限内，则根据第一夹角和第二夹角确定所述第一权重值和所述第二权重值，所述第一夹角为所述音源位置与中心位置映射在所述目标平面的位置的连线与前平面的夹角，所述第二夹角为所述第一扬声器与所述第四扬声器的连线与所述前平面的夹角或者所述第二夹角为所述第二扬声器与所述第三扬声器的连线与所述前平面的夹角，所述中心位置为所述第二扬声器与所述第三扬声器的连线与所述第一扬声器与所述第四扬声器的连线的交点，所述前平面为通过所述中心位置且垂直于所述目标平面的平面；
其中，所述目标平面被所述第一扬声器与所述第四扬声器的连线和所述第二扬声器与所述第三扬声器的连线分成四个象限，所述第一扬声器与所述第二扬声器之间的象限为所述第一象限，所述第三扬声器与所述第四扬声器之间的象限为所述第二象限，所述第一扬声器与所述第三扬声器之间的象限以及所述第二扬声器与所述第四扬声器之间的象限为所述第三象限。
可选的，该处理器2102，具体用于根据所述第一夹角和所述第二夹角利用第三公式计算位于所述第一权重值和所述第二权重值；
所述第三公式包括：
Figure PCTCN2017095187-appb-000079
其中，所述
Figure PCTCN2017095187-appb-000080
为所述第一夹角，所述
Figure PCTCN2017095187-appb-000081
为所述第二夹角，所述g1为所述第一权重值，所述g2为所述第二权重值。
可选的，该处理器2102，用于根据所述第一权重值与所述目标双声道音频信号中的左声道音频信号利用第四公式计算得到所述左前方音频信号，根据所述第一权重值与所述目标双声道音频信号中的右声道音频信号利用所述第四公式计算得到所述右前方音频信号，根据所述第二权重值与所述目标双声道音频信号中的左声道音频信号利用所述第四公式计算得到所述左后方音频信号，根据所述第二权重值与所述目标双声道音频信号中的右声道音频信号利用所述第四公式计算得到所述右后方音频信号；
其中，所述第四公式包括：
Figure PCTCN2017095187-appb-000082
其中，所述FL'为所述左前方音频信号，所述FR'为右前方音频信号，所述BL'为所述左后方音频信号，所述BR'为所述右后方音频信号，所述L为所述目标双声道音频信号中的左声道音频信号，所述R为所述目标双声道音频信号中的右声道音频信号，所述g1为所述第一权重值，所述g2为所述第二权重值。
可选的，该处理器2102，用于根据所述四个扬声器的位置参数和所述音源位置参数处理所述目标双声道音频信号得到中间四声道音频信号；根据所述四个扬声器的位置参数获取所述四个扬声器到左耳位置以及右耳位置的近场补偿响应，所述左耳位置为所述第一扬声器与所述第三扬声器之间的位置，所述右耳位置为所述第二扬声器与所述第四扬声器之间的位置；
根据所述中间四声道音频信号和所述近场补偿响应的时域响应得到所述四声道音频信号。可选的，该处理器2102，具体用于根据所述中间四声道音频信号和所述近场补偿响应的时域响应利用第五公式得到所述四声道音频信号；
所述第五公式为：
FL＝FL′*hFL；
FR＝FR′*hFR；
BL＝BL′*hBL；
BR＝BR′*hBR；
所述FL为左前方音频信号，所述FR为右前方音频信号，所述BL为左后后音频信号，所述BR为右后方音频信号，所述hFL为所述第一扬声器到所述左耳位置所述近场补偿响应的时域响应，所述hFR为所述第二扬声器到所述右耳位置所述近场补偿响应的时域响应，所述hBL为所述第三扬声器到所述左耳位置所述近场补偿响应的时域响应，所述hBR为所述第四扬声器到所述右耳位置所述近场补偿响应的时域响应。
可选的，所述四个扬声器构成四边形，其中，第一扬声器位于第四扬声器的对侧，第 二扬声器位于第三扬声器的对侧，所述四个扬声器的位置参数包括所述第一扬声器的出声口正对所述左耳位置的耳道，所述第一扬声器与所述左耳位置的耳道的水平距离为第一预设值，所述第一扬声器与所述左耳位置的耳道垂直距离为第二预设值；
所述第二扬声器的出声口正对所述右耳位置的耳道，所述第二扬声器与所述右耳位置的耳道的水平距离为所述第一预设值，所述第二扬声器与所述右耳位置的耳道垂直距离为所述第二预设值；
所述第三扬声器的出声口正对所述左耳位置的耳道，所述第三扬声器与所述左耳位置的耳道的水平距离为所述第一预设值，所述第三扬声器与所述左耳位置的耳道垂直距离为所述第二预设值；
所述第四个扬声器的出声口正对所述右耳位置的耳道，所述第四个扬声器与所述右耳位置的耳道的水平距离为所述第一预设值，所述第四个扬声器与所述右耳位置的耳道垂直距离为所述第二预设值。
可选的，该第一预设值大于或等于1厘米且小于或等于5厘米；该第二预设值大于或等于0.5厘米且小于或等于1厘米。本实施例中，该处理器2102在模拟该原始音频信号的音源位置的方位信息时，将该四个扬声器的位置参数同时进行考虑，并对该原始音频信号的音源位置的前后方位进行模拟，从而保证了该音频处理设备在确定该原始音频信号的音源位置的方位信息时更精确。
具体请参阅图22，本申请实施例中VR眼镜的一个实施例包括：
该四个扬声器2201，和该音频处理设备2202；
该四个扬声器2201与该音频处理设备2202相连；
该四个扬声器2201分布在该VR眼镜上的两个眼镜架上，其中，该四个扬声器的位置分布还满足如下规则：
所述四个扬声器构成四边形，其中，第一扬声器位于第四扬声器的对侧，第二扬声器位于第三扬声器的对侧，该四个扬声器中的第一扬声器位于该四个扬声器所处平面的左前方，该第一扬声器的出声口正对该左耳位置的耳道，该第一扬声器与该左耳位置的耳道的水平距离为第一预设值，该第一扬声器与该左耳位置的耳道垂直距离为第二预设值；
该四个扬声器中的第二扬声器位于该四个扬声器所处平面的右前方，该第二扬声器的出声口正对该右耳位置的耳道，该第二扬声器与该右耳位置的耳道的水平距离为该第一预设值，该第二扬声器与该右耳位置的耳道垂直距离为该第二预设值；
该四个扬声器中的第三扬声器位于该四个扬声器所处平面的左后方，该第三扬声器的出声口正对该左耳位置的耳道，该第三扬声器与该左耳位置的耳道的水平距离为该第一预设值，该第三扬声器与该左耳位置的耳道垂直距离为该第二预设值；
该四个扬声器中的第四扬声器位于该四个扬声器所处平面的右后方，该第四扬声器的出声口正对该右耳位置的耳道，该第四扬声器与该右耳位置的耳道的水平距离为该第一预设值，该第四扬声器与该右耳位置的耳道垂直距离为该第二预设值。
其中，该第一预设值大于或等于1厘米且小于或等于5厘米；该第二预设值大于或等于0.5厘米且小于或等于1厘米。
本实施例中，该VR眼镜还包括其他部分，此处不做赘述。
该音频处理设备2202具备上述实施例中音频处理设备的全部功能。
本实施例中，该四个扬声器2201与该音频处理设备2202还可以包含于其他可能的设备上，比如增强现实(augmented reality，AR)眼镜或者其他可穿戴设备。具体此处不做限定。
本实施例中，该音频处理设备2202在模拟该原始音频信号的音源位置的方位信息时，将该四个扬声器2201的位置参数同时进行考虑，并对该原始音频信号的音源位置的前后方位进行模拟，从而保证了该音频处理设备在确定该原始音频信号的音源位置的方位信息时更精确。同时将该四个扬声器与该音频处理设备集成在VR眼镜上可以提高用户的使用体验。
所属领域的技术人员可以清楚地了解到，为描述的方便和简洁，上述描述的系统，装置和单元的具体工作过程，可以参考前述方法实施例中的对应过程，在此不再赘述。
在本申请所提供的几个实施例中，应该理解到，所揭露的系统，装置和方法，可以通过其它的方式实现。例如，以上所描述的装置实施例仅仅是示意性的，例如，所述单元的划分，仅仅为一种逻辑功能划分，实际实现时可以有另外的划分方式，例如多个单元或组件可以结合或者可以集成到另一个系统，或一些特征可以忽略，或不执行。另一点，所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口，装置或单元的间接耦合或通信连接，可以是电性，机械或其它的形式。
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的，作为单元显示的部件可以是或者也可以不是物理单元，即可以位于一个地方，或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。
另外，在本申请各个实施例中的各功能单元可以集成在一个处理单元中，也可以是各个单元单独物理存在，也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现，也可以采用软件功能单元的形式实现。
所述集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时，可以存储在一个计算机可读取存储介质中。基于这样的理解，本申请的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来，该计算机软件产品存储在一个存储介质中，包括若干指令用以使得一台计算机设备(可以是个人计算机，服务器，或者网络设备等)执行本申请各个实施例所述方法的全部或部分步骤。而前述的存储介质包括：U盘、移动硬盘、只读存储器(ROM，Read-Only Memory)、随机存取存储器(RAM，Random Access Memory)、磁碟或者光盘等各种可以存储程序代码的介质。
以上所述，以上实施例仅用以说明本申请的技术方案，而非对其限制；尽管参照前述实施例对本申请进行了详细的说明，本领域的普通技术人员应当理解：其依然可以对前述各实施例所记载的技术方案进行修改，或者对其中部分技术特征进行等同替换；而这些修改或者替换，并不使相应技术方案的本质脱离本申请各实施例技术方案的精神和范围。

Claims (26)

  1. 一种音频处理方法，其特征在于，包括：
    音频处理设备获取原始音频信号，所述原始音频信号对应的音源位置参数以及四个扬声器的位置参数；
    所述音频处理设备根据所述音源位置参数处理所述原始音频信号得到目标双声道音频信号；
    所述音频处理设备根据所述四个扬声器的位置参数和所述音源位置参数处理所述目标双声道音频信号得到四声道音频信号，所述四声道音频信号与所述四个扬声器一一对应，所述四个扬声器用于播放所述四声道音频信号中对应的声道信号。
  2. 根据权利要求1所述的方法，其特征在于，所述音频处理设备根据所述音源位置参数处理所述原始音频信号得到目标双声道音频信号包括：
    所述音频处理设备根据所述原始音频信号，得到所述原始音频信号对应的低频信号和所述原始音频信号对应的高频信号；
    所述音频处理设备将所述低频信号与目标头相关传递函数HRTF进行卷积得到第一双声道音频信号，所述目标HRTF为所述音源位置参数对应的头相关传递函数HRTF；
    所述音频处理设备获取所述音源位置参数中的高度参数对应的高度特征响应；
    所述音频处理设备将所述高频信号与所述高度特征响应进行卷积得到目标音频信号；
    所述音频处理设备将所述目标音频信号分别与音源位置至左耳位置的时域响应以及所述音源位置至右耳位置的时域响应进行卷积得到第二双声道音频信号，所述时域响应由所述音频处理设备根据所述音源位置利用刚球模型获得，所述左耳位置为位于第一扬声器与第三扬声器之间的位置，所述右耳位置为位于第二扬声器与第四扬声器之间的位置，所述音源位置根据所述音源位置参数确定，所述四个扬声器构成四边形，其中，所述第一扬声器与所述第四扬声器的连线为所述四边形的对角线，所述第二扬声器与所述第三扬声器的连线为所述四边形的对角线；
    所述音频处理设备将所述第一双声道音频信号与所述第二双声道音频信号合并得到所述目标双声道音频信号。
  3. 根据权利要求2所述的方法，其特征在于，所述高度参数包括用于指示所述音源位置相对于水平面的高度信息，所述水平面为经过所述左耳位置与所述右耳位置的连线且平行于目标平面的平面，所述目标平面为所述四个扬声器所在的平面，所述音频处理设备获取所述音源位置参数中的高度参数对应的高度特征响应包括：
    若所述音源位置参数指示所述音源位置位于所述四个扬声器中所述第一扬声器与所述第二扬声器的一侧，则所述音频处理设备根据第一公式计算所述高度特征响应；
    若所述音源位置参数指示所述音源位置位于所述四个扬声器中所述第三扬声器与所述第四扬声器的另一侧，则所述音频处理设备根据第二公式计算所述高度特征响应；
    其中，所述第一公式为：
    Figure PCTCN2017095187-appb-100001
    所述第二公式为：
    Figure PCTCN2017095187-appb-100002
    其中，所述θ为所述音源位置相对于所述水平面的高度信息，所述HF_elve为所述音源位置位于所述四个扬声器中所述第一扬声器与所述第二扬声器的一侧时所述音源位置对应的高度特征响应，所述HB_elve为所述音源位置位于所述四个扬声器中所述第三扬声器与所述第四扬声器的一侧时所述音源位置对应的高度特征响应，所述HRTF(θ,0)为仰角为θ，方位角为0度对应的HRTF数据，所述HRTF(0,0)为仰角为0度，方位角为0度对应的正前方HRTF数据，所述HRTF(θ,180)为仰角为θ，方位角为180度对应的HRTF数据，所述HRTF(0,180)为仰角为0度，方位角为180度对应的正后方HRTF数据。
  4. 根据权利要求2或3所述的方法，其特征在于，所述时域响应由所述音频处理设备根据所述音源位置利用刚球模型获得包括：
    所述时域响应由所述音源位置至所述左耳位置的频域响应以及所述音源位置至所述右耳位置的频域响应经变换得到，所述频域响应由所述音频处理设备根据所述音源位置利用所述刚球模型得到，其中所述刚球模型包括：
    Figure PCTCN2017095187-appb-100003
    其中，所述
    Figure PCTCN2017095187-appb-100004
    所述
    Figure PCTCN2017095187-appb-100005
    其中所述
    Figure PCTCN2017095187-appb-100006
    为所述音源位置至所述左耳位置的频域响应，所述
    Figure PCTCN2017095187-appb-100007
    为所述音源位置至所述右耳位置的频域响应，所述ρ为归一化的所述刚球模型对应的球心位置至所述音源位置的距离，所述r为所述球心位置到所述音源位置的距离，所述a为所述刚球模型对应的球体的半径，所述μ为归一化的角频率，所述f为预设频率，所述c为声音传播速度，所述θL为所述球心位置与所述音源位置映射在所述水平面的位置的连线与所述球心位置与所述左耳位置的连线的夹角，所述θR为所述球心位置与所述音源位置映射在所述水平面的位置的连线与所述球心位置到所述右耳位置的连线的夹角，所述球体根据所述四个扬声器的位置参数确定，所述水平面为经过所述左耳位置与所述右耳位置的连线且平行于目标平面的平面，所述目标平面为所述四个扬声器所在的平面。
  5. 根据权利要求1至4中任一项所述的方法，其特征在于，所述四声道音频信号包括左前方音频信号，右前方音频信号，左后方音频信号和右后方音频信号，所述音频处理设备根据所述四个扬声器的位置参数和所述音源位置参数处理所述目标双声道音频信号得到用于四声道音频信号包括：
    所述音频处理设备根据所述音源位置参数和所述四个扬声器的位置参数确定所述四个扬声器中所述第一扬声器和所述第二扬声器的第一权重值以及所述四个扬声器中所述第三扬声器和第四扬声器的第二权重值；所述音频处理设备根据所述第一权重值与所述目标双声道音频信号中的左声道音频信号计算得到所述左前方音频信号，根据所述第一权重值与所述目标双声道音频信号中的右声道音频信号计算得到所述右前方音频信号，根据所述第二权重值与所述目标双声道音频信号中的左声道音频信号计算得到所述左后方音频信号，根据所述第二权重值与所述目标双声道音频信号中的右声道音频信号计算得到所述右后方音频信号。
  6. 根据权利要求5所述的方法，其特征在于，所述音频处理设备根据所述音源位置参 数和所述四个扬声器的位置参数确定所述四个扬声器中所述第一扬声器和所述第二扬声器的第一权重值以及所述四个扬声器中所述第三扬声器和第四扬声器的第二权重值包括：
    若所述音源位置参数指示所述原始音频信号的音源位置位于目标平面内的第一象限内，则所述音频处理设备确定所述第一权重值为1，所述第二权重值为0，所述目标平面为所述四个扬声器所在的平面；
    若所述音源位置参数指示所述原始音频信号的音源位置位于所述目标平面内的第二象限内，则所述音频处理设备确定所述第一权重值为0，所述第二权重值为1；
    若所述音源位置参数指示所述原始音频信号的音源位置的位于所述目标平面内的第三象限内，则所述音频处理设备根据第一夹角和第二夹角确定所述第一权重值和所述第二权重值，所述第一夹角为所述音源位置与中心位置映射在所述目标平面的位置的连线与前平面的夹角，所述第二夹角为所述第一扬声器与所述第四扬声器的连线与所述前平面的夹角或者所述第二夹角为所述第二扬声器与所述第三扬声器的连线与所述前平面的夹角，所述中心位置为所述第二扬声器与所述第三扬声器的连线与所述第一扬声器与所述第四扬声器的连线的交点，所述前平面为通过所述中心位置且垂直于所述目标平面的平面；
    其中，所述目标平面被所述第一扬声器与所述第四扬声器的连线和所述第二扬声器与所述第三扬声器的连线分成四个象限，所述第一扬声器与所述第二扬声器之间的象限为所述第一象限，所述第三扬声器与所述第四扬声器之间的象限为所述第二象限，所述第一扬声器与所述第三扬声器之间的象限以及所述第二扬声器与所述第四扬声器之间的象限为所述第三象限。
  7. 根据权利要求6所述的方法，其特征在于，所述音频处理设备根据第一夹角和第二夹角确定所述第一权重值和所述第二权重值包括：
    所述音频处理设备根据所述第一夹角和所述第二夹角利用第三公式计算所述第一权重值和所述第二权重值；
    所述第三公式包括：
    Figure PCTCN2017095187-appb-100008
    其中，所述
    Figure PCTCN2017095187-appb-100009
    为所述第一夹角，所述
    Figure PCTCN2017095187-appb-100010
    为所述第二夹角，所述g1为所述第一权重值，所述g2为所述第二权重值。
  8. 根据权利要求5所述的方法，其特征在于，所述音频处理设备根据所述第一权重值与所述目标双声道音频信号中的左声道音频信号计算得到所述左前方音频信号，根据所述第一权重值与所述目标双声道音频信号中的右声道音频信号计算得到所述右前方音频信号，根据所述第二权重值与所述目标双声道音频信号中的左声道音频信号计算得到所述左后方音频信号，根据所述第二权重值与所述目标双声道音频信号中的右声道音频信号计算得到所述右后方音频信号包括：
    所述音频处理设备根据所述第一权重值与所述目标双声道音频信号中的左声道音频信号利用第四公式计算得到所述左前方音频信号，根据所述第一权重值与所述目标双声道音频信号中的右声道音频信号利用所述第四公式计算得到所述右前方音频信号，根据所述第 二权重值与所述目标双声道音频信号中的左声道音频信号利用所述第四公式计算得到所述左后方音频信号，根据所述第二权重值与所述目标双声道音频信号中的右声道音频信号利用所述第四公式计算得到所述右后方音频信号；
    其中，所述第四公式包括：
    Figure PCTCN2017095187-appb-100011
    其中，所述FL'为所述左前方音频信号，所述FR'为右前方音频信号，所述BL'为所述左后方音频信号，所述BR'为所述右后方音频信号，所述L为所述目标双声道音频信号中的左声道音频信号，所述R为所述目标双声道音频信号中的右声道音频信号，所述g1为所述第一权重值，所述g2为所述第二权重值。
  9. 根据权利要求1至4任一项所述的方法，其特征在于，所述音频处理设备根据所述四个扬声器的位置参数和所述音源位置参数处理所述目标双声道音频信号得到四声道音频信号包括：
    所述音频处理设备根据所述四个扬声器的位置参数和所述音源位置参数处理所述目标双声道音频信号得到中间四声道音频信号；
    所述音频处理设备根据所述四个扬声器的位置参数获取所述四个扬声器到左耳位置以及右耳位置的近场补偿响应，所述左耳位置为所述第一扬声器与所述第三扬声器之间的位置，所述右耳位置为所述第二扬声器与所述第四扬声器之间的位置；
    所述音频处理设备根据所述中间四声道音频信号和所述近场补偿响应的时域响应得到所述四声道音频信号。
  10. 根据权利要求9所述的方法，其特征在于，所述音频处理设备根据所述中间四声道音频信号和所述近场补偿响应的时域响应得到所述四声道音频信号包括：
    所述音频处理设备根据所述中间四声道音频信号和所述近场补偿响应的时域响应利用第五公式得到所述四声道音频信号；
    所述第五公式为：
    FL＝FL′*hFL；
    FR＝FR′*hFR；
    BL＝BL′*hBL；
    BR＝BR′*hBR；
    所述FL为左前方音频信号，所述FR为右前方音频信号，所述BL为左后后音频信号，所述BR为右后方音频信号，所述hFL为所述第一扬声器到所述左耳位置所述近场补偿响应的时域响应，所述hFR为所述第二扬声器到所述右耳位置所述近场补偿响应的时域响应，所述hBL为所述第三扬声器到所述左耳位置所述近场补偿响应的时域响应，所述hBR为所述第四扬声器到所述右耳位置所述近场补偿响应的时域响应。
  11. 根据权利要求1至10中任一项所述的方法，其特征在于，所述四个扬声器构成四 边形，其中，第一扬声器位于第四扬声器的对侧，第二扬声器位于第三扬声器的对侧，所述四个扬声器的位置参数包括所述第一扬声器的出声口正对所述左耳位置的耳道，所述第一扬声器与所述左耳位置的耳道的水平距离为第一预设值，所述第一扬声器与所述左耳位置的耳道垂直距离为第二预设值；
    所述第二扬声器的出声口正对所述右耳位置的耳道，所述第二扬声器与所述右耳位置的耳道的水平距离为所述第一预设值，所述第二扬声器与所述右耳位置的耳道垂直距离为所述第二预设值；
    所述第三扬声器的出声口正对所述左耳位置的耳道，所述第三扬声器与所述左耳位置的耳道的水平距离为所述第一预设值，所述第三扬声器与所述左耳位置的耳道垂直距离为所述第二预设值；
    所述第四扬声器的出声口正对所述右耳位置的耳道，所述第四扬声器与所述右耳位置的耳道的水平距离为所述第一预设值，所述第四扬声器与所述右耳位置的耳道垂直距离为所述第二预设值。
  12. 根据权利要求10所述的方法，其特征在于，所述第一预设值大于或等于1厘米且小于或等于5厘米；所述第二预设值大于或等于0.5厘米且小于或等于1厘米。
  13. 一种音频处理设备，其特征在于，包括：
    获取模块，用于获取原始音频信号，所述原始音频信号对应的音源位置参数以及四个扬声器的位置参数；
    处理模块，用于根据所述音源位置参数处理所述原始音频信号得到目标双声道音频信号；根据所述四个扬声器的位置参数和所述音源位置参数处理所述目标双声道音频信号得到四声道音频信号，所述四声道音频信号与所述四个扬声器一一对应，所述四个扬声器用于播放所述四声道音频信号中对应的声道信号。
  14. 根据权利要求13所述的音频处理设备，其特征在于，所述处理模块，具体用于根据所述原始音频信号，得到所述原始音频信号对应的低频信号和所述原始音频信号对应的高频信号；
    将所述低频信号与目标头相关传递函数HRTF进行卷积得到第一双声道音频信号，所述目标HRTF为所述音源位置参数对应的头相关传递函数HRTF；
    获取所述音源位置参数中的高度参数对应的高度特征响应；
    将所述高频信号与所述高度特征响应进行卷积得到目标音频信号；
    将所述目标音频信号分别与音源位置至左耳位置的时域响应以及所述音源位置至右耳位置的时域响应进行卷积得到第二双声道音频信号，所述时域响应由所述音频处理设备根据所述音源位置利用刚球模型获得，所述左耳位置为位于第一扬声器与第三扬声器之间的位置，所述右耳位置为位于第二扬声器与第四扬声器之间的位置，所述音源位置根据所述音源位置参数确定，所述四个扬声器构成四边形，其中，所述第一扬声器与所述第四扬声器的连线为所述四边形的对角线，所述第二扬声器与所述第三扬声器的连线为所述四边形的对角线；
    将所述第一双声道音频信号与所述第二双声道音频信号合并得到所述目标双声道音频 信号。
  15. 根据权利要求14所述的音频处理设备，其特征在于，所述高度参数包括用于指示所述音源位置相对于水平面的高度信息，所述水平面为经过所述左耳位置与所述右耳位置的连线且平行于目标平面的平面，所述目标平面为所述四个扬声器所在的平面，所述处理模块，具体用于若所述音源位置参数指示所述音源位置位于所述四个扬声器中所述第一扬声器与所述第二扬声器的一侧，则根据第一公式计算所述高度特征响应；
    若所述音源位置参数指示所述音源位置位于所述四个扬声器中所述第三扬声器与所述第四扬声器的一侧，则根据第二公式计算所述高度特征响应；
    其中，所述第一公式为：
    Figure PCTCN2017095187-appb-100012
    所述第二公式为：
    Figure PCTCN2017095187-appb-100013
    其中，所述θ为所述音源位置相对于所述水平面的高度信息，所述HF_elve为所述音源位置位于所述四个扬声器中所述第一扬声器与所述第二扬声器的一侧时所述音源位置对应的高度特征响应，所述HB_elve为所述音源位置位于所述四个扬声器中所述第三扬声器与所述第四扬声器的一侧时所述音源位置对应的高度特征响应，所述HRTF(θ,0)为仰角为θ，方位角为0度对应的HRTF数据，所述HRTF(0,0)为仰角为0度，方位角为0度对应的正前方HRTF数据，所述HRTF(θ,180)为仰角为θ，方位角为180度对应的HRTF数据，所述HRTF(0,180)为仰角为0度，方位角为180度对应的正后方HRTF数据。
  16. 根据权利要求14或15所述的音频处理设备，其特征在于，所述时域响应由所述音频处理设备根据所述音源位置利用刚球模型获得包括：
    所述时域响应由所述音源位置至所述左耳位置的频域响应以及所述音源位置至所述右耳位置的频域响应经变换得到，所述频域响应由所述音频处理设备根据所述音源位置利用所述刚球模型得到，其中所述刚球模型包括：
    Figure PCTCN2017095187-appb-100014
    其中，所述
    Figure PCTCN2017095187-appb-100015
    所述
    Figure PCTCN2017095187-appb-100016
    其中所述
    Figure PCTCN2017095187-appb-100017
    为所述音源位置至所述左耳位置的频域响应，所述
    Figure PCTCN2017095187-appb-100018
    为所述音源位置至所述右耳位置的频域响应，所述ρ为归一化的所述刚球模型对应的球心位置至所述音源位置的距离，所述r为所述球心位置到所述音源位置的距离，所述a为所述刚球模型对应的球体的半径，所述μ为归一化的角频率，所述f为预设频率，所述c为声音传播速度，所述θL为所述球心位置与所述音源位置映射在所述水平面的位置的连线与所述球心位置与所述左耳位置的连线的夹角，所述θR为所述球心位置与所述音源位置映射在所述水平面的位置的连线与所述球心位置到所述右耳位置的连线的夹角，所述球体根据所述四个扬声器的位置参数确定，所述水平面为经过所述左耳位置与所述右耳位置的连线且平行于目标平面的平面，所述目标平面为所述四个扬声器所在的平面。
  17. 根据权利要求13至16中任一项所述的音频处理设备，其特征在于，所述四声道 音频信号包括左前方音频信号，右前方音频信号，左后方音频信号和右后方音频信号，所述处理模块，具体用于根据所述音源位置参数和所述四个扬声器的位置参数确定所述四个扬声器中所述第一扬声器和所述第二扬声器的第一权重值以及所述四个扬声器中所述第三扬声器和第四扬声器的第二权重值；根据所述第一权重值与所述目标双声道音频信号中的左声道音频信号计算得到所述左前方音频信号，根据所述第一权重值与所述目标双声道音频信号中的右声道音频信号计算得到所述右前方音频信号，根据所述第二权重值与所述目标双声道音频信号中的左声道音频信号计算得到所述左后方音频信号，根据所述第二权重值与所述目标双声道音频信号中的右声道音频信号计算得到所述右后方音频信号。
  18. 根据权利要求17所述的音频处理设备，其特征在于，所述处理模块，具体用于若所述音源位置参数指示所述原始音频信号的音源位置位于目标平面内的第一象限内，则确定所述第一权重值为1，所述第二权重值为0，所述目标平面为所述四个扬声器所在的平面；
    若所述音源位置参数指示所述原始音频信号的音源位置位于所述目标平面内的第二象限内，则确定所述第一权重值为0，所述第二权重值为1；
    若所述音源位置参数指示所述原始音频信号的音源位置的位于所述目标平面内的第三象限内，则根据第一夹角和第二夹角确定所述第一权重值和所述第二权重值，所述第一夹角为所述音源位置与中心位置映射在所述目标平面的位置的连线与前平面的夹角，所述第二夹角为所述第一扬声器与所述第四扬声器的连线与所述前平面的夹角或者所述第二夹角为所述第二扬声器与所述第三扬声器的连线与所述前平面的夹角，所述中心位置为所述第二扬声器与所述第三扬声器的连线与所述第一扬声器与所述第四扬声器的连线的交点，所述前平面为通过所述中心位置且垂直于所述目标平面的平面；
    其中，所述目标平面被所述第一扬声器与所述第四扬声器的连线和所述第二扬声器与所述第三扬声器的连线分成四个象限，所述第一扬声器与所述第二扬声器之间的象限为所述第一象限，所述第三扬声器与所述第四扬声器之间的象限为所述第二象限，所述第一扬声器与所述第三扬声器之间的象限以及所述第二扬声器与所述第四扬声器之间的象限为所述第三象限。
  19. 根据权利要求18所述的音频处理设备，其特征在于，所述处理模块，具体用于根据所述第一夹角和所述第二夹角利用第三公式计算位于所述第一权重值和所述第二权重值；
    所述第三公式包括：
    Figure PCTCN2017095187-appb-100019
    其中，所述
    Figure PCTCN2017095187-appb-100020
    为所述第一夹角，所述
    Figure PCTCN2017095187-appb-100021
    为所述第二夹角，所述g1为所述第一权重值，所述g2为所述第二权重值。
  20. 根据权利要求17所述的音频处理设备，其特征在于，所述处理模块，用于根据所述第一权重值与所述目标双声道音频信号中的左声道音频信号利用第四公式计算得到所述左前方音频信号，根据所述第一权重值与所述目标双声道音频信号中的右声道音频信号利用所述第四公式计算得到所述右前方音频信号，根据所述第二权重值与所述目标双声道音 频信号中的左声道音频信号利用所述第四公式计算得到所述左后方音频信号，根据所述第二权重值与所述目标双声道音频信号中的右声道音频信号利用所述第四公式计算得到所述右后方音频信号；
    其中，所述第四公式包括：
    Figure PCTCN2017095187-appb-100022
    其中，所述FL'为所述左前方音频信号，所述FR'为右前方音频信号，所述BL'为所述左后方音频信号，所述BR'为所述右后方音频信号，所述L为所述目标双声道音频信号中的左声道音频信号，所述R为所述目标双声道音频信号中的右声道音频信号，所述g1为所述第一权重值，所述g2为所述第二权重值。
  21. 根据权利要求13所述音频处理设备，其特征在于，所述处理模块，还用于根据所述四个扬声器的位置参数和所述音源位置参数处理所述目标双声道音频信号得到中间四声道音频信号；根据所述四个扬声器的位置参数获取所述四个扬声器到左耳位置以及右耳位置的近场补偿响应，所述左耳位置为所述第一扬声器与所述第三扬声器之间的位置，所述右耳位置为所述第二扬声器与所述第四扬声器之间的位置；
    根据所述中间四声道音频信号和所述近场补偿响应的时域响应得到所述四声道音频信号。
  22. 根据权利要求21所述的音频处理设备，其特征在于，所述处理模块，具体用于根据所述中间四声道音频信号和所述近场补偿响应的时域响应利用第五公式得到所述四声道音频信号；
    所述第五公式为：
    FL＝FL′*hFL；
    FR＝FR′*hFR；
    BL＝BL′*hBL；
    BR＝BR′*hBR；
    所述FL为左前方音频信号，所述FR为右前方音频信号，所述BL为左后后音频信号，所述BR为右后方音频信号，所述hFL为所述第一扬声器到所述左耳位置所述近场补偿响应的时域响应，所述hFR为所述第二扬声器到所述右耳位置所述近场补偿响应的时域响应，所述hBL为所述第三扬声器到所述左耳位置所述近场补偿响应的时域响应，所述hBR为所述第四扬声器到所述右耳位置所述近场补偿响应的时域响应。
  23. 根据权利要求13至22中任一项所述的音频处理设备，其特征在于，所述四个扬声器构成四边形，其中，第一扬声器位于第四扬声器的对侧，第二扬声器位于第三扬声器的对侧，所述四个扬声器的位置参数包括所述第一扬声器的出声口正对所述左耳位置的耳道，所述第一扬声器与所述左耳位置的耳道的水平距离为第一预设值，所述第一扬声器与所述左耳位置的耳道垂直距离为第二预设值；
    所述第二扬声器的出声口正对所述右耳位置的耳道，所述第二扬声器与所述右耳位置的耳道的水平距离为所述第一预设值，所述第二扬声器与所述右耳位置的耳道垂直距离为所述第二预设值；
    所述第三扬声器的出声口正对所述左耳位置的耳道，所述第三扬声器与所述左耳位置的耳道的水平距离为所述第一预设值，所述第三扬声器与所述左耳位置的耳道垂直距离为所述第二预设值；
    所述第四个扬声器的出声口正对所述右耳位置的耳道，所述第四个扬声器与所述右耳位置的耳道的水平距离为所述第一预设值，所述第四个扬声器与所述右耳位置的耳道垂直距离为所述第二预设值。
  24. 根据权利要求23所述的音频处理设备，其特征在于，所述第一预设值大于或等于1厘米且小于或等于5厘米；所述第二预设值大于或等于0.5厘米且小于或等于1厘米。
  25. 一种计算机可读存储介质，包括指令，当该指令在计算机上运行时，该计算机执行权利要求1至权利要求12所求的方法。
  26. 一种包含指令的计算机程序产品，当该计算机程序产品在计算机上运行时，该计算机执行权利要求1至权利要求12所求的方法。
PCT/CN2017/095187 2017-07-31 2017-07-31 一种音频处理方法以及音频处理设备 WO2019023853A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201780092977.2A CN110892735B (zh) 2017-07-31 2017-07-31 一种音频处理方法以及音频处理设备
PCT/CN2017/095187 WO2019023853A1 (zh) 2017-07-31 2017-07-31 一种音频处理方法以及音频处理设备

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/095187 WO2019023853A1 (zh) 2017-07-31 2017-07-31 一种音频处理方法以及音频处理设备

Publications (1)

Publication Number Publication Date
WO2019023853A1 true WO2019023853A1 (zh) 2019-02-07

Family

ID=65233187

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/095187 WO2019023853A1 (zh) 2017-07-31 2017-07-31 一种音频处理方法以及音频处理设备

Country Status (2)

Country Link
CN (1) CN110892735B (zh)
WO (1) WO2019023853A1 (zh)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113596673A (zh) * 2021-07-14 2021-11-02 宁波旗芯电子科技有限公司 Ar眼镜扬声器的定向发声方法、装置和发声设备
WO2021238339A1 (zh) * 2020-05-29 2021-12-02 华为技术有限公司 音频渲染方法及装置

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113903325B (zh) * 2021-05-31 2022-10-18 北京荣耀终端有限公司 文本转3d音频的方法及装置
CN113810838A (zh) * 2021-09-16 2021-12-17 Oppo广东移动通信有限公司 音频控制方法和音频播放设备

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101208988A (zh) * 2005-05-31 2008-06-25 大不列颠投资有限公司 具有大的感知声学尺度和声像的小型音频再现系统
US20090123007A1 (en) * 2007-11-14 2009-05-14 Yamaha Corporation Virtual Sound Source Localization Apparatus
US20100253490A1 (en) * 2007-12-14 2010-10-07 Fujitsu Ten Limited Anti-theft system and anti-theft control method
CN104219604A (zh) * 2014-09-28 2014-12-17 三星电子（中国）研发中心 一种扬声器阵列的立体声回放方法
CN104303523A (zh) * 2012-01-26 2015-01-21 无线电广播技术研究所有限公司 将多声道音频信号转换为双声道音频信号的方法和设备
CN104769968A (zh) * 2012-11-30 2015-07-08 华为技术有限公司 音频呈现系统
CN104919821A (zh) * 2012-09-27 2015-09-16 声摩逊实验室 用于重放音频信号的方法和系统

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101483797B (zh) * 2008-01-07 2010-12-08 昊迪移通(北京)技术有限公司 一种针对耳机音响系统的人脑音频变换函数(hrtf)的生成方法和设备
US20150264502A1 (en) * 2012-11-16 2015-09-17 Yamaha Corporation Audio Signal Processing Device, Position Information Acquisition Device, and Audio Signal Processing System
US10178489B2 (en) * 2013-02-08 2019-01-08 Qualcomm Incorporated Signaling audio rendering information in a bitstream

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101208988A (zh) * 2005-05-31 2008-06-25 大不列颠投资有限公司 具有大的感知声学尺度和声像的小型音频再现系统
US20090123007A1 (en) * 2007-11-14 2009-05-14 Yamaha Corporation Virtual Sound Source Localization Apparatus
US20100253490A1 (en) * 2007-12-14 2010-10-07 Fujitsu Ten Limited Anti-theft system and anti-theft control method
CN104303523A (zh) * 2012-01-26 2015-01-21 无线电广播技术研究所有限公司 将多声道音频信号转换为双声道音频信号的方法和设备
CN104919821A (zh) * 2012-09-27 2015-09-16 声摩逊实验室 用于重放音频信号的方法和系统
CN104769968A (zh) * 2012-11-30 2015-07-08 华为技术有限公司 音频呈现系统
CN104219604A (zh) * 2014-09-28 2014-12-17 三星电子（中国）研发中心 一种扬声器阵列的立体声回放方法

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021238339A1 (zh) * 2020-05-29 2021-12-02 华为技术有限公司 音频渲染方法及装置
TWI775457B (zh) * 2020-05-29 2022-08-21 大陸商華為技術有限公司 音訊渲染方法、裝置及電腦可讀存儲介質
CN113596673A (zh) * 2021-07-14 2021-11-02 宁波旗芯电子科技有限公司 Ar眼镜扬声器的定向发声方法、装置和发声设备
CN113596673B (zh) * 2021-07-14 2024-07-30 杭州泽沃电子科技有限公司 Ar眼镜扬声器的定向发声方法、装置和发声设备

Also Published As

Publication number Publication date
CN110892735B (zh) 2021-03-23
CN110892735A (zh) 2020-03-17

Similar Documents

Publication Publication Date Title
ES2898951T3 (es) Virtualización de auricular
US9838825B2 (en) Audio signal processing device and method for reproducing a binaural signal
US10715945B2 (en) Methods and systems for determining and/or using an audio filter based on head-tracking data
ES2261994T3 (es) Metodo de tratamiento de datos sonoros y dispositivos de adquisicion sonoro que ejecuta este procedimiento.
US9769589B2 (en) Method of improving externalization of virtual surround sound
US10341799B2 (en) Impedance matching filters and equalization for headphone surround rendering
EP3114859A1 (en) Structural modeling of the head related impulse response
US11356795B2 (en) Spatialized audio relative to a peripheral device
WO2019023853A1 (zh) 一种音频处理方法以及音频处理设备
CN112005559B (zh) 改进环绕声的定位的方法
JP6896626B2 (ja) ヘッドホンを通じて頭部外面化３ｄオーディオを生成するシステム及び方法
EP4214535A2 (en) Methods and systems for determining position and orientation of a device using acoustic beacons
US10735885B1 (en) Managing image audio sources in a virtual acoustic environment
US11388540B2 (en) Method for acoustically rendering the size of a sound source
Yuan et al. Externalization improvement in a real-time binaural sound image rendering system
EP4440159A2 (en) Method and system for rendering 3d audio
Sakamoto et al. Improvement of accuracy of three-dimensional sound space synthesized by real-time SENZI, a sound space information acquisition system using spherical array with numerous microphones
CN118235432A (zh) 经头部跟踪调整的双耳音频
CN117793609A (zh) 一种声场渲染方法和装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17920447

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17920447

Country of ref document: EP

Kind code of ref document: A1