CN105120421A - Method and apparatus of generating virtual surround sound - Google Patents

Abstract

The invention discloses a method and apparatus of generating virtual surround sound, belonging to the signal processing field. The method comprises: obtaining the first audio signal of an audio file, and rotation angles of heads of users; generating a rotation matrix according to the rotation angles of heads of users; obtaining adjusting parameters of the first audio signal according to the first audio signal; adjusting the first audio signal according to the adjusting parameters to obtain a second audio signal; and generating virtual surround sound according to the second audio signal and the rotation matrix. The apparatus comprises a first obtaining module, a first generation module, a second obtaining module, an adjusting module and a second generation module. The method and apparatus can rotate virtual surround sound according to the rotation angles of heads of users, thereby improving the reality of the virtual surround sound.

Description

A kind of method and apparatus of generating virtual surround sound

Technical field

The present invention relates to signal transacting field, particularly a kind of method and apparatus of generating virtual surround sound.

Background technology

At present, when user uses the terminals listen such as mobile phone or computer music, if when wanting the effect of the virtual surround sound experiencing concert scene, just need terminal to connect multiple audio amplifier, play this music by multiple audio amplifier; But due to price and aspect, space, general user does not have enough audio amplifiers, at this moment terminal needs to produce virtual surround sound, allows user experience effect at concert scene.

Prior art provides a kind of method of generating virtual surround sound, can be: terminal obtains the B format signal that audio file comprises, this B format signal is converted to virtual speaker array signal, by virtual speaker array signal by HRTF (HeadRelatedTransferFunction, head related transfer function) filter carries out filtering, obtains virtual surround sound.

Realizing in process of the present invention, inventor finds that prior art at least exists following problem:

User has on earphone when listening virtual surround sound, and when user's end rotation, the virtual surround sound in earphone can follow the end rotation of user, and the sensation causing people to listen to the music at the scene is like this different, and the virtual surround sound also namely generated is true not.

Summary of the invention

In order to solve the problem of prior art, the invention provides a kind of method and apparatus of generating virtual surround sound.Technical scheme is as follows:

A method for generating virtual surround sound, described method comprises:

Obtain the first audio signal of audio file and the anglec of rotation of user's end rotation;

According to the described anglec of rotation, generate spin matrix;

According to described first audio signal, obtain the adjustment parameter of described first audio signal;

According to described adjustment parameter, adjustment is carried out to described first audio signal and obtains the second audio signal;

According to described second audio signal and described spin matrix, generating virtual surround sound.

Further, described according to described second audio signal and described spin matrix, generating virtual surround sound, comprising:

According to described spin matrix, described second audio signal is carried out rotation and obtains the 3rd audio signal;

According to described 3rd audio signal, described 3rd audio signal is converted to virtual speaker array signal;

Described virtual speaker array signal is carried out filtering by head related transfer function filter, obtains virtual surround sound.

Further, described according to described first audio signal, obtain the adjustment parameter of described first audio signal, comprising:

According to described first audio signal, obtain the recording scene of described first audio signal, according to described recording scene, from the corresponding relation recording scene and adjustment parameter, obtain the adjustment parameter of described first audio signal; Or,

According to described first audio signal, from the corresponding relation of audio signal and adjustment parameter, obtain the adjustment parameter of described first audio signal.

Further, described according to described first audio signal, obtain the recording scene of described first audio signal, comprising:

Analyze described first audio signal, obtain the content of described first audio signal, according to described content, determine the recording scene of described first audio signal; Or,

According to described first audio signal, from audio signal and record scene corresponding relation obtain the recording scene of described first audio signal.

Further, described adjustment parameter comprises the topological structure of mixed exponent number and virtual speaker;

Described according to described adjustment parameter, adjustment is carried out to described first audio signal and obtains the second audio signal, comprising:

According to described mixed exponent number, described first audio signal is carried out upper mixed process and obtains the 4th audio signal;

According to the topological structure of described virtual speaker, described 4th audio signal is carried out obtaining the second audio signal around process.

A device for generating virtual surround sound, described device comprises:

First acquisition module, for the anglec of rotation of the first audio signal and user's end rotation that obtain audio file;

First generation module, for according to the described anglec of rotation, generates spin matrix;

Second acquisition module, for according to described first audio signal, obtains the adjustment parameter of described first audio signal;

Adjusting module, for according to described adjustment parameter, carries out adjustment to described first audio signal and obtains the second audio signal;

Second generation module, for according to described second audio signal and described spin matrix, generating virtual surround sound.

Further, described second generation module, comprising:

Rotary unit, for according to described spin matrix, carries out rotation by described second audio signal and obtains the 3rd audio signal;

Converting unit, for according to described 3rd audio signal, is converted to virtual speaker array signal by described 3rd audio signal;

Filter unit, for described virtual speaker array signal is carried out filtering by head related transfer function filter, obtains virtual surround sound.

Further, described second acquisition module, comprising:

First acquiring unit, for according to described first audio signal, obtains the recording scene of described first audio signal;

Second acquisition unit, for according to described recording scene, obtains the adjustment parameter of described first audio signal from the corresponding relation recording scene and adjustment parameter;

Or described second acquisition module, comprising:

3rd acquiring unit, for according to described first audio signal, obtains the adjustment parameter of described first audio signal from the corresponding relation of audio signal and adjustment parameter.

Further, described first acquiring unit, comprising:

Analyzing subelement, for analyzing described first audio signal, obtaining the content of described first audio signal;

Determine subelement, for according to described content, determine the recording scene of described first audio signal;

Or described first acquiring unit, comprising:

Obtain subelement, for according to described first audio signal, from audio signal and record scene corresponding relation obtain the recording scene of described first audio signal.

Further, described adjustment parameter comprises the topological structure of mixed exponent number and virtual speaker;

Described adjusting module, comprising:

First processing unit, for according to described mixed exponent number, carries out upper mixed process by described first audio signal and obtains the 4th audio signal;

Second processing unit, for the topological structure according to described virtual speaker, is undertaken obtaining the second audio signal around process by described 4th audio signal.

In embodiments of the present invention, the anglec of rotation of user's end rotation is obtained by head-tracker, according to this anglec of rotation, generate spin matrix, according to the first audio signal, obtain the adjustment parameter of the first audio signal, according to this adjustment parameter, adjustment is carried out to the first audio signal and obtains the second audio signal, according to the second audio signal and this spin matrix, generating virtual surround sound, thus the authenticity that can improve virtual surround sound.

Accompanying drawing explanation

Fig. 1 is the method flow diagram of a kind of generating virtual surround sound that the embodiment of the present invention 1 provides;

Fig. 2-1 is the method flow diagram of a kind of generating virtual surround sound that the embodiment of the present invention 2 provides;

Fig. 2-2 is schematic diagrames of the topological structure of a kind of virtual speaker that the embodiment of the present invention 2 provides;

Fig. 2-3 is schematic diagrames of the topological structure of the another kind of virtual speaker that the embodiment of the present invention 2 provides;

Fig. 3 is the apparatus structure schematic diagram of a kind of generating virtual surround sound that the embodiment of the present invention 3 provides.

Embodiment

For making the object, technical solutions and advantages of the present invention clearly, below in conjunction with accompanying drawing, embodiment of the present invention is described further in detail.

Embodiment 1

Embodiments provide a kind of method of generating virtual surround sound, the executive agent of the method can be terminal, and see Fig. 1, wherein, the method comprises:

Step 101: obtain the first audio signal of audio file and the anglec of rotation of user's end rotation;

Step 102: according to this anglec of rotation, generates spin matrix;

Step 103: according to the first audio signal, obtains the adjustment parameter of the first audio signal;

Step 104: according to this adjustment parameter, carries out adjustment to the first audio signal and obtains the second audio signal;

Step 105: according to the second audio signal and this spin matrix, generating virtual surround sound.

Further, according to the second audio signal and this spin matrix, generating virtual surround sound, comprising:

According to this spin matrix, the second audio signal is carried out rotation and obtain the 3rd audio signal;

According to the 3rd audio signal, the 3rd audio signal is converted to virtual speaker array signal;

Virtual speaker array signal is carried out filtering by head related transfer function filter, obtains virtual surround sound.

Further, according to the first audio signal, obtain the adjustment parameter of the first audio signal, comprising:

According to the first audio signal, obtain the recording scene of the first audio signal, according to recording scene, from the corresponding relation recording scene and adjustment parameter, obtain the adjustment parameter of the first audio signal; Or,

According to the first audio signal, from the corresponding relation of audio signal and adjustment parameter, obtain the adjustment parameter of the first audio signal.

Further, according to the first audio signal, obtain the recording scene of the first audio signal, comprising:

Analyze the first audio signal, obtain the content of the first audio signal, according to content, determine the recording scene of the first audio signal; Or,

According to the first audio signal, from audio signal and record scene corresponding relation obtain the recording scene of the first audio signal.

Further, the topological structure that parameter comprises mixed exponent number and virtual speaker is adjusted;

According to adjustment parameter, adjustment is carried out to the first audio signal and obtains the second audio signal, comprising:

According to upper mixed exponent number, the first audio signal is carried out upper mixed process and obtain the 4th audio signal;

According to the topological structure of virtual speaker, the 4th audio signal is carried out obtaining the second audio signal around process.

In embodiments of the present invention, the anglec of rotation of user's end rotation is obtained by head-tracker, according to this anglec of rotation, generate spin matrix, according to the first audio signal, obtain the adjustment parameter of the first audio signal, according to this adjustment parameter, adjustment is carried out to the first audio signal and obtains the second audio signal, according to the second audio signal and this spin matrix, generating virtual surround sound, thus the authenticity that can improve virtual surround sound.

Embodiment 2

Embodiments provide a kind of method of generating virtual surround sound, the executive agent of the method can be terminal, and see Fig. 2-1, wherein, the method comprises:

Step 201: obtain the first audio signal of audio file and the anglec of rotation of user's end rotation;

When user plays the audio file of high in the clouds or server end storage by earphone, terminal obtains the first audio signal of audio file and the anglec of rotation of user's end rotation.

Wherein, the step of the anglec of rotation of terminal acquisition user end rotation can be:

Earphone arranges head-tracker or has the equipment of head-tracker at user's head-mount, as virtual reality display device, detect user's head in real time by head-tracker whether to rotate, if user's head rotates, then obtain the anglec of rotation of user's end rotation, send this anglec of rotation to terminal; Terminal receives the anglec of rotation that head-tracker sends.

Wherein, the first audio signal can be single order B format signal, and B format signal can be triple-track signal, also can be quadraphony signal; If B format signal is triple-track signal, then B format signal comprises W, X and Y; If B format signal is quadraphony signal, then B format signal comprises W, X, Y and Z.Terminal can be mobile phone, panel computer or PC (personalcomputer, PC) terminal etc.

W sound channel signal represents omnirange sound wave, and X sound channel signal, Y sound channel signal and Z sound channel signal represent the sound wave along three orthogonal orientations; X sound channel signal represents to be listened from rear to front horizontal arrangement, and Y sound channel signal represents listens horizontal arrangement from right to left, and Z sound channel signal represents to listen and is upwards arranged vertically.

Step 202: according to this anglec of rotation, generates spin matrix;

Spin matrix for rotating virtual surround sound, thus makes when user's end rotation, and virtual surround sound does not rotate according to the rotation of user's head, realizes the effect of listening to the music in actual life.

Such as, the direction of virtual surround sound in front, when user's head is to anticlockwise 30 degree, then by this virtual surround sound from the position after user's end rotation to right rotation 30 degree, thus the direction realizing virtual surround sound is still on original direction.

If B format signal is triple-track signal, then spin matrix is $\left[\begin{array}{ccc}1& 0& 0\\ 0& cos\left(\mathrm{\θ}\right)& -sin\left(\mathrm{\θ}\right)\\ 0& sin\left(\mathrm{\θ}\right)& \cos \left(\mathrm{\θ}\right)\end{array}\right];$ If B format signal is quadraphony signal, then spin matrix is $\left[\begin{array}{cccc}1& 0& 0& 0\\ 0& cos\left(\mathrm{\θ}\right)& -sin\left(\mathrm{\θ}\right)& 0\\ 0& sin\left(\mathrm{\θ}\right)& cos\left(\mathrm{\θ}\right)& 0\\ 0& 0& 0& 1\end{array}\right],$ θ is this anglec of rotation.

Step 203: according to the first audio signal, obtains the adjustment parameter of the first audio signal;

Adjustment parameter comprises the topological structure of mixed exponent number and virtual speaker, and the topological structure of virtual speaker comprises the number of virtual speaker and the position etc. of each virtual speaker.

This step can be realized by following first kind of way or the second way, and for the first implementation, this step can pass through following steps (1) and (2) realize, and comprising:

(1) the recording scene of the first audio signal: according to the first audio signal, is obtained;

Record scene and comprise concert scene, business meetings scene or natural environment scene etc.

This step can pass through following steps (1-1) and (1-2) realizes, and comprising:

(1-1): analyze the first audio signal, the content of the first audio signal is obtained;

The content of the first audio signal at least comprises directional signal proportion, can also comprise the direction etc. of attribute information and/or main sound source; Attribute information comprises object, Instrument categories and the sound class etc. that the first audio signal comprises.

Wherein, analyze the first audio signal, the step obtaining the directional signal proportion that the first audio signal comprises can be:

By Direct-ambiencesignaldecomposition (analysis of sensing-ambient signal) Algorithm Analysis first audio signal, obtain the proportion of the directional signal that the first audio signal comprises, also can obtain the proportion of the non-directional signal that the first audio signal comprises.

Such as, only one's voice in speech is comprised in first audio signal, then the first audio signal sounds and just has very strong directivity, then by Direct-ambiencesignaldecomposition Algorithm Analysis first audio signal, the proportion obtaining the directional signal in the first audio signal is larger; For another example, noise or a large amount of reverberation is comprised in first audio signal, then the first audio signal sounds that directivity is just not strong, then by Direct-ambiencesignaldecomposition Algorithm Analysis first audio signal, the proportion obtaining the directional signal in the first audio signal is less.

Wherein, analyze the first audio signal, the step obtaining the directional signal proportion that the first audio signal comprises can also be realized by following steps (A) to (C), comprising:

(A): covariance matrix is set up to the first audio signal;

Covariance matrix cov (ω _i, n)=α cov (ω _i, n-1) and+(1-α) * S (ω _i, n) * S ^h(ω _i, n).

If the first audio signal comprises W, X and Y, then S (ω _i, n)=[W (ω _i, n) X (ω _i, n) Y (ω _i, n)] ^tif the first audio signal comprises W, X, Y and Z, then S (ω _i, n)=[W (ω _i, n) X (ω _i, n) Y (ω _i, n) Z (ω _i, n)] ^t.

Wherein, ω _ibe the frequency of the first audio signal, n is the index to frame number on time shaft, [] ^hrepresentation vector conjugate transpose; α is smoothing factor, and α can set in advance or according to the characteristics of signals dynamic conditioning of the first audio signal, and such as, α can 0.92.ω _iinclude all interested frequencies and ω _ican carry out as required arranging and changing; Such as, ω _ifor 100-16000HZ.

Further, in embodiments of the present invention, each ω can be set _iweight, then when covariance matrix being set up to the first audio signal, can according to each ω _ithe covariance matrix of weight calculation first audio signal, then covariance matrix $\mathrm{cov}\left(n\right)=\mathrm{\Σ}\mathrm{cov}({\mathrm{\ω}}_i,n)*\mathrm{\ρ},$ ρ is ω _iweight.

(B): signature analysis is carried out to covariance matrix, obtains characteristic value;

By Matlab function, signature analysis is carried out to covariance matrix, obtain [V, Λ]=eigs (cov (n)).

Wherein, V is the matrix of 3*3 or the matrix of 4*4, and the often row of this matrix represent the characteristic vector of cov (n); Λ contains the individual features value with descending.

(C) proportion of directional signal: according to characteristic value, is calculated.

From characteristic value, select eigenvalue of maximum as the First Eigenvalue, from the characteristic value except eigenvalue of maximum, select eigenvalue of maximum as Second Eigenvalue, according to the First Eigenvalue and Second Eigenvalue, calculated the proportion of directional signal by following formula (1).

$DRR=1{-}^{\frac{{\mathrm{\λ}}_2}{{\mathrm{\λ}}_1}}$ Formula (1);

Wherein, DRR is the proportion of directional signal; λ ₁for the First Eigenvalue, and λ ₁corresponding to direct sound wave energy; λ ₂for Second Eigenvalue, and λ ₂corresponding reflection, echo, ambient sound etc.The value of DRR is between [0,1], and the value of DRR is less, and to represent direct sound wave proportion lower, and sound field directivity is more weak, and also namely directional signal proportion is lower; The value of DRR is larger, and to represent direct sound wave proportion higher, and sound field directivity is stronger, and also namely directional signal proportion is higher.

Further, by directionofarrival (sound source arrival direction) Algorithm Analysis first audio signal, the direction of the first audio signal main sound source is obtained.

Further, by Instrumentclassification (musical instrument classification) Algorithm Analysis first audio signal, the Instrument categories of the first audio signal is obtained; By Speechmusicclassification (voice music classification) Algorithm Analysis first audio signal, obtain the sound class of the first audio signal.

Further, extract by Objectextraction (object extraction) algorithm the object that the first audio signal comprises.

Such as, the first audio signal is one section of voice, then the object extracting the first audio signal by Objectextraction algorithm is voice; For another example, the first audio signal is one section of thunder, then the object extracting the first audio signal by Objectextraction algorithm is thunder etc.; For another example, the first audio signal is one section of music, then the object extracting the first audio signal by Objectextraction algorithm is music etc.

Further, server can ex ante analysis first audio signal, and obtain the content of the first audio signal, be stored in the corresponding relation of audio signal and content by the content of the first audio signal and the first audio signal, then this step can be:

According to the first audio signal, in the audio signal stored from server and the corresponding relation of content, obtain the content of the first audio signal.

Wherein, the audio signal stored in server and the corresponding relation of content can store in the server in the form of metadata, and the content of the first audio signal can directly embed in the first audio signal by server, also the content of the first audio signal can be deposited separately, set up content file folder, the content of the first audio signal is stored in this content file folder, and sets up the corresponding relation of the first audio signal and this content file folder.

Terminal when obtaining the first audio frequency of audio file, can obtain the content of the first audio signal, also can obtain the content of the first audio file in this step.Further, in the corresponding relation of the audio signal that terminal stores from server and content, obtain the content of the first audio signal, the computational burden of terminal can be alleviated, and improve the efficiency of terminal generating virtual surround sound.

(1-2) the recording scene of the first audio signal: according to the content of the first audio signal, is determined.

Store the corresponding relation of content and recording scene in server, accordingly, this step can be:

Terminal, according to the content of the first audio signal, obtains the recording scene of the first audio signal in the corresponding relation of the content stored from server and recording scene.

In this step, terminal also can obtain content and record the corresponding relation of scene from server, stores the corresponding relation of content and recording scene; Accordingly, this step can be:

According to the content of the first audio signal, in the corresponding relation of the content stored from terminal and recording scene, obtain the recording scene of the first audio signal.

Wherein, the corresponding relation of content and recording scene can be stored in terminal or server in the form of metadata, and the recording scene of the first audio signal can directly embed in the content of the first audio signal by terminal or server, also the recording scene of the first audio signal can be deposited separately, set up and record document scene folder, the recording scene of the first audio signal is stored in this recording document scene folder, and sets up the content of the first audio signal and the corresponding relation of this recording scene.

Further, the recording scene of the first audio signal and the first audio signal is stored in audio signal and records in the corresponding relation of scene by terminal; Thus terminal is when again playing the first audio signal again, the recording scene of the first audio signal need not be determined by above method, directly from audio signal and record scene corresponding relation obtain the recording scene of the first audio signal.

Such as, when the proportion of the directional signal of terminal storage is greater than 0.5, determine that the recording scene of the first audio signal is business meetings; When the proportion of directional signal is less than 0.5, determine that the recording scene of the first audio signal is concert.

(2) from the corresponding relation recording scene and adjustment parameter: according to recording scene, obtain the adjustment parameter of the first audio signal.

Store the corresponding relation recording scene and adjustment parameter in server, then this step can be:

According to recording scene, in the corresponding relation of the recording scene stored from server and adjustment parameter, obtain the adjustment parameter of the first audio signal.

In this step, terminal also can obtain the corresponding relation recording scene and adjustment parameter from server, stores the corresponding relation recording scene and adjustment parameter; Accordingly, this step can be:

According to recording scene, in the corresponding relation of the recording scene stored from terminal and adjustment parameter, obtain the adjustment parameter of the first audio signal.

Further, the adjustment parameter of the first audio signal and the first audio signal is stored in the corresponding relation of audio signal and adjustment parameter by terminal, thus terminal is when again playing the first audio signal, the recording scene of the first audio signal need not be determined by above method, adjustment parameter is being obtained according to recording scene, but from the corresponding relation of audio signal and adjustment parameter, directly obtain the adjustment parameter of the first audio signal, thus shorten the acquisition time of the adjustment parameter of acquisition first audio signal, improve acquisition efficiency.

Further, for the second implementation, this step can be:

The corresponding relation of stored audio signal and adjustment parameter in server, terminal, according to the first audio signal, obtains the adjustment parameter of the first audio signal in the corresponding relation of the audio signal stored from server and adjustment parameter.

Further, the corresponding relation of audio signal and adjustment parameter can store in the server in the form of metadata, and the adjustment parameter of the first audio signal can directly embed in the first audio signal by server, also the adjustment parameter of the first audio signal can be deposited separately, set up adjustment Parameter File folder, the adjustment parameter of the first audio signal is stored in adjustment Parameter File, and sets up the corresponding relation of the first audio signal and this adjustment Parameter File folder.

Such as, in the first audio signal, the proportion of directional signal is greater than 0.5, then upper mixed exponent number is 3, and the topological structure of virtual speaker comprises 6 virtual speakers, see Fig. 2-2; For another example, in the first audio signal, the proportion of directional signal is less than 0.5, then upper mixed exponent number is 1, and the topological structure of virtual speaker comprises 4 virtual speakers, see Fig. 2-3.

Such as, the directivity sound source of the first audio signal is distributed in a direction, and such as sound field content is concert, and sound field concentrates on Ye Ji dead ahead, stage direction, then the distance of the left front in the topological structure of virtual speaker and right speakers is become large.

Further, can also arrange the adjustment parameter that different terminal types is corresponding different in embodiments of the present invention, then this step can be:

Obtain the terminal type of terminal, according to terminal type and the first audio signal, obtain the adjustment parameter of the first audio signal.

The corresponding relation of prior storage terminal type, audio signal and adjustment parameter in server; Accordingly, according to terminal type and the first audio signal, the step obtaining the adjustment parameter of the first audio signal can be:

According to terminal type and the first audio signal, in the corresponding relation of the terminal type stored from server, audio signal and adjustment parameter, obtain the adjustment parameter of the first audio signal.

The quality of topological structure on virtual surround sound of virtual speaker has great impact, and different according to the difference of the content of the first audio signal on the impact of virtual surround sound; Such as, the first audio signal major part is all from front, then the topological structure of virtual speaker can select rectangular configuration, instead of square structure.Therefore, in the embodiment of the present invention, the content-adaptive adjustment adjustment parameter according to the first audio signal can be realized, thus the broadcasting tonequality of virtual surround sound can be ensured.Further, different terminals has different operational capabilities and power consumption, and according to terminal type and the first audio signal, the adjustment parameter obtaining the first audio signal can save the power consumption of terminal.

Step 204: according to this adjustment parameter, carries out adjustment to the first audio signal and obtains the second audio signal;

Adjustment parameter comprises the topological structure of mixed exponent number and virtual speaker, then this step can pass through following steps (1) and (2) realization, comprising:

(1): according to upper mixed exponent number, the first audio signal is carried out upper mixed process and obtain the 4th audio signal;

Wherein, this step is prior art, no longer describes in detail at this.

(2): according to the topological structure of virtual speaker, the 4th audio signal is carried out obtaining the second audio signal around process.

By the 4th audio signal successively through the virtual speaker that the topological structure of virtual speaker comprises, thus realize the 4th audio signal to carry out around process, obtain the second audio signal.

Such as, the first audio signal is $\left[\begin{array}{c}{W}_1\\ X_1\\ Y_1\end{array}\right],$ The second audio signal then after adjustment is $\left[\begin{array}{c}{W}_2\\ X_2\\ Y_2\end{array}\right];$ For another example, the first audio signal is $\left[\begin{array}{c}{W}_1\\ X_1\\ Y_1\\ Z_1\end{array}\right],$ The second audio signal then after adjustment is $\left[\begin{array}{c}{W}_2\\ X_2\\ Y_2\\ Z_2\end{array}\right].$

Step 205: according to spin matrix, carries out rotation and obtains the 3rd audio signal by the second audio signal;

Spin matrix and the second audio signal are carried out multiplying, obtains the 3rd audio signal.

Such as, the second audio signal is $\left[\begin{array}{c}{W}_2\\ X_2\\ Y_2\end{array}\right],$ Spin matrix is $\left[\begin{array}{ccc}1& 0& 0\\ 0& cos\left(\mathrm{\θ}\right)& -sin\left(\mathrm{\θ}\right)\\ 0& sin\left(\mathrm{\θ}\right)& \cos \left(\mathrm{\θ}\right)\end{array}\right],$ Then the 3rd audio signal is $\left[\begin{array}{c}{W}_3\\ X_3\\ Y_3\end{array}\right]=\left[\begin{array}{ccc}1& 0& 0\\ 0& \cos \left(\mathrm{\θ}\right)& -sin\left(\mathrm{\θ}\right)\\ 0& \sin \left(\mathrm{\θ}\right)& \cos \left(\mathrm{\θ}\right)\end{array}\right]\left[\begin{array}{c}{W}_2\\ X_2\\ Y_2\end{array}\right];$ For another example, the second audio signal is $\left[\begin{array}{c}{W}_2\\ X_2\\ Y_2\\ Z_2\end{array}\right],$ Spin matrix is $\left[\begin{array}{cccc}1& 0& 0& 0\\ 0& cos\left(\mathrm{\θ}\right)& -sin\left(\mathrm{\θ}\right)& 0\\ 0& sin\left(\mathrm{\θ}\right)& \cos \left(\mathrm{\θ}\right)& 0\\ 0& 0& 0& 1\end{array}\right],$ Then the 3rd audio signal is $\left[\begin{array}{c}{W}_3\\ X_3\\ Y_3\\ Z_3\end{array}\right]=\left[\begin{array}{cccc}1& 0& 0& 0\\ 0& cos\left(\mathrm{\θ}\right)& -sin\left(\mathrm{\θ}\right)& 0\\ 0& sin\left(\mathrm{\θ}\right)& \cos \left(\mathrm{\θ}\right)& 0\\ 0& 0& 0& 1\end{array}\right]\left[\begin{array}{c}{W}_2\\ X_2\\ Y_2\\ Z_2\end{array}\right].$

Step 206: according to the 3rd audio signal, is converted to virtual speaker array signal by the 3rd audio signal;

Obtain virtual speaker matrix, virtual speaker matrix and the 3rd audio signal are carried out matrix multiplication, obtains virtual speaker array signal.

Such as, virtual speaker array is $\left[\begin{array}{ccc}{G}_{w1}& G_{x1}& G_{y1}\\ G_{w2}& G_{x2}& G_{y2}\\ .& .& .\\ .& .& .\\ G_{wN}& G_{xN}& G_{yN}\end{array}\right],$ Then virtual speaker array signal is $\left[\begin{array}{c}{L}_1\\ L_2\\ \mathrm{..}\\ L_N\end{array}\right]$ $=\left[\begin{array}{ccc}{G}_{w1}& G_{x1}& G_{y1}\\ G_{w2}& G_{x2}& G_{y2}\\ .& .& .\\ .& .& .\\ G_{wN}& G_{xN}& G_{yN}\end{array}\right]\left[\begin{array}{c}{W}_3\\ X_3\\ Y_3\end{array}\right];$ For another example, virtual speaker array is $\left[\begin{array}{cccc}{G}_{w1}& G_{x1}& G_{y1}& G_{z1}\\ G_{w2}& G_{x2}& G_{y2}& G_{z2}\\ .& .& .& .\\ .& .& .& .\\ G_{wN}& G_{xN}& G_{yN}& G_{zN}\end{array}\right],$ Then virtual speaker array signal is $\left[\begin{array}{c}{L}_1\\ L_2\\ \mathrm{..}\\ L_N\end{array}\right]=\left[\begin{array}{cccc}{G}_{w1}& G_{x1}& G_{y1}& G_{z1}\\ G_{w2}& G_{x2}& G_{y2}& G_{z2}\\ .& .& .& .\\ .& .& .& .\\ G_{wN}& G_{xN}& G_{yN}& G_{zN}\end{array}\right]\left[\begin{array}{c}{W}_3\\ X_3\\ Y_3\\ Z_3\end{array}\right].$

Wherein, N is the number of the virtual speaker that virtual speaker topological structure comprises.

Step 207: virtual speaker array signal is carried out filtering by head related transfer function filter, obtains virtual surround sound.

It is stereo that head related transfer function filter is used for that virtual speaker array signal is converted to two roads, and be also binaural signal, then this step can be:

Obtain the two stereo matrixes in road that head correlation function transforming function transformation function filter is corresponding, Jiang Gai bis-road stereoscopic matrix and virtual speaker array signal carry out matrix multiplication, obtain virtual surround sound.

Such as, the two stereo matrixes in road are $\left[\begin{array}{cccc}{H}_{1L}& H_{2L}& \mathrm{..}& H_{NL}\\ H_{1R}& H_{2R}& \mathrm{..}& H_{NR}\end{array}\right]$ Then virtual surround sound is $\left[\begin{array}{c}L\\ R\end{array}\right]=\left[\begin{array}{ccc}{H}_{1L}& H_{2L}& \mathrm{..}\\ H_{1R}& H_{2R}& \mathrm{..}\end{array}\right.$ $\left.\begin{array}{c}{H}_{NL}\\ H_{NR}\end{array}\right]\left[\begin{array}{c}{L}_1\\ L_2\\ \mathrm{..}\\ L_N\end{array}\right]=\left[\begin{array}{ccc}{F}_{WL}& F_{XL}& F_{YL}\\ F_{WR}& F_{XR}& F_{YR}\end{array}\right]\left[\begin{array}{c}{W}_1\\ X_1\\ Y_1\end{array}\right];$ Or virtual surround sound is $\left[\begin{array}{c}L\\ R\end{array}\right]=\left[\begin{array}{cccc}{H}_{1L}& H_{2L}& \mathrm{..}& H_{NL}\\ H_{1R}& H_{2R}& \mathrm{..}& H_{NR}\end{array}\right]\left[\begin{array}{c}{L}_1\\ L_2\\ \mathrm{..}\\ L_N\end{array}\right]=\left[\begin{array}{c}{F}_{WL}\\ F_{WR}\end{array}\right..$ $\left.\begin{array}{ccc}{F}_{XL}& F_{YL}& F_{ZL}\\ F_{XR}& F_{YR}& F_{ZR}\end{array}\right]\left[\begin{array}{c}{W}_1\\ X_1\\ Y_1\\ Z_1\end{array}\right].$

In embodiments of the present invention, the anglec of rotation of user's end rotation is obtained by head-tracker, according to this anglec of rotation, generate spin matrix, according to the first audio signal, obtain the adjustment parameter of the first audio signal, according to this adjustment parameter, adjustment is carried out to the first audio signal and obtains the second audio signal, according to the second audio signal and this spin matrix, generating virtual surround sound, thus the authenticity that can improve virtual surround sound.

Embodiment 3

Embodiments provide a kind of device of generating virtual surround sound, this device can be terminal, and see Fig. 3, device comprises:

First acquisition module 301, for the anglec of rotation of the first audio signal and user's end rotation that obtain audio file;

First generation module 302, for according to the anglec of rotation, generates spin matrix;

Second acquisition module 303, for according to the first audio signal, obtains the adjustment parameter of the first audio signal;

Adjusting module 304, for according to adjustment parameter, carries out adjustment to the first audio signal and obtains the second audio signal;

Second generation module 305, for according to the second audio signal and spin matrix, generating virtual surround sound.

Further, the second generation module 305, comprising:

Rotary unit, for according to spin matrix, carries out rotation and obtains the 3rd audio signal by the second audio signal;

Converting unit, for according to the 3rd audio signal, is converted to virtual speaker array signal by the 3rd audio signal;

Filter unit, for virtual speaker array signal is carried out filtering by head related transfer function filter, obtains virtual surround sound.

Further, the second acquisition module 303, comprising:

First acquiring unit, for according to the first audio signal, obtains the recording scene of the first audio signal;

Second acquisition unit, for according to recording scene, obtains the adjustment parameter of the first audio signal from the corresponding relation recording scene and adjustment parameter;

Or the second acquisition module 303, comprising:

3rd acquiring unit, for according to the first audio signal, obtains the adjustment parameter of the first audio signal from the corresponding relation of audio signal and adjustment parameter.

Further, the first acquiring unit, comprising:

Analyzing subelement, for analyzing the first audio signal, obtaining the content of the first audio signal;

Determine subelement, for according to content, determine the recording scene of the first audio signal;

Or the first acquiring unit, comprising:

Obtain subelement, for according to the first audio signal, from audio signal and record scene corresponding relation obtain the recording scene of the first audio signal.

Further, the topological structure that parameter comprises mixed exponent number and virtual speaker is adjusted;

Adjusting module 304, comprising:

First processing unit, for according to upper mixed exponent number, carries out upper mixed process and obtains the 4th audio signal by the first audio signal;

Second processing unit, for the topological structure according to virtual speaker, is undertaken obtaining the second audio signal around process by the 4th audio signal.

In embodiments of the present invention, the anglec of rotation of user's end rotation is obtained by head-tracker, according to this anglec of rotation, generate spin matrix, according to the first audio signal, obtain the adjustment parameter of the first audio signal, according to this adjustment parameter, adjustment is carried out to the first audio signal and obtains the second audio signal, according to the second audio signal and this spin matrix, generating virtual surround sound, thus the authenticity that can improve virtual surround sound.

It should be noted that: the device of the generating virtual surround sound that above-described embodiment provides is when generating virtual surround sound, only be illustrated with the division of above-mentioned each functional module, in practical application, can distribute as required and by above-mentioned functions and be completed by different functional modules, internal structure by device is divided into different functional modules, to complete all or part of function described above.In addition, the device of the generating virtual surround sound that above-described embodiment provides and the embodiment of the method for generating virtual surround sound belong to same design, and its specific implementation process refers to embodiment of the method, repeats no more here.

One of ordinary skill in the art will appreciate that all or part of step realizing above-described embodiment can have been come by hardware, the hardware that also can carry out instruction relevant by program completes, described program can be stored in a kind of computer-readable recording medium, the above-mentioned storage medium mentioned can be read-only memory, disk or CD etc.

The foregoing is only preferred embodiment of the present invention, not in order to limit the present invention, within the spirit and principles in the present invention all, any amendment done, equivalent replacement, improvement etc., all should be included within protection scope of the present invention.

Claims (10)

1. a method for generating virtual surround sound, is characterized in that, described method comprises:

Obtain the first audio signal of audio file and the anglec of rotation of user's end rotation;

According to the described anglec of rotation, generate spin matrix;

According to described first audio signal, obtain the adjustment parameter of described first audio signal;

According to described adjustment parameter, adjustment is carried out to described first audio signal and obtains the second audio signal;

According to described second audio signal and described spin matrix, generating virtual surround sound.

2. the method for claim 1, is characterized in that, described according to described second audio signal and described spin matrix, generating virtual surround sound, comprising:

According to described spin matrix, described second audio signal is carried out rotation and obtains the 3rd audio signal;

According to described 3rd audio signal, described 3rd audio signal is converted to virtual speaker array signal;

Described virtual speaker array signal is carried out filtering by head related transfer function filter, obtains virtual surround sound.

3. the method for claim 1, is characterized in that, described according to described first audio signal, obtains the adjustment parameter of described first audio signal, comprising:

According to described first audio signal, obtain the recording scene of described first audio signal, according to described recording scene, from the corresponding relation recording scene and adjustment parameter, obtain the adjustment parameter of described first audio signal; Or,

According to described first audio signal, from the corresponding relation of audio signal and adjustment parameter, obtain the adjustment parameter of described first audio signal.

4. method as claimed in claim 3, is characterized in that, described according to described first audio signal, obtains the recording scene of described first audio signal, comprising:

Analyze described first audio signal, obtain the content of described first audio signal, according to described content, determine the recording scene of described first audio signal; Or,

According to described first audio signal, from audio signal and record scene corresponding relation obtain the recording scene of described first audio signal.

5. the method for claim 1, is characterized in that, described adjustment parameter comprises the topological structure of mixed exponent number and virtual speaker;

Described according to described adjustment parameter, adjustment is carried out to described first audio signal and obtains the second audio signal, comprising:

According to described mixed exponent number, described first audio signal is carried out upper mixed process and obtains the 4th audio signal;

According to the topological structure of described virtual speaker, described 4th audio signal is carried out obtaining the second audio signal around process.

6. a device for generating virtual surround sound, is characterized in that, described device comprises:

First acquisition module, for the anglec of rotation of the first audio signal and user's end rotation that obtain audio file;

First generation module, for according to the described anglec of rotation, generates spin matrix;

Second acquisition module, for according to described first audio signal, obtains the adjustment parameter of described first audio signal;

Adjusting module, for according to described adjustment parameter, carries out adjustment to described first audio signal and obtains the second audio signal;

Second generation module, for according to described second audio signal and described spin matrix, generating virtual surround sound.

7. device as claimed in claim 6, it is characterized in that, described second generation module, comprising:

Rotary unit, for according to described spin matrix, carries out rotation by described second audio signal and obtains the 3rd audio signal;

Converting unit, for according to described 3rd audio signal, is converted to virtual speaker array signal by described 3rd audio signal;

Filter unit, for described virtual speaker array signal is carried out filtering by head related transfer function filter, obtains virtual surround sound.

8. device as claimed in claim 6, it is characterized in that, described second acquisition module, comprising:

First acquiring unit, for according to described first audio signal, obtains the recording scene of described first audio signal;

Second acquisition unit, for according to described recording scene, obtains the adjustment parameter of described first audio signal from the corresponding relation recording scene and adjustment parameter;

Or described second acquisition module, comprising:

3rd acquiring unit, for according to described first audio signal, obtains the adjustment parameter of described first audio signal from the corresponding relation of audio signal and adjustment parameter.

9. device as claimed in claim 8, it is characterized in that, described first acquiring unit, comprising:

Analyzing subelement, for analyzing described first audio signal, obtaining the content of described first audio signal;

Determine subelement, for according to described content, determine the recording scene of described first audio signal;

Or described first acquiring unit, comprising:

Obtain subelement, for according to described first audio signal, from audio signal and record scene corresponding relation obtain the recording scene of described first audio signal.

10. device as claimed in claim 6, it is characterized in that, described adjustment parameter comprises the topological structure of mixed exponent number and virtual speaker;

Described adjusting module, comprising:

First processing unit, for according to described mixed exponent number, carries out upper mixed process by described first audio signal and obtains the 4th audio signal;

Second processing unit, for the topological structure according to described virtual speaker, is undertaken obtaining the second audio signal around process by described 4th audio signal.