CN105959877A - Sound field processing method and apparatus in virtual reality device - Google Patents
Sound field processing method and apparatus in virtual reality device Download PDFInfo
- Publication number
- CN105959877A CN105959877A CN201610538406.4A CN201610538406A CN105959877A CN 105959877 A CN105959877 A CN 105959877A CN 201610538406 A CN201610538406 A CN 201610538406A CN 105959877 A CN105959877 A CN 105959877A
- Authority
- CN
- China
- Prior art keywords
- binaural signal
- sampling
- super
- predetermined number
- binaural
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R3/00—Circuits for transducers, loudspeakers or microphones
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2430/00—Signal processing covered by H04R, not provided for in its groups
Abstract
The invention discloses a sound field processing method and apparatus in a virtual reality device. The processing method comprises the following steps: predetermining a preset number of binaural signals, wherein the preset number of binaural signals comprises sampling binaural signals and oversampling binaural signals; fitting the sampling binaural signals to acquire the oversampling binaural signals; determining a first oversampling binaural signal and a second oversampling binaural signal closest to a horizontal angle according to the rotation horizontal angle of a user head; and interpolating the first oversampling binaural signal and the second oversampling binaural signal to acquire a current binaural signal corresponding to the horizontal angle, and broadcasting the current binaural signal to the user. By adopting the sound field processing method and apparatus in the virtual reality device provided by the invention, the data size to be processed can be reduced on the premise of guaranteeing better sound effect of the binaural signals, so as to improve the processing efficiency of the binaural signals.
Description
Technical field
The present invention relates to signal processing technology field, be specifically related to sound field in a kind of virtual reality device
Processing method and processing device.
Background technology
Presenting to user with virtual reality helmet (head-mounted display, HMD)
During content, audio content is play to user often through stereophone.
At present, a kind of method generating virtual reality sound field is to use number of people recording, directly obtains double
Ear signal.Specifically, can be recorded by the number of people in N number of direction, obtain the ears in N number of direction
Signal.Then the binaural signal in other direction can be carried out interpolation, thus obtain head any
The binaural signal during anglec of rotation.Another way is that audio object is used HRTF (Head
Related Transfer Function, head related transfer function) or BRIR (Binaural Room
Impulse Response, ears house impulse response) wave filter is filtered such that it is able to calculate
Obtain binaural signal.By HRTF or the BRIR filter filtering in N number of direction, obtain N number of side
To binaural signal.Similarly, then the binaural signal in other direction can be carried out interpolation, from
And obtain the head binaural signal when any anglec of rotation.
Therefore, although above-mentioned two kinds of methods are different, but ultimate principle is all by multiple sides
To binaural signal interpolation obtain the head binaural signal when any anglec of rotation.This way
Advantage is can to recover head in any anglec of rotation with the interpolation arithmetic that complexity is relatively low at broadcasting end
Binaural signal when spending.But shortcoming is that i.e. N is less if the direction of the binaural signal obtained is less
Time, the precision of interpolation is relatively low, so that the audio of binaural signal that interpolation obtains is poor.
Whereas if in order to ensure interpolation precision, then need to obtain binaural signal in more direction, that
Like this need data volume to be processed the biggest, it is impossible to ensure that interpolation obtains the effect of binaural signal
Rate.
It should be noted that introduction to technical background above is intended merely to the convenient technical side to the application
Case carries out clear, complete explanation, and facilitates the understanding of those skilled in the art to illustrate.No
Can be merely because these schemes be set forth at the background section of the application and think above-mentioned skill
Art scheme is known to those skilled in the art.
Summary of the invention
It is an object of the invention to provide processing method and the dress of sound field in a kind of virtual reality device
Put, it is possible in the case of ensureing that binaural signal audio is preferably, reduce and need data volume to be processed,
To improve the efficiency that binaural signal processes.
For achieving the above object, the place of sound field during one aspect of the present invention provides a kind of virtual reality device
Reason method, described method includes: the binaural signal of predetermined predetermined number, described predetermined number
Binaural signal be distributed in all directions centered by user's head, described predetermined number double
Ear signal includes the sampling binaural signal of the first predetermined number and the super-sampling pair of the second predetermined number
Ear signal；The sampling binaural signal of described first predetermined number is fitted, obtains described second
The super-sampling binaural signal of predetermined number；According to the level angle of user's head rotation, determine and institute
State the immediate first super-sampling binaural signal of level angle and the second super-sampling binaural signal；To institute
State the first super-sampling binaural signal and described second super-sampling binaural signal carry out interpolation, obtain with
The current binaural signal that described level angle is corresponding, and play described current binaural signal to user.
Further, the binaural signal of described predetermined number is each side centered by user's head
Upwards it is spacedly distributed.
Further, the binaural signal of described predetermined number is big at the distributed quantity of user's head front
In the distributed quantity at user's head back side.
Further, according to the following equation the sampling binaural signal of described first predetermined number is carried out
Matching, obtains the super-sampling binaural signal of described second predetermined number:
Wherein, SjRepresent jth super-sampling binaural signal, BiFor ith sample binaural signal, N
For described first predetermined number, M is described second predetermined number, Pj,iFor for jth super-sampling
Double youngster's signals, the fitting coefficient that ith sample binaural signal is corresponding.
Further, after obtaining the super-sampling binaural signal of described second predetermined number, described
Method also includes: sampling binaural signal and each fitting coefficient of described first predetermined number are deposited
Store up to virtual reality device.
Further, to described first super-sampling binaural signal and described second super-sampling ears letter
Number carry out interpolation, obtain the current binaural signal corresponding with described level angle and specifically include:
First angle corresponding according to described level angle, described first super-sampling binaural signal and
The second angle that described second super-sampling binaural signal is corresponding, determines linear interpolation coefficient；Based on institute
State linear interpolation coefficient, described first super-sampling binaural signal and described second super-sampling ears letter
Number, determine the current binaural signal corresponding with described level angle.
Further, linear interpolation coefficient is determined according to the following equation:
Wherein, g represents described linear interpolation coefficient, and θ is described level angle, θ1For described first
Angle, θ2For described second angle；
Determine the current binaural signal corresponding with described level angle according to the following equation:
Bp=(1-g) V1+g·V2
Wherein, BpFor described current binaural signal, V1For described first super-sampling binaural signal, V2For
Described second super-sampling binaural signal.
For achieving the above object, sound field during another aspect of the present invention also provides for a kind of virtual reality device
Processing means, described processing means includes: binaural signal distribution unit, for predetermined pre-
If the binaural signal of quantity, each centered by user's head of the binaural signal of described predetermined number
Being distributed on individual direction, the binaural signal of described predetermined number includes that the sampling of the first predetermined number is double
The super-sampling binaural signal of ear signal and the second predetermined number；Fitting unit, for described first
The sampling binaural signal of predetermined number is fitted, and the super-sampling obtaining described second predetermined number is double
Ear signal；Binaural signal determines unit, for the level angle according to user's head rotation, determines
First super-sampling binaural signal immediate with described level angle and the second super-sampling binaural signal；
Interpolating unit, for described first super-sampling binaural signal and described second super-sampling ears letter
Number carry out interpolation, obtain the current binaural signal corresponding with described level angle, and broadcast to user
Put described current binaural signal.
Further, described fitting unit sampling to described first predetermined number according to the following equation
Binaural signal is fitted, and obtains the super-sampling binaural signal of described second predetermined number:
Wherein, SjRepresent jth super-sampling binaural signal, BiFor ith sample binaural signal, N
For described first predetermined number, M is described second predetermined number, Pj,iFor for jth super-sampling
Double youngster's signals, the fitting coefficient that ith sample binaural signal is corresponding.
Further, described interpolating unit specifically includes: interpolation coefficient determines module, for basis
Described level angle, the first angle and described second that described first super-sampling binaural signal is corresponding
The second angle that super-sampling binaural signal is corresponding, determines linear interpolation coefficient；Current binaural signal is true
Cover half block, for based on described linear interpolation coefficient, described first super-sampling binaural signal and institute
State the second super-sampling binaural signal, determine the current binaural signal corresponding with described level angle.
Therefore, the processing method of sound field and dress in a kind of virtual reality device that the present invention provides
Put, matching can be carried out obtain the second predetermined number by the sampling binaural signal of the first predetermined number
Super-sampling binaural signal.In this case, just can according to the rotational angle of user's head,
Select the first corresponding super-sampling binaural signal and the second super-sampling binaural signal such that it is able to insert
It is worth to the binaural signal possessing preferable audio.Owing to the present invention has only to enter sampling binaural signal
Row processes, and the quantity of binaural signal of sampling is the most less, it is therefore desirable to the data volume of process is the most past
Toward less, thus decrease and need data volume to be processed, improve the efficiency that binaural signal processes.
With reference to explanation hereinafter and accompanying drawing, disclose in detail the particular implementation of the application, indicate
The principle of the application can in adopted mode.It should be understood that presently filed embodiment is at model
Place and be not so limited.In the range of the spirit and terms of claims, this Shen
Embodiment please includes many changes, revises and be equal to.
The feature described for a kind of embodiment and/or illustrate can be in same or similar mode
One or more other embodiment uses, combined with the feature in other embodiment,
Or substitute the feature in other embodiment.
It should be emphasized that term " includes/comprises " referring to when using feature, one integral piece, step or group herein
The existence of part, but it is not precluded from depositing of one or more further feature, one integral piece, step or assembly
Or additional.
Accompanying drawing explanation
The process of sound field in a kind of virtual reality device that Fig. 1 provides for the application detailed description of the invention
Method flow diagram；
Fig. 2 is the distribution schematic diagram of binaural signal in the application detailed description of the invention；
Fig. 3 is the distribution schematic diagram of binaural signal in another detailed description of the invention of the application；
Fig. 4 is the schematic diagram of user's head rotation in the application detailed description of the invention；
The process of sound field in a kind of virtual reality device that Fig. 5 provides for the application detailed description of the invention
The functional block diagram of device.
Detailed description of the invention
For the technical scheme making those skilled in the art be more fully understood that in the application, below will
In conjunction with the accompanying drawing in the application embodiment, the technical scheme in the application embodiment is carried out clearly
Chu, it is fully described by, it is clear that described embodiment is only a part of embodiment party of the application
Formula rather than whole embodiments.Based on the embodiment in the application, the common skill in this area
Other embodiments all that art personnel are obtained under not making creative work premise, all answer
When the scope belonging to the application protection.
The application embodiment provides the processing method of sound field in a kind of virtual reality device.Refer to
Fig. 1, said method comprising the steps of.
Step S1: the binaural signal of predetermined predetermined number, the binaural signal of described predetermined number
All directions centered by user's head are distributed, the binaural signal of described predetermined number wraps
Include sampling binaural signal and the super-sampling binaural signal of the second predetermined number of the first predetermined number.
In this embodiment, the binaural signal of described predetermined number can be distributed in and use account
The surrounding in portion.Specifically, the binaural signal of described predetermined number can be distributed in and with user's head be
In all directions at center.Referring to Fig. 2, the binaural signal of described predetermined number can be equally spaced
It is distributed in all directions centered by user's head.As in figure 2 it is shown, described binaural signal
Quantity can be 12, and wherein, bigger circle can represent sampling binaural signal, less circle
Shape can represent super-sampling binaural signal, and the angle interval between the adjacent binaural signal of each two is permissible
It it is 30 degree.In fig. 2, the number of described sampling binaural signal can be 4, described super-sampling
The number of binaural signal can be 8.
In the present embodiment, can be recorded by the number of people or the calculation of HRTF, obtain
The binaural signal of each sound source in the binaural signal of described predetermined number.So, as in figure 2 it is shown,
For user's head, all can there is an accurate binaural signal every the directions of 30 degree.
It should be noted that in the present embodiment, the binaural signal of described predetermined number can also
It is not spacedly distributed.Higher to the resolution in sound field space, front in view of human ear, and to rear
The resolution in sound field space is relatively low, therefore can be distributed more binaural signal in user's head front,
And less binaural signal it is distributed at user's head back side.It is to say, described predetermined number is double
Ear signal can be more than the distribution number at user's head back side at the distributed quantity of user's head front
Amount.Refer to Fig. 3,9 binaural signals can be distributed in user's head front, and at user's head
The back side then can only be distributed 3 binaural signals.
Step S2: be fitted the sampling binaural signal of described first predetermined number, obtains described
The super-sampling binaural signal of the second predetermined number.
If considering the binaural signal of described predetermined number is all processed, then need to process
Data volume will be the hugest.Therefore, in the present embodiment, described first can be simply used
The sampling binaural signal of predetermined number, and can be by matching for other super-sampling binaural signal
Mode obtains.Specifically, in the present embodiment can be double to the sampling of described first predetermined number
Ear signal is fitted, thus obtains the super-sampling binaural signal of described second predetermined number.
As a example by 4 sampling binaural signals, in the present embodiment, it is possible to use these 4 samplings
Binaural signal, is fitted each super-sampling binaural signal.Specifically, in the present embodiment,
By following formula, the sampling binaural signal of described first predetermined number can be fitted, obtain
The super-sampling binaural signal of described second predetermined number:
Wherein, SjRepresent jth super-sampling binaural signal, BiFor ith sample binaural signal, N
For described first predetermined number, M is described second predetermined number, Pj,iFor for jth super-sampling
Binaural signal, the fitting coefficient that ith sample binaural signal is corresponding.
So, super-sampling binaural signal just can be by the sampling binaural signal of described first predetermined number
And fitting coefficient determines.
In the present embodiment, described first predetermined number can be stored in virtual reality device
Sampling binaural signal and each fitting coefficient, so, follow-up just can be only to described first pre-
If the sampling binaural signal of quantity and each fitting coefficient process, just can be obtained other each
Individual super-sampling binaural signal.As a example by Fig. 2, it is only necessary to store 0 degree, 90 degree, 180 degree and
The sampling binaural signal of 270 degree of these four directions and each fitting coefficient, just can obtain other 8
Individual super-sampling binaural signal, thus decrease and need data volume to be processed.
Step S3: according to the level angle of user's head rotation, determines and connects most with described level angle
The first near super-sampling binaural signal and the second super-sampling binaural signal.
In the present embodiment, the binaural signal of described predetermined number all can be by sampling binaural signal
Represent.So, according to the level angle of user's head rotation, the ears of correspondence can just be selected
User is play binaural signal by signal.
Specifically, refer to Fig. 4, after user's head turns right, faced by direction can be round
Solid circles location on week.Binaural signal is there is not in this position.This embodiment party
In formula, can determine closest with described level angle according to the level angle of user's head rotation
The first super-sampling binaural signal and the second super-sampling binaural signal.As shown in Figure 4, with described reality
The circular immediate first super-sampling binaural signal of the heart can be super-sampling binaural signal 1, the second over-extraction
Sample binaural signal can be super-sampling binaural signal 2.So, in the present embodiment, can be by institute
State the first super-sampling binaural signal and the second super-sampling binaural signal synthesizes ears to be played jointly
Signal.
Step S4: to described first super-sampling binaural signal and described second super-sampling binaural signal
Carry out interpolation, obtain the current binaural signal corresponding with described level angle, and play to user
Described current binaural signal.
In the present embodiment, described first super-sampling binaural signal and the second super-sampling are being determined
After binaural signal, can be double to described first super-sampling binaural signal and described second super-sampling
Ear signal carries out interpolation, thus obtains the current binaural signal corresponding with described level angle.Tool
Body ground, can previously according to described level angle, described first super-sampling binaural signal corresponding the
One angle and the second angle corresponding to described second super-sampling binaural signal, determine linear interpolation system
Number.By described linear interpolation coefficient, may be constructed the first super-sampling binaural signal and the second over-extraction
The weight coefficient of sample binaural signal, when described level angle and the first angle closer to time, the first surpass
The weight coefficient that sampling binaural signal is corresponding then should be the biggest.Similarly, when described level angle with
Second angle closer to time, the weight coefficient that the second super-sampling binaural signal is corresponding then should be the biggest.
In the present embodiment, described linear interpolation coefficient can be determined according to the following equation:
Wherein, g represents described linear interpolation coefficient, and θ is described level angle, θ1For described first
Angle, θ2For described second angle.
From above formula, when level angle and the first angle closer to time, linear interpolation coefficient is the least；
And when level angle and the first angle further away from time, linear interpolation coefficient is the biggest.
In the present embodiment, can be based on described linear interpolation coefficient, described first super-sampling pair
Ear signal and described second super-sampling binaural signal, determine work as corresponding with described level angle
Front binaural signal.Specifically, can determine according to the following equation corresponding with described level angle
Current binaural signal:
Bp=(1-g) V1+g·V2
Wherein, BpFor described current binaural signal, V1For described first super-sampling binaural signal, V2For
Described second super-sampling binaural signal.
In above formula, (1-g) can be considered as the weight coefficient that the first super-sampling binaural signal is corresponding.So
When level angle and the first angle closer to time, linear interpolation coefficient is the least, and (1-g) is the biggest；When
Level angle and the second angle closer to time, linear interpolation coefficient is the biggest.Therefore, above formula is permissible
Position relationship between reflection level angle and the first angle and the second angle very accurately.
After obtaining described current binaural signal, just can be play to user by virtual reality device
Described current binaural signal.
Therefore, the present invention has only to process sampling binaural signal and each fitting coefficient,
Just can obtain can be suitable with the angle of user's head rotation current binaural signal, not only need
Data volume to be processed is little, and the audio of final current binaural signal is also very good.
It should be noted that owing to sampling binaural signal is often symmetric, therefore, at this
Can also utilize the symmetry of binaural signal in bright, reducing further needs data volume to be processed.From
In Fig. 2 it is seen that, contrary about the binaural signal of 0 degree and 180 degree, the most contrary.Therefore,
Symmetry and acoustic characteristic can be relied in the present embodiment to use the binaural signal of 0 degree to process
To the binaural signal of 180 degree of approximation.Specifically, left and right on the contrary can be by exchange left and right ear
Signal realizes；Time delay low pass filter can be utilized the most on the contrary according to the difference before and after sound source
Realize.So, the data being stored in virtual reality device the most only need the binaural signal of 0 degree
Binaural signal the two signal with 90 degree, create a further reduction the data volume of required process.
The present invention also provides for the processing means of sound field in a kind of virtual reality device, refers to Fig. 5, institute
State device to include:
Binaural signal distribution unit 100, for predefining the binaural signal of predetermined number, described pre-
If the binaural signal of quantity is distributed in all directions centered by user's head, described present count
The binaural signal of amount includes the sampling binaural signal of the first predetermined number and the super of the second predetermined number
Sampling binaural signal；
Fitting unit 200, for the sampling binaural signal of described first predetermined number is fitted,
Obtain the super-sampling binaural signal of described second predetermined number；
Binaural signal determines unit 300, for according to the level angle of user's head rotation, determine with
The immediate first super-sampling binaural signal of described level angle and the second super-sampling binaural signal；
Interpolating unit 400, for described first super-sampling binaural signal and described second super-sampling
Binaural signal carries out interpolation, obtains the current binaural signal corresponding with described level angle, and to
User plays described current binaural signal.
In one preferred implementation of the application, described fitting unit 200 can be according to following public affairs
The sampling binaural signal of described first predetermined number is fitted by formula, obtains described second present count
The super-sampling binaural signal of amount:
Wherein, SjRepresent jth super-sampling binaural signal, BiFor ith sample binaural signal, N
For described first predetermined number, M is described second predetermined number, Pj,iFor for jth super-sampling
Double youngster's signals, the fitting coefficient that ith sample binaural signal is corresponding.
In one preferred implementation of the application, described interpolating unit 400 specifically may include that
Interpolation coefficient determines module, for according to described level angle, described first super-sampling ears
The first angle that signal is corresponding and the second angle corresponding to described second super-sampling binaural signal, really
Constant linear interpolation coefficient；
Current binaural signal determines module, for based on described linear interpolation coefficient, described the first surpass
Sampling binaural signal and described second super-sampling binaural signal, determine relative with described level angle
The current binaural signal answered.
It should be noted that the specific implementation of each functional module above-mentioned and computing formula are equal
Consistent with the description in step S1 to S4, the most just repeat no more.
Therefore, the processing method of sound field and dress in a kind of virtual reality device that the present invention provides
Put, matching can be carried out obtain the second predetermined number by the sampling binaural signal of the first predetermined number
Super-sampling binaural signal.In this case, just can according to the rotational angle of user's head,
Select the first corresponding super-sampling binaural signal and the second super-sampling binaural signal such that it is able to insert
It is worth to the binaural signal possessing preferable audio.Owing to the present invention has only to enter sampling binaural signal
Row processes, and the quantity of binaural signal of sampling is the most less, it is therefore desirable to the data volume of process is the most past
Toward less, thus decrease and need data volume to be processed, improve the efficiency that binaural signal processes.
Although, the most the present invention has been made detailed with general explanation and specific embodiment
Describing, but on the basis of the present invention, can make some modifications or improvements it, this is to this area skill
It is apparent from for art personnel.Therefore, done without departing from theon the basis of the spirit of the present invention
These modifications or improvements, belong to the scope of protection of present invention.
Claims (10)
1. the processing method of sound field in a virtual reality device, it is characterised in that described process side
Method includes:
The binaural signal of predetermined predetermined number, the binaural signal of described predetermined number is with user
Being distributed in all directions centered by head, the binaural signal of described predetermined number includes that first is pre-
If the sampling binaural signal of quantity and the super-sampling binaural signal of the second predetermined number；
The sampling binaural signal of described first predetermined number is fitted, obtains described second and preset
The super-sampling binaural signal of quantity；
According to the level angle of user's head rotation, determine immediate with described level angle first
Super-sampling binaural signal and the second super-sampling binaural signal；
Described first super-sampling binaural signal and described second super-sampling binaural signal are inserted
Value, obtains the current binaural signal corresponding with described level angle, and plays described working as to user
Front binaural signal.
Processing method the most according to claim 1, it is characterised in that described predetermined number
Binaural signal is spacedly distributed in all directions centered by user's head.
Processing method the most according to claim 1, it is characterised in that described predetermined number
Binaural signal is more than the distributed quantity at user's head back side at the distributed quantity of user's head front.
Processing method the most according to claim 1, it is characterised in that the most right
The sampling binaural signal of described first predetermined number is fitted, and obtains described second predetermined number
Super-sampling binaural signal:
Wherein, SjRepresent jth super-sampling binaural signal, BiFor ith sample binaural signal, N
For described first predetermined number, M is described second predetermined number, Pj,iFor for jth super-sampling
Double youngster's signals, the fitting coefficient that ith sample binaural signal is corresponding.
Processing method the most according to claim 4, it is characterised in that obtaining described second
After the super-sampling binaural signal of predetermined number, described method also includes: by described first present count
Sampling binaural signal and each fitting coefficient of amount store to virtual reality device.
Processing method the most according to claim 1, it is characterised in that to described first over-extraction
Sample binaural signal and described second super-sampling binaural signal carry out interpolation, obtain and described horizontal angle
Spend corresponding current binaural signal to specifically include:
First angle corresponding according to described level angle, described first super-sampling binaural signal and
The second angle that described second super-sampling binaural signal is corresponding, determines linear interpolation coefficient；Based on institute
State linear interpolation coefficient, described first super-sampling binaural signal and described second super-sampling ears letter
Number, determine the current binaural signal corresponding with described level angle.
Processing method the most according to claim 6, it is characterised in that the most true
Constant linear interpolation coefficient:
Wherein, g represents described linear interpolation coefficient, and θ is described level angle, θ1For described first
Angle, θ2For described second angle；
Determine the current binaural signal corresponding with described level angle according to the following equation:
Bp=(1-g) V1+g·V2
Wherein, BpFor described current binaural signal, V1For described first super-sampling binaural signal, V2For
Described second super-sampling binaural signal.
8. the processing means of sound field in a virtual reality device, it is characterised in that described process fills
Put and include:
Binaural signal distribution unit, for predefining the binaural signal of predetermined number, described default
The binaural signal of quantity is distributed in all directions centered by user's head, described predetermined number
Binaural signal include the sampling binaural signal and the over-extraction of the second predetermined number of the first predetermined number
Sample binaural signal；
Fitting unit, for the sampling binaural signal of described first predetermined number is fitted,
Super-sampling binaural signal to described second predetermined number；
Binaural signal determines unit, for the level angle according to user's head rotation, determines and institute
State the immediate first super-sampling binaural signal of level angle and the second super-sampling binaural signal；
Interpolating unit, for double to described first super-sampling binaural signal and described second super-sampling
Ear signal carries out interpolation, obtains the current binaural signal corresponding with described level angle, and to
Described current binaural signal is play at family.
Processing means the most according to claim 8, it is characterised in that described fitting unit is pressed
According to following formula, the sampling binaural signal of described first predetermined number is fitted, obtains described
The super-sampling binaural signal of two predetermined numbers:
Wherein, SjRepresent jth super-sampling binaural signal, BiFor ith sample binaural signal, N
For described first predetermined number, M is described second predetermined number, Pj,iFor for jth super-sampling
Double youngster's signals, the fitting coefficient that ith sample binaural signal is corresponding.
Processing means the most according to claim 8, it is characterised in that described interpolating unit
Specifically include:
Interpolation coefficient determines module, for according to described level angle, described first super-sampling ears
The first angle that signal is corresponding and the second angle corresponding to described second super-sampling binaural signal, really
Constant linear interpolation coefficient；
Current binaural signal determines module, for based on described linear interpolation coefficient, described the first surpass
Sampling binaural signal and described second super-sampling binaural signal, determine relative with described level angle
The current binaural signal answered.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610538406.4A CN105959877B (en) | 2016-07-08 | 2016-07-08 | Method and device for processing sound field in virtual reality equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610538406.4A CN105959877B (en) | 2016-07-08 | 2016-07-08 | Method and device for processing sound field in virtual reality equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105959877A true CN105959877A (en) | 2016-09-21 |
| CN105959877B CN105959877B (en) | 2020-09-01 |
Family
ID=56899981
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610538406.4A Active CN105959877B (en) | 2016-07-08 | 2016-07-08 | Method and device for processing sound field in virtual reality equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105959877B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108279860A (en) * | 2017-06-14 | 2018-07-13 | 深圳市佳创视讯技术股份有限公司 | It is a kind of promoted virtual reality come personally audio experience method and system |
| CN110881157A (en) * | 2018-09-06 | 2020-03-13 | 宏碁股份有限公司 | Sound effect control method and sound effect output device for orthogonal base correction |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20010040968A1 (en) * | 1996-12-12 | 2001-11-15 | Masahiro Mukojima | Method of positioning sound image with distance adjustment |
| US20040091119A1 (en) * | 2002-11-08 | 2004-05-13 | Ramani Duraiswami | Method for measurement of head related transfer functions |
| US7116788B1 (en) * | 2002-01-17 | 2006-10-03 | Conexant Systems, Inc. | Efficient head related transfer function filter generation |
| CN101263741A (en) * | 2005-09-13 | 2008-09-10 | 皇家飞利浦电子股份有限公司 | Method of and device for generating and processing parameters representing HRTFs |
| US20100080396A1 (en) * | 2007-03-15 | 2010-04-01 | Oki Electric Industry Co.Ltd | Sound image localization processor, Method, and program |
| CN103563401A (en) * | 2011-06-09 | 2014-02-05 | 索尼爱立信移动通讯有限公司 | Reducing head-related transfer function data volume |
| WO2014189550A1 (en) * | 2013-05-24 | 2014-11-27 | University Of Maryland | Statistical modelling, interpolation, measurement and anthropometry based prediction of head-related transfer functions |
| CN104205878A (en) * | 2012-03-23 | 2014-12-10 | 杜比实验室特许公司 | Method and system for head-related transfer function generation by linear mixing of head-related transfer functions |
| CN104503963A (en) * | 2014-09-26 | 2015-04-08 | 大连理工大学 | Method for processing head-related impulse response data set |
-
2016
- 2016-07-08 CN CN201610538406.4A patent/CN105959877B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20010040968A1 (en) * | 1996-12-12 | 2001-11-15 | Masahiro Mukojima | Method of positioning sound image with distance adjustment |
| US7116788B1 (en) * | 2002-01-17 | 2006-10-03 | Conexant Systems, Inc. | Efficient head related transfer function filter generation |
| US20040091119A1 (en) * | 2002-11-08 | 2004-05-13 | Ramani Duraiswami | Method for measurement of head related transfer functions |
| CN101263741A (en) * | 2005-09-13 | 2008-09-10 | 皇家飞利浦电子股份有限公司 | Method of and device for generating and processing parameters representing HRTFs |
| US20100080396A1 (en) * | 2007-03-15 | 2010-04-01 | Oki Electric Industry Co.Ltd | Sound image localization processor, Method, and program |
| CN103563401A (en) * | 2011-06-09 | 2014-02-05 | 索尼爱立信移动通讯有限公司 | Reducing head-related transfer function data volume |
| CN104205878A (en) * | 2012-03-23 | 2014-12-10 | 杜比实验室特许公司 | Method and system for head-related transfer function generation by linear mixing of head-related transfer functions |
| WO2014189550A1 (en) * | 2013-05-24 | 2014-11-27 | University Of Maryland | Statistical modelling, interpolation, measurement and anthropometry based prediction of head-related transfer functions |
| CN104503963A (en) * | 2014-09-26 | 2015-04-08 | 大连理工大学 | Method for processing head-related impulse response data set |
Non-Patent Citations (2)
| Title |
|---|
| 刘阳，谢菠荪: ""HRTF空间插值与多通路声重放的稳定性分析"", 《华南理工大学学报》 * |
| 汪林: ""多通道语音信号处理中的关键技术研究——声场重构与语音分离"", 《中国博士学位论文全文数据库 信息科技辑》 * |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108279860A (en) * | 2017-06-14 | 2018-07-13 | 深圳市佳创视讯技术股份有限公司 | It is a kind of promoted virtual reality come personally audio experience method and system |
| CN108279860B (en) * | 2017-06-14 | 2021-05-14 | 深圳市佳创视讯技术股份有限公司 | Method and system for improving virtual reality in-situ sound effect experience |
| CN110881157A (en) * | 2018-09-06 | 2020-03-13 | 宏碁股份有限公司 | Sound effect control method and sound effect output device for orthogonal base correction |
| CN110881157B (en) * | 2018-09-06 | 2021-08-10 | 宏碁股份有限公司 | Sound effect control method and sound effect output device for orthogonal base correction |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105959877B (en) | 2020-09-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Begault et al. | Direct comparison of the impact of head tracking, reverberation, and individualized head-related transfer functions on the spatial perception of a virtual speech source | |
| CN104869524B (en) | Sound processing method and device in three-dimensional virtual scene | |
| Middlebrooks | Virtual localization improved by scaling nonindividualized external-ear transfer functions in frequency | |
| Brown et al. | An efficient HRTF model for 3-D sound | |
| EP1551205B1 (en) | Method and device for enhancing spatial audio in a teleconference system | |
| Gardner et al. | Problem of localization in the median plane: effect of pinnae cavity occlusion | |
| EP3375207B1 (en) | An audio signal processing apparatus and method | |
| Spagnol et al. | Current use and future perspectives of spatial audio technologies in electronic travel aids | |
| Sunder et al. | Individualization of binaural synthesis using frontal projection headphones | |
| Oberem et al. | Experiments on localization accuracy with non-individual and individual HRTFs comparing static and dynamic reproduction methods | |
| CN110544532A (en) | sound source space positioning ability detecting system based on APP | |
| Kan et al. | A psychophysical evaluation of near-field head-related transfer functions synthesized using a distance variation function | |
| US9560464B2 (en) | System and method for producing head-externalized 3D audio through headphones | |
| Lindau | Binaural resynthesis of acoustical environments: technology and perceptual evaluation | |
| CN105959877A (en) | Sound field processing method and apparatus in virtual reality device | |
| Rumsey | Whose head is it anyway? Optimizing binaural audio | |
| Senova et al. | Localization of virtual sound as a function of head-related impulse response duration | |
| Wenzel | What perception implies about implementation of interactive virtual acoustic environments | |
| Richter et al. | Evaluation of localization accuracy of static sources using HRTFs from a fast measurement system | |
| Lentz et al. | Realisation of an adaptive cross-talk cancellation system for a moving listener | |
| Li et al. | Towards Mobile 3D HRTF Measurement | |
| Lindau | Binaural resynthesis of acoustical environments | |
| Li et al. | The impact of trajectories of head and source movements on perceived externalization of a frontal sound source | |
| Tan et al. | Direct concha excitation for introduction of individualized hearing cues | |
| CN1466401A (en) | Method for producing stereo sound effect |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| PE01 | Entry into force of the registration of the contract for pledge of patent right | ||
| PE01 | Entry into force of the registration of the contract for pledge of patent right |
Denomination of invention: A method and device for processing sound field in virtual reality equipment Effective date of registration: 20221026 Granted publication date: 20200901 Pledgee: Zhongguancun Beijing technology financing Company limited by guarantee Pledgor: BEIJING TUOLING Inc. Registration number: Y2022990000750 |