CN206908863U - The virtual acoustic processing system of dynamic space in VR TVs - Google Patents
The virtual acoustic processing system of dynamic space in VR TVs Download PDFInfo
- Publication number
- CN206908863U CN206908863U CN201720525390.3U CN201720525390U CN206908863U CN 206908863 U CN206908863 U CN 206908863U CN 201720525390 U CN201720525390 U CN 201720525390U CN 206908863 U CN206908863 U CN 206908863U
- Authority
- CN
- China
- Prior art keywords
- virtual speaker
- virtual
- transfer function
- signal
- input signal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Stereophonic System (AREA)
Abstract
The utility model discloses the virtual acoustic processing system of dynamic space in a kind of VR TVs, including VR TV remote controllers, first processor, calling module and second processor.First processor is used for the head orientation angle information of the setting angle calculation user according to reference coordinate, Orientation differences command information and virtual speaker.Calling module draws the relative azimuth angle between head and virtual speaker for the setting angle of read head orientation angles information and virtual speaker；From head-position difficult labor database recall corresponding to relative azimuth angle transfer function or match with closest to the corresponding transfer function of certain relative azimuth angle in head-position difficult labor database.Second processor is used to carry out process of convolution to input signal according to transfer function to generate the first path signal and alternate path signal.The utility model audio signal according to corresponding to the position output that spectators user moves, and then be advantageous to improve the immersion experience of spectators user.
Description
Technical field
It the utility model is related to a kind of data processing technique, it is dynamic in more particularly to a kind of VR TVs based on virtual reality
The virtual acoustic processing system of state space.
Background technology
With the appearance of VR TVs, spectators user watches the traditional mode of TV there occurs great change, when user watches
During VR TVs, VR audio signal typically resets the sound in virtual reality by audio-frequence player device (such as earphone).Spectators use
Family can control video screen picture so as to convert viewing visual angle by remote control, when watching virtual reality imagery, with void
Intend the change of the scene, plot of reality, the action behavior of spectators user can also may change therewith.For example, in a virtual reality
Scene in, fantasy football match scene in sportsman court batting runs, or in virtual TV play war scene spectators use
Sound suddenly behind shot or the explosive sound at family, the head of user can usually rotate naturally.However, when the action of spectators user
When behavior changes, for a user, the orientation of sound source is varied in virtual reality, but the sound that spectators user wears
The orientation for the sound source reset in frequency playback equipment (such as earphone) does not make corresponding changes but, so greatly influences virtual reality
The feeling of immersion built, reduce the effect of Consumer's Experience.
Utility model content
In view of the foregoing, it is necessary to provide at the dynamic space Virtual Sound in a kind of VR TVs for improving Consumer's Experience
Reason system.
A kind of dynamic space virtual acoustic processing system in VR TVs, including：
One VR TV remote controllers, the Orientation differences of a certain VR pictures are watched to instruct corresponding to a user for exporting one
Information；
One first processor, the Orientation differences command information exported for obtaining the VR TV remote controllers, and according to
One trigger condition and the Orientation differences command information set a reference coordinate；The first processor is additionally operable to be sat according to the reference
Mark, the head orientation angle information of Orientation differences command information and the setting angle calculation of some virtual speakers user；
One calling module, the setting angle for reading the head orientation angle information and some virtual speakers are drawn
Relative azimuth angle between current head and each virtual speaker；The calling module is additionally operable to according to a head-position difficult labor
Database recall corresponding to the relative azimuth angle transfer function or match with closest to this associated transport letter
The corresponding transfer function of a certain relative azimuth angle in number database；And
One second processor, for receiving an input signal, the second processor is additionally operable to according to the transfer function pair
The input signal carries out process of convolution, is believed with generating corresponding to one first path signal of a playback equipment and an alternate path
Number.
Further, first processor described above includes a renderer, and the renderer is used to obtain VR TV remotes
The Orientation differences command information of device output, a reference coordinate is set according to a trigger condition and the Orientation differences command information；And
For current according to the setting angle calculation of the reference coordinate, the Orientation differences command information and some virtual speakers user
Head orientation angle information.
Further, head orientation angle information described above includes a horizontal angle and an elevation angle, when spectators user enters
When watching the initial time of VR TV programme, Orientation differences command information that the first processor exports to the VR TV remote controllers
In the horizontal angle that includes and the elevation angle initialized.
Further, second processor described above includes a real-time convolution module, for receiving an input signal, and
The transfer function of each virtual speaker exported according to calling module carries out real-time process of convolution to the input signal, with generation pair
The first path signal and alternate path signal of Ying Yuyi playback equipments.
Further, one of which situation, the stereosonic audio that input signal described above includes a binary channel are believed
Number, the stereo of the binary channel has a left virtual speaker and a right virtual speaker, wherein left virtual speaker and right void
Intend left front and right front that loudspeaker is respectively arranged at user.
Further, the second processor is carried out at convolution according to the transfer function of each virtual speaker to the input signal
Managing the first obtained path signal includes：
The second processor carries out what process of convolution obtained according to the transfer function of each virtual speaker to the input signal
Alternate path signal includes：
Wherein, L is the first path signal, and R is alternate path signal,Convolution operation is represented, l is in the input signal
Left path signal, r be the input signal in right path signal, hrirl(θ0- θ, φ) corresponding right virtual speaker-left ear biography
Defeated function, hrirr(θ0- θ, φ) corresponding right virtual speaker-auris dextra transfer function,It is corresponding left
The transfer function of virtual speaker-left ear,The transfer function of corresponding left virtual speaker-auris dextra,
Wherein θ0=30 °.
Another situation, input signal described above include the audio signal of the surround sound of a multi-path, the multi-path
Surround sound there is a left front virtual speaker, a right front virtual speaker, virtual speaker is put in one, one left back is virtually raised one's voice
Virtual speaker and a bass virtual speaker behind device, a right side, wherein, left front virtual speaker, right front virtual speaker, in put
Virtual speaker, left back virtual speaker, it is right after virtual speaker be respectively arranged at the left front of user, right front, front,
Left back and right back.
Further, the second processor is carried out at convolution according to the transfer function of each virtual speaker to the input signal
Managing the first obtained path signal includes：
The second processor carries out what process of convolution obtained according to the transfer function of each virtual speaker to the input signal
Alternate path signal includes：
Wherein, L is the first path signal, and R is alternate path signal,Convolution operation is represented, l is in the input signal
Left path signal, r are the right path signal in the input signal, and ls is that the left side in the input signal surround acoustical signal, and rs is should
Right surround acoustical signal in input signal, c be in the input signal in put path signal, lfe is low in the input signal
Sound path signal,The transfer function of corresponding right front virtual speaker-left ear,Before the corresponding right side
The transfer function of virtual speaker-auris dextra,The transfer function of corresponding left front virtual speaker-left ear,The transfer function of corresponding left front virtual speaker-auris dextra,Virtually raised one's voice behind the corresponding right side
The transfer function of device-left ear,The transfer function of virtual speaker-auris dextra behind the corresponding right side,
The transfer function of corresponding left back virtual speaker-left ear,The biography of corresponding left back virtual speaker-auris dextra
Defeated function, wherein θ0=30 °, θs=110 °±10°。
Further, playback equipment described above is the earphone that spectators user wears, for resetting through the second processing
The first path signal and alternate path signal obtained after device processing.
The virtual acoustic processing system of dynamic space in the VR TVs that the invention is related to is current by obtaining spectators user
Head and the relative azimuth angle of each virtual speaker, and recalled from a head-position difficult labor database corresponding to described relative
The transfer function of orientation angles or by match with closest to a certain contra in the head-position difficult labor database
The corresponding transfer function of parallactic angle degree, and an input signal is received, according to the transfer function of each virtual speaker to the input
Signal carries out process of convolution, so can root to generate the first path signal and alternate path signal corresponding to a playback equipment
According to audio signal corresponding to the position output of spectators user's movement, and then be advantageous to improve the immersion experience of spectators user.
Brief description of the drawings
Fig. 1 is the block diagram of the virtual acoustic processing system of dynamic space in the utility model VR TVs；
Fig. 2 is the block diagram of better embodiment in Fig. 1；
Fig. 3 is that the virtual acoustic processing system of dynamic space in VR TVs is applied to corresponding to a stereosonic audio signal
Orientation angles schematic diagram；
Fig. 4 is that the virtual acoustic processing system of dynamic space in VR TVs is applied to corresponding to the audio signal of a surround sound
Orientation angles schematic diagram；
Fig. 5 is the better embodiment that second processor carries out process of convolution to a stereosonic audio signal in Fig. 2
Schematic diagram；
Fig. 6 is the better embodiment that second processor carries out process of convolution to the audio signal of a surround sound in Fig. 2
Schematic diagram；
Fig. 7 is the stream of the better embodiment of processing method corresponding to the virtual acoustic processing system of dynamic space in VR TVs
Cheng Tu.
Main element symbol description
| First processor | 20 |
| Second processor | 50 |
| VR TV remote controllers | 10 |
| Calling module | 30 |
| Input signal | 40 |
| Playback equipment | 60 |
| Renderer | 200 |
| Real-time convolution module | 500 |
Embodiment
Referring to Fig. 1, the better embodiment bag of the virtual acoustic processing system of dynamic space in the utility model VR TVs
Include：
VR TV remote controllers 10, the Orientation differences of a certain VR pictures are watched to instruct corresponding to a user for exporting one
Information；
First processor 20, touched for obtaining the Orientation differences command information of the output of VR TV remote controllers 10, and according to one
Clockwork spring part and the Orientation differences command information set a reference coordinate；First processor 20 is additionally operable to according to the reference coordinate, side
The head orientation angle information of position change command information and the setting angle calculation of some virtual speakers user；
Calling module 30, the setting angle for reading the head orientation angle information and some virtual speakers are drawn
Relative azimuth angle between active user head and virtual speaker；Calling module 30 is additionally operable to according to an associated transport letter
Number databases recall corresponding to the relative azimuth angle transfer function or match with closest to this associated transport
The corresponding transfer function of a certain relative azimuth angle in function data storehouse；And
Second processor 50, for receiving an input signal 40, second processor 50 is additionally operable to according to the transfer function
Process of convolution is carried out to input signal 40, believed with the first path signal and alternate path that generate corresponding to a playback equipment 60
Number.Playback equipment 60 is used to reset the audio signal obtained after the second processor 50 processing.
In present embodiment, the Orientation differences command information that VR TV remote controllers 10 export includes corresponding to conversion VR TVs
The stairstep signal of the Orientation differences such as representative left/right/up/down of angle of view.Typically set in VR TV remote controllers 10
Sensor is equipped with, the action message of user is sensed by sensor and action message progress conversion process is obtained into the stepping and believe
Number, it is transferred to first processor 20.
Also referring to Fig. 2, in this better embodiment, first processor 20 includes a renderer 200, the renderer
200 obtain the Orientation differences command information (such as stairstep signal) of the output of VR TV remote controllers 10, according to a trigger condition and the party
Position change command information sets a reference coordinate；Renderer 200 is according to the reference coordinate, Orientation differences command information and some void
The current head orientation angle information of the setting angle calculation of the plan loudspeaker user, the head orientation angle information include a water
A straight angle θ and elevation angle φ, wherein horizontal angle θ are the water of the current gaze and the major axes orientation of the main camera of VR TVs of spectators user
Flat angle, because the major axes orientation of main camera when shooting is normally at horizontal plane；Elevation angle φ be spectators user current gaze with
The angle of horizontal plane residing for the major axes orientation of the main camera of VR TVs.First processor 20 is calculated by the renderer 200
Obtain the current head orientation angle information of the user (including horizontal angle θ and elevation angle φ) and be transferred to calling module 30.More enter
One step, in present embodiment, when user watches the initial time of VR TV programme, the renderer 200 will receive what is obtained
Action message is arranged to the reference coordinate.For example, when spectators user enters the initial time of viewing VR TV programme, this is rendered
The direction of spectators user is positioned as front and (the Orientation differences command information of the output of VR TV remote controllers 10 entered by device 200
Row initialization), such as will now the renderer 200 according to the reference coordinate, Orientation differences command information and some virtual speakers
The setting angle calculation horizontal angle θ schools that obtain including in the current head orientation angle information of the user be 0 degree, elevation angle φ schools
For 0 degree, namely set the eye-level display of spectators user parallel with the major axes orientation (i.e. earth horizontal plane) of the main camera of VR TVs.
In other embodiments, user also can set the reference coordinate by a function button, such as when the function button is triggered
When, the action message now received is then arranged to the reference coordinate by the renderer 200.
Also referring to Fig. 2, in present embodiment, calling module 30 reads the user being calculated by renderer 200
Current head orientation angle information (θ, φ), and setting the head orientation angle information (θ, φ) and some virtual speakers
Angle setting degree is overlapped processing, to obtain the relative azimuth angle between active user head and each virtual speaker.
Also referring to Fig. 2, in present embodiment, second processor 50 includes a real-time convolution module 500, and it is defeated to receive one
Enter signal 40, transfer function (the Head Related Transfer of each virtual speaker exported according to calling module 30
Function, abbreviation HRTF) real-time process of convolution is carried out to the input signal 40, to generate the corresponding to a playback equipment 60
One path signal and alternate path signal.Real-time convolution module 500 can use a DSP (Digital Signal
Processing, Digital Signal Processing) chip realization.
In present embodiment, playback equipment 60 is the earphone that spectators user wears, for resetting through the second processor 50
The audio signal obtained after processing.The playback equipment 60 is used for the stereosonic audio signal of a binary channel or multi-path
The audio signal of surround sound carries out replay action.There is the stereo of the binary channel a left virtual speaker and a right side virtually to raise
Sound device, wherein left virtual speaker and right virtual speaker are respectively arranged at the left front and right front of user；The multi-path
Surround sound can be the surround sound of 5.1 paths, have to put in a left front virtual speaker, a right front virtual speaker, one and virtually raise
Virtual speaker and a bass virtual speaker (also referred to as mega bass big gun) behind sound device, a left back virtual speaker, a right side, its
In, left front virtual speaker, right front virtual speaker, in put virtual speaker, left back virtual speaker, it is right after virtual speaker
It is respectively arranged at left front, right front, front, left back and the right back of spectators user.
Also referring to Fig. 3, for the stereosonic audio signal of binary channel, when initial, left virtual speaker l and front
The horizontal angle of central axis is (360 ° of-θ0), the horizontal angle of right virtual speaker r and front central axis be θ0.I.e. for double
Path is stereo, and left virtual speaker l setting angle is (360 ° of-θ0), right virtual speaker r setting angle is θ0.This reality
Apply in mode, the θ in stereo international standard0=30 °.In this way, the calling module 30 is according to the current head orientation angle of user
Spend information (θ, φ) and setting angle (360 ° of-θ of left virtual speaker0), the setting angle, θ of right virtual speaker0It is overlapped
Obtained after processing：Relative azimuth angle between active user head and left virtual speaker l, right virtual speaker r is respectively
(360°-θ0- θ, φ), (θ0-θ,φ)。
Also referring to Fig. 4, for the audio signal of multi-path (by taking 5.1 paths as an example) surround sound, when initial, left front void
The horizontal angle for intending loudspeaker l and front central axis is (360 ° of-θ0), right front virtual speaker r and front central axis
Horizontal angle be θ0, in put virtual speaker c and be arranged at (not shown) at 0 ° of the front of user, left back virtual speaker ls with
The horizontal angle of front central axis is (360 ° of-θs), it is right after virtual speaker rs and front central axis horizontal angle be
θs.In present embodiment, recommend θ in surround sound international standards=110 ° ± 10 °.I.e. left front virtual speaker l setting angle
For (360 ° of-θ0), right front virtual speaker r setting angle be θ0, in put virtual speaker c setting angle and (scheme not for 0 ° of place
Show), left back virtual speaker ls setting angle is (360 ° of-θs), it is right after virtual speaker rs setting angle be θs.In this way,
The head of active user behind left front virtual speaker l, right front virtual speaker r, left back virtual speaker ls, the right side with virtually raising one's voice
Device rs relative azimuth angle is (360 ° of-θ0- θ, φ), (θ0- θ, φ), (360 ° of-θs- θ, φ) and (θs-θ,φ).This implementation
In mode, virtual speaker c and bass virtual speaker lfe are put in, the calling module 30 put by virtual speaker c and
Bass virtual speaker lfe path signal is multiplied by 0.707 (i.e.) after feed back to respectively front left front void
Intend loudspeaker l and right front virtual speaker r path signal.
In present embodiment, the calling module 30 can position to the audio of each virtual speaker.The calling module 30
Recall and correspond to according to a head-position difficult labor (Head Related Transfer Function, abbreviation HRTF) database
The transfer function of the relative azimuth angle or match with closest to a certain phase in the head-position difficult labor database
The corresponding transfer function of azimuthal degree, and export the transfer function (HRTF) of each virtual speaker.
Referring to Fig. 5, for binary channel stereosonic audio signal when, the input signal 40 has a left path signal
The right path signal r of l and one.The calling module 30 is recalled corresponding to described relative from a head-position difficult labor (HRTF) database
The transfer function forms of time and space of orientation angles(corresponding right virtual speaker-left ear),It is (right
Answer right virtual speaker-auris dextra),(corresponding left virtual speaker-left ear),
(corresponding left virtual speaker-auris dextra), or match with closest to a certain relative in the head-position difficult labor database
The corresponding transfer function forms of time and space of orientation angles.The real-time convolution module 500 is by input signal 40 and corresponding contra
The calling value of parallactic angle degree carries out real-time convolutional calculation, with the first path signal L and alternate path signal R after being handled, and
First path signal L and alternate path signal R are exported to playback equipment 60, wherein：
Wherein,Convolution operation is represented, l is the left path signal in the input signal, and r is that the right side in the input signal leads to
Road signal, hrirl(θ0- θ, φ) corresponding right virtual speaker-left ear transfer function, hrirr(θ0- θ, φ) it is corresponding right virtual
The transfer function of loudspeaker-auris dextra,The transfer function of corresponding left virtual speaker-left ear,The transfer function of corresponding left virtual speaker-auris dextra, θ0=30 °.
Referring to Fig. 6, when the audio signal to a surround sound (by taking 5.1 paths as an example) carries out convolution operation, the calling
From the beginning module 30 calls in related HRTF databases the transfer function forms of time and space corresponding to the relative azimuth angle to be(corresponding right front virtual speaker-left ear),(corresponding right front virtual speaker-auris dextra),(corresponding left front virtual speaker-left ear),It is (correspondingly left front virtually to raise
Sound device-auris dextra),(virtual speaker-left ear behind the corresponding right side),(virtually raised behind the corresponding right side
Sound device-auris dextra),(corresponding left back virtual speaker-left ear),It is (corresponding
Left back virtual speaker-auris dextra), or match to closest to a certain relative azimuth angle in the related HRTF databases of this
Corresponding transfer function forms of time and space.The real-time convolution module 500 is by input signal 40 and corresponding relative azimuth angle
Calling value carries out real-time convolutional calculation, is exported and is set to broadcasting with the first path signal L after being handled and alternate path signal R
Standby 60, wherein：
Wherein,Convolution operation is represented, l is the left path signal in the input signal, and r is that the right side in the input signal leads to
Road signal, ls are that the left side in the input signal surround acoustical signal, and rs is the right surround acoustical signal in the input signal, and c is defeated for this
Path signal is put in entering in signal, lfe is the bass path signal in the input signal,It is empty before the corresponding right side
Intend the transfer function of loudspeaker-left ear,The transfer function of corresponding right front virtual speaker-auris dextra,The transfer function of corresponding left front virtual speaker-left ear,It is corresponding left
The transfer function of preceding virtual speaker-auris dextra,The transfer function of virtual speaker-left ear behind the corresponding right side,The transfer function of virtual speaker-auris dextra behind the corresponding right side,It is corresponding left back virtual
The transfer function of loudspeaker-left ear,The transfer function of corresponding left back virtual speaker-auris dextra, its
Middle θ0=30 °, θs=110 ° ± 10 °.
Referring to Fig. 7, Fig. 7 is illustrated that corresponding to the virtual acoustic processing system of dynamic space in the utility model VR TVs
The flow chart of the better embodiment of processing method, from figure, comprising the following steps：
The Orientation differences of a certain VR pictures are watched to instruct corresponding to a user by VR TV remote controllers output one
Information；
Obtain the Orientation differences command information of VR TV remote controllers output；
One reference coordinate is set according to a trigger condition and the Orientation differences command information；
According to the setting angle calculation of the reference coordinate, the Orientation differences command information and some virtual speakers user's
Head orientation angle information；
The setting angle for reading the head orientation angle information and some virtual speakers draws current head and each void
Intend the relative azimuth angle between loudspeaker；
According to a head-position difficult labor database recall corresponding to the relative azimuth angle transfer function or
Be fitted on closest to the corresponding transfer function of a certain relative azimuth angle in the head-position difficult labor database；
An input signal is received, the input signal is carried out at convolution according to the transfer function of each virtual speaker
Reason, one first path signal and an alternate path signal of the generation corresponding to a playback equipment.
Further, the head orientation angle information includes a horizontal angle and an elevation angle, and the dynamic in the VR TVs is empty
Between virtual acoustic processing method also include：, will be to the VR TVs when spectators user enters the initial time of viewing VR TV programme
The horizontal angle and the elevation angle included in the Orientation differences command information of remote control output is initialized.
The virtual acoustic processing system of dynamic space and processing method in above-mentioned VR TVs work as front by obtaining spectators user
Portion and the relative azimuth angle of each virtual speaker, and recalled from a head-position difficult labor database corresponding to the contra
The transfer function of parallactic angle degree or by match with closest to a certain relative bearing in the head-position difficult labor database
The corresponding transfer function of angle, and an input signal is received, the input is believed according to the transfer function of each virtual speaker
Number carry out process of convolution, with generate corresponding to a playback equipment the first path signal and alternate path signal, so can basis
Audio signal corresponding to the position output of spectators user's movement, and then be advantageous to improve the immersion experience of spectators user.
The invention has advantages below：
1. can real-time tracking spectators visual angle change, enhance the feeling of immersion of virtual reality.
It is 2. widely applicable.The system is applicable to stereo and around acoustical signal headphone virtual reality and reset, basic to contain
Include the audio signal in existing TV storage program.
It should be noted that in the description of the invention, term " first ", " second " etc. are only used for describing purpose,
And it is not intended that instruction or hint relative importance.
Any process or method described otherwise above description in flow chart or herein is construed as, and represents to include
Module, fragment or the portion of the code of the executable instruction of one or more the step of being used to realize specific logical function or process
Point, and the scope of the preferred embodiment of the invention includes other realization, wherein can not press shown or discuss
Order, including according to involved function by it is basic simultaneously in the way of or in the opposite order, carry out perform function, this should be by this
The embodiment person of ordinary skill in the field of innovation and creation is understood.
It should be appreciated that each several part of the invention can be realized with hardware, software, firmware or combinations thereof.
In above-mentioned embodiment, what multiple steps or method can be performed in memory and by suitable instruction execution system with storage
Software or firmware are realized.If, and in another embodiment, can be with known in this field for example, realized with hardware
Any one of following technology or their combination realize：With the gate for realizing logic function to data-signal
The discrete logic of circuit, the application specific integrated circuit with suitable combinational logic gate circuit, programmable gate array (PGA),
Field programmable gate array (FPGA) etc..
Although the embodiment of the invention has been shown and described above, it is to be understood that above-described embodiment is
Exemplary, it is impossible to it is interpreted as the limitation to the invention, scope of the one of ordinary skill in the art in the invention
It is interior above-described embodiment to be changed, changed, replaced and modification.
Claims (9)
- A kind of 1. virtual acoustic processing system of dynamic space in VR TVs, it is characterised in that including：One VR TV remote controllers, for exporting an Orientation differences instruction letter for corresponding to a user and watching a certain VR pictures Breath；One first processor, touched for obtaining the Orientation differences command information of VR TV remote controllers output, and according to one Clockwork spring part and the Orientation differences command information set a reference coordinate；The first processor is additionally operable to according to the reference coordinate, side The head orientation angle information of position change command information and the setting angle calculation of some virtual speakers user；One calling module, the setting angle for reading the head orientation angle information and some virtual speakers are drawn currently Relative azimuth angle between head and each virtual speaker；The calling module is additionally operable to according to a head-position difficult labor data Storehouse recall corresponding to the relative azimuth angle transfer function or match with closest to the head-position difficult labor number According to the corresponding transfer function of a certain relative azimuth angle in storehouse；AndOne second processor, for receiving an input signal, the second processor is additionally operable to defeated to this according to the transfer function Enter signal and carry out process of convolution, to generate one first path signal and an alternate path signal corresponding to a playback equipment.
- 2. the virtual acoustic processing system of dynamic space in VR TVs as claimed in claim 1, it is characterised in that at described first Reason device includes a renderer, and the renderer is used for the Orientation differences command information for obtaining the output of VR TV remote controllers, touched according to one Clockwork spring part and the Orientation differences command information set a reference coordinate；And for according to the reference coordinate, Orientation differences instruction letter Breath and the current head orientation angle information of the setting angle calculation of some virtual speakers user.
- 3. the virtual acoustic processing system of dynamic space in VR TVs as claimed in claim 1, it is characterised in that the head side Parallactic angle degree information includes a horizontal angle and an elevation angle, and when spectators user enters the initial time of viewing VR TV programme, this The horizontal angle and the elevation angle included in the Orientation differences command information that one processor exports to the VR TV remote controllers initializes.
- 4. the virtual acoustic processing system of dynamic space in VR TVs as claimed in claim 1, it is characterised in that at described second Reason device includes a real-time convolution module, for receiving an input signal, and according to each virtual speaker of calling module output Transfer function carries out real-time process of convolution to the input signal, to generate the first path signal and the corresponding to a playback equipment Two path signals.
- 5. the virtual acoustic processing system of dynamic space in the VR TVs as described in any one of Claims 1-4, it is characterised in that The input signal includes the stereosonic audio signal of a binary channel, the binary channel it is stereo have a left virtual speaker and One right virtual speaker, wherein left virtual speaker and right virtual speaker are respectively arranged at the left front and right front of user.
- 6. the virtual acoustic processing system of dynamic space in VR TVs as claimed in claim 5, it is characterised in that the second processing The first path signal that device obtains according to the transfer function of each virtual speaker to input signal progress process of convolution includes：The second processor carries out second that process of convolution obtains according to the transfer function of each virtual speaker to the input signal Path signal includes：Wherein, L is the first path signal, and R is alternate path signal,Convolution operation is represented, l is that the left side in the input signal leads to Road signal, r be the input signal in right path signal, hrirl(θ0- θ, φ) corresponding right virtual speaker-left ear transmission letter Number, hrirr(θ0- θ, φ) corresponding right virtual speaker-auris dextra transfer function,It is corresponding left virtual The transfer function of loudspeaker-left ear,The transfer function of corresponding left virtual speaker-auris dextra, wherein θ0 =30 °.
- 7. the virtual acoustic processing system of dynamic space in the VR TVs as described in any one of Claims 1-4, it is characterised in that The audio signal of the surround sound of the input signal an including multi-path, the surround sound of the multi-path have one left front virtually to raise one's voice Virtual speaker and one low is put behind virtual speaker, a left back virtual speaker, a right side in device, a right front virtual speaker, one Sound virtual speaker, wherein, left front virtual speaker, right front virtual speaker, in put virtual speaker, left back virtually raise one's voice Virtual speaker is respectively arranged at left front, right front, front, left back and the right back of user behind device, the right side.
- 8. the virtual acoustic processing system of dynamic space in VR TVs as claimed in claim 7, it is characterised in that the second processing The first path signal that device obtains according to the transfer function of each virtual speaker to input signal progress process of convolution includes：The second processor carries out second that process of convolution obtains according to the transfer function of each virtual speaker to the input signal Path signal includes：Wherein, L is the first path signal, and R is alternate path signal,Convolution operation is represented, l is that the left side in the input signal leads to Road signal, r are the right path signal in the input signal, and ls is that the left side in the input signal surround acoustical signal, and rs is the input Right surround acoustical signal in signal, c be in the input signal in put path signal, lfe is that the bass in the input signal leads to Road signal,The transfer function of corresponding right front virtual speaker-left ear,Corresponding right front virtual The transfer function of loudspeaker-auris dextra,The transfer function of corresponding left front virtual speaker-left ear,The transfer function of corresponding left front virtual speaker-auris dextra,Virtually raised behind the corresponding right side The transfer function of sound device-left ear,The transfer function of virtual speaker-auris dextra behind the corresponding right side,The transfer function of corresponding left back virtual speaker-left ear,It is corresponding left back The transfer function of virtual speaker-auris dextra, wherein θ0=30 °, θs=110 ° ± 10 °.
- 9. the virtual acoustic processing system of dynamic space in the VR TVs as described in any one of Claims 1-4, it is characterised in that The playback equipment is the earphone that spectators user wears, for resetting the first path letter obtained after second processor processing Number and alternate path signal.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201720525390.3U CN206908863U (en) | 2017-05-11 | 2017-05-11 | The virtual acoustic processing system of dynamic space in VR TVs |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201720525390.3U CN206908863U (en) | 2017-05-11 | 2017-05-11 | The virtual acoustic processing system of dynamic space in VR TVs |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN206908863U true CN206908863U (en) | 2018-01-19 |
Family
ID=61288509
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201720525390.3U Active CN206908863U (en) | 2017-05-11 | 2017-05-11 | The virtual acoustic processing system of dynamic space in VR TVs |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN206908863U (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2020087678A1 (en) * | 2018-11-01 | 2020-05-07 | 华南理工大学 | Surround-sound virtual playback method in multi-channel three-dimensional space |
-
2017
- 2017-05-11 CN CN201720525390.3U patent/CN206908863U/en active Active
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2020087678A1 (en) * | 2018-11-01 | 2020-05-07 | 华南理工大学 | Surround-sound virtual playback method in multi-channel three-dimensional space |
| US11962995B2 (en) | 2018-11-01 | 2024-04-16 | South China University Of Technology | Virtual playback method for surround-sound in multi-channel three-dimensional space |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10863159B2 (en) | Field-of-view prediction method based on contextual information for 360-degree VR video | |
| CN107182021A (en) | The virtual acoustic processing system of dynamic space and processing method in VR TVs | |
| US9767618B2 (en) | Adaptive ambisonic binaural rendering | |
| US6741273B1 (en) | Video camera controlled surround sound | |
| US11055057B2 (en) | Apparatus and associated methods in the field of virtual reality | |
| CN106465036B (en) | Configure the playback of the audio via home audio playback system | |
| JP2017518663A (en) | 3D viewing | |
| US11917391B2 (en) | Audio signal processing method and apparatus | |
| WO2016123901A1 (en) | Terminal and method for directionally playing audio signal thereby | |
| CN103002376A (en) | Method for orientationally transmitting voice and electronic equipment | |
| CN106572425A (en) | Audio processing device and method | |
| EP3422744B1 (en) | An apparatus and associated methods | |
| TWI709131B (en) | Audio scene processing | |
| US20220225050A1 (en) | Head tracked spatial audio and/or video rendering | |
| JP2021535632A (en) | Methods and equipment for processing audio signals | |
| CN114067810A (en) | Audio signal rendering method and device | |
| US11856386B2 (en) | Apparatus and method for processing audiovisual data | |
| CN206908863U (en) | The virtual acoustic processing system of dynamic space in VR TVs | |
| US20220345844A1 (en) | Electronic apparatus for audio signal processing and operating method thereof | |
| CN112135226B (en) | Y-axis audio reproduction method and Y-axis audio reproduction system | |
| WO2019174442A1 (en) | Adapterization equipment, voice output method, device, storage medium and electronic device | |
| TWI733219B (en) | Audio signal adjusting method and audio signal adjusting device | |
| US20230283976A1 (en) | Device and rendering environment tracking | |
| EP4221263A1 (en) | Head tracking and hrtf prediction | |
| Batke et al. | Recording spatial audio signals for interactive broadcast systems |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| GR01 | Patent grant | ||
| GR01 | Patent grant |