CN107182021A - The virtual acoustic processing system of dynamic space and processing method in VR TVs - Google Patents
The virtual acoustic processing system of dynamic space and processing method in VR TVs Download PDFInfo
- Publication number
- CN107182021A CN107182021A CN201710331233.3A CN201710331233A CN107182021A CN 107182021 A CN107182021 A CN 107182021A CN 201710331233 A CN201710331233 A CN 201710331233A CN 107182021 A CN107182021 A CN 107182021A
- Authority
- CN
- China
- Prior art keywords
- virtual speaker
- transfer function
- virtual
- signal
- input signal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S3/00—Systems employing more than two channels, e.g. quadraphonic
- H04S3/008—Systems employing more than two channels, e.g. quadraphonic in which the audio signals are in digital form, i.e. employing more than two discrete digital channels
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
- H04S7/30—Control circuits for electronic adaptation of the sound field
- H04S7/302—Electronic adaptation of stereophonic sound system to listener position or orientation
- H04S7/303—Tracking of listener position or orientation
- H04S7/304—For headphones
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
- H04S2400/11—Positioning of individual sound objects, e.g. moving airplane, within a sound field
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S2420/00—Techniques used stereophonic systems covered by H04S but not provided for in its groups
- H04S2420/01—Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
Abstract
The invention discloses the virtual acoustic processing system of dynamic space in a kind of VR TVs and method, the processing system includes VR TV remote controllers, first processor, calling module and second processor.Wherein first processor is according to the head orientation angle information of the setting angle calculation user of reference coordinate, Orientation differences command information and virtual speaker.Calling module read head orientation angles information and the setting angle of virtual speaker draw the relative azimuth angle between head and virtual speaker；From head-position difficult labor database recall corresponding to relative azimuth angle transfer function or match with closest to the corresponding transfer function of certain relative azimuth angle in head-position difficult labor database.Second processor carries out process of convolution to generate the first path signal and alternate path signal according to transfer function to input signal.The position that the present invention is moved according to spectators user exports corresponding audio signal, and then is conducive to improving the immersion experience of spectators user.
Description
Technical field
The present invention relates to a kind of data processing technique, the dynamic in more particularly to a kind of VR TVs based on virtual reality is empty
Between virtual acoustic processing system and processing method.
Background technology
With the appearance of VR TVs, the traditional mode of spectators user's viewing TV there occurs great change, when user's viewing
During VR TVs, VR audio signal typically resets the sound in virtual reality by audio-frequence player device (such as earphone).Spectators use
Family can control video screen picture to convert viewing visual angle by remote control, when watching virtual reality imagery, with void
Intend scene, the change of plot of reality, the action behavior of spectators user can also may change therewith.For example, in a virtual reality
Scene in, in fantasy football match scene sportsman in court, batting is run, or spectators use in the acute war scene of virtual TV
Sound suddenly after one's death shot or the explosive sound at family, the head of user can usually be rotated naturally.However, when the action of spectators user
When behavior changes, for a user, the orientation of sound source is varied in virtual reality, but the sound that spectators user wears
The orientation for the sound source reset in frequency playback equipment (such as earphone) does not make corresponding changes but, so greatly influences virtual reality
The feeling of immersion built, reduces the effect of Consumer's Experience.
The content of the invention
In view of the foregoing, it is necessary to provide at the dynamic space Virtual Sound in a kind of VR TVs for improving Consumer's Experience
Reason system and processing method.
A kind of dynamic space virtual acoustic processing system in VR TVs, including：
One VR TV remote controllers, watch the Orientation differences of a certain VR pictures to instruct for output one corresponding to a user
Information；
One first processor, the Orientation differences command information for obtaining VR TV remote controllers output, and according to
One trigger condition and the Orientation differences command information set a reference coordinate；The first processor is additionally operable to be sat according to the reference
Mark, the head orientation angle information of Orientation differences command information and the setting angle calculation of some virtual speakers user；
One calling module, the setting angle for reading the head orientation angle information and some virtual speakers is drawn
Relative azimuth angle between current head and each virtual speaker；The calling module is additionally operable to according to a head-position difficult labor
Database recall corresponding to the relative azimuth angle transfer function or match with closest to this associated transport letter
The corresponding transfer function of a certain relative azimuth angle in number database；And
One second processor, for receiving an input signal, the second processor is additionally operable to according to the transfer function pair
The input signal carries out process of convolution, is believed with one first path signal and an alternate path that generate corresponding to a playback equipment
Number.
A kind of dynamic space virtual acoustic processing method in VR TVs, including：
The Orientation differences of a certain VR pictures are watched to instruct corresponding to a user by VR TV remote controllers output one
Information；
Obtain the Orientation differences command information of VR TV remote controllers output；
One reference coordinate is set according to a trigger condition and the Orientation differences command information；
According to the setting angle calculation of the reference coordinate, the Orientation differences command information and some virtual speakers user's
Head orientation angle information；
The setting angle for reading the head orientation angle information and some virtual speakers draws current head and each void
Intend the relative azimuth angle between loudspeaker；
According to a head-position difficult labor database recall corresponding to the relative azimuth angle transfer function or
Be fitted on closest to the corresponding transfer function of a certain relative azimuth angle in the head-position difficult labor database；And
An input signal is received, process of convolution is carried out to the input signal according to the transfer function of each virtual speaker, it is raw
Into one first path signal and an alternate path signal corresponding to a playback equipment.
Further, head orientation angle information described above includes a horizontal angle and an elevation angle, and the processing method is also wrapped
Include：When spectators user enters the initial time of viewing VR TV programme, the Orientation differences that the VR TV remote controllers will be exported
The horizontal angle and the elevation angle included in command information is initialized.
Further, one of which situation, the stereosonic audio that input signal described above includes a binary channel is believed
Number, the stereo of the binary channel has a left virtual speaker and a right virtual speaker, wherein left virtual speaker and right void
Intend left front and right front that loudspeaker is respectively arranged at user, the processing method also includes：
Process of convolution is carried out to the input signal according to the transfer function of each virtual speaker and obtains the first path signal bag
Include：
Process of convolution is carried out to the input signal according to the transfer function of each virtual speaker and obtains alternate path signal bag
Include：
Wherein, L is the first path signal, and R is alternate path signal,Convolution operation is represented, l is in the input signal
Left path signal, r is the right path signal in the input signal, hrirl(θ0- θ, φ) the right virtual speaker-left ear of correspondence biography
Defeated function, hrirr(θ0- θ, φ) the right virtual speaker-auris dextra of correspondence transfer function,Correspondence is left
The transfer function of virtual speaker-left ear,The transfer function of the left virtual speaker-auris dextra of correspondence,
Wherein θ0=30 °.
Another situation, input signal described above includes the audio signal of the surround sound of a multi-path, the multi-path
Surround sound have virtual speaker put in a left front virtual speaker, a right front virtual speaker, one, one left back is virtually raised one's voice
Virtual speaker and a bass virtual speaker behind device, a right side, wherein, left front virtual speaker, right front virtual speaker, in put
Virtual speaker, left back virtual speaker, it is right after virtual speaker be respectively arranged at the left front of user, right front, front,
Left back and right back, the processing method also include：
Process of convolution is carried out to the input signal according to the transfer function of each virtual speaker and obtains the first path signal bag
Include：
Process of convolution is carried out to the input signal according to the transfer function of each virtual speaker and obtains alternate path signal bag
Include：
Wherein, L is the first path signal, and R is alternate path signal,Convolution operation is represented, l is in the input signal
Left path signal, r is the right path signal in the input signal, and ls is that the left side in the input signal surround acoustical signal, and rs is should
Right surround acoustical signal in input signal, c be in the input signal in put path signal, lfe is low in the input signal
Sound path signal,The transfer function of correspondence right front virtual speaker-left ear,Before correspondence is right
The transfer function of virtual speaker-auris dextra,The transmission letter of the left front virtual speaker-left ear of correspondence
Number,The transfer function of the left front virtual speaker-auris dextra of correspondence,It is empty after correspondence is right
Intend the transfer function of loudspeaker-left ear,The transfer function of virtual speaker-auris dextra after correspondence is right,The transfer function of the left back virtual speaker-left ear of correspondence,Correspondence is left back
The transfer function of virtual speaker-auris dextra, wherein θ0=30 °, θs=110 ° ± 10 °.
The virtual acoustic processing system of dynamic space and processing method in the VR TVs that the invention is related to are seen by obtaining
The relative azimuth angle of many user's current heads and each virtual speaker, and recall correspondence from a head-position difficult labor database
In the relative azimuth angle transfer function or by match with closest in the head-position difficult labor database
The corresponding transfer function of a certain relative azimuth angle, and an input signal is received, according to the transmission letter of each virtual speaker
It is several that process of convolution is carried out to the input signal, believed with the first path signal and alternate path that generate corresponding to a playback equipment
Number, the position that can be so moved according to spectators user exports corresponding audio signal, and then is conducive to improving the heavy of spectators user
Immersion is experienced.
Brief description of the drawings
Fig. 1 is the block diagram of the virtual acoustic processing system of dynamic space in VR TVs of the present invention；
Fig. 2 is the block diagram of better embodiment in Fig. 1；
Fig. 3 is that the virtual acoustic processing system of dynamic space in VR TVs of the present invention is applied to a stereosonic audio signal institute
Corresponding orientation angles schematic diagram；
Fig. 4 is the audio signal institute that the virtual acoustic processing system of dynamic space in VR TVs of the present invention is applied to a surround sound
Corresponding orientation angles schematic diagram；
Fig. 5 is the better embodiment that second processor carries out process of convolution to a stereosonic audio signal in Fig. 2
Schematic diagram；
Fig. 6 is the better embodiment that second processor carries out process of convolution to the audio signal of a surround sound in Fig. 2
Schematic diagram；
Fig. 7 is the flow chart of the better embodiment of the virtual acoustic processing method of dynamic space in VR TVs of the present invention.
Main element symbol description
| First processor | 20 |
| Second processor | 50 |
| VR TV remote controllers | 10 |
| Calling module | 30 |
| Input signal | 40 |
| Playback equipment | 60 |
| Renderer | 200 |
| Real-time convolution module | 500 |
Embodiment
Referring to Fig. 1, the better embodiment of the virtual acoustic processing system of dynamic space in VR TVs of the present invention includes：
VR TV remote controllers 10, watch the Orientation differences of a certain VR pictures to instruct for output one corresponding to a user
Information；
First processor 20, the Orientation differences command information for obtaining the output of VR TV remote controllers 10, and touched according to one
Clockwork spring part and the Orientation differences command information set a reference coordinate；First processor 20 is additionally operable to according to the reference coordinate, side
The head orientation angle information of position change command information and the setting angle calculation of some virtual speakers user；
Calling module 30, the setting angle for reading the head orientation angle information and some virtual speakers is drawn
Relative azimuth angle between active user head and virtual speaker；Calling module 30 is additionally operable to according to an associated transport letter
Number databases recall corresponding to the relative azimuth angle transfer function or match with closest to this associated transport
The corresponding transfer function of a certain relative azimuth angle in function data storehouse；And
Second processor 50, for receiving an input signal 40, second processor 50 is additionally operable to according to the transfer function
Process of convolution is carried out to input signal 40, believed with the first path signal and alternate path that generate corresponding to a playback equipment 60
Number.Playback equipment 60 is used to reset the audio signal obtained after the second processor 50 processing.
In present embodiment, the Orientation differences command information that VR TV remote controllers 10 are exported includes corresponding to conversion VR TVs
The stairstep signal of the Orientation differences such as representative left/right/up/down of angle of view.Typically set in VR TV remote controllers 10
Sensor is equipped with, the action message of user is sensed by sensor and action message progress conversion process is obtained into the stepping and believe
Number, it is transferred to first processor 20.
Also referring to Fig. 2, in this better embodiment, first processor 20 includes a renderer 200, the renderer
200 obtain the Orientation differences command information (such as stairstep signal) of the output of VR TV remote controllers 10, according to a trigger condition and the party
Position change command information sets a reference coordinate；Renderer 200 is according to the reference coordinate, Orientation differences command information and some void
The current head orientation angle information of the setting angle calculation of the plan loudspeaker user, the head orientation angle information includes a water
A straight angle θ and elevation angle φ, wherein horizontal angle θ are the water of the current gaze and the major axes orientation of the main camera of VR TVs of spectators user
Flat angle, because the major axes orientation of main camera when shooting is normally at horizontal plane；Elevation angle φ for spectators user current gaze with
The angle of horizontal plane residing for the major axes orientation of the main camera of VR TVs.First processor 20 is calculated by the renderer 200
Obtain the current head orientation angle information of the user (including horizontal angle θ and elevation angle φ) and be transferred to calling module 30.More enter
One step, in present embodiment, when user watches the initial time of VR TV programme, the renderer 200 will receive what is obtained
Action message is set to the reference coordinate.For example, when spectators user enters the initial time of viewing VR TV programme, this is rendered
Device 200 is orientated the direction of spectators user as front and (the Orientation differences command information that VR TV remote controllers 10 are exported entered
Row initialization), such as will now the renderer 200 according to the reference coordinate, Orientation differences command information and some virtual speakers
Setting angle calculation to obtain the horizontal angle θ schools that are included in the current head orientation angle information of the user be 0 degree, elevation angle φ schools
For 0 degree, namely set the eye-level display of spectators user parallel with the major axes orientation (i.e. earth horizontal plane) of the main camera of VR TVs.
In other embodiments, user can also set the reference coordinate by a function button, such as when the function button is triggered
When, the action message now received is then set to the reference coordinate by the renderer 200.
Also referring to Fig. 2, in present embodiment, calling module 30 is read calculates the obtained user by renderer 200
Current head orientation angle information (θ, φ), and setting the head orientation angle information (θ, φ) and some virtual speakers
Angle setting degree is overlapped processing, to obtain the relative azimuth angle between active user head and each virtual speaker.
Also referring to Fig. 2, in present embodiment, second processor 50 includes a real-time convolution module 500, receives one defeated
Enter signal 40, transfer function (the Head Related Transfer of each virtual speaker exported according to calling module 30
Function, abbreviation HRTF) real-time process of convolution is carried out to the input signal 40, to generate the corresponding to a playback equipment 60
One path signal and alternate path signal.Real-time convolution module 500 can use a DSP (Digital Signal
Processing, Digital Signal Processing) chip realization.
In present embodiment, playback equipment 60 is the earphone that spectators user wears, for resetting through the second processor 50
The audio signal obtained after processing.The playback equipment 60 is used for the stereosonic audio signal of a binary channel or multi-path
The audio signal of surround sound carries out replay action.There is the stereo of the binary channel a left virtual speaker and a right side virtually to raise
Sound device, wherein left virtual speaker and right virtual speaker are respectively arranged at the left front and right front of user；The multi-path
Surround sound can be the surround sound of 5.1 paths, virtually be raised with being put in a left front virtual speaker, a right front virtual speaker, one
Virtual speaker and a bass virtual speaker (also referred to as mega bass big gun) behind sound device, a left back virtual speaker, a right side, its
In, left front virtual speaker, right front virtual speaker, in put virtual speaker, left back virtual speaker, it is right after virtual speaker
It is respectively arranged at left front, right front, front, left back and the right back of spectators user.
Also referring to Fig. 3, for the stereosonic audio signal of binary channel, when initial, left virtual speaker l and front
The horizontal angle of central axis is (360 ° of-θ0), the horizontal angle of right virtual speaker r and front central axis be θ0.I.e. for double
Path is stereo, and left virtual speaker l setting angle is (360 ° of-θ0), right virtual speaker r setting angle is θ0.This reality
Apply in mode, the θ in stereo international standard0=30 °.In this way, the calling module 30 is according to the current head orientation angle of user
Spend information (θ, φ) and setting angle (360 ° of-θ of left virtual speaker0), the setting angle, θ of right virtual speaker0It is overlapped
Obtained after processing：Relative azimuth angle between active user head and left virtual speaker l, right virtual speaker r is respectively
(360°-θ0- θ, φ), (θ0-θ,φ)。
Also referring to Fig. 4, for the audio signal of multi-path (by taking 5.1 paths as an example) surround sound, when initial, left front void
The horizontal angle for intending loudspeaker l and front central axis is (360 ° of-θ0), right front virtual speaker r and front central axis
Horizontal angle be θ0, in put virtual speaker c and be arranged at (not shown) at 0 ° of the front of user, left back virtual speaker ls with
The horizontal angle of front central axis is (360 ° of-θs), it is right after the horizontal angle of virtual speaker rs and front central axis be
θs.In present embodiment, θ is recommended in surround sound international standards=110 ° ± 10 °.I.e. left front virtual speaker l setting angle
For (360 ° of-θ0), right front virtual speaker r setting angle be θ0, in put virtual speaker c setting angle and (scheme not for 0 ° of place
Show), left back virtual speaker ls setting angle is (360 ° of-θs), it is right after virtual speaker rs setting angle be θs.In this way,
The head of active user behind left front virtual speaker l, right front virtual speaker r, left back virtual speaker ls, the right side with virtually raising one's voice
Device rs relative azimuth angle is (360 ° of-θ0- θ, φ), (θ0- θ, φ), (360 ° of-θs- θ, φ) and (θs-θ,φ).This implementation
In mode, virtual speaker c and bass virtual speaker lfe are put in, the calling module 30 put by virtual speaker c and
Bass virtual speaker lfe path signal is multiplied by 0.707 (i.e.) after feed back to the left front virtual of front respectively
Loudspeaker l and right front virtual speaker r path signal.
In present embodiment, the calling module 30 can be positioned to the audio of each virtual speaker.The calling module 30
Recall and correspond to according to a head-position difficult labor (Head Related Transfer Function, abbreviation HRTF) database
The transfer function of the relative azimuth angle or match with closest to a certain phase in the head-position difficult labor database
The corresponding transfer function of azimuthal degree, and export the transfer function (HRTF) of each virtual speaker.
Referring to Fig. 5, for binary channel stereosonic audio signal when, the input signal 40 have a left path signal
The right path signal r of l and one.The calling module 30 is recalled corresponding to described relative from a head-position difficult labor (HRTF) database
The transfer function forms of time and space of orientation angles(the right virtual speaker-left ear of correspondence),It is (right
Answer right virtual speaker-auris dextra),(the left virtual speaker-left ear of correspondence),(correspondence left virtual speaker-auris dextra), or match with closest to this associated transport letter
The corresponding transfer function forms of time and space of a certain relative azimuth angle in number database.The real-time convolution module 500, which will be inputted, to be believed
Numbers 40 call the value to carry out real-time convolutional calculation with corresponding relative azimuth angle, with the first path signal L after being handled
And alternate path signal R, and the first path signal L and alternate path signal R are exported to playback equipment 60, wherein：
Wherein,Convolution operation is represented, l is the left path signal in the input signal, and r is that the right side in the input signal leads to
Road signal, hrirl(θ0- θ, φ) the right virtual speaker-left ear of correspondence transfer function, hrirr(θ0- θ, φ) the correspondence right side is virtually
The transfer function of loudspeaker-auris dextra,The transfer function of the left virtual speaker-left ear of correspondence,The transfer function of the left virtual speaker-auris dextra of correspondence, θ0=30 °.
Referring to Fig. 6, when the audio signal to a surround sound (by taking 5.1 paths as an example) carries out convolution operation, this is called
From the beginning module 30 calls in correlation HRTF databases the transfer function forms of time and space corresponding to the relative azimuth angle to be(correspondence right front virtual speaker-left ear),(correspondence right front virtual speaker-auris dextra),(the left front virtual speaker-left ear of correspondence),(correspondence is left front virtually to raise
Sound device-auris dextra),(virtual speaker-left ear after correspondence is right),(correspondence is virtually raised behind the right side
Sound device-auris dextra),(the left back virtual speaker-left ear of correspondence),(correspondence
Left back virtual speaker-auris dextra), or match to closest to a certain relative azimuth angle in the related HRTF databases of this
Corresponding transfer function forms of time and space.The real-time convolution module 500 is by input signal 40 and corresponding relative azimuth angle
Call value to carry out real-time convolutional calculation, export and set to broadcasting with the first path signal L and alternate path signal R after being handled
Standby 60, wherein：
Wherein,Convolution operation is represented, l is the left path signal in the input signal, and r is that the right side in the input signal leads to
Road signal, ls is that the left side in the input signal surround acoustical signal, and rs is the right surround acoustical signal in the input signal, and c is defeated for this
Path signal is put in entering in signal, lfe is the bass path signal in the input signal,It is empty before correspondence is right
Intend the transfer function of loudspeaker-left ear,The transfer function of correspondence right front virtual speaker-auris dextra,The transfer function of the left front virtual speaker-left ear of correspondence,Correspondence is left
The transfer function of preceding virtual speaker-auris dextra,The transfer function of virtual speaker-left ear after correspondence is right,The transfer function of virtual speaker-auris dextra after correspondence is right,Correspondence is left back virtual
The transfer function of loudspeaker-left ear,The transfer function of the left back virtual speaker-auris dextra of correspondence, its
Middle θ0=30 °, θs=110 ° ± 10 °.
Referring to Fig. 7, the better embodiment of the virtual acoustic processing method of dynamic space in VR TVs of the present invention is included such as
Lower step：
The Orientation differences of a certain VR pictures are watched to instruct corresponding to a user by VR TV remote controllers output one
Information；
Obtain the Orientation differences command information of VR TV remote controllers output；
One reference coordinate is set according to a trigger condition and the Orientation differences command information；
According to the setting angle calculation of the reference coordinate, the Orientation differences command information and some virtual speakers user's
Head orientation angle information；
The setting angle for reading the head orientation angle information and some virtual speakers draws current head and each void
Intend the relative azimuth angle between loudspeaker；
According to a head-position difficult labor database recall corresponding to the relative azimuth angle transfer function or
Be fitted on closest to the corresponding transfer function of a certain relative azimuth angle in the head-position difficult labor database；
An input signal is received, the input signal is carried out at convolution according to the transfer function of each virtual speaker
Reason, one first path signal and an alternate path signal of the generation corresponding to a playback equipment.
Further, the dynamic that the head orientation angle information is included in a horizontal angle and an elevation angle, the VR TVs is empty
Between virtual acoustic processing method also include：, will be to the VR TVs when spectators user enters the initial time of viewing VR TV programme
The horizontal angle and the elevation angle included in the Orientation differences command information of remote control output is initialized.
The virtual acoustic processing system of dynamic space and processing method in above-mentioned VR TVs work as front by obtaining spectators user
Portion and the relative azimuth angle of each virtual speaker, and recalled from a head-position difficult labor database corresponding to the contra
The transfer function of parallactic angle degree or by match with closest to a certain relative bearing in the head-position difficult labor database
The corresponding transfer function of angle, and an input signal is received, the input is believed according to the transfer function of each virtual speaker
Number carry out process of convolution, with generate corresponding to a playback equipment the first path signal and alternate path signal, so can basis
The position of spectators user's movement exports corresponding audio signal, and then is conducive to improving the immersion experience of spectators user.
The present invention has advantages below：
1. can real-time tracking spectators visual angle change, enhance the feeling of immersion of virtual reality.
2. it is widely applicable.The system is applicable to stereo and around acoustical signal headphone virtual reality and reset, basic to contain
Include the audio signal in existing TV storage program.
It should be noted that in the description of the invention, term " first ", " second " etc. are only used for describing purpose, without
It is understood that to indicate or imply relative importance.
Any process described otherwise above or method description are construed as in flow chart or herein, represent to include
Module, fragment or the portion of the code of one or more executable instructions for the step of realizing specific logical function or process
Point, and the scope of the preferred embodiment of the present invention includes other realization, wherein can not be by shown or discussion suitable
Sequence, including according to involved function by it is basic simultaneously in the way of or in the opposite order, carry out perform function, this should be of the invention
Embodiment person of ordinary skill in the field understood.
It should be appreciated that each several part of the present invention can be realized with hardware, software, firmware or combinations thereof.Above-mentioned
In embodiment, the software that multiple steps or method can in memory and by suitable instruction execution system be performed with storage
Or firmware is realized.If, and in another embodiment, can be with well known in the art for example, realized with hardware
Any one of row technology or their combination are realized：With the logic gates for realizing logic function to data-signal
Discrete logic, the application specific integrated circuit with suitable combinational logic gate circuit, programmable gate array (PGA), scene
Programmable gate array (FPGA) etc..
Although embodiments of the invention have been shown and described above, it is to be understood that above-described embodiment is example
Property, it is impossible to limitation of the present invention is interpreted as, one of ordinary skill in the art within the scope of the invention can be to above-mentioned
Embodiment is changed, changed, replacing and modification.
Claims (10)
1. the virtual acoustic processing system of dynamic space in a kind of VR TVs, it is characterised in that including：
One VR TV remote controllers, correspond to the Orientation differences instruction letter that a user watches a certain VR pictures for exporting one
Breath；
One first processor, the Orientation differences command information for obtaining VR TV remote controllers output, and touched according to one
Clockwork spring part and the Orientation differences command information set a reference coordinate；The first processor is additionally operable to according to the reference coordinate, side
The head orientation angle information of position change command information and the setting angle calculation of some virtual speakers user；
One calling module, the setting angle for reading the head orientation angle information and some virtual speakers is drawn currently
Relative azimuth angle between head and each virtual speaker；The calling module is additionally operable to according to a head-position difficult labor data
Storehouse recall corresponding to the relative azimuth angle transfer function or match with closest to the head-position difficult labor number
According to the corresponding transfer function of a certain relative azimuth angle in storehouse；And
One second processor, for receiving an input signal, the second processor is additionally operable to defeated to this according to the transfer function
Enter signal and carry out process of convolution, to generate one first path signal and an alternate path signal corresponding to a playback equipment.
2. the virtual acoustic processing system of dynamic space in VR TVs as claimed in claim 1, it is characterised in that the head side
Parallactic angle degree information includes a horizontal angle and an elevation angle, and when spectators user enters the initial time of viewing VR TV programme, this
The horizontal angle and the elevation angle included in the Orientation differences command information that one processor is exported to the VR TV remote controllers is initialized.
3. the virtual acoustic processing system of dynamic space in VR TVs as claimed in claim 1 or 2, it is characterised in that the input
Signal includes the stereosonic audio signal of a binary channel, and the stereo of the binary channel has a left virtual speaker and a right void
Intend loudspeaker, wherein left virtual speaker and right virtual speaker are respectively arranged at the left front and right front of user.
4. the virtual acoustic processing system of dynamic space in VR TVs as claimed in claim 3, it is characterised in that the second processing
The first path signal that device is obtained according to the transfer function of each virtual speaker to input signal progress process of convolution includes：
The second processor carries out process of convolution is obtained second to the input signal according to the transfer function of each virtual speaker
Path signal includes：
Wherein, L is the first path signal, and R is alternate path signal,Convolution operation is represented, l is that the left side in the input signal leads to
Road signal, r is the right path signal in the input signal, hrirl(θ0- θ, φ) the right virtual speaker-left ear of correspondence transmission letter
Number, hrirr(θ0- θ, φ) the right virtual speaker-auris dextra of correspondence transfer function,Correspondence is left virtual
The transfer function of loudspeaker-left ear,The transfer function of the left virtual speaker-auris dextra of correspondence, wherein θ0
=30 °.
5. the virtual acoustic processing system of dynamic space in VR TVs as claimed in claim 1 or 2, it is characterised in that the input
Signal includes the audio signal of the surround sound of a multi-path, and the surround sound of the multi-path has a left front virtual speaker, a right side
Virtual speaker and a bass behind virtual speaker, a left back virtual speaker, a right side is put in preceding virtual speaker, one virtually to raise
Sound device, wherein, left front virtual speaker, right front virtual speaker, in put virtual speaker, left back virtual speaker, it is right after it is empty
Intend left front, right front, front, left back and right back that loudspeaker is respectively arranged at user.
6. the virtual acoustic processing system of dynamic space in VR TVs as claimed in claim 5, it is characterised in that the second processing
The first path signal that device is obtained according to the transfer function of each virtual speaker to input signal progress process of convolution includes：
The second processor carries out process of convolution is obtained second to the input signal according to the transfer function of each virtual speaker
Path signal includes：
Wherein, L is the first path signal, and R is alternate path signal,Convolution operation is represented, l is that the left side in the input signal leads to
Road signal, r is the right path signal in the input signal, and ls is that the left side in the input signal surround acoustical signal, and rs is the input
Right surround acoustical signal in signal, c be in the input signal in put path signal, lfe is that the bass in the input signal leads to
Road signal,The transfer function of correspondence right front virtual speaker-left ear,Correspondence right front virtual
The transfer function of loudspeaker-auris dextra,The transfer function of the left front virtual speaker-left ear of correspondence,The transfer function of the left front virtual speaker-auris dextra of correspondence,It is virtual after correspondence is right
The transfer function of loudspeaker-left ear,The transfer function of virtual speaker-auris dextra after correspondence is right,The transfer function of the left back virtual speaker-left ear of correspondence,Correspondence is left back
The transfer function of virtual speaker-auris dextra, wherein θ0=30 °, θs=110 ° ± 10 °.
7. the virtual acoustic processing method of dynamic space in a kind of VR TVs, it is characterised in that including：
One, which is exported, by a VR TV remote controllers corresponds to the Orientation differences command information that a user watches a certain VR pictures；
Obtain the Orientation differences command information of VR TV remote controllers output；
One reference coordinate is set according to a trigger condition and the Orientation differences command information；
According to the head of the setting angle calculation of the reference coordinate, the Orientation differences command information and some virtual speakers user
Orientation angles information；
The setting angle for reading the head orientation angle information and some virtual speakers show that current head is virtually raised with each
Relative azimuth angle between sound device；
According to a head-position difficult labor database recall corresponding to the relative azimuth angle transfer function or match
With closest to the corresponding transfer function of a certain relative azimuth angle in the head-position difficult labor database；And
An input signal is received, process of convolution is carried out to the input signal according to the transfer function of each virtual speaker, it is raw
Into one first path signal and an alternate path signal corresponding to a playback equipment.
8. the virtual acoustic processing method of dynamic space in VR TVs as claimed in claim 7, it is characterised in that the head side
Parallactic angle degree information includes a horizontal angle and an elevation angle, and the processing method also includes：
When spectators user enters the initial time of viewing VR TV programme, the Orientation differences that the VR TV remote controllers will be exported
The horizontal angle and the elevation angle included in command information is initialized.
9. the virtual acoustic processing method of dynamic space in VR TVs as claimed in claim 7 or 8, it is characterised in that the input
Signal includes the stereosonic audio signal of a binary channel, and the stereo of the binary channel has a left virtual speaker and a right void
Intend loudspeaker, wherein left virtual speaker and right virtual speaker are respectively arranged at the left front and right front of user, the processing
Method also includes：
Obtaining the first path signal to input signal progress process of convolution according to the transfer function of each virtual speaker includes：
Obtaining alternate path signal to input signal progress process of convolution according to the transfer function of each virtual speaker includes：
Wherein, L is the first path signal, and R is alternate path signal,Convolution operation is represented, l is that the left side in the input signal leads to
Road signal, r is the right path signal in the input signal, hrirl(θ0- θ, φ) the right virtual speaker-left ear of correspondence transmission letter
Number, hrirr(θ0- θ, φ) the right virtual speaker-auris dextra of correspondence transfer function,Correspondence is left virtual
The transfer function of loudspeaker-left ear,The transfer function of the left virtual speaker-auris dextra of correspondence, wherein θ0
=30 °.
10. the virtual acoustic processing method of dynamic space in VR TVs as claimed in claim 7 or 8, it is characterised in that the input
Signal includes the audio signal of the surround sound of a multi-path, and the surround sound of the multi-path has a left front virtual speaker, a right side
Virtual speaker and a bass behind virtual speaker, a left back virtual speaker, a right side is put in preceding virtual speaker, one virtually to raise
Sound device, wherein, left front virtual speaker, right front virtual speaker, in put virtual speaker, left back virtual speaker, it is right after it is empty
Intend left front, right front, front, left back and right back that loudspeaker is respectively arranged at user, the processing method also includes：
Obtaining the first path signal to input signal progress process of convolution according to the transfer function of each virtual speaker includes：
Obtaining alternate path signal to input signal progress process of convolution according to the transfer function of each virtual speaker includes：
Wherein, L is the first path signal, and R is alternate path signal,Convolution operation is represented, l is that the left side in the input signal leads to
Road signal, r is the right path signal in the input signal, and ls is that the left side in the input signal surround acoustical signal, and rs is the input
Right surround acoustical signal in signal, c be in the input signal in put path signal, lfe is that the bass in the input signal leads to
Road signal,The transfer function of correspondence right front virtual speaker-left ear,Correspondence right front virtual
The transfer function of loudspeaker-auris dextra,The transfer function of the left front virtual speaker-left ear of correspondence,The transfer function of the left front virtual speaker-auris dextra of correspondence,It is virtual after correspondence is right
The transfer function of loudspeaker-left ear,The transfer function of virtual speaker-auris dextra after correspondence is right,The transfer function of the left back virtual speaker-left ear of correspondence,Correspondence is left back
The transfer function of virtual speaker-auris dextra, wherein θ0=30 °, θs=110 ° ± 10 °.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710331233.3A CN107182021A (en) | 2017-05-11 | 2017-05-11 | The virtual acoustic processing system of dynamic space and processing method in VR TVs |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710331233.3A CN107182021A (en) | 2017-05-11 | 2017-05-11 | The virtual acoustic processing system of dynamic space and processing method in VR TVs |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107182021A true CN107182021A (en) | 2017-09-19 |
Family
ID=59832275
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710331233.3A Pending CN107182021A (en) | 2017-05-11 | 2017-05-11 | The virtual acoustic processing system of dynamic space and processing method in VR TVs |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107182021A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2020037984A1 (en) * | 2018-08-20 | 2020-02-27 | 华为技术有限公司 | Audio processing method and apparatus |
| CN110856095A (en) * | 2018-08-20 | 2020-02-28 | 华为技术有限公司 | Audio processing method and device |
| WO2020135366A1 (en) * | 2018-12-29 | 2020-07-02 | 华为技术有限公司 | Audio signal processing method and apparatus |
| CN112071326A (en) * | 2020-09-07 | 2020-12-11 | 三星电子（中国）研发中心 | Sound effect processing method and device |
| CN113903325A (en) * | 2021-05-31 | 2022-01-07 | 荣耀终端有限公司 | Method and device for converting text into 3D audio |
| CN114501295A (en) * | 2020-10-26 | 2022-05-13 | 深圳Tcl数字技术有限公司 | Audio data processing method, device, terminal and computer readable storage medium |
-
2017
- 2017-05-11 CN CN201710331233.3A patent/CN107182021A/en active Pending
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11863964B2 (en) | 2018-08-20 | 2024-01-02 | Huawei Technologies Co., Ltd. | Audio processing method and apparatus |
| CN110856095A (en) * | 2018-08-20 | 2020-02-28 | 华为技术有限公司 | Audio processing method and device |
| CN110856094A (en) * | 2018-08-20 | 2020-02-28 | 华为技术有限公司 | Audio processing method and device |
| CN110856095B (en) * | 2018-08-20 | 2021-11-19 | 华为技术有限公司 | Audio processing method and device |
| US11910180B2 (en) | 2018-08-20 | 2024-02-20 | Huawei Technologies Co., Ltd. | Audio processing method and apparatus |
| US11451921B2 (en) | 2018-08-20 | 2022-09-20 | Huawei Technologies Co., Ltd. | Audio processing method and apparatus |
| WO2020037984A1 (en) * | 2018-08-20 | 2020-02-27 | 华为技术有限公司 | Audio processing method and apparatus |
| US11611841B2 (en) | 2018-08-20 | 2023-03-21 | Huawei Technologies Co., Ltd. | Audio processing method and apparatus |
| WO2020135366A1 (en) * | 2018-12-29 | 2020-07-02 | 华为技术有限公司 | Audio signal processing method and apparatus |
| US11917391B2 (en) | 2018-12-29 | 2024-02-27 | Huawei Technologies Co., Ltd. | Audio signal processing method and apparatus |
| CN112071326A (en) * | 2020-09-07 | 2020-12-11 | 三星电子（中国）研发中心 | Sound effect processing method and device |
| CN114501295B (en) * | 2020-10-26 | 2022-11-15 | 深圳Tcl数字技术有限公司 | Audio data processing method, device, terminal and computer readable storage medium |
| CN114501295A (en) * | 2020-10-26 | 2022-05-13 | 深圳Tcl数字技术有限公司 | Audio data processing method, device, terminal and computer readable storage medium |
| CN113903325A (en) * | 2021-05-31 | 2022-01-07 | 荣耀终端有限公司 | Method and device for converting text into 3D audio |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107182021A (en) | The virtual acoustic processing system of dynamic space and processing method in VR TVs | |
| US10863159B2 (en) | Field-of-view prediction method based on contextual information for 360-degree VR video | |
| EP2874413B1 (en) | Method and apparatus for calibrating an audio playback system | |
| US6741273B1 (en) | Video camera controlled surround sound | |
| JP2017518663A (en) | 3D viewing | |
| US9591418B2 (en) | Method, apparatus and computer program for generating an spatial audio output based on an spatial audio input | |
| JP2017535985A (en) | Method and apparatus for capturing, streaming and / or playing content | |
| US11917391B2 (en) | Audio signal processing method and apparatus | |
| CN103002376A (en) | Method for orientationally transmitting voice and electronic equipment | |
| WO2016123901A1 (en) | Terminal and method for directionally playing audio signal thereby | |
| EP3422744B1 (en) | An apparatus and associated methods | |
| CN106572425A (en) | Audio processing device and method | |
| CN111294724A (en) | Spatial repositioning of multiple audio streams | |
| JP2021535632A (en) | Methods and equipment for processing audio signals | |
| US20240098446A1 (en) | Head tracked spatial audio and/or video rendering | |
| US11856386B2 (en) | Apparatus and method for processing audiovisual data | |
| CN111492342A (en) | Audio scene processing | |
| CN206908863U (en) | The virtual acoustic processing system of dynamic space in VR TVs | |
| US20220345844A1 (en) | Electronic apparatus for audio signal processing and operating method thereof | |
| TW201246174A (en) | Video-audio playing system relating to 2-views application and method thereof | |
| WO2019174442A1 (en) | Adapterization equipment, voice output method, device, storage medium and electronic device | |
| TWI733219B (en) | Audio signal adjusting method and audio signal adjusting device | |
| US20230283976A1 (en) | Device and rendering environment tracking | |
| JP6564489B2 (en) | Acoustic signal processing device | |
| Batke et al. | Recording spatial audio signals for interactive broadcast systems |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |