CN106210990B - A kind of panorama sound audio processing method - Google Patents
A kind of panorama sound audio processing method Download PDFInfo
- Publication number
- CN106210990B CN106210990B CN201610550721.9A CN201610550721A CN106210990B CN 106210990 B CN106210990 B CN 106210990B CN 201610550721 A CN201610550721 A CN 201610550721A CN 106210990 B CN106210990 B CN 106210990B
- Authority
- CN
- China
- Prior art keywords
- signal
- signals
- sound
- audio signal
- audio
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R5/00—Stereophonic arrangements
- H04R5/04—Circuit arrangements, e.g. for selective connection of amplifier inputs/outputs to loudspeakers, for loudspeaker detection, or for adaptation of settings to personal preferences or hearing impairments
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Stereophonic System (AREA)
Abstract
The invention discloses a kind of panorama sound audio processing method, the method includes：Server end obtains the audio signal of different-format, and transcoding obtains intermediate form audio signal；Intermediate form audio signal is superimposed, obtains exporting to the intermediate form audio signal of client；Client obtains intermediate form audio signal of the output to client from server end；Obtain end rotation direction；Decoding obtains panorama sound binaural signal.The method can effectively and in high quality generate panorama sound, panorama sound is in server end by handling, it is unified for intermediate form, the compatibility of panorama sound content format is improved well, it reduces network bandwidth occupancy and alleviates the processing complexity of client, solve the problems, such as that existing customer end can not effectively, efficiently play the panorama sound content of various formats.The panorama sound of end rotation is rendered to be completed in client, is also met the demand of head-tracking low delay, is particularly suitable for the application of virtual reality.
Description
Technical field
The present invention relates to signal processing technology fields, and in particular to a kind of panorama sound audio processing method.
Background technology
When with virtual reality helmet (Head-Mounted Display, HMD) to user's presentation content, in audio
Hold and is played to user by stereophone.At this moment need that the problem of how improving virtual surrounding sound effect faced.Virtually existing
In real application, when playing audio content by stereophone, the purpose of virtual 3D audios is intended to reach a kind of effect, allows
User is true just as being listened (such as 5.1 or 7.1) with loudspeaker array, or even as listening the sound in reality.
When making virtual reality audio content, it is generally necessary to several sound elements.A method of improving telepresenc
It is tracking user's head action (head tracking), sound is handled accordingly.For example, if original sound by with
Family is perceived as coming from front, and after 90 degree of user's rotary head to the left, sound should be by processing so that user perceives sound from the positive right side
90 degree of side.
Herein virtual reality device can there are many kinds of class, such as headed tracking display equipment, or only one
The stereophone of portion's headed tracking transducer.
Realizing head tracking, also there are many methods.Relatively common is to use multiple sensors.Motion sensor external member is logical
Include often accelerometer, gyroscope and magnetometric sensor.Each sensor has oneself in terms of motion tracking and absolute direction
Intrinsic strong point and weakness.Therefore practices well is to use sensor " fusion " (sensor fusion), will come from each sensor
Signal combine, generate a more accurate motion detection result.
After obtaining end rotation angle, need to change sound accordingly.Generation virtual reality sound field has following
Several method：
A kind of way is that using HRTF, (Head Related Transfer Function, head are related to audio object
Transforming function transformation function) filter is filtered, obtain virtual surround sound.Titles of the HRTF corresponding to time-domain is HRIR (Head
Related Impulse Response).Or by source of sound and binaural room impulse response (Binaural Room Impulse
Response, BRIR) do convolution.Binaural room impulse response is made of three parts：Direct sound wave, reflection and reverberation.
Directly by the shortcomings that audio object and this way of BRIR convolution be if scene is complicated, it is containing a large amount of audio object, then multiple
Miscellaneous degree can become very high, especially also needed on virtual reality device according to the action on head to the position of audio object into
Row adjustment in real time, for many audio-frequency playing terminals, this will cause power consumption excessive, or even can not play.In addition a large amount of audio
Object data is high to the requirement of bandwidth from server to client, does not gear to actual circumstances.
The second way is that sound is gone to the domains ambisonic, is then converted again to signal by using spin matrix.
Specific practice is that audio is switched to B format signals, which is converted to virtual speaker array signal, will virtually be raised
Sound device array signal is filtered by hrtf filter, obtains virtual surround sound.
The third method is recorded using the number of people, and the signal of ears is directly obtained.It is recorded by the number of people of multiple directions, into
Row interpolation, to obtain binaural signal of the head in any rotation angle.
It can be seen that there are multiple formats for virtual reality panorama sound, respectively have advantage and disadvantage in efficiency and effect.It is existing
Various panorama sound formats generally can not be supported and be compatible with completely to virtual reality panorama sound client.Simultaneously as complexity and band
Wide limitation, client support that the panorama sound format having can be unable to do what one wishes.In view of this, being needed in this field a kind of effectively and high
Quality generates the system scheme of virtual reality panorama sound.
Invention content
The purpose of the present invention is to provide a kind of panorama sound audio processing methods, using at the audio of server plus client
Reason mode effectively can be selected dynamically in the various panorama sound formats of server end compatibility input by it according to application and content
Select the intermediate form progress transcoding output of good compatibility reduces to substantially improve client to the compatibility of panorama sound
The complexity of client process panorama sound reduces the bandwidth that server transmits panorama acoustical signal to client.Client only needs
The intermediate form of panorama sound and the cephalad direction of virtual reality helmet acquisition are obtained from server end, you can decoding
Panorama sound binaural signal is obtained, is played by stereophone, the experience of panorama sound can be obtained.
To achieve the above object, panorama sound audio processing method of the present invention includes the following steps：
Server end obtains the audio signal of different-format, and layout in transcoding acquisition is carried out to the audio signal of different-format
Formula audio signal；The intermediate form audio signal is superimposed, obtains exporting to the intermediate form audio signal of client；
Client obtains intermediate form audio signal of the output to client from server end；Obtain end rotation direction；
Decoding obtains panorama sound binaural signal.
Preferably, the audio signal of the different-format includes multi-direction Double-ear type sound-recording signal, sound field recorded audio signals and sound
Frequency object signal.
Preferably, the intermediate form audio signal includes multichannel binaural signals and Ambisonic signals.
Preferably, server end is unified intermediate form audio signal to the audio signal transcoding of the different-format,
It specifically includes：
A, for intermediate form audio signal be multichannel binaural signals the case where：By the multi-direction Double-ear type sound-recording of input
Signal, sound field recorded audio signals and audio object signal are all uniformly transcoded into multichannel binaural signals；
B, for intermediate form audio signal be Ambisonic signals the case where：The multi-direction Double-ear type sound-recording of input is believed
Number, sound field recorded audio signals and audio object signal be all uniformly transcoded into Ambisonic signals.
Preferably, server end is to the audio signal of the different-format mixedly or during dynamically transcoding is a variety of simultaneously
Between format audio signal.
Preferably, intermediate form audio signal superposition is referred to obtaining the audio signal transcoding of different-format
The mixing of intermediate form audio signal is superimposed, and obtains intermediate form audio signal of the final output to client.
Preferably, the end rotation direction includes horizontal angle and the elevation angle of head direction of gaze.
Preferably, the acquisition in the end rotation direction is obtained by the sensor of virtual reality helmet.
Preferably, the decoding refers to intermediate form audio signal decoding being converted to panorama sound binaural signal, tool
Body includes：
A, for intermediate form audio signal be multichannel binaural signals the case where：By multichannel binaural signals, root
According to end rotation angle, interpolation obtains panorama sound binaural signal；
B, for intermediate form audio signal be Ambisonic signals the case where：By Ambisonic signals, pass through basis
The spin matrix that end rotation angle obtains handles to obtain the postrotational Ambisonic signals of sound field；Turned again by decoding matrix
It is changed to virtual speaker array signal, virtual speaker array signal is filtered by corresponding hrtf filter, is obtained
Panorama sound binaural signal.
The invention has the advantages that：Panorama sound audio processing method of the present invention effectively and can be generated in high quality
Panorama sound is mainly used for the stereophone for coordinating virtual reality helmet to carry out audio and plays, and the panorama sound exists
Server end is unified for intermediate form, improves the compatibility of panorama sound content format well, reduce network by processing
Bandwidth usage and the processing complexity for alleviating client, have been well adapted for the existing network class based on cloud framework
Type executes main audio frequency process, storage and distribution by cloud server, can not be effective, high to solve existing customer end
The problem of effect ground plays the panorama sound content of various formats.The panorama sound of end rotation is rendered to be completed in client, is also met
The demand of head-tracking low delay is particularly suitable for the application of virtual reality.
Description of the drawings
Fig. 1 is the flow diagram of panorama sound audio processing method of the present invention.
Specific implementation mode
The following examples are used to illustrate the present invention, but are not intended to limit the scope of the present invention..
As shown in Figure 1, panorama sound audio processing method of the present invention includes the following steps：
Server end obtain different-format audio signal, by its according to application and content, dynamic select good compatibility
Intermediate form carries out transcoding, obtains intermediate form audio signal；The intermediate form audio signal is superimposed, obtains output to visitor
The intermediate form audio signal at family end；
Client obtains intermediate form audio signal of (such as passing through internet) output to client from server end；It obtains
Take end rotation direction；Decoding obtains panorama sound binaural signal.
Preferably, the audio signal of the different-format includes multi-direction Double-ear type sound-recording signal (such as quad
Binaural), sound field recorded audio signals (such as Ambisonic) and audio object signal.
Preferably, the intermediate form audio signal includes multichannel binaural signals and Ambisonic signals.
Preferably, server end is unified intermediate form audio signal to the audio signal transcoding of the different-format,
It specifically includes：
A, for intermediate form audio signal be multichannel binaural signals the case where：By the multi-direction Double-ear type sound-recording of input
Signal, sound field recorded audio signals and audio object signal are all uniformly transcoded into multichannel binaural signals；
B, for intermediate form audio signal be Ambisonic signals the case where：The multi-direction Double-ear type sound-recording of input is believed
Number, sound field recorded audio signals and audio object signal be all uniformly transcoded into Ambisonic signals.
Preferably, server end is to the audio signal of the different-format mixedly or during dynamically transcoding is a variety of simultaneously
Between format audio signal.
Preferably, intermediate form audio signal superposition is referred to obtaining the audio signal transcoding of different-format
The mixing of intermediate form audio signal is superimposed, and obtains intermediate form audio signal of the final output to client.
Preferably, the end rotation direction includes horizontal angle and the elevation angle of head direction of gaze.
Preferably, the acquisition in the end rotation direction is obtained by the sensor of virtual reality helmet.
Such as gyroscope, accelerometer and compass.
Preferably, the decoding refers to intermediate form audio signal decoding being converted to panorama sound binaural signal, tool
Body includes：
A, for intermediate form audio signal be multichannel binaural signals the case where：By multichannel binaural signals, root
According to end rotation angle, interpolation obtains panorama sound binaural signal；
B, for intermediate form audio signal be Ambisonic signals the case where：By Ambisonic signals, pass through basis
The spin matrix that end rotation angle obtains handles to obtain the postrotational Ambisonic signals of sound field；Turned again by decoding matrix
It is changed to virtual speaker array signal, virtual speaker array signal is filtered by corresponding hrtf filter, is obtained
Panorama sound binaural signal.
Below by the specific steps of three embodiments the present invention will be described in detail panorama sound audio processing method.
Embodiment one：
For intermediate form audio signal be multichannel binaural signals the case where processing include following processing step (with
4 tunnels, i.e. for Quad binaural)：
1, it is multichannel binaural formats by the various panorama sound uniform format transcodings of server end.
A. it is multichannel binaural formats by audio object signal transcoding.
Audio object is filtered by HRTF to obtain binaural signal Bi.Because handling the binaural signal in N=4 direction,
So audio object will hrtf filter corresponding with 4 directions all once filtered.
Bi=Hi·SObj
Wherein：I=1~N；
HiIndicate the HRTF filtering matrixs on the i-th tunnel.
SObjIndicate the audio object of input.
B. it is multichannel binaural formats by sound field recorded audio signals transcoding.
Sound field recorded audio signals are rotated by spin matrix to obtain the acoustic field signal in N=4 direction, it respectively will be postrotational
Acoustic field signal is converted to virtual speaker array signal, and virtual speaker array signal is filtered by hrtf filter,
Obtain the binaural signal B in N=4 directioni。
Bi=Hi·Di·Ri·SAmb
Wherein：I=1~N；
HiIndicate the HRTF filtering matrixs on the i-th tunnel.
DiIndicate the decoding matrix on the i-th tunnel.
RiIndicate the spin matrix on the i-th tunnel.
SAmbIndicate the audio sound field of input.
C. it is multichannel binaural formats by number of people recorded audio signals transcoding.
The recording B in N=4 direction can be recorded simultaneously by integrating the dummy head of multigroup human eari, wherein：I=1~N.
If the multichannel binaural signals way of multichannel binaural signal and the server intermediate form of number of people recording not phase
Together or direction is inconsistent, then can be converted by interpolation fitting.
2, the multichannel binaural format audio signals for being transcoded into the audio signal of different-format are superimposed, and are exported to client
End.
To the binaural signal that three kinds of formats (audio object signal, sound field recorded audio signals and number of people recorded audio signals) generate above
(mix) is mixed into one group of signal Bi, wherein：I=1~N；
3, client is restored from received server-side to multichannel binaural format audio signals according to number of people directional interpolation
Play panorama sound field.
In client, according to number of people direction, by the binaural audio signal to N=4 direction into row interpolation, restore complete
Scape sound field B.
Wherein：I=1~N；
GiIndicate the interpolation coefficient on the i-th tunnel；
Such as when N=4, in order to keep signal energy, cosine signal may be used as interpolation coefficient.
If Gi<0, then enable Gi=0
Wherein：I=1~N；
θ indicates the level angle of number of people rotation.
Embodiment two：
The processing for the case where being Ambisonic for intermediate form includes following processing step：
1. being Ambisonic formats by the various panorama sound uniform format transcodings of server end.
A. it is Ambisonic formats by audio object transcoding.
It is described below and how audio object is encoded to ambisonic formats.
Audio object is encoded to single order ambisonic signals：
Wherein siIt is i-th of audio object, i=1 ... k, k are the numbers of audio object.θiIt is the angle (side in plane
Parallactic angle), φiThe angle (elevation angle) being vertically oriented.W sound channel signals indicate omnidirection sound wave, X sound channel signals, Y sound channel signals
It is indicated respectively along the orthogonal sound wave for being orientated X, Y, Z in three, space with Z sound channel signals.
Single order Ambisonic B format signals are expressed as
Similarly, audio object is encoded to 2 ranks or 3 rank Ambisonic format signals and preferably defines progress according to following table：
B. it is Ambisonic formats by sound field recorded audio signals transcoding.
If sound field recorded audio signals are Ambisonic A format signals, and intermediate form is believed for Ambisonic B formats
Number, then can by conversion formula by A format conversions be B formats.
If sound field recorded audio signals are the Ambisonic signals of low order, and intermediate form is high-order Ambisonic signals,
Then can by upmix modes by low order format conversion be high order scheme.
If sound field recorded audio signals are the Ambisonic signals of high-order, and intermediate form is low order Ambisonic signals,
Then can by downmix modes by low order format conversion be high order scheme.
C. it is Ambisonic formats by number of people recorded audio signals transcoding.
There are two types of modes can the number of people be recorded transcoding as Ambisonic formats.
A kind of mode is using the recording of each ear as an audio object, and the orientation at ear opposing headers center is
The orientation of audio object.Then transcoding is carried out i.e. according to the mode that the sections of a above audio object transcoding is Ambisonic
It can.
Another way is that audio object (object extraction) is extracted from number of people recorded audio signals, is then estimated
Go out the orientation of audio object (by DOA methods).Then it is Ambisonic's according to the sections of a above audio object transcoding
Mode carries out transcoding.Extract the residual signals after audio object, it is believed that be nondirectional ambient sound, can be placed on
In the omnidirection W sound channels of Ambisonic.
2. the Ambisonic format signals that different-format is transcoded into are superimposed, export to client.
For example, Ambisonic uses B format signals, then will above three kinds of formats (audio object, sound field recorded audio signals and
Number of people recorded audio signals) generate Ambisonic signals mix at one group of signal
3. client from received server-side to Ambisonic format signals, is decoded and is restored according to number of people direction of rotation
Play panorama sound field.
A. according to the number of people rotation angle, the Ambisonic B format signals are rotated to obtain postrotational
Ambisonic B format signals；Specifically, it is that spin matrix is generated according to the rotation angle, further according to the spin moment
Battle array, rotates the Ambisonic B format signals.So-called rotation, i.e., by spin matrix and signal matrix phase to be adjusted
Multiply, rotation does not change the size of audio signal matrix component, only changes the direction of component.The signal square of Ambisonic B formats
Battle array is [W X YZ]TWhen, spin matrix is
Then postrotational Ambisonic B format signals are：
B. the postrotational Ambisonic B format signals are converted into virtual speaker array signal；
With a single order B format signal [W1 X1 Y1 Z1]TFor, it is converted into virtual speaker array signal [L1 L2
… LN]TProcess be exactly to carry out lower column operations：
Wherein, N is the number for the virtual speaker that virtual speaker topological structure includes.G matrix used in above formula
For ambisonic decoding matrix, can be obtained by seeking pseudo inverse matrix.
C. it is double binaural room impulse response (BRIR) progress to be based on to the virtual speaker array signal of audio object
Ear transcoding (being typically 3 dimensions, that is, include elevation information), the ears for obtaining audio object export virtual ring around acoustical signal.Specifically：
The stereo BRIR matrixes in corresponding two road of earphone signal are gone to from virtual speaker signal, the stereo matrix in bis- roads Jiang Gai and virtual
Loudspeaker array signal carries out matrix multiplication, obtains virtual surround sound.
BRIR matrixes areThen virtual surround sound is
The binaural room impulse response is preferably offline to be generated, and true measurement may be used or given birth to by special software
At, therefore need to store a large amount of BRIR when online generating mode not necessarily like using in the prior art, reduce memory consumption.
Embodiment three：
It can simultaneously be mixed according to practical application and recording substance or dynamic uses several intermediate forms.
Two kinds of heretofore described intermediate forms respectively have its advantage and disadvantage.
For multichannel binaural formats, the effect in Double-ear type sound-recording direction is best.In two-way Double-ear type sound-recording direction
Interpolation region, effect are worst.The general 4 road binaural formats relatively high using cost performance, that is, Quad binaural
Format.It needs to transmit 8 rail audios, data volume is not not low high.
For Ambisonic formats, effect in all directions is relatively uniform, best without multichannel binaural formats
Direction is good, also without the worst direction difference of multichannel binaural formats.In addition for 1 rank ambisonic formats, it is only necessary to transmit
4 rail audios, smaller than the data volume of Quad binaural formats half.If certain precision prescribed and quality higher, can adopt
With the ambisonic formats of 3 ranks or 5 ranks.The ambisonic formats of 3 ranks need 16 rail audios.The ambisonic of 5 ranks needs 36
Rail audio basically reaches the quality of multi-object audio.
So according to the advantage and disadvantage of two kinds of intermediate forms, can according to application, bandwidth and content dynamic using wherein certain
Intermediate form is used in combination flag bit to show which kind of intermediate form currently employed, so that client is correctly decoded.
For example, current network bandwidth is more rich, system can dynamically adjust intermediate form and use high-order Ambisonic lattice
Formula.If current network conditions are bad, system can dynamically adjust intermediate form and use 1 rank Ambisonic formats.If current
Network status is normal, and the sound source in scene is concentrated mainly on several discrete directions, and the area-of-interest in scene concentrates on
One direction, head will not do frequent rotation, then it is best that system, which uses multichannel binaural formats,.
Although above having used general explanation and specific embodiment, the present invention is described in detail, at this
On the basis of invention, it can be made some modifications or improvements, this will be apparent to those skilled in the art.Therefore,
These modifications or improvements without departing from theon the basis of the spirit of the present invention belong to the scope of protection of present invention.
Claims (5)
1. a kind of panorama sound audio processing method, which is characterized in that the panorama sound audio processing method includes the following steps：
Server end obtains the audio signal of different-format, and carrying out transcoding to the audio signal of different-format obtains intermediate form sound
Frequency signal, server end are unified intermediate form audio signal to the audio signal transcoding of the different-format；In described
Between format audio signal be superimposed, obtain exporting to the intermediate form audio signal of client；
Client obtains intermediate form audio signal of the output to client from server end；Obtain end rotation direction；Decoding
Obtain panorama sound binaural signal；
The audio signal of the different-format includes multi-direction Double-ear type sound-recording signal, sound field recorded audio signals and audio object signal；
The intermediate form audio signal includes multichannel binaural signals and Ambisonic signals；
Server end is for the case where intermediate form audio signal is multichannel binaural signals：
Multi-direction Double-ear type sound-recording signal, sound field recorded audio signals and the audio object signal of input are all uniformly transcoded into multichannel
Binaural signals；
The multichannel binaural format audio signals superposition that the audio signal of different-format is transcoded into, exports to client；
Client is broadcast from received server-side to multichannel binaural format audio signals according to the reduction of end rotation directional interpolation
Put panorama sound field；
Server end is for the case where intermediate form audio signal is Ambisonic signals：
Multi-direction Double-ear type sound-recording signal, sound field recorded audio signals and the audio object signal of input are all uniformly transcoded into
Ambisonic signals；
The Ambisonic format signals superposition that different-format is transcoded into, exports to client；
Client is decoded and is played according to the reduction of end rotation direction complete from received server-side to Ambisonic format signals
Scape sound field；
Mixedly or dynamically transcoding is a variety of intermediate form audios to audio signal of the server end to the different-format simultaneously
Signal.
2. panorama sound audio processing method as described in claim 1, which is characterized in that be superimposed to the intermediate form audio signal
It refers to mixing the intermediate form audio signal that the audio signal transcoding of different-format obtains and be superimposed, obtain final defeated
Go out to the intermediate form audio signal of client.
3. panorama sound audio processing method as described in claim 1, which is characterized in that the end rotation direction includes head note
The horizontal angle of apparent direction and the elevation angle.
4. panorama sound audio processing method as described in claim 1, which is characterized in that the acquisition in the end rotation direction is
It is obtained by the sensor of virtual reality helmet.
5. panorama sound audio processing method as described in claim 1, which is characterized in that the decoding is referred to intermediate form
Audio signal decoding is converted to panorama sound binaural signal, specifically includes：
A, for intermediate form audio signal be multichannel binaural signals the case where：By multichannel binaural signals, according to head
Portion's rotation angle, interpolation obtain panorama sound binaural signal；
B, for intermediate form audio signal be Ambisonic signals the case where：By Ambisonic signals, by according to head
The spin matrix that rotation angle obtains handles to obtain the postrotational Ambisonic signals of sound field；It is converted to again by decoding matrix
Virtual speaker array signal is filtered by corresponding hrtf filter, obtains panorama by virtual speaker array signal
Sound binaural signal.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610550721.9A CN106210990B (en) | 2016-07-13 | 2016-07-13 | A kind of panorama sound audio processing method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610550721.9A CN106210990B (en) | 2016-07-13 | 2016-07-13 | A kind of panorama sound audio processing method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106210990A CN106210990A (en) | 2016-12-07 |
| CN106210990B true CN106210990B (en) | 2018-08-10 |
Family
ID=57476648
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610550721.9A Active CN106210990B (en) | 2016-07-13 | 2016-07-13 | A kind of panorama sound audio processing method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106210990B (en) |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108346432B (en) * | 2017-01-25 | 2022-09-09 | 北京三星通信技术研究有限公司 | Virtual reality VR audio processing method and corresponding equipment |
| CN106851482A (en) * | 2017-03-24 | 2017-06-13 | 北京时代拓灵科技有限公司 | A kind of panorama sound loudspeaker body-sensing real-time interaction system and exchange method |
| US10390166B2 (en) | 2017-05-31 | 2019-08-20 | Qualcomm Incorporated | System and method for mixing and adjusting multi-input ambisonics |
| CN109756683B (en) * | 2017-11-02 | 2024-06-04 | 深圳市裂石影音科技有限公司 | Panoramic audio and video recording method and device, storage medium and computer equipment |
| CN114513698B (en) * | 2020-11-16 | 2023-08-22 | 中国联合网络通信集团有限公司 | Panoramic sound playing system and method |
| CN117546236A (en) * | 2021-06-15 | 2024-02-09 | 北京字跳网络技术有限公司 | Audio rendering system, method and electronic equipment |
| CN114173256B (en) * | 2021-12-10 | 2024-04-19 | 中国电影科学技术研究所 | Method, device and equipment for restoring sound field space and posture tracking |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104698956A (en) * | 2015-02-15 | 2015-06-10 | 四川长虹电器股份有限公司 | Method and system for treating noise |
| CN105872940A (en) * | 2016-06-08 | 2016-08-17 | 北京时代拓灵科技有限公司 | Virtual reality sound field generating method and system |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9774974B2 (en) * | 2014-09-24 | 2017-09-26 | Electronics And Telecommunications Research Institute | Audio metadata providing apparatus and method, and multichannel audio data playback apparatus and method to support dynamic format conversion |
| CN105120421B (en) * | 2015-08-21 | 2017-06-30 | 北京时代拓灵科技有限公司 | A kind of method and apparatus for generating virtual surround sound |
| CN105376690A (en) * | 2015-11-04 | 2016-03-02 | 北京时代拓灵科技有限公司 | Method and device of generating virtual surround sound |
| CN105682000B (en) * | 2016-01-11 | 2017-11-07 | 北京时代拓灵科技有限公司 | A kind of audio-frequency processing method and system |
-
2016
- 2016-07-13 CN CN201610550721.9A patent/CN106210990B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104698956A (en) * | 2015-02-15 | 2015-06-10 | 四川长虹电器股份有限公司 | Method and system for treating noise |
| CN105872940A (en) * | 2016-06-08 | 2016-08-17 | 北京时代拓灵科技有限公司 | Virtual reality sound field generating method and system |
Non-Patent Citations (1)
| Title |
|---|
| 电影声音技术的3D革命—Dolby Atoms解析;王忆霏;《现代电视技术》;20130930;第88-92页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106210990A (en) | 2016-12-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106210990B (en) | A kind of panorama sound audio processing method | |
| CN105872940B (en) | A kind of virtual reality sound field generation method and system | |
| US6766028B1 (en) | Headtracked processing for headtracked playback of audio signals | |
| JP7038725B2 (en) | Audio signal processing method and equipment | |
| US10674301B2 (en) | Fast and memory efficient encoding of sound objects using spherical harmonic symmetries | |
| EP2285139B1 (en) | Device and method for converting spatial audio signal | |
| TWI841483B (en) | Method and apparatus for rendering ambisonics format audio signal to 2d loudspeaker setup and computer readable storage medium | |
| CN110035376A (en) | Come the acoustic signal processing method and device of ears rendering using phase response feature | |
| CN105376690A (en) | Method and device of generating virtual surround sound | |
| KR20170106063A (en) | A method and an apparatus for processing an audio signal | |
| CN105682000B (en) | A kind of audio-frequency processing method and system | |
| CN106331977B (en) | A kind of virtual reality panorama acoustic processing method of network K songs | |
| CN106060758B (en) | The processing method of virtual reality sound field metadata | |
| WO2018026963A1 (en) | Head-trackable spatial audio for headphones and system and method for head-trackable spatial audio for headphones | |
| TW202105164A (en) | Audio rendering for low frequency effects | |
| JP6834985B2 (en) | Speech processing equipment and methods, and programs | |
| CN105959905B (en) | Mixed mode spatial sound generates System and method for | |
| WO2017119320A1 (en) | Audio processing device and method, and program | |
| WO2017119321A1 (en) | Audio processing device and method, and program | |
| US20240119946A1 (en) | Audio rendering system and method and electronic device | |
| CN105959877B (en) | Method and device for processing sound field in virtual reality equipment | |
| Berebi et al. | Enabling head-tracking for binaural sound reproduction based on bilateral ambisonics | |
| CN113347530A (en) | Panoramic audio processing method for panoramic camera | |
| Gölles et al. | Cat3DA-Camera-Tracked 3D Audio Player | |
| Paterson et al. | Producing 3-D audio |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20200407 Address after: 210042 floor 3, No. 699-1, Xuanwu Avenue, Xuanwu District, Nanjing City, Jiangsu Province Patentee after: Nanjing Tuoling Intelligent Technology Co., Ltd. Address before: 100085, 0014-32, room 01, 26 Information Road, Haidian District, Beijing Patentee before: BEIJING TUOLING Inc. |
|
| TR01 | Transfer of patent right |