CN107071639A - A kind of 3D audios based on head phase produce algorithm - Google Patents

A kind of 3D audios based on head phase produce algorithm Download PDF

Info

Publication number
CN107071639A
CN107071639A CN201710147042.1A CN201710147042A CN107071639A CN 107071639 A CN107071639 A CN 107071639A CN 201710147042 A CN201710147042 A CN 201710147042A CN 107071639 A CN107071639 A CN 107071639A
Authority
CN
China
Prior art keywords
audios
modules
hrtf
voice data
sound
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201710147042.1A
Other languages
Chinese (zh)
Inventor
程轩昂
张志超
马奇东
姜福泉
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Wuhan Mountain Technology Co Ltd
Original Assignee
Wuhan Mountain Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Wuhan Mountain Technology Co Ltd filed Critical Wuhan Mountain Technology Co Ltd
Priority to CN201710147042.1A priority Critical patent/CN107071639A/en
Publication of CN107071639A publication Critical patent/CN107071639A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00Circuits for transducers, loudspeakers or microphones
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2430/00Signal processing covered by H04R, not provided for in its groups

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Stereophonic System (AREA)

Abstract

The present invention relates to electroacoustic techniques field, specifically related to a kind of 3D audios based on head phase produce algorithm, its key step includes receiving distal end voice data, receiving pcm voice data by Neteq module solution RTP bag datas, 3D audio effect processing modules, and generation 3D audios, the audio data transmitting of generation 3D audios are sent to hardware broadcasting.The 3D audio effect processings module includes 3D audios pretreatment module and HRTF algoritic modules.The beneficial effects of the invention are as follows:The present invention to HRTF algoritic modules function by carrying out in-depth improvement, add 3D audio pretreatment modules, during personage's head rotation, the propagation starting point of sound source is predicted according to the angular acceleration of head rotation, 3D sound in following 10ms~60ms time is calculated in advance, largely reducing the delay of 3D sounds, there is provided the 3D sound experience instant to user.

Description

A kind of 3D audios based on head phase produce algorithm
Technical field
The present invention relates to electroacoustic techniques field, specifically a kind of 3D audios based on head phase produce algorithm.
Background technology
3D audios, this effect looked such as magic is actually the performance of another surround sound, is not real 3D audio frequency effects performance.Essentially, what this technology was utilized is only some simple time delay circuits and wave filter. In addition, left and right acoustic channels are mixed by it.Therefore, the brain of people can experience the openr effect of sound field change.This causes people non- Advanced and professional level is often convenient to use to edit and compile CD music.But, this technology has its shortcoming, process circuit It is mixed with the source of sound transmitted from L channel and R channel.The circular audio technology of standard can not show the sound transmitted from upper and lower side Source, can not also rely on software random localization of sound source in virtual environment, or calculate and compare the sound relation of 3D game in real time. Judged with strict impression, this technology can not be referred to as 3D audios, can only at most can be regarded as 2.5D, because it is only relatively improved Listen to the limitation in the orientation of loudspeaker.In addition to eyes, ear is set also to differentiate the 3-dimensional positioning of object, and reduction sound Sound propagation delay problem, makes positioning more precisely more fit actual.In daily life, audiovisual mutually makes up, and the technology makes The sense of hearing makes up the defect of vision positioning object.And the 3D audios based on head phase produce algorithm and may apply to virtual reality In, the direction of sound is gone out by the angular advance budget for person head position of predicting future games, sound biography is reduced with this The latency issue broadcast and received, the sound for allowing user to listen to more has direction feeling, gives user more real game experiencing.
It is that can not stand calculating 3D sounds to prolong because head rotation is too fast and tradition HRTF algorithms are in this application scene Late.Traditional 3D sound only solves 3D acoustic problems using only HRTF, but can not timely calculate 3D sound, delay compared with Greatly.Then propose to reduce the delay that 3D sounds play by this algorithm that there is provided the 3D sound experience instant to user.
The content of the invention
The technical problem that algorithm is present is produced in order to solve the above-mentioned existing 3D audios based on head phase, the present invention provides one Plant the 3D audios based on head phase and produce algorithm.
The technical solution adopted for the present invention to solve the technical problems is:
A kind of 3D audios based on head phase produce algorithm, and its key step includes:
1) receive distal end voice data, i.e., the other users voice data listened to sent from streaming media server, These data are through overcompression and add the RTP bag datas of some network states (such as present flow rate bps sizes);
2) by the incoming Neteq modules of distal end voice data, by Neteq module solution RTP bag datas, processing network is trembled It is dynamic, voice package losing is handled, the loss of the data caused by network jitter, smooth generation pcm voice data is compensated;
3) pcm voice data are received by 3D audio effect processing modules, generates 3D audios;
4) audio data transmitting of generation 3D audios is sent to hardware broadcasting.
Further, the step 3) in, the 3D audio effect processings module includes 3D audios pretreatment module and HRTF is calculated In method module, the 3D audios pretreatment module, according to formula
θ=ω0t+βt2/ 2,
Wherein, θ is head rotation angle, ω0For the angular speed of head rotation, β is the angular acceleration of head rotation, and t is It is the voice data length of reciever caching between the time for the sound heard, 10ms~60ms, is shaken according to current network Situation, a specific t value (10ms~60ms) can be obtained by hardware, and more than 60ms can substantially feel there is sound delay time, used Family experience is bad, so 10ms~60ms head rotation angle, θ is calculated, by the incoming HRTF algoritic modules of head rotation angle, θ In, HRTF algoritic modules use existing algorithms library, generate 3D audios.
The beneficial effects of the invention are as follows:The present invention adds 3D sounds by carrying out in-depth improvement to HRTF algoritic modules function Pretreatment module is imitated, during personage's head rotation, the propagation starting point of sound source is predicted according to the angular acceleration of head rotation, is counted in advance 3D sound in following 10ms~60ms time is calculated, largely reducing the delay of 3D sounds, there is provided instant to user 3D sound experiences.
Brief description of the drawings
The present invention is further described with reference to the accompanying drawings and examples.
Fig. 1 is flowage structure schematic diagram of the present invention.
Embodiment
In order to make the purpose , technical scheme and advantage of the present invention be clearer, it is right below in conjunction with drawings and Examples The present invention is further elaborated.It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, and It is not used in the restriction present invention.
As shown in figure 1, a kind of 3D audios based on head phase of the present invention produce algorithm, its key step includes:
1) receive distal end voice data, i.e., the other users voice data listened to sent from streaming media server, These data are through overcompression and add the RTP bag datas of some network states (such as present flow rate bps sizes);
2) by the incoming Neteq modules of distal end voice data, by Neteq module solution RTP bag datas, processing network is trembled It is dynamic, voice package losing is handled, the loss of the data caused by network jitter, smooth generation pcm voice data is compensated;
3) pcm voice data are received by 3D audio effect processing modules, generates 3D audios;
4) audio data transmitting of generation 3D audios is sent to hardware broadcasting.
Further, the step 3) in, the 3D audio effect processings module includes 3D audios pretreatment module and HRTF is calculated In method module, the 3D audios pretreatment module, according to formula
θ=ω0t+βt2/ 2,
Wherein, θ is head rotation angle, ω0For the angular speed of head rotation, β is the angular acceleration of head rotation, and t is It is the voice data length of reciever caching between the time for the sound heard, 10ms~60ms, is shaken according to current network Situation, a specific t value (10ms~60ms) can be obtained by hardware, and more than 60ms can substantially feel there is sound delay time, used Family experience is bad, so 10ms~60ms head rotation angle, θ is calculated, by the incoming HRTF algoritic modules of head rotation angle, θ In, HRTF algoritic modules use existing algorithms library, generate 3D audios.
General principle, principal character and the advantages of the present invention of the present invention has been shown and described above.The technology of the industry Personnel are it should be appreciated that the present invention is not limited to the above embodiments, and the simply explanation described in above-described embodiment and specification is originally The principle of invention, without departing from the spirit and scope of the present invention, various changes and modifications of the present invention are possible, these changes Change and improvement all fall within the protetion scope of the claimed invention.The claimed scope of the invention by appended claims and its Equivalent thereof.

Claims (2)

1. a kind of 3D audios based on head phase produce algorithm, its key step includes:
1) distal end voice data is received;
2) unpacked by Neteq modules, handle network jitter, handle voice package losing, smooth generation pcm voice data;
3) pcm voice data are received by 3D audio effect processing modules, generates 3D audios;
4) audio data transmitting of generation 3D audios is sent to hardware broadcasting.
2. a kind of 3D audios based on head phase according to claim 1 produce algorithm, it is characterised in that:The step 3) In, the 3D audio effect processings module includes 3D audios pretreatment module and HRTF algoritic modules, the 3D audios pretreatment module In, according to formula
θ=ω0t+βt2/ 2,
Calculate 10ms~60ms head rotation angle, θ, by the incoming HRTF algoritic modules of head rotation angle, θ, HRTF algorithms Module uses existing algorithms library, generates 3D audios.
CN201710147042.1A 2017-03-13 2017-03-13 A kind of 3D audios based on head phase produce algorithm Pending CN107071639A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710147042.1A CN107071639A (en) 2017-03-13 2017-03-13 A kind of 3D audios based on head phase produce algorithm

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710147042.1A CN107071639A (en) 2017-03-13 2017-03-13 A kind of 3D audios based on head phase produce algorithm

Publications (1)

Publication Number Publication Date
CN107071639A true CN107071639A (en) 2017-08-18

Family

ID=59621620

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710147042.1A Pending CN107071639A (en) 2017-03-13 2017-03-13 A kind of 3D audios based on head phase produce algorithm

Country Status (1)

Country Link
CN (1) CN107071639A (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101483797A (en) * 2008-01-07 2009-07-15 昊迪移通(北京)技术有限公司 Head-related transfer function generation method and apparatus for earphone acoustic system
CN104050288A (en) * 2014-06-27 2014-09-17 上海二三四五网络科技股份有限公司 Calling method and system based on web browser and soft switch server
CN105163242A (en) * 2015-09-01 2015-12-16 深圳东方酷音信息技术有限公司 Multi-angle 3D sound playback method and device
CN105872928A (en) * 2016-04-26 2016-08-17 惠州Tcl移动通信有限公司 Method and system for generating virtual surround sound based on mobile terminal

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101483797A (en) * 2008-01-07 2009-07-15 昊迪移通(北京)技术有限公司 Head-related transfer function generation method and apparatus for earphone acoustic system
CN104050288A (en) * 2014-06-27 2014-09-17 上海二三四五网络科技股份有限公司 Calling method and system based on web browser and soft switch server
CN105163242A (en) * 2015-09-01 2015-12-16 深圳东方酷音信息技术有限公司 Multi-angle 3D sound playback method and device
CN105872928A (en) * 2016-04-26 2016-08-17 惠州Tcl移动通信有限公司 Method and system for generating virtual surround sound based on mobile terminal

Similar Documents

Publication Publication Date Title
US9525958B2 (en) Multidimensional virtual learning system and method
CN109068263B (en) Binaural rendering of headphones using metadata processing
WO2018196469A1 (en) Method and apparatus for processing audio data of sound field
WO2020088158A1 (en) Headset and playing method therefor
TWI310930B (en)
JP2010538572A (en) Audio signal decoding method and apparatus
MX2011005782A (en) Audio/video data play control method and apparatus.
MY147141A (en) Head related transfer functions for panned stereo audio content
WO2017128481A1 (en) Method of controlling bone conduction headphone, device and bone conduction headphone apparatus
EP1552723A1 (en) Apparatus and method for adapting audio signal according to user's preference
CN108366299A (en) A kind of media playing method and device
US10516959B1 (en) Methods and systems for extended reality audio processing and rendering for near-field and far-field audio reproduction
CN109120947A (en) A kind of the voice private chat method and client of direct broadcasting room
JP2022548400A (en) Hybrid near-field/far-field speaker virtualization
US11589184B1 (en) Differential spatial rendering of audio sources
US10871939B2 (en) Method and system for immersive virtual reality (VR) streaming with reduced audio latency
Bolot et al. Adding voice to distributed games on the internet
CN107071639A (en) A kind of 3D audios based on head phase produce algorithm
CN105976825A (en) Music sharing device and music sharing method
CN112073890A (en) Audio data processing method and device and terminal equipment
US11950088B2 (en) System and method for generating spatial audio with uniform reverberation in real-time communication
CN107979807A (en) A kind of analog loop is around stereosonic method and system
TW200850041A (en) Positioning and recovery headphone for the sound-source compensates the sound-image
TWI620425B (en) Information transferring system with speed adjusting function and its implementing method
JP5946090B2 (en) Acoustic signal processing apparatus and acoustic signal processing method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20170818