CN108076415A - A kind of real-time implementation method of Doppler's audio - Google Patents
A kind of real-time implementation method of Doppler's audio Download PDFInfo
- Publication number
- CN108076415A CN108076415A CN201611018808.8A CN201611018808A CN108076415A CN 108076415 A CN108076415 A CN 108076415A CN 201611018808 A CN201611018808 A CN 201611018808A CN 108076415 A CN108076415 A CN 108076415A
- Authority
- CN
- China
- Prior art keywords
- time
- real
- delay
- doppler
- audio
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 31
- 238000005070 sampling Methods 0.000 claims abstract description 25
- 230000008569 process Effects 0.000 claims abstract description 11
- 230000005540 biological transmission Effects 0.000 claims abstract description 3
- 230000006698 induction Effects 0.000 claims description 4
- 230000008859 change Effects 0.000 abstract description 6
- 238000006073 displacement reaction Methods 0.000 abstract description 5
- 230000007246 mechanism Effects 0.000 abstract description 2
- 230000009467 reduction Effects 0.000 abstract description 2
- 230000000694 effects Effects 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 238000006243 chemical reaction Methods 0.000 description 2
- 210000005069 ears Anatomy 0.000 description 2
- NAWXUBYGYWOOIX-SFHVURJKSA-N (2s)-2-[[4-[2-(2,4-diaminoquinazolin-6-yl)ethyl]benzoyl]amino]-4-methylidenepentanedioic acid Chemical compound C1=CC2=NC(N)=NC(N)=C2C=C1CCC1=CC=C(C(=O)N[C@@H](CC(=C)C(O)=O)C(O)=O)C=C1 NAWXUBYGYWOOIX-SFHVURJKSA-N 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 238000002360 preparation method Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R3/00—Circuits for transducers, loudspeakers or microphones
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2430/00—Signal processing covered by H04R, not provided for in its groups
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Stereophonic System (AREA)
Abstract
The invention discloses a kind of real-time implementation methods of Doppler's audio, this method is from the mechanism of transmission of sound, virtual sound source is calculated to the propagation delay of auditor's virtual location, and signal is passed through by queue caching and the sampling filter of time-varying according to the time delay in real time, so as to fulfill real-time Doppler's audio, wherein, time varing filter comes from default Time-Delay Filter group.Doppler's audio of any time arbitrary change in displacement can be simulated or reappeared to a kind of real-time implementation method of Doppler's audio disclosed in this invention in real time, the missing of data will not occur, because whole process is linear process, so the distortion and distortion of signal will not be introduced, with larger flexibility, computational complexity is low, is highly suitable for the application scenario of the emulation of 3D audios and sound field reduction, has larger application prospect.
Description
Technical field
The present invention relates to electroacoustic techniques fields, and in particular to a kind of real-time implementation method of Doppler's audio.
Background technology
Doppler effect is a kind of common acoustic phenomenon, and for auditor, the frequency of acoustical signal can be with Virtual Sound
Source speed of related movement changes.Specifically, virtual sound source is perceived with certain speed close to auditor by auditor
The frequency of acoustical signal can increase than the frequency of acoustic signal, and virtual sound source with certain speed away from auditor, by audition
The frequency for the acoustical signal that person perceives can decrease than the frequency of acoustic signal.In 3D audios, for more real weight
Now or the sound in reconstruct nature, the real-time implementation of Doppler's audio become the key technology of 3D sound effect technologies.Traditional
The real-time implementation of Doppler's audio is handled often through modified tone or frequency displacement, wherein, the modified tone processing for being directly changed sample rate can band
Carry out the missing of voice data, destroy the continuity of initial data, and digital frequency displacement processing flexibility is poor, can bring larger volume
Outer operand, and signal distortion and distortion can be introduced.
The content of the invention
In order to solve the problems, such as that Doppler's audio in audio reappears and reconstruct, the present invention propose a kind of Doppler's audio
Real-time implementation method.
Technical scheme is as follows：
Initialize the velocity of sound, the virtual location of listeners head, the virtual location and virtual sound source of virtual sound source in 3D audios
Acoustical signal；
The trace information that the virtual location of setting auditor changes over time, the position for setting virtual sound source changes over time
Trace information；
At certain time point, virtual sound source is calculated to the distance of the virtual location of listeners head, the distance divided by the velocity of sound obtain
To direct sound wave propagation delay time, the direct sound wave propagation delay time divided by sampling period obtain direct sound wave propagation delay time sampling period number；It should
Direct sound wave propagation delay time sampling period number is made of integer and non-negative pure decimal (pure decimal i.e. more than or equal to 0), wherein：
1) integer part to induction signal using the sampling period as the time delay of least unit, is realized by data buffer storage queue；
2) non-negative pure decimal part to time delay of the induction signal within the sampling period, is realized by Time-Delay Filter；
According to the combination of above-mentioned direct sound wave propagation delay time sampling period number, corresponding data buffer storage queue and time delay is selected to filter
Ripple device realizes time varing filter；
Time-Delay Filter comes from default Time-Delay Filter group, each wave filter in Time-Delay Filter group corresponds to one
The process demand of a non-negative pure decimal time delay sampling period number.
Using data frame or using single sampled point as minimal processing unit, current acoustical signal is filtered by the time-varying selected
Ripple device obtains the output signal at the time point；
The signal for handling obtained Each point in time is connected in chronological order, is then added because acoustic propagation is brought
Gain, obtain with Doppler's audio acoustical signal.
A kind of real-time implementation method of Doppler's audio, including：
According to the physical distance d of virtual source position to the virtual location at listeners head center, the biography of direct sound wave is calculated
Defeated delay, τ, i.e.,
Wherein, c is the velocity of sound.
Then, it is from the acoustical signal y (n) of virtual sound source x (n) arrival head parts
Y (n)=Ax (n) * sinc (nTs- τ), (2)
Wherein, A is because sound pressure level caused by acoustic propagation decays, and * is convolution, TsIt is the sampling period of signal,
sinc(n·Ts- τ) it is that the sample delay that sampling function sinc (t) is obtained after delay, τ represents, sampling function sinc's (t)
Expression formula is
Further, propagation delay time τ can be analyzed to
τ=(p+q) Ts, (4)
In formula, p is integer, and q is non-negative pure decimal, that is, is met
0≤q ＜ 1. (5)
Further, formula (4) is brought into formula (2), can obtained
Y (n)=Ax (n-p) * sinc ((n-q) Ts). (6)
Therefore, to arbitrary delay, τ, output signal y (n) can be acquired by formula (6).
Since q is continuous value, so calculating formula (6) in real time, operand is larger, the value of q is carried out equidistantly discrete
It turns toI.e.
In formula, K is positive integer, represents the precision of q discretizations, and k is integer and meets 0≤k ＜ K.The size of K values determines
The resolution ratio of virtual sound source displacement also determines the continuity of audio conversion, i.e. K is bigger, and delay resolution is higher, audio conversion
The continuity changed is better, and the tonequality of output and the perceived effect of Doppler's audio are better.
Further, make
Then hk(n) be corresponding different discretization q filter coefficient, bring formula (8) into formula (6), then have
y(n)≈A·x(n-p)*hk(n). (9)
In formula, the value of any k all corresponds to a wave filter hk(n), each wave filter pair in Time-Delay Filter group
The process demand of a non-negative pure decimal time delay sampling period number is answered, therefore, a total of K wave filter hk(n).This K filtering
Device hk(n) preserved as wave filter group, be known as Time-Delay Filter group.In real-time calculating process, system is according to different
Q after discretization selects corresponding wave filter in Time-Delay Filter group, and avoids calculating formula (6) median filter coefficient institute band
The additional operand come, meets the needs of handling in real time.
Further, according to formula (9), when virtual sound source is close, τ is tapered into, i.e., p is tapered into, and the q sampling periods become
Change, compared with x (n), the calculating process of y (n) can skip the sampled point of part x (n), so that the frequency liter of acoustical signal
It is high；According to formula (9), when virtual sound source is separate, τ becomes larger, i.e., p becomes larger, and the q sampling periods change, compared with x (n)
Compared with the sampled point of the calculating process meeting repeating part x (n) of y (n), so that the frequency of acoustical signal reduces.
Preferably, according to virtual sound source to the physical distance d of auditor's ears virtual locationi, it is through to calculate ears correspondence
The delivery lag τ of soundi, wherein, i=0,1, left and right ear is represented respectively, i.e.,
Based on formula (10), the virtual location that left and right ear is reached to virtual sound source is carried out respectively at similar formula (4) and formula (9)
Reason, optimization processing effect.
Beneficial effects of the present invention
The invention discloses a kind of real-time implementation method of Doppler's audio, this method from the mechanism of transmission of sound,
Calculate virtual sound source arrive auditor's virtual location propagation delay, and according to the time delay by signal in real time by queue cache and when
The sampling filter of change, so as to fulfill real-time Doppler's audio, wherein, time varing filter comes from default Time-Delay Filter
Group.A kind of real-time implementation method of Doppler's audio disclosed in this invention can be simulated in real time or to reappear any time arbitrary
The missing of data will not occur for Doppler's audio of change in displacement, because whole process is linear process, will not introduce
The distortion and distortion of signal have larger flexibility, and computational complexity is low, are highly suitable for the emulation of 3D audios and sound field reduction
Application scenario, have larger application prospect.
Description of the drawings
To describe the technical solutions in the embodiments of the present invention more clearly, make required in being described below to embodiment
Attached drawing is briefly described, it should be apparent that, the accompanying drawings in the following description is only some embodiments of the present invention, for
For those of ordinary skill in the art, without creative efforts, other are can also be obtained according to these attached drawings
Attached drawing.
Fig. 1 is a kind of flow chart of the real-time implementation method of Doppler's audio of the present invention；
Fig. 2 is a kind of structure diagram of the real-time implementation method of Doppler's audio of the present invention.
Specific embodiment
Below in conjunction with the attached drawing in the embodiment of the present invention, the technical solution in the embodiment of the present invention is described, is shown
So, described embodiment is only part of the embodiment of the present invention, instead of all the embodiments.Based on the reality in the present invention
Apply example, those of ordinary skill in the art's all other embodiments obtained without making creative work all belong to
In the scope of protection of the invention.
As shown in Figure 1, it is a kind of flow chart of the real-time implementation method of Doppler's audio of the present invention.
In step [101], Time-Delay Filter group (8) is initialized, the sample rate of signal is set as 48kHz, and the length of K is set
100 are set to, the length of each wave filter is arranged to 100, then the total amount of data of Time-Delay Filter group (8) is deposited for 10000 data
Store up unit.
In step [102], initialization velocity of sound c, auditor's movement locus (1), virtual sound source movement locus (2) and original
Source of sound (9).
In step [103], it is corresponding virtual to calculate current time point data (sampled data points or sample data frames)
The distance (4) of sound source position and auditor's virtual location, and then according to the velocity of sound and signal sampling period, calculate because the distance generates
Direct sound propagation time delay and the time delay corresponding to sampling period number (5).
In step [104], the corresponding sampling period number of time delay is divided into integer part p (6) and pure decimal part q (7)
Two parts.
In step [105], integer part time delay is cached by data queue and realized, i.e. y1(n)=x (n-p).
In step [106], according to the value of pure decimal part q, it is suitable to select to obtain in Time-Delay Filter group (8)
Filter coefficient hk(n) (12), by its output signal convolution with caching, i.e. y2(n)=hk(n)·y1(n)。
In step [107], according to the position of auditor and the distance of virtual source position, gain A is calculated, and passes through increasing
Benefit calculates (13) and acts on signal, i.e. y (n)=Ay2(n)。
In step [108], current data handling result y (n) is exported.Step [103] is then back to, under preparation processing
The data at one time point.
A kind of real-time implementation method of the Doppler's audio provided above the embodiment of the present invention is described in detail,
For those of ordinary skill in the art, according to the thought of the embodiment of the present invention, in specific embodiments and applications
It will change, therefore, this specification content should not be construed as limiting the invention.
Claims (4)
- A kind of 1. real-time implementation method of Doppler's audio, it is characterised in that：At certain time point, calculate the distance (4) that virtual sound source arrives the virtual location of listeners head, the distance divided by the velocity of sound this away from From direct sound wave propagation delay time is obtained, the direct sound wave propagation delay time is again divided by the sampling period obtains the direct sound wave propagation delay time sampling period Number (5)；The direct sound wave propagation delay time sampling period number is made of integer (6) and non-negative pure decimal (7)；During according to the through sound transmission Prolong the combination of sampling period number, sound-source signal is real by data buffer storage queue (11) and the corresponding Time-Delay Filter (12) of selection Existing time varing filter, then by because of gain process caused by acoustic propagation, so as to fulfill the real-time implementation of Doppler's audio Purpose.
- 2. the real-time implementation method of Doppler's audio as described in claim 1, it is characterised in that：Direct sound wave propagation delay time samples The integer part of periodicity, it is real by data buffer storage queue (11) to induction signal using the sampling period as the pure time delay of least unit It is existing.
- 3. the real-time implementation method of Doppler's audio as described in claim 1, it is characterised in that：Direct sound wave propagation delay time samples The non-negative pure decimal part of periodicity to time delay of the induction signal within the sampling period, is realized by Time-Delay Filter (12).
- 4. the real-time implementation method of Doppler's audio as described in claim 1, it is characterised in that：Time-Delay Filter comes from pre- If Time-Delay Filter group (8), each wave filter in Time-Delay Filter group (8) corresponds to a non-negative pure decimal time delay sampling The process demand of periodicity.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611018808.8A CN108076415B (en) | 2016-11-16 | 2016-11-16 | Real-time realization method of Doppler sound effect |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611018808.8A CN108076415B (en) | 2016-11-16 | 2016-11-16 | Real-time realization method of Doppler sound effect |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108076415A true CN108076415A (en) | 2018-05-25 |
| CN108076415B CN108076415B (en) | 2020-06-30 |
Family
ID=62160292
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611018808.8A Active CN108076415B (en) | 2016-11-16 | 2016-11-16 | Real-time realization method of Doppler sound effect |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108076415B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109714697A (en) * | 2018-08-06 | 2019-05-03 | 上海头趣科技有限公司 | The emulation mode and analogue system of three-dimensional sound field Doppler's audio |
| CN110459220A (en) * | 2019-08-26 | 2019-11-15 | 杭州涂鸦信息技术有限公司 | A kind of voice awakening method and system and readable storage medium storing program for executing, computer |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1566984A (en) * | 2003-06-19 | 2005-01-19 | 中国科学院声学研究所 | Method for sonar array signal simulation by utilizing interpolation filter |
| JP2008035320A (en) * | 2006-07-31 | 2008-02-14 | Konami Digital Entertainment:Kk | Sound simulation device, sound simulation method, and program |
| CN101263739A (en) * | 2005-09-13 | 2008-09-10 | Srs实验室有限公司 | Systems and methods for audio processing |
| CN101681663A (en) * | 2007-05-22 | 2010-03-24 | 皇家飞利浦电子股份有限公司 | A device for and a method of processing audio data |
| CN101960866A (en) * | 2007-03-01 | 2011-01-26 | 杰里·马哈布比 | Audio spatialization and environment simulation |
| CN102130992A (en) * | 2011-01-21 | 2011-07-20 | 宇龙计算机通信科技(深圳)有限公司 | Sound effect processing method and terminal |
| US20130142338A1 (en) * | 2011-12-01 | 2013-06-06 | National Central University | Virtual Reality Sound Source Localization Apparatus |
| US20140009644A1 (en) * | 2012-07-06 | 2014-01-09 | Sony Corporation | Server, client terminal, and program |
| US20160034248A1 (en) * | 2014-07-29 | 2016-02-04 | The University Of North Carolina At Chapel Hill | Methods, systems, and computer readable media for conducting interactive sound propagation and rendering for a plurality of sound sources in a virtual environment scene |
-
2016
- 2016-11-16 CN CN201611018808.8A patent/CN108076415B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1566984A (en) * | 2003-06-19 | 2005-01-19 | 中国科学院声学研究所 | Method for sonar array signal simulation by utilizing interpolation filter |
| CN101263739A (en) * | 2005-09-13 | 2008-09-10 | Srs实验室有限公司 | Systems and methods for audio processing |
| JP2008035320A (en) * | 2006-07-31 | 2008-02-14 | Konami Digital Entertainment:Kk | Sound simulation device, sound simulation method, and program |
| CN101960866A (en) * | 2007-03-01 | 2011-01-26 | 杰里·马哈布比 | Audio spatialization and environment simulation |
| CN101681663A (en) * | 2007-05-22 | 2010-03-24 | 皇家飞利浦电子股份有限公司 | A device for and a method of processing audio data |
| CN102130992A (en) * | 2011-01-21 | 2011-07-20 | 宇龙计算机通信科技(深圳)有限公司 | Sound effect processing method and terminal |
| US20130142338A1 (en) * | 2011-12-01 | 2013-06-06 | National Central University | Virtual Reality Sound Source Localization Apparatus |
| US20140009644A1 (en) * | 2012-07-06 | 2014-01-09 | Sony Corporation | Server, client terminal, and program |
| US20160034248A1 (en) * | 2014-07-29 | 2016-02-04 | The University Of North Carolina At Chapel Hill | Methods, systems, and computer readable media for conducting interactive sound propagation and rendering for a plurality of sound sources in a virtual environment scene |
Non-Patent Citations (1)
| Title |
|---|
| 张蕾: "飞行模拟机数字音效系统研究", 《中国优秀硕士论文全文数据库 信息科技辑》 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109714697A (en) * | 2018-08-06 | 2019-05-03 | 上海头趣科技有限公司 | The emulation mode and analogue system of three-dimensional sound field Doppler's audio |
| CN110459220A (en) * | 2019-08-26 | 2019-11-15 | 杭州涂鸦信息技术有限公司 | A kind of voice awakening method and system and readable storage medium storing program for executing, computer |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108076415B (en) | 2020-06-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9918177B2 (en) | Binaural headphone rendering with head tracking | |
| KR101315070B1 (en) | A method of and a device for generating 3D sound | |
| CN101483797B (en) | Head-related transfer function generation method and apparatus for earphone acoustic system | |
| CN102739886B (en) | Stereo echo offset method based on echo spectrum estimation and speech existence probability | |
| US20200089468A1 (en) | Audio synchronization and delay estimation | |
| EP3295682A1 (en) | Privacy-preserving energy-efficient speakers for personal sound | |
| CN104778950B (en) | A kind of microphone signal delay compensation control method based on echo cancellor | |
| TW202338788A (en) | Method and apparatus for compressing and decompressing a higher order ambisonics representation for a sound field | |
| JP4724054B2 (en) | Specific direction sound collection device, specific direction sound collection program, recording medium | |
| CN111402868B (en) | Speech recognition method, device, electronic equipment and computer readable storage medium | |
| CN103945291B (en) | Method and device for achieving orientation voice transmission through two microphones | |
| JP2008020913A (en) | Partitioned fast convolution in time and frequency domain | |
| CN104134444B (en) | A kind of song based on MMSE removes method and apparatus of accompanying | |
| CN109036440B (en) | Multi-person conversation method and system | |
| CN107221337A (en) | Data filtering methods, multi-person speech call method and relevant device | |
| US8774418B2 (en) | Multi-channel down-mixing device | |
| CN104978966B (en) | Frame losing compensation implementation method and device in audio stream | |
| CN108076415A (en) | A kind of real-time implementation method of Doppler's audio | |
| US20160126915A1 (en) | Filter coefficient group computation device and filter coefficient group computation method | |
| CN110580912A (en) | Music visualization method, device and system | |
| CN110890100A (en) | Voice enhancement method, multimedia data acquisition method, multimedia data playing method, device and monitoring system | |
| Wenzel | Analysis of the role of update rate and system latency in interactive virtual acoustic environments | |
| CN115665616A (en) | FPGA-based microphone array directional pickup method | |
| CN105706162B (en) | Sound spatialization with complexity optimized room effect | |
| Otani et al. | Auditory artifacts due to switching head-related transfer functions of a dynamic virtual auditory display |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |