CN103854642A - Flame and sound synthesis method based on physics - Google Patents

Flame and sound synthesis method based on physics Download PDF

Info

Publication number
CN103854642A
CN103854642A CN201410082910.9A CN201410082910A CN103854642A CN 103854642 A CN103854642 A CN 103854642A CN 201410082910 A CN201410082910 A CN 201410082910A CN 103854642 A CN103854642 A CN 103854642A
Authority
CN
China
Prior art keywords
flame
mrow
integral
sound
divergence
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201410082910.9A
Other languages
Chinese (zh)
Other versions
CN103854642B (en
Inventor
刘世光
俞卓均
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tianjin University
Original Assignee
Tianjin University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tianjin University filed Critical Tianjin University
Priority to CN201410082910.9A priority Critical patent/CN103854642B/en
Publication of CN103854642A publication Critical patent/CN103854642A/en
Application granted granted Critical
Publication of CN103854642B publication Critical patent/CN103854642B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

The invention relates to the field of computer games, after effects, engineering simulation and the like, and provides an automatic synthesis method of flame and sound. The flame and sound synthesis method based on physics provides key technical support for acousto-optic simulation. According to the technical scheme, the flame and sound synthesis method based on physics comprises the step of visual simulation of flame, wherein a blue core model is used for modeling flame, the flame is simulated, the velocity field of each frame and other related field quantities like the fuel combustion rate are led out; the step of speed divergence integral computation, wherein the speed divergence integral of the part surrounded by the front end of the flame is worked out through the fuel combustion rate; the step of up-sampling based on fast Fourier transform (FFT), wherein the obtained speed divergence integral is rebuilt by adopting the up-sample based on the FFT; and the step of sound pressure output, wherein derivation is carried out on the speed divergence integral after up-sampling to obtain the final sound pressure. The flame and sound synthesis method based on physics is mainly applied to the occasions of video and image processing.

Description

Flame sound synthesis method based on physics
Technical Field
The invention relates to the fields of computer games, movie and television special effects, engineering simulation and the like, in particular to a flame sound synthesis method based on physics.
Technical Field
Traditional flame simulation tends to focus on visual rendering [1] only, ignoring auditory rendering. Like visual rendering, auditory rendering is also an important component of the realism of virtual reality. Even though flame simulation can produce vivid, realistic scenes, the user still experiences unrealistic scenes if there is a lack of auditory rendering, resulting in a poor user experience.
Recording is one of the most direct methods of auditory rendering. The user needs to record a corresponding piece of sound for each specific application. However, since such a form of recording is not conducive to multiplexing, different applications need to re-record, and more people start using short recordings. This type of process is commonly referred to as granular synthesis (granular synthesis) by editing, manipulating, and synthesizing short recordings to match specific applications. However, sound recordings have two inherent drawbacks: firstly, the recording and the simulated scenes need to be manually synchronized, which is not only a time-consuming and labor-consuming work, but also difficult to achieve complete synchronization; secondly, in some interactive scenes, most of the interactive behaviors are unpredictable in advance, so that the recording method has a large limitation in practical application.
In recent years, with the further development of computer graphics, attention to auditory rendering has been increased, and the results of such studies have been highlighted, and researchers have proposed sound generation methods for such phenomena as vibrating solids [2] [3] [4], aerodynamic acoustic phenomena [5] [6], splashed liquids [7] [8], and fractured solids [9] in succession. But is still relatively blank for the generation of flame sounds. Dobashi et al [5] [6] propose a physics-based method of generating vortex sounds and applying it to flames. Although this approach solves the above problem, the main source of the flame is not from vortices, i.e. vortices are only a small part of the flame sound. Jeffrey and Doug [10] propose methods for generating sound from the combustion of the main source of sound from a flame. Their proposed method, while producing a credible flame sound, is computationally expensive making it unsuitable for complex scenes. Even simple flame scenes, such as the back and forth movement of a candle, can take tens of hours, or even days, of operating time. Lowering the frame rate of the simulation can significantly reduce the simulation time, but at the same time, can significantly affect the reality of the generated sound.
Flames are important components of game scenes, movie special effects, simulation drilling systems (such as fire drilling) and the like. The realistic simulation of the flame comprises a visual simulation part and an auditory simulation part, but the existing work is more focused on the research of the visual simulation part and the auditory simulation part; the auditory simulation can greatly enhance the immersion of the simulated scene, and is not only an indispensable part in a game engine but also an indispensable key technology in a plurality of movie special effects.
[1]Bukowski R,Sequin C.Interactive simulation of fire in virtual building environments.Proceedings of SIGGRAPH,1997.35~44.
[2]O’Brien J F,Cook P R,Essl G.Synthesizing sounds from physically based motion.Proceedings of SIGGRAPH,2001.529~536.
[3]O’Brien J F,Shen C,Gatchalian C M.Synthesizing sounds from rigid-body simulations.Proceedings of SIGGRAPH,2002.175~181.
[4]Van D D,Pai D K.Foleyautomatic:Physically based sound effects for interactive simulationand animation.Proceedings of SIGGRAPH,2001.537~544.
[5]Dobashi Y,Yamamoto T,Nishita T.Real-time rendering of aerodynamic sound using soundtextures based on computational fluid dynamics.ACM Transactions on Graphics,2003,22(3):732~740.
[6]Dobashi Y,Yamamoto T,Nishita T.Synthesizing sound from turbulent fields using soundtextures for interactive fluid simulation.Computer Graphics Forum,2004,23(3):736~744.
[7]Zheng C.,James D.L.Harmonic fluids.ACM Transactions on Graphics,2009,28(3):37:1~37:12.
[8]Moss W,Yeh H,Manocha D.Sounding liquids:Automatic sound synthesis from fluidsimulation.ACM Transactions on Graphics,2010,29(3):21:1~21:13.
[9]Zheng C,James D L.Rigid-body fracture sound with precomputed soundbanks.ACMTransactions on Graphics,2010,29(3):69:1~69:13.
[10]Chadwick J N,James D L.Animating fire with sound.ACM Transactions on Graphics,2011,30(4):84:1~84:8.。
Disclosure of Invention
In order to overcome the defects of the prior art, the automatic synthesis method of the flame sound is provided, and key technical support is provided for acousto-optic simulation. Therefore, the technical scheme adopted by the invention is that the flame sound synthesis method based on physics comprises the following steps:
visual simulation of the flame: modeling flame by adopting a blue core model, simulating the flame, and deriving a velocity field of each frame and other related field quantities such as fuel combustion rate;
velocity divergence integral calculation: calculating the velocity divergence integral of the portion surrounded by the flame front end from the fuel combustion rate;
fast Fourier Transform (FFT) -based upsampling: reconstructing the obtained velocity divergence integral by adopting FFT-based up-sampling;
sound pressure output: and (4) obtaining final sound pressure by differentiating the velocity divergence integral after the up-sampling.
The simulation of the flame is as follows:
the present invention employs a blue core model to model the flame, which assumes that the gaseous fuel will immediately burn completely when it crosses the interface of the gaseous fuel and the combustion products, releasing a large amount of heat and the corresponding combustion products, the interface being referred to as the flame front, which is explicitly tracked using a level set or similar method, and the gaseous fuel and the combustion products are modeled using the following Navier-Stokes equations, respectively:
<math> <mrow> <mfrac> <mrow> <mo>&PartialD;</mo> <mi>u</mi> </mrow> <mrow> <mo>&PartialD;</mo> <mi>t</mi> </mrow> </mfrac> <mo>=</mo> <mo>-</mo> <mrow> <mo>(</mo> <mi>u</mi> <mo>&CenterDot;</mo> <mo>&dtri;</mo> <mo>)</mo> </mrow> <mi>u</mi> <mo>-</mo> <mo>&dtri;</mo> <mi>p</mi> <mo>/</mo> <mi>&rho;</mi> <mo>+</mo> <mi>f</mi> <mo>,</mo> <mo>-</mo> <mo>-</mo> <mo>-</mo> <mrow> <mo>(</mo> <mn>1</mn> <mo>)</mo> </mrow> </mrow> </math>
<math> <mrow> <mo>&dtri;</mo> <mo>&CenterDot;</mo> <mi>u</mi> <mo>=</mo> <mi>&Phi;</mi> <mo>,</mo> <mo>-</mo> <mo>-</mo> <mo>-</mo> <mrow> <mo>(</mo> <mn>2</mn> <mo>)</mo> </mrow> </mrow> </math>
wherein, formula (1) is a momentum equation, u is a speed, t represents time, p is a pressure, ρ is a density, and f represents an external force including buoyancy or gravity; formula (2) is a mass equation, phi is an optional divergence source, the value of phi is calculated through real-time data obtained through pre-specification or simulation, and when phi is larger than zero, a velocity field diffuses outwards at the point; conversely, when Φ is less than zero, the velocity field contracts inward at that point; in addition to the velocity field, the density field is used to model the state of smoke produced by combustion, and the temperature field is used to model the heat produced by combustion;
the velocity divergence integral calculation specifically comprises:
based on the assumption of a blue core, the heat release is concentrated at the flame front, which is directly proportional to the fuel velocity, and the volumetric integral of the heat release can then be converted into a curved integral of the velocity flux, which yields:
<math> <mrow> <mo>&Integral;</mo> <msup> <mi>qd</mi> <mn>3</mn> </msup> <mi>x</mi> <mo>=</mo> <msub> <mo>&Integral;</mo> <mi>S</mi> </msub> <mi>u</mi> <mo>&CenterDot;</mo> <mi>nds</mi> <mo>,</mo> <mo>-</mo> <mo>-</mo> <mo>-</mo> <mrow> <mo>(</mo> <mn>3</mn> <mo>)</mo> </mrow> </mrow> </math>
wherein S is the flame front end, u represents the velocity, n is the normal vector, and q represents the heat release amount; to avoid this operation, the surface integral is converted into a volume integral of the divergence according to the gaussian divergence formula, i.e.:
<math> <mrow> <msub> <mo>&Integral;</mo> <mi>S</mi> </msub> <mi>u</mi> <mo>&CenterDot;</mo> <mi>nds</mi> <mo>=</mo> <msub> <mo>&Integral;</mo> <mi>V</mi> </msub> <mo>&dtri;</mo> <mo>&CenterDot;</mo> <mi>udv</mi> <mo>,</mo> <mo>-</mo> <mo>-</mo> <mo>-</mo> <mrow> <mo>(</mo> <mn>4</mn> <mo>)</mo> </mrow> </mrow> </math>
where V is an arbitrary geometric body surrounded by the flame front, and based on a propagation wave equation describing the sound source and sound, and ignoring time delay and distance attenuation, the sound pressure p (t) is obtained as:
<math> <mrow> <mi>p</mi> <mrow> <mo>(</mo> <mi>t</mi> <mo>)</mo> </mrow> <mo>=</mo> <mfrac> <mi>d</mi> <mi>dt</mi> </mfrac> <msub> <mo>&Integral;</mo> <mi>V</mi> </msub> <mo>&dtri;</mo> <mo>&CenterDot;</mo> <mi>u</mi> <mrow> <mo>(</mo> <mi>x</mi> <mo>,</mo> <mi>t</mi> <mo>)</mo> </mrow> <mi>dv</mi> <mrow> <mo>(</mo> <mi>x</mi> <mo>)</mo> </mrow> <mo>.</mo> <mo>-</mo> <mo>-</mo> <mo>-</mo> <mrow> <mo>(</mo> <mn>5</mn> <mo>)</mo> </mrow> </mrow> </math>
the FFT-based upsampling specifically comprises:
signal enhancement is realized by constructing an FFT-based up-sampling operation in a zero-padding mode in a frequency domain, wherein zero padding is used for prolonging the spectrum length, and a spectrum with the length of L is prolonged to N > L by zero padding, as follows:
<math> <mrow> <msub> <mi>ZeroPad</mi> <mrow> <mi>N</mi> <mo>,</mo> <mi>L</mi> </mrow> </msub> <mrow> <mo>(</mo> <mi>x</mi> <mo>)</mo> </mrow> <mo>=</mo> <mfenced open='{' close=''> <mtable> <mtr> <mtd> <mi>x</mi> <mrow> <mo>(</mo> <mi>&omega;</mi> <mo>)</mo> </mrow> <mo>,</mo> </mtd> <mtd> <mo>|</mo> <mi>&omega;</mi> <mo>|</mo> <mo>&lt;</mo> <mi>L</mi> <mo>/</mo> <mn>2</mn> </mtd> </mtr> <mtr> <mtd> <mn>0</mn> <mo>,</mo> </mtd> <mtd> <mi>otherwise</mi> </mtd> </mtr> </mtable> </mfenced> <mo>,</mo> <mo>-</mo> <mo>-</mo> <mo>-</mo> <mrow> <mo>(</mo> <mn>6</mn> <mo>)</mo> </mrow> </mrow> </math>
wherein, L is the original spectrum length, N is the spectrum signal length after zero padding operation, generally, N = kL, and k is the expansion multiple; the upsampling operation is to firstly convert the obtained divergence value div (t) from the spatial domain to the frequency domain s (ω) through FFT; keeping the low-frequency part unchanged, and performing zero filling operation on the high-frequency part; finally, an up-sampled time domain signal is obtained by Inverse Fast Fourier Transform (IFFT).
The sound pressure output is specifically:
to determine the sound pressure p (t), the divergence value div (t) needs to be derived: interpolate div (t) using the cubic interpolation function:
<math> <mrow> <mi>div</mi> <mrow> <mo>(</mo> <mi>t</mi> <mo>)</mo> </mrow> <mo>=</mo> <munderover> <mi>&Sigma;</mi> <mrow> <mi>n</mi> <mo>=</mo> <mn>0</mn> </mrow> <mi>N</mi> </munderover> <mi>div</mi> <mrow> <mo>(</mo> <mi>n&Delta;t</mi> <mo>)</mo> </mrow> <mi>k</mi> <mo>[</mo> <mrow> <mo>(</mo> <mi>t</mi> <mo>-</mo> <mi>n&Delta;t</mi> <mo>)</mo> </mrow> <mo>/</mo> <mi>&Delta;t</mi> <mo>]</mo> <mo>,</mo> <mo>-</mo> <mo>-</mo> <mo>-</mo> <mrow> <mo>(</mo> <mn>7</mn> <mo>)</mo> </mrow> </mrow> </math>
wherein, <math> <mrow> <mi>k</mi> <mrow> <mo>(</mo> <mi>x</mi> <mo>)</mo> </mrow> <mo>=</mo> <mfrac> <mn>1</mn> <mn>6</mn> </mfrac> <mfenced open='{' close=''> <mtable> <mtr> <mtd> <mn>7</mn> <msup> <mrow> <mo>|</mo> <mi>x</mi> <mo>|</mo> </mrow> <mn>3</mn> </msup> <mo>-</mo> <mn>12</mn> <msup> <mrow> <mo>|</mo> <mi>x</mi> <mo>|</mo> </mrow> <mn>2</mn> </msup> <mo>+</mo> <mfrac> <mn>16</mn> <mn>3</mn> </mfrac> <mo>,</mo> </mtd> <mtd> <mo>|</mo> <mi>x</mi> <mo>|</mo> <mo>&lt;</mo> <mn>1</mn> </mtd> </mtr> <mtr> <mtd> <mo>-</mo> <mfrac> <mn>7</mn> <mn>3</mn> </mfrac> <msup> <mrow> <mo>|</mo> <mi>x</mi> <mo>|</mo> </mrow> <mn>3</mn> </msup> <mo>+</mo> <mn>12</mn> <msup> <mrow> <mo>|</mo> <mi>x</mi> <mo>|</mo> </mrow> <mn>2</mn> </msup> <mo>-</mo> <mn>20</mn> <mo>|</mo> <mi>x</mi> <mo>|</mo> <mo>+</mo> <mfrac> <mn>32</mn> <mn>3</mn> </mfrac> <mo>,</mo> </mtd> <mtd> <mn>1</mn> <mo>&le;</mo> <mo>|</mo> <mi>x</mi> <mo>|</mo> <mo>&lt;</mo> <mn>2</mn> </mtd> </mtr> <mtr> <mtd> <mn>0</mn> <mo>,</mo> </mtd> <mtd> <mi>otherwise</mi> </mtd> </mtr> </mtable> </mfenced> <mo>.</mo> </mrow> </math>
then, the sound pressure is derived as:
<math> <mrow> <mi>p</mi> <mrow> <mo>(</mo> <mi>t</mi> <mo>)</mo> </mrow> <mo>=</mo> <mfrac> <mi>d</mi> <mi>dt</mi> </mfrac> <mi>div</mi> <mrow> <mo>(</mo> <mi>t</mi> <mo>)</mo> </mrow> <mo>=</mo> <munderover> <mi>&Sigma;</mi> <mrow> <mi>n</mi> <mo>=</mo> <mn>0</mn> </mrow> <mi>N</mi> </munderover> <mi>div</mi> <mrow> <mo>(</mo> <mi>n&Delta;t</mi> <mo>)</mo> </mrow> <mfrac> <mi>d</mi> <mi>dt</mi> </mfrac> <mi>k</mi> <mo>[</mo> <mrow> <mo>(</mo> <mi>t</mi> <mo>-</mo> <mi>n&Delta;t</mi> <mo>)</mo> </mrow> <mo>/</mo> <mi>&Delta;t</mi> <mo>]</mo> <mo>,</mo> <mo>-</mo> <mo>-</mo> <mo>-</mo> <mrow> <mo>(</mo> <mn>8</mn> <mo>)</mo> </mrow> <mo>.</mo> </mrow> </math>
the invention has the following technical effects:
the invention can automatically generate more vivid flame sound effect and can be used in the fields of computer games, movie and television special effect making and the like. In addition, when the method is used in engineering simulation, the sense of reality and the immersion of a simulation environment can be enhanced.
The invention has simple requirements on the operating environment and low implementation cost, and the specific requirements are as follows:
support Windows XP, Windows vista, Windows7 environment, the microcomputer of the memory above 2G, the video memory configuration above 1G.
Drawings
Fig. 1 is a schematic diagram of FFT-based upsampling.
Fig. 2 shows a flame scene and a resulting sound signal generated using the present invention.
FIG. 3 is a flow chart of the present invention.
Detailed Description
The invention provides a flame sound automatic synthesis method based on physics, which mainly comprises the following steps:
visual simulation of the flame: the flame is simulated using a physics-based solution and the velocity field and other relevant field quantities such as fuel burn rate for each frame are derived.
Velocity divergence integral calculation: the velocity dispersion integral of the portion surrounded by the flame front is calculated from the fuel combustion rate.
Fast Fourier Transform (FFT) -based upsampling: and reconstructing the obtained velocity divergence integral by adopting FFT-based up-sampling.
Sound pressure output: and (4) obtaining final sound pressure by differentiating the velocity divergence integral after the up-sampling.
The specific technical scheme of the invention is as follows:
1) visual simulation of flames
The invention adopts a blue core model (reference: Nguyen D, Fedkiwew R, Jensen H.Physally based and evaluation of fire. ACM Transactions on Graphics,2002,21(3): 721-728.) to model the flame. The model assumes that the gaseous fuel will immediately burn completely as it crosses the interface of the gaseous fuel and the combustion products, releasing a significant amount of heat and the corresponding combustion products. This interface is referred to as the flame front. The flame front is explicitly tracked using a level set or similar method, and the gaseous fuel and combustion products are modeled using the following Navier-Stokes equations, respectively:
<math> <mrow> <mfrac> <mrow> <mo>&PartialD;</mo> <mi>u</mi> </mrow> <mrow> <mo>&PartialD;</mo> <mi>t</mi> </mrow> </mfrac> <mo>=</mo> <mo>-</mo> <mrow> <mo>(</mo> <mi>u</mi> <mo>&CenterDot;</mo> <mo>&dtri;</mo> <mo>)</mo> </mrow> <mi>u</mi> <mo>-</mo> <mo>&dtri;</mo> <mi>p</mi> <mo>/</mo> <mi>&rho;</mi> <mo>+</mo> <mi>f</mi> <mo>,</mo> <mo>-</mo> <mo>-</mo> <mo>-</mo> <mrow> <mo>(</mo> <mn>1</mn> <mo>)</mo> </mrow> </mrow> </math>
<math> <mrow> <mo>&dtri;</mo> <mo>&CenterDot;</mo> <mi>u</mi> <mo>=</mo> <mi>&Phi;</mi> <mo>,</mo> <mo>-</mo> <mo>-</mo> <mo>-</mo> <mrow> <mo>(</mo> <mn>2</mn> <mo>)</mo> </mrow> </mrow> </math>
where equation (1) is a momentum equation, u is velocity, t represents time, p is pressure, ρ is density, and f represents an external force such as buoyancy or gravity. Equation (2) is a mass equation, and Φ is an optional divergence source, and the value of Φ can be calculated from real-time data that is specified in advance or modeled. When phi is larger than zero, the velocity field diffuses outwards at the point; conversely, when Φ is less than zero, the velocity field contracts inward at that point. In addition to the velocity field, the density field may be used to model the state of smoke produced by combustion, and the temperature field may be used to model the heat produced by combustion.
2) Velocity divergence integral calculation
Based on the assumption of a blue core, the heat release is concentrated at the flame front. The amount of heat released is directly proportional to the fuel velocity, and the volumetric integral of heat released can be converted into a curved integral of velocity flux, from which:
<math> <mrow> <mo>&Integral;</mo> <msup> <mi>qd</mi> <mn>3</mn> </msup> <mi>x</mi> <mo>=</mo> <msub> <mo>&Integral;</mo> <mi>S</mi> </msub> <mi>u</mi> <mo>&CenterDot;</mo> <mi>nds</mi> <mo>,</mo> <mo>-</mo> <mo>-</mo> <mo>-</mo> <mrow> <mo>(</mo> <mn>3</mn> <mo>)</mo> </mrow> </mrow> </math>
where S is the flame front, u represents the velocity, n is the normal vector, and q represents the amount of heat released. Although the heat release amount q does not need to be obtained, the conversion inevitably requires the flame front end to be discretized into a triangular patch because the curved surface integral needs to be calculated on the flame front end. Experiments have shown that this is a rather computationally expensive operation, each of which takes on the order of seconds. To avoid this operation, the present invention converts the surface integral into a volume integral of divergence according to the gaussian divergence formula, namely:
<math> <mrow> <msub> <mo>&Integral;</mo> <mi>S</mi> </msub> <mi>u</mi> <mo>&CenterDot;</mo> <mi>nds</mi> <mo>=</mo> <msub> <mo>&Integral;</mo> <mi>V</mi> </msub> <mo>&dtri;</mo> <mo>&CenterDot;</mo> <mi>udv</mi> <mo>,</mo> <mo>-</mo> <mo>-</mo> <mo>-</mo> <mrow> <mo>(</mo> <mn>4</mn> <mo>)</mo> </mrow> </mrow> </math>
where V is any geometric body surrounded by the flame front. Although the integral is still calculated within the geometry of the flame front envelope, the only thing that needs to be calculated is the divergence of the velocity, which can significantly increase the calculation time. Based on the propagation wave equation describing the sound source and sound (ref: Chrighton D G, Dowling A P.model Methods in analytical acoustics. Berlin: Springer-Verlag, 1992.), neglecting time delay and distance attenuation, a sound pressure p (t) is obtained as:
<math> <mrow> <mi>p</mi> <mrow> <mo>(</mo> <mi>t</mi> <mo>)</mo> </mrow> <mo>=</mo> <mfrac> <mi>d</mi> <mi>dt</mi> </mfrac> <msub> <mo>&Integral;</mo> <mi>V</mi> </msub> <mo>&dtri;</mo> <mo>&CenterDot;</mo> <mi>u</mi> <mrow> <mo>(</mo> <mi>x</mi> <mo>,</mo> <mi>t</mi> <mo>)</mo> </mrow> <mi>dv</mi> <mrow> <mo>(</mo> <mi>x</mi> <mo>)</mo> </mrow> <mo>.</mo> <mo>-</mo> <mo>-</mo> <mo>-</mo> <mrow> <mo>(</mo> <mn>5</mn> <mo>)</mo> </mrow> </mrow> </math>
3) FFT-based upsampling
The velocity divergence integral div (t) is found for each frame from the data derived from the flame simulation, but the information from frame to frame is lost. In order to further increase the speed, the analog frame rate needs to be reduced. But lowering the frame rate results in the loss of some key frame information and thus distortion of the generated sound.
The invention constructs an FFT-based up-sampling operation to realize signal enhancement by a zero filling mode in a frequency domain. The zero padding operation uses zero padding to extend the spectral length. By zero-filling, a spectrum of length L can be extended to N > L, as follows:
<math> <mrow> <msub> <mi>ZeroPad</mi> <mrow> <mi>N</mi> <mo>,</mo> <mi>L</mi> </mrow> </msub> <mrow> <mo>(</mo> <mi>x</mi> <mo>)</mo> </mrow> <mo>=</mo> <mfenced open='{' close=''> <mtable> <mtr> <mtd> <mi>x</mi> <mrow> <mo>(</mo> <mi>&omega;</mi> <mo>)</mo> </mrow> <mo>,</mo> </mtd> <mtd> <mo>|</mo> <mi>&omega;</mi> <mo>|</mo> <mo>&lt;</mo> <mi>L</mi> <mo>/</mo> <mn>2</mn> </mtd> </mtr> <mtr> <mtd> <mn>0</mn> <mo>,</mo> </mtd> <mtd> <mi>otherwise</mi> </mtd> </mtr> </mtable> </mfenced> <mo>,</mo> <mo>-</mo> <mo>-</mo> <mo>-</mo> <mrow> <mo>(</mo> <mn>6</mn> <mo>)</mo> </mrow> </mrow> </math>
wherein, L is the original spectrum length, and N is the spectrum signal length after zero filling operation. Typically, N = kL, k being the expansion factor. Since such zero-padding operation can provide nearly perfect upsampling information for the time-domain signal, the upsampling operation thus constructed can recover as much as possible the frame information lost by lowering the frame rate. The upsampling operation is shown in fig. 1, and the obtained divergence value div (t) is first transformed from the spatial domain to the frequency domain s (ω) by the FFT. In fig. 1 (c), the low frequency part is kept unchanged, and the zero padding operation is performed on the high frequency part. Finally, an up-sampled time domain signal is obtained by Inverse Fast Fourier Transform (IFFT). Comparing fig. 1 (a) and fig. 1 (d), after the up-sampling operation, the frame information lost between the time steps is recovered.
Sound pressure output
To determine the sound pressure p (t), a derivation of the divergence value div (t) is required. Since div (t) is only known at fixed time steps 0,. DELTA.t, 2. DELTA.t, …, N. DELTA.t, a continuous time-domain signal is obtained by interpolation. The invention uses the cubic interpolation function (reference: Mitchell D P, Nefracali A. Reconstruction filters in computer-graphics. proceedings of SIGTRAPH, 1988.221-228.) proposed by Mitchell and Nefracali to interpolate div (t):
<math> <mrow> <mi>div</mi> <mrow> <mo>(</mo> <mi>t</mi> <mo>)</mo> </mrow> <mo>=</mo> <munderover> <mi>&Sigma;</mi> <mrow> <mi>n</mi> <mo>=</mo> <mn>0</mn> </mrow> <mi>N</mi> </munderover> <mi>div</mi> <mrow> <mo>(</mo> <mi>n&Delta;t</mi> <mo>)</mo> </mrow> <mi>k</mi> <mo>[</mo> <mrow> <mo>(</mo> <mi>t</mi> <mo>-</mo> <mi>n&Delta;t</mi> <mo>)</mo> </mrow> <mo>/</mo> <mi>&Delta;t</mi> <mo>]</mo> <mo>,</mo> <mo>-</mo> <mo>-</mo> <mo>-</mo> <mrow> <mo>(</mo> <mn>7</mn> <mo>)</mo> </mrow> </mrow> </math>
wherein, <math> <mrow> <mi>k</mi> <mrow> <mo>(</mo> <mi>x</mi> <mo>)</mo> </mrow> <mo>=</mo> <mfrac> <mn>1</mn> <mn>6</mn> </mfrac> <mfenced open='{' close=''> <mtable> <mtr> <mtd> <mn>7</mn> <msup> <mrow> <mo>|</mo> <mi>x</mi> <mo>|</mo> </mrow> <mn>3</mn> </msup> <mo>-</mo> <mn>12</mn> <msup> <mrow> <mo>|</mo> <mi>x</mi> <mo>|</mo> </mrow> <mn>2</mn> </msup> <mo>+</mo> <mfrac> <mn>16</mn> <mn>3</mn> </mfrac> <mo>,</mo> </mtd> <mtd> <mo>|</mo> <mi>x</mi> <mo>|</mo> <mo>&lt;</mo> <mn>1</mn> </mtd> </mtr> <mtr> <mtd> <mo>-</mo> <mfrac> <mn>7</mn> <mn>3</mn> </mfrac> <msup> <mrow> <mo>|</mo> <mi>x</mi> <mo>|</mo> </mrow> <mn>3</mn> </msup> <mo>+</mo> <mn>12</mn> <msup> <mrow> <mo>|</mo> <mi>x</mi> <mo>|</mo> </mrow> <mn>2</mn> </msup> <mo>-</mo> <mn>20</mn> <mo>|</mo> <mi>x</mi> <mo>|</mo> <mo>+</mo> <mfrac> <mn>32</mn> <mn>3</mn> </mfrac> <mo>,</mo> </mtd> <mtd> <mn>1</mn> <mo>&le;</mo> <mo>|</mo> <mi>x</mi> <mo>|</mo> <mo>&lt;</mo> <mn>2</mn> </mtd> </mtr> <mtr> <mtd> <mn>0</mn> <mo>,</mo> </mtd> <mtd> <mi>otherwise</mi> </mtd> </mtr> </mtable> </mfenced> <mo>.</mo> </mrow> </math>
then, the sound pressure is derived as:
<math> <mrow> <mi>p</mi> <mrow> <mo>(</mo> <mi>t</mi> <mo>)</mo> </mrow> <mo>=</mo> <mfrac> <mi>d</mi> <mi>dt</mi> </mfrac> <mi>div</mi> <mrow> <mo>(</mo> <mi>t</mi> <mo>)</mo> </mrow> <mo>=</mo> <munderover> <mi>&Sigma;</mi> <mrow> <mi>n</mi> <mo>=</mo> <mn>0</mn> </mrow> <mi>N</mi> </munderover> <mi>div</mi> <mrow> <mo>(</mo> <mi>n&Delta;t</mi> <mo>)</mo> </mrow> <mfrac> <mi>d</mi> <mi>dt</mi> </mfrac> <mi>k</mi> <mo>[</mo> <mrow> <mo>(</mo> <mi>t</mi> <mo>-</mo> <mi>n&Delta;t</mi> <mo>)</mo> </mrow> <mo>/</mo> <mi>&Delta;t</mi> <mo>]</mo> <mo>,</mo> <mo>-</mo> <mo>-</mo> <mo>-</mo> <mrow> <mo>(</mo> <mn>8</mn> <mo>)</mo> </mrow> </mrow> </math>
the invention relates to solution and vector operation of a large number of equations, and the computational efficiency can be improved by adopting a programming mode based on GPU (graphics Processing units).

Claims (5)

1. A method for synthesizing flame sound based on physics is characterized by comprising the following steps:
visual simulation of the flame: modeling flame by adopting a blue core model, simulating the flame, and deriving a velocity field of each frame and other related field quantities such as fuel combustion rate;
velocity divergence integral calculation: calculating the velocity divergence integral of the portion surrounded by the flame front end from the fuel combustion rate;
fast Fourier Transform (FFT) -based upsampling: reconstructing the obtained velocity divergence integral by adopting FFT-based up-sampling;
sound pressure output: and (4) obtaining final sound pressure by differentiating the velocity divergence integral after the up-sampling.
2. A physics-based flame sound synthesis method as claimed in claim 1 wherein the simulating of flames is specifically: the flame is modeled using a blue-colored core model that assumes complete combustion immediately as the gaseous fuel crosses the interface of the gaseous fuel and the combustion products, known as the flame front, which is explicitly tracked using a level set or similar method, releasing a large amount of heat and corresponding combustion products, modeled using the following Navier-Stokes equations for the gaseous fuel and combustion products, respectively:
Figure FDA0000474385330000011
wherein, formula (1) is a momentum equation, u is a speed, t represents time, p is a pressure, ρ is a density, and f represents an external force including buoyancy or gravity; formula (2) is a mass equation, phi is an optional divergence source, the value of phi is calculated through real-time data obtained through pre-specification or simulation, and when phi is larger than zero, a velocity field diffuses outwards at the point; conversely, when Φ is less than zero, the velocity field contracts inward at that point; in addition to the velocity field, the density field is used to model the state of smoke produced by combustion, and the temperature field is used to model the heat produced by combustion.
3. The physics-based flame sound synthesis method of claim 1, wherein the velocity divergence integral calculation is specifically:
based on the assumption of a blue core, the heat release is concentrated at the flame front, which is directly proportional to the fuel velocity, and the volumetric integral of the heat release can then be converted into a curved integral of the velocity flux, which yields:
Figure FDA0000474385330000012
wherein S is the flame front end, u represents the velocity, n is the normal vector, and q represents the heat release amount; to avoid this operation, the surface integral is converted into a volume integral of the divergence according to the gaussian divergence formula, i.e.:
Figure FDA0000474385330000013
where V is an arbitrary geometric body surrounded by the flame front, and based on a propagation wave equation describing the sound source and sound, and ignoring time delay and distance attenuation, the sound pressure p (t) is obtained as:
Figure FDA0000474385330000014
4. the physics-based flame sound synthesis method of claim 1, wherein the FFT-based upsampling is specifically: signal enhancement is realized by constructing an FFT-based up-sampling operation in a zero-padding mode in a frequency domain, wherein zero padding is used for prolonging the spectrum length, and a spectrum with the length of L is prolonged to N > L by zero padding, as follows:
Figure FDA0000474385330000021
wherein, L is the original spectrum length, N is the spectrum signal length after zero filling operation, N = kL, k is the expansion multiple; the upsampling operation is to firstly convert the obtained divergence value div (t) from the spatial domain to the frequency domain s (ω) through FFT; keeping the low-frequency part unchanged, and performing zero filling operation on the high-frequency part; finally, an up-sampled time domain signal is obtained by Inverse Fast Fourier Transform (IFFT).
5. The physics-based flame sound synthesis method of claim 1, wherein the sound pressure output is specifically:
to determine the sound pressure p (t), the divergence value div (t) needs to be derived: interpolate div (t) using the cubic interpolation function:
Figure FDA0000474385330000022
wherein,
Figure FDA0000474385330000023
then, the sound pressure is derived as:
Figure FDA0000474385330000024
CN201410082910.9A 2014-03-07 2014-03-07 Flame speech synthesizing method based on physics Active CN103854642B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201410082910.9A CN103854642B (en) 2014-03-07 2014-03-07 Flame speech synthesizing method based on physics

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410082910.9A CN103854642B (en) 2014-03-07 2014-03-07 Flame speech synthesizing method based on physics

Publications (2)

Publication Number Publication Date
CN103854642A true CN103854642A (en) 2014-06-11
CN103854642B CN103854642B (en) 2016-08-17

Family

ID=50862213

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410082910.9A Active CN103854642B (en) 2014-03-07 2014-03-07 Flame speech synthesizing method based on physics

Country Status (1)

Country Link
CN (1) CN103854642B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109448753A (en) * 2018-10-24 2019-03-08 天津大学 Explosion sound automatic synthesis method based on sample
CN109711395A (en) * 2019-02-28 2019-05-03 李娟娟 The device for preventing infant hospital respiratory infections

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101046956A (en) * 2006-03-28 2007-10-03 国际商业机器公司 Interactive audio effect generating method and system
CN101116136A (en) * 2005-02-10 2008-01-30 皇家飞利浦电子股份有限公司 Sound synthesis
CN101842830A (en) * 2007-09-28 2010-09-22 Ati技术无限责任公司 Interactive sound synthesis
US20110112840A1 (en) * 2008-07-11 2011-05-12 Otodesigners Co., Ltd. Synthetic sound generation method and apparatus

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101116136A (en) * 2005-02-10 2008-01-30 皇家飞利浦电子股份有限公司 Sound synthesis
CN101046956A (en) * 2006-03-28 2007-10-03 国际商业机器公司 Interactive audio effect generating method and system
CN101842830A (en) * 2007-09-28 2010-09-22 Ati技术无限责任公司 Interactive sound synthesis
US20110112840A1 (en) * 2008-07-11 2011-05-12 Otodesigners Co., Ltd. Synthetic sound generation method and apparatus

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109448753A (en) * 2018-10-24 2019-03-08 天津大学 Explosion sound automatic synthesis method based on sample
CN109448753B (en) * 2018-10-24 2022-10-11 天津大学 Sample-based automatic explosion sound synthesis method
CN109711395A (en) * 2019-02-28 2019-05-03 李娟娟 The device for preventing infant hospital respiratory infections
CN109711395B (en) * 2019-02-28 2019-11-26 李娟娟 The device for preventing infant hospital respiratory infections

Also Published As

Publication number Publication date
CN103854642B (en) 2016-08-17

Similar Documents

Publication Publication Date Title
Chadwick et al. Animating fire with sound
Moss et al. Sounding liquids: Automatic sound synthesis from fluid simulation
Dobashi et al. Real-time rendering of aerodynamic sound using sound textures based on computational fluid dynamics
Narain et al. Fast animation of turbulence using energy transport and procedural synthesis
Schechter et al. Evolving sub-grid turbulence for smoke animation
Wang et al. Toward wave-based sound synthesis for computer animation.
Dobashi et al. Synthesizing sound from turbulent field using sound textures for interactive fluid simulation
EP2551825A2 (en) Fluid dynamics framework for animated special effects
Liu et al. Sounding fire for immersive virtual reality
James Physically based sound for computer animation and virtual environments
CN103854642B (en) Flame speech synthesizing method based on physics
CA3174278A1 (en) Method for simulating combustion in digital imagery with variable pressure conditions
CN118228460A (en) Noise audible visualization method and system based on mixed reality open rotor engine
Yin et al. Sounding solid combustibles: non-premixed flame sound synthesis for different solid combustibles
CN109448753B (en) Sample-based automatic explosion sound synthesis method
Liu et al. Automatic synthesis of explosion sound synchronized with animation
Liu et al. Animating explosion with exploding sound and rigid‐body sound
Liu et al. Sound Synthesis
Huang et al. Physically-based modeling, simulation and rendering of fire for computer animation
Paul Granulation of sound in video games
Wang et al. Efficient sound synthesis for natural scenes
Cheng et al. Liquid-solid interaction sound synthesis
Cheng et al. Lightweight Scene-aware Rain Sound Simulation for Interactive Virtual Environments
US9454624B2 (en) System and method for time-based graphical simulation of a natural effect
Sato et al. Feedback control of fire simulation based on computational fluid dynamics

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant