CN107195310A - A kind of method for processing video frequency of sound driver particle effect - Google Patents
A kind of method for processing video frequency of sound driver particle effect Download PDFInfo
- Publication number
- CN107195310A CN107195310A CN201710499407.7A CN201710499407A CN107195310A CN 107195310 A CN107195310 A CN 107195310A CN 201710499407 A CN201710499407 A CN 201710499407A CN 107195310 A CN107195310 A CN 107195310A
- Authority
- CN
- China
- Prior art keywords
- audio
- particle
- video
- fft
- particle effect
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 239000002245 particle Substances 0.000 title claims abstract description 48
- 230000000694 effects Effects 0.000 title claims abstract description 40
- 238000000034 method Methods 0.000 title claims abstract description 21
- 238000012545 processing Methods 0.000 title claims abstract description 17
- 238000004458 analytical method Methods 0.000 claims abstract description 17
- 238000001228 spectrum Methods 0.000 claims abstract description 5
- 238000010183 spectrum analysis Methods 0.000 claims description 5
- 230000001360 synchronised effect Effects 0.000 claims description 3
- 230000009466 transformation Effects 0.000 claims description 3
- 238000000844 transformation Methods 0.000 claims description 3
- 238000012800 visualization Methods 0.000 abstract description 4
- 230000008569 process Effects 0.000 abstract description 3
- 230000008676 import Effects 0.000 description 3
- 241000208340 Araliaceae Species 0.000 description 2
- 235000005035 Panax pseudoginseng ssp. pseudoginseng Nutrition 0.000 description 2
- 235000003140 Panax quinquefolius Nutrition 0.000 description 2
- 238000000354 decomposition reaction Methods 0.000 description 2
- 230000008020 evaporation Effects 0.000 description 2
- 238000001704 evaporation Methods 0.000 description 2
- 235000008434 ginseng Nutrition 0.000 description 2
- 230000002452 interceptive effect Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- NAWXUBYGYWOOIX-SFHVURJKSA-N (2s)-2-[[4-[2-(2,4-diaminoquinazolin-6-yl)ethyl]benzoyl]amino]-4-methylidenepentanedioic acid Chemical compound C1=CC2=NC(N)=NC(N)=C2C=C1CCC1=CC=C(C(=O)N[C@@H](CC(=C)C(O)=O)C(O)=O)C=C1 NAWXUBYGYWOOIX-SFHVURJKSA-N 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/48—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use
- G10L25/51—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for comparison or discrimination
- G10L25/57—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for comparison or discrimination for processing of video signals
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/03—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 characterised by the type of extracted parameters
- G10L25/18—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 characterised by the type of extracted parameters the extracted parameters being spectral information of each sub-band
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Signal Processing (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention discloses a kind of method for processing video frequency of sound driver particle effect, following steps are specifically included：Selecting video and special efficacy step, audio-visual synchronization step, based on the corresponding particle step of FFT fast frequency spectrums analytical procedure, audio-frequency information, particle effect step；The invention enables whole process is quick and smooth, visualization is strong.
Description
Technical field
The present invention relates to video field, in particular, it is related to at a kind of video of sound driver particle effect
Reason method.
Background technology
Smart mobile phone becomes increasingly popular in recent years, and its function is also stronger and stronger, is shared in daily life using mobile phone
The video oneself shot is also more and more universal.The content of traditional video sharing in expressive force in addition to adding some special efficacys,
It is few that interaction effect can be done with the sound in video and also not convenient enough, directly perceived when making special efficacy.
The content of the invention
It is an object of the invention to provide a kind of method for processing video frequency of sound driver particle effect so that whole process is fast
Fast smooth, visualization is strong.
In order to solve the above-mentioned technical problem, technical scheme is as follows：
A kind of method for processing video frequency of sound driver particle effect, specifically includes following steps：
101) selecting video and special efficacy step：Select video and the particle effect template to be edited；
102) audio-visual synchronization step：By step 101) selection video, by by audio time carry out deblocking, reach
It is synchronous to visual/audio effects；
103) FFT fast frequency spectrum analytical procedures are based on：By to step 102) audio-frequency information analyzed by FFT, obtain
Audio frequency parameter is taken, and caches analysis result；The FFT is one kind that Fast Fourier Transform (FFT) is the i.e. offline Fourier transformations of DFT
The method that modified quickly handles audio-frequency information；
104) audio-frequency information correspondence particle step：Step 103 is obtained from template) ginseng of obtained audio-frequency information and particle
Several corresponding relations, the corresponding relation uses corresponding mathe-matical map；
105) particle effect step：In template driving processing, carry out actuation step 104) in particle parameter, and
Edlin is entered to corresponding particle effect using AE particle effect, it is specific then to import simulator progress according to the parameter of particle
Particle effect generation；The AE is that After Effect are a graphics video processing software.
Further, the step 102) the one section of PCM data i.e. pulse code that is read out by Audio decoders of audio
Modulation data, and carry out deblocking processing according to the time stepping of audio.
Further, the step 103) in DFT using equation below (1) carry out spectrum analysis：
Wherein N is the quantity of finite length sequence, and x (n) is the expression formula of finite length sequence,J is imaginary number
Unit, e is natural constant.
Further, the FFT carries out first half analysis using equation below (2), and formula (3) carries out latter half point
Analysis：
Wherein X1(k),X2(k) it is, that FFT list entries is expressed as the N/2 points DFT of pair-point sequence and singular point sequence respectively.
Advantage is the present invention compared with prior art：
Then the present invention ties first with the sound or music in high-precision audible spectrum technical Analysis video for analysis
Really, particle effect is driven according to cut-and-dried template.So as to realize the seamless link of sound and particle, increase video interactive
Effect.Effect is directly exported from After Effect edit tools and imports mobile phone, and which is convenient, effect visualization is strong.Can be with
In the operation of mobile phone A PP ends, speed is smooth.
Brief description of the drawings
Fig. 1 is a kind of audio analysis flow chart of the method for processing video frequency of sound driver particle effect of the invention；
Fig. 2 is a kind of mobile phone terminal process chart of the method for processing video frequency of sound driver particle effect of the invention.
Embodiment
The present invention is further described with reference to the accompanying drawings and detailed description.
As depicted in figs. 1 and 2, a kind of method for processing video frequency of sound driver particle effect, specifically includes following steps：
101) selecting video and special efficacy step：User chooses the video to be edited and the particle effect mould to drive
Plate.
102) audio-visual synchronization step：By step 101) selection video, one section of PCM number is read out by Audio decoders
According to i.e. pulse code modulation data, that is, audio, and by carrying out deblocking by the time stepping of audio time, reached with this
It is synchronous to visual/audio effects, it is ensured that the real-time interactive sense of effect experience.
103) FFT fast frequency spectrum analytical procedures are based on：By to step 102) audio-frequency information analyzed by FFT, obtain
Audio frequency parameter is taken, and caches analysis result；The FFT is one kind that Fast Fourier Transform (FFT) is the i.e. offline Fourier transformations of DFT
The method that modified quickly handles audio-frequency information.The DFT carries out spectrum analysis using equation below (1)：
Wherein N is the quantity of finite length sequence, and x (n) is the expression formula of finite length sequence,J is imaginary number
Unit, e is natural constant.For N point finite length sequences, DFT needs to carry out 4N2Secondary multiplying, the time of operand is complicated
Spend for O (N2).And in order to want to obtain high-precision result of spectrum analysis, N values are general more than 512, data operation quantity now
Very big, the real-time that will result directly in this method is very poor.As a kind of DFT fast method, FFT requires the quantity of list entries
N=2L(L is a mathematical notation amount for representing sequence number with exponential form for convenience, for example:L=1, sequence number 2L=
2；L=2 sequences number 2L=4...), if being unsatisfactory for this condition, can taking human as additionally add some zero points, be allowed to
Reach this requirement.FFT list entries can be expressed as equation below (4) pair-point sequence x1(r) with singular point sequence x2
(r), r is the index value of sequence：
And then DFT expression formula can be split as equation below (5)：
WhereinAnd then formula is further developed as equation below (6)：
X1And X (k)2(k) it is respectively x1And x (r)2(r) N/2 points, so that the formula (7) developed：
As can be seen that a N points DFT has resolved into the DFT of two N/2 points, they constitute a N points DFT again.And X1
And X (k)2And x (k)1And x (r)2(r) all it is N/2 point sequences, X (k) but has N points.With the above-mentioned simply X (k) calculated
The first half item number result, wants to utilize X1And X (k)2(k) if the whole values for obtaining X (k), the cycle of complex exponential root need to be utilized
Property equation below (8)：
So as to obtain equation below (9)：
X1(k+N/2)=X1(k),X2(k+N/2)=X2(k) formula (9)
SimultaneouslyAlso have periodically, so as to draw equation below (10)：
The expression formula that complete N points FFT is can obtain with reference to formula (9) and formula (10) is that equation below (2) carries out first half
Partial analysis, formula (3) carries out latter half analysis：
It can thus be appreciated thatIt isDifferentiation formula.Do after above-mentioned such decomposition analysis calculating, multiplication is calculated
Amount halves, simultaneously as the FFT sequences number of input is 2L, therefore further can also decompose always, finally it is decomposed at 2 points
DFT, decomposition number of times is log2N, final operand time complexity is O (Nlog2N).Original DFT is so compared, FFT's
Time complexity significantly reduces.By taking N=1024 as an example, take and poor 2 orders of magnitude of DFT.This is provided for high-precision spectrum analysis
Ensure.Also allow to the smoothness under mobile phone terminal environment to use, reduce hardware requirement.
104) audio-frequency information correspondence particle step：Step 103 is obtained from template) ginseng of obtained audio-frequency information and particle
Several corresponding relations, the corresponding relation uses corresponding mathe-matical map.For example define in a template the volume value of audio with
The mathematical relationship of the number of evaporation particle per second of particle is y=2x+15, and the x is the volume value of audio, and y is the hair per second of particle
Radion subnumber, then it represents that the volume value that certain moment obtains is 20, then the number of evaporation particle per second of current particle is 55.
105) particle effect step：In template driving processing, carry out actuation step 104) in particle parameter, and
Edlin is entered to corresponding particle effect using AE particle effect, it is specific then to import simulator progress according to the parameter of particle
Particle effect generation, which solve special efficacy design visualization problem, increase convenience.The AE is After Effect
I.e. a graphics video processing software.
Described above is only the preferred embodiment of the present invention, it is noted that for the ordinary skill people of the art
Member, without departing from the inventive concept of the premise, can also make some improvements and modifications, these improvements and modifications also should be regarded as
In the scope of the present invention.
Claims (4)
1. a kind of method for processing video frequency of sound driver particle effect, it is characterised in that specifically include following steps：
101) selecting video and special efficacy step：Select video and the particle effect template to be edited；
102) audio-visual synchronization step：By step 101) selection video, by by audio time carry out deblocking, reach sound
Video effect is synchronous；
103) FFT fast frequency spectrum analytical procedures are based on：By to step 102) audio-frequency information analyzed by FFT, obtain sound
Frequency parameter, and cache analysis result；The FFT is that Fast Fourier Transform (FFT) improves for a kind of of the i.e. offline Fourier transformations of DFT
The method that type quickly handles audio-frequency information；
104) audio-frequency information correspondence particle step：Step 103 is obtained from template) parameter of obtained audio-frequency information and particle
Corresponding relation, the corresponding relation uses corresponding mathe-matical map；
105) particle effect step：Driving processing in template, carrys out actuation step 104) in particle parameter, and utilize
AE particle effect enters edlin to corresponding particle effect, and then importing simulator according to the parameter of particle carries out specific grain
The generation of sub- special efficacy；The AE is that After Effect are a graphics video processing software.
2. a kind of method for processing video frequency of sound driver particle effect according to claim 1, it is characterised in that the step
The one section of PCM data i.e. pulse code modulation data that rapid audio 102) is read out by Audio decoders, and according to audio when
Between stepping carry out deblocking processing.
3. a kind of method for processing video frequency of sound driver particle effect according to claim 1, it is characterised in that the step
It is rapid 103) in DFT using equation below (1) carry out spectrum analysis：
Wherein N is the quantity of finite length sequence, and x (n) is the expression formula of finite length sequence,J is imaginary unit, e
For natural constant.
4. the method for processing video frequency of a kind of sound driver particle effect according to claim 3, it is characterised in that described
FFT carries out first half analysis using equation below (2), and formula (3) carries out latter half analysis：
Wherein X1(k),X2(k) it is, that FFT list entries is expressed as the N/2 points DFT of pair-point sequence and singular point sequence respectively.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2017101257717 | 2017-03-05 | ||
| CN201710125771 | 2017-03-05 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107195310A true CN107195310A (en) | 2017-09-22 |
Family
ID=59880526
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710499407.7A Pending CN107195310A (en) | 2017-03-05 | 2017-06-27 | A kind of method for processing video frequency of sound driver particle effect |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107195310A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111249727A (en) * | 2020-01-20 | 2020-06-09 | 网易（杭州）网络有限公司 | Game special effect generation method and device, storage medium and electronic equipment |
| CN111669497A (en) * | 2020-06-12 | 2020-09-15 | 杭州趣维科技有限公司 | Method for driving sticker effect by volume during self-shooting of mobile terminal |
| EP3748954A4 (en) * | 2018-01-30 | 2021-03-24 | Guangzhou Baiguoyuan Information Technology Co., Ltd. | Processing method for achieving interactive special effects for video, medium, and terminal apparatus |
| CN113838168A (en) * | 2021-10-13 | 2021-12-24 | 亿览在线网络技术（北京）有限公司 | Method for generating particle special effect animation |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2134081A1 (en) * | 2007-03-09 | 2009-12-16 | Pioneer Corporation | Effect device, av processing device and program |
| CN102800130A (en) * | 2012-07-04 | 2012-11-28 | 哈尔滨工程大学 | Water level-close aircraft maneuvering flight visual scene simulation method |
| CN103391468A (en) * | 2012-05-08 | 2013-11-13 | 安凯(广州)微电子技术有限公司 | Network video data buffer control method and system based on mobile terminal |
| CN103402118A (en) * | 2013-07-05 | 2013-11-20 | Tcl集团股份有限公司 | Media program interaction method and system |
| CN104023265A (en) * | 2013-03-01 | 2014-09-03 | 联想(北京)有限公司 | Method and device for switching audio information streams and electronic equipment |
| CN104077090A (en) * | 2013-03-25 | 2014-10-01 | 北京发现角科技有限公司 | Particle system based on gravity sensing and sound-based control of injection rate and method |
| CN104703043A (en) * | 2015-03-26 | 2015-06-10 | 努比亚技术有限公司 | Video special effect adding method and device |
| CN104717567A (en) * | 2015-03-30 | 2015-06-17 | 北京奇艺世纪科技有限公司 | Dynamic display method and device for weather information |
| CN105872838A (en) * | 2016-04-28 | 2016-08-17 | 徐文波 | Sending method and device of special media effects of real-time videos |
-
2017
- 2017-06-27 CN CN201710499407.7A patent/CN107195310A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2134081A1 (en) * | 2007-03-09 | 2009-12-16 | Pioneer Corporation | Effect device, av processing device and program |
| CN103391468A (en) * | 2012-05-08 | 2013-11-13 | 安凯(广州)微电子技术有限公司 | Network video data buffer control method and system based on mobile terminal |
| CN102800130A (en) * | 2012-07-04 | 2012-11-28 | 哈尔滨工程大学 | Water level-close aircraft maneuvering flight visual scene simulation method |
| CN104023265A (en) * | 2013-03-01 | 2014-09-03 | 联想(北京)有限公司 | Method and device for switching audio information streams and electronic equipment |
| CN104077090A (en) * | 2013-03-25 | 2014-10-01 | 北京发现角科技有限公司 | Particle system based on gravity sensing and sound-based control of injection rate and method |
| CN103402118A (en) * | 2013-07-05 | 2013-11-20 | Tcl集团股份有限公司 | Media program interaction method and system |
| CN104703043A (en) * | 2015-03-26 | 2015-06-10 | 努比亚技术有限公司 | Video special effect adding method and device |
| CN104717567A (en) * | 2015-03-30 | 2015-06-17 | 北京奇艺世纪科技有限公司 | Dynamic display method and device for weather information |
| CN105872838A (en) * | 2016-04-28 | 2016-08-17 | 徐文波 | Sending method and device of special media effects of real-time videos |
Non-Patent Citations (2)
| Title |
|---|
| 林平: "《硕士学位论文》", 15 March 2016, 电子科技大学 * |
| 胡丽莹，肖蓬: "快速傅里叶变换在频谱分析中的应用", 《福建师范大学学报(自然科学版)》 * |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP3748954A4 (en) * | 2018-01-30 | 2021-03-24 | Guangzhou Baiguoyuan Information Technology Co., Ltd. | Processing method for achieving interactive special effects for video, medium, and terminal apparatus |
| US11533442B2 (en) | 2018-01-30 | 2022-12-20 | Guangzhou Baiguoyuan Information Technology Co., Ltd. | Method for processing video with special effects, storage medium, and terminal device thereof |
| CN111249727A (en) * | 2020-01-20 | 2020-06-09 | 网易（杭州）网络有限公司 | Game special effect generation method and device, storage medium and electronic equipment |
| CN111249727B (en) * | 2020-01-20 | 2021-03-02 | 网易（杭州）网络有限公司 | Game special effect generation method and device, storage medium and electronic equipment |
| WO2021147157A1 (en) * | 2020-01-20 | 2021-07-29 | 网易（杭州）网络有限公司 | Game special effect generation method and apparatus, and storage medium and electronic device |
| CN111669497A (en) * | 2020-06-12 | 2020-09-15 | 杭州趣维科技有限公司 | Method for driving sticker effect by volume during self-shooting of mobile terminal |
| CN113838168A (en) * | 2021-10-13 | 2021-12-24 | 亿览在线网络技术（北京）有限公司 | Method for generating particle special effect animation |
| CN113838168B (en) * | 2021-10-13 | 2023-10-03 | 亿览在线网络技术（北京）有限公司 | Particle special effect animation generation method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107195310A (en) | A kind of method for processing video frequency of sound driver particle effect | |
| CN110992449B (en) | Dance action synthesis method, device, equipment and storage medium | |
| CN106570106A (en) | Method and device for converting voice information into expression in input process | |
| CN109783655A (en) | A kind of cross-module state search method, device, computer equipment and storage medium | |
| CN104731861B (en) | Multi-medium data method for pushing and device | |
| WO2012154470A1 (en) | Generating a playlist | |
| CN106095834A (en) | Intelligent dialogue method and system based on topic | |
| CN107589828A (en) | The man-machine interaction method and system of knowledge based collection of illustrative plates | |
| CN110209869A (en) | A kind of audio file recommended method, device and storage medium | |
| CN106921749A (en) | For the method and apparatus of pushed information | |
| CN110400254A (en) | A kind of lipstick examination cosmetic method and device | |
| EP3425630A1 (en) | Electronic device-awakening method and apparatus, device and computer-readable storage medium | |
| CN110288682A (en) | Method and apparatus for controlling the variation of the three-dimensional portrait shape of the mouth as one speaks | |
| CN110110134A (en) | A kind of generation method, system and the associated component of music recommendation information | |
| CN108989706A (en) | The method and device of special efficacy is generated based on music rhythm | |
| CN114513678A (en) | Face information generation method and device | |
| CN108877794A (en) | For the method, apparatus of human-computer interaction, electronic equipment and computer readable storage medium | |
| CN111400473A (en) | Method and device for training intention recognition model, storage medium and electronic equipment | |
| CN115691544A (en) | Training of virtual image mouth shape driving model and driving method, device and equipment thereof | |
| CN111383619B (en) | Sound effect generation method, device, equipment and computer readable storage medium | |
| CN111462775B (en) | Audio similarity determination method, device, server and medium | |
| CN112989177B (en) | Information processing method, information processing device, electronic equipment and computer storage medium | |
| CN104866091A (en) | Method and device for outputting audio-effect information in computer equipment | |
| Kostek et al. | Parametrisation and correlation analysis applied to music mood classification | |
| CN103885994A (en) | Method and device for comparing products |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170922 |
|
| RJ01 | Rejection of invention patent application after publication |