CN108536790A - The generation of sound special efficacy program file packet and sound special efficacy generation method and device - Google Patents
The generation of sound special efficacy program file packet and sound special efficacy generation method and device Download PDFInfo
- Publication number
- CN108536790A CN108536790A CN201810277590.0A CN201810277590A CN108536790A CN 108536790 A CN108536790 A CN 108536790A CN 201810277590 A CN201810277590 A CN 201810277590A CN 108536790 A CN108536790 A CN 108536790A
- Authority
- CN
- China
- Prior art keywords
- sound
- special efficacy
- parameter
- sound material
- play
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 132
- 239000000463 material Substances 0.000 claims abstract description 534
- 230000000694 effects Effects 0.000 claims abstract description 85
- 230000008676 import Effects 0.000 claims abstract description 38
- 230000004044 response Effects 0.000 claims description 47
- 230000009471 action Effects 0.000 claims description 44
- 230000002452 interceptive effect Effects 0.000 claims description 35
- 238000004590 computer program Methods 0.000 claims description 23
- 238000012545 processing Methods 0.000 claims description 8
- 238000009877 rendering Methods 0.000 abstract description 7
- 241000208340 Araliaceae Species 0.000 description 18
- 235000005035 Panax pseudoginseng ssp. pseudoginseng Nutrition 0.000 description 18
- 235000003140 Panax quinquefolius Nutrition 0.000 description 18
- 230000006870 function Effects 0.000 description 18
- 235000008434 ginseng Nutrition 0.000 description 18
- 238000001514 detection method Methods 0.000 description 17
- 238000010586 diagram Methods 0.000 description 14
- 238000004891 communication Methods 0.000 description 10
- 238000004321 preservation Methods 0.000 description 10
- 230000008569 process Effects 0.000 description 10
- 230000006835 compression Effects 0.000 description 8
- 238000007906 compression Methods 0.000 description 8
- 210000004209 hair Anatomy 0.000 description 6
- 230000008859 change Effects 0.000 description 5
- 235000013399 edible fruits Nutrition 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 5
- 238000007654 immersion Methods 0.000 description 4
- 230000006399 behavior Effects 0.000 description 3
- 210000003811 finger Anatomy 0.000 description 3
- 241000320126 Pseudomugilidae Species 0.000 description 2
- 206010044074 Torticollis Diseases 0.000 description 2
- 230000003190 augmentative effect Effects 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 125000004122 cyclic group Chemical group 0.000 description 2
- 210000004709 eyebrow Anatomy 0.000 description 2
- 210000004247 hand Anatomy 0.000 description 2
- 210000003128 head Anatomy 0.000 description 2
- 208000018197 inherited torticollis Diseases 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 210000001747 pupil Anatomy 0.000 description 2
- 230000010255 response to auditory stimulus Effects 0.000 description 2
- 210000003813 thumb Anatomy 0.000 description 2
- 230000001960 triggered effect Effects 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 210000003414 extremity Anatomy 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
- G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/06—Transformation of speech into a non-audible representation, e.g. speech visualisation or speech processing for tactile aids
- G10L21/10—Transforming into visible information
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Multimedia (AREA)
- General Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Acoustics & Sound (AREA)
- Quality & Reliability (AREA)
- General Health & Medical Sciences (AREA)
- Computational Linguistics (AREA)
- Signal Processing (AREA)
- Data Mining & Analysis (AREA)
- Studio Circuits (AREA)
Abstract
The embodiment of the invention discloses a kind of generation of sound special efficacy program file packet and sound special efficacy generation method and devices, wherein the generation method of sound special efficacy program file packet includes：Import sound material；Obtain the parameter value of the play parameter of the sound material；Sound special efficacy program file packet is generated according to the sound material and the parameter value of the play parameter.The embodiment of the present invention is not necessarily to pass through manual writing program file, the executable sound special efficacy program file of rendering engine can be generated, it is easy to operate, required time is short, improve the whole efficiency of sound special efficacy realization, and avoid the mistake that manual writing program file is likely to occur, the effective guarantee accuracy of special effect.
Description
Technical field
The present invention relates to computer vision technique, the generation of especially a kind of sound special efficacy program file packet and sound special efficacy
Generation method and device.
Background technology
Augmented reality (Augmented Reality, AR) is a kind of by real world information and virtual world information
" seamless " integrated new technology, is the entity information script in the certain time spatial dimension of real world, analog simulation
It is superimposed virtual information again afterwards, virtual information is applied to real world, the personage of real world, environment and virtual object is real
When be added to the same picture or space exists simultaneously, to reach the sensory experience of exceeding reality.
Invention content
The embodiment of the present invention provides a kind of technical solution of generation and the generation of sound special efficacy of sound special efficacy program file packet.
One side according to the ... of the embodiment of the present invention, a kind of generation method of the sound special efficacy program file packet provided, packet
It includes：
Import sound material；
The parameter value of the play parameter of the sound material is obtained, and establishes the display location of the sound material and makes a reservation for
An at least key point between correspondence；
Sound special efficacy program file packet is generated according to the sound material and the parameter value of the play parameter.
Optionally, in the above-mentioned each method embodiment of the present invention, the importing sound material, including：
The importing instruction inputted by the interactive interface of action bar is received, the material file for importing instruction and being directed toward is imported
Sound material in folder.
Optionally, in the above-mentioned each method embodiment of the present invention, the reception is inputted by the interactive interface of action bar
Instruction is imported, the sound material imported in the material file folder that instruction is directed toward is imported, including：
It receives the importing that the interactive interface by special effect parameters under the action bar being arranged in interface is sent to instruct, imports institute
State the sound material imported in the material file folder that instruction is directed toward.
Optionally, it in the above-mentioned each method embodiment of the present invention, receives and is instructed by the importing that interactive interface is sent, imported
The sound material imported in the material file folder that instruction is directed toward, including：
It receives and is instructed by the importing that the interactive interface is sent, obtained and show the material text for importing instruction and being directed toward
Part presss from both sides；
In response to receiving the selection operation to sound material in material file folder, imports the sound material and choose
Operate the sound material chosen；And/or
In response to not receiving the selection operation to sound material in material file folder, element is chosen according to pre-setting
One or more of material file sound material, and import according to the sound material for pre-setting selection.
Optionally, in the above-mentioned each method embodiment of the present invention, the ginseng of the play parameter for obtaining the sound material
Numerical value, including：
In response to receiving the plain for the sound of the interactive interface transmission being arranged by the special effect parameters in interface
The parameter value of the play parameter setting of material, using the parameter value of the setting as the parameter of the play parameter of the sound material
Value；And/or
In response to not receiving the sound is directed to by what the interactive interface in special effect parameters setting interface was sent
The parameter value of the play parameter setting of material, using preset parameter value as the parameter value of the play parameter of the sound material.
Optionally, in the above-mentioned each method embodiment of the present invention, the play parameter includes following any one or more：
Play control parameter：For controlling whether the sound material plays；
Triggering mode parameter：For indicating that triggering plays the trigger event of the sound material；
Loop parameter：Loop play number for indicating the sound material；
Postpone trigger parameter：For indicating that delay plays the time of the sound material；
Triggering terminates parameter：Trigger event for indicating to terminate to play the sound material；
Play frame number parameter：For indicating the sound material plays how many frame number；
U.S. face/makeups/efficacy parameter of changing face：The U.S. shown in predetermined patterns when for indicating the broadcasting sound material
Face/makeups/effect of changing face；
Deform special effect parameters：For indicating that the when of playing the sound material generates the deformation effect of deformed region on the image
Fruit；
Paster special effect parameters, for indicating that the when of playing the sound material generates the special efficacy of sub- material on the image.
Optionally, in the above-mentioned each method embodiment of the present invention, the trigger event includes following any one or more：
No event triggering, eye motion, headwork, supercilium action, hand motion, mouth action, shoulder action, body action become
Shape special efficacy, paster special efficacy, U.S. face/makeups/special efficacy of changing face.
Optionally, in the above-mentioned each method embodiment of the present invention, the sound special efficacy program file packet includes：With json journeys
The sound special efficacy program file packet that sequence generates.
Optionally, in the above-mentioned each method embodiment of the present invention, further include：
According to the enabled instruction received, operation display interface, the operation interface includes：Action bar, content display field
The program file column and/or.
Optionally, in the above-mentioned each method embodiment of the present invention, the operation interface includes left side, middle part and three, right side
Region；
The operation display interface, including：
The action bar is shown in the left side of the operation interface, shows that the content is aobvious at the middle part of the operation interface
Show column, described program body guoup is shown on the right side of the operation interface.
Optionally, it in the above-mentioned each method embodiment of the present invention, after the generation sound special efficacy program file packet, also wraps
It includes：
According to the preservation instruction received the sound special efficacy program file is preserved in the position for preserving instruction direction
Packet.
Optionally, in the above-mentioned each method embodiment of the present invention, the preservation that the basis receives is instructed in the preservation
The position that instruction is directed toward preserves the sound special efficacy program file packet, including：
Instruction is preserved in response to receiving, display storing path selection interface and compression interface；
It receives and the save location that interface is sent is selected by the storing path；And it receives and is sent out based on the compression interface
The compress mode sent, and the sound special efficacy program file packet is compressed according to the compress mode, generate compressed file
Packet；
The compressed file packet is stored in the file being directed toward to the save location.
Optionally, in the above-mentioned each method embodiment of the present invention, the sound special efficacy program file packet is compressed
In the process, to remain the size before being imported into constant for the size of sound material in the sound special efficacy program file packet.
Other side according to the ... of the embodiment of the present invention, a kind of sound special efficacy generation method provided, including：
Obtain the parameter value of the play parameter of sound material and the sound material in sound special efficacy program file packet；
The parameter value of play parameter based on the sound material, the sound for generating the sound material on the image are special
Effect.
Optionally, in the above-mentioned each sound special efficacy generation method embodiment of the present invention, the acquisition sound special efficacy program text
In part packet before the parameter value of the play parameter of sound material and the sound material, further include：
Import the sound special efficacy program file packet；
The parameter value for obtaining the play parameter of sound material and the sound material in sound special efficacy program file packet,
Including：Obtain the parameter of the play parameter of the sound material and the sound material in the sound special efficacy program file packet
Value.
Optionally, in the above-mentioned each sound special efficacy generation method embodiment of the present invention, the sound special efficacy program file packet
It is generated using the generation method of the sound special efficacy program file packet as described in any of the above-described embodiment of the application.
Optionally, in the above-mentioned each sound special efficacy generation method embodiment of the present invention, described image includes following any one
Item is multinomial：Still image, image in video.
Optionally, in the above-mentioned each sound special efficacy generation method embodiment of the present invention, the play parameter includes：Play control
Parameter processed, the broadcasting control parameter is for controlling whether the sound material plays；
The parameter value of the play parameter based on the sound material, generates the sound of the sound material on the image
Special efficacy, including：
When in response to the parameter value for playing control parameter for for controlling the parameter value for playing the sound material, base
In the parameter value of the play parameter of the sound material, the sound special efficacy of the sound material is generated on the image.
Optionally, in the above-mentioned each sound special efficacy generation method embodiment of the present invention, the play parameter includes：Triggering side
Formula parameter, the triggering mode parameter are used to indicate the trigger event that triggering plays the sound material；
The method further includes：The parameter value for whether occurring the triggering mode parameter in detection described image is corresponding tactile
Hair event；
The parameter value of the play parameter based on the sound material, generates the sound of the sound material on the image
Special efficacy, including：
Occur the corresponding trigger event of parameter value of the triggering mode parameter in described image in response to detecting, is based on
The parameter value of the play parameter of the sound material generates the sound special efficacy of the sound material on the image.
Optionally, in the above-mentioned each sound special efficacy generation method embodiment of the present invention, the play parameter includes：Delay is touched
Parameter is sent out, the delay trigger parameter is used to indicate the time that delay plays the sound material；
The parameter value of the play parameter based on the sound material, generates the sound of the sound material on the image
Special efficacy, including：
In response to meeting the playing condition of sound material, the parameter value of the play parameter based on the sound material, according to
The corresponding delay reproduction time of parameter value of the delay trigger parameter postpones to generate the sound material on image in video
Sound special efficacy；The playing condition for meeting sound material includes：The parameter value for playing control parameter is for controlling
The parameter value of the sound material is played, and/or, the parameter value for occurring the triggering mode parameter in described image is corresponding tactile
Hair event.
Optionally, in the above-mentioned each sound special efficacy generation method embodiment of the present invention, the play parameter includes：Cycle ginseng
Number, the loop parameter are used to indicate the loop play number of the sound material；
The parameter value of the play parameter based on the sound material, generates the sound of the sound material on the image
Special efficacy, including：
In response to meeting the playing condition of sound material, the parameter value of the play parameter based on the sound material, according to
The corresponding cycle-index of parameter value of the loop parameter, sound material described in loop play on image in video, to generate
The sound special efficacy of the sound material；The playing condition for meeting sound material includes：The parameter for playing control parameter
Value for for controlling the parameter value for playing the sound material, and/or, occur the ginseng of the triggering mode parameter in described image
The corresponding trigger event of numerical value.
Optionally, in the above-mentioned each sound special efficacy generation method embodiment of the present invention, the play parameter includes：Play frame
Number parameter, the broadcasting frame number parameter is for indicating the sound material plays how many frame number；
The parameter value of the play parameter based on the sound material, generates the sound of the sound material on the image
Special efficacy, including：
In response to meeting the playing condition of sound material, the parameter value of the play parameter based on the sound material, according to
The corresponding broadcasting frame number of parameter value for playing frame number parameter, generates institute on the corresponding image of the broadcasting frame number in video
State the sound special efficacy of sound material；The playing condition for meeting sound material includes：The parameter value for playing control parameter
For for controlling the parameter value for playing the sound material, and/or, occur the parameter of the triggering mode parameter in described image
It is worth corresponding trigger event.
Optionally, in the above-mentioned each sound special efficacy generation method embodiment of the present invention, the play parameter includes：Triggering knot
Beam parameter, the triggering terminate the trigger event that parameter is used to indicate to terminate to play the sound material；
The method further includes：
Whether parameter value corresponding trigger event that the triggering terminate parameter is occurred in detection described image；
In response to detecting the corresponding trigger event of parameter value for occurring the triggering in described image and terminating parameter, stop
The sound special efficacy of the sound material is generated on the image.
Optionally, in the above-mentioned each sound special efficacy generation method embodiment of the present invention, the play parameter includes：U.S. face/
Makeups/efficacy parameter of changing face, default when described U.S.'s face/makeups/efficacy parameter of changing face is for indicating to play the sound material
U.S. face/makeups/effect of changing face that position is shown；
The method further includes：
The parameter value of play parameter based on the sound material generates the sound special efficacy of the sound material on the image
When, according to described U.S. face/makeups/efficacy parameter of changing face, the U.S. face/makeups/of predetermined patterns display in described image is changed
Face effect.
Optionally, in the above-mentioned each sound special efficacy generation method embodiment of the present invention, the play parameter includes：Deformation is special
Imitate parameter, the deformation effect that the deformation special effect parameters are used to indicate to generate deformed region when playing the sound material on the image
Fruit；
The method further includes：
The parameter value of play parameter based on the sound material generates the sound special efficacy of the sound material on the image
When, according to the deformation special effect parameters, the deformation effect of the deformed region is generated in described image.
Optionally, in the above-mentioned each sound special efficacy generation method embodiment of the present invention, the play parameter includes：Paster is special
Imitate parameter, the special efficacy that the paster special effect parameters are used to indicate to generate sub- material when playing the sound material on the image；
The method further includes：
The parameter value of play parameter based on the sound material generates the sound special efficacy of the sound material on the image
When, according to the paster special effect parameters, the special efficacy of the sub- material is generated in described image.
Optionally, in the above-mentioned each sound special efficacy generation method embodiment of the present invention, the importing sound special efficacy program text
Part packet, including：
By calling the interface function for reading file packet, the sound special efficacy program file packet is read in into memory；
The sound special efficacy program file packet is parsed, the sound material and sound special efficacy program file, the sound are obtained
Sound special efficacy program file includes the parameter value of the play parameter of the sound material.
Optionally, described to obtain the special efficacy program text in the above-mentioned each sound special efficacy generation method embodiment of the present invention
The parameter value of the play parameter of sound material described in part packet, including：
Paster handle is created by the interface function for creating paster handle；
It reads the parameter value of the sound material and the play parameter and stores into the paster handle.
Optionally, in the above-mentioned each sound special efficacy generation method embodiment of the present invention, the broadcasting based on the sound material
The parameter value of parameter generates the sound special efficacy of the sound material on the image, including：
By calling the interface function for rendering sound material, the play parameter is read from the paster handle
The sound material that parameter value and needs play；
The parameter value of play parameter based on the sound material, the sound for generating the sound material on the image are special
Effect.
Optionally, in the above-mentioned each sound special efficacy generation method embodiment of the present invention, when described image is image in video,
The parameter value of play parameter based on the sound material generates the sound special efficacy of the sound material, further includes on the image：
According to the parameter value of the play parameter, the video frame for the sound special efficacy for needing to generate the sound material is obtained
Number, and the corresponding image of the video frame number is read from the video in advance.
Optionally, in the above-mentioned each sound special efficacy generation method embodiment of the present invention, further include：
It is finished in response to the sound special efficacy program file packet, by for calling the interface letter for destroying paster handle
Number destroys the paster handle.
Optionally, described to generate the sound on the image in the above-mentioned each sound special efficacy generation method embodiment of the present invention
The sound special efficacy of phoneme material, including：
Built-in player by electronic equipment where calling or external player generate the sound element on the image
The sound special efficacy of material.
Another aspect according to the ... of the embodiment of the present invention, a kind of generating means of the sound special efficacy program file packet provided,
Including：
First import modul, for importing sound material；
First acquisition module, the parameter value of the play parameter for obtaining the sound material；
First generation module, for generating sound special efficacy journey according to the sound material and the parameter value of the play parameter
Preface part packet.
Optionally, in the above-mentioned each device embodiment of the present invention, first import modul passes through behaviour specifically for receiving
The importing instruction for making the interactive interface input on column imports the sound material imported in the material file folder that instruction is directed toward.
Optionally, in the above-mentioned each device embodiment of the present invention, first import modul passes through institute specifically for receiving
The importing instruction that the interactive interface under action bar in special effect parameters setting interface is sent is stated, the element for importing instruction and being directed toward is imported
Sound material in material file.
Optionally, in the above-mentioned each device embodiment of the present invention, first import modul is specifically used for：
It receives and is instructed by the importing that the interactive interface is sent, obtained and show the material text for importing instruction and being directed toward
Part presss from both sides；
In response to receiving the selection operation to sound material in material file folder, imports the sound material and choose
Operate the sound material chosen；And/or
In response to not receiving the selection operation to sound material in material file folder, element is chosen according to pre-setting
One or more of material file sound material, and import according to the sound material for pre-setting selection.
Optionally, in the above-mentioned each device embodiment of the present invention, first acquisition module is specifically used for：
In response to receiving the plain for the sound of the interactive interface transmission being arranged by the special effect parameters in interface
The parameter value of the play parameter setting of material, using the parameter value of the setting as the parameter of the play parameter of the sound material
Value；And/or
In response to not receiving the sound is directed to by what the interactive interface in special effect parameters setting interface was sent
The parameter value of the play parameter setting of material, using preset parameter value as the parameter value of the play parameter of the sound material.
Optionally, in the above-mentioned each device embodiment of the present invention, the play parameter includes following any one or more：
Play control parameter：For controlling whether the sound material plays；
Triggering mode parameter：For indicating that triggering plays the trigger event of the sound material；
Loop parameter：Loop play number for indicating the sound material；
Postpone trigger parameter：For indicating that delay plays the time of the sound material；
Triggering terminates parameter：Trigger event for indicating to terminate to play the sound material；
Play frame number parameter：For indicating the sound material plays how many frame number；
U.S. face/makeups/efficacy parameter of changing face：The U.S. shown in predetermined patterns when for indicating the broadcasting sound material
Face/makeups/effect of changing face；
Deform special effect parameters：For indicating that the when of playing the sound material generates the deformation effect of deformed region on the image
Fruit；
Paster special effect parameters, for indicating that the when of playing the sound material generates the special efficacy of sub- material on the image.
Optionally, in the above-mentioned each device embodiment of the present invention, the trigger event includes following any one or more：
No event triggering, eye motion, headwork, supercilium action, hand motion, mouth action, shoulder action, body action become
Shape special efficacy, paster special efficacy, U.S. face/makeups/special efficacy of changing face.
Optionally, in the above-mentioned each device embodiment of the present invention, the sound special efficacy program file packet includes：With json journeys
The sound special efficacy program file packet that sequence generates.
Optionally, in the above-mentioned each device embodiment of the present invention, further include：
Operation interface, the operation interface include：Action bar, content display field and/or program file column.
Optionally, in the above-mentioned each device embodiment of the present invention, the operation interface includes left side, middle part and three, right side
Region；
The action bar is shown in the left side of the operation interface, shows that the content is aobvious at the middle part of the operation interface
Show column, described program body guoup is shown on the right side of the operation interface.
Optionally, in the above-mentioned each device embodiment of the present invention, further include：
Preserving module, for instructing the position being directed toward to preserve the sound in described preserve according to the preservation instruction received
Special efficacy program file packet.
Optionally, in the above-mentioned each device embodiment of the present invention, the preserving module is specifically used for：
Instruction is preserved in response to receiving, display storing path selection interface and compression interface；
It receives and the save location that interface is sent is selected by the storing path；And it receives and is sent out based on the compression interface
The compress mode sent, and the sound special efficacy program file packet is compressed according to the compress mode, generate compressed file
Packet；
The compressed file packet is stored in the file being directed toward to the save location.
Optionally, in the above-mentioned each device embodiment of the present invention, the sound special efficacy program file packet is compressed
In the process, to remain the size before being imported into constant for the size of sound material in the sound special efficacy program file packet.
Another aspect according to the ... of the embodiment of the present invention, a kind of sound special efficacy generating means provided, including：
Second acquisition module, the broadcasting for obtaining sound material and the sound material in sound special efficacy program file packet
The parameter value of parameter；
Second generation module is used for the parameter value of the play parameter based on the sound material, on the image described in generation
The sound special efficacy of sound material.
Optionally, in the above-mentioned each sound special efficacy generating means embodiment of the present invention, further include：
Second import modul, for importing the sound special efficacy program file packet；
Second acquisition module, be specifically used for obtaining the sound material in the sound special efficacy program file packet and
The parameter value of the play parameter of the sound material.
Optionally, in the above-mentioned each sound special efficacy generating means embodiment of the present invention, the sound special efficacy program file packet
It is generated using the generation method or device of the sound special efficacy program file packet described in any of the above-described embodiment of the present invention.
Optionally, in the above-mentioned each sound special efficacy generating means embodiment of the present invention, described image includes following any one
Item is multinomial：Still image, image in video.
Optionally, in the above-mentioned each sound special efficacy generating means embodiment of the present invention, the play parameter includes：Play control
Parameter processed, the broadcasting control parameter is for controlling whether the sound material plays；
Second generation module is specifically used in response to the parameter value for playing control parameter being to play for controlling
When the parameter value of the sound material, the parameter value of the play parameter based on the sound material generates the sound on the image
The sound special efficacy of phoneme material.
Optionally, in the above-mentioned each sound special efficacy generating means embodiment of the present invention, the play parameter includes：Triggering side
Formula parameter, the triggering mode parameter are used to indicate the trigger event that triggering plays the sound material；
Described device further includes：Whether first detection module there is the triggering mode ginseng for detecting in described image
The corresponding trigger event of several parameter values；
Second generation module, specifically for detecting in described image institute occur in response to the first detection module
The corresponding trigger event of parameter value of triggering mode parameter is stated, the parameter value of the play parameter based on the sound material is being schemed
As the upper sound special efficacy for generating the sound material.
Optionally, in the above-mentioned each sound special efficacy generating means embodiment of the present invention, the play parameter includes：Delay is touched
Parameter is sent out, the delay trigger parameter is used to indicate the time that delay plays the sound material；
Second generation module, specifically for the playing condition in response to meeting sound material, based on sound element
The parameter value of the play parameter of material, according to it is described delay trigger parameter the corresponding delay reproduction time of parameter value, delay regarding
The sound special efficacy of the sound material is generated in frequency on image；The playing condition for meeting sound material includes：The broadcasting
The parameter value of control parameter be for control the parameter value for playing the sound material, and/or, occur in described image described tactile
The corresponding trigger event of parameter value of originating party formula parameter.
Optionally, in the above-mentioned each sound special efficacy generating means embodiment of the present invention, the play parameter includes：Cycle ginseng
Number, the loop parameter are used to indicate the loop play number of the sound material；
Second generation module, specifically for the playing condition in response to meeting sound material, based on sound element
The parameter value of the play parameter of material follows on image in video according to the corresponding cycle-index of the parameter value of the loop parameter
Ring plays the sound material, to generate the sound special efficacy of the sound material；The playing condition packet for meeting sound material
It includes：The parameter value for playing control parameter be for controlling the parameter value for playing the sound material, and/or, described image
The middle corresponding trigger event of parameter value for the triggering mode parameter occur.
Optionally, in the above-mentioned each sound special efficacy generating means embodiment of the present invention, the play parameter includes：Play frame
Number parameter, the broadcasting frame number parameter is for indicating the sound material plays how many frame number；
Second generation module, specifically for the playing condition in response to meeting sound material, based on sound element
The parameter value of the play parameter of material, it is described in video according to the corresponding broadcasting frame number of parameter value for playing frame number parameter
Play the sound special efficacy that the sound material is generated on the corresponding image of frame number；The playing condition packet for meeting sound material
It includes：The parameter value for playing control parameter be for controlling the parameter value for playing the sound material, and/or, described image
The middle corresponding trigger event of parameter value for the triggering mode parameter occur.
Optionally, in the above-mentioned each sound special efficacy generating means embodiment of the present invention, the play parameter includes：Triggering knot
Beam parameter, the triggering terminate the trigger event that parameter is used to indicate to terminate to play the sound material；
Described device further includes：Whether the second detection module there is the triggering end ginseng for detecting in described image
The corresponding trigger event of several parameter values；
Second generation module is additionally operable to detect in described image described in appearance in response to second detection module
Triggering terminates the corresponding trigger event of parameter value of parameter, and the sound for stopping generating the sound material on the image is special
Effect.
Optionally, in the above-mentioned each sound special efficacy generating means embodiment of the present invention, the play parameter includes：U.S. face/
Makeups/efficacy parameter of changing face, default when described U.S.'s face/makeups/efficacy parameter of changing face is for indicating to play the sound material
U.S. face/makeups/effect of changing face that position is shown；
Second generation module generates institute on the image in the parameter value of the play parameter based on the sound material
When stating the sound special efficacy of sound material, it is additionally operable to according to described U.S. face/makeups/efficacy parameter of changing face, the institute in described image
State U.S. face/makeups/effect of changing face of predetermined patterns display.
Optionally, in the above-mentioned each sound special efficacy generating means embodiment of the present invention, the play parameter includes：Deformation is special
Imitate parameter, the deformation effect that the deformation special effect parameters are used to indicate to generate deformed region when playing the sound material on the image
Fruit；
Second generation module generates institute on the image in the parameter value of the play parameter based on the sound material
When stating the sound special efficacy of sound material, it is additionally operable to, according to the deformation special effect parameters, the deformed area be generated in described image
The deformation effect in domain.
Optionally, in the above-mentioned each sound special efficacy generating means embodiment of the present invention, the play parameter includes：Paster is special
Imitate parameter, the special efficacy that the paster special effect parameters are used to indicate to generate sub- material when playing the sound material on the image；
Second generation module generates institute on the image in the parameter value of the play parameter based on the sound material
When stating the sound special efficacy of sound material, it is additionally operable to, according to the paster special effect parameters, the sub- material be generated in described image
Special efficacy.
Optionally, in the above-mentioned each sound special efficacy generating means embodiment of the present invention, second import modul is specific to use
In：By calling the interface function for reading file packet, the sound special efficacy program file packet is read in into memory；And parsing
The sound special efficacy program file packet obtains the sound material and sound special efficacy program file, the sound special efficacy program text
Part includes the parameter value of the play parameter of the sound material.
Optionally, in the above-mentioned each sound special efficacy generating means embodiment of the present invention, second acquisition module obtains institute
When stating the parameter value of the play parameter of sound material described in special efficacy program file packet, it is specifically used for：By being used to create paster
The interface function of handle creates paster handle；And it reads the parameter value of the sound material and the play parameter and stores
To in the paster handle.
Optionally, in the above-mentioned each sound special efficacy generating means embodiment of the present invention, the second generation module is specifically used for：
By calling interface function for rendering sound material, read from the paster handle play parameter parameter value and
Need the sound material played；And the parameter value of the play parameter based on the sound material, the sound is generated on the image
The sound special efficacy of phoneme material.
Optionally, in the above-mentioned each sound special efficacy generating means embodiment of the present invention, when described image is image in video,
Second generation module is specifically used for the parameter value according to the play parameter, obtains the sound for needing to generate the sound material
The video frame number of special efficacy, and the corresponding image of the video frame number is read from the video in advance.
Optionally, in the above-mentioned each sound special efficacy generating means embodiment of the present invention, second acquisition module is additionally operable to
It is finished in response to the sound special efficacy program file packet, by for calling the interface function for destroying paster handle to destroy institute
State paster handle.
Optionally, in the above-mentioned each sound special efficacy generating means embodiment of the present invention, second generation module is specific to use
In by the built-in player for calling place electronic equipment or external player, the sound of the sound material is generated on the image
Sound special efficacy.
Another aspect according to the ... of the embodiment of the present invention, a kind of electronic equipment provided, including：
Memory, for storing computer program；
Processor, for executing the computer program stored in the memory, and the computer program is performed,
Realize the method described in any of the above-described embodiment of the present invention.
A kind of another aspect according to the ... of the embodiment of the present invention, the computer readable storage medium provided, is stored thereon with
Computer program when the computer program is executed by processor, realizes the method described in any of the above-described embodiment of the present invention.
Another aspect according to the ... of the embodiment of the present invention, a kind of computer program provided, including computer instruction, work as institute
When stating computer instruction and being run in the processor of equipment, the method described in any of the above-described embodiment of the present invention is realized.
The generation method of sound special efficacy program file packet based on the above embodiment of the present invention offer is set with device, electronics
Standby, program and medium when generating sound special efficacy program file packet, import sound material, obtain the play parameter of the sound material
Parameter value, sound special efficacy program file packet is generated according to sound material and its parameter value of play parameter, to be based on the sound
Sound special efficacy program file packet carries out sound special effect processing to image, realizes that sound special efficacy, the embodiment of the present invention are not necessarily on the image
By manual writing program file, the executable sound special efficacy program file of rendering engine can be generated, it is easy to operate, taken
Between it is short, improve the whole efficiency of sound special efficacy realization, and avoid the mistake that manual writing program file is likely to occur, effectively
The accuracy of sound special effect is ensured.
The sound special efficacy generation method and device, electronic equipment, program and medium provided based on the above embodiment of the present invention,
Sound material and its parameter value of play parameter in sound special efficacy program file packet are obtained, the play parameter based on sound material
Parameter value generates the sound special efficacy of sound material on the image.The embodiment of the present invention passes through the sound special efficacy program that is generated in advance
Sound material and its parameter value of play parameter generate sound special efficacy on the image in file packet, realize the sound to image
Special effect play, enhance it is recreational, improve image broadcasting feeling of immersion, improve image result of broadcast.
Below by drawings and examples, technical scheme of the present invention will be described in further detail.
Description of the drawings
The attached drawing of a part for constitution instruction describes the embodiment of the present invention, and together with description for explaining
The principle of the present invention.
The present invention can be more clearly understood according to following detailed description with reference to attached drawing, wherein：
Fig. 1 is the flow chart of generation method one embodiment of sound special efficacy program file packet of the present invention.
Fig. 2 is an operation interface exemplary plot of the generating means of sound special efficacy program file packet in the embodiment of the present invention.
Fig. 3 is an illustrative diagram of hand motion in the embodiment of the present invention.
Fig. 4 is the flow chart of another embodiment of generation method of sound special efficacy program file packet of the present invention.
Fig. 5 is the flow chart of sound special efficacy generation method one embodiment of the present invention.
Fig. 6 is the flow chart of another embodiment of sound special efficacy generation method of the present invention.
Fig. 7 is the flow chart of another embodiment of sound special efficacy generation method of the present invention.
Fig. 8 is the structural schematic diagram of generating means one embodiment of sound special efficacy program file packet of the present invention.
Fig. 9 is the structural schematic diagram of another embodiment of the generating means of sound special efficacy program file packet of the present invention.
Figure 10 is the structural schematic diagram of sound special efficacy generating means one embodiment of the present invention.
Figure 11 is the structural schematic diagram of another embodiment of sound special efficacy generating means of the present invention.
Figure 12 is the structural schematic diagram of one Application Example of electronic equipment of the present invention.
Specific implementation mode
Carry out the various exemplary embodiments of detailed description of the present invention now with reference to attached drawing.It should be noted that：Unless in addition having
Body illustrates that the unlimited system of component and the positioned opposite of step, numerical expression and the numerical value otherwise illustrated in these embodiments is originally
The range of invention.
Simultaneously, it should be appreciated that for ease of description, the size of attached various pieces shown in the drawings is not according to reality
Proportionate relationship draw.
It is illustrative to the description only actually of at least one exemplary embodiment below, is never used as to the present invention
And its application or any restrictions that use.
Technology, method and apparatus known to person of ordinary skill in the relevant may be not discussed in detail, but suitable
In the case of, the technology, method and apparatus should be considered as part of specification.
It should be noted that：Similar label and letter indicate similar terms in following attached drawing, therefore, once a certain Xiang Yi
It is defined, then it need not be further discussed in subsequent attached drawing in a attached drawing.
The embodiment of the present invention can be applied to the electronic equipments such as terminal device, computer system, server, can with it is numerous
Other general or specialized computing system environments or configuration operate together.Suitable for electric with terminal device, computer system, server etc.
The example for well-known terminal device, computing system, environment and/or the configuration that sub- equipment is used together includes but not limited to：
Personal computer system, thin client, thick client computer, hand-held or laptop devices, is based on microprocessor at server computer system
System, set-top box, programmable consumer electronics, NetPC Network PC, little types Ji calculate machine Xi Tong ﹑ large computer systems and
Distributed cloud computing technology environment including any of the above described system, etc..
The electronic equipments such as terminal device, computer system, server can be in the department of computer science executed by computer system
It is described under the general context of system executable instruction (such as program module).In general, program module may include routine, program, mesh
Beacon course sequence, component, logic, data structure etc., they execute specific task or realize specific abstract data type.Meter
Calculation machine systems/servers can be implemented in distributed cloud computing environment, and in distributed cloud computing environment, task is by by logical
What the remote processing devices of communication network link executed.In distributed cloud computing environment, it includes storage that program module, which can be located at,
On the Local or Remote computing system storage medium of equipment.
Fig. 1 is the flow chart of generation method one embodiment of sound special efficacy program file packet of the present invention.Each reality of the present invention
Apply a generation method for sound special efficacy program file packet, such as can (embodiment of the present invention claims through but not limited to a device
For the generating means of sound special efficacy program file packet) it realizes.As shown in Figure 1, the life of the embodiment sound special efficacy program file packet
Include at method：
102, import sound material.
The sound material in various embodiments of the present invention can be the audio file of various audio formats, such as can be
The audio file of the formats such as MP3, ARM, WAVE, APE, WMA, MPEG.
104, obtain the parameter value of the play parameter of the above sound material.
106, sound special efficacy program file packet is generated according to the above sound material and its parameter value of play parameter.
In the embodiment of the present invention, sound special efficacy program file packet can be used for increasing audio function to video or image, regarding
Sound special efficacy is generated in frequency or on image, for example, increasing background music when playing image or video, it is dynamic to occur certain in video
As when play effect sounds, increase and play atmosphere, promote feeling of immersion.
Generation method based on the sound special efficacy program file packet that the above embodiment of the present invention provides, generates sound special efficacy journey
When preface part packet, sound material is imported, the parameter value of the play parameter of the sound material is obtained, according to sound material and its broadcasting
The parameter value of parameter generates sound special efficacy program file packet, and sound is carried out to image to be based on the sound special efficacy program file packet
Special effect processing realizes that sound special efficacy, the embodiment of the present invention are not necessarily to that, by manual writing program file, wash with watercolours can be generated on the image
Contaminate the executable sound special efficacy program file of engine, it is easy to operate, required time is short, improve the whole effect of sound special efficacy realization
Rate, and avoid the mistake that manual writing program file is likely to occur, the effective guarantee accuracy of sound special effect.
In an embodiment of various embodiments of the present invention, it can be wrapped in the generating means of sound special efficacy program file packet
Pre-set sound special efficacy program file is included, such as can be the data exchange of the lightweight based on JavaScript language
Format (JavaScript Object Notiation, json) file or any other executable program file, generation
Sound special efficacy program file packet can be accordingly, with the sound special efficacy program file packet of json Program Generatings.The sound special efficacy journey
The parameter value of play parameter with vacancy or can be predetermined to be default value in preface part, receive the broadcasting ginseng for sound material
When the parameter value of number setting, the corresponding parametric values in the sound special efficacy program file are automatically updated into the parameter value received.
Optionally, the generating means of the above sound special efficacy program file packet may include action bar, and at least one is provided in the action bar
A interactive interface, for importing sound material and for the play parameter arrange parameter value of sound material；In addition, the sound special efficacy
The generating means of program file packet can also include program file display field, can be with for showing sound special efficacy program file
Play parameter including sound material and its parameter value.As shown in Fig. 2, for sound special efficacy program file packet in the embodiment of the present invention
Generating means an operation interface exemplary plot, the operation interfaces of the generating means of the sound special efficacy program file packet includes behaviour
It blocks and program file display field.After the generating means of the sound special efficacy program file packet start, correspond in action bar one
Interface is arranged in the play parameter of sound material, and program file display field shows the play parameter vacancy or pre- of the sound material
It is set as sound special efficacy program file when default value, broadcasting for sound material is received by the interactive interface of action bar
When putting the parameter value of parameter setting, the parameter value that the play parameter of the sound material is arranged is updated to the parameter being most recently received
Value, the updated sound special efficacy program file of program file display field real-time display parameter value.It should be noted that Fig. 2 intermediate ranges
The program file that preface part display field is shown is only used for the operation interface showed to the generating means of sound special efficacy program file packet
It illustrates, the form of expression and particular content of the present invention without concern wherein program file do not limit the journey yet
The form of expression and particular content of preface part.
In an embodiment of the generation method embodiment of each special efficacy program file packet of the present invention, operation 102 can be with
Including：The importing instruction sent by the interactive interface of action bar is received, is imported in the material file folder that importing instruction is directed toward
Sound material.
As shown in Fig. 2, it is unrestricted as an optional example of various embodiments of the present invention, may include in action bar：
Interface is arranged in the play parameter of at least one sound material, and the play parameter setting interface of each sound material includes：For leading
Enter the interactive interface 20 of sound material and at least one interactive interface 21 for the parameter value of play parameter to be arranged.For example,
In Fig. 2, lalala indicates sound special effective function, and lalala.mp3 is the sound material imported by interactive interface 20.
In one optional example of the above embodiment of the present invention, the importing instruction inputted by the interactive interface of action bar is received, is led
Enter the sound material in the material file folder that importing instruction is directed toward, may include：Reception is set by play parameter under action bar
The importing instruction that the interactive interface 20 in interface is sent is set, the sound element in the material file folder that importing instruction is directed toward is imported
Material.
Furthermore it is possible to increase sound material and its play parameter setting interface by the interactive interface of action bar, for example, can
Instruction is added with the sound material that the interactive interface received through action bar inputs, adds a sound material and its play parameter
Interface is set.For example, can by " addition " in the control buttons such as sound material " music " in right click operation column or
Interface is arranged in " duplication " option of operation, addition or one sound material of duplication and its play parameter.
In another optional example of the above embodiment of the present invention, the interactive interface input for passing through action bar is received
Instruction is imported, the sound material in the material file folder that importing instruction is directed toward is imported, may include：
The importing instruction sent by interactive interface 20 is received, obtains and show the material file that importing instruction is directed toward
Folder；
In response to receiving the sound material selection operation in being pressed from both sides to material file, sound material selection operation choosing is imported
The sound material taken；And/or in response to not receiving the sound material selection operation in being pressed from both sides to material file, according to setting in advance
It sets and chooses one or more of material file folder sound material, and import according to the sound material for pre-setting selection.
May include multiple sound materials in each material file folder, in an embodiment of various embodiments of the present invention
In, it, can be according to advance if not receiving the sound material selection operation during user presss from both sides material file when importing sound material
Setting imports predeterminated position or the sound material of default serial number in the material file folder that importing instruction is directed toward.For example, in user
When not choosing sound material, acquiescence is chosen and imports first sound material or the last one sound in material file folder
Material or a randomly selected sound material.
In an embodiment of various embodiments of the present invention, in operation 104, the ginseng of the play parameter of sound material is obtained
Numerical value may include：
The broadcasting for sound material sent in response to receiving the interactive interface being arranged in interface by play parameter
The parameter value of parameter setting, using the parameter value of the setting as the parameter value of the play parameter of sound material；And/or
The broadcasting for sound material sent in response to not receiving the interactive interface being arranged in interface by play parameter
The parameter value for putting parameter setting, using preset parameter value as the parameter value of the play parameter of sound material.
The embodiment of the present invention is not necessarily to by manual writing program file generated rendering engine executable file, based on user's
The setting of parameter value in action bar to the selection operation of sound material and to play parameter operates, and can realize sound spy
The generation of program bag is imitated, it is easy to operate, required time is short, the whole efficiency of sound special efficacy realization is improved, and avoid manually
The mistake that writing program file is likely to occur, the effective guarantee accuracy of special effect.
In an embodiment of various embodiments of the present invention, the play parameter of sound material for example may include but unlimited
In following any one or more：
1, play control parameter (Display)：For controlling whether sound material plays.Its parameter value is including " being
(Yes) " it and " no (No) " two options, indicates to need to play corresponding sound material, parameter when parameter value selection " being (Yes) "
It indicates that corresponding sound material need not be played when value selection " no (No) "；
2, triggering mode parameter (TriggerType)：Refer to leading to for indicating that triggering plays the trigger event of sound material
It crosses the triggering of what trigger event and plays corresponding sound material, parameter value may include each trigger event, and user can be from pre-
If selecting at least one event as trigger event in event sets.I.e.：In video display process, tactile event accordingly is detected
When can trigger and play corresponding sound material, occur triggering thing specified in the triggering mode parameter for example, detecting in video
Start to play one section of advertising words, background music etc. as sound material when part " opening one's mouth ", the specific sound material starts to show
Show the time, terminate to show the time, display how long etc., can specifically be determined according to the parameter value of other play parameter, such as can be with
Parameter is terminated according to delay trigger parameter, triggering respectively, the parameter value of loop parameter determines；
3, loop parameter (TriggerLoop)：Loop play number for indicating sound material, can be arranged or select
The concrete numerical value of loop play number is as its parameter value, for example, 1,5 etc., can arrange parameter value to be set as 0 to be Infinite Cyclic
It plays；
4, delay trigger parameter (TriggerDelay)：For indicating that delay plays the time of sound material, i.e.,：From video
In a certain frame image detection to trigger event in triggering mode parameter when, postpone how many frame images and start to play sound element
Material can be arranged or select the specific time for postponing to play sound material or frame number as its parameter value；
5, triggering terminates parameter (TriggerStop)：Trigger event for indicating to terminate to play sound material, refers to leading to
The broadcasting what terminates sound material is crossed, parameter value includes each trigger event, and user can be from predeterminable event set
Select at least one event as the trigger event for terminating broadcasting sound material.I.e.：In video display process, the triggering is detected
Terminate to terminate to play corresponding sound material when trigger event as defined in parameter, such as is triggered for detecting in video
Start to play one section of background music when trigger event " opening one's mouth " specified in mode parameter, triggering can be set and terminated in parameter
Parameter value is " shutting up ", then detects in video that stopping plays the background music when there is the trigger event " shutting up " action；
6, play frame number parameter (DisplayFrames)：For indicating sound material plays how many frame number.It can be by user
Frame number is selected, when the frame number selected is arranged to the property of can be exemplified be 0, indicates to play stiff material always；
7, U.S. face/makeups/is changed face (U.S. face and/or makeups and/or change face) efficacy parameter：For indicating to play sound material
When U.S. face/makeups/effect of changing face for being shown in predetermined patterns, such as red lip, U.S. pupil, blue eyes etc.；
8, deform special effect parameters：For indicating that the when of playing sound material generates the deformation effect of deformed region on the image,
The shape of deformed region therein is unrestricted, for example, can be circle, ellipse, rectangle, square, triangle or
Other arbitrary shapes etc.；
9, paster special effect parameters, for indicating that the when of playing sound material generates the special efficacy of sub- material on the image, for example,
Position plays cap this sub- material overhead when playing sound material.
In a wherein optional example, the corresponding trigger event of above-mentioned triggering mode parameter is for example including following any one
Item is multinomial：
Attonity triggers (NULL), i.e.,：The sound material can be shown by being not required to any action；
Eye motion, for example, blink, eye closing, eye opening etc.；
Headwork, for example, shake the head, nod, torticollis, rotary head etc.；
Supercilium acts, for example, choosing eyebrow etc.；
Hand motion, for example, love hand, support hand, palm, big thumb brother, embrace fist congratulate, it is singlehanded than the heart, OK hands, scissors hand,
Pistol hand, index finger etc..As shown in figure 3, for an illustrative diagram of hand motion in the embodiment of the present invention；
Mouth action, for example, opening one's mouth, shutting up；
Shoulder acts, for example, shrugging；
Other actions.
In addition, referring back to Fig. 2, the generating means of the sound special efficacy program file packet of the embodiment of the present invention can also include interior
Hold display field, the content display field is for showing that reference picture (such as averagely face, hand, limbs etc.), U.S. face/makeups/change
Face effect, deformation special efficacy, paster special efficacy etc..In the further embodiment of the generation method of special efficacy program file packet of the present invention,
Further include：
The generating means of sound special efficacy program file packet start according to the enabled instruction received, and operation display interface,
The operation interface includes：Action bar, content display field and program file column.
As shown in Fig. 2, in a wherein optional example, aforesaid operations interface includes left side, middle part and three, right side area
Domain.Correspondingly, above-mentioned operation display interface may include：On the left side display operation column of operation interface, in operation interface
Portion shows content display field, and described program body guoup is shown on the right side of operation interface.
Wherein, the program file display field on right side is used to show current setting parameter value by display area 22 therein
The content of the sound special efficacy program file of sound material, can be exported by the preservation instruction interface 23 in program file display field
Sound special efficacy program file packet, i.e.,：It generates and preserves the sound special efficacy program file packet.
Fig. 4 is the flow chart of another embodiment of generation method of special efficacy program file packet of the present invention.As shown in figure 4, and Fig. 1
Illustrated embodiment is compared, the generation method of the sound special efficacy program file packet of the embodiment, is generating sound special efficacy program file
After packet, further include：
302, it is instructed according to the preservation received, the sound special efficacy program file is preserved in the position that preservation instruction is directed toward
Packet.
It in a wherein embodiment, is instructed according to the preservation received, is preserved in the position that preservation instruction is directed toward
The sound special efficacy program file packet may include：
Instruction is preserved in response to receiving, display storing path selection interface and compression interface；
It receives and the save location that interface is sent is selected by above-mentioned storing path；And it receives above-mentioned based on compression interface hair
The compress mode sent, and sound special efficacy program file packet is compressed according to the compress mode, generate compressed file packet；
Above-mentioned compressed file packet is stored in the file being directed toward to above-mentioned save location.
When the size of special efficacy program file packet is larger, be not suitable for running in mobile phone terminal, the embodiment of the present invention can be with
It is preserved after being compressed to sound special efficacy program file packet, sound special efficacy generation is carried out in mobile phone terminal in order to import.This hair
Bright embodiment only compresses the size of sound special efficacy program file packet, does not change sound in sound special efficacy program file packet
The size of material, i.e.,：The size of sound material remains before the sound material is imported into sound special efficacy program file packet
Size is constant.
After generating special efficacy program file packet based on the various embodiments described above of the present invention, which can be led
Enter in terminal, special efficacy generation is carried out to the video of the terminal plays.
Fig. 5 is the flow chart of sound special efficacy generation method one embodiment of the present invention.As shown in figure 5, the sound of the embodiment
Sound special efficacy generation method includes：
402, obtain the parameter value of the play parameter of sound material and sound material in sound special efficacy program file packet.
404, the parameter value of the play parameter based on the above sound material generates the sound spy of sound material on the image
Effect.
Illustratively, the image in various embodiments of the present invention can be still image, can also be the image in video.
In some embodiments of various embodiments of the present invention, which may include：It is set by electronics where calling
Standby built-in player or external player generate the sound special efficacy of sound material on the image.
Based on the sound special efficacy generation method that the above embodiment of the present invention provides, sound in sound special efficacy program file packet is obtained
The parameter value of phoneme material and its play parameter, the parameter value of the play parameter based on sound material generate sound element on the image
The sound special efficacy of material.The embodiment of the present invention is joined by sound material in the sound special efficacy program file packet that is generated in advance and its play
Several parameter values generates sound special efficacy on the image, realizes the sound special effect play to image, enhances recreational, raising
The feeling of immersion that image plays, improves image result of broadcast.
Fig. 6 is the flow chart of another embodiment of sound special efficacy generation method of the present invention.As shown in fig. 6, the embodiment
Sound special efficacy generation method includes：
502, import sound special efficacy program file packet.
In a wherein embodiment, which may include：By calling the interface letter for reading file packet
Sound special efficacy program file packet is read in memory by number；The sound special efficacy program file packet is parsed, sound material is obtained and sound is special
Program file is imitated, which includes the parameter value of the play parameter of sound material.
In a wherein optional example, above-mentioned special efficacy program file may include：Json programs or other are executable
The special efficacy program file of program.
Illustratively, any of the above-described embodiment institute of the present invention may be used in the sound special efficacy program file packet in the present embodiment
The generation method for the sound special efficacy program file packet stated generates.
504, obtain the parameter value of the play parameter of the sound material and sound material in sound special efficacy program file packet.
506, the parameter value of the play parameter based on the above sound material generates the sound spy of sound material on the image
Effect.
In some embodiments of the above-mentioned each sound special efficacy generation method embodiment of the present invention, above-mentioned play parameter packet
It includes：Control parameter is played, the broadcasting control parameter is for controlling whether sound material plays.Correspondingly, in the embodiment, operation
In 404 or 506, the parameter value of the play parameter based on sound material generates the sound special efficacy of sound material on the image, can
To include：When parameter value in response to playing control parameter is for controlling the parameter value for playing sound material, based on sound element
The parameter value of the play parameter of material generates the sound special efficacy of sound material on the image.
In some embodiments of the above-mentioned each sound special efficacy generation method embodiment of the present invention, above-mentioned play parameter packet
It includes：Triggering mode parameter, triggering mode parameter are used to indicate the trigger event that triggering plays sound material.Correspondingly, the implementation
Example sound special efficacy generation method can also include：602, whether there is the parameter value of above-mentioned triggering mode parameter in detection image
Corresponding trigger event.In the embodiment, in operation 404 or 506, the parameter value of the play parameter based on sound material,
On image generate sound material sound special efficacy, may include：604, there is triggering mode parameter in response to detecting in image
Parameter value corresponding trigger event, the parameter value of the play parameter based on sound material generates sound material on the image
Sound special efficacy.If in operation 602, the corresponding trigger event of parameter value for occurring triggering mode parameter in image is not detected, no
The follow-up process of the present embodiment is executed, i.e.,：Operation 604 is not executed.As shown in fig. 7, again for sound special efficacy generation method of the present invention
The flow chart of one embodiment.
In some embodiments of the above-mentioned each sound special efficacy generation method embodiment of the present invention, above-mentioned play parameter packet
It includes：Postpone trigger parameter, which is used to indicate the time that delay plays sound material.Correspondingly, the embodiment
In, in operation 404 or 506, the parameter value of the play parameter based on sound material generates the sound of sound material on the image
Special efficacy may include：In response to meeting the playing condition of sound material, the parameter value of the play parameter based on sound material, root
According to the corresponding delay reproduction time of parameter value of delay trigger parameter, postpone the sound that sound material is generated on image in video
Special efficacy.
Wherein, the playing condition for meeting sound material for example can include but is not limited to：Play the parameter value of control parameter
For for control play sound material parameter value, and/or, occur the corresponding triggering of parameter value of triggering mode parameter in image
Event.
In some embodiments of the above-mentioned each sound special efficacy generation method embodiment of the present invention, above-mentioned play parameter packet
It includes：Loop parameter, the loop parameter are used to indicate the loop play number of sound material.Correspondingly, in the embodiment, operation
In 404 or 506, the parameter value of the play parameter based on sound material generates the sound special efficacy of sound material on the image, can
To include：In response to meeting the playing condition of sound material, the parameter value of the play parameter based on sound material is joined according to cycle
The corresponding cycle-index of several parameter values, loop play sound material on image in video, to generate the sound of sound material
Special efficacy.
Wherein, the playing condition for meeting sound material for example can include but is not limited to：Play the parameter value of control parameter
For for control play sound material parameter value, and/or, occur the corresponding triggering of parameter value of triggering mode parameter in image
Event.
In some embodiments of the above-mentioned each sound special efficacy generation method embodiment of the present invention, above-mentioned play parameter packet
It includes：Frame number parameter is played, the broadcasting frame number parameter is for indicating sound material plays how many frame number.Correspondingly, in the embodiment,
In operation 404 or 506, the parameter value of the play parameter based on sound material generates the sound spy of sound material on the image
It imitates, may include：In response to meeting the playing condition of sound material, the parameter value of the play parameter based on sound material, according to
The corresponding broadcasting frame number of parameter value of frame number parameter is played, plays generate sound material on the corresponding image of frame number in video
Sound special efficacy.
Wherein, the playing condition for meeting sound material for example can include but is not limited to：Play the parameter value of control parameter
For for control play sound material parameter value, and/or, occur the corresponding triggering of parameter value of triggering mode parameter in image
Event.
In addition, in some embodiments of the above-mentioned each sound special efficacy generation method embodiment of the present invention, above-mentioned broadcasting ginseng
Number can also include：Triggering terminates parameter, which terminates trigger event of the parameter for indicating to terminate to play sound material.Phase
Ying Di, referring back to Fig. 7, the sound special efficacy generation method of the embodiment can also include：606, whether touch in detection image
Hair terminates the corresponding trigger event of parameter value of parameter；608, in response to detecting the parameter for occurring triggering in image and terminating parameter
It is worth corresponding trigger event, stops the sound special efficacy for generating sound material on the image.If in operation 606, image is not detected
The middle corresponding trigger event of parameter value for triggering occur and terminating parameter, does not execute the follow-up process of the present embodiment, i.e.,：Do not execute behaviour
Make 608.
In addition, in some embodiments of the above-mentioned each sound special efficacy generation method embodiment of the present invention, above-mentioned broadcasting ginseng
Number may include：U.S. face/makeups/efficacy parameter of changing face, U.S.'s face/makeups/efficacy parameter of changing face play sound element for indicating
U.S. face/makeups/effect of changing face shown in predetermined patterns when material.Correspondingly, in the embodiment, in operation 404 or 506, base
In the parameter value of the play parameter of sound material, the sound special efficacy of sound material is generated on the image, may include：Based on sound
The parameter value of the play parameter of material generates the sound special efficacy of sound material on the image, and/makeups/change face effect according to U.S. face
Fruit parameter, U.S. face/makeups/effect of changing face of predetermined patterns display in the picture.
In addition, in some embodiments of the above-mentioned each sound special efficacy generation method embodiment of the present invention, above-mentioned broadcasting ginseng
Number may include：Special effect parameters are deformed, the deformation special effect parameters are for indicating that the when of playing sound material generates deformation on the image
The deformation effect in region.Correspondingly, in the embodiment, in operation 404 or 506, the ginseng of the play parameter based on sound material
Numerical value generates the sound special efficacy of sound material, may include on the image：The parameter value of play parameter based on sound material,
The sound special efficacy of sound material is generated on the image, and according to deformation special effect parameters, generates the deformation of deformed region in the picture
Effect.
In addition, in some embodiments of the above-mentioned each sound special efficacy generation method embodiment of the present invention, above-mentioned broadcasting ginseng
Number may include：Paster special effect parameters generate son element on the image when the paster special effect parameters are for indicating to play sound material
The special efficacy of material.Correspondingly, in the embodiment, in operation 404 or 506, the parameter value of the play parameter based on sound material,
On image generate sound material sound special efficacy, may include：The parameter value of play parameter based on sound material, on the image
The sound special efficacy of sound material is generated, and according to paster special effect parameters, generates the special efficacy of sub- material in the picture.
In some embodiments of the above-mentioned each sound special efficacy generation method embodiment of the present invention, special efficacy program file is obtained
The parameter value of the play parameter of sound material in packet may include：Patch is created by the interface function for creating paster handle
Paper handle；It reads the parameter value of sound material and play parameter and stores into paster handle.
Correspondingly, in other embodiment, the parameter value of the play parameter based on sound material is given birth on the image
At the sound special efficacy of sound material, may include：By calling the interface function for rendering sound material, from paster handle
The sound material that the parameter value and needs of reading play parameter play；The parameter value of play parameter based on the sound material,
The sound special efficacy of sound material is generated on image.
In some optional examples of the above embodiment, when above-mentioned image is image in video, it is based on sound material
Play parameter parameter value, on the image generate sound material sound special efficacy, further include：According to the ginseng of above-mentioned play parameter
Numerical value obtains the video frame number for the sound special efficacy for needing to generate sound material, and reads video frame number from video in advance and correspond to
Image generate the sound special efficacy of sound material on the image so as to the parameter value of the play parameter based on the sound material.
Further, in other embodiment, can also include：It is played in response to sound special efficacy program file packet
It finishes, by for calling the interface function for destroying paster handle to destroy paster handle.
Each sound special efficacy generation method embodiment of the present invention can be used for various images or video playing scene, such as with
In the net cast scene comprising personage, sound special efficacy is generated for the live video, according to sound special efficacy program file packet straight
Broadcasting on video superposition and playing corresponding sound material enhances the recreational of client to increase ambiance effect, promotes immersing of using
Sense.
The generation method and sound special efficacy generation method of any sound special efficacy program file packet provided in an embodiment of the present invention
It can be executed by any suitable equipment with data-handling capacity, including but not limited to：Terminal device and server etc..Or
Person, the generation method and sound special efficacy generation method of any sound special efficacy program file packet provided in an embodiment of the present invention can be by
Processor executes, as processor executes any sound that the embodiment of the present invention refers to by the command adapted thereto for calling memory to store
The generation method and sound special efficacy generation method of sound special efficacy program file packet.Hereafter repeat no more.
One of ordinary skill in the art will appreciate that：Realize that all or part of step of above method embodiment can pass through
The relevant hardware of program instruction is completed, and program above-mentioned can be stored in a computer read/write memory medium, the program
When being executed, step including the steps of the foregoing method embodiments is executed；And storage medium above-mentioned includes：ROM, RAM, magnetic disc or light
The various media that can store program code such as disk.
Fig. 8 is the structural schematic diagram of generating means one embodiment of sound special efficacy program file packet of the present invention.The implementation
The generating means of example sound special efficacy program file packet can be used for realizing the generation of the above-mentioned each sound special efficacy program file packet of the present invention
Embodiment of the method.As shown in figure 8, the generating means of the embodiment sound special efficacy program file packet include：First import modul, the
One acquisition module and the first generation module.Wherein：
First import modul, for importing sound material.
First acquisition module, the parameter value of the play parameter for obtaining sound material.
First generation module, for generating sound special efficacy program file according to sound material and the parameter value of play parameter
Packet.
In wherein some optional examples, the sound special efficacy program file packet in the embodiment of the present invention can be with json journeys
The sound special efficacy program file packet that sequence or any other executable program generate.
Generating means based on the sound special efficacy program file packet that the above embodiment of the present invention provides, generate sound special efficacy journey
When preface part packet, sound material is imported, the parameter value of the play parameter of the sound material is obtained, according to sound material and its broadcasting
The parameter value of parameter generates sound special efficacy program file packet, and sound is carried out to image to be based on the sound special efficacy program file packet
Special effect processing realizes that sound special efficacy, the embodiment of the present invention are not necessarily to that, by manual writing program file, wash with watercolours can be generated on the image
Contaminate the executable sound special efficacy program file of engine, it is easy to operate, required time is short, improve the whole effect of sound special efficacy realization
Rate, and avoid the mistake that manual writing program file is likely to occur, the effective guarantee accuracy of sound special effect.
In wherein some embodiments, the first import modul is specifically used for receiving defeated by the interactive interface of action bar
The importing instruction entered imports the sound material in the material file folder that importing instruction is directed toward.
In wherein some optional examples, the first import modul is set specifically for receiving by special effect parameters under action bar
The importing instruction that the interactive interface in interface is sent is set, the sound material in the material file folder that instruction is directed toward is imported.
In wherein some optional examples, the first import modul is specifically used for：Receive the importing sent by interactive interface
Instruction obtains and shows that importing the material file that instruction is directed toward presss from both sides；In response to receiving to sound material in material file folder
Selection operation imports the sound material that sound material selection operation is chosen；And/or material file is pressed from both sides in response to not receiving
The selection operation of middle sound material is chosen one or more of material file folder sound material according to pre-setting, and is imported
According to the sound material for pre-setting selection.
In wherein some optional examples, the first import modul is specifically used for：It is set by special effect parameters in response to receiving
Set the parameter value that the play parameter for sound material that interactive interface in interface is sent is arranged, using the parameter value of setting as
The parameter value of the play parameter of sound material；And/or it is connect in response to not receiving the interaction being arranged in interface by special effect parameters
The parameter value for the play parameter setting for sound material that mouth is sent, using preset parameter value as the play parameter of sound material
Parameter value.
In wherein some embodiments, the play parameter of sound material for example can include but is not limited to following any one
Item is multinomial：
1, play control parameter (Display)：For controlling whether sound material plays.Its parameter value is including " being
(Yes) " it and " no (No) " two options, indicates to need to play corresponding sound material, parameter when parameter value selection " being (Yes) "
It indicates that corresponding sound material need not be played when value selection " no (No) "；
2, triggering mode parameter (TriggerType)：Refer to leading to for indicating that triggering plays the trigger event of sound material
It crosses the triggering of what trigger event and plays corresponding sound material, parameter value may include each trigger event, and user can be from pre-
If selecting at least one event as trigger event in event sets.I.e.：In video display process, tactile event accordingly is detected
When can trigger and play corresponding sound material, occur triggering thing specified in the triggering mode parameter for example, detecting in video
Start to play one section of advertising words, background music etc. as sound material when part " opening one's mouth ", the specific sound material starts to show
Show the time, terminate to show the time, display how long etc., can specifically be determined according to the parameter value of other play parameter, such as can be with
Parameter is terminated according to delay trigger parameter, triggering respectively, the parameter value of loop parameter determines；
3, loop parameter (TriggerLoop)：Loop play number for indicating sound material, can be arranged or select
The concrete numerical value of loop play number is as its parameter value, for example, 1,5 etc., can arrange parameter value to be set as 0 to be Infinite Cyclic
It plays；
4, delay trigger parameter (TriggerDelay)：For indicating that delay plays the time of sound material, i.e.,：From video
In a certain frame image detection to trigger event in triggering mode parameter when, postpone how many frame images and start to play sound element
Material can be arranged or select the specific time for postponing to play sound material or frame number as its parameter value；
5, triggering terminates parameter (TriggerStop)：Trigger event for indicating to terminate to play sound material, refers to leading to
The broadcasting what terminates sound material is crossed, parameter value includes each trigger event, and user can be from predeterminable event set
Select at least one event as the trigger event for terminating broadcasting sound material.I.e.：In video display process, the triggering is detected
Terminate to terminate to play corresponding sound material when trigger event as defined in parameter, such as is triggered for detecting in video
Start to play one section of background music when trigger event " opening one's mouth " specified in mode parameter, triggering can be set and terminated in parameter
Parameter value is " shutting up ", then detects in video that stopping plays the background music when there is the trigger event " shutting up " action；
6, play frame number parameter (DisplayFrames)：For indicating sound material plays how many frame number.It can be by user
Frame number is selected, when the frame number selected is arranged to the property of can be exemplified be 0, indicates to play stiff material always；
7, U.S. face/makeups/is changed face (U.S. face and/or makeups and/or change face) efficacy parameter：For indicating to play sound material
When U.S. face/makeups/effect of changing face for being shown in predetermined patterns, such as red lip, U.S. pupil, blue eyes etc.；
8, deform special effect parameters：For indicating that the when of playing sound material generates the deformation effect of deformed region on the image,
The shape of deformed region therein is unrestricted, for example, can be circle, ellipse, rectangle, square, triangle or
Other arbitrary shapes etc.；
9, paster special effect parameters, for indicating that the when of playing sound material generates the special efficacy of sub- material on the image, for example,
Position plays cap this sub- material overhead when playing sound material.
In a wherein optional example, the corresponding trigger event of above-mentioned triggering mode parameter is for example including following any one
Item is multinomial：
Attonity triggers (NULL), i.e.,：The sound material can be shown by being not required to any action；
Eye motion, for example, blink, eye closing, eye opening etc.；
Headwork, for example, shake the head, nod, torticollis, rotary head etc.；
Supercilium acts, for example, choosing eyebrow etc.；
Hand motion, for example, love hand, support hand, palm, big thumb brother, embrace fist congratulate, it is singlehanded than the heart, OK hands, scissors hand,
Pistol hand, index finger etc..As shown in figure 3, for an illustrative diagram of hand motion in the embodiment of the present invention；
Mouth action, for example, opening one's mouth, shutting up；
Shoulder acts, for example, shrugging；
Other actions.
Fig. 9 is the structural schematic diagram of another embodiment of the generating means of sound special efficacy program file packet of the present invention.Such as Fig. 9
It is shown, can also include operation interface, operation circle in the generating means of sound special efficacy program file packet another embodiments
Face includes：Action bar, content display field and/or program file column.
As shown in Fig. 2, in wherein some optional examples, operation interface may include left side, middle part and three, right side area
Domain.Content display field can be shown at the middle part of operation interface, on the operation interface right side on the left side display operation column of operation interface
Side shows program file column.
In addition, referring back to Fig. 9, in another embodiment of generating means, can also include：Preserving module is used for root
According to the preservation instruction received sound special efficacy program file packet is preserved in the position for preserving instruction direction.
In wherein some embodiments, preserving module is specifically used for：Instruction is preserved in response to receiving, display preserves road
Diameter selects interface and compression interface；It receives and the save location that interface is sent is selected by storing path；And it receives based on compression
The compress mode that interface is sent, and sound special efficacy program file packet is compressed according to compress mode, generate compressed file packet；
And compressed file packet is stored in the file being directed toward to save location.
In some optional examples, during being compressed to sound special efficacy program file packet, sound special efficacy program text
It is constant to remain the size before being imported into for the size of sound material in part packet.
Figure 10 is the structural schematic diagram of sound special efficacy generating means one embodiment of the present invention.The sound special efficacy of the embodiment
Generating means can be used for realizing the above-mentioned each sound special efficacy generation method embodiment of the present invention.As shown in Figure 10, the embodiment sound
The generating means of special efficacy program file packet include：Second acquisition module and the second generation module.Wherein：
Second acquisition module, the play parameter for obtaining sound material and sound material in sound special efficacy program file packet
Parameter value.
Second generation module is used for the parameter value of the play parameter based on sound material, generates sound material on the image
Sound special efficacy.
Based on the sound special efficacy generating means that the above embodiment of the present invention provides, sound in sound special efficacy program file packet is obtained
The parameter value of phoneme material and its play parameter, the parameter value of the play parameter based on sound material generate sound element on the image
The sound special efficacy of material.The embodiment of the present invention is joined by sound material in the sound special efficacy program file packet that is generated in advance and its play
Several parameter values generates sound special efficacy on the image, realizes the sound special effect play to image, enhances recreational, raising
The feeling of immersion that image plays, improves image result of broadcast.
Figure 11 is the structural schematic diagram of another embodiment of sound special efficacy generating means of the present invention.As shown in figure 11, with figure
Embodiment shown in 10 is compared, and the sound special efficacy generating means of the embodiment further include：Second import modul, for importing sound
Special efficacy program file packet.Correspondingly, in the embodiment, the second acquisition module is specifically used for obtaining sound special efficacy program file packet
In sound material and sound material play parameter parameter value.
Wherein, the sound special efficacy program file of any of the above-described embodiment of the application may be used in sound special efficacy program file packet
The generation method or device of packet generate.
Wherein, image for example can include but is not limited to following any one or more：Still image is schemed in video
Picture.
In some embodiments of above-mentioned each sound special efficacy generating means, play parameter includes：Control parameter is played, it should
Control parameter is played for controlling whether sound material plays.Correspondingly, in the embodiment, the second generation module is specifically used for
When parameter value in response to playing control parameter is for controlling the parameter value for playing sound material, the broadcasting based on sound material
The parameter value of parameter generates the sound special efficacy of sound material on the image.
In some embodiments of above-mentioned each sound special efficacy generating means, play parameter includes：Triggering mode parameter, should
Triggering mode parameter is used to indicate the trigger event that triggering plays sound material.Correspondingly, as shown in figure 11, the sound of the embodiment
Sound special efficacy generating means can also include：First detection module, the ginseng for whether occurring triggering mode parameter in detection image
The corresponding trigger event of numerical value.In the embodiment, the second generation module, specifically for detecting figure in response to first detection module
There is the corresponding trigger event of parameter value of triggering mode parameter as in, the parameter value of the play parameter based on sound material,
The sound special efficacy of sound material is generated on image.
In some embodiments of above-mentioned each sound special efficacy generating means, play parameter includes：Postpone trigger parameter, it should
Delay trigger parameter is used to indicate the time that delay plays sound material.Correspondingly, in the embodiment, the second generation module, tool
Body is used for the playing condition in response to meeting sound material, and the parameter value of the play parameter based on sound material is touched according to delay
The corresponding delay reproduction time of parameter value of parameter is sent out, the sound special efficacy for generating sound material on image in video is postponed；It is full
The playing condition of sufficient sound material includes：The parameter value for playing control parameter is the parameter value for controlling broadcasting sound material,
And/or occurs the corresponding trigger event of parameter value of triggering mode parameter in image.
In some embodiments of above-mentioned each sound special efficacy generating means, play parameter includes：Loop parameter, the cycle
Parameter is used to indicate the loop play number of sound material.Correspondingly, in the embodiment, the second generation module is specifically used for ringing
It should be in the playing condition for meeting sound material, the parameter value of the play parameter based on sound material, according to the parameter of loop parameter
It is worth corresponding cycle-index, in video loop play sound material on image, to generate the sound special efficacy of sound material；Meet
The playing condition of sound material includes：The parameter value for playing control parameter is the parameter value for controlling broadcasting sound material, and/
Or, the corresponding trigger event of the parameter value for occurring triggering mode parameter in image.
In some embodiments of above-mentioned each sound special efficacy generating means, play parameter includes：Frame number parameter is played, it should
Frame number parameter is played for indicating sound material plays how many frame number.Correspondingly, in the embodiment, the second generation module, specifically
For the playing condition in response to meeting sound material, the parameter value of the play parameter based on sound material, according to broadcasting frame number
The corresponding broadcasting frame number of parameter value of parameter plays the sound spy that sound material is generated on the corresponding image of frame number in video
Effect；The playing condition for meeting sound material includes：The parameter value for playing control parameter is for controlling the ginseng for playing sound material
Numerical value, and/or, occur the corresponding trigger event of parameter value of triggering mode parameter in image.
In some embodiments of above-mentioned each sound special efficacy generating means, play parameter includes：Triggering terminates parameter, should
Triggering terminates the trigger event that parameter is used to indicate to terminate to play sound material.Correspondingly, as shown in figure 11, the sound of the embodiment
Sound special efficacy generating means can also include：Second detection module, the ginseng for terminating parameter for whether occurring triggering in detection image
The corresponding trigger event of numerical value.In the embodiment, the second generation module is additionally operable to detect image in response to the second detection module
The middle corresponding trigger event of parameter value for triggering occur and terminating parameter stops the sound special efficacy for generating sound material on the image.
In some embodiments of above-mentioned each sound special efficacy generating means, play parameter includes：U.S. face/makeups/is changed face
Efficacy parameter, U.S.'s face/makeups/efficacy parameter of changing face be used to indicate the U.S. face shown in predetermined patterns when broadcasting sound material/
Makeups/effect of changing face.Correspondingly, in the embodiment, the second generation module, in the parameter of the play parameter based on sound material
Value, when generating the sound special efficacy of sound material on the image, it may also be used for/makeups/efficacy parameter of changing face according to U.S. face, in image
In U.S. face/makeups/effect of changing face of predetermined patterns display.
In some embodiments of above-mentioned each sound special efficacy generating means, play parameter includes：Special effect parameters are deformed, it should
The deformation effect that deformation special effect parameters are used to indicate to generate deformed region when playing sound material on the image.Correspondingly, the reality
It applies in example, the second generation module, in the parameter value of the play parameter based on sound material, generates the sound of sound material on the image
When sound special efficacy, it may also be used for according to deformation special effect parameters, generate the deformation effect of deformed region in the picture.
In some embodiments of above-mentioned each sound special efficacy generating means, play parameter includes：Paster special effect parameters, should
The special efficacy that paster special effect parameters are used to indicate to generate sub- material when playing sound material on the image.Correspondingly, in the embodiment,
Second generation module generates the sound special efficacy of sound material on the image in the parameter value of the play parameter based on sound material
When, it may also be used for according to paster special effect parameters, the special efficacy of sub- material is generated in the picture.
In some embodiments of above-mentioned each sound special efficacy generating means, the second import modul is specifically used for：Pass through tune
With the interface function for reading file packet, sound special efficacy program file packet is read in into memory；And parsing sound special efficacy program
File packet, it includes the play parameter of sound material to obtain sound material and sound special efficacy program file, sound special efficacy program file
Parameter value.
In some embodiments of above-mentioned each sound special efficacy generating means, the second acquisition module obtains special efficacy program file
In packet when the parameter value of the play parameter of sound material, it is specifically used for：It is created by the interface function for creating paster handle
Paster handle；And it reads the parameter value of sound material and play parameter and stores into paster handle.
In some embodiments of above-mentioned each sound special efficacy generating means, the second generation module is specifically used for：Pass through tune
With the interface function for rendering sound material, the sound that the parameter value and needs of reading play parameter play from paster handle
Material；And the parameter value of the play parameter based on sound material, the sound special efficacy of sound material is generated on the image.
In some embodiments of above-mentioned each sound special efficacy generating means, in image during image is video, the second life
At module, it is specifically used for the parameter value according to play parameter, obtains the video frame number for the sound special efficacy for needing to generate sound material,
And the corresponding image of video frame number is read from video in advance.
In some embodiments of above-mentioned each sound special efficacy generating means, the second acquisition module, it may also be used in response to
Sound special efficacy program file packet finishes, by for calling the interface function for destroying paster handle to destroy paster handle.
In some embodiments of above-mentioned each sound special efficacy generating means, the second generation module is adjusted specifically for passing through
Built-in player with place electronic equipment or external player generate the sound special efficacy of sound material on the image.
In addition, another kind electronic equipment provided in an embodiment of the present invention, including：
Memory, for storing computer program；
Processor, for executing the computer program stored in memory, and computer program is performed, and realizes this hair
The generation method or sound special efficacy generation method of the sound special efficacy program file packet of bright any of the above-described embodiment.
Figure 12 is the structural schematic diagram of one Application Example of electronic equipment of the present invention.Below with reference to Figure 12, it illustrates
Suitable for for realizing the structural schematic diagram of the terminal device of the embodiment of the present application or the electronic equipment of server.As shown in figure 12,
The electronic equipment includes one or more processors, communication unit etc., and one or more of processors are for example：In one or more
Central Processing Unit (CPU), and/or one or more image processor (GPU) etc., processor can be according to being stored in read-only storage
Executable instruction in device (ROM) or be loaded into the executable instruction in random access storage device (RAM) from storage section and
Execute various actions appropriate and processing.Communication unit may include but be not limited to network interface card, and the network interface card may include but be not limited to IB
(Infiniband) network interface card, processor can be communicated with read-only memory and/or random access storage device to execute executable finger
It enables, is connected with communication unit by bus and is communicated with other target devices through communication unit, provided to complete the embodiment of the present application
The corresponding operation of either method, for example, import sound material；Obtain the parameter value of the play parameter of the sound material；Root
Sound special efficacy program file packet is generated according to the sound material and the parameter value of the play parameter.For another example, sound special efficacy is obtained
The parameter value of the play parameter of sound material and the sound material in program file packet；Broadcasting ginseng based on the sound material
Several parameter values generates the sound special efficacy of the sound material on the image.
In addition, in RAM, it can also be stored with various programs and data needed for device operation.CPU, ROM and RAM are logical
Bus is crossed to be connected with each other.In the case where there is RAM, ROM is optional module.RAM store executable instruction, or at runtime to
Executable instruction is written in ROM, executable instruction makes processor execute the corresponding operation of any of the above-described method of the present invention.Input/
Output (I/O) interface is also connected to bus.Communication unit can be integrally disposed, may be set to be with multiple submodule (such as
Multiple IB network interface cards), and in bus link.
It is connected to I/O interfaces with lower component：Include the importation of keyboard, mouse etc.；Including such as cathode-ray tube
(CRT), the output par, c of liquid crystal display (LCD) etc. and loud speaker etc.；Storage section including hard disk etc.；And including all
Such as communications portion of the network interface card of LAN card, modem.Communications portion executes logical via the network of such as internet
Letter processing.Driver is also according to needing to be connected to I/O interfaces.Detachable media, such as disk, CD, magneto-optic disk, semiconductor are deposited
Reservoir etc. is installed as needed on a drive, in order to be mounted into as needed from the computer program read thereon
Storage section.
It should be noted that framework as shown in figure 12 is only a kind of optional realization method, it, can root during concrete practice
The component count amount and type of above-mentioned Figure 12 are selected, are deleted, increased or replaced according to actual needs；It is set in different function component
It sets, separately positioned or integrally disposed and other implementations, such as separable settings of GPU and CPU or can be by GPU collection can also be used
At on CPU, the separable setting of communication unit, can also be integrally disposed on CPU or GPU, etc..These interchangeable embodiments
Each fall within protection domain disclosed by the invention.
Particularly, in accordance with an embodiment of the present disclosure, it may be implemented as computer above with reference to the process of flow chart description
Software program.For example, embodiment of the disclosure includes a kind of computer program product comprising be tangibly embodied in machine readable
Computer program on medium, computer program include the program code for method shown in execution flow chart, program code
It may include the corresponding instruction of corresponding execution face false-proof detection method step provided by the embodiments of the present application.In such embodiment
In, which can be downloaded and installed by communications portion from network, and/or is mounted from detachable media.
When the computer program is executed by CPU, the above-mentioned function of being limited in the present processes is executed.
In addition, the embodiment of the present invention additionally provides a kind of computer program, including computer instruction, when computer instruction exists
When being run in the processor of equipment, realize the special efficacy program file packet of any of the above-described embodiment of the present invention generation method or
Special efficacy generation method.
In addition, the embodiment of the present invention additionally provides a kind of computer readable storage medium, it is stored thereon with computer program,
When the computer program is executed by processor, the generation of the sound special efficacy program file packet of any of the above-described embodiment of the present invention is realized
Method or sound special efficacy generation method.
Each embodiment is described in a progressive manner in this specification, the highlights of each of the examples are with its
The difference of its embodiment, same or analogous part cross-reference between each embodiment.For system embodiment
For, since it is substantially corresponding with embodiment of the method, so description is fairly simple, referring to the portion of embodiment of the method in place of correlation
It defends oneself bright.
Methods and apparatus of the present invention may be achieved in many ways.For example, can by software, hardware, firmware or
Software, hardware, firmware any combinations realize methods and apparatus of the present invention.The said sequence of the step of for the method
Merely to illustrate, the step of method of the invention, is not limited to sequence described in detail above, special unless otherwise
It does not mentionlet alone bright.In addition, in some embodiments, also the present invention can be embodied as to record program in the recording medium, these programs
Include for realizing machine readable instructions according to the method for the present invention.Thus, the present invention also covers storage for executing basis
The recording medium of the program of the method for the present invention.
Description of the invention provides for the sake of example and description, and is not exhaustively or will be of the invention
It is limited to disclosed form.Many modifications and variations are obvious for the ordinary skill in the art.It selects and retouches
It states embodiment and is to more preferably illustrate the principle of the present invention and practical application, and those skilled in the art is enable to manage
Various embodiments with various modifications of the solution present invention to design suitable for special-purpose.
Claims (10)
1. a kind of generation method of sound special efficacy program file packet, which is characterized in that including：
Import sound material；
Obtain the parameter value of the play parameter of the sound material；
Sound special efficacy program file packet is generated according to the sound material and the parameter value of the play parameter.
2. according to the method described in claim 1, it is characterized in that, the importing sound material, including：
The importing instruction inputted by the interactive interface of action bar is received, described import in the material file folder that instruction is directed toward is imported
Sound material.
3. according to the method described in claim 2, it is characterized in that, described receive is led by what the interactive interface of action bar inputted
Enter instruction, imports the sound material imported in the material file folder that instruction is directed toward, including：
It receives the importing that the interactive interface by special effect parameters under the action bar being arranged in interface is sent to instruct, be led described in importing
Enter the sound material in the material file folder that instruction is directed toward.
4. according to the method in claim 2 or 3, which is characterized in that receive and instructed by the importing that interactive interface is sent, led
Enter the sound material imported in the material file folder that instruction is directed toward, including：
It receives and is instructed by the importing that the interactive interface is sent, obtained and show the material file for importing instruction and being directed toward
Folder；
In response to receiving the selection operation to sound material in material file folder, the sound material selection operation is imported
The sound material of selection；And/or
In response to not receiving the selection operation to sound material in material file folder, material text is chosen according to pre-setting
One or more of part folder sound material, and import according to the sound material for pre-setting selection.
5. a kind of sound special efficacy generation method, which is characterized in that including：
Obtain the parameter value of the play parameter of sound material and the sound material in sound special efficacy program file packet；
The parameter value of play parameter based on the sound material generates the sound special efficacy of the sound material on the image.
6. a kind of generating means of sound special efficacy program file packet, which is characterized in that including：
First import modul, for importing sound material；
First acquisition module, the parameter value of the play parameter for obtaining the sound material；
First generation module, for generating sound special efficacy program text according to the sound material and the parameter value of the play parameter
Part packet.
7. a kind of sound special efficacy generating means, which is characterized in that including：
Second acquisition module, the play parameter for obtaining sound material and the sound material in sound special efficacy program file packet
Parameter value；
Second generation module is used for the parameter value of the play parameter based on the sound material, generates the sound on the image
The sound special efficacy of material.
8. a kind of electronic equipment, which is characterized in that including：
Memory, for storing computer program；
Processor, for executing the computer program stored in the memory, and the computer program is performed, and is realized
The claims 1-5 any one of them methods.
9. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the computer program is located
When managing device execution, any methods of the claims 1-5 are realized.
10. a kind of computer program, including computer instruction, which is characterized in that when the computer instruction is in the processing of equipment
When being run in device, any methods of the claims 1-5 are realized.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810277590.0A CN108536790A (en) | 2018-03-30 | 2018-03-30 | The generation of sound special efficacy program file packet and sound special efficacy generation method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810277590.0A CN108536790A (en) | 2018-03-30 | 2018-03-30 | The generation of sound special efficacy program file packet and sound special efficacy generation method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108536790A true CN108536790A (en) | 2018-09-14 |
Family
ID=63482087
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810277590.0A Pending CN108536790A (en) | 2018-03-30 | 2018-03-30 | The generation of sound special efficacy program file packet and sound special efficacy generation method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108536790A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI662488B (en) * | 2018-11-14 | 2019-06-11 | 技嘉科技股份有限公司 | Method of analyzing performer video and method of increasing performance effect |
| WO2021103609A1 (en) * | 2019-11-28 | 2021-06-03 | 北京市商汤科技开发有限公司 | Method and apparatus for driving interaction object, electronic device and storage medium |
| CN113760161A (en) * | 2021-08-31 | 2021-12-07 | 北京市商汤科技开发有限公司 | Data generation method, data generation device, image processing method, image processing device, equipment and storage medium |
| CN114501109A (en) * | 2022-02-25 | 2022-05-13 | 深圳火山视觉技术有限公司 | Method for processing sound effect and video effect of disc player |
| CN115442639A (en) * | 2021-06-03 | 2022-12-06 | 北京字跳网络技术有限公司 | Method, device, equipment and medium for generating special effect configuration file |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103853563A (en) * | 2014-03-26 | 2014-06-11 | 北京奇艺世纪科技有限公司 | Media material editing method and device |
| US20150016777A1 (en) * | 2012-06-11 | 2015-01-15 | Magic Leap, Inc. | Planar waveguide apparatus with diffraction element(s) and system employing same |
| CN106060655A (en) * | 2016-08-04 | 2016-10-26 | 腾讯科技（深圳）有限公司 | Video processing method, server and terminal |
| CN107179908A (en) * | 2017-05-16 | 2017-09-19 | 网易（杭州）网络有限公司 | Audio method of adjustment, device, electronic equipment and computer-readable recording medium |
| CN107770626A (en) * | 2017-11-06 | 2018-03-06 | 腾讯科技（深圳）有限公司 | Processing method, image synthesizing method, device and the storage medium of video material |
-
2018
- 2018-03-30 CN CN201810277590.0A patent/CN108536790A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150016777A1 (en) * | 2012-06-11 | 2015-01-15 | Magic Leap, Inc. | Planar waveguide apparatus with diffraction element(s) and system employing same |
| CN103853563A (en) * | 2014-03-26 | 2014-06-11 | 北京奇艺世纪科技有限公司 | Media material editing method and device |
| CN106060655A (en) * | 2016-08-04 | 2016-10-26 | 腾讯科技（深圳）有限公司 | Video processing method, server and terminal |
| CN107179908A (en) * | 2017-05-16 | 2017-09-19 | 网易（杭州）网络有限公司 | Audio method of adjustment, device, electronic equipment and computer-readable recording medium |
| CN107770626A (en) * | 2017-11-06 | 2018-03-06 | 腾讯科技（深圳）有限公司 | Processing method, image synthesizing method, device and the storage medium of video material |
Non-Patent Citations (1)
| Title |
|---|
| 15887733335: "在Flash中添加声音和视频", 《百度文库，HTTPS://WENKU.BAIDU.COM/VIEW/DD1D90B2B0717FD5360CDCF2.HTML?FROM=SEARCH》 * |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI662488B (en) * | 2018-11-14 | 2019-06-11 | 技嘉科技股份有限公司 | Method of analyzing performer video and method of increasing performance effect |
| WO2021103609A1 (en) * | 2019-11-28 | 2021-06-03 | 北京市商汤科技开发有限公司 | Method and apparatus for driving interaction object, electronic device and storage medium |
| TWI777229B (en) * | 2019-11-28 | 2022-09-11 | 大陸商北京市商湯科技開發有限公司 | Driving method of an interactive object, apparatus thereof, display device, electronic device and computer readable storage medium |
| US11769499B2 (en) | 2019-11-28 | 2023-09-26 | Beijing Sensetime Technology Development Co., Ltd. | Driving interaction object |
| CN115442639A (en) * | 2021-06-03 | 2022-12-06 | 北京字跳网络技术有限公司 | Method, device, equipment and medium for generating special effect configuration file |
| CN115442639B (en) * | 2021-06-03 | 2024-01-16 | 北京字跳网络技术有限公司 | Method, device, equipment and medium for generating special effect configuration file |
| CN113760161A (en) * | 2021-08-31 | 2021-12-07 | 北京市商汤科技开发有限公司 | Data generation method, data generation device, image processing method, image processing device, equipment and storage medium |
| CN114501109A (en) * | 2022-02-25 | 2022-05-13 | 深圳火山视觉技术有限公司 | Method for processing sound effect and video effect of disc player |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108536790A (en) | The generation of sound special efficacy program file packet and sound special efficacy generation method and device | |
| US11521389B2 (en) | Method for generating special effect program file package, method for generating special effect, electronic device, and storage medium | |
| CN106095235B (en) | control method and device based on virtual reality | |
| CN106502554B (en) | Display control method and device | |
| CN108711180A (en) | Makeups/generation and makeups of special efficacy of changing face program file packet/special efficacy of changing face generation method and device | |
| US9501140B2 (en) | Method and apparatus for developing and playing natural user interface applications | |
| CN108280883A (en) | It deforms the generation of special efficacy program file packet and deforms special efficacy generation method and device | |
| KR102466689B1 (en) | Special effect program file package and special effect generation method and device, electronic device | |
| CN108273265A (en) | The display methods and device of virtual objects | |
| CN109254650B (en) | Man-machine interaction method and device | |
| CN108399654A (en) | It retouches in the generation of special efficacy program file packet and special efficacy generation method and device when retouching | |
| CN103902489B (en) | Generate and execute the method and system of the Miniapp of computer application | |
| CN109035373A (en) | The generation of three-dimensional special efficacy program file packet and three-dimensional special efficacy generation method and device | |
| CN106485956A (en) | A kind of method of demonstration electronic functionalities, device and intelligent terminal | |
| CN108109209A (en) | A kind of method for processing video frequency and its device based on augmented reality | |
| MY149297A (en) | Storage medium storing interactive graphics stream activated in response to user's command, and reproducing apparatus and method for reproducing from the same | |
| CN108986227A (en) | The generation of particle effect program file packet and particle effect generation method and device | |
| CN108563327A (en) | Augmented reality method, apparatus, storage medium and electronic equipment | |
| CN114222076B (en) | Face changing video generation method, device, equipment and storage medium | |
| KR101403579B1 (en) | Method for providing on-line game supporting item customaizing by user and the system there of | |
| CN109445573A (en) | A kind of method and apparatus for avatar image interactive | |
| EP3549009A1 (en) | Realtime recording of gestures and/or voice to modify animations | |
| CN112755510A (en) | Mobile terminal cloud game control method, system and computer readable storage medium | |
| CN106445085B (en) | Interaction control method and device based on virtual reality | |
| CN113841107A (en) | Spatial audio and haptic |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |