CN106028119A - Multimedia special effect customizing method and device - Google Patents
Multimedia special effect customizing method and device Download PDFInfo
- Publication number
- CN106028119A CN106028119A CN201610375654.1A CN201610375654A CN106028119A CN 106028119 A CN106028119 A CN 106028119A CN 201610375654 A CN201610375654 A CN 201610375654A CN 106028119 A CN106028119 A CN 106028119A
- Authority
- CN
- China
- Prior art keywords
- specially good
- good effect
- raw data
- audio
- effect
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/435—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
- H04N21/4355—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream involving reformatting operations of additional data, e.g. HTML pages on a television screen
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/81—Monomedia components thereof
- H04N21/8106—Monomedia components thereof involving special audio data, e.g. different tracks for different languages
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Studio Circuits (AREA)
- Electrophonic Musical Instruments (AREA)
Abstract
The invention discloses a multimedia special effect customizing method. The method comprises the following steps: monitoring a special effect customizing instruction, and entering a special effect customizing generating mode according to the special effect customizing instruction; acquiring raw materials and a relevant sound effect processing template, and acquiring audio data; performing real-time sound effect processing on the audio data through the audio processing template to generate an audio special effect; and synthesizing the audio special effect and the raw materials to generate a customized multimedia special effect. Moreover, the invention also provides a multimedia special effect customizing device matched with the method. Through adoption of the multimedia special effect customizing method and device, the adaptability and specificity of the multimedia special effect are improved.
Description
Technical field
The present invention relates to multimedia application technical field, particularly to customizing method and the device of a kind of multimedia specially good effect.
Background technology
In recent years, along with the high speed development of Internet technology, include entertain online and play live including numerous reality TV show internet, applications obtained unprecedented development.User can issue instant video by above-mentioned reality TV show internet, applications, carries out reality TV show performance, shows from the ability in the aspect such as sing and dance, explanation.
At present, user, during issuing instant video, can carry out interaction with spectators, and such as, interaction can be realized by the mode sending multimedia specially good effect (such as, with the special video effect of voice).User usually opens the specially good effect window of instant video application, chooses a multimedia specially good effect so that the special video effect in complementary multimedia specially good effect in the video pictures of display in video clip, and plays the sound accompaniment specially good effect in multimedia specially good effect.
But, existing multimedia specially good effect is preset by instant video application often, and the multimedia specially good effect that provided also cannot be adapted to the interaction content required for current instant video or user, and then make multimedia the lacking of property of specially good effect in video.
Summary of the invention
Based on this, it is necessary to propose the customizing method of a kind of multimedia specially good effect, the method can improve adaptability and the specific aim of multimedia specially good effect.
Additionally, it is necessary to propose the self-defined device of a kind of multimedia specially good effect, this device can improve adaptability and the specific aim of multimedia specially good effect.
A kind of customizing method of multimedia specially good effect, including:
Intercept the instruction of self-defined specially good effect, and enter the self-defined generation mode of specially good effect according to the instruction of described self-defined specially good effect；
Obtain raw data and relevant audio effect processing template, and trigger the acquisition carrying out voice data；
By described Audio Processing template, described voice data is carried out real-time audio effect processing and generate audio frequency specially good effect；
Synthesize described audio frequency specially good effect and described raw data, generate self-defining multimedia specially good effect.
Further, described method, described acquisition raw data and relevant audio effect processing template, and the step obtaining voice data includes:
Triggering in response to the self-defined generation mode of described specially good effect enters, and carries out the display at raw data interface；
Described raw data is obtained according to the selection operation triggered in raw data interface；
Carrying out calling of audio effect processing template according to the sound accompaniment specially good effect in described raw data, the described audio effect processing template called is once for exporting described sound accompaniment specially good effect；
When described raw data to be obtained and relevant audio effect processing template, trigger the acquisition carrying out voice data.
Further, described method, described acquisition raw data and relevant audio effect processing template, and the step obtaining voice data includes:
Triggering in response to the self-defined generation mode of described specially good effect enters, and carries out the display at raw data interface；
Trigger choosing of carrying out obtain the raw data chosen and relevant audio effect processing template by raw data interface is respectively directed to raw data and audio effect processing template；
When described raw data to be obtained and relevant audio effect processing template, trigger the acquisition carrying out voice data.
Further, described method, described raw data to be obtained and relevant audio effect processing template, after triggering the step of the acquisition carrying out voice data, described method also includes:
By the collection of user voice signal is obtained described voice data.
Further, described method, after the described step that described voice data is carried out real-time audio effect processing generation audio frequency specially good effect by described Audio Processing template, described method also includes:
Obtain the time span of described audio frequency specially good effect；
Judge whether the time span of the described audio frequency specially good effect display time span corresponding with described raw data is consistent；
If it has not, then be adjusted processing to described audio frequency specially good effect according to the display time span that described raw data is corresponding.
Further, described method, the described step by described audio frequency specially good effect and the described raw data self-defining multimedia specially good effect of synthesis includes:
Shield the sound accompaniment specially good effect in described raw data；
Synthesize described audio frequency specially good effect and described raw data, generate self-defining multimedia specially good effect.
Further, described method, after the described step that described audio frequency specially good effect and described special video effect synthesize multimedia specially good effect, described method also includes:
The described multimedia specially good effect of instant broadcasting, and send described multimedia specially good effect；
After completing the transmission of described multimedia specially good effect, release the masking operation of described sound accompaniment specially good effect and remove described audio frequency specially good effect.
The present invention separately provides the self-defined device of a kind of multimedia specially good effect, including:
Intercept module, be used for intercepting the instruction of self-defined specially good effect, and enter the self-defined generation mode of specially good effect according to the instruction of described self-defined specially good effect；
Acquisition module, for obtaining raw data and relevant audio effect processing template, and obtains voice data；
Processing module, generates audio frequency specially good effect for described voice data being carried out real-time audio effect processing by described Audio Processing template；
Synthesis module, is used for synthesizing described audio frequency specially good effect and described raw data, generates self-defining multimedia specially good effect.
Further, described device, described acquisition module includes:
Raw data interface display unit, for entering in response to the triggering in the self-defined generation mode of described specially good effect, carries out the display at raw data interface；
Raw data acquiring unit, for obtaining described raw data according to the selection operation triggered in raw data interface；
Audio effect processing template acquiring unit, for carrying out calling of audio effect processing template according to the sound accompaniment specially good effect in described raw data, the described audio effect processing template called is once for exporting described sound accompaniment specially good effect；
Obtain the trigger element of voice data, when described raw data to be obtained and relevant audio effect processing template, trigger the acquisition carrying out voice data.
Further, described device, described acquisition module includes:
Interface display unit, the triggering for the self-defined generation mode in response to described specially good effect enters, and carries out the display at raw data interface；
Raw data and audio template acquiring unit, for triggering choosing of carrying out and obtain the raw data chosen and relevant audio effect processing template by being respectively directed to raw data and audio effect processing template in raw data interface；
Audio frequency obtains trigger element, when described raw data to be obtained and relevant audio effect processing template, triggers the acquisition carrying out voice data.
Further, described device, described device also includes:
Voice data acquisition module, for by obtaining described voice data to the collection of user voice signal.
Further, described device, described device also includes:
Time span acquisition module, for obtaining the time span of described audio frequency specially good effect；
Judge module, for judging whether the time span of the described audio frequency specially good effect display time span corresponding with described raw data is consistent, if it has not, then notice adjustment processing module；
Adjust processing module, be adjusted processing to described audio frequency specially good effect for the display time span corresponding according to described raw data.
Further, described device, described synthesis module includes:
Screen unit, for shielding the described sound accompaniment specially good effect in described raw data；
Synthesis unit, for synthesizing described audio frequency specially good effect and the special video effect in described raw data, generates self-defining multimedia specially good effect.
Further, described device, described device also includes:
Play and sending module, play described multimedia specially good effect for instant, and send described multimedia specially good effect；
Recover module, for, after completing the transmission of described multimedia specially good effect, releasing the masking operation of described sound accompaniment specially good effect and remove described audio frequency specially good effect.
Compared with prior art, there is advantages that
In the customizing method of above-mentioned multimedia specially good effect, if needing for video clip loads self-defining multimedia specially good effect, then can intercept the instruction of self-defined specially good effect, and the self-defined generation mode of specially good effect is entered according to the instruction of self-defined specially good effect, obtain raw data and relevant audio effect processing template, and obtain voice data, by Audio Processing template, voice data is carried out real-time audio effect processing and generate audio frequency specially good effect, audio frequency specially good effect is synthesized self-defining multimedia specially good effect with raw data, and be transmitted, the most just the generation of self-defined multimedia specially good effect in video distribution is achieved, improve adaptability and the specific aim of multimedia specially good effect.
Additionally, the device matched with the customizing method of above-mentioned multimedia specially good effect has the technique effect that said method can reach too.
Accompanying drawing explanation
Fig. 1 is the flow chart of multimedia specially good effect customizing method in an embodiment.
Fig. 2 is to obtain raw data and relevant audio effect processing template in an embodiment, and obtains voice data method flow diagram.
Fig. 3 is to obtain raw data and relevant audio effect processing template in another embodiment, and obtains the method flow diagram of voice data.
Fig. 4 is the flow chart of multimedia specially good effect customizing method in another embodiment.
Fig. 5 is Composite tone specially good effect and described raw data in an embodiment, generates the method flow diagram of self-defining multimedia specially good effect.
Fig. 6 is the flow chart of multimedia specially good effect customizing method in another embodiment.
Fig. 7 is the structural representation of the self-defined device of multimedia specially good effect in an embodiment.
Fig. 8 is the structural representation of acquisition module in an embodiment.
Fig. 9 is the structural representation of acquisition module in another embodiment.
Figure 10 is the structural representation of the self-defined device of multimedia specially good effect in another embodiment.
Figure 11 is the structural representation of synthesis module in an embodiment.
Figure 12 is the structural representation of the self-defined device of multimedia specially good effect in another embodiment.
Detailed description of the invention
Embodiment feature of present invention will describe the most in detail with the exemplary embodiment of advantage.Iting should be understood that the present invention can have various changes on different embodiments, it neither departs from the scope of the present invention, and explanation therein and be shown in and be substantially treated as purposes of discussion, and is not used to limit the present invention.
Based on this, for improving adaptability and the specific aim of multimedia specially good effect, spy of the present invention proposes the customizing method of a kind of multimedia specially good effect, the customizing method of this multimedia specially good effect is realized by computer program, corresponding, the self-defined device of constructed multimedia specially good effect is then stored in the terminal comprising Input/Output Device.
In one embodiment, concrete, as it is shown in figure 1, the customizing method of a kind of multimedia specially good effect, including:
Step 110, intercepts the instruction of self-defined specially good effect, and enters the self-defined generation mode of specially good effect according to the instruction of self-defined specially good effect.
The instruction of self-defined specially good effect can be to trigger to generate in the video clip issuing instant video, it is also possible to triggers generating in function interface when being not issue instant video.
Video clip refers to contain the interface in video distribution region, its manipulation that specially good effect loads in the issue realizing video and video.The instruction of self-defined specially good effect is generated by video clip triggering the multimedia specially good effect carried out self-defined.
The Action Events that the instruction of self-defined specially good effect is triggered by user generates, and such as, user triggers this Action Events by clicking on the specially good effect custom button in video clip, now, will be responsive to this Action Events and generates the instruction of self-defined specially good effect.The instruction of self-defined specially good effect is for triggering the self-defined generation mode entering specially good effect.The self-defined generation mode of specially good effect will be different from directly the choosing and send, under the self-defined generation mode of specially good effect of multimedia specially good effect in video clip, it is possible to carry out the self-defined generation of multimedia specially good effect for the video issued.
Under the self-defined generation mode of specially good effect, the multimedia specially good effect preset can be modified in Video Applications, to generate the self-defining multimedia specially good effect that can adapt to the interaction content required for current video or user.
Intercept the Action Events for generating the instruction of self-defined specially good effect, under the triggering of this Action Events, generate the instruction of this self-defined specially good effect, enter the self-defined generation mode of specially good effect according to the instruction of this self-defined specially good effect, to start the self-defined flow process of this multimedia specially good effect.
Step 130, obtains raw data and relevant audio effect processing template, and obtains voice data.
This raw data can be the material that carries of Video Applications or locally stored material, and this raw data can be multimedia specially good effect, special video effect, picture etc., and multimedia specially good effect can be special video effect or the special video effect of subsidiary audio frequency specially good effect.In the self-defined generation mode of specially good effect, by user, the selection operation of raw data is obtained raw data.
Audio Processing template is the template being packaged with at least one audio frequency audio effect processing algorithm.This Audio Processing template for carrying out audio effect processing and exporting audio frequency specially good effect (this audio frequency specially good effect is to include the sound of sound-content and sound effect) to voice data.This sound effect can be the effect being embodied in volume, tone and tone color, and this sound effect can also be to be embodied in increase sound appeal, verity and recreational effect, such as, EAX, musical instrument audio, animal sounds audio etc..
In the self-defined generation mode of specially good effect, this Audio Processing template is to call to obtain or automatically called by Video Applications to the selection operation of Audio Processing template according to user to obtain.
The voice data obtained can be the voice data being implemented collection by audio collecting device, or, by user, the selection operation of voice data is obtained the voice data in memorizer.
Step 150, carries out real-time audio effect processing by Audio Processing template to voice data and generates audio frequency specially good effect.
This audio effect processing includes but not limited to that the equilibrium to voice data, the change of voice, echo, audio mixing, reverberation, fringing, trill, distortion etc. process, and is realized by Audio Processing template.
Such as, this Audio Processing template can carry out change of voice process to voice data so that the output of this Audio Processing template is different from the another kind of sound of the tone of original sound.Such as, voice data, before unprocessed, be the sound that sends of human vocal band, after Audio Processing template processes, become the effect of Robotics Sound.
Step 170, Composite tone specially good effect and raw data, generate self-defining multimedia specially good effect.
By the voice data of acquisition after audio effect processing, synthesize self-defining multimedia specially good effect with raw data.
Such as, raw data is the voice (such as robot says " my Shi Ge robot ") of a robot animation and this robot, and wherein, the robot animation is special video effect, and the voice of robot is sound accompaniment specially good effect.Audio frequency specially good effect after audio template processes is to include cheer " I is hornet ", then the audio frequency specially good effect of " I is hornet " and the robot animation are synthesized this self-defining multimedia specially good effect, this multimedia specially good effect shows the robot animation in video clip, and plays the sound of " I is hornet ".
The most such as, raw data is the voice (such as robot says " my Shi Ge robot ") of a robot animation and this robot, and wherein, the robot animation is special video effect, and the voice of robot is sound accompaniment specially good effect.By mike input voice " I is hornet ", voice " I is hornet " is processed as the effect (i.e. having the tone of robot sounding, volume and tone color) of Robotics Sound by audio effect processing template, and the audio frequency specially good effect of " I is hornet " and the robot animation are synthesized this self-defining multimedia specially good effect.
The most such as, raw data is a Robotic Dynamic figure, by mike input voice " I is robot ", voice " I is robot " is processed as the effect of Robotics Sound by audio effect processing template, and the audio frequency specially good effect of " I is robot " synthesizes this self-defining multimedia specially good effect with Robotic Dynamic figure.
As mentioned above, just the multimedia specially good effect in video distribution can be custom-configured by technical scheme as above, multimedia specially good effect existing in video clip can be modified by user according to the demand of self or hobby, make this self-defining multimedia specially good effect can adapt to the interaction content required for current video or user, and then make the media specially good effect in video have specific aim.
In another embodiment, as in figure 2 it is shown, step 130 includes:
Step 131, the triggering in response to the self-defined generation mode of specially good effect enters, and carries out the display at raw data interface.
Showing multiple raw data in raw data interface, the plurality of raw data can show with the pattern of list.
Step 133, obtains raw data according to the selection operation triggered in raw data interface.
For multiple raw data of display in raw data interface, carry out the selection operation of one of them raw data, to obtain corresponding raw data.Such as, user clicks on a raw data of certain in raw data interface, corresponding this raw data of acquisition.
In this embodiment, the raw data of above-mentioned acquisition is multimedia specially good effect, i.e. this raw data includes special video effect and sound accompaniment specially good effect.Such as, this raw data is the sound accompaniment specially good effect (such as robot says " my Shi Ge robot ") of a robot animation and this robot, and wherein, " my Shi Ge robot " that robot says is sound accompaniment specially good effect, and the robot animation is special video effect.
Step 135, carries out calling of audio effect processing template according to the sound accompaniment specially good effect in raw data, and the audio effect processing template called is once for exporting sound accompaniment specially good effect.
This sound accompaniment specially good effect is the dubbing of special video effect in raw data, and it is to obtain by carrying out audio effect processing by certain audio effect processing template.
These sound accompaniment data are the initial voice in raw data, such as, and the voice of people, and sound accompaniment specially good effect is the acoustic information of output after audio effect processing resume module.Such as, process of changing voice the voice of people, to be treated as the effect of Robotics Sound by voice.
The audio effect processing template of sound accompaniment specially good effect is stored in locally-stored device, this audio effect processing template is called for processing the voice data of acquisition from locally-stored device, so that this voice data is after this audio effect processing template processes, there is the sound effect identical with this sound accompaniment specially good effect.
In this embodiment, by calling once for exporting the audio effect processing template of sound accompaniment specially good effect in raw data, make the audio frequency specially good effect after this audio effect processing template processes closer to the special video effect in raw data so that the result of broadcast of this self-defined multimedia specially good effect is more preferably.
When step 137, raw data to be obtained and relevant audio effect processing template, trigger the acquisition carrying out voice data.
In another embodiment, as it is shown on figure 3, step 130 includes:
Step 132, the triggering in response to the self-defined generation mode of specially good effect enters, and carries out the display at raw data interface.
Raw data interface shows multiple raw data and multiple audio effect processing template, the plurality of raw data and multiple audio effect processing template to show with the pattern of list in raw data interface.
Step 134, triggers choosing of carrying out obtain the raw data chosen and relevant audio effect processing template by being respectively directed to raw data and audio effect processing template in raw data interface.
User carries out selection operation to the multiple raw data in raw data interface and multiple audio effect processing template respectively, to obtain the raw data and audio effect processing template chosen.Such as, user obtains this clicked raw data by some raw data in raw data list is carried out clicking operation；User obtains this clicked audio effect processing template by some the audio effect processing template in audio effect processing template list is carried out clicking operation.
When step 136, raw data to be obtained and relevant audio effect processing template, trigger the acquisition carrying out voice data.
In another embodiment, described in the self-defined generation mode of specially good effect, obtain raw data and relevant audio effect processing template, and after triggering the step of the acquisition carrying out voice data, i.e. after step 137 or step 136, said method also includes:
By the collection of user voice signal is obtained voice data.
When raw data to be obtained and relevant audio effect processing template, trigger the startup of audio collecting device, or trigger the corresponding information of generation and manually boot audio collecting device with prompting user, obtain corresponding voice data to carry out the collection of user voice signal.By the collection of user voice data by obtaining the acoustical signal of user and can be blended in multimedia specially good effect, improve the interactive performance of computer system.
In another embodiment, as shown in Figure 4, after voice data being carried out the step that audio effect processing generates audio frequency specially good effect by Audio Processing template, i.e. after step 150, said method also includes:
Step 310, obtains the time span of audio frequency specially good effect.
Step 330, it is judged that whether the display time span that the time span of audio frequency specially good effect is corresponding with raw data is consistent, if it has not, then perform step 350, if it has, then do not process.
Display time span corresponding to raw data is default, such as, when this raw data is special video effect, the display time span of this special video effect is default, changeless, when the time span of audio frequency specially good effect is longer than the display time span of special video effect, it may appear that special video effect and the situation of the asynchronous broadcasting of audio frequency specially good effect, affect viewing effect.Therefore, need to determining whether whether the time span of the audio frequency specially good effect time span corresponding with raw data is consistent, if not corresponding, then entering step 350.
Step 350, is adjusted processing to described audio frequency specially good effect according to the time span that raw data is corresponding.
According to the time span that raw data is corresponding, such as, according to the display time span of special video effect in raw data, it is adjusted processing to the time span of audio frequency specially good effect, such as, if the reproduction time of this audio frequency specially good effect is longer than the display time of special video effect, then this audio frequency specially good effect is carried out quickening process.
In another embodiment, as it is shown in figure 5, step 170 includes:
Step 171, the sound accompaniment specially good effect in shielding raw data.
In this embodiment, raw data is multimedia specially good effect, and this multimedia specially good effect includes special video effect and sound accompaniment specially good effect.Before the synthesis carrying out stating raw data and audio frequency specially good effect, the sound accompaniment specially good effect that shielding raw data carries, make the sound accompaniment specially good effect in this raw data to be played, the sound accompaniment specially good effect also making this raw data carry will not be replaced or delete.
Step 173, Composite tone specially good effect and the special video effect in described raw data, generate self-defining multimedia specially good effect.
After sound accompaniment specially good effect in raw data is shielded, raw data is only play special video effect, this special video effect is synthesized self-defining multimedia specially good effect with audio frequency specially good effect.
In another embodiment, as shown in Figure 6, after audio frequency specially good effect and the special video effect in raw data synthesize the step of self-defining multimedia specially good effect, said method includes:
Step 410, instant broadcasting multimedia specially good effect, and send multimedia specially good effect.
After synthesizing this self-defining multimedia specially good effect, the relevant position in video clip carries out the instant broadcasting of this multimedia specially good effect, and the synchronization including special video effect and audio frequency specially good effect is play.Wherein, the relevant position in video clip refers to the loading position that this multimedia specially good effect itself is mapped.
After completing the broadcasting of this multimedia specially good effect, triggering the transmission of this multimedia specially good effect, such as, user clicks on specially good effect send button, triggers and generates specially good effect transmission instruction, sends instruction according to this specially good effect and send this multimedia specially good effect.
Or, after completing the broadcasting of this multimedia specially good effect, instant this multimedia specially good effect of transmission, in the playing process of multimedia specially good effect, user can cancel this multimedia specially good effect.Such as, after user chooses raw data and audio effect processing template, press sound and obtain trigger button, typing sound, when user unclamps sound acquisition trigger button, the audio frequency specially good effect after audio effect processing template processes is synthesized multimedia specially good effect with raw data, and immediately plays, after completing the broadcasting of this multimedia specially good effect, multimedia specially good effect sends immediately.Therefore, the present embodiment has the function quickly generating, sending multimedia specially good effect.
Step 430, after the transmission completing multimedia specially good effect, releases the masking operation of sound accompaniment specially good effect and removes audio frequency specially good effect.
After completing the transmission of multimedia special effect play, in order to make this self-defining multimedia specially good effect will not cover raw data, this self-defining multimedia specially good effect need not be preserved, but the raw data before recovering, i.e. release the masking operation of sound accompaniment specially good effect and remove audio frequency specially good effect so that user is still the raw data of systemic presupposition when again raw data being carried out selection operation.
In one embodiment, also correspondingly provide the self-defined device of a kind of multimedia specially good effect, as it is shown in fig. 7, this device includes intercepting module 210, acquisition module 230, processing module 250 and synthesis module 270, wherein:
Intercept module 210, be used for intercepting the instruction of self-defined specially good effect, and enter the self-defined generation mode of specially good effect according to the instruction of self-defined specially good effect；
Acquisition module 230, for obtaining raw data and relevant audio effect processing template, and obtains voice data；
Processing module 250, generates audio frequency specially good effect for described voice data being carried out real-time audio effect processing by described Audio Processing template；
Synthesis module 270, is used for synthesizing described audio frequency specially good effect and described raw data, generates self-defining multimedia specially good effect.
In one embodiment, as shown in Figure 8, above-mentioned acquisition module 230 includes raw data interface display unit 231, raw data acquiring unit 233, audio effect processing template acquiring unit 235 and obtains the trigger element 237 of voice data, wherein:
Raw data interface display unit 231, for entering in response to the triggering in the self-defined generation mode of described specially good effect, carries out the display at raw data interface；
Raw data acquiring unit 233, for obtaining described raw data according to the selection operation triggered in raw data interface；
Audio effect processing template acquiring unit 235, for carrying out calling of audio effect processing template according to the sound accompaniment specially good effect in described raw data, the described audio effect processing template called is once for exporting described sound accompaniment specially good effect；
Obtain the trigger element 237 of voice data, when described raw data to be obtained and relevant audio effect processing template, trigger the acquisition carrying out voice data.
In one embodiment, as it is shown in figure 9, above-mentioned acquisition module 230 includes that interface display unit 232, raw data and audio template acquiring unit 234 and audio frequency obtain trigger element 236, wherein:
Interface display unit 232, the triggering for the self-defined generation mode in response to specially good effect enters, and carries out the display at raw data interface；
Raw data and audio template acquiring unit 234, for triggering choosing of carrying out and obtain the raw data chosen and relevant audio effect processing template by being respectively directed to raw data and audio effect processing template in raw data interface；
Audio frequency obtains trigger element 236, when described raw data to be obtained and relevant audio effect processing template, triggers the acquisition carrying out voice data.
In one embodiment, the self-defined device of this multimedia specially good effect also includes voice data acquisition module, and this voice data acquisition module is for by obtaining described voice data to the collection of user voice signal.
In one embodiment, as shown in Figure 10, the self-defined device of this multimedia specially good effect also includes time span acquisition module 510, judge module 530 and adjusts processing module 550, wherein:
Time span acquisition module 510, for obtaining the time span of described audio frequency specially good effect；
Judge module 530, for judging whether the time span of the described audio frequency specially good effect display time span corresponding with described raw data is consistent, if it has not, then notice adjustment processing module 550；
Adjust processing module 550, be adjusted processing to described audio frequency specially good effect for the display time span corresponding according to described raw data.
In one embodiment, as shown in figure 11, synthesis module 270 includes screen unit 271 and synthesis unit 273, wherein:
Screen unit 271, for shielding the described sound accompaniment specially good effect in described raw data；
Synthesis unit 273, for Composite tone specially good effect and described raw data, generates self-defining multimedia specially good effect.
In one embodiment, as shown in figure 12, the self-defined device of this multimedia specially good effect also includes playing and sending module 610 and recovery module 630, wherein:
Play and sending module 610, play multimedia specially good effect for instant, and send multimedia specially good effect；
Recover module 630, for after described multimedia special effect play completes, release the masking operation of described sound accompaniment specially good effect and remove the data cached of described audio frequency specially good effect.
One of ordinary skill in the art will appreciate that all or part of step realizing above-described embodiment can be completed by hardware, relevant hardware can also be instructed by program to complete, described program can be stored in a kind of computer-readable recording medium, storage medium mentioned above can be read only memory, disk or CD etc..
Although describing the present invention with reference to several exemplary embodiment, it is to be understood that, term used is explanation and exemplary and nonrestrictive term.Owing to the present invention can be embodied as the spirit without deviating from invention or essence in a variety of forms, it is to be understood that, above-mentioned embodiment is not limited to any aforesaid details, and should explain widely in the spirit and scope that appended claims are limited, therefore fall into the whole changes in claim or its equivalent scope and remodeling all should be appended claims and contained.
Claims (10)
1. the customizing method of a multimedia specially good effect, it is characterised in that including:
Intercept the instruction of self-defined specially good effect, and enter the self-defined generation mode of specially good effect according to the instruction of described self-defined specially good effect；
Obtain raw data and relevant audio effect processing template, and obtain voice data；
By described Audio Processing template, described voice data is carried out real-time audio effect processing and generate audio frequency specially good effect；
Synthesize described audio frequency specially good effect and described raw data, generate self-defining multimedia specially good effect.
Method the most according to claim 1, it is characterised in that described acquisition raw data and relevant audio effect processing template, and the step obtaining voice data includes:
Triggering in response to the self-defined generation mode of described specially good effect enters, and carries out the display at raw data interface；
Described raw data is obtained according to the selection operation triggered in raw data interface；
Carrying out calling of audio effect processing template according to the sound accompaniment specially good effect in described raw data, the described audio effect processing template called is once for exporting described sound accompaniment specially good effect；
When described raw data to be obtained and relevant audio effect processing template, trigger the acquisition carrying out voice data.
Method the most according to claim 1, it is characterised in that described acquisition raw data and relevant audio effect processing template, and the step obtaining voice data includes:
Triggering in response to the self-defined generation mode of described specially good effect enters, and carries out the display at raw data interface；
Trigger choosing of carrying out obtain the raw data chosen and relevant audio effect processing template by raw data interface is respectively directed to raw data and audio effect processing template；
When described raw data to be obtained and relevant audio effect processing template, trigger the acquisition carrying out voice data.
The most according to the method in claim 2 or 3, it is characterised in that when described raw data to be obtained and relevant audio effect processing template, after triggering the step of the acquisition carrying out voice data, described method also includes:
By the collection of user voice signal is obtained described voice data.
Method the most according to claim 1, it is characterised in that after the described step that described voice data is carried out real-time audio effect processing generation audio frequency specially good effect by described Audio Processing template, described method also includes:
Obtain the time span of described audio frequency specially good effect；
Judge whether the time span of the described audio frequency specially good effect display time span corresponding with described raw data is consistent；
If it has not, then be adjusted processing to described audio frequency specially good effect according to the display time span that described raw data is corresponding.
6. the self-defined device of a multimedia specially good effect, it is characterised in that including:
Intercept module, be used for intercepting the instruction of self-defined specially good effect, and enter the self-defined generation mode of specially good effect according to the instruction of described self-defined specially good effect；
Acquisition module, for obtaining raw data and relevant audio effect processing template, and obtains voice data；
Processing module, generates audio frequency specially good effect for described voice data being carried out real-time audio effect processing by described Audio Processing template；
Synthesis module, is used for synthesizing described audio frequency specially good effect and described raw data, generates self-defining multimedia specially good effect.
Device the most according to claim 6, it is characterised in that described acquisition module includes:
Raw data interface display unit, for entering in response to the triggering in the self-defined generation mode of described specially good effect, carries out the display at raw data interface；
Raw data acquiring unit, for obtaining described raw data according to the selection operation triggered in raw data interface；
Audio effect processing template acquiring unit, for carrying out calling of audio effect processing template according to the sound accompaniment specially good effect in described raw data, the described audio effect processing template called is once for exporting described sound accompaniment specially good effect；
Obtain the trigger element of voice data, when described raw data to be obtained and relevant audio effect processing template, trigger the acquisition carrying out voice data.
Device the most according to claim 6, it is characterised in that described acquisition module includes:
Interface display unit, the triggering for the self-defined generation mode in response to described specially good effect enters, and carries out the display at raw data interface；
Raw data and audio template acquiring unit, for triggering choosing of carrying out and obtain the raw data chosen and relevant audio effect processing template by being respectively directed to raw data and audio effect processing template in raw data interface；
Audio frequency obtains trigger element, when described raw data to be obtained and relevant audio effect processing template, triggers the acquisition carrying out voice data.
9. according to the device described in claim 7 or 8, it is characterised in that described device also includes:
Voice data acquisition module, for by obtaining described voice data to the collection of user voice signal.
Device the most according to claim 6, it is characterised in that described device also includes:
Time span acquisition module, for obtaining the time span of described audio frequency specially good effect；
Judge module, for judging whether the time span of the described audio frequency specially good effect display time span corresponding with described raw data is consistent, if it has not, then notice adjustment processing module；
Adjust processing module, be adjusted processing to described audio frequency specially good effect for the display time span corresponding according to described raw data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610375654.1A CN106028119B (en) | 2016-05-30 | 2016-05-30 | The customizing method and device of multimedia special efficacy |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610375654.1A CN106028119B (en) | 2016-05-30 | 2016-05-30 | The customizing method and device of multimedia special efficacy |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106028119A true CN106028119A (en) | 2016-10-12 |
| CN106028119B CN106028119B (en) | 2019-07-19 |
Family
ID=57091770
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610375654.1A Active CN106028119B (en) | 2016-05-30 | 2016-05-30 | The customizing method and device of multimedia special efficacy |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106028119B (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107360160A (en) * | 2017-07-12 | 2017-11-17 | 广州华多网络科技有限公司 | live video and animation fusion method, device and terminal device |
| CN107895394A (en) * | 2017-11-17 | 2018-04-10 | 中国平安财产保险股份有限公司 | Animation effect implementation method, device, terminal device and storage medium |
| CN108124101A (en) * | 2017-12-18 | 2018-06-05 | 北京奇虎科技有限公司 | Video capture method, device, electronic equipment and computer readable storage medium |
| CN109347971A (en) * | 2018-11-12 | 2019-02-15 | 徐豪杰 | A kind of shared master of ceremonies's Service Operation method and system |
| CN111243632A (en) * | 2020-01-02 | 2020-06-05 | 北京达佳互联信息技术有限公司 | Multimedia resource generation method, device, equipment and storage medium |
| CN111835986A (en) * | 2020-07-09 | 2020-10-27 | 腾讯科技（深圳）有限公司 | Video editing processing method and device and electronic equipment |
| CN114866791A (en) * | 2022-03-31 | 2022-08-05 | 北京达佳互联信息技术有限公司 | Sound effect switching method and device, electronic equipment and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060050140A1 (en) * | 2004-09-08 | 2006-03-09 | Jae-Gyoung Shin | Wireless communication terminal and its method for generating moving picture using still image |
| CN101046956A (en) * | 2006-03-28 | 2007-10-03 | 国际商业机器公司 | Interactive audio effect generating method and system |
| CN101072207A (en) * | 2007-06-22 | 2007-11-14 | 腾讯科技（深圳）有限公司 | Exchange method for instant messaging tool and instant messaging tool |
| CN104407893A (en) * | 2014-11-25 | 2015-03-11 | 广州酷狗计算机科技有限公司 | Animation displaying method and device |
| CN104836979A (en) * | 2014-03-17 | 2015-08-12 | 腾讯科技（北京）有限公司 | Information interaction method and device |
| CN105208056A (en) * | 2014-06-18 | 2015-12-30 | 腾讯科技（深圳）有限公司 | Information exchange method and terminal |
-
2016
- 2016-05-30 CN CN201610375654.1A patent/CN106028119B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060050140A1 (en) * | 2004-09-08 | 2006-03-09 | Jae-Gyoung Shin | Wireless communication terminal and its method for generating moving picture using still image |
| CN101046956A (en) * | 2006-03-28 | 2007-10-03 | 国际商业机器公司 | Interactive audio effect generating method and system |
| CN101072207A (en) * | 2007-06-22 | 2007-11-14 | 腾讯科技（深圳）有限公司 | Exchange method for instant messaging tool and instant messaging tool |
| CN104836979A (en) * | 2014-03-17 | 2015-08-12 | 腾讯科技（北京）有限公司 | Information interaction method and device |
| CN105208056A (en) * | 2014-06-18 | 2015-12-30 | 腾讯科技（深圳）有限公司 | Information exchange method and terminal |
| CN104407893A (en) * | 2014-11-25 | 2015-03-11 | 广州酷狗计算机科技有限公司 | Animation displaying method and device |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107360160A (en) * | 2017-07-12 | 2017-11-17 | 广州华多网络科技有限公司 | live video and animation fusion method, device and terminal device |
| CN107895394A (en) * | 2017-11-17 | 2018-04-10 | 中国平安财产保险股份有限公司 | Animation effect implementation method, device, terminal device and storage medium |
| CN107895394B (en) * | 2017-11-17 | 2021-03-30 | 中国平安财产保险股份有限公司 | Animation special effect implementation method and device, terminal equipment and storage medium |
| CN108124101A (en) * | 2017-12-18 | 2018-06-05 | 北京奇虎科技有限公司 | Video capture method, device, electronic equipment and computer readable storage medium |
| CN109347971A (en) * | 2018-11-12 | 2019-02-15 | 徐豪杰 | A kind of shared master of ceremonies's Service Operation method and system |
| CN111243632A (en) * | 2020-01-02 | 2020-06-05 | 北京达佳互联信息技术有限公司 | Multimedia resource generation method, device, equipment and storage medium |
| CN111243632B (en) * | 2020-01-02 | 2022-06-24 | 北京达佳互联信息技术有限公司 | Multimedia resource generation method, device, equipment and storage medium |
| US11557322B2 (en) | 2020-01-02 | 2023-01-17 | Beijing Dajia Internet Information Technology Co., Ltd. | Method and device for generating multimedia resource |
| CN111835986A (en) * | 2020-07-09 | 2020-10-27 | 腾讯科技（深圳）有限公司 | Video editing processing method and device and electronic equipment |
| CN111835986B (en) * | 2020-07-09 | 2021-08-24 | 腾讯科技（深圳）有限公司 | Video editing processing method and device and electronic equipment |
| CN114866791A (en) * | 2022-03-31 | 2022-08-05 | 北京达佳互联信息技术有限公司 | Sound effect switching method and device, electronic equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106028119B (en) | 2019-07-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106028119A (en) | Multimedia special effect customizing method and device | |
| JP6484605B2 (en) | Automatic multi-channel music mix from multiple audio stems | |
| US8917972B2 (en) | Modifying audio in an interactive video using RFID tags | |
| JPH09500747A (en) | Computer controlled virtual environment with acoustic control | |
| JP2000081886A (en) | Sound/video simulator | |
| WO2009040372A1 (en) | Technique for allowing the modification of the audio characteristics of items appearing in an interactive video using rfid tags | |
| JP2007027846A (en) | Moving picture reproduction system and moving picture reproduction method | |
| Pauletto | The voice delivers the threats, Foley delivers the punch: Embodied knowledge in Foley artistry | |
| US20220345842A1 (en) | Impulse response generation system and method | |
| JP2009530680A (en) | Audio processing and equipment | |
| JP2010140278A (en) | Voice information visualization device and program | |
| Beggs et al. | Designing web audio | |
| JP2008217447A (en) | Content generation device and content generation program | |
| WO2017061278A1 (en) | Signal processing device, signal processing method, and computer program | |
| JP2006254187A (en) | Acoustic field determining method and device | |
| CN108140370A (en) | Signal handling equipment, signal processing method and computer program | |
| US6744487B2 (en) | Producing a soundtrack for moving picture sequences | |
| JP2005173080A (en) | Music reproducing apparatus | |
| CN111696566B (en) | Voice processing method, device and medium | |
| JP2006217183A (en) | Data processor and program for generating multimedia data | |
| CN105979468A (en) | Audio frequency processing method and device | |
| CN105827829A (en) | Reception method and electronic equipment | |
| JP2004266746A (en) | Image and voice communication system | |
| Kokoras | Strategies for the creation of spatial audio in electroacoustic music | |
| Wilkins | From voice-body to sound-body: A phenomenological approach to the voice |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |