CN106028119B - The customizing method and device of multimedia special efficacy - Google Patents

The customizing method and device of multimedia special efficacy Download PDF

Info

Publication number
CN106028119B
CN106028119B CN201610375654.1A CN201610375654A CN106028119B CN 106028119 B CN106028119 B CN 106028119B CN 201610375654 A CN201610375654 A CN 201610375654A CN 106028119 B CN106028119 B CN 106028119B
Authority
CN
China
Prior art keywords
special efficacy
audio
raw data
customized
multimedia
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201610375654.1A
Other languages
Chinese (zh)
Other versions
CN106028119A (en
Inventor
徐文波
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to CN201610375654.1A priority Critical patent/CN106028119B/en
Publication of CN106028119A publication Critical patent/CN106028119A/en
Application granted granted Critical
Publication of CN106028119B publication Critical patent/CN106028119B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/435Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
    • H04N21/4355Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream involving reformatting operations of additional data, e.g. HTML pages on a television screen
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81Monomedia components thereof
    • H04N21/8106Monomedia components thereof involving special audio data, e.g. different tracks for different languages

Abstract

The invention discloses a kind of customizing methods of multimedia special efficacy, including listen to customized special efficacy instruction, and enter the customized generation mode of special efficacy according to the customized special efficacy instruction;Raw data and relevant audio effect processing template are obtained, and obtains audio data;Real-time audio effect processing is carried out to the audio data by the audio processing template and generates audio special efficacy;The audio special efficacy and the raw data are synthesized, customized multimedia special efficacy is generated.In addition, the present invention also provides a kind of customized devices of multimedia special efficacy to match with this method.The customizing method and device of above-mentioned multimedia special efficacy improve the adaptability and specific aim of multimedia special efficacy.

Description

The customizing method and device of multimedia special efficacy
Technical field
The present invention relates to multimedia application technical field, in particular to a kind of the customizing method and dress of multimedia special efficacy It sets.
Background technique
In recent years, with the rapid development of internet technology, including entertaining online and numerous true man including game live streaming Elegant Internet application has obtained unprecedented development.User can issue instant video by above-mentioned reality TV show Internet application, into Row reality TV show performance is shown from the ability in sing and dance, explanation etc..
Currently, user during issuing instant video, can interact with spectators, for example, interaction can pass through hair The mode of multimedia special efficacy (for example, the special video effect for having voice) is sent to realize.User is usually to open instant video application Special efficacy window chooses a multimedia special efficacy, so that in the video pictures shown in video clip in complementary multimedia special efficacy Special video effect, and play the sound accompaniment special efficacy in multimedia special efficacy.
But existing multimedia special efficacy, often by instant video using preset, provided multimedia special efficacy is simultaneously It can not be adapted to interaction content required for current instant video or user, so that the multimedia special efficacy in video lacks Weary specific aim.
Summary of the invention
Based on this, it is necessary to propose a kind of customizing method of multimedia special efficacy, this method can be improved multimedia special efficacy Adaptability and specific aim.
Additionally, it is necessary to propose a kind of customized device of multimedia special efficacy, which can be improved multimedia special efficacy Adaptability and specific aim.
A kind of customizing method of multimedia special efficacy, comprising:
Customized special efficacy instruction is listened to, and enters the customized generation mode of special efficacy according to the customized special efficacy instruction;
Raw data and relevant audio effect processing template are obtained, and triggers the acquisition for carrying out audio data;
Real-time audio effect processing is carried out to the audio data by the audio processing template and generates audio special efficacy;
The audio special efficacy and the raw data are synthesized, customized multimedia special efficacy is generated.
Further, the method, the acquisition raw data and relevant audio effect processing template, and obtain audio data The step of include:
Triggering in response to the customized generation mode of the special efficacy enters, and carries out the display at raw data interface;
The raw data is obtained according to the selection operation triggered in raw data interface;
The calling of audio effect processing template, the audio effect processing of calling are carried out according to the sound accompaniment special efficacy in the raw data Template is once used to export the sound accompaniment special efficacy;
When the raw data to be obtained and relevant audio effect processing template, triggering carries out the acquisition of audio data.
Further, the method, the acquisition raw data and relevant audio effect processing template, and obtain audio data The step of include:
Triggering in response to the customized generation mode of the special efficacy enters, and carries out the display at raw data interface;
It is selected by the selection carried out respectively for raw data and the triggering of audio effect processing template in raw data interface The raw data and relevant audio effect processing template taken;
When the raw data to be obtained and relevant audio effect processing template, triggering carries out the acquisition of audio data.
Further, the method, the raw data to be obtained and relevant audio effect processing template, triggering carry out audio After the step of acquisition of data, the method also includes:
The audio data is obtained by the acquisition to user voice signal.
Further, the method, it is described that real-time audio is carried out to the audio data by the audio processing template After processing generates the step of audio special efficacy, the method also includes:
Obtain the time span of the audio special efficacy;
Judge whether the time span of audio special efficacy display time span corresponding with the raw data is consistent;
If it has not, being then adjusted place to the audio special efficacy according to the corresponding display time span of the raw data Reason.
Further, the method, it is described that the audio special efficacy is synthesized into customized multimedia with the raw data The step of special efficacy includes:
Shield the sound accompaniment special efficacy in the raw data;
The audio special efficacy and the raw data are synthesized, customized multimedia special efficacy is generated.
Further, the method, the step that the audio special efficacy is synthesized to multimedia special efficacy with the special video effect After rapid, the method also includes:
Immediately the multimedia special efficacy is played, and sends the multimedia special efficacy;
After completing the multimedia special efficacy and sending, releases the masking operation of the sound accompaniment special efficacy and remove the audio spy Effect.
The present invention separately provides a kind of customized device of multimedia special efficacy, comprising:
Module is listened to, enters oneself of special efficacy for listening to customized special efficacy instruction, and according to the customized special efficacy instruction Define generation mode;
Module is obtained, for obtaining raw data and relevant audio effect processing template, and obtains audio data;
Processing module generates sound for carrying out real-time audio effect processing to the audio data by the audio processing template Frequency special efficacy;
Synthesis module generates customized multimedia special efficacy for synthesizing the audio special efficacy and the raw data.
Further, the device, the acquisition module include:
Raw data interface display unit enters for the triggering in the customized generation mode in response to the special efficacy, Carry out the display at raw data interface;
Raw data acquiring unit, for obtaining the original element according to the selection operation triggered in raw data interface Material;
Audio effect processing template acquiring unit, for carrying out audio effect processing template according to the sound accompaniment special efficacy in the raw data Calling, the audio effect processing template of calling is once used to export the sound accompaniment special efficacy;
The trigger unit of audio data is obtained, when being used for the raw data to be obtained and relevant audio effect processing template, Triggering carries out the acquisition of audio data.
Further, the device, the acquisition module include:
Interface display unit, the triggering for the customized generation mode in response to the special efficacy enter, and carry out original element The display at material interface;
Raw data and audio template acquiring unit, for by being directed to raw data and sound in raw data interface respectively It imitates the selection that processing template triggering carries out and obtains the raw data and relevant audio effect processing template chosen;
Audio obtain trigger unit, be used for the raw data to be obtained and relevant audio effect processing template when, trigger into The acquisition of row audio data.
Further, the device, described device further include:
Audio data obtains module, for obtaining the audio data by the acquisition to user voice signal.
Further, the device, described device further include:
Time span obtains module, for obtaining the time span of the audio special efficacy;
Judgment module, the time span display time corresponding with the raw data for judging the audio special efficacy are long Whether degree is consistent, if it has not, then notifying adjustment processing module;
Processing module is adjusted, for carrying out according to the corresponding display time span of the raw data to the audio special efficacy Adjustment processing.
Further, the device, the synthesis module include:
Screen unit, for shielding the sound accompaniment special efficacy in the raw data;
Synthesis unit generates customized for synthesizing the special video effect in the audio special efficacy and the raw data Multimedia special efficacy.
Further, the device, described device further include:
Broadcasting and sending module, for playing the multimedia special efficacy immediately, and send the multimedia special efficacy;
Recovery module, for releasing the masking operation of the sound accompaniment special efficacy simultaneously after completing the multimedia special efficacy and sending Remove the audio special efficacy.
Compared with prior art, the invention has the following beneficial effects:
In the customizing method of above-mentioned multimedia special efficacy, if necessary to special to load customized multimedia in video clip Effect can then listen to customized special efficacy instruction, and enter the customized generation mode of special efficacy according to the instruction of customized special efficacy, obtain former Beginning material and relevant audio effect processing template, and audio data is obtained, audio data is carried out by audio processing template real-time Audio effect processing generates audio special efficacy, audio special efficacy is synthesized to customized multimedia special efficacy with raw data, and sent, by This just realizes the generation of customized multimedia special efficacy in video distribution, improves the adaptability and specific aim of multimedia special efficacy.
In addition, with the device that the customizing method of above-mentioned multimedia special efficacy matches similarly there is the above method can reach The technical effect arrived.
Detailed description of the invention
Fig. 1 is the flow chart of multimedia special efficacy customizing method in one embodiment.
Fig. 2 is raw data and relevant audio effect processing template to be obtained in one embodiment, and obtain audio data method Flow chart.
Fig. 3 is raw data and relevant audio effect processing template to be obtained in another embodiment, and obtain audio data Method flow diagram.
Fig. 4 is the flow chart of multimedia special efficacy customizing method in another embodiment.
Fig. 5 is Composite tone special efficacy and the raw data in one embodiment, generates customized multimedia special efficacy Method flow diagram.
Fig. 6 is the flow chart of multimedia special efficacy customizing method in another embodiment.
Fig. 7 is the structural schematic diagram of the customized device of multimedia special efficacy in one embodiment.
Fig. 8 is the structural schematic diagram that module is obtained in one embodiment.
Fig. 9 is the structural schematic diagram that module is obtained in another embodiment.
Figure 10 is the structural schematic diagram of the customized device of multimedia special efficacy in another embodiment.
Figure 11 is the structural schematic diagram of synthesis module in one embodiment.
Figure 12 is the structural schematic diagram of the customized device of multimedia special efficacy in another embodiment.
Specific embodiment
The exemplary embodiment for embodying feature of present invention and advantage will describe in detail in the following description.It should be understood that The present invention can have various variations in different embodiments, neither depart from the scope of the present invention, and theory therein Bright and diagram inherently is illustrated as being used, rather than to limit the present invention.
Based on this, for the adaptability and specific aim for improving multimedia special efficacy, spy of the present invention proposes a kind of multimedia special efficacy The customizing method of customizing method, the multimedia special efficacy is realized by computer program, corresponding, constructed more matchmakers The customized device of body special efficacy is then stored in the terminal comprising Input/Output Device.
In one embodiment, specifically, as shown in Figure 1, a kind of customizing method of multimedia special efficacy, comprising:
Step 110, customized special efficacy instruction is listened to, and enters the customized generation mould of special efficacy according to the instruction of customized special efficacy Formula.
Customized special efficacy instruction, which can be to trigger in the video clip of publication instant video, to be generated, and is also possible to not issue It triggers and generates in function interface when instant video.
Video clip refers to containing the interface in video distribution region, for realizing special in the publication of video and video Imitate the manipulation of load.Multimedia special efficacy by triggering progress in video clip is customized to generate customized special efficacy instruction.
Customized special efficacy instruction is generated by the action event that user triggers, for example, user is by clicking in video clip Special efficacy custom button trigger the action event, at this point, will be responsive to the action event generates customized special efficacy instruction.From Special efficacy instruction is defined for triggering the customized generation mode into special efficacy.The customized generation mode of special efficacy will be different from video The directly selection and transmission of multimedia special efficacy can be for the videos of publication under the customized generation mode of special efficacy in interface Carry out the customized generation of multimedia special efficacy.
Under the customized generation mode of special efficacy, multimedia special efficacy preset in Video Applications can be modified, with life At the customized multimedia special efficacy that can adapt to the interaction content required for current video or user.
The action event for generating customized special efficacy instruction is listened to, it is customized to generate this under the triggering of the action event Special efficacy instruction enters the customized generation mode of special efficacy according to customized special efficacy instruction, with start the multimedia special efficacy from Definitim flow.
Step 130, raw data and relevant audio effect processing template are obtained, and obtains audio data.
The raw data can be that the material that Video Applications carry or the material being locally stored, the raw data can be Multimedia special efficacy, special video effect, picture etc., multimedia special efficacy can be the special video effect of special video effect or subsidiary audio special efficacy. In the customized generation mode of special efficacy, raw data is obtained to the selection operation of raw data by user.
Audio processing template is to be packaged with the template of at least one audio audio effect processing algorithm.The audio processing template is used for Audio effect processing is carried out to audio data and exports audio special efficacy (the audio special efficacy is the sound for including sound-content and sound effect Sound).The sound effect can be the effect being embodied in volume, tone and tone color, which is also possible to be embodied in increasing Add the effect of sound appeal, authenticity and entertainment, for example, environmental sound, musical instrument audio, animal sounds audio etc..
In the customized generation mode of special efficacy, which is the selection according to user to audio processing template Operation calls obtain or are called automatically by Video Applications to obtain.
The audio data of acquisition can be the audio data for implementing acquisition by audio collecting device, alternatively, passing through user The audio data in memory is obtained to the selection operation of audio data.
Step 150, real-time audio effect processing is carried out to audio data by audio processing template and generates audio special efficacy.
The audio effect processing include but is not limited to the equilibrium of audio data, the change of voice, echo, audio mixing, reverberation, fringing, trill, The processing such as distortion, and realized by audio processing template.
For example, the audio processing template can carry out voice change process to audio data, so that the audio processing template exports Different from another sound of the tone of original sound.For example, audio data before unprocessed, is the sound that human vocal band issues Sound becomes the effect of Robotics Sound after the processing of audio processing template.
Step 170, Composite tone special efficacy and raw data generate customized multimedia special efficacy.
The audio data that will acquire synthesizes customized multimedia special efficacy with raw data after audio effect processing.
For example, raw data is that (for example robot says that " I is an a machine for the voice of a robot animation and the robot People "), wherein the robot animation is special video effect, and the voice of robot is sound accompaniment special efficacy.Through audio template treated audio Special efficacy includes cheer " I is hornet ", then the audio special efficacy of " I is hornet " is synthesized this with the robot animation certainly The multimedia special efficacy of definition, the multimedia special efficacy show the robot animation in video clip, and play " I is hornet " Sound.
In another example raw data is that (for example robot says that " I is an a machine for the voice of a robot animation and the robot Device people "), wherein the robot animation is special video effect, and the voice of robot is sound accompaniment special efficacy.Pass through microphone input voice " I It is hornet ", audio effect processing template, which handles voice " I is hornet ", (has machine human hair for the effect of Robotics Sound Tone, volume and the tone color of sound), the audio special efficacy of " I is hornet " is synthesized into the customized multimedia with the robot animation Special efficacy.
In another example raw data is a Robotic Dynamic figure, pass through microphone input voice " I is robot ", audio Voice " I is robot " is handled the effect for Robotics Sound, and the audio special efficacy and machine of " I is robot " by processing template Device people's Dynamic Graph synthesizes the customized multimedia special efficacy.
As described above, can be made by oneself to the multimedia special efficacy in video distribution by technical solution as described above Justice configuration, user can be modified multimedia special efficacy existing in video clip according to the demand or hobby of itself, so that The customized multimedia special efficacy can adapt to the interaction content required for current video or user, so that video In media special efficacy have specific aim.
In another embodiment, as shown in Fig. 2, step 130 includes:
Step 131, enter in response to the triggering of the customized generation mode of special efficacy, carry out the display at raw data interface.
Multiple raw data are shown in raw data interface, multiple raw data can be shown with the pattern of list Show.
Step 133, raw data is obtained according to the selection operation triggered in raw data interface.
For the multiple raw data shown in raw data interface, the selection operation of one of raw data is carried out, To obtain corresponding raw data.For example, user clicks certain a raw data in raw data interface, this is accordingly obtained Raw data.
In this embodiment, the raw data of above-mentioned acquisition is multimedia special efficacy, i.e. the raw data includes special video effect With sound accompaniment special efficacy.For example, the raw data is that (for example robot is said for the sound accompaniment special efficacy of a robot animation and the robot " I is a robot "), wherein " I is a robot " that robot is said is sound accompaniment special efficacy, and the robot animation is special video effect.
Step 135, the calling of audio effect processing template, the audio effect processing of calling are carried out according to the sound accompaniment special efficacy in raw data Template is once used to export sound accompaniment special efficacy.
The sound accompaniment special efficacy is that special video effect is dubbed in raw data, is by being carried out by certain audio effect processing template What audio effect processing obtained.
The sound accompaniment data are the initial voice in raw data, for example, the voice of people, and sound accompaniment special efficacy is through at audio The acoustic information exported after reason resume module.For example, the voice to people carries out processing of changing voice, voice is treated as machine The effect of voice sound.
The audio effect processing template of sound accompaniment special efficacy is stored in locally-stored device, and the audio effect processing is called from locally-stored device Template is used to handle the audio data obtained, so that the audio data has and the sound accompaniment after audio effect processing template processing The identical sound effect of special efficacy.
In this embodiment, by calling once for exporting the audio effect processing template of sound accompaniment special efficacy in raw data, so that Through the audio effect processing template treated audio special efficacy closer to the special video effect in raw data, so that the customized multimedia The result of broadcast of special efficacy is more preferably.
Step 137, raw data to be obtained and when relevant audio effect processing template, triggering carries out the acquisition of audio data.
In another embodiment, as shown in figure 3, step 130 includes:
Step 132, enter in response to the triggering of the customized generation mode of special efficacy, carry out the display at raw data interface.
Show multiple raw data and multiple audio effect processing templates in raw data interface, multiple raw data and more A audio effect processing template can be shown in raw data interface with the pattern of list.
Step 134, the choosing by being carried out respectively for raw data and the triggering of audio effect processing template in raw data interface Take the raw data and relevant audio effect processing template for obtaining and choosing.
User respectively in raw data interface multiple raw data and multiple audio effect processing templates carry out selection operation, To obtain the raw data and audio effect processing template chosen.For example, user pass through it is original to some in raw data list Material carries out clicking operation and obtains the raw data being clicked;User passes through to some in audio effect processing template list Audio effect processing template carries out clicking operation and obtains the audio effect processing template being clicked.
Step 136, raw data to be obtained and when relevant audio effect processing template, triggering carries out the acquisition of audio data.
In another embodiment, described in the customized generation mode of special efficacy, obtain raw data and relevant audio Processing template, and after the step of triggering the acquisition of progress audio data, i.e., after step 137 or step 136, the above method Further include:
Audio data is obtained by the acquisition to user voice signal.
When raw data to be obtained and relevant audio effect processing template, the starting of audio collecting device, or triggering are triggered Corresponding prompt information is generated to prompt user to manually boot audio collecting device, is obtained with carrying out the acquisition of user voice signal Obtain corresponding audio data.The voice signal of user can will be obtained by the acquisition to user voice data and is blended into more matchmakers In body special efficacy, the interactive performance of computer system is improved.
In another embodiment, as shown in figure 4, carrying out audio effect processing to audio data by audio processing template generates sound After the step of frequency special efficacy, i.e., after step 150, the above method further include:
Step 310, the time span of audio special efficacy is obtained.
Step 330, judge whether the time span of audio special efficacy display time span corresponding with raw data is consistent, if Be it is no, 350 are thened follow the steps, if it has, then being not processed.
The corresponding display time span of raw data is preset, for example, when the raw data is special video effect, the view The display time span of frequency special efficacy be it is preset, it is changeless, when the time span of audio special efficacy is longer than the aobvious of special video effect When showing time span, it may appear that the case where special video effect and the asynchronous broadcasting of audio special efficacy, influence viewing effect.It therefore, need to be into One step judges whether the time span of audio special efficacy time span corresponding with raw data is consistent, if not being consistent, enters step Rapid 350.
Step 350, processing is adjusted to the audio special efficacy according to the corresponding time span of raw data.
According to the corresponding time span of raw data, for example, according to the display time span of special video effect in raw data, Processing is adjusted to the time span of audio special efficacy, for example, if the play time of the audio special efficacy is longer than the aobvious of special video effect Show the time, then quickening processing is carried out to the audio special efficacy.
In another embodiment, as shown in figure 5, step 170 includes:
Step 171, the sound accompaniment special efficacy in raw data is shielded.
In this embodiment, raw data is multimedia special efficacy, which includes special video effect and sound accompaniment special efficacy. Before the synthesis for state raw data and audio special efficacy, the included sound accompaniment special efficacy of shielding raw data makes the raw data In sound accompaniment special efficacy will not be played, but also the included sound accompaniment special efficacy of the raw data will not be replaced or delete.
Step 173, the special video effect in Composite tone special efficacy and the raw data, it is special to generate customized multimedia Effect.
After sound accompaniment special efficacy in raw data is shielded, special video effect is only played in raw data, by the special video effect with Audio special efficacy synthesizes customized multimedia special efficacy.
In another embodiment, as shown in fig. 6, audio special efficacy is synthesized with the special video effect in raw data customized After the step of multimedia special efficacy, the above method includes:
Step 410, multimedia special efficacy is played immediately, and sends multimedia special efficacy.
After synthesizing the customized multimedia special efficacy, the corresponding position in video clip carry out the multimedia special efficacy i.e. When play, being played simultaneously including special video effect and audio special efficacy.Wherein, the corresponding position in video clip refers to more matchmakers Body special efficacy mapped loading position itself.
After the broadcasting for completing the multimedia special efficacy, the transmission of the multimedia special efficacy is triggered, is sent for example, user clicks special efficacy Button, triggering generate special efficacy and send instruction, send instruction according to the special efficacy and send the multimedia special efficacy.
Alternatively, the multimedia special efficacy is sent immediately, in the broadcasting of multimedia special efficacy after completing the broadcasting of the multimedia special efficacy In the process, user can cancel the multimedia special efficacy.For example, pressing sound after user chooses raw data and audio effect processing template Sound obtains trigger button, and typing sound will be after the processing of audio effect processing template when user, which unclamps sound, obtains trigger button Audio special efficacy multimedia special efficacy is synthesized with raw data, and play immediately, after the broadcasting for completing the multimedia special efficacy, multimedia Special efficacy is sent immediately.Therefore, the present embodiment has the function of quickly generating, sends multimedia special efficacy.
Step 430, it after the transmission for completing multimedia special efficacy, releases the masking operation of sound accompaniment special efficacy and removes audio spy Effect.
After completing multimedia special effect play and sending, in order to make the customized multimedia special efficacy not cover original element Material, it is not necessary to save the customized multimedia special efficacy, but the raw data before restoring, the i.e. shielding of releasing sound accompaniment special efficacy are grasped Make and remove audio special efficacy so that user again to raw data carry out selection operation when be still systemic presupposition raw data.
In one embodiment, a kind of customized device of multimedia special efficacy has been also correspondingly provided, as shown in fig. 7, should Device includes listening to module 210, obtaining module 230, processing module 250 and synthesis module 270, in which:
Module 210 is listened to, enters making by oneself for special efficacy for listening to customized special efficacy instruction, and according to the instruction of customized special efficacy Adopted generation mode;
Module 230 is obtained, for obtaining raw data and relevant audio effect processing template, and obtains audio data;
Processing module 250, it is raw for carrying out real-time audio effect processing to the audio data by the audio processing template At audio special efficacy;
It is special to generate customized multimedia for synthesizing the audio special efficacy and the raw data for synthesis module 270 Effect.
In one embodiment, as shown in figure 8, above-mentioned acquisition module 230 include raw data interface display unit 231, Raw data acquiring unit 233, audio effect processing template acquiring unit 235 and the trigger unit 237 for obtaining audio data, in which:
Raw data interface display unit 231, for the triggering in the customized generation mode in response to the special efficacy into Enter, carries out the display at raw data interface;
Raw data acquiring unit 233 is described original for being obtained according to the selection operation triggered in raw data interface Material;
Audio effect processing template acquiring unit 235, for carrying out audio effect processing according to the sound accompaniment special efficacy in the raw data The audio effect processing template of the calling of template, calling is once used to export the sound accompaniment special efficacy;
The trigger unit 237 of audio data is obtained, the raw data to be obtained and relevant audio effect processing template are used for When, triggering carries out the acquisition of audio data.
In one embodiment, as shown in figure 9, above-mentioned acquisition module 230 includes interface display unit 232, raw data Trigger unit 236 is obtained with audio template acquiring unit 234 and audio, in which:
Interface display unit 232, the triggering for the customized generation mode in response to special efficacy enter, and carry out raw data The display at interface;
Raw data and audio template acquiring unit 234, for by being directed to raw data in raw data interface respectively The selection carried out with the triggering of audio effect processing template obtains the raw data and relevant audio effect processing template chosen;
Audio obtains trigger unit 236, when being used for the raw data to be obtained and relevant audio effect processing template, triggering Carry out the acquisition of audio data.
In one embodiment, the customized device of the multimedia special efficacy further includes that audio data obtains module, the audio Data acquisition module is used to obtain the audio data by the acquisition to user voice signal.
In one embodiment, as shown in Figure 10, the customized device of the multimedia special efficacy further includes that time span obtains Module 510, judgment module 530 and adjustment processing module 550, in which:
Time span obtains module 510, for obtaining the time span of the audio special efficacy;
Judgment module 530, when corresponding with the raw data display of time span for judging the audio special efficacy Between length whether be consistent, if it has not, then notify adjustment processing module 550;
Processing module 550 is adjusted, is used for according to the corresponding display time span of the raw data to the audio special efficacy It is adjusted processing.
In one embodiment, as shown in figure 11, synthesis module 270 includes screen unit 271 and synthesis unit 273, In:
Screen unit 271, for shielding the sound accompaniment special efficacy in the raw data;
Synthesis unit 273 generates customized multimedia special efficacy for Composite tone special efficacy and the raw data.
In one embodiment, as shown in figure 12, the customized device of the multimedia special efficacy further includes playing and sending mould Block 610 and recovery module 630, in which:
It plays with sending module 610, plays multimedia special efficacy for instant, and send multimedia special efficacy;
Recovery module 630, for releasing the masking operation of the sound accompaniment special efficacy after the completion of multimedia special effect play And remove the data cached of the audio special efficacy.
Those of ordinary skill in the art will appreciate that realizing that all or part of the steps of above-described embodiment can pass through hardware It completes, relevant hardware can also be instructed to complete by program, the program can store in a kind of computer-readable In storage medium, storage medium mentioned above can be read-only memory, disk or CD etc..
Although describing the present invention with reference to several exemplary embodiments, it is to be understood that, term used be explanation and Term exemplary, and not restrictive.Due to the present invention can be embodied in a variety of forms without departing from invention spirit or Essence, it should therefore be appreciated that above embodiment is not limited to any of the foregoing details, and should be defined by the appended claims The whole change and modification widely explained, therefore fallen into claim or its equivalent scope in spirit and scope all should be with Attached claim is covered.

Claims (6)

1. a kind of customizing method of multimedia special efficacy characterized by comprising
Customized special efficacy instruction is listened to, and enters the customized generation mode of special efficacy according to the customized special efficacy instruction;
Triggering in response to the customized generation mode of the special efficacy enters, and carries out the display at raw data interface;
The raw data is obtained according to the selection operation triggered in raw data interface;
The calling of audio effect processing template, the audio effect processing template of calling are carried out according to the sound accompaniment special efficacy in the raw data Once for exporting the sound accompaniment special efficacy;
When the raw data to be obtained and relevant audio effect processing template, triggering carries out the acquisition of audio data;
Real-time audio effect processing is carried out to the audio data by the audio processing template and generates audio special efficacy;
The audio special efficacy and the raw data are synthesized, customized multimedia special efficacy is generated.
2. the method according to claim 1, wherein the raw data to be obtained and relevant audio effect processing mould When plate, triggering carry out audio data acquisition the step of after, the method also includes:
The audio data is obtained by the acquisition to user voice signal.
3. the method according to claim 1, wherein it is described by the audio processing template to the audio number After carrying out the step of real-time audio effect processing generates audio special efficacy, the method also includes:
Obtain the time span of the audio special efficacy;
Judge whether the time span of audio special efficacy display time span corresponding with the raw data is consistent;
If it has not, being then adjusted processing to the audio special efficacy according to the corresponding display time span of the raw data.
4. a kind of customized device of multimedia special efficacy characterized by comprising
Module is listened to, enters the customized of special efficacy for listening to customized special efficacy instruction, and according to the customized special efficacy instruction Generation mode;
Raw data interface display unit enters for the triggering in the customized generation mode in response to the special efficacy, carries out The display at raw data interface;
Raw data acquiring unit, for obtaining the raw data according to the selection operation triggered in raw data interface;
Audio effect processing template acquiring unit, for carrying out the tune of audio effect processing template according to the sound accompaniment special efficacy in the raw data With the audio effect processing template of calling is once used to export the sound accompaniment special efficacy;
The trigger unit of audio data is obtained, when being used for the raw data to be obtained and relevant audio effect processing template, triggering Carry out the acquisition of audio data;
Processing module generates audio spy for carrying out real-time audio effect processing to the audio data by the audio processing template Effect;Synthesis module generates customized multimedia special efficacy for synthesizing the audio special efficacy and the raw data.
5. device according to claim 4, which is characterized in that described device further include:
Audio data obtains module, for obtaining the audio data by the acquisition to user voice signal.
6. device according to claim 4, which is characterized in that described device further include:
Time span obtains module, for obtaining the time span of the audio special efficacy;
Judgment module, the time span display time span corresponding with the raw data for judging the audio special efficacy are It is no to be consistent, if it has not, then notifying adjustment processing module;
Processing module is adjusted, for being adjusted according to the corresponding display time span of the raw data to the audio special efficacy Processing.
CN201610375654.1A 2016-05-30 2016-05-30 The customizing method and device of multimedia special efficacy Active CN106028119B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610375654.1A CN106028119B (en) 2016-05-30 2016-05-30 The customizing method and device of multimedia special efficacy

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610375654.1A CN106028119B (en) 2016-05-30 2016-05-30 The customizing method and device of multimedia special efficacy

Publications (2)

Publication Number Publication Date
CN106028119A CN106028119A (en) 2016-10-12
CN106028119B true CN106028119B (en) 2019-07-19

Family

ID=57091770

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610375654.1A Active CN106028119B (en) 2016-05-30 2016-05-30 The customizing method and device of multimedia special efficacy

Country Status (1)

Country Link
CN (1) CN106028119B (en)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107360160A (en) * 2017-07-12 2017-11-17 广州华多网络科技有限公司 live video and animation fusion method, device and terminal device
CN107895394B (en) * 2017-11-17 2021-03-30 中国平安财产保险股份有限公司 Animation special effect implementation method and device, terminal equipment and storage medium
CN108124101A (en) * 2017-12-18 2018-06-05 北京奇虎科技有限公司 Video capture method, device, electronic equipment and computer readable storage medium
CN109347971A (en) * 2018-11-12 2019-02-15 徐豪杰 A kind of shared master of ceremonies's Service Operation method and system
CN111243632B (en) * 2020-01-02 2022-06-24 北京达佳互联信息技术有限公司 Multimedia resource generation method, device, equipment and storage medium
CN111835986B (en) * 2020-07-09 2021-08-24 腾讯科技(深圳)有限公司 Video editing processing method and device and electronic equipment
CN114866791A (en) * 2022-03-31 2022-08-05 北京达佳互联信息技术有限公司 Sound effect switching method and device, electronic equipment and storage medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060050140A1 (en) * 2004-09-08 2006-03-09 Jae-Gyoung Shin Wireless communication terminal and its method for generating moving picture using still image
CN101046956A (en) * 2006-03-28 2007-10-03 国际商业机器公司 Interactive audio effect generating method and system
CN101072207A (en) * 2007-06-22 2007-11-14 腾讯科技(深圳)有限公司 Exchange method for instant messaging tool and instant messaging tool
CN104407893A (en) * 2014-11-25 2015-03-11 广州酷狗计算机科技有限公司 Animation displaying method and device
CN104836979A (en) * 2014-03-17 2015-08-12 腾讯科技(北京)有限公司 Information interaction method and device
CN105208056A (en) * 2014-06-18 2015-12-30 腾讯科技(深圳)有限公司 Information exchange method and terminal

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060050140A1 (en) * 2004-09-08 2006-03-09 Jae-Gyoung Shin Wireless communication terminal and its method for generating moving picture using still image
CN101046956A (en) * 2006-03-28 2007-10-03 国际商业机器公司 Interactive audio effect generating method and system
CN101072207A (en) * 2007-06-22 2007-11-14 腾讯科技(深圳)有限公司 Exchange method for instant messaging tool and instant messaging tool
CN104836979A (en) * 2014-03-17 2015-08-12 腾讯科技(北京)有限公司 Information interaction method and device
CN105208056A (en) * 2014-06-18 2015-12-30 腾讯科技(深圳)有限公司 Information exchange method and terminal
CN104407893A (en) * 2014-11-25 2015-03-11 广州酷狗计算机科技有限公司 Animation displaying method and device

Also Published As

Publication number Publication date
CN106028119A (en) 2016-10-12

Similar Documents

Publication Publication Date Title
CN106028119B (en) The customizing method and device of multimedia special efficacy
Sterne Space within space: Artificial reverb and the detachable echo
Stuart The object of performance: Aural performativity in contemporary laptop music
WO2009038225A1 (en) Contents reproducing device, and contents reproducing method
JP7465019B2 (en) Information processing device, information processing method, and information processing program
Pauletto The voice delivers the threats, Foley delivers the punch: Embodied knowledge in Foley artistry
CN112512649A (en) Techniques for providing audio and video effects
JP2010140278A (en) Voice information visualization device and program
US10440446B2 (en) Method for generating haptic coefficients using an autoregressive model, signal and device for reproducing such coefficients
CN108140370A (en) Signal handling equipment, signal processing method and computer program
JP2001517814A (en) Sound effect system
CN111696566B (en) Voice processing method, device and medium
US6744487B2 (en) Producing a soundtrack for moving picture sequences
CN105827829A (en) Reception method and electronic equipment
Wilkins From voice-body to sound-body: A phenomenological approach to the voice
CN105979468A (en) Audio frequency processing method and device
CN111696565B (en) Voice processing method, device and medium
CN111696564B (en) Voice processing method, device and medium
CN113318432B (en) Music control method in game, nonvolatile storage medium and electronic device
Heikkilä An ode to listening: sound diegesis and the perception of space in linear and non-linear narrative
Kokoras Strategies for the creation of spatial audio in electroacoustic music
De Man Audio Effects in Sound Design
CN117579767A (en) Virtual method for emotion appeal
Kinsley et al. Making Things Go Boom
Rochelle I Knew You Were Trouble: Digital Production in Pop Music and Its Implications for Performance

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant