CN103928039A - Video compositing method and device - Google Patents

Video compositing method and device Download PDF

Info

Publication number
CN103928039A
CN103928039A CN201410150722.5A CN201410150722A CN103928039A CN 103928039 A CN103928039 A CN 103928039A CN 201410150722 A CN201410150722 A CN 201410150722A CN 103928039 A CN103928039 A CN 103928039A
Authority
CN
China
Prior art keywords
media materials
time domain
synthetic
video
result
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201410150722.5A
Other languages
Chinese (zh)
Other versions
CN103928039B (en
Inventor
蒋金峰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing QIYI Century Science and Technology Co Ltd
Original Assignee
Beijing QIYI Century Science and Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing QIYI Century Science and Technology Co Ltd filed Critical Beijing QIYI Century Science and Technology Co Ltd
Priority to CN201410150722.5A priority Critical patent/CN103928039B/en
Publication of CN103928039A publication Critical patent/CN103928039A/en
Application granted granted Critical
Publication of CN103928039B publication Critical patent/CN103928039B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Television Signal Processing For Recording (AREA)

Abstract

The embodiment of the invention discloses a video compositing method and device. The video compositing method comprises the steps of receiving a video compositing request of a user; according to the video compositing request, determining media materials required by video compositing, display periods, corresponding to the media materials, in an expected compositing result, render effects corresponding to the media materials, and render periods corresponding to the render effects; according to determining results, generating time domain distribution information used for video compositing, wherein time domain distribution situations of the media materials in the expected compositing result, and time domain distribution situations of the render effects corresponding to the media materials in the expected compositing result are recorded in the distribution information; respectively decoding the media materials, and conducting compositing on decoding results of the medial materials according to the time domain distribution information. Thus, in a video, image and audio compositing process, corresponding effects can be added at the same time, time for video compositing is shortened, and user experience is promoted.

Description

A kind of image synthesizing method and device
Technical field
The present invention relates to technical field of video processing, particularly a kind of image synthesizing method and device.
Background technology
In these micro-bat epoch, people often utilize the mobile terminals such as mobile phone, panel computer to come capture video, picture or recording audio, carry out the dribs and drabs of writing task and life.People can also install the software with media materials editting function in mobile terminal, and the video of shooting, picture and the audio frequency recorded are synthesized to sound dynamic video, can also add to synthetic video various special efficacys.
Yet, media materials of the prior art software for editing, when video, picture and audio frequency are synthesized and add special efficacy, need to carry out respectively, first video, picture and audio frequency are synthesized, and then the video after synthetic is added to corresponding special efficacy, or first respectively video, picture and audio frequency are added to each self-corresponding special efficacy, then video, picture and the audio frequency after interpolation special efficacy synthesized, editing process is more loaded down with trivial details, need to expend the longer time, user experiences poor.
Summary of the invention
In order to address the above problem, the embodiment of the invention discloses a kind of image synthesizing method and device, shortened the synthetic required time of video, improved user's experience, concrete technical scheme is as follows:
An image synthesizing method, comprising:
Receive user's the synthetic request of video;
According to the synthetic request of described video, determine that the synthetic required media materials of video, each media materials are corresponding in the synthetic result of expectation and represent period, the corresponding render effects of each media materials and each render effects is corresponding plays up the period;
According to definite result, generate for the synthetic time domain distributed intelligence of video, in described time domain distributed intelligence, record: the time domain distribution situation of each media materials in the synthetic result of expectation and the render effects corresponding with each media materials time domain distribution situation in the synthetic result of expectation;
Respectively each media materials is decoded, and according to described time domain distributed intelligence, the decoded result of each media materials is synthesized, obtain synthetic result.
Preferably, described media materials comprises: audio file, video file and/or picture file.
Preferably, the method also comprises:
Described time domain distributed intelligence is showed to user;
Request is revised in the time domain distributed intelligence that receives user, according to this request, upgrades current time domain distributed intelligence;
Describedly according to described time domain distributed intelligence, the decoded result of each media materials is synthesized, obtain synthetic result, specific implementation is: according to the time domain distributed intelligence after upgrading, the decoded result of each media materials is synthesized, obtain synthetic result.
Preferably, represent the period and exist in overlapping situation each media materials is corresponding in the synthetic result of expectation, the described decoded result to each media materials synthesizes, and comprising:
The decoded result of each media materials is being carried out in synthetic process, represent the period overlapping, add transition special effective between decoded media materials.
Preferably, generate for after the synthetic time domain distributed intelligence of video, also comprise:
The special efficacy that receives user is added request;
According to described special efficacy, add request, determine the special efficacy of adding and the effect period corresponding to special efficacy of adding, and according to determined result, upgrade current time domain distributed intelligence;
Describedly according to described time domain distributed intelligence, the decoded result of each media materials is synthesized, obtain synthetic result, specific implementation is: according to the time domain distributed intelligence after upgrading, the decoded result of each media materials is synthesized, obtain synthetic result.
A video synthesizer, comprising:
Request receiving module, for receiving user's the synthetic request of video;
Information determination module, for according to the synthetic request of described video, determine that the synthetic required media materials of video, each media materials are corresponding in the synthetic result of expectation and represent period, the corresponding render effects of each media materials and each render effects is corresponding plays up the period;
Time domain distributed intelligence generation module, for basis, determine result, generate for the synthetic time domain distributed intelligence of video, in described time domain distributed intelligence, record: the time domain distribution situation of each media materials in the synthetic result of expectation and the render effects corresponding with each media materials time domain distribution situation in the synthetic result of expectation;
Synthesis module, for respectively each media materials being decoded, and according to described time domain distributed intelligence, synthesizes the decoded result of each media materials, obtains synthetic result.
Preferably, described media materials comprises: audio file, video file and/or picture file.
Preferably, this device also comprises:
Time domain distributed intelligence display module, for showing user by described time domain distributed intelligence;
The first update module, revises request for receiving user's time domain distributed intelligence, and upgrades current time domain distributed intelligence according to this request;
Described synthesis module, specifically for: respectively each media materials is decoded, and according to the time domain distributed intelligence after upgrading, the decoded result of each media materials is synthesized, obtain synthetic result.
Preferably, in described synthesis module, comprise that transition special effective adds submodule, for representing the period and exist in overlapping situation the synthetic result of expectation is corresponding at each media materials, the decoded result of each media materials is being carried out in synthetic process, represent the period overlapping, add transition special effective between decoded media materials.
Preferably, this device also comprises:
The second update module, adds request for receiving user's special efficacy, according to described special efficacy, adds request, determines the special efficacy of adding and the effect period corresponding to special efficacy of adding, and according to determined result, upgrades current time domain distributed intelligence;
Described synthesis module, specifically for: respectively each media materials is decoded, and according to the time domain distributed intelligence after upgrading, the decoded result of each media materials is synthesized, obtain synthetic result.
Application technique scheme, the embodiment of the present invention is being carried out video when synthetic, first determines that the synthetic required media materials of video, each media materials are corresponding in the synthetic result of expectation to represent period, the corresponding render effects of each media materials and each render effects is corresponding plays up the period; Then the time domain distributed intelligence synthetic according to definite result generating video, and according to this time domain distributed intelligence, media materials is merged, synthetic result obtained.Compared with prior art, the embodiment of the present invention is being carried out in synthetic process video, picture and audio frequency, can add corresponding special efficacy simultaneously, has shortened the synthetic required time of video, has improved user's experience.
Accompanying drawing explanation
In order to be illustrated more clearly in the embodiment of the present invention or technical scheme of the prior art, to the accompanying drawing of required use in embodiment or description of the Prior Art be briefly described below, apparently, accompanying drawing in the following describes is only some embodiments of the present invention, for those of ordinary skills, do not paying under the prerequisite of creative work, can also obtain according to these accompanying drawings other accompanying drawing.
The first process flow diagram of a kind of image synthesizing method that Fig. 1 a provides for the embodiment of the present invention;
Fig. 1 b is the schematic diagram of the time domain distributed intelligence that provides in embodiment as shown in Figure 1a;
Fig. 1 c is the schematic diagram of the orbit integration corresponding with Fig. 1 b;
Fig. 1 d is the schematic diagram of another orbit integration;
Fig. 1 e is the synthetic schematic diagram of a plurality of set rails;
The second process flow diagram of a kind of image synthesizing method that Fig. 2 provides for the embodiment of the present invention;
The third process flow diagram of a kind of image synthesizing method that Fig. 3 provides for the embodiment of the present invention;
The first structural representation of a kind of video synthesizer that Fig. 4 provides for the embodiment of the present invention;
The second structural representation of a kind of video synthesizer that Fig. 5 provides for the embodiment of the present invention;
The third structural representation of a kind of video synthesizer that Fig. 6 provides for the embodiment of the present invention.
Embodiment
First a kind of image synthesizing method embodiment of the present invention being provided describes, and the method can comprise:
Receive user's the synthetic request of video;
According to the synthetic request of described video, determine that the synthetic required media materials of video, each media materials are corresponding in the synthetic result of expectation and represent period, the corresponding render effects of each media materials and each render effects is corresponding plays up the period;
According to definite result, generate for the synthetic time domain distributed intelligence of video, in described time domain distributed intelligence, record: the time domain distribution situation of each media materials in the synthetic result of expectation and the render effects corresponding with each media materials time domain distribution situation in the synthetic result of expectation;
Respectively each media materials is decoded, and according to described time domain distributed intelligence, the decoded result of each media materials is synthesized, obtain synthetic result.
Application technique scheme, the embodiment of the present invention is being carried out video when synthetic, first determines that the synthetic required media materials of video, each media materials are corresponding in the synthetic result of expectation to represent period, the corresponding render effects of each media materials and each render effects is corresponding plays up the period; Then the time domain distributed intelligence synthetic according to definite result generating video, and according to this time domain distributed intelligence, media materials is merged, synthetic result obtained.Compared with prior art, the embodiment of the present invention is being carried out in synthetic process video, picture and audio frequency, can add corresponding special efficacy simultaneously, has shortened the synthetic required time of video, has improved user's experience.
In order to make those skilled in the art understand better the technical scheme in the present invention, below in conjunction with the accompanying drawing in the embodiment of the present invention, technical scheme in the embodiment of the present invention is clearly and completely described, obviously, described embodiment is only the present invention's part embodiment, rather than whole embodiment.Embodiment based in the present invention, those of ordinary skills, not making the every other embodiment obtaining under creative work prerequisite, belong to the scope of protection of the invention.
For the media materials such as video, picture and audio frequency are being carried out in synthetic process, can add the corresponding special efficacy of each media materials simultaneously, thereby shortened the synthetic required time of video, improved user and experience, the embodiment of the present invention provides a kind of image synthesizing method and device.
First a kind of image synthesizing method embodiment of the present invention being provided is below introduced.
It should be noted that, the image synthesizing method that the embodiment of the present invention provides is applicable in electronic equipment, and in actual applications, this electronic equipment can be: the mobile terminals such as mobile phone, panel computer.
As shown in Figure 1a, a kind of image synthesizing method, can comprise:
S101, receives user's the synthetic request of video.
" video is synthetic " of the present invention can be understood as a plurality of independently media materials are synthesized to one section of video according to time sequencing, such as one section of foreign film, one section of advertisement film clips, children's photo and one section of background music are synthesized to one section of video; Also can be understood as a plurality of independently media materials are added respectively special efficacy and merged according to time sequencing, synthetic one section of video, such as one section of foreign film being added to filter special efficacy, children's photo being added to gradual change special efficacy, background music is added to denoising special efficacy, and these three media materials are merged into one section of video.
Media materials in the embodiment of the present invention can be video, picture or audio frequency; Can be the material taken by user, also can be the material that derives from network, the embodiment of the present invention be not construed as limiting this.
When user need to synthesize the synthetic required media materials of video, can on client software, carry out corresponding solicit operation, such as clicking certain function button, carrying out certain menu option, or by some specific prompt operation, with the synthetic step of triggering following.Certainly user also can adopt other form, and the embodiment of the present invention is not construed as limiting this.
S102, according to the synthetic request of described video, determines that the synthetic required media materials of video, each media materials are corresponding in the synthetic result of expectation and represents period, the corresponding render effects of each media materials and each render effects is corresponding plays up the period.
Be understandable that, in the synthetic request of user's video, include following information: the synthetic required media materials of video, each media materials are corresponding in the synthetic result of expectation represents period, the corresponding render effects of each media materials and each render effects is corresponding plays up the period.After the synthetic request of the video that receives user, the embodiment of the present invention can, according to the synthetic request of this video, be determined the synthetic required above information of video of carrying out.
" the synthetic result of expectation " of the present invention is appreciated that as being synthesized by a plurality of media materials resulting one section of new video." representing the period " of the present invention can be understood as the time that each media materials occurs in this new video." playing up the period " of the present invention can be understood as the time that the corresponding special efficacy of each media materials occurs in new video.
Such as user wishes the synthetic such one section of new video of the music of the advertisement film clips of one section of duration 60s foreign film, one section of duration 30s, a children's photo and one section of duration 90s, 0~60s of new video plays this foreign film, this children's photo continues to float over the upper left corner of foreign film simultaneously, 60~90s of new video plays this advertisement film clips, in the whole playing process of new video, plays background music always.
As can be seen here, the represent period of foreign film in new video is exactly 0~60 second, the represent time of advertisement film clips in new video is exactly 60~90 seconds, and the represent period of children's photo in new video is exactly 0~60 second, and the represent time of background music in new video is exactly 0~90 second.
Still according to above-mentioned example, describe, such as user wishes to add the filter special efficacy of duration 20S in this foreign film, and wish to show this special efficacy in 20~40s of new video.As can be seen here, the play up period of filter special efficacy in new video is exactly 20~40s.
S103, according to definite result, generates for the synthetic time domain distributed intelligence of video.
In " time domain distributed intelligence " described in the embodiment of the present invention, record: the time domain distribution situation of each media materials in the synthetic result of expectation and the render effects corresponding with each media materials time domain distribution situation in the synthetic result of expectation.
For the ease of understanding, the angle that the time domain distributed intelligence that the embodiment of the present invention generates can be arranged from track is understood, and below in conjunction with Fig. 1 b, describes:
Video 1, video 2, picture and music are the synthetic required media materials of new video, wherein, the represent period of video 1 in new video is the 0th~the 60s, the represent period of video 2 in new video is the 60th~the 100s, the represent period of picture in new video is the 100th~the 130s, the corresponding special efficacy A of video 1 and special efficacy B, the corresponding special efficacy C of video 2, the corresponding special efficacy D of picture, the corresponding special efficacy E of music, the play up period of special efficacy A in new video is the 5th~the 18s, the play up period of special efficacy B in new video is the 30th~the 55s, the play up period of special efficacy C in new video is the 75th~the 90s, the play up period of special efficacy D in new video is the 105th~the 125s, the play up period of special efficacy E in new video is the 20th~the 60s.
According to above-mentioned temporal information, video 1, video 2, picture, music, special efficacy A, special efficacy B, special efficacy C, special efficacy D and special efficacy E are arranged according to time sequencing, generate time domain distributed intelligence.
S104, decodes to each media materials respectively, and according to described time domain distributed intelligence, the decoded result of each media materials is synthesized, and obtains synthetic result.
After generating time domain distributed intelligence, the embodiment of the present invention is decoded to each media materials respectively, Fig. 1 b of still take describes as example, respectively to video 1, video 2, after picture and music are decoded, according to the order shown in Fig. 1 b, first simultaneously displaying video 1 and music, while being played to 5s, add special efficacy A, while being played to 20s, add special efficacy E, while being played to 30s, add special efficacy B, while being played to 60s, video 1 is play and is finished, start displaying video 2, music continues to play, while being played to 75s, add special efficacy C, while being played to 100s, video 2 finishes, start playing pictures, music still continues to play, while being played to 105s, add special efficacy D, finally synthesize one section of new video.
In order to describe more intuitively video building-up process, the embodiment of the present invention is introduced the concept of track, " track " of the present invention is not the track in physical significance, can be understood as the corresponding track of video of one section of video, the corresponding picture track of one or more picture, one section of corresponding audio track of music here, also can be understood as one section of corresponding track of video of the video that comprises special efficacy, the corresponding picture track of one or more picture that comprises special efficacy, one section of corresponding audio track of the music that comprises special efficacy.After in order to narrate conveniently, by " track " referred to as " rail ".
Fig. 1 c of take is below specifically described as example, in Fig. 1 c, the music of describing the video that comprises special efficacy A, B 1 in Fig. 1 b, the video 2 that comprises special efficacy C, the picture that comprises special efficacy D and comprising special efficacy E with video track 1, video track 2, picture rail and audio track 1 respectively; Video track 1, video track 2, picture rail and audio track 1 are according to the synthetic one section of new video of time domain distributed intelligence, and this new video can be described with set track 1.
In Fig. 1 d, video track 2 and the synthetic one section of new video of audio track 2, this new video can be described with set track 2.
Be understandable that, synthetic new video can merge with other track again, as shown in Fig. 1 e, the set track 1 in Fig. 1 c, set track 2 can synthesize new video with video track 4, audio track 3 again, and this new video can be described with set track 3.
It should be noted that, the embodiment of the present invention has only been listed the situation of above several orbit integrations, but the present invention is not limited to above situation, can have a plurality of tracks to synthesize, and the embodiment of the present invention is not construed as limiting this.
In a specific embodiment of the present invention, represent the period and exist in overlapping situation each media materials is corresponding in the synthetic result of expectation, the described decoded result to each media materials synthesizes, and comprising:
The decoded result of each media materials is being carried out in synthetic process, represent the period overlapping, add transition special effective between decoded media materials.
Such as, the period that represents of video A is 0th~60s, the period that represents of video B is 40~100s, both periods that represents have overlappingly, need in video A and video B, add transition special effective, otherwise represent the overlapping period of period, video B can cover video A, and can't see the content of video A.
It should be noted that, the embodiment of the present invention is decoded to video, picture and music, obtain frame of video with audio frame, the corresponding special efficacy of the video single frames special efficacy corresponding from audio frequency single frames is different, that is to say that the special efficacy that video and picture are corresponding can be identical, special efficacy corresponding to special efficacy corresponding to music and video and special efficacy is different.
Application technique scheme, the embodiment of the present invention is being carried out video when synthetic, first determines that the synthetic required media materials of video, each media materials are corresponding in the synthetic result of expectation to represent period, the corresponding render effects of each media materials and each render effects is corresponding plays up the period; Then the time domain distributed intelligence synthetic according to definite result generating video, and according to this time domain distributed intelligence, media materials is merged, synthetic result obtained.Compared with prior art, the embodiment of the present invention is being carried out in synthetic process video, picture and audio frequency, can add corresponding special efficacy simultaneously, has shortened the synthetic required time of video, has improved user's experience.
In another embodiment of the present invention, as shown in Figure 2, a kind of image synthesizing method, can comprise:
S201, receives user's the synthetic request of video.
S202, according to the synthetic request of described video, determines that the synthetic required media materials of video, each media materials are corresponding in the synthetic result of expectation and represents period, the corresponding render effects of each media materials and each render effects is corresponding plays up the period.
S203, according to definite result, generates for the synthetic time domain distributed intelligence of video.
In time domain distributed intelligence described in the embodiment of the present invention, record: the time domain distribution situation of each media materials in the synthetic result of expectation and the render effects corresponding with each media materials time domain distribution situation in the synthetic result of expectation.
S204, shows user by described time domain distributed intelligence.
S205, request is revised in the time domain distributed intelligence that receives user, according to this request, upgrades current time domain distributed intelligence.
S206, decodes to each media materials respectively, and according to the time domain distributed intelligence after upgrading, the decoded result of each media materials is synthesized, and obtains synthetic result.
In embodiments of the present invention, S201, S202, S203 are identical with S101, S102, S103 in embodiment as shown in Figure 1a respectively, and the embodiment of the present invention repeats no more this.
In newly-increased S204, the embodiment of the present invention can show user by generated time domain distributed intelligence, to realize the synthetic visual edit of video.
In newly-increased S205, the embodiment of the present invention can receive user's time domain distributed intelligence and revise request, in Fig. 1 b, user wishes that first displaying video 2, video 2 finish afterwards displaying video 1 again, user can input time domain distributed intelligence and revise request, client software receives after this request, according to this request, upgrades current time domain distributed intelligence.
The embodiment of the present invention provides the interface that can carry out visual edit to user, and user can edit building-up process by this interface according to the actual requirements, to meet individual requirements.
In another embodiment of the present invention, as shown in Figure 3, a kind of image synthesizing method, can comprise:
S301, receives user's the synthetic request of video.
S302, according to the synthetic request of described video, determines that the synthetic required media materials of video, each media materials are corresponding in the synthetic result of expectation and represents period, the corresponding render effects of each media materials and each render effects is corresponding plays up the period.
S303, according to definite result, generates for the synthetic time domain distributed intelligence of video.
In time domain distributed intelligence described in the embodiment of the present invention, record: the time domain distribution situation of each media materials in the synthetic result of expectation and the render effects corresponding with each media materials time domain distribution situation in the synthetic result of expectation.
S304, the special efficacy that receives user is added request.
S305, adds request according to described special efficacy, determines the special efficacy of adding, and effect period corresponding to the special efficacy of adding, and according to determined result, upgrades current time domain distributed intelligence.
S306, decodes to each media materials respectively, and according to the time domain distributed intelligence after upgrading, the decoded result of each media materials is synthesized, and obtains synthetic result.
In embodiments of the present invention, S301, S302, S303 are identical with S101, S102, S103 in embodiment as shown in Figure 1a respectively, and the embodiment of the present invention repeats no more this.
In newly-increased S304, the embodiment of the present invention can receive user's special efficacy and add request, such as user wishes to add a new special efficacy F in the video 1 of Fig. 1 b, or in video 2, add a new special efficacy G, user can input at client software the request of corresponding interpolation special efficacy.
In newly-increased S305, after the special efficacy that receives user is added request, the embodiment of the present invention can receive this request, upgrades current time domain distributed intelligence.Such as user wishes to add a new special efficacy F in the video 1 of Fig. 1 b, can to client input, add the request of special efficacy F, client is determined playing up the period of special efficacy F and special efficacy F according to this request, upgrades afterwards time domain distributed intelligence.
The embodiment of the present invention provides one can in video building-up process, add the interface of special efficacy to user, and user can according to the actual requirements, add the special efficacy oneself needing, to meet individual requirements by this interface.
Corresponding to embodiment of the method above, the present invention also provides a kind of video synthesizer, and as shown in Figure 4, this device can comprise:
Request receiving module 401, for receiving user's the synthetic request of video;
Information determination module 402, for according to the synthetic request of described video, determine that the synthetic required media materials of video, each media materials are corresponding in the synthetic result of expectation and represent period, the corresponding render effects of each media materials and each render effects is corresponding plays up the period;
Time domain distributed intelligence generation module 403, for basis, determine result, generate for the synthetic time domain distributed intelligence of video, in described time domain distributed intelligence, record: the time domain distribution situation of each media materials in the synthetic result of expectation and the render effects corresponding with each media materials time domain distribution situation in the synthetic result of expectation;
Synthesis module 404, for respectively each media materials being decoded, and according to described time domain distributed intelligence, synthesizes the decoded result of each media materials, obtains synthetic result.
Application technique scheme, the embodiment of the present invention is being carried out video when synthetic, first determines that the synthetic required media materials of video, each media materials are corresponding in the synthetic result of expectation to represent period, the corresponding render effects of each media materials and each render effects is corresponding plays up the period; Then the time domain distributed intelligence synthetic according to definite result generating video, and according to this time domain distributed intelligence, media materials is merged, synthetic result obtained.Compared with prior art, the embodiment of the present invention is being carried out in synthetic process video, picture and audio frequency, can add corresponding special efficacy simultaneously, has shortened the synthetic required time of video, has improved user's experience.
Further, in described synthesis module 404, can comprise that transition special effective adds submodule, for representing the period and exist in overlapping situation the synthetic result of expectation is corresponding at each media materials, the decoded result of each media materials is being carried out in synthetic process, represent the period overlapping, add transition special effective between decoded media materials.
Further, the media materials described in the embodiment of the present invention can comprise: audio file, video file and/or picture file, the embodiment of the present invention is not restricted this.
In another embodiment of the present invention, as shown in Figure 5, a kind of video synthesizer, can comprise:
Request receiving module 501, for receiving user's the synthetic request of video;
Information determination module 502, for according to the synthetic request of described video, determine that the synthetic required media materials of video, each media materials are corresponding in the synthetic result of expectation and represent period, the corresponding render effects of each media materials and each render effects is corresponding plays up the period;
Time domain distributed intelligence generation module 503, for basis, determine result, generate for the synthetic time domain distributed intelligence of video, in described time domain distributed intelligence, record: the time domain distribution situation of each media materials in the synthetic result of expectation and the render effects corresponding with each media materials time domain distribution situation in the synthetic result of expectation;
Time domain distributed intelligence display module 504, for showing user by described time domain distributed intelligence;
The first update module 505, revises request for receiving user's time domain distributed intelligence, and upgrades current time domain distributed intelligence according to this request;
Synthesis module 506, for respectively each media materials being decoded, and according to the time domain distributed intelligence after upgrading, synthesizes the decoded result of each media materials, obtains synthetic result.
In another embodiment of the present invention, as shown in Figure 6, a kind of video synthesizer, can comprise:
Request receiving module 601, for receiving user's the synthetic request of video;
Information determination module 602, for according to the synthetic request of described video, determine that the synthetic required media materials of video, each media materials are corresponding in the synthetic result of expectation and represent period, the corresponding render effects of each media materials and each render effects is corresponding plays up the period;
Time domain distributed intelligence generation module 603, for basis, determine result, generate for the synthetic time domain distributed intelligence of video, in described time domain distributed intelligence, record: the time domain distribution situation of each media materials in the synthetic result of expectation and the render effects corresponding with each media materials time domain distribution situation in the synthetic result of expectation;
The second update module 604, adds request for receiving user's special efficacy, according to described special efficacy, adds request, determines the special efficacy of adding and the effect period corresponding to special efficacy of adding, and according to determined result, upgrades current time domain distributed intelligence;
Synthesis module 605, for respectively each media materials being decoded, and according to the time domain distributed intelligence after upgrading, synthesizes the decoded result of each media materials, obtains synthetic result.
For device embodiment, because it is substantially similar in appearance to embodiment of the method, so description is fairly simple, relevant part is referring to the part explanation of embodiment of the method.
While for convenience of description, describing above device, with function, being divided into various modules describes respectively.Certainly, when enforcement is of the present invention, the function of each module can be realized in same or a plurality of software and/or hardware.
It should be noted that, in this article, relational terms such as the first and second grades is only used for an entity or operation to separate with another entity or operational zone, and not necessarily requires or imply and between these entities or operation, have the relation of any this reality or sequentially.And, term " comprises ", " comprising " or its any other variant are intended to contain comprising of nonexcludability, thereby the process, method, article or the equipment that make to comprise a series of key elements not only comprise those key elements, but also comprise other key elements of clearly not listing, or be also included as the intrinsic key element of this process, method, article or equipment.The in the situation that of more restrictions not, the key element being limited by statement " comprising ... ", and be not precluded within process, method, article or the equipment that comprises described key element and also have other identical element.
Each embodiment in this instructions all adopts relevant mode to describe, between each embodiment identical similar part mutually referring to, each embodiment stresses is the difference with other embodiment.Especially, for device embodiment, because it is substantially similar in appearance to embodiment of the method, so description is fairly simple, relevant part is referring to the part explanation of embodiment of the method.
One of ordinary skill in the art will appreciate that all or part of step realizing in said method embodiment is to come the hardware that instruction is relevant to complete by program, described program can be stored in computer read/write memory medium, here alleged storage medium, as: ROM/RAM, magnetic disc, CD etc.
The foregoing is only preferred embodiment of the present invention, be not intended to limit protection scope of the present invention.All any modifications of doing within the spirit and principles in the present invention, be equal to replacement, improvement etc., be all included in protection scope of the present invention.

Claims (10)

1. an image synthesizing method, is characterized in that, the method comprises:
Receive user's the synthetic request of video;
According to the synthetic request of described video, determine that the synthetic required media materials of video, each media materials are corresponding in the synthetic result of expectation and represent period, the corresponding render effects of each media materials and each render effects is corresponding plays up the period;
According to definite result, generate for the synthetic time domain distributed intelligence of video, in described time domain distributed intelligence, record: the time domain distribution situation of each media materials in the synthetic result of expectation and the render effects corresponding with each media materials time domain distribution situation in the synthetic result of expectation;
Respectively each media materials is decoded, and according to described time domain distributed intelligence, the decoded result of each media materials is synthesized, obtain synthetic result.
2. method according to claim 1, is characterized in that, described media materials comprises: audio file, video file and/or picture file.
3. method according to claim 1, is characterized in that, the method also comprises:
Described time domain distributed intelligence is showed to user;
Request is revised in the time domain distributed intelligence that receives user, according to this request, upgrades current time domain distributed intelligence;
Describedly according to described time domain distributed intelligence, the decoded result of each media materials is synthesized, obtain synthetic result, specific implementation is: according to the time domain distributed intelligence after upgrading, the decoded result of each media materials is synthesized, obtain synthetic result.
4. method according to claim 1, is characterized in that, represents the period and exists in overlapping situation each media materials is corresponding in the synthetic result of expectation, and the described decoded result to each media materials synthesizes, and comprising:
The decoded result of each media materials is being carried out in synthetic process, represent the period overlapping, add transition special effective between decoded media materials.
5. method according to claim 1, is characterized in that, generates for after the synthetic time domain distributed intelligence of video, also comprises:
The special efficacy that receives user is added request;
According to described special efficacy, add request, determine the special efficacy of adding and the effect period corresponding to special efficacy of adding, and according to determined result, upgrade current time domain distributed intelligence;
Describedly according to described time domain distributed intelligence, the decoded result of each media materials is synthesized, obtain synthetic result, specific implementation is: according to the time domain distributed intelligence after upgrading, the decoded result of each media materials is synthesized, obtain synthetic result.
6. a video synthesizer, is characterized in that, this device comprises:
Request receiving module, for receiving user's the synthetic request of video;
Information determination module, for according to the synthetic request of described video, determine that the synthetic required media materials of video, each media materials are corresponding in the synthetic result of expectation and represent period, the corresponding render effects of each media materials and each render effects is corresponding plays up the period;
Time domain distributed intelligence generation module, for basis, determine result, generate for the synthetic time domain distributed intelligence of video, in described time domain distributed intelligence, record: the time domain distribution situation of each media materials in the synthetic result of expectation and the render effects corresponding with each media materials time domain distribution situation in the synthetic result of expectation;
Synthesis module, for respectively each media materials being decoded, and according to described time domain distributed intelligence, synthesizes the decoded result of each media materials, obtains synthetic result.
7. device according to claim 6, is characterized in that, described media materials comprises: audio file, video file and/or picture file.
8. device according to claim 6, is characterized in that, this device also comprises:
Time domain distributed intelligence display module, for showing user by described time domain distributed intelligence;
The first update module, revises request for receiving user's time domain distributed intelligence, and upgrades current time domain distributed intelligence according to this request;
Described synthesis module, specifically for: respectively each media materials is decoded, and according to the time domain distributed intelligence after upgrading, the decoded result of each media materials is synthesized, obtain synthetic result.
9. device according to claim 6, it is characterized in that, in described synthesis module, comprise that transition special effective adds submodule, for representing the period and exist in overlapping situation the synthetic result of expectation is corresponding at each media materials, the decoded result of each media materials is being carried out in synthetic process, represent the period overlapping, add transition special effective between decoded media materials.
10. device according to claim 6, is characterized in that, this device also comprises:
The second update module, adds request for receiving user's special efficacy, according to described special efficacy, adds request, determines the special efficacy of adding and the effect period corresponding to special efficacy of adding, and according to determined result, upgrades current time domain distributed intelligence;
Described synthesis module, specifically for: respectively each media materials is decoded, and according to the time domain distributed intelligence after upgrading, the decoded result of each media materials is synthesized, obtain synthetic result.
CN201410150722.5A 2014-04-15 2014-04-15 A kind of image synthesizing method and device Active CN103928039B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201410150722.5A CN103928039B (en) 2014-04-15 2014-04-15 A kind of image synthesizing method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410150722.5A CN103928039B (en) 2014-04-15 2014-04-15 A kind of image synthesizing method and device

Publications (2)

Publication Number Publication Date
CN103928039A true CN103928039A (en) 2014-07-16
CN103928039B CN103928039B (en) 2016-09-21

Family

ID=51146236

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410150722.5A Active CN103928039B (en) 2014-04-15 2014-04-15 A kind of image synthesizing method and device

Country Status (1)

Country Link
CN (1) CN103928039B (en)

Cited By (34)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104144301A (en) * 2014-07-30 2014-11-12 厦门美图之家科技有限公司 Method for transition special effects on basis of mixed modes
CN105354219A (en) * 2015-09-28 2016-02-24 努比亚技术有限公司 File encoding method and apparatus
CN105516618A (en) * 2014-09-27 2016-04-20 北京金山安全软件有限公司 Method and device for making video and communication terminal
CN105681891A (en) * 2016-01-28 2016-06-15 杭州秀娱科技有限公司 Mobile terminal used method for embedding user video in scene
WO2016124095A1 (en) * 2015-02-04 2016-08-11 腾讯科技(深圳)有限公司 Video generation method, apparatus and terminal
CN106331869A (en) * 2015-06-29 2017-01-11 北京金山安全软件有限公司 Video-based picture re-editing method and device
CN106331849A (en) * 2016-09-14 2017-01-11 北京金山安全软件有限公司 Video image processing method and device and electronic equipment
CN106851385A (en) * 2017-02-20 2017-06-13 北京金山安全软件有限公司 Video recording method and device and electronic equipment
CN107566769A (en) * 2017-09-27 2018-01-09 维沃移动通信有限公司 A kind of video recording method and mobile terminal
CN107786876A (en) * 2017-09-21 2018-03-09 北京达佳互联信息技术有限公司 The synchronous method of music and video, device and mobile terminal
CN107888963A (en) * 2017-10-27 2018-04-06 北京雷石天地电子技术有限公司 Method and system based on rhythm synthetic video
CN108388434A (en) * 2018-02-08 2018-08-10 北京市商汤科技开发有限公司 The generation of special efficacy program file packet and special efficacy generation method and device, electronic equipment
CN108471554A (en) * 2017-02-23 2018-08-31 合网络技术(北京)有限公司 Multimedia resource synthetic method and device
CN108810597A (en) * 2018-06-25 2018-11-13 百度在线网络技术(北京)有限公司 Special video effect processing method and processing device
CN109492577A (en) * 2018-11-08 2019-03-19 北京奇艺世纪科技有限公司 A kind of gesture identification method, device and electronic equipment
WO2019057202A1 (en) * 2017-09-25 2019-03-28 北京达佳互联信息技术有限公司 Special effect synchronization method and apparatus, and mobile terminal
CN109697060A (en) * 2018-12-29 2019-04-30 广州华多网络科技有限公司 Special video effect software and its generation method, device, equipment and storage medium
WO2019086037A1 (en) * 2017-11-06 2019-05-09 腾讯科技(深圳)有限公司 Video material processing method, video synthesis method, terminal device and storage medium
CN109963166A (en) * 2017-12-22 2019-07-02 上海全土豆文化传播有限公司 Online Video edit methods and device
CN110309351A (en) * 2018-02-14 2019-10-08 阿里巴巴集团控股有限公司 Video image generation, device and the computer system of data object
CN110691276A (en) * 2019-11-06 2020-01-14 北京字节跳动网络技术有限公司 Method and device for splicing multimedia segments, mobile terminal and storage medium
WO2020077854A1 (en) * 2018-10-19 2020-04-23 北京微播视界科技有限公司 Video generation method and device, electronic device and computer storage medium
CN111083396A (en) * 2019-12-26 2020-04-28 北京奇艺世纪科技有限公司 Video synthesis method and device, electronic equipment and computer-readable storage medium
CN111225232A (en) * 2018-11-23 2020-06-02 北京字节跳动网络技术有限公司 Video-based sticker animation engine, realization method, server and medium
CN111417015A (en) * 2020-04-22 2020-07-14 永城职业学院 Method for synthesizing computer video
CN111491205A (en) * 2020-04-17 2020-08-04 维沃移动通信有限公司 Video processing method and device and electronic equipment
CN111866609A (en) * 2019-04-08 2020-10-30 百度(美国)有限责任公司 Method and apparatus for generating video
CN111866585A (en) * 2020-06-22 2020-10-30 北京美摄网络科技有限公司 Video processing method and device
WO2021189995A1 (en) * 2020-03-24 2021-09-30 北京达佳互联信息技术有限公司 Video rendering method and apparatus, electronic device, and storage medium
CN113473178A (en) * 2021-06-30 2021-10-01 北京百度网讯科技有限公司 Video processing method and device, electronic equipment and computer readable storage medium
WO2022213801A1 (en) * 2021-04-09 2022-10-13 北京字跳网络技术有限公司 Video processing method, apparatus, and device
CN115278306A (en) * 2022-06-20 2022-11-01 阿里巴巴(中国)有限公司 Video editing method and device
US11521389B2 (en) 2018-01-19 2022-12-06 Beijing Sensetime Technology Development Co., Ltd. Method for generating special effect program file package, method for generating special effect, electronic device, and storage medium
CN115278306B (en) * 2022-06-20 2024-05-31 阿里巴巴(中国)有限公司 Video editing method and device

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004164668A (en) * 2004-01-16 2004-06-10 Matsushita Electric Ind Co Ltd Image generation device and image generation method
CN102572300A (en) * 2010-12-31 2012-07-11 新奥特(北京)视频技术有限公司 Video special-effect synthetizing method of flow chart mode
CN102638658A (en) * 2012-03-01 2012-08-15 盛乐信息技术(上海)有限公司 Method and system for editing audio-video
CN102917174A (en) * 2011-08-04 2013-02-06 深圳光启高等理工研究院 Video synthesis method and system applied to electronic equipment
CN103679782A (en) * 2013-12-24 2014-03-26 邢刚 Low-cost civil synthetic method for movie and television special effects

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102842323A (en) * 2012-09-13 2012-12-26 北京富年科技有限公司 Mobile terminal and video scoring method applied to mobile terminal

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004164668A (en) * 2004-01-16 2004-06-10 Matsushita Electric Ind Co Ltd Image generation device and image generation method
CN102572300A (en) * 2010-12-31 2012-07-11 新奥特(北京)视频技术有限公司 Video special-effect synthetizing method of flow chart mode
CN102917174A (en) * 2011-08-04 2013-02-06 深圳光启高等理工研究院 Video synthesis method and system applied to electronic equipment
CN102638658A (en) * 2012-03-01 2012-08-15 盛乐信息技术(上海)有限公司 Method and system for editing audio-video
CN103679782A (en) * 2013-12-24 2014-03-26 邢刚 Low-cost civil synthetic method for movie and television special effects

Cited By (49)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104144301A (en) * 2014-07-30 2014-11-12 厦门美图之家科技有限公司 Method for transition special effects on basis of mixed modes
CN105516618A (en) * 2014-09-27 2016-04-20 北京金山安全软件有限公司 Method and device for making video and communication terminal
US10200634B2 (en) 2015-02-04 2019-02-05 Tencent Technology (Shenzhen) Company Limited Video generation method, apparatus and terminal
WO2016124095A1 (en) * 2015-02-04 2016-08-11 腾讯科技(深圳)有限公司 Video generation method, apparatus and terminal
CN106331869A (en) * 2015-06-29 2017-01-11 北京金山安全软件有限公司 Video-based picture re-editing method and device
CN106331869B (en) * 2015-06-29 2019-10-29 北京金山安全软件有限公司 Video-based picture re-editing method and device
CN105354219A (en) * 2015-09-28 2016-02-24 努比亚技术有限公司 File encoding method and apparatus
CN105681891A (en) * 2016-01-28 2016-06-15 杭州秀娱科技有限公司 Mobile terminal used method for embedding user video in scene
CN106331849A (en) * 2016-09-14 2017-01-11 北京金山安全软件有限公司 Video image processing method and device and electronic equipment
CN106851385A (en) * 2017-02-20 2017-06-13 北京金山安全软件有限公司 Video recording method and device and electronic equipment
CN106851385B (en) * 2017-02-20 2019-12-27 北京乐我无限科技有限责任公司 Video recording method and device and electronic equipment
CN108471554A (en) * 2017-02-23 2018-08-31 合网络技术(北京)有限公司 Multimedia resource synthetic method and device
CN107786876A (en) * 2017-09-21 2018-03-09 北京达佳互联信息技术有限公司 The synchronous method of music and video, device and mobile terminal
US10971189B2 (en) 2017-09-25 2021-04-06 Bejing Dajia Internet Information Technology Co., Ltd Special effect synchronization method and apparatus, and mobile terminal
US11355157B2 (en) 2017-09-25 2022-06-07 Beijing Dajia Internet Information Technology Co., Ltd. Special effect synchronization method and apparatus, and mobile terminal
WO2019057202A1 (en) * 2017-09-25 2019-03-28 北京达佳互联信息技术有限公司 Special effect synchronization method and apparatus, and mobile terminal
CN107566769A (en) * 2017-09-27 2018-01-09 维沃移动通信有限公司 A kind of video recording method and mobile terminal
CN107888963A (en) * 2017-10-27 2018-04-06 北京雷石天地电子技术有限公司 Method and system based on rhythm synthetic video
CN107888963B (en) * 2017-10-27 2021-02-23 北京雷石天地电子技术有限公司 Method and system for synthesizing video based on rhythm
WO2019086037A1 (en) * 2017-11-06 2019-05-09 腾讯科技(深圳)有限公司 Video material processing method, video synthesis method, terminal device and storage medium
CN109963166A (en) * 2017-12-22 2019-07-02 上海全土豆文化传播有限公司 Online Video edit methods and device
US11521389B2 (en) 2018-01-19 2022-12-06 Beijing Sensetime Technology Development Co., Ltd. Method for generating special effect program file package, method for generating special effect, electronic device, and storage medium
US11368746B2 (en) 2018-02-08 2022-06-21 Beijing Sensetime Technology Development Co., Ltd. Method and device for generating special effect program file package, method and device for generating special effect, and electronic device
CN108388434A (en) * 2018-02-08 2018-08-10 北京市商汤科技开发有限公司 The generation of special efficacy program file packet and special efficacy generation method and device, electronic equipment
CN110309351A (en) * 2018-02-14 2019-10-08 阿里巴巴集团控股有限公司 Video image generation, device and the computer system of data object
CN108810597B (en) * 2018-06-25 2021-08-17 百度在线网络技术(北京)有限公司 Video special effect processing method and device
CN108810597A (en) * 2018-06-25 2018-11-13 百度在线网络技术(北京)有限公司 Special video effect processing method and processing device
WO2020077854A1 (en) * 2018-10-19 2020-04-23 北京微播视界科技有限公司 Video generation method and device, electronic device and computer storage medium
GB2593005B (en) * 2018-10-19 2023-02-22 Beijing Microlive Vision Tech Co Ltd Video generating method, apparatus, electronic device and computer storage medium
US11490033B2 (en) 2018-10-19 2022-11-01 Beijing Microlive Vision Technology Co., Ltd Video generating method, apparatus, electronic device and computer storage medium
GB2593005A (en) * 2018-10-19 2021-09-15 Beijing Microlive Vision Tech Co Ltd Video generation method and device, electronic device and computer storage medium
CN109492577B (en) * 2018-11-08 2020-09-18 北京奇艺世纪科技有限公司 Gesture recognition method and device and electronic equipment
CN109492577A (en) * 2018-11-08 2019-03-19 北京奇艺世纪科技有限公司 A kind of gesture identification method, device and electronic equipment
CN111225232A (en) * 2018-11-23 2020-06-02 北京字节跳动网络技术有限公司 Video-based sticker animation engine, realization method, server and medium
CN109697060A (en) * 2018-12-29 2019-04-30 广州华多网络科技有限公司 Special video effect software and its generation method, device, equipment and storage medium
CN109697060B (en) * 2018-12-29 2022-08-26 广州方硅信息技术有限公司 Video special effect system, generation method, device, equipment and storage medium thereof
CN111866609A (en) * 2019-04-08 2020-10-30 百度(美国)有限责任公司 Method and apparatus for generating video
CN110691276B (en) * 2019-11-06 2022-03-18 北京字节跳动网络技术有限公司 Method and device for splicing multimedia segments, mobile terminal and storage medium
CN110691276A (en) * 2019-11-06 2020-01-14 北京字节跳动网络技术有限公司 Method and device for splicing multimedia segments, mobile terminal and storage medium
CN111083396A (en) * 2019-12-26 2020-04-28 北京奇艺世纪科技有限公司 Video synthesis method and device, electronic equipment and computer-readable storage medium
WO2021189995A1 (en) * 2020-03-24 2021-09-30 北京达佳互联信息技术有限公司 Video rendering method and apparatus, electronic device, and storage medium
CN111491205A (en) * 2020-04-17 2020-08-04 维沃移动通信有限公司 Video processing method and device and electronic equipment
CN111417015A (en) * 2020-04-22 2020-07-14 永城职业学院 Method for synthesizing computer video
CN111866585A (en) * 2020-06-22 2020-10-30 北京美摄网络科技有限公司 Video processing method and device
WO2022213801A1 (en) * 2021-04-09 2022-10-13 北京字跳网络技术有限公司 Video processing method, apparatus, and device
CN115209215A (en) * 2021-04-09 2022-10-18 北京字跳网络技术有限公司 Video processing method, device and equipment
CN113473178A (en) * 2021-06-30 2021-10-01 北京百度网讯科技有限公司 Video processing method and device, electronic equipment and computer readable storage medium
CN115278306A (en) * 2022-06-20 2022-11-01 阿里巴巴(中国)有限公司 Video editing method and device
CN115278306B (en) * 2022-06-20 2024-05-31 阿里巴巴(中国)有限公司 Video editing method and device

Also Published As

Publication number Publication date
CN103928039B (en) 2016-09-21

Similar Documents

Publication Publication Date Title
CN103928039A (en) Video compositing method and device
CN106804005B (en) A kind of production method and mobile terminal of video
Gopinath The ringtone dialectic: Economy and cultural form
CN112911379B (en) Video generation method, device, electronic equipment and storage medium
CN111225232B (en) Video-based sticker animation engine, realization method, server and medium
US20200120400A1 (en) Method and system for generating interactive media content
CN103853563A (en) Media material editing method and device
CN102868862A (en) Method and equipment for dubbing video applied to mobile terminal
CN109788212A (en) A kind of processing method of segmenting video, device, terminal and storage medium
CN106254776A (en) Video processing method and device and electronic equipment
CN110798737A (en) Video and audio synthesis method, terminal and storage medium
CN110781349A (en) Method, equipment, client device and electronic equipment for generating short video
CN106331479A (en) Video processing method and device and electronic equipment
Böttcher Current problems and future possibilities of procedural audio in computer games
CN111158573A (en) Vehicle-mounted machine interaction method, system, medium and equipment based on picture framework
CN104681048A (en) Multimedia read control device, curve acquiring device, electronic equipment and curve providing device and method
CN106506325A (en) Picture sharing method and device
CN113342330A (en) Front-end engineering generation method and device
CN102035937A (en) Display method and device of information in mobile terminal and mobile terminal
CN103116632B (en) A kind of generation method of theme bag, device and equipment
CN105094823A (en) Method and device used for generating interface for input method
CN104123112A (en) Image processing method and electronic equipment
CN104301762A (en) Advertisement updating method, device and system and advertisement terminal device
CN106328174A (en) Method and device for processing recording data
CN113559503A (en) Video generation method, device and computer readable medium

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant