WO2020135055A1 - 视频特效的添加方法、装置、设备及存储介质 - Google Patents

视频特效的添加方法、装置、设备及存储介质 Download PDF

Info

Publication number
WO2020135055A1
WO2020135055A1 PCT/CN2019/124583 CN2019124583W WO2020135055A1 WO 2020135055 A1 WO2020135055 A1 WO 2020135055A1 CN 2019124583 W CN2019124583 W CN 2019124583W WO 2020135055 A1 WO2020135055 A1 WO 2020135055A1
Authority
WO
WIPO (PCT)
Prior art keywords
frame
special effect
video
video sequence
sequence
Prior art date
Application number
PCT/CN2019/124583
Other languages
English (en)
French (fr)
Inventor
刘清
颜乐驹
Original Assignee
广州市百果园信息技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 广州市百果园信息技术有限公司 filed Critical 广州市百果园信息技术有限公司
Priority to US17/419,035 priority Critical patent/US11553240B2/en
Priority to RU2021121786A priority patent/RU2763518C1/ru
Publication of WO2020135055A1 publication Critical patent/WO2020135055A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/272—Means for inserting a foreground image in a background image, i.e. inlay, outlay
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/265—Mixing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/7867—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using information manually generated, e.g. tags, keywords, comments, title and artist information, manually generated time, location and usage information, user ratings
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/02—Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
    • G11B27/031—Electronic editing of digitised analogue information signals, e.g. audio or video signals
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/02—Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
    • G11B27/031—Electronic editing of digitised analogue information signals, e.g. audio or video signals
    • G11B27/036—Insert-editing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44016—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving splicing one content stream with another content stream, e.g. for substituting a video clip
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440281—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the temporal resolution, e.g. by frame skipping
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47205—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/816—Monomedia components thereof involving special video data, e.g 3D video
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845—Structuring of content, e.g. decomposing content into time segments
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845—Structuring of content, e.g. decomposing content into time segments
    • H04N21/8456—Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments

Definitions

  • the embodiments of the present application relate to the technical field of video processing, for example, to a method, device, device, and storage medium for adding video special effects.
  • the video sequence (also called special effect sequence) of the special effect part usually has a stable frame rate, but the source video quality may be uneven. If the quality of the source video sequence is not high (the frame rate is low or the rhythm is not smooth), the playback effect of the superimposed special effects is not smooth.
  • special effects are added in the following two ways.
  • One is to directly superimpose the frame number. In this way, if the frame rate of the special effect sequence is greater than the frame rate of the source video, the superimposed special effect will play slower and the effect will not Good; the other is to remove part of the video frame of the special effect sequence, so that the frame rate of the special effect sequence after removing this part of the video frame is the same as that of the source video. This way makes the superimposed special effect appear to be stuck.
  • Embodiments of the present application provide a method, device, equipment, and storage medium for adding video special effects, so as to add special effects to videos, and improve the fluency of playing special effects.
  • an embodiment of the present application provides a method for adding video special effects.
  • the method includes:
  • the source video sequence is superimposed on the special effect video sequence while inserting frames, or the source video sequence is inserted into the source video sequence according to the frame rate of the special effect video sequence. Describe the special effect video sequence overlay;
  • the source video sequence is superimposed with the special effect video sequence while being framed ;
  • the target frame rate is determined from the frame rate of the special effect video sequence, and the source video sequence is superimposed on the special effect video sequence after frame insertion according to the target frame rate.
  • an embodiment of the present application further provides a device for adding video effects, the device includes:
  • the special effect video sequence acquisition module is set to obtain the source video sequence and at least one special effect video sequence
  • a special effect video sequence superimposing module is set to superimpose the source video sequence with the special effect video sequence while inserting frames, or, according to the frame rate of the special effect video sequence, when the number of special effect video sequences is one
  • the source video sequence is superimposed with the special effect video sequence after frame insertion;
  • the frame-overlay module is inserted to set the source video sequence when the number of special effect video sequences is two or more, and the frame rates of the two or more special effect video sequences are the same. Overlay frames and special effect video sequences while inserting frames;
  • an embodiment of the present application further provides a computer device, including a memory, a processor, and a computer program stored on the memory and executable on the processor.
  • a computer device including a memory, a processor, and a computer program stored on the memory and executable on the processor.
  • the processor executes the program, it is implemented as The method described in the embodiments of the present application.
  • an embodiment of the present application further provides a computer-readable storage medium that stores a computer program on the computer-readable storage medium, and when the computer program is executed by a processor, it is implemented as described in the embodiment of the present application method.
  • FIG. 1 is a schematic flowchart of a method for adding video special effects in an embodiment of the present application
  • FIG. 2 is a schematic structural diagram of a device for adding video effects in an embodiment of the present application
  • FIG. 3 is a schematic structural diagram of a computer device in an embodiment of the present application.
  • FIG. 1 is a flowchart of a method for adding a video special effect provided by an embodiment of the present application. This embodiment can be applied to the case of adding a special effect to a video.
  • the method can be performed by a device for adding a video special effect.
  • the device can be implemented by hardware and And/or software, and can generally be integrated into a device with the added function of video effects, which can be an electronic device such as a server, mobile terminal, or server cluster.
  • the method includes steps 110 to 140.
  • Step 110 Obtain a source video sequence and at least one special effect video sequence.
  • the source video sequence may be a sequence composed of video frames in a video segment to be added with special effects.
  • the special effect video sequence may be a sequence composed of special effect frames.
  • the special effect frame may be a frame containing special effects.
  • the source video sequence may be a video obtained by a user using a camera device, and the special effect video sequence is a video produced by professionals including special effects.
  • Step 120 when the number of special effect video sequences is one, superimpose the source video sequence with the special effect video sequence while inserting frames, or superimpose the source video sequence with the special effect video sequence according to the frame rate of the special effect video sequence .
  • the way to add the special effect to the video may be to superimpose the source video sequence with the special effect video sequence, or, According to the frame rate of the special effect video sequence, the source video sequence is superimposed with the special effect video sequence after frame insertion.
  • the duration of the special effect video sequence is the same as that of the source video sequence.
  • the process of aligning the time stamp may be to obtain the first frame of the source video sequence Timestamp, according to the timestamp to modify the special effect frames in the special effect video sequence, each special effect frame in the special effect video sequence plus a time offset, so that the first frame of the special effect video sequence timestamp and the source video sequence The timestamps of the first frame are consistent, thereby achieving timestamp alignment.
  • the source video sequence is a sequence composed of video frames to be superimposed with special effects.
  • overlaying the source video sequence with the special effect video sequence while inserting frames may be implemented in the following manner: according to the time stamp of the current video frame in the source video sequence, determine the effect frame in the special effect sequence that has not participated in the overlay The frame number of the target special effect frame; when the frame number of the target special effect frame is greater than the frame number of the current video frame, insert a frame of video frame before the current video frame and update the frame number of the video frame in the source video sequence; insert Video frame and the first frame of the special effect frame in the special effect video sequence that did not participate in the superposition; return to perform according to the time stamp of the current video frame in the source video sequence, determine the target special effect frame in the special effect frame in the special effect video sequence that did not participate in the overlay Until the frame number of the target special effect frame is not greater than the frame number of the current video frame, the target special effect frame and the current video frame are superimposed; the next video frame of the current video frame in the source video sequence is continued as the current video frame Perform frame insertion and superposition until
  • the current video frame is the first frame of the video frames in the source video sequence that did not participate in the overlay.
  • the frame number of the special effect frame is obtained by numbering the special effect frames in the special effect video sequence starting from the first frame in ascending order.
  • the frame number of the video frame is obtained by numbering the video frames in the source video sequence from the first frame in ascending order.
  • the frame number of the first frame of the source video sequence and the frame number of the first frame of the special effect video sequence may be the same, for example, both are numbered 1.
  • the process of obtaining the frame number of the target special effect frame is to obtain the special effect frame in the special effect video sequence whose time stamp is less than or equal to the time stamp of the current video frame, obtain the frame number of these special effect frames, and take the
  • the maximum value in the frame number is the frame number of the target special effect frame.
  • the inserted video frame is the same as the previous video frame of the current video frame, that is, the last video frame is copied and inserted, and the time stamp of the inserted video frame is determined as the special effect frame in the special effect video sequence that does not participate in the overlay The timestamp of the first frame of this will align the timestamps of the two superimposed video frames.
  • the frame number of the target special effect frame is greater than the frame number of the current video frame, a video frame that is the same as the previous frame of the current video frame is inserted before the current video frame, and the video in the source video sequence is updated The frame number of the frame superimposes the inserted video frame with the first frame of the special effect frames in the special effect video sequence that did not participate in the overlay.
  • the source video sequence is inserted into the special effect video sequence and superimposed, which can be implemented by traversing the source video sequence and calculating the current video frame when traversing to the current video frame Timestamp difference between the first frame of the source video sequence; multiply the timestamp difference by the frame rate of the special effect video sequence to obtain the target frame number; subtract the frame number of the current video frame from the target frame number to obtain The number of inserted frames; insert the video frames of the number of frames to be inserted between the current video frame and the previous video frame of the current video frame according to a set step; superimpose the source video sequence completed with the frame insertion and the special effect video sequence .
  • the calculation formula of the step size can be: Among them, T1 is the time stamp of the current video frame, T2 is the time stamp of the previous video frame, and M is the number of frames to be inserted.
  • the inserted video frame is the same as the previous video frame of the current video frame.
  • the time stamps of the multiple video frames after the insertion are respectively: T2, T2+t, T2+2t, T1.
  • the frame rate of the source video sequence is the same as the frame rate of the special effect video sequence, and the frame number is correspondingly superimposed according to the frame number.
  • Step 130 when the number of the special effect video sequences is two or more, and the frame rate of the two or more special effect video sequences is the same, the source video sequence is superimposed with the special effect video sequence while framing.
  • the method of superimposing the source video sequence while inserting the frame and the special effect video sequence is: according to the time stamp of the current video frame in the source video sequence, separately determine the special effects of the multiple special effect video sequences that have not participated in the overlay The frame number of the target special effect frame in the frame; if the frame number of the target special effect frame is greater than the frame number of the current video frame, insert a frame of video frame before the current video frame and update the frame of the video frame in the source video sequence No.; superimpose the inserted video frame with the first frame of the special effect frames that did not participate in the superposition of the multiple special effect video sequences; return to execution According to the time stamp of the current video frame in the source video sequence, determine that the multiple special effect video sequences have not participated in the superposition Operation of the frame number of the target special effect frame in the special effect frame, until the frame number of the target special effect frame is not greater than the frame number of the current video frame, multiple target special effect frames are superimposed with the current video frame; the next video
  • the non-overlapping part is implemented according to the above-mentioned one-effect video sequence side-by-side frame superposition method, and for the overlapping portion according to the above-mentioned multiple special-effect video sequence completely overlapping side-by-side frame superposition method achieve.
  • Step 140 when the number of special effect video sequences is two or more, and the frame rates of the two or more special effect video sequences are not the same, according to the preset rule, select two or more special effects Determine the target frame rate from the frame rate of the video sequence, and superimpose the source video sequence with the special effect video sequence after inserting frames according to the target frame rate.
  • the preset rule may be to select the maximum value among the frame rates of the two or more special effect video sequences as the target frame rate, or determine a target frame rate according to the actual standards (such as 30 frames per second transmission Frame number (frame per second, fps)).
  • the process of inserting the source video sequence according to the target frame rate is the same as the above one special effect video During the sequence, the source video sequence is inserted in the same manner according to the frame rate of the special effect sequence.
  • the frame rate of the source video sequence after the frame insertion is the same as the target frame rate.
  • the overlay with the special effect video sequence includes the following three cases: the frame rate of the special effect video sequence is equal to the target frame rate, the frame rate of the special effect video sequence is greater than the target frame rate, and the frame rate of the special effect video sequence is less than the target frame rate.
  • the effect video frame sequence is equal to the target frame rate, the source video sequence and the effect frame sequence are superimposed correspondingly according to the frame number.
  • the frame rate of the special effect video sequence is greater than or less than the target frame rate
  • obtain the special effect frame whose time stamp is less than or equal to the time stamp of the current video frame in the special effect video sequence, and the maximum time stamp in the obtained special effect frame
  • the special effect frame is superimposed with the current video frame.
  • this method is equivalent to deleting the frame of the special effect video sequence.
  • this method is equivalent to superimposing multiple video frames with the same special effect frame.
  • the technical solution of this embodiment obtains the source video sequence and at least one special effect video sequence; when the number of special effect video sequences is one, the source video sequence is superimposed with the special effect video sequence while being framed, or, according to the special effect video sequence Frame rate of the source video sequence is superimposed on the special effect video sequence after frame insertion; when the number of special effect video sequences is two or more, and the frame rates of the two or more special effect video sequences are the same , Overlay the source video sequence with the special effect video sequence while inserting frames; when the number of special effect video sequences is two or more, and the frame rates of the two or more special effect video sequences are not the same , Determine the target frame rate from the frame rates of the two or more special effect video sequences according to a preset rule, and superimpose the source video sequence with the special effect video sequence after inserting frames according to the target frame rate.
  • the method for adding video special effects determines the method of interpolating and superimposing according to the number and frame rate of special effect video sequences. By inserting frames to the source video sequence, the effect video sequence played after being added to the source video is improved. Fluency.
  • FIG. 2 is a schematic structural diagram of a video effect adding device provided by an embodiment of the present application.
  • the device includes: a special effect video sequence acquisition module 210, a special effect video sequence overlay module 220, a frame-by-frame overlay module 230, and a frame-after-frame overlay module 240.
  • the apparatus for adding video effects in this embodiment can execute the method provided in this embodiment.
  • the special effect video sequence obtaining module 210 is set to obtain the source video sequence and at least one special effect video sequence;
  • a special effect video sequence superimposition module 220 is set to superimpose the source video sequence with the special effect video sequence while the number of special effect video sequences is one, or to interpolate the source video sequence according to the frame rate of the special effect video sequence After the frame is superimposed with the special effect video sequence;
  • the edge-to-frame overlay module 230 is configured to control the source video sequence when the number of special effect video sequences is two or more, and the frame rates of the two or more special effect video sequences are the same. Overlay the frame edge with the special effect video sequence;
  • Insert frame first and then superimpose module 240 when the number of special effect video sequences is two or more, and the frame rates of the two or more special effect video sequences are not the same, according to a preset rule
  • a target frame rate is determined from the frame rates of the two or more special effect video sequences, and the source video sequence is framed and superimposed on the special effect video sequence according to the target frame rate.
  • the frame-overlay module 230 is also set to:
  • the time stamp of the current video frame in the source video sequence determine the frame number of the target special effect frame in the special effect frame in the special effect video sequence that did not participate in the overlay;
  • next video frame of the current video frame in the source video sequence as the current video frame, continue to perform interpolation and superposition until the source video sequence is traversed.
  • FIG. 3 is a schematic structural diagram of a computer device provided by an embodiment of the present application.
  • a computer device provided by this embodiment includes a processor 31 and a memory 32. There may be one or more processors in the computer device.
  • FIG. 3 takes a processor 31 as an example.
  • the processor 31 and the memory 32 in the computer device may be connected by a bus or other means. Take bus connection as an example.
  • the processor 31 of the computer device in this embodiment integrates the apparatus provided in the above embodiment.
  • the memory 32 in the computer device as a computer-readable storage medium may be configured to store one or more programs, and the programs may be software programs, computer executable programs, and modules, as in the embodiments of the present application Program instructions/modules corresponding to the method.
  • the processor 31 executes various functional applications and data processing of the device by running software programs, instructions, and modules stored in the memory 32, that is, implementing the above method.
  • An embodiment of the present application further provides a computer-readable storage medium, and the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method as provided in the embodiment of the present application is implemented.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Library & Information Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Studio Circuits (AREA)
  • Display Devices Of Pinball Game Machines (AREA)

Abstract

本申请实施例公开了一种视频特效的添加方法、装置、设备及存储介质。该方法包括：获取源视频序列和至少一个特效视频序列；在特效视频序列的数量为两个或两个以上，且两个或两个以上的特效视频序列的帧率相同的情况下，对所述源视频序列边插帧边与特效视频序列叠加；在特效视频序列的数量为两个或两个以上，且两个或两个以上的特效视频序列的帧率不相同的情况下，根据预设规则从所述两个或两个以上的特效视频序列的帧率中确定目标帧率，并根据所述目标帧率对所述源视频序列插帧后与特效视频序列叠加。

Description

视频特效的添加方法、装置、设备及存储介质
本申请要求在2018年12月28日提交中国专利局、申请号为201811627586.9的中国专利申请的优先权，该申请的全部内容通过引用结合在本申请中。
技术领域
本申请实施例涉及视频处理技术领域，例如涉及一种视频特效的添加方法、装置、设备及存储介质。
背景技术
在视频制作过程中，常常有叠加动态特效的操作，特效部分的视频序列(也称为特效序列)通常帧率稳定，但源视频质量可能参差不齐。如果源视频序列质量不高(帧率较低或者节奏不平滑)，导致叠加后的特效的播放效果也不流畅。
相关技术中，按照如下两种方式添加特效，一种是直接按照帧序号叠加，这种方式若特效序列的帧率大于源视频的帧率，使得叠加后的特效播放起来速度变慢，效果不好；另一种是剔除特效序列的部分视频帧，使得剔除该部分视频帧后的特效序列的帧率和源视频的相同，这种方式使得叠加后的特效播放时出现卡顿现象。
发明内容
本申请实施例提供一种视频特效的添加方法、装置、设备及存储介质，以实现对视频添加特效，提高特效播放的流畅性。
在一实施例中，本申请实施例提供了一种视频特效的添加方法，该方法包括：
获取源视频序列和至少一个特效视频序列；
在特效视频序列的数量为一个的情况下，对所述源视频序列边插帧边与特效视频序列叠加，或者，根据所述特效视频序列的帧率对所述源视频序列插帧后与所述特效视频序列叠加；
在特效视频序列的数量为两个或两个以上，且所述两个或两个以上的特效视频序列的帧率相同的情况下，对所述源视频序列边插帧边与特效视频序列叠加；
在特效视频序列的数量为两个或两个以上，且所述两个或两个以上的特效视频序列的帧率不相同的情况下，根据预设规则从所述两个或两个以上的特效视频序列的帧率中确定目标帧率，并根据所述目标帧率对所述源视频序列插帧后与特效视频序列叠加。
在一实施例中，本申请实施例还提供了一种视频特效的添加装置，该装置包括：
特效视频序列获取模块，设置为获取源视频序列和至少一个特效视频序列；
一个特效视频序列叠加模块，设置为在特效视频序列的数量为一个的情况下，对所述源视频序列边插帧边与特效视频序列叠加，或者，根据所述特效视频序列的帧率对所述源视频序列插帧后与特效视频序列叠加；
边插帧边叠加模块，设置为在特效视频序列的数量为两个或两个以上，且所述两个或两个以上的特效视频序列的帧率相同的情况下，对所述源视频序列边插帧边与特效视频序列叠加；
先插帧后叠加模块，设置为在特效视频序列的数量为两个或两个以上，且所述两个或两个以上的特效视频序列的帧率不相同的情况下，根据预设规则从所述两个或两个以上的特效视频序列的帧率中确定目标帧率，并根据所述目标帧率对所述源视频序列插帧后与特效视频序列叠加。
在一实施例中，本申请实施例还提供了一种计算机设备，包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序，所述处理器执行所述程序时实现如本申请实施例所述的方法。
在一实施例中，本申请实施例还提供了一种计算机可读存储介质，该计算机可读存储介质上存储有计算机程序，该计算机程序被处理器执行时实现如本申请实施例所述的方法。
附图说明
图1是本申请实施例中的一种视频特效的添加方法的流程示意图；
图2是本申请实施例中的一种视频特效的添加装置的结构示意图；
图3是本申请实施例中的一种计算机设备的结构示意图。
具体实施方式
下面结合附图和实施例对本申请进行说明。此处所描述的实施例仅仅用于 解释本申请，而非对本申请的限定。附图中仅示出了与本申请相关的部分而非全部结构。
实施例一
图1为本申请实施例提供的一种视频特效的添加方法的流程图，本实施例可适用于对视频添加特效的情况，该方法可以由视频特效的添加装置来执行，该装置可由硬件和/或软件组成，并一般可集成在具有视频特效的添加功能的设备中，该设备可以是服务器、移动终端或服务器集群等电子设备。如图1所示，该方法包括步骤110至步骤140。
步骤110，获取源视频序列和至少一个特效视频序列。
其中，源视频序列可以是由待添加特效的视频片段中的视频帧构成的序列。特效视频序列可以是由特效帧构成的序列。特效帧可以是包含特效的帧。本实施例中，源视频序列可以是用户采用摄像设备拍摄获得的视频，特效视频序列是专业人士制作的包括特效的视频。
步骤120，在特效视频序列的数量为一个的情况下，对源视频序列边插帧边与特效视频序列叠加，或者，根据特效视频序列的帧率对源视频序列插帧后与特效视频序列叠加。
当特效视频序列的数量只有一个，即在源视频序列只添加一种特效的情况下，将特效添加至视频中的方式可以是，对源视频序列边插帧边与特效视频序列叠加，或者，根据特效视频序列的帧率对源视频序列插帧后与特效视频序列叠加。本实施例中，特效视频序列与源视频序列的时长相同，在添加特效之前，将特效视频序列的时间戳与源视频序列的时间戳对齐，时间戳对齐的过程可以是获取源视频序列首帧的时间戳，根据该时间戳对特效视频序列中的特效帧进行修正，特效视频序列中的每一个特效帧加一个时间偏移量，使得特效视频序列的首帧的时间戳与源视频序列的首帧的时间戳一致，从而实现时间戳的对齐。其中，源视频序列是由待叠加特效的视频帧构成的序列。
可选的，对源视频序列边插帧边与特效视频序列叠加，可通过下述方式实施：根据源视频序列中当前视频帧的时间戳，确定特效视频序列中未参与叠加的特效帧中的目标特效帧的帧号；在目标特效帧的帧号大于当前视频帧的帧号的情况下，在当前视频帧之前插入一帧视频帧，并更新源视频序列中视频帧的帧号；将插入的视频帧与特效视频序列中未参与叠加的特效帧中的首帧叠加；返回执行根据源视频序列中当前视频帧的时间戳，确定特效视频序列中未参与叠加的特效帧中的目标特效帧的帧号的操作，直到目标特效帧的帧号不大于当前视频帧的帧号，将目标特效帧与当前视频帧叠加；将源视频序列中当前视频 帧的下一视频帧作为当前视频帧继续执行插帧和叠加，直至遍历源视频序列。
其中，当前视频帧为源视频序列中未参与叠加的视频帧中的首帧。特效帧的帧号是对特效视频序列中的特效帧从首帧开始按照从小到大的顺序进行编号获得的。视频帧的帧号是对源视频序列中的视频帧从首帧开始按照从小到大的顺序进行编号获得的。本实施例中，源视频序列的首帧的帧号与特效视频序列的首帧的帧号可以相同，例如，都编号为1号。
根据源视频序列中当前视频帧的时间戳，确定特效视频序列中未参与叠加的特效帧中的目标特效帧的帧号按照如下公式计算：j＝max{n|T(E,n)≤T(S,q)}，其中，j表示目标特效帧的帧号，q表示当前视频帧的帧号，T(E,n)表示特效视频序列中帧号为n的特效帧的时间戳，T(S,q)表示源视频序列中当前视频帧的时间戳，所述n为正整数，所述S表示所述源视频序列，所述E表示所述特效视频序列。从上述公式可以获知，获取目标特效帧的帧号的过程为，获取特效视频序列中时间戳小于或等于当前视频帧的时间戳的特效帧，获取这些特效帧的帧号，并取特效帧的帧号中的最大值，即为目标特效帧的帧号。本实施例中，插入的视频帧与当前视频帧的上一视频帧相同，即拷贝上一视频帧插入，并将插入的视频帧的时间戳确定为特效视频序列中未参与叠加的特效帧中的首帧的时间戳，这样使得叠加的两个视频帧的时间戳对齐。
在一实施例中，若目标特效帧的帧号大于当前视频帧的帧号，则在当前视频帧之前插入一帧与当前视频帧的上一帧相同的视频帧，并且更新源视频序列中视频帧的帧号，将插入的视频帧与特效视频序列中未参与叠加的特效帧中的首帧叠加。返回执行根据源视频序列中当前视频帧的时间戳，确定特效视频序列中未参与叠加的特效帧中的目标特效帧的帧号的操作，直到目标特效帧的帧号不大于当前视频帧的帧号，将目标特效帧与当前视频帧叠加。将源视频序列中下一视频帧作为当前视频帧继续执行插帧和叠加，直至遍历源视频序列，从而完成特效的添加。
可选的，根据特效视频序列的帧率对源视频序列插帧后与特效视频序列叠加，可通过下述方式实施：遍历源视频序列，在遍历至当前视频帧的情况下，计算当前视频帧与所述源视频序列的首帧之间的时间戳差值；将时间戳差值乘以特效视频序列的帧率获得目标帧数量；将目标帧数量减去当前视频帧的帧号，获得待插入帧数量；将待插入帧数量的视频帧按照设定的一个步长插入当前视频帧和所述当前视频帧的上一视频帧之间；将插帧完成的源视频序列与特效视频序列叠加。
步长的计算公式可以是：
Figure PCTCN2019124583-appb-000001
其中，T1为当前视频帧的时间戳，T2 为上一视频帧的时间戳，M为待插入帧数量。在所述当前视频帧不为所述源视频序列的首帧的情况下，插入的视频帧与当前视频帧的上一视频帧相同。示例性的，假设在当前视频帧与上一视频帧插入2个视频帧，则插帧之后多个视频帧的时间戳分别为：T2，T2+t，T2+2t，T1。对源视频序列插帧完成后，源视频序列的帧率与特效视频序列的帧率相同，则按照帧号对应叠加。
步骤130，在特效视频序列的数量为两个或两个以上，且两个或两个以上的特效视频序列的帧率相同的情况下，对源视频序列边插帧边与特效视频序列叠加。
当特效视频序列的数量为两个或两个以上且两个或两个以上的特效视频序列的帧率相同时，添加多个特效视频序列的情况有如下三种：多个特效完全重叠、多个特效部分重叠或者多个特效不重叠。当多个特效不重叠时，对于每种特效按照上述一个特效视频序列的边插帧边叠加的方式实现。当多个特效完全重叠时，对源视频序列边插帧边与特效视频序列叠加的方式为：根据源视频序列中当前视频帧的时间戳，分别确定多个特效视频序列中未参与叠加的特效帧中的目标特效帧的帧号；在目标特效帧的帧号大于当前视频帧的帧号的情况下，则在当前视频帧前插入一帧视频帧，并更新源视频序列中视频帧的帧号；将插入的视频帧与多个特效视频序列中未参与叠加的特效帧中的首帧叠加；返回执行根据源视频序列中当前视频帧的时间戳，确定多个特效视频序列中未参与叠加的特效帧中的目标特效帧的帧号的操作，直到目标特效帧的帧号不大于当前视频帧的帧号，将多个目标特效帧与当前视频帧叠加；将源视频序列中下一视频帧作为当前视频帧继续执行插帧和叠加，直至遍历源视频序列。当多个特效部分重叠时，对于不重叠的部分按照上述一个特效视频序列的边插帧边叠加的方式实现，对于重叠部分按照上述多个特效视频序列完全重叠时的边插帧边叠加的方式实现。
步骤140，在特效视频序列的数量为两个或两个以上，且两个或两个以上的特效视频序列的帧率不相同的情况下，根据预设规则从两个或两个以上的特效视频序列的帧率中确定目标帧率，并根据目标帧率对源视频序列插帧后与特效视频序列叠加。
其中，预设规则可以是选择所述两个或两个以上的特效视频序列的帧率中的最大值作为目标帧率，或者按照实际中的标准确定一个目标帧率(如30画面每秒传输帧数(frame per second，fps))。当特效视频序列的数量为两个或者两个以上，且所述两个或两个以上的特效视频序列的帧率不同时，根据目标帧率对源视频序列的插帧过程与上述一个特效视频序列时根据特效序列的帧率对源视频序列插帧的方式相同。
插帧完成的源视频序列的帧率和目标帧率相同。源视频插帧完成后与特效视频序列叠加包括如下三种情况：特效视频序列的帧率等于目标帧率、特效视频序列的帧率大于目标帧率和特效视频序列的帧率小于目标帧率。当特效视频帧序列的等于目标帧率时，源视频序列与特效帧序列则按照帧号对应叠加。当特效视频序列的帧率大于或小于目标帧率时，对于当前视频帧，在特效视频序列中获取时间戳小于或等于当前视频帧的时间戳的特效帧，将获得的特效帧中时间戳最大的特效帧与当前视频帧进行叠加。在特效视频序列的帧率大于目标帧率时，该种方式相当于对特效视频序列进行了删帧。在特效视频序列的帧率大于目标帧率时，该种方式相当于多个视频帧与同一特效帧进行了叠加。
本实施例的技术方案，获取源视频序列和至少一个特效视频序列；在特效视频序列的数量为一个的情况下，对源视频序列边插帧边与特效视频序列叠加，或者，根据特效视频序列的帧率对源视频序列插帧后与特效视频序列叠加；在特效视频序列的数量为两个或两个以上，且所述两个或两个以上的特效视频序列的帧率相同的情况下，对源视频序列边插帧边与特效视频序列叠加；在特效视频序列的数量为两个或两个以上，且所述两个或两个以上的特效视频序列的帧率不相同的情况下，根据预设规则从所述两个或两个以上的特效视频序列的帧率中确定目标帧率，并根据目标帧率对源视频序列插帧后与特效视频序列叠加。本申请实施例提供的视频特效的添加方法，根据特效视频序列的数量及帧率确定插帧及叠加的方式，通过对源视频序列进行插帧，提高特效视频序列在添加至源视频后播放的流畅性。
实施例二
图2为本申请实施例提供的一种视频特效的添加装置的结构示意图。如图2所示，该装置包括：特效视频序列获取模块210，一个特效视频序列叠加模块220，边插帧边叠加模块230和先插帧后叠加模块240。本实施例的视频特效的添加装置可执行本实施例提供的方法。
特效视频序列获取模块210，设置为获取源视频序列和至少一个特效视频序列；
一个特效视频序列叠加模块220，设置为在特效视频序列的数量为一个的情况下，对源视频序列边插帧边与特效视频序列叠加，或者，根据特效视频序列的帧率对源视频序列插帧后与特效视频序列叠加；
边插帧边叠加模块230，设置为在特效视频序列的数量为两个或两个以上，且所述两个或两个以上的特效视频序列的帧率相同的情况下，对源视频序列边插帧边与特效视频序列叠加；
先插帧后叠加模块240，设置为在特效视频序列的数量为两个或两个以上，且所述两个或两个以上的特效视频序列的帧率不相同的情况下，根据预设规则从所述两个或两个以上的特效视频序列的帧率中确定目标帧率，并根据目标帧率对源视频序列插帧后与特效视频序列叠加。
可选的，边插帧边叠加模块230，还设置为：
根据源视频序列中当前视频帧的时间戳，确定特效视频序列中未参与叠加的特效帧中的目标特效帧的帧号；
在目标特效帧的帧号大于当前视频帧的帧号的情况下，在当前视频帧之前插入一帧视频帧，并更新源视频序列中视频帧的帧号；
将插入的视频帧与特效视频序列中未参与叠加的特效帧中的首帧叠加；
返回执行根据源视频序列中当前视频帧的时间戳，确定特效视频序列中未参与叠加的特效帧中的目标特效帧的帧号的操作，直到目标特效帧的帧号不大于当前视频帧的帧号，将目标特效帧与当前视频帧叠加；
将源视频序列中所述当前视频帧的下一视频帧作为当前视频帧继续执行插帧和叠加，直至遍历源视频序列。
实施例三
图3为本申请实施例提供的一种计算机设备的结构示意图，如图3所示，本实施例提供的一种计算机设备，包括：处理器31和存储器32。该计算机设备中的处理器可以是一个或多个，图3中以一个处理器31为例，所述计算机设备中的处理器31和存储器32可以通过总线或其他方式连接，图3中以通过总线连接为例。
本实施例中计算机设备的处理器31中集成了上述实施例提供的装置。此外，该计算机设备中的存储器32作为一种计算机可读存储介质，可设置为存储一个或多个程序，所述程序可以是软件程序、计算机可执行程序以及模块，如本申请实施例中的方法对应的程序指令/模块。处理器31通过运行存储在存储器32中的软件程序、指令以及模块，从而执行设备的多种功能应用以及数据处理，即实现上述方法。
实施例四
本申请实施例还提供了一种计算机可读存储介质，该计算机可读存储介质上存储有计算机程序，该计算机程序被处理器执行时实现如本申请实施例所提供的方法。

Claims (10)

  1. 一种视频特效的添加方法，包括：
    获取源视频序列和至少一个特效视频序列；
    在所述特效视频序列的数量为一个的情况下，对所述源视频序列边插帧边与所述特效视频序列叠加，或者，根据所述特效视频序列的帧率对所述源视频序列插帧后与所述特效视频序列叠加；
    在所述特效视频序列的数量为两个或两个以上，且所述两个或两个以上的特效视频序列的帧率相同的情况下，对所述源视频序列边插帧边与所述特效视频序列叠加；
    在所述特效视频序列的数量为两个或两个以上，且所述两个或两个以上的特效视频序列的帧率不相同的情况下，根据预设规则从所述两个或两个以上的特效视频序列的帧率中确定目标帧率，并根据所述目标帧率对所述源视频序列插帧后与所述特效视频序列叠加。
  2. 根据权利要求1所述的方法，其中，所述对所述源视频序列边插帧边与所述特效视频序列叠加，包括：
    根据所述源视频序列中当前视频帧的时间戳，确定所述特效视频序列中未参与叠加的特效帧中的目标特效帧的帧号；
    在所述目标特效帧的帧号大于所述当前视频帧的帧号的情况下，在所述当前视频帧之前插入一帧视频帧，并更新所述源视频序列中视频帧的帧号；
    将插入的视频帧与所述特效视频序列中未参与叠加的特效帧中的首帧叠加；
    返回执行根据所述源视频序列中当前视频帧的时间戳，确定所述特效视频序列中未参与叠加的特效帧中的目标特效帧的帧号的操作，直到所述目标特效帧的帧号不大于所述当前视频帧的帧号，将所述目标特效帧与所述当前视频帧叠加；
    将所述源视频序列中所述当前视频帧的下一视频帧作为所述当前视频帧继续执行插帧和叠加，直至遍历所述源视频序列。
  3. 根据权利要求2所述的方法，其中，所述根据所述源视频序列中当前视频帧的时间戳，确定所述特效视频序列中未参与叠加的特效帧中的目标特效帧的帧号按照如下公式计算：
    j＝max{n|T(E,n)≤T(S,q)}，其中，所述j表示所述目标特效帧的帧号，所述q表示所述当前视频帧的帧号，所述T(E,n)表示所述特效视频序列中帧号为n的特效帧的时间戳，所述T(S,q)表示所述源视频序列中所述当前视频帧的时间戳， 所述n为正整数，所述S表示所述源视频序列，所述E表示所述特效视频序列。
  4. 根据权利要求2所述的方法，在所述当前视频帧之前插入一帧视频帧，并更新所述源视频序列中视频帧的帧号之后，还包括：
    将插入的视频帧的时间戳确定为所述特效视频序列中未参与叠加的特效帧中的首帧的时间戳。
  5. 根据权利要求1所述的方法，其中，所述根据所述目标帧率对所述源视频序列插帧后与所述特效视频序列叠加，包括：
    遍历所述源视频序列，在遍历至当前视频帧的情况下，计算所述当前视频帧与所述源视频序列的首帧之间的时间戳差值；
    将所述时间戳差值乘以所述目标帧率获得目标帧数量；
    将所述目标帧数量减去所述当前视频帧的帧号，获得待插入帧数量；
    将所述待插入帧数量的视频帧按照设定的一个步长插入所述当前视频帧和所述当前视频帧的上一视频帧之间；
    将插帧完成的源视频序列与所述特效视频序列叠加。
  6. 根据权利要求2或5所述的方法，其中，在所述当前视频帧不为所述源视频序列的首帧的情况下，插入的视频帧与所述当前视频帧的上一视频帧相同。
  7. 一种视频特效的添加装置，包括：
    特效视频序列获取模块，设置为获取源视频序列和至少一个特效视频序列；
    一个特效视频序列叠加模块，设置为在所述特效视频序列的数量为一个的情况下，对所述源视频序列边插帧边与所述特效视频序列叠加，或者，根据所述特效视频序列的帧率对所述源视频序列插帧后与所述特效视频序列叠加；
    边插帧边叠加模块，设置为在所述特效视频序列的数量为两个或两个以上，且所述两个或两个以上的特效视频序列的帧率相同的情况下，对所述源视频序列边插帧边与所述特效视频序列叠加；
    先插帧后叠加模块，设置为在所述特效视频序列的数量为两个或两个以上，且所述两个或两个以上的特效视频序列的帧率不相同的情况下，根据预设规则从所述两个或两个以上的特效视频序列的帧率中确定目标帧率，并根据所述目标帧率对所述源视频序列插帧后与所述特效视频序列叠加。
  8. 根据权利要求7所述的装置，其中，所述边插帧边叠加模块，还设置为：
    根据所述源视频序列中当前视频帧的时间戳，确定所述特效视频序列中未参与叠加的特效帧中的目标特效帧的帧号；
    在所述目标特效帧的帧号大于所述当前视频帧的帧号的情况下，在所述当前视频帧之前插入一帧视频帧，并更新所述源视频序列中视频帧的帧号；
    将插入的视频帧与所述特效视频序列中未参与叠加的特效帧中的首帧叠加；
    返回执行根据所述源视频序列中当前视频帧的时间戳，确定所述特效视频序列中未参与叠加的特效帧中的目标特效帧的帧号的操作，直到所述目标特效帧的帧号不大于所述当前视频帧的帧号，将所述目标特效帧与所述当前视频帧叠加；
    将所述源视频序列中所述当前视频帧的下一视频帧作为所述当前视频帧继续执行插帧和叠加，直至遍历所述源视频序列。
  9. 一种计算机设备，包括存储器、处理器及存储在所述存储器上并可在所述处理器上运行的计算机程序，所述处理器执行所述程序实现如权利要求1-6中任一项所述的方法。
  10. 一种计算机可读存储介质，所述计算机可读存储介质上存储有计算机程序，所述计算机程序被处理器执行时实现如权利要求1-6中任一项所述的方法。
PCT/CN2019/124583 2018-12-28 2019-12-11 视频特效的添加方法、装置、设备及存储介质 WO2020135055A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US17/419,035 US11553240B2 (en) 2018-12-28 2019-12-11 Method, device and apparatus for adding video special effects and storage medium
RU2021121786A RU2763518C1 (ru) 2018-12-28 2019-12-11 Способ, устройство и аппарат для добавления спецэффектов в видео и носитель данных

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201811627586.9 2018-12-28
CN201811627586.9A CN111385639B (zh) 2018-12-28 2018-12-28 视频特效的添加方法、装置、设备及存储介质

Publications (1)

Publication Number Publication Date
WO2020135055A1 true WO2020135055A1 (zh) 2020-07-02

Family

ID=71126300

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/124583 WO2020135055A1 (zh) 2018-12-28 2019-12-11 视频特效的添加方法、装置、设备及存储介质

Country Status (4)

Country Link
US (1) US11553240B2 (zh)
CN (1) CN111385639B (zh)
RU (1) RU2763518C1 (zh)
WO (1) WO2020135055A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114520875A (zh) * 2022-01-28 2022-05-20 西安维沃软件技术有限公司 视频处理方法、装置及电子设备

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114125528B (zh) * 2020-08-28 2022-11-11 北京达佳互联信息技术有限公司 一种视频特效处理方法、装置、电子设备及存储介质
CN113766275B (zh) * 2021-09-29 2023-05-30 北京达佳互联信息技术有限公司 视频剪辑方法、装置、终端及存储介质
CN113949898B (zh) * 2021-10-13 2024-03-08 北京奇艺世纪科技有限公司 多媒体处理方法、装置、设备和存储介质
CN117041628B (zh) * 2023-10-09 2024-02-02 腾讯科技（深圳）有限公司 直播画面的渲染方法、系统、装置、设备及介质

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1971622A (zh) * 2006-12-12 2007-05-30 北京中星微电子有限公司 数字摄像装置的视频动画背景处理方法和系统
JP2011193117A (ja) * 2010-03-12 2011-09-29 Casio Computer Co Ltd 画像処理装置及びプログラム
CN102263906A (zh) * 2011-07-26 2011-11-30 北京数码视讯科技股份有限公司 视频图像的处理方法及装置
CN105430537A (zh) * 2015-11-27 2016-03-23 刘军 对多路数据进行合成的方法、服务器及音乐教学系统
CN107018442A (zh) * 2016-01-28 2017-08-04 浙江宇视科技有限公司 一种录像同步回放方法及装置
CN107644440A (zh) * 2017-09-11 2018-01-30 广东欧珀移动通信有限公司 图像处理方法和装置、电子装置和计算机可读存储介质

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6323914B1 (en) * 1999-04-20 2001-11-27 Lsi Logic Corporation Compressed video recording device with integrated effects processing
US20060182425A1 (en) * 2005-02-11 2006-08-17 Paul Boerger Converting a still image to a plurality of video frame images
CN103686450A (zh) * 2013-12-31 2014-03-26 广州华多网络科技有限公司 视频处理方法及系统
US20150294687A1 (en) * 2014-04-11 2015-10-15 Hipstamatic, LLC Automatic Transitions, Wipes and Fades, In A Common Video Recording/Playback Device
US10026450B2 (en) * 2015-03-31 2018-07-17 Jaguar Land Rover Limited Content processing and distribution system and method
CN105120337A (zh) * 2015-08-28 2015-12-02 小米科技有限责任公司 视频特效处理方法、装置及终端设备
CN105763922B (zh) * 2016-04-28 2019-01-04 徐文波 视频处理的方法和装置
US20180014067A1 (en) * 2016-07-11 2018-01-11 Wistia, Inc. Systems and methods for analyzing user interactions with video content

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1971622A (zh) * 2006-12-12 2007-05-30 北京中星微电子有限公司 数字摄像装置的视频动画背景处理方法和系统
JP2011193117A (ja) * 2010-03-12 2011-09-29 Casio Computer Co Ltd 画像処理装置及びプログラム
CN102263906A (zh) * 2011-07-26 2011-11-30 北京数码视讯科技股份有限公司 视频图像的处理方法及装置
CN105430537A (zh) * 2015-11-27 2016-03-23 刘军 对多路数据进行合成的方法、服务器及音乐教学系统
CN107018442A (zh) * 2016-01-28 2017-08-04 浙江宇视科技有限公司 一种录像同步回放方法及装置
CN107644440A (zh) * 2017-09-11 2018-01-30 广东欧珀移动通信有限公司 图像处理方法和装置、电子装置和计算机可读存储介质

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114520875A (zh) * 2022-01-28 2022-05-20 西安维沃软件技术有限公司 视频处理方法、装置及电子设备
CN114520875B (zh) * 2022-01-28 2024-04-02 西安维沃软件技术有限公司 视频处理方法、装置及电子设备

Also Published As

Publication number Publication date
CN111385639B (zh) 2021-02-12
US20220086521A1 (en) 2022-03-17
US11553240B2 (en) 2023-01-10
RU2763518C1 (ru) 2021-12-30
CN111385639A (zh) 2020-07-07

Similar Documents

Publication Publication Date Title
WO2020135055A1 (zh) 视频特效的添加方法、装置、设备及存储介质
US9591237B2 (en) Automated generation of panning shots
WO2021115136A1 (zh) 视频图像的防抖方法、装置、电子设备和存储介质
US9288393B2 (en) Estimation of picture motion blurriness
US8704853B2 (en) Modifying graphical paths
US20100166300A1 (en) Method of generating motion vectors of images of a video sequence
CN110418065B (zh) 高动态范围图像运动补偿方法、装置及电子设备
US20130329063A1 (en) Noise reduction based on motion sensors
CN110860086B (zh) 数据处理方法、可读存储介质和电子设备
WO2021253186A1 (zh) 信息处理方法、装置和成像系统
JP6814849B2 (ja) 画像処理方法及び装置
EP3886425A1 (en) Panoramic video anti-shake method and portable terminal
JP2008306330A (ja) 情報処理装置、動きベクトル生成プログラムおよび補間画像生成プログラム
EP2735165A1 (en) Display apparatus for displaying 3d images
CN110689502B (zh) 一种图像处理方法及相关装置
WO2017168528A1 (ja) 画像処理装置、画像処理方法および画像処理プログラム
EP3522114B1 (en) Method, device and system for time aligning a frame of a video stream with respect to reference frames of a reference video stream
JP6766203B2 (ja) ビデオ最適化処理システム及び方法
CN112866670A (zh) 基于双目时空自适应的手术3d视频稳像合成系统及方法
CN107534736A (zh) 终端的图像配准方法、装置和终端
JP5459231B2 (ja) 擬似立体画像生成装置、擬似立体画像生成プログラム及び擬似立体画像表示装置
WO2023036275A1 (zh) 视频处理方法、装置、电子设备、介质及程序产品
KR102561903B1 (ko) 클라우드 서버를 이용한 ai 기반의 xr 콘텐츠 서비스 방법
WO2023236767A1 (zh) 音视频处理方法及其装置、存储介质
CN117135460A (zh) 图像校正方法及其装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19901766

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19901766

Country of ref document: EP

Kind code of ref document: A1