WO2021026785A1 - Procédé et appareil de traitement vidéo et support de stockage - Google Patents

Procédé et appareil de traitement vidéo et support de stockage Download PDF

Info

Publication number
WO2021026785A1
WO2021026785A1 PCT/CN2019/100452 CN2019100452W WO2021026785A1 WO 2021026785 A1 WO2021026785 A1 WO 2021026785A1 CN 2019100452 W CN2019100452 W CN 2019100452W WO 2021026785 A1 WO2021026785 A1 WO 2021026785A1
Authority
WO
WIPO (PCT)
Prior art keywords
frame
speed
video
original
speed adjustment
Prior art date
Application number
PCT/CN2019/100452
Other languages
English (en)
Chinese (zh)
Inventor
李菊梅
蒋松艳
Original Assignee
深圳市大疆创新科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市大疆创新科技有限公司 filed Critical 深圳市大疆创新科技有限公司
Priority to PCT/CN2019/100452 priority Critical patent/WO2021026785A1/fr
Priority to CN201980033825.4A priority patent/CN112154670A/zh
Publication of WO2021026785A1 publication Critical patent/WO2021026785A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/172—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects

Definitions

  • the present invention relates to the field of image processing technology, and in particular to a video processing method, device and storage medium.
  • the video speed adjustment method in the prior art is often a single speed adjustment for the entire video, that is, the entire video is edited and played at 2x speed or 0.5x speed, which cannot meet the individual needs of users.
  • the embodiments of the present invention provide a video processing method, device, and storage medium, which are used to solve the problem in the prior art that only a single speed adjustment can be performed for the entire video and cannot meet the individual needs of users.
  • the first aspect of the embodiments of the present invention is to provide a video processing method, including:
  • the video speed adjustment information includes: the frame position of the speed adjustment initial frame in the original video, the frame position of the speed adjustment end frame in the original video, and the initial speed corresponding to the speed adjustment initial frame, the The target speed corresponding to the end frame of speed adjustment;
  • the second aspect of the present invention is to provide a video processing device, including:
  • Memory used to store computer programs
  • the processor is configured to run a computer program stored in the memory to achieve: acquiring video speed adjustment information, the video speed adjustment information including: the frame position of the speed adjustment initial frame in the original video, and the speed adjustment end frame of the original video Frame position, and the initial speed corresponding to the initial frame of speed adjustment, and the target speed corresponding to the end frame of speed adjustment; determine the corresponding frame of each frame in the target video in the original video according to the video speed adjustment information Position, wherein the target video is a video obtained by adjusting the speed of the original video; the target video is acquired according to the frame position of each frame in the target video corresponding to the original video.
  • the third aspect of the present invention is to provide a computer-readable storage medium, the storage medium is a computer-readable storage medium, the computer-readable storage medium stores program instructions, the program instructions are used in the first aspect The video processing method described.
  • the video speed adjustment information is obtained, and the corresponding frame position of each frame in the target video in the original video is determined according to the video speed adjustment information, and then according to the target video
  • Each frame in the original video corresponds to the position of the frame in the original video, so as to obtain the target video after the speed adjustment process, which can realize the variable speed adjustment of the video, improve the display effect of the target video, and meet the user's need for video speed adjustment. Individual needs.
  • the fourth aspect of the present invention is to provide a video processing method, including:
  • the video speed adjustment information includes: the frame position of the speed adjustment initial frame in the original video, the frame position of the speed adjustment end frame in the original video, and the initial speed corresponding to the speed adjustment initial frame, the The target speed corresponding to the end frame of speed adjustment;
  • the fifth aspect of the present invention is to provide a video processing device, including:
  • Memory used to store computer programs
  • the processor is configured to run a computer program stored in the memory to achieve: acquiring video speed adjustment information, the video speed adjustment information including: the frame position of the speed adjustment initial frame in the original video, and the speed adjustment end frame of the original video Frame position, and the initial speed corresponding to the initial frame of speed adjustment, and the target speed corresponding to the end frame of speed adjustment; determine the speed adjustment parameter corresponding to the target video after the original video speed adjustment according to the video speed adjustment information,
  • the speed adjustment parameter includes a speed adjustment start time, an original time length, and a target time length after speed adjustment; and the target video is acquired according to the speed adjustment parameter.
  • the sixth aspect of the present invention is to provide a computer-readable storage medium, the storage medium is a computer-readable storage medium, the computer-readable storage medium stores program instructions, and the program instructions are used in the fourth aspect.
  • the video processing method provided in this embodiment obtains video speed adjustment information, determines the speed adjustment parameter corresponding to the target video after the original video speed adjustment according to the video speed adjustment information, and obtains all speed adjustment parameters according to the speed adjustment parameter.
  • the variable speed adjustment of the video can be realized, the display effect of the target video is improved, and the individual needs of users for video speed adjustment can be met.
  • FIG. 1 is a schematic flowchart of a video processing method provided by an embodiment of the present invention
  • FIG. 2 is a schematic flowchart of determining the corresponding frame position of each frame in the target video in the original video according to the video speed adjustment information according to an embodiment of the present invention
  • Figure 3 is an embodiment of the present invention for determining the corresponding frame position of each frame in the target video in the original video according to the original frame position corresponding to the part of the video frame, the adjusted frame position and the playback speed Flow chart one;
  • FIG. 4 is a schematic flow chart of determining the original frame position, the adjusted frame position, and the playback speed corresponding to some video frames in the original video according to the video speed adjustment information according to an embodiment of the present invention
  • FIG. 5 is a schematic diagram 1 of the process of obtaining the original frame position corresponding to the speed-adjusted initial frame, the frame position after the speed-adjustment, and the playback speed according to an embodiment of the present invention
  • FIG. 6 is a second schematic diagram of the process of obtaining the original frame position corresponding to the speed-adjusted initial frame, the frame position after the speed-adjustment, and the playback speed according to an embodiment of the present invention
  • FIG. 7 is an embodiment of the present invention to determine the original frame position and speed adjustment corresponding to the speed adjustment intermediate frame at least partly according to the original frame position corresponding to the speed adjustment initial frame, the speed adjustment frame position and the playback speed Schematic diagram of the flow of post frame position and playback speed;
  • FIG. 8 is an embodiment of the present invention for determining the corresponding frame position of each frame in the target video in the original video according to the original frame position corresponding to the partial video frame, the adjusted frame position, and the playback speed.
  • FIG. 9 is a schematic flowchart of another video processing method provided by an embodiment of the present invention.
  • FIG. 10 is a schematic flowchart of determining the speed adjustment parameter corresponding to the target video after the original video speed adjustment according to the video speed adjustment information according to an embodiment of the present invention
  • FIG. 11 is a schematic diagram of a scene of a video processing method provided by an application embodiment of the present invention.
  • FIG. 12 is a schematic structural diagram of a video processing apparatus provided by an embodiment of the present invention.
  • FIG. 13 is a schematic structural diagram of a video processing apparatus provided by an embodiment of the present invention.
  • the video speed adjustment method in the prior art is often a single speed adjustment for the entire video, that is, the entire The video is edited and played at 2x speed or 0.5x speed, which cannot meet the individual needs of users.
  • the embodiments of the present invention provide a video processing method, device, and storage medium, which are used to solve the problem that the prior art can only perform a single speed adjustment for the entire video, and cannot meet the individual needs of users. .
  • the video processing method provided by the embodiment of the present invention can be used to process aerial video.
  • the user can remotely control the unmanned aerial vehicle through the control terminal to shoot the target scene while the unmanned aerial vehicle is hovering or moving.
  • the video captured by the unmanned aerial vehicle can be transmitted to the control terminal through the wireless communication link, and further ,
  • the control terminal is equipped with an application program (APP) that can edit the video.
  • the APP can adjust the speed of the aerial video taken by the unmanned aerial vehicle.
  • the user can select the frame position of the speed adjustment initial frame and the frame position of the speed adjustment end frame, and the initial speed corresponding to the speed adjustment initial frame and the target speed corresponding to the speed adjustment end frame.
  • the speed adjustment initial frame may be the 60th frame of the original aerial video
  • the speed adjustment end frame may be the 600th frame of the original aerial video.
  • the initial speed may be 1x speed
  • the target speed may be 2x speed.
  • the video processing method provided by the embodiment of the present invention can obtain a speed-regulated target video whose playback speed gradually changes from 1x speed to 2x speed. Different from the prior art in which the entire video is played at twice the speed, the embodiment of the present invention can realize the variable speed adjustment of the video, improve the display effect of the target video, and meet the individual needs of users for video speed adjustment.
  • FIG. 1 is a schematic flowchart of a video processing method provided by an embodiment of the present invention; referring to FIG. 1, this embodiment provides a video processing method.
  • the execution body of the method is a video processing device, which can be It is conceivable that the processing device can be implemented as software, or a combination of software and hardware. Specifically, the method may include:
  • the video speed adjustment information includes: the frame position of the speed adjustment initial frame in the original video, the frame position of the speed adjustment end frame in the original video, and the initial speed and speed adjustment end frame corresponding to the speed adjustment initial frame The corresponding target speed.
  • the video speed adjustment information may be speed adjustment information for all original videos, or may also be speed adjustment information for part of the original videos.
  • the speed adjustment initial frame in the video speed adjustment information is the first frame in the original video
  • the speed adjustment end frame is the original video Last frame
  • the speed control initial frame in the video speed control information can be the first frame in the original video
  • the speed control end frame can be the middle of the original video Frame
  • the speed adjustment initial frame in the video speed adjustment information is the first intermediate frame in the original video
  • the speed adjustment end frame can be the second intermediate frame or the last frame in the original video, where the second intermediate frame corresponds
  • the frame position of is greater than the frame position corresponding to the first intermediate frame.
  • this embodiment does not limit the specific acquisition method of video speed adjustment information.
  • the user can input video adjustment parameters for the original video and adjust the parameters according to the video.
  • the video speed adjustment information can be determined; or, the user can perform an operation on the original video input, and determine the frame position of the speed adjustment initial frame in the original video and the frame position of the speed adjustment end frame in the original video according to the performed operation; After obtaining the frame positions of the speed adjustment initial frame and the speed adjustment end frame in the original video, you can configure the speed of the speed adjustment initial frame and the speed adjustment end frame to obtain the initial speed and speed adjustment corresponding to the speed adjustment initial frame The target speed corresponding to the end frame.
  • those skilled in the art can also use other methods to obtain the video speed adjustment information, as long as the accuracy and reliability of the acquisition of the video speed adjustment information can be ensured, which will not be repeated here.
  • S2 Determine the corresponding frame position of each frame in the target video in the original video according to the video speed adjustment information, where the target video is a video after speed adjustment of the original video.
  • the video speed adjustment information can be analyzed and processed, so that the frame position of each frame in the target video corresponding to the original video can be obtained.
  • the frame position of the speed adjustment initial frame is 60 frames
  • the frame position of the speed adjustment end frame is 70 frames
  • the initial speed corresponding to the speed adjustment initial frame is 1x speed
  • the target speed corresponding to the speed adjustment end frame is 2x speed
  • taking the 67th frame in the target video as an example, through the analysis and processing of the above video speed adjustment information, it can be determined that the 67th frame in the target video corresponds to the 69th frame in the original video, that is, the frame in the target video
  • the 67th frame corresponds to the 69th frame in the original video.
  • the corresponding frame After obtaining the corresponding frame position of each frame in the target video in the original video, the corresponding frame can be obtained through the corresponding frame position of each frame in the target video in the original video, and all the obtained frames constitute In addition to the target video, further, the target video can be displayed.
  • the corresponding frame position of each frame in the target video in the original video is determined according to the video speed adjustment information, and then according to the position of each frame in the target video in the original video.
  • the corresponding frame position in the video so as to obtain the target video after the speed adjustment process.
  • each frame or every few frames in the target video corresponds to a different playback speed, thus realizing the variable speed adjustment of the video and improving
  • the display effect of the target video meets the individual needs of users for video speed adjustment.
  • Fig. 2 is a schematic flow chart of determining the corresponding frame position of each frame in the target video in the original video according to the video speed adjustment information provided by an embodiment of the present invention; on the basis of the above embodiment, continue to refer to Fig. 2.
  • determining the corresponding frame position of each frame in the target video in the original video according to the video speed adjustment information may include:
  • S21 According to the video speed adjustment information, determine the original frame position, the speed adjusted frame position and the playback speed corresponding to some video frames in the original video.
  • Some video frames include the speed adjustment initial frame, the speed adjustment initial frame and the speed adjustment end The speed-adjusted intermediate frame between frames.
  • the initial speed corresponding to the speed adjustment initial frame and the target speed corresponding to the speed adjustment end frame may be the same or different.
  • part of the video frames in the original video can also include several speed-adjusting intermediate frames between the speed-adjusting initial frame and the speed-adjusting end frame; for the speed-adjusting intermediate frame, the initial speed corresponding to the initial frame
  • the speeds of several speed adjustment intermediate frames may be the same as or different from the initial speeds corresponding to the speed adjustment initial frame.
  • the initial speed corresponding to the existing speed adjustment initial frame and the target speed corresponding to the speed adjustment end frame are both 1x speed.
  • the speed of the speed intermediate frame is different from the initial speed, and changes gradually; for example, the playback speed of the initial frame, several intermediate frames, and the end frame of the speed adjustment are: 1x speed, 1.2x speed, 1.4x speed, 1.5x speed, 1.3 times speed, 1.1 times speed, 1 times speed, that is, the speed of some intermediate frames of speed adjustment gradually increases first and then gradually decreases.
  • the initial speed corresponding to the speed adjustment initial frame is 1x speed
  • the end speed corresponding to the speed adjustment end frame is 2x speed.
  • the speed of several speed-adjusting intermediate frames can be greater than the initial speed and lower than the ending speed, for example: 1.2 times, 1.4 times, 1.5 times, 1.8 times, 1.9 times, that is, the speeds of several speed-adjusting intermediate frames are gradually increasing.
  • the video speed adjustment information can be analyzed and processed first, so that the original frames corresponding to some video frames in the original video can be obtained
  • This part of the video frame may include: the speed adjustment initial frame, and one or more speed adjustment intermediate frames between the speed adjustment initial frame and the speed adjustment end frame.
  • determining the original frame position, the adjusted frame position, and the playback speed corresponding to some video frames in the original video may include:
  • a method can realize the acquisition of the original frame position and speed adjustment corresponding to the speed adjustment initial frame.
  • the following frame position and playback speed methods include:
  • the frame position of the speed-adjusted initial frame in the original video is directly determined as the original frame position corresponding to the speed-adjusted initial frame.
  • the adjustment can be determined according to the frame position of the speed-adjusted initial frame and the initial speed corresponding to the speed-adjusted initial frame.
  • the speed-adjusted frame position corresponding to the speed initial frame specifically, the ratio of the frame position of the speed-adjusted initial frame to the initial speed corresponding to the speed-adjusted initial frame in the original video can be obtained, and the ratio is determined as the speed-adjusted initial frame.
  • the initial speed corresponding to the speed-adjusting initial frame may be a preset default speed, or may also be a playback speed designated or configured by the user. After the initial speed corresponding to the initial frame of the speed adjustment is obtained, the initial speed corresponding to the initial frame of the speed adjustment can be directly determined as the playback speed corresponding to the initial frame of the speed adjustment.
  • the above method can be used to determine the speed-adjusted frame position of the initial speed-adjusted frame. For example, when the total length of the original video is 90 frames, the frame position of the speed adjustment initial frame is 60 frames, and the frame position of the speed adjustment end frame is 70 frames, the original video is divided into 3 videos by the video speed adjustment information Segments: the first video segment: 1-59 frames, the second video segment: 60-70 frames, and the second video segment: 71-90 frames.
  • the speed of the video frame before the initial frame of the speed adjustment is the playback speed of the first frame in the original video
  • the initial speed corresponding to the 60th frame is 2x speed
  • the speed is the playback speed of the first frame, that is, when the speed is 1x
  • the position of the adjusted frame corresponding to the initial frame of the speed adjustment is related to the playback speed of the first frame.
  • the following methods can be used to determine the position of the frame after the speed adjustment of the initial frame.
  • the frame position of the speed-adjusted initial frame in the original video is directly determined as the original frame position corresponding to the speed-adjusted initial frame.
  • the initial speed corresponding to the speed-adjusting initial frame may be a preset default speed, or may also be a playback speed designated or configured by the user. After the initial speed corresponding to the initial frame of the speed adjustment is obtained, the initial speed corresponding to the initial frame of the speed adjustment can be directly determined as the playback speed corresponding to the initial frame of the speed adjustment.
  • step S2111 and steps S2112 and S2113 in this embodiment is not limited to the order shown by the serial number, that is, steps S2112 and S2113 can also be performed before step S2111, or step S2112 , S2113 can also be executed simultaneously with step S2111.
  • step S2114 and steps S2115 and S2116 is not limited to the order shown by the serial number. That is, steps S2115 and S2116 can also be executed before step S2114, or steps S2115 and S2116 can also be executed before step S2114. Simultaneous execution.
  • S212 Determine the original frame position, the speed-adjusted frame position, and the playing speed corresponding to the speed-adjusted intermediate frame at least partly according to the original frame position corresponding to the speed-adjusted initial frame, the frame position after the speed-adjustment, and the playback speed.
  • the adjustment can be determined based at least in part on the original frame position corresponding to the speed-adjusted initial frame, the frame position after the speed-adjustment, and the playback speed.
  • Frame position and playback speed; and the original frame positions corresponding to other speed-adjusted intermediate frames after the first speed-adjusted intermediate frame, the frame position after speed-adjustment, and the playback speed can be based on the original frame of the first speed-adjusted intermediate frame
  • the position, frame position and playback speed after speed adjustment are determined.
  • the original frame position corresponding to the speed-adjusted intermediate frame is determined at least partly based on the original frame position corresponding to the speed-adjusted initial frame, the post-speed-adjusted frame position, and the playback speed.
  • the frame position and playback speed after speed adjustment can include:
  • S2121 Determine the frame position of the frame to be processed in the original video at least partially according to the original frame position and the playback speed corresponding to the speed-regulated initial frame.
  • the frame to be processed is located between the speed adjustment initial frame and the speed adjustment end frame; after obtaining the original frame position and playback speed corresponding to the speed adjustment initial frame, the original frame position and the playback speed corresponding to the speed adjustment initial frame can be at least partially
  • the playback speed determines the frame position of the frame to be processed in the original video.
  • the above “determine the frame position of the frame to be processed in the original video based at least in part on the original frame position and playback speed corresponding to the speed-regulated initial frame” means that the original frame position and the playback speed corresponding to the speed-regulated initial frame
  • the playback speed determines the frame position corresponding to the first frame to be processed adjacent to the initial frame to be processed; and the frame positions corresponding to other frames to be processed after the first frame to be processed can be based on the first frame to be processed
  • the original frame position and playback speed are determined.
  • the original frame position corresponding to the speed adjustment initial frame is org_pos0
  • the playback speed is speed
  • the first frame adjacent to the speed adjustment initial frame to be processed can be determined according to the original frame position and playback speed corresponding to the speed adjustment initial frame
  • the frame position corresponding to the frame: org_pos1 org_pos0+speed
  • the frame positions of multiple frames to be processed in the original video can be obtained.
  • the sum value of org_pos+speed is not an integer
  • the sum value can be rounded, and the rounding method can be rounding down, rounding up, or using other rounding algorithms. More preferably, the sum value can be rounded down, so that the frame positions of multiple frames to be processed can be obtained.
  • S2122 Determine the interpolation speed of the frame to be processed according to the frame position of the frame to be processed in the original video, the frame position of the initial frame of speed adjustment in the original video, the frame position of the end frame of speed adjustment in the original video, and the initial speed and target speed.
  • the frame position of the frame to be processed in the original video After obtaining the frame position of the frame to be processed, the frame position of the frame to be processed in the original video, the frame position of the initial frame of the speed adjustment in the original video, the frame position of the end frame of the speed adjustment in the original video, as well as the initial speed and target
  • the speed is analyzed and processed, so that the interpolation speed of the frame to be processed can be determined.
  • the frame position of the initial frame of speed adjustment is 60 frames
  • the frame position of the end frame of speed adjustment is 70 frames
  • the initial speed is 1x speed
  • the target speed 2x speed
  • the frame position of the frame to be processed is 65 frames
  • the interpolation speed of frame 65 is Double speed.
  • the frame position of the frame to be processed is frame 67
  • the interpolation speed of the 67th frame can be obtained according to the above formula as Double speed.
  • the interpolation speed of the frame to be processed can be analyzed and identified to determine whether the interpolation speed of the frame to be processed meets preset conditions, where the preset conditions include: the interpolation speed of the frame to be processed and The difference in the playback speed corresponding to the previous frame of the frame to be processed is greater than or equal to the preset threshold; the preset threshold here can be set arbitrarily according to different application scenarios and application requirements, for example: when the initial speed is greater than the target speed, the preset threshold Set the threshold as the first preset threshold, that is, the first preset threshold is the minimum adjustment granularity used to implement slow adjustment of the video; when the initial speed is less than the target speed, the preset threshold is different from the first preset The second preset threshold of the threshold is set, that is, the second preset threshold is the minimum adjustment granularity used to realize rapid adjustment of the video.
  • the preset conditions include: the interpolation speed of the frame to be processed and The difference in the playback speed corresponding to the previous frame of the frame to be
  • slow adjustment and fast adjustment can be included.
  • speed ⁇ 1.0 you can set a speed adjustment interval every 0.25, such as: 0%-25%, 25%-50%, 50%-75%, 75%-100%;
  • fast speed Adjust (speed>1.0) you can adjust the interval every 1.0, such as: 100% ⁇ 200%, 200% ⁇ 300%...700% ⁇ 800%.
  • each adjustment interval can be further refined by 8 particles, that is, for a slow video, the smallest particle is 1/32, and the smallest particle for slow adjustment of the original video is the first preview.
  • Set a threshold for fast videos, the smallest particle is 1/8, and the smallest particle for fast adjustment of the original video is the second preset threshold.
  • the result of analyzing and identifying the interpolation speed of the frame to be processed is: when the interpolation speed of the frame to be processed does not meet the preset condition, that is, the difference between the interpolation speed of the frame to be processed and the playback speed corresponding to the previous frame of the frame to be processed If the value is less than the preset threshold, the frame to be processed is discarded, that is, the original frame position, the frame position after speed adjustment, and the playback speed corresponding to the frame to be processed are not calculated.
  • the result of analyzing and identifying the interpolation speed of the frame to be processed is: when the interpolation speed of the frame to be processed meets the preset condition, that is, the difference between the interpolation speed of the frame to be processed and the playback speed corresponding to the previous frame of the frame to be processed If it is greater than or equal to the preset threshold, the frame to be processed can be used as the speed adjustment intermediate frame, and the original frame position corresponding to the frame to be processed, the frame position after speed adjustment, and the playback speed can be obtained. It should be noted that the frame to be processed corresponds to The playback speed of can be determined according to the interpolation speed of the frame to be processed and a preset threshold.
  • the following formula can be used to determine the playback speed corresponding to the video frame:
  • V is the playback speed corresponding to the video frame
  • V p is the interpolation speed
  • ⁇ is the preset threshold
  • "round()" is the rounding function.
  • the preset threshold is 1/32 of the first preset threshold
  • the preset threshold is 1/8 of the second preset threshold, then the playback speed corresponding to the video frame is determined:
  • the speed-adjusting intermediate frame whose interpolation speed meets the preset conditions can be accurately and quickly identified, and the original frame position, the speed-adjusted frame position and the playback speed corresponding to the speed-adjusting intermediate frame can be determined according to the interpolation speed.
  • the speed adjustment intermediate frame refers to at least a part of the video frame between the speed adjustment initial frame and the speed adjustment end frame.
  • the speed adjustment intermediate frame is a part of the part of the video frame. Therefore, the The accuracy and reliability of obtaining the corresponding original frame position, frame position after speed adjustment, and playback speed.
  • S22 Determine the corresponding frame position of each frame in the target video in the original video according to the original frame position, the speed-adjusted frame position, and the playback speed corresponding to some video frames.
  • the original frame position, the adjusted frame position and the playback speed corresponding to some video frames can be analyzed and processed to determine The corresponding frame position of each frame in the target video in the original video.
  • an achievable way is based on the original frame position corresponding to some video frames, the frame position after speed adjustment and Play speed, determine the corresponding frame position of each frame in the target video in the original video, including:
  • S221 Associatively store the original frame position, the frame position after the speed adjustment, and the playback speed corresponding to each video frame in the partial video frames to obtain an association relationship set.
  • the original frame position, the adjusted frame position, and the playback speed of each video frame in some video frames After obtaining the original frame position, the adjusted frame position, and the playback speed of each video frame in some video frames, the original frame position, the adjusted frame position and the playback speed of each video frame can be changed By performing associative storage, an association relationship set can be obtained, and the association relationship set includes an association relationship corresponding to each video frame in the partial video frames.
  • the frame position corresponding to each frame in the target video in the original video can be determined according to the association relationship set.
  • the association relationship set the first association relationship and the second association relationship corresponding to the position of the video frame may be determined.
  • the first association relationship is adjacent to the second association relationship, and each frame in the target video is The corresponding frame position is greater than or equal to the first speed-adjusted frame position corresponding to the first association relationship, and smaller than the second speed-adjusted frame position corresponding to the second association relationship; then, the first association relationship is used to determine the target video The corresponding frame position of each frame in the original video.
  • the frame position of the initial frame of speed adjustment is 60 frames
  • the frame position of the end frame of speed adjustment is 70 frames
  • the initial speed corresponding to the initial frame of speed adjustment is 1x speed
  • the end frame of speed adjustment corresponds to The target speed is 2 times speed.
  • the association relationship set includes the original frame position corresponding to each video frame, the association relationship between the frame position after speed adjustment and the playback speed (original frame Position, frame position after speed adjustment, playback speed), for example, the association relationship includes: (60,60,1), (62,62,1.25), (64.5,64,1.375), (65.875,65,1.5), (67.375,66,1.75), (69.125,67,1.875), (71,68,2).
  • the frame position of the playing frame is the 63rd frame
  • it can be based on the frame to be played in the target video Analyze and compare the frame position with all speed-adjusted frame positions in the association relationship, so that the first association relationship and the second association relationship corresponding to this playback frame can be found, that is, the 63 frames are in the first association relationship (62 /62/1.25) and the second association relationship (64.5/64/1.375) frames), and then obtain the three values (org_pos/speed_pos/speed) stored in association in the first association relationship, where org_pos is 62, The speed_pos is 62, and the speed is 1.25.
  • the association relationship set determine the corresponding frame position of each frame in the target video in the original video, which effectively ensures the accuracy and reliability of the determination of the corresponding frame position of each frame in the target video in the original video, and then can be based on this
  • the frame position plays the target video.
  • each frame of the target video is in the original video according to the original frame position corresponding to some video frames, the frame position after speed adjustment, and the playback speed.
  • the corresponding frame positions include:
  • the frame position corresponding to the currently played frame in the target video can be obtained, and the frame interval corresponding to the currently played frame can be determined by the frame position.
  • the frame position corresponding to the current playback frame is frame 67
  • the frame interval corresponding to the 67 frame can be obtained as (66, 68), where 66 is the interval start frame and 68 is the interval end frame ;
  • the frame position 67 in the frame, the original frame position 67.375 corresponding to the start frame of the interval, the frame position 66 after the speed adjustment and the playback speed 1.75 determine the current playback frame 67 in the target video, and the corresponding frame position in the original video is 69 frames
  • the original position of the current playing frame in the video can be obtained according to org_pos+
  • the target video can be determined according to the frame position To play.
  • determining the original frame position, the frame position after the speed adjustment, and the playback speed corresponding to some video frames in the original video in this embodiment further includes:
  • S213 Determine the original frame position, the speed-adjusted frame position, and the playback speed corresponding to the first frame.
  • the first frame in the original video will also be the first frame in the target video after the speed adjustment, that is, the original frame position and the speed adjustment frame position corresponding to the first frame can be directly obtained, for example, the first frame
  • the corresponding original frame position and the frame position after speed adjustment are all 0, and the playback speed corresponding to the first frame can be a preset default speed, a configured speed or a user-specified playback speed.
  • part of the video frame also includes the speed adjustment end frame; at this time, in this example, determine the original frame position and speed adjustment corresponding to some video frames in the original video.
  • Back frame position and playback speed including:
  • S214 Determine the original frame position, the frame position after the speed adjustment, and the playback speed corresponding to the end frame of the speed adjustment.
  • the original frame position corresponding to the speed adjustment end frame can be determined according to the video length.
  • the original frame position corresponding to the speed adjustment end frame is 70.
  • the playback speed corresponding to the last frame may be the target speed that the speed adjustment end frame needs to achieve, or it may be other speeds that are default or pre-configured.
  • the total length of the original video, the original frame position corresponding to the frame before the last frame, the frame position after speed adjustment, and the playback speed can be obtained, and then according to the original
  • the total length of the video, the original frame position corresponding to the frame before the last frame, the frame position after speed adjustment, and the playback speed determine the frame position after speed adjustment corresponding to the last frame.
  • the following formula can be used to determine the frame position after the speed adjustment corresponding to the last frame:
  • speed_pos_end speed_pos+(length-org_pos)/speed
  • speed_pos_end is the speed-adjusted frame position corresponding to the last frame
  • speed_pos is the speed-adjusted frame position corresponding to the frame before the last frame
  • length is the total length of the original video
  • org_pos is the frame before the last frame.
  • the original frame position, speed is the playback speed corresponding to one frame after the end frame of the speed adjustment.
  • the original video has a total of 70 frames
  • the initial frame of the speed adjustment is the 60th frame in the original video
  • the end frame of the speed adjustment is the 70th frame in the original video.
  • some video frames also include a frame after the speed adjustment end frame and the last frame in the original video; wherein, the frame after the speed adjustment end frame can be Adjacent or not adjacent to the end frame of the speed control.
  • determine the original frame position, the frame position after speed adjustment, and the playback speed corresponding to some video frames in the original video including:
  • S215 Determine the original frame position, the frame position after the speed adjustment, and the playback speed corresponding to a frame after the speed adjustment end frame.
  • the original frame position of the current frame is determined as the frame after the speed adjustment end frame, where the frame position of the frame after the speed adjustment end frame in the original video is based on the last frame of the speed adjustment intermediate frame
  • the original video has a total of 90 frames
  • the initial frame of the speed adjustment is the 60th frame in the original video
  • the end frame of the speed adjustment is the 70th frame in the original video
  • the last frame of the intermediate frame of the speed adjustment corresponds to the (original frame position)
  • the frame position after the speed adjustment, the playback speed) is (69.125, 67, 1.875)
  • the target speed corresponding to the speed adjustment end frame may be determined as the playback speed corresponding to a frame after the speed adjustment end frame.
  • S216 Determine the original frame position, the frame position after the speed adjustment, and the playback speed corresponding to the last frame.
  • the original frame position corresponding to the last frame may be determined according to the video length, for example, the original frame position corresponding to the last frame is 90.
  • the playback speed corresponding to the last frame may be the target speed that the speed adjustment end frame needs to achieve, or it may be other speeds that are default or pre-configured.
  • the total length of the original video, the original frame position corresponding to the frame after the speed adjustment end frame, the frame position after speed adjustment and the playback speed can be obtained, and then according to the original video
  • the total length, the original frame position corresponding to the frame after the speed adjustment end frame, the adjusted frame position and the playback speed determine the adjusted frame position corresponding to the last frame.
  • the following formula can be used to determine the frame position after the speed adjustment corresponding to the last frame:
  • speed_pos_end speed_pos+(length-org_pos)/speed
  • speed_pos_end is the speed-adjusted frame position corresponding to the last frame
  • speed_pos is the speed-adjusted frame position corresponding to a frame after the speed adjustment end frame
  • length is the total length of the original video
  • org_pos is one frame after the speed adjustment end frame.
  • the position of the original frame corresponding to the frame, and speed is the playback speed corresponding to one frame after the end frame of the speed adjustment.
  • the original video has a total of 90 frames
  • the initial frame of the speed adjustment is the 60th frame in the original video
  • the end frame of the speed adjustment is the 70th frame in the original video
  • the frame after the end of the speed adjustment corresponds to the (original frame position)
  • the frame position after speed adjustment, the playback speed) is (71,68,2)
  • record the last frame (90, 77.5, 2).
  • FIG. 9 is a schematic flowchart of another video processing method provided by an embodiment of the present invention. referring to FIG. 9, this embodiment provides another video processing method, and the execution subject of the method is a video processing device ,
  • the processing device may be implemented as software or a combination of software and hardware.
  • the application environment of the video processing method provided in this embodiment is different from the application environment of the video processing method corresponding to FIG. 1, and the application environment of the video processing method corresponding to FIG.
  • the constituted application environment, the application environment of the video processing method provided in this embodiment may include an application environment constituted based on the IOS system.
  • the method may include:
  • the video speed adjustment information includes: the frame position of the speed adjustment initial frame in the original video, the frame position of the speed adjustment end frame in the original video, and the initial speed and speed adjustment end frame corresponding to the speed adjustment initial frame The corresponding target speed.
  • step S101 in this embodiment are similar to the specific implementation manner and implementation effect of step S1 in the foregoing embodiment.
  • the foregoing statement content please refer to the foregoing statement content, which is not repeated here.
  • S102 Determine the speed adjustment parameter corresponding to the target video after the speed adjustment of the original video according to the video speed adjustment information, where the speed adjustment parameter includes the speed adjustment start time, the original time length, and the target time length after the speed adjustment.
  • the speed adjustment parameter corresponding to the target video after the speed adjustment of the original video is determined according to the video speed adjustment information may include:
  • S1021 According to the video speed adjustment information, determine the original frame position, the speed adjusted frame position, and the playback speed of some video frames in the original video.
  • Some video frames include the speed adjustment initial frame and the speed adjustment initial frame and the speed adjustment end frame Adjust the speed between intermediate frames.
  • step S1021 in this embodiment are similar to the specific implementation manner and implementation effect of step S21 in the foregoing embodiment.
  • S1022 Associatively store the original frame position, the speed-adjusted frame position, and the playback speed corresponding to each video frame in the partial video frames to obtain an association relationship set.
  • step S1022 in this embodiment are similar to the specific implementation manner and implementation effect of step S221 in the foregoing embodiment.
  • the foregoing statement content please refer to the foregoing statement content, which will not be repeated here.
  • S1023 Determine the speed adjustment parameter corresponding to the target video after the speed adjustment of the original video according to the association relationship set.
  • the preset processing algorithm can be used to analyze and process the association relationship set, so that the speed adjustment parameter corresponding to the target video after the original video speed adjustment can be determined.
  • the speed adjustment parameter includes the speed adjustment start time , Original duration and target duration after speed adjustment.
  • the target video can be obtained according to the speed adjustment parameters, thereby achieving stable and effective playback of the target video after the speed adjustment processing.
  • the embodiment of the present invention is equivalent to dividing the entire video into multiple video segments, and each video segment corresponds to a different playback speed, thereby realizing variable speed regulation of the video as a whole.
  • the video processing method provided in this embodiment obtains video speed adjustment information, determines the speed adjustment parameter corresponding to the target video after the original video speed adjustment according to the video speed adjustment information, and obtains the target video according to the speed adjustment parameter, thereby realizing the speed change Speed adjustment improves the display effect of the target video and meets the individual needs of users for video speed adjustment.
  • this application embodiment provides a video processing method.
  • the execution body of the method is a video processing device.
  • the processing device executes the video processing method, it may include a video processing method.
  • the process of acquisition and video processing specifically:
  • step0 Get the video data to be processed.
  • the video data of the target object can be acquired through the camera on the drone.
  • an airship/unmanned vehicle and a camera can be used to obtain the video data for the target object; or the remote control car and a 360° camera can be used to obtain the video data for the target object; or the camera linkage technology can be used to obtain the video data.
  • the video data for the target object can be acquired through the camera on the drone.
  • an airship/unmanned vehicle and a camera can be used to obtain the video data for the target object; or the remote control car and a 360° camera can be used to obtain the video data for the target object; or the camera linkage technology can be used to obtain the video data.
  • step2 The processing device that transmits the video data to, and the processing device processes the video data.
  • the processing device may be a mobile phone, a tablet computer, a desktop computer, etc., a terminal device that can process video data.
  • the video data can be processed.
  • the video data can be adjusted slowly or quickly; among them, for the slow adjustment (speed ⁇ 1.0), an interval of 0.25, such as 0 % ⁇ 25%, 25% ⁇ 50%, 50% ⁇ 75%, 75% ⁇ 100%; for fast adjustment (speed>1.0), every 1.0 interval, such as 100% ⁇ 200%, 200% ⁇ 300%. . . 700% ⁇ 800%.
  • 8 particles can be further refined, that is, for slow videos, the smallest particle is 1/32, and for fast videos, the smallest particle is 1/8.
  • the initial frame of speed adjustment A point is the 60th frame
  • the speed is 1x speed
  • the end frame of speed adjustment B is the 70th frame
  • the speed is 2x speed as an example.
  • org_pos(i) is the corresponding original frame position of the i-th frame
  • speed_pos(i) is the frame position of the i-th frame after speed adjustment
  • org_speed is the interpolation speed obtained by linear interpolation
  • slow Speed adjustment: speed round(org_speed*32)/32
  • the method includes the following steps:
  • step2.1 Through linear interpolation, the interpolation speed of each frame from frame 60 to frame 70 can be 1, 1.1, 1.2, 1.3, 1.4, 1.5, 1.6, 1.7, 1.8, 1.9, 2. This step is optional, and the interpolation speed of the speed-adjusting intermediate frame can also be obtained in the subsequent steps.
  • the above processing points are rounded. In order to ensure the quality and efficiency of data processing, the above processing points can be rounded down. 63 frames to be processed can be obtained. At this time, the obtained 63 frames are the video frames skipped by the previous calculation.
  • step 2.13 In addition, for the first frame in the original video, the association relationship of the first frame can be recorded as (0, 0, 1).
  • the arrays stored so far are (0,0,1); (60,60,1); (62,62,1.25); (64.5,64,1.375); (65.875,65,1.5); (67.375,66, 1.75); (69.125,67,1.875); (71,68,2); (90,77.5,2).
  • the playback speed is different, which can increase the playback effect of the video.
  • the playback effect of the video can be gradually accelerated or changed gradually. Slow, or make the playback effect of the video gradually speed up first, then gradually slow down, etc., so that the playback effect of the video has been greatly improved and improved to meet the individual needs of users.
  • step2.14 When playing the video, when the application system of the processing device is the Android system, the time stamp of the currently played frame can be obtained, and then the time stamp is sent to the decoder, so that the corresponding display can be obtained frame.
  • the example is 62/62/1.25.
  • the current playback frame is 67, 67 is between 66 (67.375, 66, 1.75) and 68 (71, 68, 2). Therefore, according to the formula org_pos+(pos-speed_pos)*speed, the current playback frame is obtained
  • the current playback frame is 70 frames, 70 is between 68 (71, 68, 2) and 77.5 (90, 77.5, 2). Therefore, according to the formula org_pos+(pos-speed_pos)*speed, the current playback frame is obtained
  • step2.15 When playing the video, when the application system of the processing device is the ios system, you can calculate the start time of each interval, the original duration and the target after the speed adjustment according to the interval of the recording array. Time length, the speed adjustment start time, original time length, and target time length after speed adjustment are sent to the corresponding interface as speed adjustment parameters, and then the decoder can automatically return to what is needed after speed adjustment according to the received speed adjustment parameters Video frame.
  • FIG. 12 is a schematic structural diagram of a video processing apparatus provided by an embodiment of the present invention; the video processing apparatus may include: one or more first processors 21 and one or more first memories 22.
  • the first memory 22 is used to store a program for executing the video processing method provided in the embodiments shown in FIG. 1 to FIG. 8 and FIG. 11.
  • the first processor 21 is configured to execute a program stored in the first memory 22. specific,
  • the program includes one or more computer instructions, where one or more computer instructions can implement the following steps when executed by the first processor 21:
  • the video speed adjustment information includes: the frame position of the speed adjustment initial frame in the original video, the frame position of the speed adjustment end frame in the original video, and The initial speed corresponding to the initial frame of the speed adjustment and the target speed corresponding to the end frame of the speed adjustment; determine the corresponding frame position of each frame in the target video in the original video according to the video speed adjustment information, where the target video is to adjust the original video Speeded up video; Obtain the target video according to the corresponding frame position of each frame in the target video in the original video.
  • the structure of the video processing apparatus may further include a first communication interface 23 for the electronic device to communicate with other devices or a communication network.
  • the first processor 21 is further configured to: according to the video speed adjustment information, determine the original frame position, the speed adjusted frame position, and the playback speed corresponding to some video frames in the original video, and some video frames include the speed adjustment initial Frame, the intermediate frame between the initial frame and the end frame; according to the original frame position corresponding to the part of the video frame, the frame position after the speed adjustment and the playback speed, it is determined that each frame in the target video is in the original The corresponding frame position in the video.
  • the first processor 21 is further configured to: associate and store the original frame position, the frame position after speed adjustment, and the playback speed corresponding to each video frame in the partial video frames to obtain an association relationship set; Set, determine the corresponding frame position of each frame in the target video in the original video.
  • the first processor 21 is further configured to: obtain the original frame position corresponding to the speed-adjusted initial frame, the post-speed-adjusted frame position, and the playback speed; at least partly according to the original frame position and the speed-adjusted initial frame. Determine the position of the frame after speed adjustment and the playback speed, determine the original frame position corresponding to the middle frame of speed adjustment, the position of the frame after speed adjustment, and the playback speed.
  • the first processor 21 is further configured to: determine the original frame position corresponding to the speed adjustment initial frame according to the frame position of the speed adjustment initial frame in the original video; and according to the frame position and adjustment of the speed adjustment initial frame in the original video
  • the initial speed corresponding to the speed initial frame is determined to determine the position of the adjusted frame corresponding to the initial frame of speed adjustment; the playback speed corresponding to the initial frame of speed adjustment is determined according to the initial speed corresponding to the initial frame of speed adjustment.
  • the first processor 21 is further configured to: determine the original frame position corresponding to the speed adjustment initial frame according to the frame position of the speed adjustment initial frame in the original video; according to the frame position of the speed adjustment initial frame in the original video and the original video The playback speed of the first frame in the middle, determine the frame position after the speed adjustment corresponding to the initial frame of the speed adjustment; determine the playback speed corresponding to the initial frame of the speed adjustment according to the initial speed corresponding to the speed adjustment initial frame.
  • the first processor 21 is further configured to: determine the frame position of the frame to be processed in the original video at least in part according to the original frame position and the playback speed corresponding to the initial frame of the speed adjustment; according to the frame of the frame to be processed in the original video The position, the frame position of the initial frame of the speed adjustment in the original video, the frame position of the end frame of the speed adjustment in the original video, as well as the initial speed and target speed, determine the interpolation speed of the frame to be processed; when the interpolation speed of the frame to be processed meets the preset conditions
  • the frame to be processed is used as an intermediate frame for speed adjustment, and the original frame position, the frame position after speed adjustment, and the playback speed corresponding to the frame to be processed are obtained; otherwise, the frame to be processed is discarded.
  • the preset condition includes: the difference between the interpolation speed of the frame to be processed and the playback speed corresponding to the previous frame of the frame to be processed is greater than or equal to a preset threshold.
  • the playback speed of the frame to be processed is determined according to the interpolation speed of the frame to be processed and a preset threshold.
  • the preset threshold when the initial speed is greater than the target speed, the preset threshold is a first preset threshold, and when the initial speed is less than the target speed, the preset threshold is a second preset threshold different from the first preset threshold.
  • the first processor 21 is further configured to: determine the original frame position corresponding to the first frame and the speed-adjusted frame Position and playback speed.
  • the speed adjustment end frame is the last frame of the original video
  • some of the video frames also include the speed adjustment end frame
  • the first processor 21 is also used for determining the original frame position corresponding to the speed adjustment end frame, and the speed adjustment Post frame position and playback speed.
  • the first processor 21 is further configured to: determine The position of the original frame, the position of the frame after the speed adjustment, and the playback speed of the frame after the end of the speed adjustment frame; the original frame position, the position of the frame after the speed adjustment, and the playback speed corresponding to the last frame are determined.
  • the frame position of a frame in the original video after the speed adjustment end frame is determined according to the original frame position and the playback speed corresponding to the last frame of the speed adjustment intermediate frame.
  • the first processor 21 is further configured to: obtain the frame interval corresponding to each frame in the target video, the interval start frame and the interval end frame of the frame interval are two adjacent frames in the partial video frame; The frame position of each frame in the video in the target video, the original frame position corresponding to the start frame of the interval, the frame position after speed adjustment, and the playback speed are determined to determine the corresponding frame position of each frame in the target video in the original video.
  • the device shown in FIG. 12 can execute the methods of the embodiments shown in FIG. 1 to FIG. 8 and FIG. 11.
  • parts that are not described in detail in this embodiment please refer to the related descriptions of the embodiments shown in FIG. 1 to FIG. 8 and FIG. 11.
  • the implementation process and technical effects of this technical solution please refer to the description in the embodiments shown in FIG. 1 to FIG. 8 and FIG. 11, and will not be repeated here.
  • an embodiment of the present invention provides a computer-readable storage medium.
  • the storage medium is a computer-readable storage medium.
  • the computer-readable storage medium stores program instructions. 11 video processing methods.
  • FIG. 13 is a schematic structural diagram of a video processing apparatus provided by an embodiment of the present invention
  • the video processing apparatus may include: one or more second processors 41 and one or more second memories 42.
  • the second memory 42 is used to store a program for executing the video processing method provided in the embodiment shown in FIG. 9-11.
  • the first processor 41 is configured to execute a program stored in the second memory 42. specific,
  • the program includes one or more computer instructions, and when one or more computer instructions are executed by the second processor 41, the following steps can be implemented:
  • the video speed adjustment information includes: the frame position of the speed adjustment initial frame in the original video, the frame position of the speed adjustment end frame in the original video, and The initial speed corresponding to the initial frame of the speed adjustment and the target speed corresponding to the end frame of the speed adjustment; the speed adjustment parameters corresponding to the target video after the original video speed adjustment are determined according to the video speed adjustment information.
  • the speed adjustment parameters include the speed adjustment start time and original duration And the target duration after speed adjustment; according to the speed adjustment parameters, the target video is obtained.
  • the structure of the video processing apparatus may further include a second communication interface 43 for the electronic device to communicate with other devices or a communication network.
  • the second processor 41 is further configured to: according to the video speed adjustment information, determine the original frame position, the speed adjusted frame position, and the playback speed corresponding to some video frames in the original video, and some video frames include the speed adjustment initial frame And the speed adjustment intermediate frame located between the speed adjustment initial frame and the speed adjustment end frame; the original frame position, the speed adjustment frame position and the playback speed corresponding to each video frame in the partial video frame are associated and stored to obtain the association Relationship set: According to the association relationship set, determine the speed adjustment parameter corresponding to the target video after the original video speed adjustment.
  • the device shown in FIG. 13 can execute the method of the embodiment shown in FIG. 9-11.
  • parts that are not described in detail in this embodiment please refer to the related description of the embodiment shown in FIG. 9-11.
  • an embodiment of the present invention provides a computer-readable storage medium, the storage medium is a computer-readable storage medium, the computer-readable storage medium stores program instructions, and the program instructions are used to implement the video shown in FIGS. 9-11. ⁇ Treatment methods.
  • the disclosed video processing device and method can be implemented in other ways.
  • the embodiments of the remote control device described above are merely illustrative.
  • the division of the modules or units is only a logical function division, and there may be other divisions in actual implementation, such as multiple units or components. Can be combined or integrated into another system, or some features can be ignored or not implemented.
  • the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, remote control devices or units, and may be in electrical, mechanical or other forms.
  • the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.
  • the functional units in the various embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit.
  • the above-mentioned integrated unit can be implemented in the form of hardware or software functional unit.
  • the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer readable storage medium.
  • the technical solution of the present invention essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium , Including several instructions to make a computer processor (processor) execute all or part of the steps of the method described in each embodiment of the present invention.
  • the aforementioned storage media include: U disk, mobile hard disk, Read-Only Memory (ROM), Random Access Memory (RAM, Random Access Memory), magnetic disks or optical disks and other media that can store program codes.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Television Signal Processing For Recording (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

La présente invention concerne un procédé et un appareil de traitement vidéo, ainsi qu'un support de stockage. Le procédé comprend les étapes consistant à : acquérir des informations de régulation de vitesse vidéo, les informations de régulation de vitesse vidéo comprenant : une position de trame d'une trame initiale de régulation de vitesse dans une vidéo d'origine, une position de trame d'une trame de fin de régulation de vitesse dans la vidéo d'origine, une vitesse initiale correspondant à la trame initiale de régulation de vitesse et une vitesse cible correspondant à la trame de fin de régulation de vitesse; déterminer, en fonction des informations de régulation de vitesse vidéo, une position de trame correspondante, dans la vidéo d'origine, de chaque trame dans une vidéo cible, la vidéo cible étant une vidéo obtenue après que la vidéo d'origine a été soumise à une régulation de vitesse; et acquérir la vidéo cible en fonction de la position de trame correspondante, dans la vidéo d'origine, de chaque trame dans la vidéo cible. La vidéo cible après un traitement de régulation de vitesse peut être acquise de manière stable au moyen de l'acquisition d'informations de régulation de vitesse vidéo, et des vitesses de lecture correspondant à chaque trame ou chaque trame dans la vidéo cible sont différentes, de telle sorte qu'une régulation de vitesse variable est réalisée, l'effet d'affichage d'une vidéo est amélioré et les exigences personnalisées d'un utilisateur pour la régulation de vitesse vidéo sont satisfaites.
PCT/CN2019/100452 2019-08-13 2019-08-13 Procédé et appareil de traitement vidéo et support de stockage WO2021026785A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/CN2019/100452 WO2021026785A1 (fr) 2019-08-13 2019-08-13 Procédé et appareil de traitement vidéo et support de stockage
CN201980033825.4A CN112154670A (zh) 2019-08-13 2019-08-13 视频的处理方法、装置和存储介质

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2019/100452 WO2021026785A1 (fr) 2019-08-13 2019-08-13 Procédé et appareil de traitement vidéo et support de stockage

Publications (1)

Publication Number Publication Date
WO2021026785A1 true WO2021026785A1 (fr) 2021-02-18

Family

ID=73891558

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/100452 WO2021026785A1 (fr) 2019-08-13 2019-08-13 Procédé et appareil de traitement vidéo et support de stockage

Country Status (2)

Country Link
CN (1) CN112154670A (fr)
WO (1) WO2021026785A1 (fr)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040179825A1 (en) * 2003-03-11 2004-09-16 Im Jin Seok Digital video record/playback apparatus and playback method thereof
CN101075949A (zh) * 2006-05-15 2007-11-21 中兴通讯股份有限公司 一种改变流媒体文件播放速度的方法
CN101534405A (zh) * 2004-03-31 2009-09-16 松下电器产业株式会社 用于可变帧速率记录的视频记录设备
US20140003516A1 (en) * 2012-06-28 2014-01-02 Divx, Llc Systems and methods for fast video startup using trick play streams
US20140359678A1 (en) * 2013-05-30 2014-12-04 Sonic Ip, Inc. Device video streaming with trick play based on separate trick play files
US9025927B2 (en) * 2009-03-25 2015-05-05 Cyberlink Corp. Systems and methods of variable frame rate playback
CN104702975A (zh) * 2015-03-24 2015-06-10 北京中熙正保远程教育技术有限公司 用于远程授课的Flash视频变速播放方法
CN104869430A (zh) * 2015-05-18 2015-08-26 北京中熙正保远程教育技术有限公司 一种视频倍速播放方法及装置

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8233772B1 (en) * 2007-04-16 2012-07-31 Adobe Systems Incorporated Generating transitions for remapping video playback time
US8170396B2 (en) * 2007-04-16 2012-05-01 Adobe Systems Incorporated Changing video playback rate
US8978077B2 (en) * 2009-02-23 2015-03-10 Qualcomm Incorporated Video content presentation
CN102547192B (zh) * 2010-12-21 2017-12-29 新奥特（北京）视频技术有限公司 一种对录像图像设置自动变速播放及回放功能的方法
CN104616338B (zh) * 2015-01-26 2018-02-27 江苏如意通动漫产业有限公司 基于二维动画的时空一致的变速内插方法

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040179825A1 (en) * 2003-03-11 2004-09-16 Im Jin Seok Digital video record/playback apparatus and playback method thereof
CN101534405A (zh) * 2004-03-31 2009-09-16 松下电器产业株式会社 用于可变帧速率记录的视频记录设备
CN101075949A (zh) * 2006-05-15 2007-11-21 中兴通讯股份有限公司 一种改变流媒体文件播放速度的方法
US9025927B2 (en) * 2009-03-25 2015-05-05 Cyberlink Corp. Systems and methods of variable frame rate playback
US20140003516A1 (en) * 2012-06-28 2014-01-02 Divx, Llc Systems and methods for fast video startup using trick play streams
US20140359678A1 (en) * 2013-05-30 2014-12-04 Sonic Ip, Inc. Device video streaming with trick play based on separate trick play files
CN104702975A (zh) * 2015-03-24 2015-06-10 北京中熙正保远程教育技术有限公司 用于远程授课的Flash视频变速播放方法
CN104869430A (zh) * 2015-05-18 2015-08-26 北京中熙正保远程教育技术有限公司 一种视频倍速播放方法及装置

Also Published As

Publication number Publication date
CN112154670A (zh) 2020-12-29

Similar Documents

Publication Publication Date Title
US10372991B1 (en) Systems and methods that leverage deep learning to selectively store audiovisual content
US10452919B2 (en) Detecting segments of a video program through image comparisons
US10452713B2 (en) Video analysis techniques for improved editing, navigation, and summarization
US20210344978A1 (en) Methods, systems, processors and computer code for providing video clips
US11277562B2 (en) Image stabilization using machine learning
US11176967B2 (en) Automatic generation of video playback effects
US10623784B2 (en) Content-adaptive digital content adjustment method and system
JP2022509502A (ja) リアルタイム動画特殊効果システム及び方法
CN110022498B (zh) 一种实现码率切换的方法及装置
US20210120230A1 (en) Image encoding control method and apparatus, storage medium, and unmanned aerial vehicle
US9807301B1 (en) Variable pre- and post-shot continuous frame buffering with automated image selection and enhancement
WO2023185175A1 (fr) Procédé et appareil de traitement vidéo
CN111970565A (zh) 视频数据处理方法、装置、电子设备及存储介质
US20140205020A1 (en) Real-time transcoding method and device
Polakovič et al. Adaptive multimedia content delivery in 5G networks using DASH and saliency information
WO2021026785A1 (fr) Procédé et appareil de traitement vidéo et support de stockage
US10122907B1 (en) Integration of transducer outputs in a conferencing system
WO2023207513A1 (fr) Procédé et appareil de traitement vidéo, et dispositif électronique
WO2019140651A1 (fr) Procédé et dispositif de traitement vidéo
US20060080591A1 (en) Apparatus and method for automated temporal compression of multimedia content
US20120246269A1 (en) Data processing apparatus, data processing method, and computer program product
CN114650448A (zh) 录像的快慢动作调节方法、系统、存储介质及计算机
WO2020024197A1 (fr) Procédé et appareil de traitement vidéo et support lisible par ordinateur
US10893331B1 (en) Subtitle processing for devices with limited memory
KR20240037556A (ko) 인공지능을 기반으로 비디오 품질을 강화시키는 방법, 컴퓨터 장치, 및 컴퓨터 프로그램

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19941617

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19941617

Country of ref document: EP

Kind code of ref document: A1