WO2020024197A1 - Video processing method and apparatus, and computer readable medium - Google Patents

Video processing method and apparatus, and computer readable medium Download PDF

Info

Publication number
WO2020024197A1
WO2020024197A1 PCT/CN2018/098149 CN2018098149W WO2020024197A1 WO 2020024197 A1 WO2020024197 A1 WO 2020024197A1 CN 2018098149 W CN2018098149 W CN 2018098149W WO 2020024197 A1 WO2020024197 A1 WO 2020024197A1
Authority
WO
WIPO (PCT)
Prior art keywords
video
trigger operation
dragging
playback time
editor
Prior art date
Application number
PCT/CN2018/098149
Other languages
French (fr)
Chinese (zh)
Inventor
胡智
Original Assignee
深圳市大疆创新科技有限公司
大疆互娱科技（北京）有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市大疆创新科技有限公司, 大疆互娱科技（北京）有限公司 filed Critical 深圳市大疆创新科技有限公司
Priority to PCT/CN2018/098149 priority Critical patent/WO2020024197A1/en
Priority to CN201880041188.0A priority patent/CN110786020A/en
Publication of WO2020024197A1 publication Critical patent/WO2020024197A1/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47205—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/8166—Monomedia components thereof involving executable data, e.g. software
    • H04N21/8193—Monomedia components thereof involving executable data, e.g. software dedicated tools, e.g. video decoder software or IPMP tool
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/91—Television signal processing therefor

Definitions

  • the present invention relates to the field of image processing technologies, and in particular, to a video processing method, device, and computer-readable storage medium.
  • the APP for editing video is one of the commonly used APPs.
  • the invention provides a video processing method, a device and a computer-readable storage medium, which are used to solve the problem that in the prior art, when using a video editing APP, certain segments in a video frame cannot be accurately selected and cannot be selected. Meet the needs of users.
  • a first aspect of the present invention is to provide a video processing method, including:
  • a second aspect of the present invention is to provide a video processing device, including:
  • a processor for running a computer program stored in the memory to implement: acquiring a trigger operation of a user dragging a video editor; and determining video information to be processed after dragging according to the trigger operation, the video information including multiple Video sequence frames; adjusting thumbnails of video sequence frames in the video information displayed in the video editor according to the trigger operation.
  • a third aspect of the present invention is to provide a video processing device, including:
  • An acquisition module for acquiring a trigger operation of a user dragging a video editor
  • a determining module configured to determine video information to be processed after dragging according to the trigger operation, where the video information includes multiple video sequence frames;
  • a processing module configured to adjust a thumbnail of a video sequence frame in the video information displayed in the video editor according to the trigger operation.
  • a fourth aspect of the present invention is to provide a computer-readable storage medium, where the computer-readable storage medium stores program instructions, and the program instructions are used to implement the video processing method according to the first aspect.
  • the video processing method, device and computer-readable storage medium provided by the present invention obtain a trigger operation of a user dragging a video editor, and then determine video information to be processed after dragging according to the trigger operation, so that the user can
  • the video clips are precisely selected according to requirements, and the thumbnails of the video sequence frames in the video information displayed in the video editor can also be adjusted according to the trigger operation, so that the user can intuitively view the
  • the change of information improves the quality and efficiency of human-computer interaction, thereby ensuring the practicability of the processing method and facilitating the promotion and application of the market.
  • FIG. 1 is a schematic flowchart of a video processing method according to an embodiment of the present invention
  • FIG. 2 is a schematic flowchart of determining video information to be processed after dragging according to the trigger operation according to an embodiment of the present invention
  • FIG. 3 is a schematic flowchart of determining a playback time period after dragging according to the trigger operation according to an embodiment of the present invention
  • FIG. 4 is a schematic flowchart of adjusting a thumbnail of a video sequence frame in the video information displayed in the video editor according to the trigger operation according to an embodiment of the present invention
  • FIG. 5 is a schematic flowchart of acquiring a trigger operation of a user dragging a video editor according to an embodiment of the present invention
  • FIG. 6 is a schematic flowchart of another video processing method according to an embodiment of the present invention.
  • FIG. 7 is a schematic flowchart of decoding the image data by using a preset decoding manner according to an embodiment of the present invention.
  • FIG. 8 is a schematic structural diagram of a video processing apparatus according to an embodiment of the present invention.
  • FIG. 9 is a schematic structural diagram of another video processing apparatus according to an embodiment of the present invention.
  • FIG. 1 is a schematic flowchart of a video processing method according to an embodiment of the present invention. Referring to FIG. 1, this embodiment provides a video processing method. The method can implement video information processing through human-computer interaction. Select precisely, including:
  • the video editor can be located around the video to be processed, for example, the upper, lower, left, or right ends.
  • the video editor can be displayed as a bar-shaped edit box or other shapes of edit boxes, which is not limited here.
  • the editing process may include at least one of the following: interception, flattening, picture adjustment, zoom processing, speed adjustment, playback order adjustment, etc. of the video to be processed.
  • the user drags the video editor one or both edges of the video editor can be dragged. At this time, the edge of the video editor can be moved by the user's drag operation, so that it can be detected and obtained. Triggered by the user dragging the video editor.
  • S102 Determine video information to be processed after dragging according to the trigger operation, and the video information includes multiple video sequence frames;
  • the user can process the video information or video clips that are needed or interested by selecting a trigger operation, and the video information that needs to be processed can be specifically: video information that needs to be edited or video information that needs to be played. It may be at least a part of the original video, that is, after the trigger operation of the user dragging the video editor is obtained, the video information determined to be processed according to the trigger operation may be the entire original video, or according to the needs determined by the trigger operation The processed video information is part of the original video.
  • S103 Adjust the thumbnail of the video sequence frame in the video information displayed in the video editor according to the trigger operation.
  • thumbnails of video sequence frames in multiple determined video information can be displayed in the video editor.
  • the above thumbnails may be some unspecified images in multiple video sequence frames in the video information.
  • the thumbnail can be an image of multiple intra-coded frames (I frames), or the thumbnail can be an image of multiple key frames, or the thumbnail can be For preset representative images and more.
  • the thumbnails displayed in the video editor can be adjusted according to the trigger operation. Specifically, the number, display size, or size of the thumbnails displayed in the video editor can be adjusted. The display ratio and the like can be adjusted by those skilled in the art according to specific design requirements for the thumbnails displayed in the video editor.
  • the video processing method provided in this embodiment obtains a trigger operation of a user dragging a video editor, and then determines video information to be processed after dragging according to the trigger operation, so that the user can accurately select a video clip according to requirements.
  • the thumbnails of the video sequence frames in the video information displayed in the video editor can be adjusted according to the trigger operation, so that the user can intuitively view the change information of the video sequence frames, which improves the quality and efficiency of human-computer interaction, thereby ensuring The practicability of this treatment method is conducive to the promotion and application of the market.
  • FIG. 2 is a schematic flowchart of determining video information to be processed after dragging according to a trigger operation according to an embodiment of the present invention
  • FIG. 3 is a schematic flowchart of determining a playback time period after dragging according to a trigger operation according to an embodiment of the present invention
  • the specific implementation of determining the video information to be processed after dragging according to the trigger operation is not limited, and those skilled in the art may design according to the specific design. It is preferable to set the requirements.
  • the video information to be processed after dragging according to the trigger operation may include:
  • determining the playback time period after dragging according to the trigger operation may include:
  • S10211 Determine the playback start time and playback end time after dragging according to the trigger operation
  • the playback start time and playback end time after dragging can be determined according to the trigger operation.
  • the playback start time can be a preset initial time or any preset intermediate time
  • the playback end time can be The preset end time or any preset intermediate time; for example: the initial time corresponding to the existing original video is 0:00; the corresponding end time is 1:30, then, when the user drags
  • the playback start time can be 0:00, or it can be any time between 0:00 and 1:30, for example: 0:15, 0:30, or 1:15; and the playback ends
  • the time can be 1:30, or it can be any time between 0:00 and 1:30, for example: 0:45, 0:50, or 1:15.
  • S10212 Determine the time period between the playback end time and the playback start time as the playback time period.
  • the playback time period in this embodiment is less than or equal to a preset standard playback time, and the standard playback time is the time required to process a complete video including video information.
  • the determined playback time period may also be greater than or equal to a preset time period threshold, and the time period threshold may be set according to specific design requirements, for example, the time period threshold may be 0.3s, 0.5s, 1s, or other Custom values, etc., can effectively prevent the user from misoperation, and thus ensure the accuracy and reliability of video information selection.
  • S1022 Determine video information according to a playing time period.
  • the video information includes multiple video sequence frames and time information corresponding to each video sequence frame. Therefore, the video information corresponding to the playback time period can be determined according to the playback time period, that is, the video information selected by the user is determined. .
  • an APP including a video editor can play the video information according to the video information selected by the user, and can also preview the video information.
  • FIG. 4 is a schematic flow chart of adjusting a thumbnail of a video sequence frame in video information displayed in a video editor according to a trigger operation according to an embodiment of the present invention. referring to FIG. 4, it can be known that the The thumbnails of the video sequence frames in the video information displayed in the editor can include:
  • the historical playback time is the time before the user drags the video editor.
  • the historical playback time may be less than or equal to a preset standard playback time.
  • the standard playback time is the time required to process a complete video including video information. .
  • the historical playback time corresponding to a video is T1.
  • the number of thumbnails displayed in the video editor is N1.
  • Information and the playback time period T2 corresponding to the video information is N2.
  • T2> T1, then N2> N1, that is, the playback time period is relative to the historical playback time.
  • the number of thumbnails of video sequence frames displayed in the video editor increases.
  • N2 N1.
  • the playing time period is equal to the historical playing time, it means that the playing time at this time has not changed. Therefore, the number of thumbnails of the video sequence frames displayed in the video editor is not the same. changes happened. In general, the number of thumbnails of video sequence frames displayed in the video editor is a preset ratio to the time in the playback time period.
  • the method further includes:
  • the historical playback time corresponding to a video is T1
  • the number of thumbnails displayed in the video editor is N3.
  • T2 the number of thumbnails displayed in the video editor
  • N4 the playback time period is extended relative to the historical playback time.
  • the number of thumbnails of video sequence frames displayed outside the video editor is reduced.
  • N4 N3 when the playing time period is equal to the historical playing time, it means that the playing time at this time has not changed. Therefore, the video sequence frames displayed in the video editor and outside the video editor are The number of thumbnails does not change.
  • the size and / or the display ratio of the thumbnail displayed in the video editor can also be adjusted according to the trigger operation. For example: if the playback time period is longer than the historical playback time, the size / display ratio of the thumbnail of the video sequence frame in the video information displayed in the video editor is reduced; or if the playback time period is shortened relative to the historical playback time , The size / display ratio of the thumbnails of the video sequence frames in the video information displayed in the video editor becomes larger.
  • Those skilled in the art may determine a specific implementation manner according to specific design requirements, as long as the thumbnails displayed in the video editor can be adjusted according to a trigger operation, and details are not described herein again.
  • FIG. 5 is a schematic flowchart of acquiring a trigger operation of a user dragging a video editor according to an embodiment of the present invention. based on the foregoing embodiment, and referring to FIG. 5, it can be known that when a user performs a drag operation on a video editor, This embodiment does not limit the specific implementation of the trigger operation acquisition. Those skilled in the art can set it according to specific design requirements. More preferably, the trigger operation of acquiring the user dragging the video editor in this embodiment may include:
  • S1011 Obtain a first trigger operation of the user dragging the first adjustment area located in the video editor; and / or,
  • S1012 Acquire a second trigger operation of the user dragging the second adjustment area located in the video editor, and the second adjustment area and the first adjustment area are located on both sides of the video editor.
  • the video editor is located at the upper or lower end of the video to be processed, and the video editor is a bar-shaped edit box that can be edited.
  • the above-mentioned editing can be performed by the user by dragging the video editor left or right.
  • the first adjustment area and the second adjustment area can be located on the left and right sides of the video editor, respectively.
  • the user can drag the first adjustment area, so that the first adjustment area can be moved left and right, and then can be obtained.
  • the second adjustment area can also be moved left and right according to the drag operation of the user, and then the second trigger operation can be obtained.
  • the method may further include:
  • the initial position of the first adjustment area is L1.
  • the first adjustment area can be moved according to the user's drag operation, and the position at the end of the user's drag operation is L2 , The first adjustment area will be restored from the position L2 to L1 after the user's drag operation is completed, so that when the user ends the drag operation, the first adjustment area has a rebound effect, which further improves human-computer interaction. Display effect.
  • the method also includes:
  • step S201 The implementation process of step S201 is similar, and is not repeated here.
  • the method in this embodiment may further include:
  • the time information includes at least one of the following: a playback time period, a playback start time, and a playback end time.
  • the playback time period can be displayed through the middle area of the video editor, the playback start time can be displayed on one side (left or right) of the video editor, and the playback end time can be displayed on the other side of the video editor ( Right or left) to distinguish it from playback start time.
  • the playback time period displayed in the video editor can be changed in real time according to the trigger operation of the user dragging the video editor, and the video editing
  • the playback start time displayed in the editor can be changed in real time according to the trigger operation of the user dragging the first adjustment area on one side (for example: left side) of the video editor
  • the playback end time displayed in the video editor can be changed according to the user
  • the trigger operation of dragging the second adjustment area on the other side (for example, the right side) of the video editor is changed in real time. It can be understood that when the user does not have a trigger operation for the first adjustment area or the second adjustment area, then The playback start time and playback end time corresponding to the first adjustment area or the second adjustment area do not change.
  • the video editor is used to display the time information corresponding to the video information, and when the video is processed, the user can intuitively obtain the time information related to the video processing, which further improves the convenience of the method.
  • FIG. 6 is a schematic flowchart of another video processing method according to an embodiment of the present invention
  • FIG. 7 is a schematic flowchart of decoding image data by using a preset decoding method according to an embodiment of the present invention
  • S502 Decode the image data by using a preset decoding method to obtain multiple video sequence frames in the video information.
  • the preset decoding method includes a hard decoding method and / or a soft decoding method.
  • decoding the image data by using a preset decoding method may include:
  • the hard decoding (also known as hardware decoding) method is to decode the video (HD video) through the video acceleration function of the graphics card
  • the soft decoding (also known as software decoding) method is to rely on the central processing unit CPU to decode the video (HD video).
  • Decoding method using API Media Metada Retiever as a hard decoding method, FFPG as a soft decoding method as an example.
  • the hard decoding API Media Metada Retiever is used to decode video data to implement the API of video sequence frames. Extraction; if it cannot be extracted, the video data is decoded through FFPG soft decoding to achieve API extraction of video sequence frames.
  • the method further includes:
  • S601 Buffer multiple video sequence frames.
  • a preset LRU (Least, Recently Used) algorithm can be used to cache the extracted pictures.
  • the LRU algorithm is a page replacement algorithm of memory management, and the extracted pictures can be cached to a preset Memory or phone disk.
  • the entire extraction process of the video sequence frames can also be used as a LRU cache in a preset memory or a mobile phone disk.
  • the video sequence frames are extracted in the above manner, and the video sequence frames can be cached, which effectively ensures the use efficiency of the method and further improves the accuracy and reliability of the method.
  • FIG. 8 is a schematic structural diagram of a video processing apparatus according to an embodiment of the present invention. referring to FIG. 8, it is known that this embodiment provides a video processing apparatus, including:
  • the memory 201 is configured to store a computer program
  • the processor 202 is configured to run a computer program stored in the memory 201 to implement: obtaining a trigger operation of a user dragging a video editor; and determining video information to be processed after dragging according to the trigger operation.
  • the video information includes multiple video sequence frames ; Adjust the thumbnail of the video sequence frame in the video information displayed in the video editor according to the trigger operation.
  • the processor 202 determines video information to be processed after dragging according to the trigger operation
  • the processor 202 is configured to: determine a playback time period after dragging according to the trigger operation; and determine video information according to the playback time period.
  • the processor 202 determines the playback time period after dragging according to the trigger operation
  • the processor 202 is configured to: determine the playback start time and playback end time after dragging according to the trigger operation; and set the playback end time and playback start time The time period between them is determined as the playback time period.
  • the processor 202 adjusts the thumbnail of the video sequence frame in the video information displayed in the video editor according to the trigger operation, the processor 202 is configured to:
  • the playback time period is longer than the historical playback time, the number of thumbnails of the video sequence frames in the video information displayed in the video editor is increased; or if the playback time period is shortened relative to the historical playback time, the video editor is displayed in the video editor The number of thumbnails showing video sequence frames in the video information is reduced.
  • the processor 202 determines the playback time period after dragging according to the trigger operation, the processor 202 is configured to: if the playback time period is extended relative to the historical playback time, display the video sequence frame in the video information outside the video editor. The number of thumbnails is reduced; or, if the playback time period is shortened relative to the historical playback time, the number of thumbnails of the video sequence frames in the video information displayed outside the video editor is increased.
  • the playback time period and the historical playback time are both less than or equal to a preset standard playback time, and the standard playback time is the time required to process a complete video including video information.
  • the processor 202 when the processor 202 obtains a trigger operation of the user dragging the video editor, the processor 202 is configured to: obtain a first trigger operation of the user dragging the first adjustment area located in the video editor; and / or, obtain The user drags a second trigger operation located in a second adjustment area of the video editor, and the second adjustment area and the first adjustment area are located on both sides of the video editor.
  • the processor 202 is configured to: when the user drags the first adjustment area, the first adjustment area can be moved according to the drag track of the user, and is restored to a preset initial position after the drag is finished.
  • the processor 202 is configured to: when the user drags the second adjustment area, the second adjustment area can be moved according to the drag track of the user, and restored to a preset initial position after the dragging ends.
  • the processor 202 is configured to use a video editor to display time information corresponding to the video information, and the time information includes at least one of the following: a playback time period, a playback start time, and a playback end time.
  • the processor 202 determines the video information to be processed after dragging according to the trigger operation, the processor 202 is configured to: obtain image data corresponding to the video information; and decode the image data by using a preset decoding method, Get multiple video sequence frames in video information.
  • the preset decoding method includes a hard decoding method and / or a soft decoding method.
  • the processor 202 when the processor 202 decodes the image data by using a preset decoding method, the processor 202 is configured to: use a hard decoding method to decode the video data; if the hard decoding method cannot be used to decode the video data, Then use soft decoding to decode video data.
  • the processor 202 is configured to: buffer the multiple video sequence frames.
  • the video processing device in this embodiment may be used to execute the technical solutions of the embodiments shown in FIGS. 1-7 in the foregoing method.
  • the implementation principles and technical effects are similar, and details are not described herein again.
  • FIG. 9 is a schematic structural diagram of another video processing apparatus according to an embodiment of the present invention. Referring to FIG. 9, this embodiment provides another video processing apparatus, including:
  • a determining module 2 configured to determine video information to be processed after dragging according to a trigger operation, where the video information includes multiple video sequence frames;
  • the processing module 3 is configured to adjust a thumbnail of a video sequence frame in the video information displayed in the video editor according to a trigger operation.
  • the acquisition module 1, the determination module 2, and the processing module 3 in the image encoding control device in this embodiment may be used to execute the technical solution of the embodiment shown in FIG. 1-7 in the above method.
  • the implementation principles and technical effects are similar. I will not repeat them here.
  • Another aspect of this embodiment provides a computer-readable storage medium.
  • the computer-readable storage medium stores program instructions, and the program instructions are used to implement the video processing method in any one of the foregoing embodiments.
  • the related apparatuses and methods disclosed may be implemented in other ways.
  • the device embodiments described above are only schematic.
  • the division of the modules or units is only a logical function division.
  • multiple units or components may be divided.
  • the combination can either be integrated into another system, or some features can be ignored or not implemented.
  • the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, which may be electrical, mechanical or other forms.
  • the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, may be located in one place, or may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the objective of the solution of this embodiment.
  • each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist separately physically, or two or more units may be integrated into one unit.
  • the above integrated unit may be implemented in the form of hardware or in the form of software functional unit.
  • the integrated unit When the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it may be stored in a computer-readable storage medium.
  • the technical solution of the present invention essentially or part that contributes to the existing technology or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium Including instructions for causing a computer processor to perform all or part of the steps of the method described in various embodiments of the present invention.
  • the foregoing storage media include: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disks or optical disks and other media that can store program codes.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Human Computer Interaction (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • User Interface Of Digital Computer (AREA)
  • Television Signal Processing For Recording (AREA)

Abstract

Disclosed are a video processing method and apparatus, and a computer readable medium. Said method comprises: acquiring a trigger operation of a user dragging in a video editor; determining, according to the trigger operation, video information that needs to be processed after dragging, the video information comprising a plurality of video sequence frames; and adjusting, according to the trigger operation, thumbnails of the video sequence frames in the video information displayed in the video editor. According to the video processing method and apparatus, and the computer readable storage medium provided in the present invention, by acquiring the trigger operation of the user dragging in the video editor, and then determining, according to the trigger operation, video information that needs to be processed after the dragging, the user can precisely select a video clip according to requirements, and can also adjust, according to the trigger operation, thumbnails of the video sequence frames in the video information displayed in the video editor, so that the user can directly view the change information of the video sequence frames, improving the quality and efficiency of man-machine interaction.

Description

视频的处理方法、装置及计算机可读存储介质Video processing method, device and computer-readable storage medium 技术领域Technical field
本发明涉及图像处理技术领域，尤其涉及一种视频的处理方法、装置及计算机可读存储介质。The present invention relates to the field of image processing technologies, and in particular, to a video processing method, device, and computer-readable storage medium.
背景技术Background technique
随着科学技术的不断进步，智能终端的使用越来越广泛，并且适用于终端上的应用程序APP的种类也越来越多，其中，对于视频进行编辑的APP就是普遍使用的APP之一。With the continuous progress of science and technology, the use of smart terminals is becoming more and more extensive, and the types of applications APPs suitable for terminals are also increasing. Among them, the APP for editing video is one of the commonly used APPs.
目前，对于大多数的视频编辑APP，包括：视频显示区域和进度调整区域，用户可以通过对进度调整区域的位置调整来选择所显示的视频画面，然而，用户在使用上述的视频编辑APP时，不可以对视频画面中的某些片段进行精确选取，无法满足用户的使用需求。At present, for most video editing apps, including: video display area and progress adjustment area, the user can select the displayed video screen by adjusting the position of the progress adjustment area. However, when the user uses the above video editing APP, It is not possible to accurately select certain segments in the video picture, which cannot meet the user's needs.
发明内容Summary of the invention
本发明提供了一种视频的处理方法、装置及计算机可读存储介质，用于解决现有技术中存在的在使用视频编辑APP时，不可以对视频画面中的某些片段进行精确选取，无法满足用户的使用需求问题。The invention provides a video processing method, a device and a computer-readable storage medium, which are used to solve the problem that in the prior art, when using a video editing APP, certain segments in a video frame cannot be accurately selected and cannot be selected. Meet the needs of users.
本发明的第一方面是为了提供一种视频的处理方法，包括：A first aspect of the present invention is to provide a video processing method, including:
获取用户拖动视频编辑器的触发操作；Get the trigger action of the user dragging the video editor;
根据所述触发操作确定拖动后需要处理的视频信息，所述视频信息中包括多个视频序列帧；Determining video information to be processed after dragging according to the trigger operation, where the video information includes multiple video sequence frames;
根据所述触发操作调整在所述视频编辑器中显示的所述视频信息中视频序列帧的缩略图。Adjusting a thumbnail of a video sequence frame in the video information displayed in the video editor according to the trigger operation.
本发明的第二方面是为了提供一种视频的处理装置，包括：A second aspect of the present invention is to provide a video processing device, including:
存储器，用于存储计算机程序；Memory for storing computer programs;
处理器，用于运行所述存储器中存储的计算机程序以实现：获取用户拖动视频编辑器的触发操作；根据所述触发操作确定拖动后需要处理的视频信息，所述视频信息中包括多个视频序列帧；根据所述触发操作调整在所述视频编辑器中显示的所述视频信息中视频序列帧的缩略图。A processor for running a computer program stored in the memory to implement: acquiring a trigger operation of a user dragging a video editor; and determining video information to be processed after dragging according to the trigger operation, the video information including multiple Video sequence frames; adjusting thumbnails of video sequence frames in the video information displayed in the video editor according to the trigger operation.
本发明的第三方面是为了提供一种视频的处理装置，包括：A third aspect of the present invention is to provide a video processing device, including:
获取模块，用于获取用户拖动视频编辑器的触发操作；An acquisition module for acquiring a trigger operation of a user dragging a video editor;
确定模块，用于根据所述触发操作确定拖动后需要处理的视频信息，所述视频信息中包括多个视频序列帧；A determining module, configured to determine video information to be processed after dragging according to the trigger operation, where the video information includes multiple video sequence frames;
处理模块，用于根据所述触发操作调整在所述视频编辑器中显示的所述视频信息中视频序列帧的缩略图。A processing module, configured to adjust a thumbnail of a video sequence frame in the video information displayed in the video editor according to the trigger operation.
本发明的第四方面是为了提供一种计算机可读存储介质，该计算机可读存储介质中存储有程序指令，所述程序指令用于实现第一方面所述的视频的处理方法。A fourth aspect of the present invention is to provide a computer-readable storage medium, where the computer-readable storage medium stores program instructions, and the program instructions are used to implement the video processing method according to the first aspect.
本发明提供的视频的处理方法、装置及计算机可读存储介质，通过获取用户拖动视频编辑器的触发操作，而后可以根据所述触发操作确定拖动后需要处理的视频信息，从而使得用户可以根据需求对视频片段进行精确选择，并且还可以根据所述触发操作调整在所述视频编辑器中显示的所述视频信息中视频序列帧的缩略图，可以使得用户直观地查看到视频序列帧的变化信息，提高了人机交互的质量和效率，进而保证了该处理方法的实用性，有利于市场的推广与应用。The video processing method, device and computer-readable storage medium provided by the present invention obtain a trigger operation of a user dragging a video editor, and then determine video information to be processed after dragging according to the trigger operation, so that the user can The video clips are precisely selected according to requirements, and the thumbnails of the video sequence frames in the video information displayed in the video editor can also be adjusted according to the trigger operation, so that the user can intuitively view the The change of information improves the quality and efficiency of human-computer interaction, thereby ensuring the practicability of the processing method and facilitating the promotion and application of the market.
附图说明BRIEF DESCRIPTION OF THE DRAWINGS
图1为本发明实施例提供的一种视频的处理方法的流程示意图；FIG. 1 is a schematic flowchart of a video processing method according to an embodiment of the present invention; FIG.
图2为本发明实施例提供的根据所述触发操作确定拖动后需要处理的视频信息的流程示意图；2 is a schematic flowchart of determining video information to be processed after dragging according to the trigger operation according to an embodiment of the present invention;
图3为本发明实施例提供的根据所述触发操作确定拖动后的播放时间段的流程示意图；3 is a schematic flowchart of determining a playback time period after dragging according to the trigger operation according to an embodiment of the present invention;
图4为本发明实施例提供的根据所述触发操作调整在所述视频编辑器中显示的所述视频信息中视频序列帧的缩略图的流程示意图；4 is a schematic flowchart of adjusting a thumbnail of a video sequence frame in the video information displayed in the video editor according to the trigger operation according to an embodiment of the present invention;
图5为本发明实施例提供的获取用户拖动视频编辑器的触发操作的流程示意图；FIG. 5 is a schematic flowchart of acquiring a trigger operation of a user dragging a video editor according to an embodiment of the present invention; FIG.
图6为本发明实施例提供的又一种视频的处理方法的流程示意图；6 is a schematic flowchart of another video processing method according to an embodiment of the present invention;
图7为本发明实施例提供的利用预设的解码方式对所述图像数据进行解码的流程示意图；7 is a schematic flowchart of decoding the image data by using a preset decoding manner according to an embodiment of the present invention;
图8为本发明实施例提供的一种视频的处理装置的结构示意图；8 is a schematic structural diagram of a video processing apparatus according to an embodiment of the present invention;
图9为本发明实施例提供的另一种视频的处理装置的结构示意图。FIG. 9 is a schematic structural diagram of another video processing apparatus according to an embodiment of the present invention.
具体实施方式detailed description
为使本发明实施例的目的、技术方案和优点更加清楚，下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例是本发明一部分实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例，都属于本发明保护的范围。In order to make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments It is a part of the embodiments of the present invention, but not all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by a person of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.
除非另有定义，本文所使用的所有的技术和科学术语与属于本发明的技术领域的技术人员通常理解的含义相同。本文中在本发明的说明书中所使用的术语只是为了描述具体的实施例的目的，不是旨在于限制本发明。Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. The terminology used herein in the description of the invention is for the purpose of describing particular embodiments only and is not intended to limit the invention.
下面结合附图，对本发明的一些实施方式作详细说明。在各实施例之间不冲突的情况下，下述的实施例及实施例中的特征可以相互组合。Hereinafter, some embodiments of the present invention will be described in detail with reference to the drawings. In the case where there is no conflict between the embodiments, the following embodiments and features in the embodiments can be combined with each other.
图1为本发明实施例提供的一种视频的处理方法的流程示意图；参考附图1所示，本实施例提供了一种视频的处理方法，该方法可以通过人机交互实现对视频信息的精准选取，包括：FIG. 1 is a schematic flowchart of a video processing method according to an embodiment of the present invention. Referring to FIG. 1, this embodiment provides a video processing method. The method can implement video information processing through human-computer interaction. Select precisely, including:
S101：获取用户拖动视频编辑器的触发操作；S101: Obtain a trigger operation of a user dragging a video editor;
其中，视频编辑器可以位于待处理视频周边，例如：上端、下端、左端或者右端，视频编辑器可以是以条状编辑框进行显示，也可以是其它形状的编辑框进行显示，这里不做限定，用于对待处理视频进行编辑处理，编辑处理的方式可以包括以下至少之一：对待处理视频的截取、拼合、画面调整、变焦处理、速度调整、播放顺序调整等等。另外，在用户拖动视频编辑器时， 可以拖动视频编辑器的一侧或者两侧边缘，此时，视频编辑器的边缘可以在用户的拖动操作下进行移动，从而可以检测并获取到用户拖动视频编辑器的触发操作。The video editor can be located around the video to be processed, for example, the upper, lower, left, or right ends. The video editor can be displayed as a bar-shaped edit box or other shapes of edit boxes, which is not limited here. For editing the video to be processed, and the editing process may include at least one of the following: interception, flattening, picture adjustment, zoom processing, speed adjustment, playback order adjustment, etc. of the video to be processed. In addition, when the user drags the video editor, one or both edges of the video editor can be dragged. At this time, the edge of the video editor can be moved by the user's drag operation, so that it can be detected and obtained. Triggered by the user dragging the video editor.
S102：根据触发操作确定拖动后需要处理的视频信息，视频信息中包括多个视频序列帧；S102: Determine video information to be processed after dragging according to the trigger operation, and the video information includes multiple video sequence frames;
其中，用户可以对通过触发操作选择所需要或者所感兴趣的视频信息或者视频片段进行处理，而需要处理的视频信息可以具体为：需要进行编辑的视频信息或者需要进行播放的视频信息，该视频信息可以为原始视频的至少一部分，也即，在获取到用户拖动视频编辑器的触发操作之后，根据触发操作所确定的需要处理的视频信息可以为整个原始视频，或者，根据触发操作确定的需要处理的视频信息为原始视频的一部分。The user can process the video information or video clips that are needed or interested by selecting a trigger operation, and the video information that needs to be processed can be specifically: video information that needs to be edited or video information that needs to be played. It may be at least a part of the original video, that is, after the trigger operation of the user dragging the video editor is obtained, the video information determined to be processed according to the trigger operation may be the entire original video, or according to the needs determined by the trigger operation The processed video information is part of the original video.
S103：根据触发操作调整在视频编辑器中显示的视频信息中视频序列帧的缩略图。S103: Adjust the thumbnail of the video sequence frame in the video information displayed in the video editor according to the trigger operation.
其中，在视频编辑器中可以显示多个确定的视频信息中的视频序列帧的缩略图，需要说明的是，上述的缩略图可以为视频信息中多个视频序列帧中的某些不特定图像，而不是视频信息种的每一帧的图像，例如：缩略图可以为多个帧内编码帧(I帧)的图像，或者，缩略图可以为多个关键帧的图像，或者，缩略图可以为预设的代表图像等等。Among them, thumbnails of video sequence frames in multiple determined video information can be displayed in the video editor. It should be noted that the above thumbnails may be some unspecified images in multiple video sequence frames in the video information. Instead of the image of each frame of the video information, for example: the thumbnail can be an image of multiple intra-coded frames (I frames), or the thumbnail can be an image of multiple key frames, or the thumbnail can be For preset representative images and more.
在获取用户拖动视频编辑器的触发操作之后，可以根据触发操作调整在视频编辑器中所显示的缩略图，具体的，可以调整在视频编辑器中所显示的缩略图的数量、显示尺寸或者显示比例等等，本领域技术人员可以根据具体的设计需求对视频编辑器中所显示的缩略图进行调整，在此不再赘述。After obtaining the trigger operation of the user dragging the video editor, the thumbnails displayed in the video editor can be adjusted according to the trigger operation. Specifically, the number, display size, or size of the thumbnails displayed in the video editor can be adjusted. The display ratio and the like can be adjusted by those skilled in the art according to specific design requirements for the thumbnails displayed in the video editor.
本实施例提供的视频的处理方法，通过获取用户拖动视频编辑器的触发操作，而后可以根据触发操作确定拖动后需要处理的视频信息，从而使得用户可以根据需求对视频片段进行精确选择，并且还可以根据触发操作调整在视频编辑器中显示的视频信息中视频序列帧的缩略图，可以使得用户直观地查看到视频序列帧的变化信息，提高了人机交互的质量和效率，进而保证了该处理方法的实用性，有利于市场的推广与应用。The video processing method provided in this embodiment obtains a trigger operation of a user dragging a video editor, and then determines video information to be processed after dragging according to the trigger operation, so that the user can accurately select a video clip according to requirements. In addition, the thumbnails of the video sequence frames in the video information displayed in the video editor can be adjusted according to the trigger operation, so that the user can intuitively view the change information of the video sequence frames, which improves the quality and efficiency of human-computer interaction, thereby ensuring The practicability of this treatment method is conducive to the promotion and application of the market.
图2为本发明实施例提供的根据触发操作确定拖动后需要处理的视频信息的流程示意图；图3为本发明实施例提供的根据触发操作确定拖动后的播 放时间段的流程示意图；在上述实施例的基础上，继续参考附图2-3可知，本实施例中对于根据触发操作确定拖动后需要处理的视频信息的具体实现方式不做限定，本领域技术人员可以根据具体的设计需求进行设置，较为优选的，根据触发操作确定拖动后需要处理的视频信息可以包括：2 is a schematic flowchart of determining video information to be processed after dragging according to a trigger operation according to an embodiment of the present invention; FIG. 3 is a schematic flowchart of determining a playback time period after dragging according to a trigger operation according to an embodiment of the present invention; Based on the foregoing embodiment, it can be seen from the continued reference to FIGS. 2-3 that in this embodiment, the specific implementation of determining the video information to be processed after dragging according to the trigger operation is not limited, and those skilled in the art may design according to the specific design. It is preferable to set the requirements. The video information to be processed after dragging according to the trigger operation may include:
S1021：根据触发操作确定拖动后的播放时间段；S1021: Determine the playback time period after dragging according to the trigger operation;
其中，根据触发操作确定拖动后的播放时间段可以包括：Wherein, determining the playback time period after dragging according to the trigger operation may include:
S10211：根据触发操作确定拖动后的播放开始时间和播放结束时间；S10211: Determine the playback start time and playback end time after dragging according to the trigger operation;
在获取触发操作后，可以根据触发操作确定拖动后的播放开始时间和播放结束时间，其中，播放开始时间可以为预设的初始时间或者为任意一个预设的中间时间，播放结束时间可以为预设的结束时间或者为任意一个预设的中间时间；举例来说：现有原始视频所对应的初始时间为0:00；所对应的结束时间为1:30，那么，在用户通过拖动视频编辑器之后，播放开始时间可以为0:00，或者，也可以为0:00与1:30之间的任意一个时间，例如：0:15、0:30或者1:15；而播放结束时间可以为1:30，或者，也可以为0:00与1:30之间的任意一个时间，例如：0:45、0:50或者1:15。After the trigger operation is obtained, the playback start time and playback end time after dragging can be determined according to the trigger operation. The playback start time can be a preset initial time or any preset intermediate time, and the playback end time can be The preset end time or any preset intermediate time; for example: the initial time corresponding to the existing original video is 0:00; the corresponding end time is 1:30, then, when the user drags After the video editor, the playback start time can be 0:00, or it can be any time between 0:00 and 1:30, for example: 0:15, 0:30, or 1:15; and the playback ends The time can be 1:30, or it can be any time between 0:00 and 1:30, for example: 0:45, 0:50, or 1:15.
S10212：将播放结束时间与播放开始时间之间的时间段确定为播放时间段。S10212: Determine the time period between the playback end time and the playback start time as the playback time period.
其中，本实施例中的播放时间段小于或等于预设的标准播放时间，标准播放时间为包括视频信息在内的完整视频所需要处理的时间。进一步的，所确定的播放时间段还可以大于或等于预设的时间段阈值，该时间段阈值可以根据具体的设计需求进行设置，例如：时间段阈值可以为0.3s、0.5s、1s或者其他自定义数值等等，这样可以有效地防止用户误操作的情况，进而保证了视频信息选取的准确可靠性。Wherein, the playback time period in this embodiment is less than or equal to a preset standard playback time, and the standard playback time is the time required to process a complete video including video information. Further, the determined playback time period may also be greater than or equal to a preset time period threshold, and the time period threshold may be set according to specific design requirements, for example, the time period threshold may be 0.3s, 0.5s, 1s, or other Custom values, etc., can effectively prevent the user from misoperation, and thus ensure the accuracy and reliability of video information selection.
S1022：根据播放时间段确定视频信息。S1022: Determine video information according to a playing time period.
其中，视频信息包括多个视频序列帧以及与每个视频序列帧相对应的时间信息，因此，可以根据播放时间段确定与播放时间段相对应的视频信息，即确定了用户所选取的视频信息。The video information includes multiple video sequence frames and time information corresponding to each video sequence frame. Therefore, the video information corresponding to the playback time period can be determined according to the playback time period, that is, the video information selected by the user is determined. .
其中，包括视频编辑器的APP可以根据用户选取的视频信息对该视频信息进行播放，也可以对该视频信息进行预览等等。Among them, an APP including a video editor can play the video information according to the video information selected by the user, and can also preview the video information.
通过上述方式获取视频信息，有效地保证了视频信息确定的准确可靠性， 进一步提高了该方法使用的精确程度。Obtaining video information in the above manner effectively ensures the accuracy and reliability of video information determination, and further improves the accuracy of the method.
图4为本发明实施例提供的根据触发操作调整在视频编辑器中显示的视频信息中视频序列帧的缩略图的流程示意图；参考附图4可知，本实施例中的根据触发操作调整在视频编辑器中显示的视频信息中视频序列帧的缩略图可以包括：FIG. 4 is a schematic flow chart of adjusting a thumbnail of a video sequence frame in video information displayed in a video editor according to a trigger operation according to an embodiment of the present invention; referring to FIG. 4, it can be known that the The thumbnails of the video sequence frames in the video information displayed in the editor can include:
S1031：若播放时间段相对于历史播放时间延长，则在视频编辑器中显示视频信息中视频序列帧的缩略图的数量增加；或者，S1031: If the playback time period is extended relative to the historical playback time, the number of thumbnails of the video sequence frames in the video information displayed in the video editor is increased; or,
S1032：若播放时间段相对于历史播放时间缩短，则在视频编辑器中显示视频信息中视频序列帧的缩略图的数量减少。S1032: If the playback time period is shortened relative to the historical playback time, the number of thumbnails of the video sequence frames in the video information displayed in the video editor is reduced.
其中，历史播放时间为在用户进行拖动视频编辑器之前的时间，该历史播放时间可以小于或等于预设的标准播放时间，标准播放时间为包括视频信息在内的完整视频所需要处理的时间。The historical playback time is the time before the user drags the video editor. The historical playback time may be less than or equal to a preset standard playback time. The standard playback time is the time required to process a complete video including video information. .
举例来说，某一视频所对应的历史播放时间为T1，此时，视频编辑器中所显示的缩略图的数量为N1，当用户拖动视频编辑器之后，可以确定视频中的某一视频信息以及与视频信息相对应的播放时间段T2，此时，视频编辑器中所显示的缩略图的数量为N2，若T2>T1，则N2>N1，也即播放时间段相对于历史播放时间有所延长时，在视频编辑器中显示的视频序列帧的缩略图的数量会增加。或者，若T2<T1，则N2<N1，也即播放时间段相对于历史播放时间有所缩短时，在视频编辑器中显示的视频序列帧的缩略图的数量会减少。若T2＝T1，则N2＝N1，在播放时间段等于历史播放时间时，说明此时的播放时间并未发生变化，因此，在视频编辑器中显示的视频序列帧的缩略图的数量也不发生改变。总的来说，位于视频编辑器中所显示的视频序列帧的缩略图的数量与播放时间段中的时间呈预设比例。For example, the historical playback time corresponding to a video is T1. At this time, the number of thumbnails displayed in the video editor is N1. After the user drags the video editor, a certain video in the video can be determined. Information and the playback time period T2 corresponding to the video information. At this time, the number of thumbnails displayed in the video editor is N2. If T2> T1, then N2> N1, that is, the playback time period is relative to the historical playback time. When extended, the number of thumbnails of video sequence frames displayed in the video editor increases. Alternatively, if T2 <T1, then N2 <N1, that is, when the playback time period is shortened relative to the historical playback time, the number of thumbnails of the video sequence frames displayed in the video editor will be reduced. If T2 = T1, then N2 = N1. When the playing time period is equal to the historical playing time, it means that the playing time at this time has not changed. Therefore, the number of thumbnails of the video sequence frames displayed in the video editor is not the same. changes happened. In general, the number of thumbnails of video sequence frames displayed in the video editor is a preset ratio to the time in the playback time period.
可以理解的是，在根据触发操作确定拖动后的播放时间段之后，方法还包括：It can be understood that after determining the playback time period after dragging according to the trigger operation, the method further includes:
S201：若播放时间段相对于历史播放时间延长，则在视频编辑器之外显示视频信息中视频序列帧的缩略图的数量减少；或者，S201: If the playback time period is longer than the historical playback time, the number of thumbnails of the video sequence frames in the video information displayed outside the video editor is reduced; or,
S202：若播放时间段相对于历史播放时间缩短，则在视频编辑器之外显示视频信息中视频序列帧的缩略图的数量增加。S202: If the playback time period is shortened relative to the historical playback time, the number of thumbnails of the video sequence frames in the video information displayed outside the video editor is increased.
继上述陈述举例内容，某一视频所对应的历史播放时间为T1，视频编辑 器中所显示的缩略图的数量为N3，当用户拖动视频编辑器之后，可以确定视频中的视频信息以及与视频信息相对应的播放时间段T2，此时，视频编辑器中所显示的缩略图的数量为N4，若T2>T1，则N4<N3，也即播放时间段相对于历史播放时间有所延长，在视频编辑器之外显示的视频序列帧的缩略图的数量会减少。若T2<T1，则N4>N3，也即播放时间段相对于历史播放时间有所缩短，在视频编辑器之外显示的视频序列帧的缩略图的数量会增加。若T2＝T1，则N4＝N3，在播放时间段等于历史播放时间时，说明此时的播放时间并未发生变化，因此，在视频编辑器中和视频编辑器之外显示的视频序列帧的缩略图的数量均不发生改变。Following the example content in the statement above, the historical playback time corresponding to a video is T1, and the number of thumbnails displayed in the video editor is N3. After the user drags the video editor, the video information in the video and the The playback time period T2 corresponding to the video information. At this time, the number of thumbnails displayed in the video editor is N4. If T2> T1, then N4 <N3, that is, the playback time period is extended relative to the historical playback time. , The number of thumbnails of video sequence frames displayed outside the video editor is reduced. If T2 <T1, then N4> N3, that is, the playback time period is shortened relative to the historical playback time, and the number of thumbnails of video sequence frames displayed outside the video editor will increase. If T2 = T1, then N4 = N3, when the playing time period is equal to the historical playing time, it means that the playing time at this time has not changed. Therefore, the video sequence frames displayed in the video editor and outside the video editor are The number of thumbnails does not change.
可以理解的是，在根据触发操作调整在视频编辑器中显示的视频信息中视频序列帧的缩略图时，还可以根据触发操作调整视频编辑器中显示缩略图的大小和/或显示比例等等，例如：若播放时间段相对于历史播放时间延长，则在视频编辑器中显示视频信息中视频序列帧的缩略图的尺寸/显示比例变小；或者，若播放时间段相对于历史播放时间缩短，则在视频编辑器中显示视频信息中视频序列帧的缩略图的尺寸/显示比例变大。本领域技术人员可以根据具体的设计需求确定具体的实现方式，只要能够实现根据触发操作调整在视频编辑器中显示的缩略图即可，在此不再赘述。It can be understood that when the thumbnail of the video sequence frame in the video information displayed in the video editor is adjusted according to the trigger operation, the size and / or the display ratio of the thumbnail displayed in the video editor can also be adjusted according to the trigger operation. For example: if the playback time period is longer than the historical playback time, the size / display ratio of the thumbnail of the video sequence frame in the video information displayed in the video editor is reduced; or if the playback time period is shortened relative to the historical playback time , The size / display ratio of the thumbnails of the video sequence frames in the video information displayed in the video editor becomes larger. Those skilled in the art may determine a specific implementation manner according to specific design requirements, as long as the thumbnails displayed in the video editor can be adjusted according to a trigger operation, and details are not described herein again.
图5为本发明实施例提供的获取用户拖动视频编辑器的触发操作的流程示意图；在上述实施例的基础上，继续参考附图5可知，在用户对视频编辑器进行拖动操作时，本实施例对于触发操作获取的具体实现方式不做限定，本领域技术人员可以根据具体的设计需求进行设置，较为优选的，本实施例中的获取用户拖动视频编辑器的触发操作可以包括：FIG. 5 is a schematic flowchart of acquiring a trigger operation of a user dragging a video editor according to an embodiment of the present invention; based on the foregoing embodiment, and referring to FIG. 5, it can be known that when a user performs a drag operation on a video editor, This embodiment does not limit the specific implementation of the trigger operation acquisition. Those skilled in the art can set it according to specific design requirements. More preferably, the trigger operation of acquiring the user dragging the video editor in this embodiment may include:
S1011：获取用户拖动位于视频编辑器的第一调整区域的第一触发操作；和/或，S1011: Obtain a first trigger operation of the user dragging the first adjustment area located in the video editor; and / or,
S1012：获取用户拖动位于视频编辑器的第二调整区域的第二触发操作，第二调整区域和第一调整区域位于视频编辑器的两侧。S1012: Acquire a second trigger operation of the user dragging the second adjustment area located in the video editor, and the second adjustment area and the first adjustment area are located on both sides of the video editor.
举例来说，视频编辑器位于待处理视频的上端或者下端，且该视频编辑器为可以进行编辑的条状编辑框，其中，上述的编辑可以为用户对视频编辑器进行左右拖动的编辑操作，此时，第一调整区域和第二调整区域可以分别位于视频编辑器的左右两侧，用户可以对第一调整区域进行拖动操作，从而 使得第一调整区域可以进行左右移动，进而可以获取到第一触发操作；同理的，第二调整区域也可以根据用户的拖动操作进行左右移动，进而可以获取到第二触发操作。For example, the video editor is located at the upper or lower end of the video to be processed, and the video editor is a bar-shaped edit box that can be edited. The above-mentioned editing can be performed by the user by dragging the video editor left or right. At this time, the first adjustment area and the second adjustment area can be located on the left and right sides of the video editor, respectively. The user can drag the first adjustment area, so that the first adjustment area can be moved left and right, and then can be obtained. To the first trigger operation; similarly, the second adjustment area can also be moved left and right according to the drag operation of the user, and then the second trigger operation can be obtained.
为了提高人机交互的显示效果，该方法还可以包括：In order to improve the display effect of human-computer interaction, the method may further include:
S201：在用户拖动第一调整区域时，第一调整区域可以根据用户的拖动轨迹进行移动，并在拖动结束后恢复至预设的初始位置。S201: When the user drags the first adjustment area, the first adjustment area can be moved according to the drag track of the user, and is restored to a preset initial position after the dragging ends.
举例来说，第一调整区域的初始位置为L1，在用户拖动第一调整区域时，第一调整区域可以根据用户的拖动操作进行移动，而在用户的拖动操作结束的位置为L2时，第一调整区域会在用户拖动操作结束后，由位置L2处恢复至L1处，进而实现了在用户结束拖动操作时，第一调整区域带有反弹效果，进一步提高了人机交互的显示效果。For example, the initial position of the first adjustment area is L1. When the user drags the first adjustment area, the first adjustment area can be moved according to the user's drag operation, and the position at the end of the user's drag operation is L2 , The first adjustment area will be restored from the position L2 to L1 after the user's drag operation is completed, so that when the user ends the drag operation, the first adjustment area has a rebound effect, which further improves human-computer interaction. Display effect.
类似的，方法还包括：Similarly, the method also includes:
S301：在用户拖动第二调整区域时，第二调整区域可以根据用户的拖动轨迹进行移动，并在拖动结束后恢复至预设的初始位置。S301: When the user drags the second adjustment area, the second adjustment area can be moved according to the drag track of the user, and is restored to a preset initial position after the dragging ends.
与上述步骤S201的实现过程相类似，在此不再赘述。The implementation process of step S201 is similar, and is not repeated here.
为了进一步提高该方法的实用性，本实施例中的方法还可以包括：To further improve the practicability of the method, the method in this embodiment may further include:
S401：利用视频编辑器显示与视频信息相对应的时间信息，时间信息包括以下至少之一：播放时间段、播放开始时间、播放结束时间。S401: Use a video editor to display time information corresponding to the video information. The time information includes at least one of the following: a playback time period, a playback start time, and a playback end time.
其中，播放时间段可以通过视频编辑器的中部区域进行显示，播放开始时间可以通过视频编辑器的一侧(左侧或者右侧)进行显示，播放结束时间可以通过视频编辑器的另一侧(右侧或左侧)进行显示，以与播放开始时间进行区分。The playback time period can be displayed through the middle area of the video editor, the playback start time can be displayed on one side (left or right) of the video editor, and the playback end time can be displayed on the other side of the video editor ( Right or left) to distinguish it from playback start time.
另外，在视频编辑器均可以显示播放时间段、播放开始时间、播放结束时间时，视频编辑器中所显示的播放时间段可以根据用户拖动视频编辑器的触发操作进行实时改变，而视频编辑器中所显示的播放开始时间可以根据用户拖动视频编辑器一侧(例如：左侧)的第一调整区域的触发操作进行实时改变，而视频编辑器中所显示的播放结束时间可以根据用户拖动视频编辑器另一侧(例如：右侧)的第二调整区域的触发操作进行实时改变；可以理解的是，当用户对第一调整区域或者第二调整区域不存在触发操作时，那么第一调整区域或者第二调整区域所对应的播放开始时间和播放结束时间不发生 改变。In addition, when the video editor can display the playback time period, playback start time, and playback end time, the playback time period displayed in the video editor can be changed in real time according to the trigger operation of the user dragging the video editor, and the video editing The playback start time displayed in the editor can be changed in real time according to the trigger operation of the user dragging the first adjustment area on one side (for example: left side) of the video editor, and the playback end time displayed in the video editor can be changed according to the user The trigger operation of dragging the second adjustment area on the other side (for example, the right side) of the video editor is changed in real time. It can be understood that when the user does not have a trigger operation for the first adjustment area or the second adjustment area, then The playback start time and playback end time corresponding to the first adjustment area or the second adjustment area do not change.
利用视频编辑器显示与视频信息相对应的时间信息，对视频进行处理操作时，使得用户可以直观地获取到与视频处理有关的时间信息，进一步提高了该方法使用的方便程度。The video editor is used to display the time information corresponding to the video information, and when the video is processed, the user can intuitively obtain the time information related to the video processing, which further improves the convenience of the method.
图6为本发明实施例提供的又一种视频的处理方法的流程示意图；图7为本发明实施例提供的利用预设的解码方式对图像数据进行解码的流程示意图；在上述实施例的基础上，继续参考附图6-7可知，本实施例中，在根据触发操作确定拖动后需要处理的视频信息之后，方法还包括：6 is a schematic flowchart of another video processing method according to an embodiment of the present invention; FIG. 7 is a schematic flowchart of decoding image data by using a preset decoding method according to an embodiment of the present invention; It can be known from the above with reference to FIGS. 6-7 that in this embodiment, after determining the video information to be processed after dragging according to the trigger operation, the method further includes:
S501：获取与视频信息相对应的图像数据；S501: Acquire image data corresponding to video information;
S502：利用预设的解码方式对图像数据进行解码，获取视频信息中的多个视频序列帧。S502: Decode the image data by using a preset decoding method to obtain multiple video sequence frames in the video information.
其中，预设的解码方式包括硬解码方式和/或软解码方式。The preset decoding method includes a hard decoding method and / or a soft decoding method.
具体的，利用预设的解码方式对图像数据进行解码可以包括：Specifically, decoding the image data by using a preset decoding method may include:
S5021：利用硬解码方式对视频数据进行解码操作；S5021: Decoding video data by using a hard decoding method;
S5022：若利用硬解码方式无法对视频数据进行解码操作，则利用软解码方式对视频数据进行解码操作。S5022: If the video data cannot be decoded using the hard decoding method, the video data is decoded using the soft decoding method.
其中，硬解码(也成为硬件解码)方式是通过显卡的视频加速功能对视频(高清视频)进行解码的方式，软解码(也成为软件解码)方式是依靠中央处理器CPU来对视频(高清视频)进行解码的方式，以API Media Metada Retiever作为硬解码方式、FFPG作为软解码方式为例进行说明，首先，通过硬解码API Media Metada Retiever对视频数据进行解码操作，以实现对视频序列帧的API抽取；如果抽取不到，则通过FFPG的软解码对视频数据进行解码操作，以实现对视频序列帧的API抽取。Among them, the hard decoding (also known as hardware decoding) method is to decode the video (HD video) through the video acceleration function of the graphics card, and the soft decoding (also known as software decoding) method is to rely on the central processing unit CPU to decode the video (HD video). ) Decoding method, using API Media Metada Retiever as a hard decoding method, FFPG as a soft decoding method as an example. First, the hard decoding API Media Metada Retiever is used to decode video data to implement the API of video sequence frames. Extraction; if it cannot be extracted, the video data is decoded through FFPG soft decoding to achieve API extraction of video sequence frames.
进一步的，在获取视频信息中的多个视频序列帧之后，方法还包括：Further, after acquiring multiple video sequence frames in the video information, the method further includes:
S601：对多个视频序列帧进行缓存。S601: Buffer multiple video sequence frames.
为了提高效率，可以使用预设的LRU(Least Recently Used)算法对抽取过的图片进行缓存，其中，LRU算法为内存管理的一种页面置换算法，具体可以将所抽取的图片缓存至预设的内存或者手机磁盘上。In order to improve the efficiency, a preset LRU (Least, Recently Used) algorithm can be used to cache the extracted pictures. The LRU algorithm is a page replacement algorithm of memory management, and the extracted pictures can be cached to a preset Memory or phone disk.
另外，为例使得性能达到最佳，还可以将对视频序列帧的整个抽取过程在预设的内存或者手机磁盘上做LRU的缓存。In addition, as an example, to achieve the best performance, the entire extraction process of the video sequence frames can also be used as a LRU cache in a preset memory or a mobile phone disk.
通过上述方式对视频序列帧进行抽取，并可以对视频序列帧进行缓存，有效地保证了该方法的使用效率，进一步提高了该方法使用的准确可靠性。The video sequence frames are extracted in the above manner, and the video sequence frames can be cached, which effectively ensures the use efficiency of the method and further improves the accuracy and reliability of the method.
图8为本发明实施例提供的一种视频的处理装置的结构示意图；参考附图8可知，本实施例提供了一种视频的处理装置，包括：FIG. 8 is a schematic structural diagram of a video processing apparatus according to an embodiment of the present invention; referring to FIG. 8, it is known that this embodiment provides a video processing apparatus, including:
存储器201，用于存储计算机程序；The memory 201 is configured to store a computer program;
处理器202，用于运行存储器201中存储的计算机程序以实现：获取用户拖动视频编辑器的触发操作；根据触发操作确定拖动后需要处理的视频信息，视频信息中包括多个视频序列帧；根据触发操作调整在视频编辑器中显示的视频信息中视频序列帧的缩略图。The processor 202 is configured to run a computer program stored in the memory 201 to implement: obtaining a trigger operation of a user dragging a video editor; and determining video information to be processed after dragging according to the trigger operation. The video information includes multiple video sequence frames ; Adjust the thumbnail of the video sequence frame in the video information displayed in the video editor according to the trigger operation.
进一步的，在处理器202根据触发操作确定拖动后需要处理的视频信息时，处理器202被配置为：根据触发操作确定拖动后的播放时间段；根据播放时间段确定视频信息。Further, when the processor 202 determines video information to be processed after dragging according to the trigger operation, the processor 202 is configured to: determine a playback time period after dragging according to the trigger operation; and determine video information according to the playback time period.
其中，在处理器202根据触发操作确定拖动后的播放时间段时，处理器202被配置为：根据触发操作确定拖动后的播放开始时间和播放结束时间；将播放结束时间与播放开始时间之间的时间段确定为播放时间段。Wherein, when the processor 202 determines the playback time period after dragging according to the trigger operation, the processor 202 is configured to: determine the playback start time and playback end time after dragging according to the trigger operation; and set the playback end time and playback start time The time period between them is determined as the playback time period.
进一步的，在处理器202根据触发操作调整在视频编辑器中显示的视频信息中视频序列帧的缩略图时，处理器202被配置为：Further, when the processor 202 adjusts the thumbnail of the video sequence frame in the video information displayed in the video editor according to the trigger operation, the processor 202 is configured to:
若播放时间段相对于历史播放时间延长，则在视频编辑器中显示视频信息中视频序列帧的缩略图的数量增加；或者，若播放时间段相对于历史播放时间缩短，则在视频编辑器中显示视频信息中视频序列帧的缩略图的数量减少。If the playback time period is longer than the historical playback time, the number of thumbnails of the video sequence frames in the video information displayed in the video editor is increased; or if the playback time period is shortened relative to the historical playback time, the video editor is displayed in the video editor The number of thumbnails showing video sequence frames in the video information is reduced.
在处理器202根据触发操作确定拖动后的播放时间段之后，处理器202被配置为：若播放时间段相对于历史播放时间延长，则在视频编辑器之外显示视频信息中视频序列帧的缩略图的数量减少；或者，若播放时间段相对于历史播放时间缩短，则在视频编辑器之外显示视频信息中视频序列帧的缩略图的数量增加。After the processor 202 determines the playback time period after dragging according to the trigger operation, the processor 202 is configured to: if the playback time period is extended relative to the historical playback time, display the video sequence frame in the video information outside the video editor. The number of thumbnails is reduced; or, if the playback time period is shortened relative to the historical playback time, the number of thumbnails of the video sequence frames in the video information displayed outside the video editor is increased.
其中，播放时间段和历史播放时间均小于或等于预设的标准播放时间，标准播放时间为包括视频信息在内的完整视频所需要处理的时间。Among them, the playback time period and the historical playback time are both less than or equal to a preset standard playback time, and the standard playback time is the time required to process a complete video including video information.
进一步的，在处理器202获取用户拖动视频编辑器的触发操作时，处理器202被配置为：获取用户拖动位于视频编辑器的第一调整区域的第一触发 操作；和/或，获取用户拖动位于视频编辑器的第二调整区域的第二触发操作，第二调整区域和第一调整区域位于视频编辑器的两侧。Further, when the processor 202 obtains a trigger operation of the user dragging the video editor, the processor 202 is configured to: obtain a first trigger operation of the user dragging the first adjustment area located in the video editor; and / or, obtain The user drags a second trigger operation located in a second adjustment area of the video editor, and the second adjustment area and the first adjustment area are located on both sides of the video editor.
其中，处理器202被配置为：在用户拖动第一调整区域时，第一调整区域可以根据用户的拖动轨迹进行移动，并在拖动结束后恢复至预设的初始位置。Wherein, the processor 202 is configured to: when the user drags the first adjustment area, the first adjustment area can be moved according to the drag track of the user, and is restored to a preset initial position after the drag is finished.
另外，处理器202被配置为：在用户拖动第二调整区域时，第二调整区域可以根据用户的拖动轨迹进行移动，并在拖动结束后恢复至预设的初始位置。In addition, the processor 202 is configured to: when the user drags the second adjustment area, the second adjustment area can be moved according to the drag track of the user, and restored to a preset initial position after the dragging ends.
进一步的，处理器202被配置为：利用视频编辑器显示与视频信息相对应的时间信息，时间信息包括以下至少之一：播放时间段、播放开始时间、播放结束时间。Further, the processor 202 is configured to use a video editor to display time information corresponding to the video information, and the time information includes at least one of the following: a playback time period, a playback start time, and a playback end time.
进一步的，在处理器202根据触发操作确定拖动后需要处理的视频信息之后，处理器202被配置为：获取与视频信息相对应的图像数据；利用预设的解码方式对图像数据进行解码，获取视频信息中的多个视频序列帧。Further, after the processor 202 determines the video information to be processed after dragging according to the trigger operation, the processor 202 is configured to: obtain image data corresponding to the video information; and decode the image data by using a preset decoding method, Get multiple video sequence frames in video information.
其中，预设的解码方式包括硬解码方式和/或软解码方式。The preset decoding method includes a hard decoding method and / or a soft decoding method.
另外，在处理器202利用预设的解码方式对图像数据进行解码时，处理器202被配置为：利用硬解码方式对视频数据进行解码操作；若利用硬解码方式无法对视频数据进行解码操作，则利用软解码方式对视频数据进行解码操作。In addition, when the processor 202 decodes the image data by using a preset decoding method, the processor 202 is configured to: use a hard decoding method to decode the video data; if the hard decoding method cannot be used to decode the video data, Then use soft decoding to decode video data.
进一步的，在处理器202获取视频信息中的多个视频序列帧之后，处理器202被配置为：对多个视频序列帧进行缓存。Further, after the processor 202 acquires multiple video sequence frames in the video information, the processor 202 is configured to: buffer the multiple video sequence frames.
本实施例中的视频的处理装置可用于执行上述方法中图1-7所示实施例的技术方案，其实现原理和技术效果类似，此处不再赘述。The video processing device in this embodiment may be used to execute the technical solutions of the embodiments shown in FIGS. 1-7 in the foregoing method. The implementation principles and technical effects are similar, and details are not described herein again.
图9为本发明实施例提供的另一种视频的处理装置的结构示意图，参考附图9所示，本实施例提供了另一种视频的处理装置，包括：FIG. 9 is a schematic structural diagram of another video processing apparatus according to an embodiment of the present invention. Referring to FIG. 9, this embodiment provides another video processing apparatus, including:
获取模块1，用于获取用户拖动视频编辑器的触发操作；An acquisition module 1 for acquiring a trigger operation of a user dragging a video editor;
确定模块2，用于根据触发操作确定拖动后需要处理的视频信息，视频信息中包括多个视频序列帧；A determining module 2 configured to determine video information to be processed after dragging according to a trigger operation, where the video information includes multiple video sequence frames;
处理模块3，用于根据触发操作调整在视频编辑器中显示的视频信息中 视频序列帧的缩略图。The processing module 3 is configured to adjust a thumbnail of a video sequence frame in the video information displayed in the video editor according to a trigger operation.
本实施例中的图像的编码控制装置中的获取模块1、确定模块2和处理模块3可用于执行上述方法中图1-7所示实施例的技术方案，其实现原理和技术效果类似，此处不再赘述。The acquisition module 1, the determination module 2, and the processing module 3 in the image encoding control device in this embodiment may be used to execute the technical solution of the embodiment shown in FIG. 1-7 in the above method. The implementation principles and technical effects are similar. I will not repeat them here.
本实施例的另一方面提供了一种计算机可读存储介质，该计算机可读存储介质中存储有程序指令，程序指令用于实现上述任意一个实施例中的视频的处理方法。Another aspect of this embodiment provides a computer-readable storage medium. The computer-readable storage medium stores program instructions, and the program instructions are used to implement the video processing method in any one of the foregoing embodiments.
以上各个实施例中的技术方案、技术特征在与本相冲突的情况下均可以单独，或者进行组合，只要未超出本领域技术人员的认知范围，均属于本申请保护范围内的等同实施例。The technical solutions and technical features in each of the above embodiments may be singular or combined in the case of conflict with the present, as long as they do not exceed the scope of the knowledge of those skilled in the art, they all belong to the equivalent embodiments within the protection scope of this application .
在本发明所提供的几个实施例中，应该理解到，所揭露的相关装置和方法，可以通过其它的方式实现。例如，以上所描述的装置实施例仅仅是示意性的，例如，所述模块或单元的划分，仅仅为一种逻辑功能划分，实际实现时可以有另外的划分方式，例如多个单元或组件可以结合或者可以集成到另一个系统，或一些特征可以忽略，或不执行。另一点，所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口，装置或单元的间接耦合或通信连接，可以是电性，机械或其它的形式。In the several embodiments provided by the present invention, it should be understood that the related apparatuses and methods disclosed may be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the modules or units is only a logical function division. In actual implementation, there may be another division manner. For example, multiple units or components may be divided. The combination can either be integrated into another system, or some features can be ignored or not implemented. In addition, the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, which may be electrical, mechanical or other forms.
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的，作为单元显示的部件可以是或者也可以不是物理单元，即可以位于一个地方，或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, may be located in one place, or may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the objective of the solution of this embodiment.
另外，在本发明各个实施例中的各功能单元可以集成在一个处理单元中，也可以是各个单元单独物理存在，也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现，也可以采用软件功能单元的形式实现。In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist separately physically, or two or more units may be integrated into one unit. The above integrated unit may be implemented in the form of hardware or in the form of software functional unit.
所述集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时，可以存储在一个计算机可读取存储介质中。基于这样的理解，本发明的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的 全部或部分可以以软件产品的形式体现出来，该计算机软件产品存储在一个存储介质中，包括若干指令用以使得计算机处理器(processor)执行本发明各个实施例所述方法的全部或部分步骤。而前述的存储介质包括：U盘、移动硬盘、只读存储器(ROM，Read-Only Memory)、随机存取存储器(RAM，Random Access Memory)、磁盘或者光盘等各种可以存储程序代码的介质。When the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it may be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention essentially or part that contributes to the existing technology or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium Including instructions for causing a computer processor to perform all or part of the steps of the method described in various embodiments of the present invention. The foregoing storage media include: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disks or optical disks and other media that can store program codes.
以上所述仅为本发明的实施例，并非因此限制本发明的专利范围，凡是利用本发明说明书及附图内容所作的等效结构或等效流程变换，或直接或间接运用在其他相关的技术领域，均同理包括在本发明的专利保护范围内。The above description is only an embodiment of the present invention, and thus does not limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made by using the description and drawings of the present invention, or directly or indirectly applied to other related technologies The same applies to the fields of patent protection of the present invention.
最后应说明的是：以上各实施例仅用以说明本发明的技术方案，而非对其限制；尽管参照前述各实施例对本发明进行了详细的说明，本领域的普通技术人员应当理解：其依然可以对前述各实施例所记载的技术方案进行修改，或者对其中部分或者全部技术特征进行等同替换；而这些修改或者替换，并不使相应技术方案的本质脱离本发明各实施例技术方案的范围。Finally, it should be noted that the above embodiments are only used to illustrate the technical solution of the present invention, but not limited thereto. Although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that: It is still possible to modify the technical solutions described in the foregoing embodiments, or to replace some or all of the technical features equivalently; and these modifications or replacements do not depart from the essence of the corresponding technical solutions of the technical solutions of the embodiments of the present invention. range.

Claims (29)

  1. 一种视频的处理方法，其特征在于，包括：A video processing method, comprising:
    获取用户拖动视频编辑器的触发操作；Get the trigger action of the user dragging the video editor;
    根据所述触发操作确定拖动后需要处理的视频信息，所述视频信息中包括多个视频序列帧；Determining video information to be processed after dragging according to the trigger operation, where the video information includes multiple video sequence frames;
    根据所述触发操作调整在所述视频编辑器中显示的所述视频信息中视频序列帧的缩略图。Adjusting a thumbnail of a video sequence frame in the video information displayed in the video editor according to the trigger operation.
  2. 根据权利要求1所述的方法，其特征在于，根据所述触发操作确定拖动后需要处理的视频信息，包括：The method according to claim 1, wherein determining video information to be processed after dragging according to the trigger operation comprises:
    根据所述触发操作确定拖动后的播放时间段；Determining a playback time period after dragging according to the trigger operation;
    根据所述播放时间段确定所述视频信息。The video information is determined according to the playback time period.
  3. 根据权利要求2所述的方法，其特征在于，根据所述触发操作确定拖动后的播放时间段，包括：The method according to claim 2, wherein determining the playback time period after dragging according to the trigger operation comprises:
    根据所述触发操作确定拖动后的播放开始时间和播放结束时间；Determining the playback start time and playback end time after dragging according to the trigger operation;
    将所述播放结束时间与所述播放开始时间之间的时间段确定为所述播放时间段。A time period between the playback end time and the playback start time is determined as the playback time period.
  4. 根据权利要求2所述的方法，其特征在于，根据所述触发操作调整在所述视频编辑器中显示的所述视频信息中视频序列帧的缩略图，包括：The method according to claim 2, wherein adjusting a thumbnail of a video sequence frame in the video information displayed in the video editor according to the trigger operation comprises:
    若所述播放时间段相对于历史播放时间延长，则在所述视频编辑器中显示所述视频信息中视频序列帧的缩略图的数量增加；或者，If the playback time period is extended relative to the historical playback time, the number of thumbnails of the video sequence frames in the video information displayed in the video editor is increased; or,
    若所述播放时间段相对于历史播放时间缩短，则在所述视频编辑器中显示所述视频信息中视频序列帧的缩略图的数量减少。If the playback time period is shortened relative to the historical playback time, the number of thumbnails of video sequence frames in the video information displayed in the video editor is reduced.
  5. 根据权利要求2所述的方法，其特征在于，在根据所述触发操作确定拖动后的播放时间段之后，所述方法还包括：The method according to claim 2, wherein after determining a playback time period after dragging according to the trigger operation, the method further comprises:
    若所述播放时间段相对于历史播放时间延长，则在所述视频编辑器之外显示所述视频信息中视频序列帧的缩略图的数量减少；或者，If the playback time period is extended relative to the historical playback time, the number of thumbnails of the video sequence frames in the video information displayed outside the video editor is reduced; or,
    若所述播放时间段相对于历史播放时间缩短，则在所述视频编辑器之外显示所述视频信息中视频序列帧的缩略图的数量增加。If the playback time period is shortened relative to the historical playback time, the number of thumbnails of video sequence frames in the video information displayed outside the video editor is increased.
  6. 根据权利要求4所述的方法，其特征在于，所述播放时间段和历史播 放时间均小于或等于预设的标准播放时间，所述标准播放时间为包括所述视频信息在内的完整视频所需要处理的时间。The method according to claim 4, wherein the playback time period and the historical playback time are both less than or equal to a preset standard playback time, and the standard playback time is a complete video including the video information. Time to process.
  7. 根据权利要求1所述的方法，其特征在于，获取用户拖动视频编辑器的触发操作，包括：The method according to claim 1, wherein obtaining a trigger operation of a user dragging a video editor comprises:
    获取用户拖动位于所述视频编辑器的第一调整区域的第一触发操作；和/或，Acquiring a first trigger operation of a user dragging a first adjustment area located in the video editor; and / or,
    获取用户拖动位于所述视频编辑器的第二调整区域的第二触发操作，所述第二调整区域和所述第一调整区域位于所述视频编辑器的两侧。A second trigger operation is obtained in which a user drags a second adjustment area located in the video editor, and the second adjustment area and the first adjustment area are located on both sides of the video editor.
  8. 根据权利要求7所述的方法，其特征在于，所述方法还包括：The method according to claim 7, further comprising:
    在用户拖动所述第一调整区域时，所述第一调整区域可以根据用户的拖动轨迹进行移动，并在拖动结束后恢复至预设的初始位置。When the user drags the first adjustment area, the first adjustment area can be moved according to the drag track of the user, and is restored to a preset initial position after the dragging ends.
  9. 根据权利要求7所述的方法，其特征在于，所述方法还包括：The method according to claim 7, further comprising:
    在用户拖动所述第二调整区域时，所述第二调整区域可以根据用户的拖动轨迹进行移动，并在拖动结束后恢复至预设的初始位置。When the user drags the second adjustment area, the second adjustment area can be moved according to the drag track of the user, and is restored to a preset initial position after the dragging ends.
  10. 根据权利要求1-9中任意一项所述的方法，其特征在于，所述方法还包括：The method according to any one of claims 1-9, wherein the method further comprises:
    利用所述视频编辑器显示与所述视频信息相对应的时间信息，所述时间信息包括以下至少之一：播放时间段、播放开始时间、播放结束时间。Using the video editor to display time information corresponding to the video information, the time information includes at least one of the following: a playback time period, a playback start time, and a playback end time.
  11. 根据权利要求1-9中任意一项所述的方法，其特征在于，在根据所述触发操作确定拖动后需要处理的视频信息之后，所述方法还包括：The method according to any one of claims 1-9, wherein after determining the video information to be processed after dragging according to the trigger operation, the method further comprises:
    获取与所述视频信息相对应的图像数据；Acquiring image data corresponding to the video information;
    利用预设的解码方式对所述图像数据进行解码，获取所述视频信息中的多个视频序列帧。Decoding the image data by using a preset decoding method to obtain multiple video sequence frames in the video information.
  12. 根据权利要求11所述的方法，其特征在于，所述预设的解码方式包括硬解码方式和/或软解码方式。The method according to claim 11, wherein the preset decoding mode comprises a hard decoding mode and / or a soft decoding mode.
  13. 根据权利要求12所述的方法，其特征在于，利用预设的解码方式对所述图像数据进行解码，包括：The method according to claim 12, wherein decoding the image data by using a preset decoding method comprises:
    利用所述硬解码方式对所述视频数据进行解码操作；Performing a decoding operation on the video data by using the hard decoding mode;
    若利用所述硬解码方式无法对所述视频数据进行解码操作，则利用所述软解码方式对所述视频数据进行解码操作。If the video data cannot be decoded using the hard decoding method, the video data is decoded using the soft decoding method.
  14. 根据权利要求11所述的方法，其特征在于，在获取所述视频信息中的多个视频序列帧之后，所述方法还包括：The method according to claim 11, wherein after acquiring a plurality of video sequence frames in the video information, the method further comprises:
    对所述多个视频序列帧进行缓存。Buffering the plurality of video sequence frames.
  15. 一种视频的处理装置，其特征在于，包括：A video processing device, comprising:
    存储器，用于存储计算机程序；Memory for storing computer programs;
    处理器，用于运行所述存储器中存储的计算机程序以实现：获取用户拖动视频编辑器的触发操作；根据所述触发操作确定拖动后需要处理的视频信息，所述视频信息中包括多个视频序列帧；根据所述触发操作调整在所述视频编辑器中显示的所述视频信息中视频序列帧的缩略图。A processor for running a computer program stored in the memory to implement: acquiring a trigger operation of a user dragging a video editor; and determining video information to be processed after dragging according to the trigger operation, the video information including multiple Video sequence frames; adjusting thumbnails of video sequence frames in the video information displayed in the video editor according to the trigger operation.
  16. 根据权利要求15所述的装置，其特征在于，在所述处理器根据所述触发操作确定拖动后需要处理的视频信息时，所述处理器被配置为：The apparatus according to claim 15, wherein when the processor determines video information to be processed after dragging according to the trigger operation, the processor is configured to:
    根据所述触发操作确定拖动后的播放时间段；Determining a playback time period after dragging according to the trigger operation;
    根据所述播放时间段确定所述视频信息。The video information is determined according to the playback time period.
  17. 根据权利要求16所述的装置，其特征在于，在所述处理器根据所述触发操作确定拖动后的播放时间段时，所述处理器被配置为：The device according to claim 16, wherein when the processor determines a playback time period after dragging according to the trigger operation, the processor is configured to:
    根据所述触发操作确定拖动后的播放开始时间和播放结束时间；Determining the playback start time and playback end time after dragging according to the trigger operation;
    将所述播放结束时间与所述播放开始时间之间的时间段确定为所述播放时间段。A time period between the playback end time and the playback start time is determined as the playback time period.
  18. 根据权利要求16所述的装置，其特征在于，在所述处理器根据所述触发操作调整在所述视频编辑器中显示的所述视频信息中视频序列帧的缩略图时，所述处理器被配置为：The device according to claim 16, wherein when the processor adjusts a thumbnail of a video sequence frame in the video information displayed in the video editor according to the trigger operation, the processor Is configured as:
    若所述播放时间段相对于历史播放时间延长，则在所述视频编辑器中显示所述视频信息中视频序列帧的缩略图的数量增加；或者，If the playback time period is extended relative to the historical playback time, the number of thumbnails of the video sequence frames in the video information displayed in the video editor is increased; or,
    若所述播放时间段相对于历史播放时间缩短，则在所述视频编辑器中显示所述视频信息中视频序列帧的缩略图的数量减少。If the playback time period is shortened relative to the historical playback time, the number of thumbnails of video sequence frames in the video information displayed in the video editor is reduced.
  19. 根据权利要求16所述的装置，其特征在于，在所述处理器根据所述触发操作确定拖动后的播放时间段之后，所述处理器被配置为：The device according to claim 16, wherein after the processor determines a playback time period after dragging according to the trigger operation, the processor is configured to:
    若所述播放时间段相对于历史播放时间延长，则在所述视频编辑器之外显示所述视频信息中视频序列帧的缩略图的数量减少；或者，If the playback time period is extended relative to the historical playback time, the number of thumbnails of the video sequence frames in the video information displayed outside the video editor is reduced; or,
    若所述播放时间段相对于历史播放时间缩短，则在所述视频编辑器之外 显示所述视频信息中视频序列帧的缩略图的数量增加。If the playback time period is shortened relative to the historical playback time, the number of thumbnails of video sequence frames in the video information displayed outside the video editor increases.
  20. 根据权利要求18所述的装置，其特征在于，所述播放时间段和历史播放时间均小于或等于预设的标准播放时间，所述标准播放时间为包括所述视频信息在内的完整视频所需要处理的时间。The device according to claim 18, wherein the playback time period and historical playback time are both less than or equal to a preset standard playback time, and the standard playback time is a complete video including the video information. Time to process.
  21. 根据权利要求15所述的装置，其特征在于，在所述处理器获取用户拖动视频编辑器的触发操作时，所述处理器被配置为：The apparatus according to claim 15, wherein when the processor obtains a trigger operation of a user dragging a video editor, the processor is configured to:
    获取用户拖动位于所述视频编辑器的第一调整区域的第一触发操作；和/或，Acquiring a first trigger operation of a user dragging a first adjustment area located in the video editor; and / or,
    获取用户拖动位于所述视频编辑器的第二调整区域的第二触发操作，所述第二调整区域和所述第一调整区域位于所述视频编辑器的两侧。A second trigger operation is obtained in which a user drags a second adjustment area located in the video editor, and the second adjustment area and the first adjustment area are located on both sides of the video editor.
  22. 根据权利要求21所述的装置，其特征在于，所述处理器被配置为：The apparatus according to claim 21, wherein the processor is configured to:
    在用户拖动所述第一调整区域时，所述第一调整区域可以根据用户的拖动轨迹进行移动，并在拖动结束后恢复至预设的初始位置。When the user drags the first adjustment area, the first adjustment area can be moved according to the drag track of the user, and is restored to a preset initial position after the dragging ends.
  23. 根据权利要求21所述的装置，其特征在于，所述处理器被配置为：The apparatus according to claim 21, wherein the processor is configured to:
    在用户拖动所述第二调整区域时，所述第二调整区域可以根据用户的拖动轨迹进行移动，并在拖动结束后恢复至预设的初始位置。When the user drags the second adjustment area, the second adjustment area can be moved according to the drag track of the user, and is restored to a preset initial position after the dragging ends.
  24. 根据权利要求15-23中任意一项所述的装置，其特征在于，所述处理器被配置为：The apparatus according to any one of claims 15-23, wherein the processor is configured to:
    利用所述视频编辑器显示与所述视频信息相对应的时间信息，所述时间信息包括以下至少之一：播放时间段、播放开始时间、播放结束时间。Using the video editor to display time information corresponding to the video information, the time information includes at least one of the following: a playback time period, a playback start time, and a playback end time.
  25. 根据权利要求15-23中任意一项所述的装置，其特征在于，在所述处理器根据所述触发操作确定拖动后需要处理的视频信息之后，所述处理器被配置为：The device according to any one of claims 15-23, wherein after the processor determines video information to be processed after dragging according to the trigger operation, the processor is configured to:
    获取与所述视频信息相对应的图像数据；Acquiring image data corresponding to the video information;
    利用预设的解码方式对所述图像数据进行解码，获取所述视频信息中的多个视频序列帧。Decoding the image data by using a preset decoding method to obtain multiple video sequence frames in the video information.
  26. 根据权利要求25所述的装置，其特征在于，所述预设的解码方式包括硬解码方式和/或软解码方式。The device according to claim 25, wherein the preset decoding mode comprises a hard decoding mode and / or a soft decoding mode.
  27. 根据权利要求26所述的装置，其特征在于，在所述处理器利用预设的解码方式对所述图像数据进行解码时，所述处理器被配置为：The apparatus according to claim 26, wherein when the processor decodes the image data by using a preset decoding method, the processor is configured to:
    利用所述硬解码方式对所述视频数据进行解码操作；Performing a decoding operation on the video data by using the hard decoding mode;
    若利用所述硬解码方式无法对所述视频数据进行解码操作，则利用所述软解码方式对所述视频数据进行解码操作。If the video data cannot be decoded using the hard decoding method, the video data is decoded using the soft decoding method.
  28. 根据权利要求25所述的装置，其特征在于，在所述处理器获取所述视频信息中的多个视频序列帧之后，所述处理器被配置为：The apparatus according to claim 25, wherein after the processor obtains a plurality of video sequence frames in the video information, the processor is configured to:
    对所述多个视频序列帧进行缓存。Buffering the plurality of video sequence frames.
  29. 一种计算机可读存储介质，其特征在于，该计算机可读存储介质中存储有程序指令，所述程序指令用于实现权利要求1-14中任意一项所述的视频的处理方法。A computer-readable storage medium, characterized in that the computer-readable storage medium stores program instructions, and the program instructions are used to implement the video processing method according to any one of claims 1-14.
PCT/CN2018/098149 2018-08-01 2018-08-01 Video processing method and apparatus, and computer readable medium WO2020024197A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/CN2018/098149 WO2020024197A1 (en) 2018-08-01 2018-08-01 Video processing method and apparatus, and computer readable medium
CN201880041188.0A CN110786020A (en) 2018-08-01 2018-08-01 Video processing method and device and computer readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2018/098149 WO2020024197A1 (en) 2018-08-01 2018-08-01 Video processing method and apparatus, and computer readable medium

Publications (1)

Publication Number Publication Date
WO2020024197A1 true WO2020024197A1 (en) 2020-02-06

Family

ID=69231304

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/098149 WO2020024197A1 (en) 2018-08-01 2018-08-01 Video processing method and apparatus, and computer readable medium

Country Status (2)

Country Link
CN (1) CN110786020A (en)
WO (1) WO2020024197A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112540713B (en) * 2020-11-13 2022-09-23 广州市百果园网络科技有限公司 Video preview progress bar scaling method, system, device and storage medium

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101032164A (en) * 2004-09-30 2007-09-05 索尼株式会社 Moving picture data edition device and moving picture data edition method
CN101552898A (en) * 2008-03-31 2009-10-07 Lg电子株式会社 Methods and device for reproducing images
US20100053342A1 (en) * 2008-09-04 2010-03-04 Samsung Electronics Co. Ltd. Image edit method and apparatus for mobile terminal
CN102099860A (en) * 2008-05-15 2011-06-15 苹果公司 User interfaces for editing video clips
CN104380380A (en) * 2012-06-08 2015-02-25 Lg电子株式会社 Video editing method and digital device therefor
CN104813399A (en) * 2012-11-05 2015-07-29 奈斯瑞明株式会社 Method for editing motion picture, terminal for same and recording medium
CN108156407A (en) * 2017-12-13 2018-06-12 深圳市金立通信设备有限公司 A kind of video clipping method and terminal

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101032164A (en) * 2004-09-30 2007-09-05 索尼株式会社 Moving picture data edition device and moving picture data edition method
CN101552898A (en) * 2008-03-31 2009-10-07 Lg电子株式会社 Methods and device for reproducing images
CN102099860A (en) * 2008-05-15 2011-06-15 苹果公司 User interfaces for editing video clips
US20100053342A1 (en) * 2008-09-04 2010-03-04 Samsung Electronics Co. Ltd. Image edit method and apparatus for mobile terminal
CN104380380A (en) * 2012-06-08 2015-02-25 Lg电子株式会社 Video editing method and digital device therefor
CN104813399A (en) * 2012-11-05 2015-07-29 奈斯瑞明株式会社 Method for editing motion picture, terminal for same and recording medium
CN108156407A (en) * 2017-12-13 2018-06-12 深圳市金立通信设备有限公司 A kind of video clipping method and terminal

Also Published As

Publication number Publication date
CN110786020A (en) 2020-02-11

Similar Documents

Publication Publication Date Title
JP6662986B2 (en) Generating video with multiple viewpoints
CN112291627B (en) Video editing method and device, mobile terminal and storage medium
US9015590B2 (en) Multimedia comment system and multimedia comment method
US9473548B1 (en) Latency reduction in streamed content consumption
US11670339B2 (en) Video acquisition method and device, terminal and medium
US9002175B1 (en) Automated video trailer creation
WO2013075342A1 (en) Video processing method and device
WO2021169459A1 (en) Short video generation method and platform, electronic device, and storage medium
JP2022509502A (en) Real-time video special effects system and method
CN103197924B (en) Method and system for real-time selection squeeze operation
WO2018161843A1 (en) Method and device for adjusting video playback speed
US20140344751A1 (en) Image Processing Method and Terminal Device
CN105556979A (en) Streaming Media
US11356739B2 (en) Video playback method, terminal apparatus, and storage medium
KR102147633B1 (en) Method and apparatus for decoding variable length coded files
US9055272B2 (en) Moving image reproduction apparatus, information processing apparatus, and moving image reproduction method
WO2021052130A1 (en) Video processing method, apparatus and device, and computer-readable storage medium
CN105791952A (en) Screen shooting method and device for streaming media video data, and electronic device
WO2020024197A1 (en) Video processing method and apparatus, and computer readable medium
TW201601541A (en) Network camera data managing system and managing method thereof
CN105681893A (en) Method and device for decoding stream media video data
WO2023083064A1 (en) Video processing method and apparatus, electronic device, and readable storage medium
KR102066857B1 (en) object image tracking streaming system and method using the same
CN110266706A (en) A kind of playing method and device of multimedia streaming data
JP6597041B2 (en) Server apparatus and information processing system

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18928825

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18928825

Country of ref document: EP

Kind code of ref document: A1