CN111818393B - Video progress adjusting method and device and electronic equipment - Google Patents
Video progress adjusting method and device and electronic equipment Download PDFInfo
- Publication number
- CN111818393B CN111818393B CN202010789499.4A CN202010789499A CN111818393B CN 111818393 B CN111818393 B CN 111818393B CN 202010789499 A CN202010789499 A CN 202010789499A CN 111818393 B CN111818393 B CN 111818393B
- Authority
- CN
- China
- Prior art keywords
- progress
- preview
- image
- images
- frames
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
- H04N21/2387—Stream processing in response to a playback request from an end-user, e.g. for trick-play
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
Abstract
According to the video progress adjusting method, after the initial progress and the terminal progress of the preview are obtained, the multi-frame preview images of the video between the two progresses can be displayed, and further, if the first preview image which can trigger progress jumping is determined in the multi-frame preview images, the video is controlled to jump to the progress corresponding to the first preview image. Therefore, a user can view the multi-frame preview images by performing progress adjustment once, and because each preview image represents the video content of the corresponding progress, the user can accurately control the degree of progress adjustment, fine adjustment of the video progress is realized, and the user experience is improved.
Description
Technical Field
The present application relates to the field of video processing technologies, and in particular, to a method and an apparatus for adjusting a video progress, and an electronic device.
Background
At present, in the process of watching a video by a user, there is often a need to adjust the video playing progress. For example, the user may adjust through fast forward or fast reverse functions of the video.
However, since the degree of fast forward or fast backward cannot be accurately controlled, the user experience is very poor due to the fact that more or less slips often occur.
Disclosure of Invention
In view of this, the present application provides the following technical solutions:
a video progress adjustment method comprises the following steps:
obtaining the initial progress and the termination progress of the preview;
obtaining a plurality of frames of preview images from a plurality of frames of images contained in the video and positioned between the starting progress and the ending progress, and displaying the plurality of frames of preview images;
determining a frame of first preview image meeting a first condition from the displayed multiple frames of preview images, wherein the first condition is used for triggering progress jump operation;
and controlling the video to jump from the current playing progress to the corresponding progress of the first preview image in the video.
Preferably, the obtaining of the starting progress and the ending progress of the preview includes:
in the process of receiving the first sliding operation, obtaining a corresponding first sliding track;
determining the current playing progress as the starting progress, and determining the progress indicated by the end point position of the first sliding track as the ending progress;
correspondingly, the displaying the multi-frame preview image includes:
and displaying the multi-frame preview image in a position area of a display interface where the first sliding track is located.
Preferably, after the displaying the plurality of frames of preview images, the method further includes:
determining a second preview image of one frame meeting a second condition from the displayed plurality of frames of preview images, wherein the second condition is used for triggering image preview operation; determining the current playing progress as a starting progress, and determining the corresponding progress of the second preview image in the video as a terminating progress; returning to execute the step of obtaining multi-frame preview images from the multi-frame images contained in the video and positioned between the starting progress and the ending progress;
alternatively, the first and second electrodes may be,
determining two frames of third preview images from the displayed plurality of frames of preview images; determining the corresponding progress of a third preview image with earlier playing time in the two frames of third preview images in the video as a starting progress, and determining the corresponding progress of a third preview image with later playing time in the video as a terminating progress; and returning to execute the step of obtaining multi-frame preview images from the multi-frame images contained in the video and positioned between the starting progress and the ending progress.
Preferably, the determining two frames of the third preview images from the displayed multiple frames of preview images includes:
in the process of receiving the second sliding operation, obtaining a corresponding second sliding track;
and determining the preview image of which the position area comprises the starting point position of the second sliding track and the preview image of which the position area comprises the ending point position of the second sliding track as the two frames of third preview images.
Preferably, the obtaining a plurality of frames of preview images from a plurality of frames of images included in the video between the starting progress and the ending progress includes:
and obtaining a sampling time interval, and sampling the multi-frame images according to the time interval to obtain the multi-frame preview images.
Preferably, the time interval for obtaining samples includes:
determining the time interval based on a progress interval formed by the starting progress and the ending progress, wherein the time interval is proportional to the duration of the progress interval.
Preferably, the obtaining a plurality of frames of preview images from a plurality of frames of images included in the video between the starting progress and the ending progress includes:
dividing the multi-frame image into a plurality of image sets, wherein the similarity degree of two adjacent frames of images in playing time in each image set is greater than or equal to a preset threshold value, and the similarity degree of two adjacent frames of images in playing time in the two image sets is less than the preset threshold value;
at least one preview image is obtained from each image collection.
Preferably, the obtaining at least one preview image from each image set includes:
and obtaining one frame of image with the maximum bullet screen quantity from each image set as a preview image of the image.
A video progress adjustment apparatus comprising:
the preview module is used for obtaining the initial progress and the termination progress of preview; obtaining a plurality of frames of preview images from a plurality of frames of images contained in the video and positioned between the starting progress and the ending progress, and displaying the plurality of frames of preview images;
the playing module is used for determining a frame of first preview image meeting a first condition from the displayed multiple frames of preview images, wherein the first condition is used for triggering progress jump operation; and controlling the video to jump from the current playing progress to the corresponding progress of the first preview image in the video.
An electronic device, comprising:
the memory is used for storing an application program and data generated by the operation of the application program;
a processor for executing the application to perform the functions of: obtaining the initial progress and the termination progress of the preview; obtaining a plurality of frames of preview images from a plurality of frames of images contained in the video and positioned between the starting progress and the ending progress, and displaying the plurality of frames of preview images; determining a frame of first preview image meeting a first condition from the displayed plurality of frames of preview images, wherein the first condition is used for triggering progress jump operation; and controlling the video to jump from the current playing progress to the corresponding progress of the first preview image in the video.
According to the technical scheme, after the initial progress and the terminal progress of the preview are obtained, the multi-frame preview image of the video between the two progresses can be displayed, and further, if the first preview image which can trigger progress jumping is determined in the multi-frame preview image, the video is controlled to jump to the progress corresponding to the first preview image. Therefore, a user can check the multi-frame preview images by performing progress adjustment once, and each preview image represents the video content of the corresponding progress, so that the user can accurately control the degree of progress adjustment, fine adjustment of the video progress is realized, and the user experience is improved.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, it is obvious that the drawings in the following description are only embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
Fig. 1 is a block diagram of a hardware structure of an electronic device according to an embodiment of the present disclosure;
fig. 2 is a flowchart of a method for adjusting a video progress according to an embodiment of the present disclosure;
fig. 3 is a scene schematic diagram of video progress adjustment according to an embodiment of the present application;
FIG. 4 is a timing diagram of a frame image of a video according to an embodiment of the present disclosure;
fig. 5 is a flowchart of a method of adjusting a video progress according to a second embodiment of the present application;
fig. 6 is a schematic view of a sliding operation scenario provided in an embodiment of the present application;
fig. 7 is a flowchart of a method of adjusting a video progress according to a third embodiment of the present application;
fig. 8 is a flowchart of a video progress adjustment method according to a fourth embodiment of the present application;
fig. 9 is a flowchart of a video progress adjustment method according to a fifth embodiment of the present application;
fig. 10 is a flowchart of a video progress adjustment method according to a sixth embodiment of the present application;
FIG. 11 is a schematic view of an embodiment of the present application;
fig. 12 is a schematic structural diagram of a video progress adjusting device according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments in the present application without making any creative effort belong to the protection scope of the present application.
In order to make the aforementioned objects, features and advantages of the present application more comprehensible, the present application is described in further detail with reference to the accompanying drawings and the detailed description.
The present application provides a video progress adjustment method, which may be applied to an electronic device, and referring to a hardware structure block diagram of the electronic device shown in fig. 1, a hardware structure of the electronic device may include: a processor 11, a communication interface 12, a memory 13 and a communication bus 14;
in the embodiment of the present application, the number of the processor 11, the communication interface 12, the memory 13 and the communication bus 14 is at least one, and the processor 11, the communication interface 12 and the memory 13 complete communication with each other through the communication bus 14.
The processor 11 may be a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), an Application Specific Integrated Circuit (ASIC), one or more Integrated circuits configured to implement the embodiments of the present Application, and so on.
The memory 13 may include a high-speed RAM memory, and may further include a non-volatile memory (non-volatile memory) or the like, for example, at least one disk memory.
The memory 13 stores applications and data generated by the applications, and the processor 11 executes the applications to implement the following functions:
obtaining the initial progress and the termination progress of the preview; obtaining a plurality of frames of preview images from a plurality of frames of images which are contained in the video and are positioned between the initial progress and the final progress, and displaying the plurality of frames of preview images; determining a frame of first preview image meeting a first condition from the displayed multi-frame preview images, wherein the first condition is used for triggering progress jump operation; and controlling the video to jump from the current playing progress to the corresponding progress of the first preview image in the video.
It should be noted that the processor performs refinements and extensions of the implemented functions of the application program, as described below.
An embodiment of the present application provides a video progress adjustment method, referring to a method flowchart shown in fig. 2, where the method includes the following steps:
In the embodiment of the application, in the process of playing the video by the electronic device, the starting progress and the ending progress of the video preview can be input by a user, that is, the user can enter a setting interface of a related preview function, and then the starting progress and the ending progress of the preview are set under the interface.
Of course, the electronic device may also determine by monitoring the input operation of the user, for example, taking the current playing progress of the video as the starting progress of the preview, and further determining the ending progress of the preview in combination with the operation of the user on the fast forward or fast backward function. The embodiment of the present application does not limit the obtaining manner of the starting progress and the ending progress.
Generally, the starting progress of the video preview is the current playing progress of the video, and when the ending progress of the preview is obtained, since there is a difference between hardware devices of different electronic devices receiving input operations, the electronic devices with different input types can set the corresponding input operations.
Taking the tablet as an example, the hardware device that receives the input operation is a touch screen, so when the termination progress of the preview is obtained, the termination progress can be determined by monitoring the touch operation of the user on the touch screen. Continuing with the PC side as an example, the hardware devices receiving the input operation are a keyboard and a mouse, so the termination progress of the preview can be determined by monitoring the position of the cursor on the progress display area (e.g., progress bar).
For convenience of understanding of the present application, referring to the scene schematic diagram shown in fig. 3, when a tablet is playing a video, a current playing progress of the video may be determined to be a through a progress indication mark (a black circle mark in fig. 2) on a progress bar, and at this time, if it is monitored that a touch operation for indicating a preview is input by a user, for example, a duration of one click of a playing progress B of the progress bar exceeds 3S, and for example, a playing progress B of a continuous click of the progress bar within 1S exceeds two times, the playing progress B is taken as a termination progress of the preview.
It should be noted that the input operations described above for the electronic device to determine the termination progress of the preview are only examples, and it is understood that other input operations not listed in the present application are also within the scope of the present application.
And 102, obtaining a plurality of frames of preview images from a plurality of frames of images between the starting progress and the ending progress contained in the video, and displaying the plurality of frames of preview images.
In the embodiment of the present application, a video includes a group of images with time sequence, see the image schematic diagram of the video shown in fig. 4, where one frame of image in the video corresponds to one playing time, and since the playing progress of the video is essentially a playing time period, for example, the starting progress of a preview is 0 to 10min, and the ending progress is 0 to 20min, a multi-frame image included in the video and located between the starting progress of the preview and the ending progress B can be determined by determining whether the playing time of the frame of image is located between 10min and 20 min.
On the basis, different preview image sampling modes can be set according to different scene requirements, and then a part of frame images are sampled from the determined multi-frame images between the preview starting progress A and the preview ending progress B according to the corresponding preview image sampling modes to be used as preview images, and the multi-frame preview images obtained through sampling are displayed on a display interface of the video.
It should be noted that when the multiple frames of preview images are displayed on the display interface of the video, the multiple frames of preview images are arranged in the order from small to large of the corresponding progress, so that the user can determine the size relationship of the progress between the preview images.
And 103, determining a first preview image of one frame meeting a first condition from the displayed multi-frame preview images, wherein the first condition is used for triggering progress jump operation.
In the embodiment of the application, a user can determine whether the expected video content exists in the multi-frame preview image by checking the multi-frame preview image between the starting progress and the ending progress.
Assuming that the preview image displayed between the initial progress a and the final progress B of the preview in step S102 includes a preview image 1 and a preview image 2, and the playing time of the preview image 1 and the playing time of the preview image 2 are 12min-30S and 18min-30S, respectively, the electronic device may determine a first preview image expected by the user by monitoring an input operation of the user on the preview image, so that the progress corresponding to the first preview image is taken as the expected progress of the user. Assuming that the first preview image is preview image 1, the corresponding expected progress is 0-12 min-30S.
The input operation monitored by the electronic device when determining the first preview image may be a double-click operation on the preview image, a voice operation such as "jump to the 5 th frame preview image", or the like, which is not limited in this embodiment of the present application.
And 104, controlling the video to jump from the current playing progress to the corresponding progress of the first preview image in the video.
In the embodiment of the application, after the first preview image is determined, the electronic device controls the video to jump to the progress corresponding to the first preview image. It should be noted that, after the progress of the video jumps, the state of the progress bar changes, that is, the position of the progress indicator (the black circle in fig. 2) on the progress bar moves.
Therefore, based on the video progress adjusting method provided by the embodiment of the application, a user can view the multiple frames of preview images by performing progress adjustment once, and each preview image represents the video content of the corresponding progress, so that the user can accurately control the progress adjusting degree, the fine adjustment of the video progress is realized, and the user experience is improved.
As an implementation manner of obtaining the starting progress and the ending progress of the preview, a video progress adjustment method provided by the second embodiment of the present application is, as shown in fig. 5, the method includes the following steps:
In the embodiment of the application, most common electronic equipment is provided with a touch screen, and for the electronic equipment, the starting progress and the ending progress of the preview can be determined by monitoring the sliding operation of a user on the touch screen.
In step 202, the current playing progress is determined as the starting progress, and the progress indicated by the end position of the first sliding track is determined as the ending progress.
For convenience of understanding, referring to a scene schematic diagram of a sliding operation shown in fig. 6, an electronic device receives a sliding operation performed by a user on a touch screen, draws a corresponding sliding track a, and may determine a starting point position and an ending point position of the sliding track a by identifying a sliding direction of the sliding operation.
Further, in the embodiment of the present application, a corresponding relationship between the sliding direction and the progress adjusting direction may be preset. Specifically, the sliding direction is the right direction (the right-hand direction when the user faces the touch screen) to indicate the fast forward of the progress, and the sliding direction is the left direction (the left-hand direction when the user faces the touch screen) to indicate the fast backward of the progress.
In addition, the corresponding relation between the transverse sliding distance of the sliding track in the direction of the transverse axis and the progress adjusting step length can be preset in the embodiment of the application. Specifically, after the sliding track is determined, the sliding track is mapped to the direction of the transverse axis of the touch screen to obtain a corresponding transverse sliding distance, and a corresponding progress adjustment step length is determined based on the distance.
If the sliding direction is right, the ending progress of the preview is equal to the sum of the starting progress of the preview and the progress adjusting step length; if the sliding direction is left, the ending progress of the preview is equal to the difference between the starting progress of the preview and the progress adjustment step size.
And 204, displaying the multiple frames of preview images in the position area of the display interface where the first sliding track is located.
In order to achieve the effect of user-defined preview and improve the interestingness of user interaction, in the embodiment of the application, the multi-frame preview image is displayed in the position area where the first sliding track is located, and the image format, such as resolution, size, arrangement position and the like of the preview image when displayed in the position area can be determined by specifically combining the size of the position area, and certainly, the user can also define the preview image.
It should be noted that when the multiple frames of preview images are displayed in the position area where the first sliding track is located, the multiple frames of preview images are still arranged according to the sequence of the corresponding progresses from small to large, so that the user can determine the size relationship of the progresses between the preview images.
Specifically, in the embodiment of the application, in the process of determining the position area where the first sliding track is located, the transverse sliding distance and the longitudinal sliding distance are obtained by mapping the first sliding track to the direction of the transverse axis and the direction of the longitudinal axis respectively, and the transverse sliding distance and the longitudinal sliding distance are used for constructing a rectangular enclosure frame of the first sliding track, where the area of the rectangular enclosure frame located on the display interface is the position area where the first sliding track is located.
And step 206, controlling the video to jump from the current playing progress to the corresponding progress of the first preview image in the video.
Therefore, based on the video progress adjusting method provided by the embodiment of the application, a user can quickly position the initial progress and the termination progress of the preview only by simple sliding operation in the progress adjusting process, and complicated gesture operation is reduced on the basis of realizing fine adjustment of the video progress.
As an implementation manner of obtaining a multi-frame preview image from a multi-frame image included in a video between a starting progress and a terminating progress, a video progress adjustment method provided by a third embodiment of the present application is, as shown in fig. 7, including the following steps:
And step 302, obtaining a sampling time interval, and sampling a plurality of frame images contained in the video between the starting progress and the ending progress according to the time interval to obtain a plurality of frame preview images.
In the embodiment of the application, the sampling time interval can be preset, that is, multiple frames of images between the starting progress and the ending progress contained in the video are sampled averagely according to a certain preset time interval to obtain multiple frames of preview images, and the time intervals between any two adjacent frames of preview images are the same.
In addition, because the video content of the current playing progress exists in the display interface of the video, the viewing effect of the user is affected if the sampling time interval is set too small and the number of the preview images is too large, and a better preview reference cannot be provided for the user if the sampling time interval is set too large and the number of the preview images is too small.
Therefore, in the embodiment of the present application, the time interval of sampling may also be determined based on the duration of the progress interval formed by the starting progress and the ending progress, where the time interval is proportional to the duration of the progress interval. Specifically, taking proportional as an example, the larger the duration of the progress interval is, the larger the time interval is, so as to ensure that the number of preview images is adapted to the progress span of the preview (the span of the starting progress and the ending progress).
And step 304, determining a frame of first preview image meeting a first condition from the displayed multiple frames of preview images, wherein the first condition is used for triggering progress jump operation.
And 305, controlling the video to jump from the current playing progress to the corresponding progress of the first preview image in the video.
Therefore, the video progress adjusting method provided by the embodiment of the application can provide the preview images with the progress being distributed uniformly for the user by setting the sampling time interval, and does not concentrate most of the preview images in a certain preview interval, so that the user can know the video content between the initial progress and the final progress, and a basis is provided for accurately controlling the progress adjusting degree.
As an implementation manner of obtaining a multi-frame preview image from a multi-frame image included in a video between a starting progress and a terminating progress, a video progress adjustment method provided in a fourth embodiment of the present application is, as shown in fig. 8, including the following steps:
In the embodiment of the application, for a multi-frame image between a starting progress and a terminating progress included in a video, the multi-frame image may be divided according to a similarity degree so as to divide the multi-frame image into a plurality of image sets, for example, the multi-frame image is a 20-frame image with a time sequence in a playing period t1 to t2, and the 20-frame image is divided into 3 image sets according to the similarity degree, where the 1 st to 10 th frames belong to the 1 st image set, the 11 th to 15 th frames belong to the 2 nd image set, and the 16 th to 20 th frames belong to the 3 rd image set.
When the image set is divided, the similarity degree of two adjacent images in the multi-frame images is calculated in sequence. Specifically, if the similarity between the two images is greater than or equal to a preset threshold, the images are divided into the same image set (i.e., the image set in which the image of the frame with the earlier playing time is located); and if the similarity degree is smaller than the preset threshold value, dividing one frame of image with later playing time into another new image set.
Continuing to take the 20-frame images with time sequence in the playing time periods t1 to t2 as an example, when dividing the image set, dividing the 1 st frame image into the 1 st image set, further calculating the similarity degree between the 1 st frame image and the 2 nd frame image, and dividing the 2 nd frame image into the 1 st image set because the similarity degree between the 1 st frame image and the 2 nd frame image is greater than or equal to a preset threshold value. And in the same way, calculating the similarity degree of the 10 th frame image and the 11 th frame image after dividing the 10 th frame image into the 1 st image set, dividing the 11 th frame image into the 2 nd image set because the similarity degree of the 10 th frame image and the 11 th frame image is smaller than a preset threshold value, and further calculating the similarity degree … … of the 11 th frame image and the 12 th frame image until the 20 th frame image is divided into the 3 rd image set.
In addition, the similarity degree in the embodiment of the present application may refer to a similarity degree in a scene aspect, and may also refer to a similarity degree in a conversation topic aspect.
1) For similarity in terms of scenes: on one hand, description texts of each Frame of image in a multi-Frame image can be generated firstly through an image description algorithm (for example, visual-Tex: video Tagging using Frame titles), and furthermore, the similarity of two adjacent frames of images in the scene can be determined through calculating the semantic similarity of the description texts (the related algorithm comprises sequence-BERT: sequence embedding using parameter BERT-Networks);
on the other hand, the similarity of two adjacent images in the multi-frame Image (the correlation algorithm includes Learning to composite Image buffers via a relational Neural network) can be directly calculated, so as to determine the similarity degree of the two adjacent images in terms of the scene.
Corresponding to the scenes, a scene similarity threshold can be set, which can ensure that each image set belongs to one scene, and different image sets belong to different scenes.
2) For similarity in topic of conversation: the caption of each frame of image in the multi-frame images can be extracted through a character recognition algorithm, and can be obtained through voice recognition if no caption exists, and the similarity degree of the two adjacent frames of images in the aspect of the conversation topic is further determined through calculating the semantic similarity of the caption (a related algorithm comprises sequence-BERT: sequence embedding using parameter BERT-Networks).
A threshold for the similarity of the conversation topics may be set corresponding to the conversation topics, which may ensure that each image set belongs to one conversation topic and that different image sets belong to different conversation topics.
At step 403, at least one frame of preview image is obtained from each image set.
In the embodiment of the present application, since each image set represents a respective scene or a dialog theme, at least one image may be obtained from each image set according to a certain rule as a preview image, for example, the 1 st image in each image set may be selected as the preview image.
In addition, in order to improve the representativeness of the preview image with respect to the image set, at least one frame of image with the highest playing heat can be selected from the image set as the preview image, and specifically, since the number of bullet screens can represent the playing heat of the video to a certain extent, one frame of image with the largest number of bullet screens can be selected as the preview image of the image set.
And step 404, displaying the multi-frame preview image.
And 406, controlling the video to jump from the current playing progress to the corresponding progress of the first preview image in the video.
Therefore, the video progress adjusting method provided by the embodiment of the application can provide preview images under different scenes or conversation topics for a user by dividing the image set, so that the user can quickly know all scenes or conversation topics between the starting progress and the ending progress, and a powerful basis is provided for accurately adjusting the progress control degree.
By integrating the video progress adjusting method provided by each embodiment, the electronic device obtains the starting progress and the ending progress of the video preview indicated by the user through interaction with the user, further obtains a multi-frame preview image of the video between the two progresses and displays the multi-frame preview image to the user, further determines a first preview image in the multi-frame preview image, which meets the progress jumping condition, through interaction with the user again, and takes the progress corresponding to the first preview image as the expected progress of the user, so as to finish the jumping of the video progress.
It can be seen that, based on the above embodiments, the electronic device may achieve the desired progress by displaying the preview image at least once, that is, by adjusting the progress at least once by the user, but in practical applications, it is likely that the desired progress cannot be located at one time, and at this time, the progress adjustment needs to be performed again.
Based on this, a fifth embodiment of the present application provides a method for adjusting a video progress, referring to a flowchart of the method shown in fig. 9, where the method includes the following steps:
In the embodiment of the application, a user can determine whether the expected video content exists in the multi-frame preview image by checking the multi-frame preview image, and if the expected video content does not exist in the multi-frame preview image, the user needs to adjust the progress of the video again. The electronic equipment determines a second preview image which meets the image preview condition from the multi-frame preview images by monitoring the input operation of the user, so that the progress corresponding to the second preview image is taken as a termination progress, and the preview image is displayed once again.
When determining the second preview image, the input operation monitored by the electronic device may be a single-click operation on the preview image, or may also be a voice operation such as "preview to frame 5 preview image", and the like, which is not limited in this embodiment of the application.
And 505, controlling the video to jump from the current playing progress to the corresponding progress of the first preview image in the video.
Therefore, the video progress adjusting method provided by the embodiment of the application can respond to the requirement of a user for multiple progress adjustments, and can realize fine adjustment on the video progress in a multi-preview mode in the process of each progress adjustment, so that the user can quickly position the progress interval where the expected video content is located, and accurate control on the video progress is finished.
Based on this, an embodiment of the present application provides a video progress adjustment method, referring to a method flowchart shown in fig. 10, where the method includes the following steps:
In the embodiment of the application, a user can determine whether the expected video content exists in the multi-frame preview image by checking the multi-frame preview image, and if the expected video content does not exist in the multi-frame preview image, the user needs to adjust the progress of the video again. If the electronic equipment monitors that the input operation of the user determines two frames of third preview images from the multi-frame preview images, determining a starting progress and a stopping progress based on respective corresponding progresses of the two frames of third preview images. Based on this, the user does not need to start from the current play progress every time the preview is made, and can preview again from an arbitrary progress section of the preview image.
When determining the two frames of the third preview image, the input operation monitored by the electronic device may be a single-click operation for the two frames of the preview images, or may also be a voice operation such as "previewing the 3 rd to 5 th frame preview images", which is not limited in this embodiment of the present application.
In addition, for the electronic device with the touch screen, the two frames of the third preview images can be determined by monitoring the sliding operation of the user on the touch screen. Specifically, the position areas of each preview image on the display interface are different, and a corresponding second sliding track is obtained in the process of receiving a second sliding operation; the preview image in which the position area includes the start position of the slide trajectory and the preview image in which the position area includes the end position of the slide trajectory are determined as two frames of the third preview image.
Continuing with the scenario diagram of the sliding operation shown in FIG. 6. The electronic device can draw a corresponding sliding track a by monitoring the sliding operation of the user, and can determine the starting position and the end position of the sliding track a by identifying the sliding direction.
Further, in this embodiment of the application, when the preview image is displayed, a corresponding position area can be allocated on the display interface for each preview image, where the position area at least includes a display area of the preview image on the display interface, specifically, a horizontal distance can be obtained by mapping the display area of the preview image on the display interface to a horizontal axis direction, and the horizontal distance and a maximum longitudinal distance of the display interface construct a rectangular bounding box of the preview image, where an area of the rectangular bounding box located on the display interface is the position area corresponding to the preview image.
And step 605, controlling the video to jump from the current playing progress to the corresponding progress of the first preview image in the video.
Therefore, the video progress adjusting method provided by the embodiment of the application can respond to the requirement of a user for multiple progress adjustments, and can realize fine adjustment of the video progress in a multi-preview mode in the process of each progress adjustment, so that the user can quickly locate the progress interval where the expected video content is located, and accurate control of the video progress is finished.
For the convenience of understanding of the present application, the present application is explained by way of the following scenario examples:
see the scene diagram shown in fig. 11. The user is watching the animal video, and the video progress can be adjusted through sliding left and right when watching the video. The current playing progress of the video is A, the user slides for the first time, the electronic equipment records the sliding direction and draws a sliding track b, the termination progress of the progress adjustment is determined based on the progress indicated by the terminal position of the sliding track b, and two frames of images are obtained from each scene in three scenes of standing, lying and jumping as a preview image of the preview by identifying the scene similarity degree of the multi-frame images between the current playing progress and the termination progress.
Further, the user slides for the second time, the electronic device records the sliding direction again and draws the sliding track c, the starting position of the sliding track c and the position area (the area where the dotted line frame is located in the figure) of each preview image on the display interface are respectively matched, the end position of the sliding track c and the position area of each preview image on the display interface are respectively matched, two frames of images of which the position areas comprise the starting position and the end position of the sliding track c are determined, the progress corresponding to one frame of image with earlier playing time in the two frames of images is used as the starting progress of the progress adjustment, and the progress corresponding to one frame of image with later playing time is used as the ending progress.
Moreover, because the multi-frame images in the progress interval (formed by the initial progress and the final progress) of the progress adjustment all belong to one scene, namely a 'jump' scene, the corresponding sampling time interval can be determined according to the duration of the progress interval, and the multi-frame images in the progress interval in the video are sampled according to the time interval to obtain the four-frame preview images for the preview.
Finally, the electronic equipment detects that the user executes double-click operation on the third frame preview image previewed this time, so that the progress B corresponding to the third frame preview image is determined as the expected progress of the user, and the video is controlled to jump from the current playing progress A to the progress B.
Corresponding to the video progress adjusting method, the present application also discloses a video progress adjusting device, as shown in fig. 12, the video progress adjusting device includes:
a preview module 10, configured to obtain a start progress and an end progress of a preview; acquiring a plurality of frames of preview images from a plurality of frames of images between the starting progress and the ending progress contained in the video, and displaying the plurality of frames of preview images;
the playing module 20 is configured to determine a first preview image of one frame meeting a first condition from the displayed multiple frames of preview images, where the first condition is used to trigger a progress jump operation; and controlling the video to jump from the current playing progress to the corresponding progress of the first preview image in the video.
In another embodiment of the video progress adjustment apparatus disclosed in the present application, the preview module 10 obtains a start progress and an end progress of the preview, including:
in the process of receiving the first sliding operation, obtaining a corresponding first sliding track; determining the current playing progress as a starting progress, and determining the progress indicated by the end point position of the first sliding track as a terminating progress;
correspondingly, displaying the multi-frame preview image comprises the following steps:
and displaying the multi-frame preview images in the position area of the display interface where the first sliding track is located.
In another embodiment of the video progress adjustment apparatus disclosed in the present application, after the preview module 10 displays the plurality of preview images, the method further includes:
determining a second preview image of one frame meeting a second condition from the displayed multi-frame preview images, wherein the second condition is used for triggering image preview operation; determining the current playing progress as an initial progress, and determining the corresponding progress of the second preview image in the video as a termination progress; returning to execute the step of obtaining multi-frame preview images from the multi-frame images between the starting progress and the ending progress contained in the video;
alternatively, the first and second electrodes may be,
determining two frames of third preview images from the displayed multiple frames of preview images; determining the progress corresponding to the third preview image with earlier playing time in the two frames of third preview images in the video as the starting progress, and determining the progress corresponding to the third preview image with later playing time in the video as the ending progress; and returning to execute the step of obtaining the multi-frame preview image from the multi-frame image between the starting progress and the ending progress contained in the video.
In another embodiment of the video progress adjusting apparatus disclosed in the present application, each preview image is located in a different position area of the display interface, and the preview module 10 determines two third preview images from the displayed multiple frames of preview images, including:
in the process of receiving the second sliding operation, obtaining a corresponding second sliding track; the preview image in which the position area includes the start position of the second slide trajectory and the preview image in which the position area includes the end position of the second slide trajectory are determined as two frames of the third preview image.
In another embodiment of the video progress adjusting apparatus disclosed in the present application, the preview module 10 obtains a multi-frame preview image from a multi-frame image included in the video between the starting progress and the ending progress, including:
and obtaining the sampling time interval, and sampling the multi-frame images according to the time interval to obtain the multi-frame preview images.
In another embodiment of the video progress adjustment apparatus disclosed in the present application, the preview module 10 obtains a sampled time interval, including:
based on a progress interval formed by the starting progress and the ending progress, a time interval is determined, and the time interval is proportional to the duration of the progress interval.
In another embodiment of the video progress adjusting apparatus disclosed in the present application, the preview module 10 obtains a multi-frame preview image from a multi-frame image included in the video between the starting progress and the ending progress, including:
dividing a multi-frame image into a plurality of image sets, wherein the similarity degree of two adjacent frames of images in playing time in each image set is greater than or equal to a preset threshold value, and the similarity degree of two adjacent frames of images in playing time in the two image sets is less than the preset threshold value; at least one preview image is obtained from each image collection.
In another embodiment of the video progress adjustment apparatus disclosed in the present application, the preview module 10 obtains at least one preview image from each image set, and includes:
and obtaining a frame of image with the maximum bullet screen quantity from each image set as a preview image of the image.
According to the video progress adjusting device provided by the embodiment of the application, a user can view multi-frame preview images by performing progress adjustment once, and each preview image represents the video content of the corresponding progress, so that the user can accurately control the progress adjusting degree, fine adjustment of the video progress is realized, and the user experience is improved.
The video progress adjusting method, the video progress adjusting device and the electronic device provided by the application are described in detail above, a specific example is applied in the description to explain the principle and the implementation of the application, and the description of the above embodiment is only used to help understand the method and the core idea of the application; meanwhile, for a person skilled in the art, according to the idea of the present application, the specific implementation manner and the application scope may be changed, and in summary, the content of the present specification should not be construed as a limitation to the present application.
It should be noted that, in the present specification, the embodiments are all described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments may be referred to each other. The device disclosed in the embodiment corresponds to the method disclosed in the embodiment, so that the description is simple, and the relevant points can be referred to the description of the method part.
It is further noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include or include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising a … …" does not exclude the presence of another identical element in a process, method, article, or apparatus that comprises the element.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the application. Thus, the present application is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (8)
1. A video progress adjustment method comprises the following steps:
in the process of receiving the first sliding operation, obtaining a corresponding first sliding track;
determining the current playing progress as a starting progress, and determining the progress indicated by the end point position of the first sliding track as a terminating progress;
dividing the multi-frame images into a plurality of image sets, wherein the similarity degree of the scene aspects of the two adjacent frames of images in playing time in each image set is greater than or equal to a scene similarity threshold value, and the similarity degree of the scene aspects of the two adjacent frames of images in playing time in the two image sets is less than the scene similarity threshold value; and/or the similarity degree of the conversation topic aspect of the two frames of images with adjacent playing time in each image set is greater than or equal to the conversation topic similarity threshold value, and the similarity degree of the conversation topic aspect of the two frames of images with adjacent playing time in the two image sets is less than the conversation topic similarity threshold value; the similarity degree of the scene aspect is determined by generating a description text of each frame of image in a plurality of frames of images through an image description algorithm and calculating the semantic similarity of the description text; the similarity degree of the conversation theme is determined by extracting subtitles of each frame of image in a plurality of frames of images in a character recognition or voice recognition mode and calculating the semantic similarity of the subtitles;
obtaining at least one frame of preview image from each image set, obtaining a plurality of frames of preview images, and displaying the plurality of frames of preview images, wherein the position areas of the preview images on the display interface are different;
determining a frame of first preview image meeting a first condition from the displayed multiple frames of preview images, wherein the first condition is used for triggering progress jump operation;
controlling the video to jump from the current playing progress to the corresponding progress of the first preview image in the video;
after the displaying the plurality of frames of preview images, the method further comprises:
in the process of receiving the second sliding operation, obtaining a corresponding second sliding track;
determining a preview image of which the position area contains the starting point position of the second sliding track and a preview image of which the position area contains the ending point position of the second sliding track as the two frames of third preview images;
determining the corresponding progress of a third preview image with earlier playing time in the two frames of third preview images in the video as a starting progress, and determining the corresponding progress of a third preview image with later playing time in the video as a terminating progress; and returning to execute the step of obtaining multi-frame preview images from the multi-frame images contained in the video between the starting progress and the ending progress.
2. The method of claim 1, wherein the first and second light sources are selected from the group consisting of,
the displaying the plurality of frames of preview images includes:
and displaying the plurality of frames of preview images in a position area of a display interface where the first sliding track is located.
3. The method of claim 1, further comprising, after said displaying the plurality of frames of preview images:
determining a second preview image of one frame meeting a second condition from the displayed plurality of frames of preview images, wherein the second condition is used for triggering image preview operation; determining the current playing progress as a starting progress, and determining the corresponding progress of the second preview image in the video as a terminating progress; and returning to execute the step of obtaining multi-frame preview images from the multi-frame images contained in the video between the starting progress and the ending progress.
4. The method of claim 1, further comprising:
and obtaining a sampling time interval, and sampling the multi-frame images according to the time interval to obtain the multi-frame preview images.
5. The method of claim 4, the obtaining a time interval of samples, comprising:
determining the time interval based on a progress interval formed by the starting progress and the ending progress, wherein the time interval is proportional to the duration of the progress interval.
6. The method of claim 1, the obtaining at least one preview image from each image collection comprising:
and obtaining a frame of image with the maximum bullet screen quantity from each image set as a preview image of the image.
7. A video progress adjustment apparatus comprising:
the preview module is used for obtaining a corresponding first sliding track in the process of receiving the first sliding operation; determining the current playing progress as a starting progress, and determining the progress indicated by the end point position of the first sliding track as a terminating progress; dividing the multi-frame images into a plurality of image sets, wherein the similarity degree of the scene aspects of the two adjacent frames of images in playing time in each image set is greater than or equal to a scene similarity threshold value, and the similarity degree of the scene aspects of the two adjacent frames of images in playing time in the two image sets is less than the scene similarity threshold value; and/or the similarity degree of the conversation topic aspect of the two frames of images with adjacent playing time in each image set is greater than or equal to the conversation topic similarity threshold value, and the similarity degree of the conversation topic aspect of the two frames of images with adjacent playing time in the two image sets is less than the conversation topic similarity threshold value; the similarity degree of the scene aspect is determined by generating a description text of each frame of image in a plurality of frames of images through an image description algorithm and calculating the semantic similarity of the description text; the similarity degree of the conversation theme is determined by extracting subtitles of each frame of image in a plurality of frames of images in a character recognition or voice recognition mode and calculating the semantic similarity of the subtitles; obtaining at least one frame of preview image from each image set, obtaining a plurality of frames of preview images, and displaying the plurality of frames of preview images, wherein the position areas of the preview images on the display interface are different;
the playing module is used for determining a frame of first preview image meeting a first condition from the displayed multiple frames of preview images, wherein the first condition is used for triggering progress jump operation; controlling the video to jump from the current playing progress to the corresponding progress of the first preview image in the video;
after the displaying the plurality of frames of preview images, the method further comprises:
in the process of receiving the second sliding operation, obtaining a corresponding second sliding track;
determining a preview image of which the position area contains the starting point position of the second sliding track and a preview image of which the position area contains the end point position of the second sliding track as the two frames of third preview images;
determining the corresponding progress of a third preview image with earlier playing time in the two frames of third preview images in the video as a starting progress, and determining the corresponding progress of a third preview image with later playing time in the video as a terminating progress; and returning to execute the step of obtaining multi-frame preview images from the multi-frame images contained in the video between the starting progress and the ending progress.
8. An electronic device, comprising:
the memory is used for storing an application program and data generated by the running of the application program;
a processor for executing the application to perform the functions of: in the process of receiving the first sliding operation, obtaining a corresponding first sliding track; determining the current playing progress as a starting progress, and determining the progress indicated by the end point position of the first sliding track as a terminating progress; dividing the multi-frame images into a plurality of image sets, wherein the similarity degree of the scene aspects of the two adjacent frames of images in playing time in each image set is greater than or equal to a scene similarity threshold value, and the similarity degree of the scene aspects of the two adjacent frames of images in playing time in the two image sets is less than the scene similarity threshold value; and/or the similarity degree of the conversation topic aspect of the two frames of images with adjacent playing time in each image set is greater than or equal to the conversation topic similarity threshold value, and the similarity degree of the conversation topic aspect of the two frames of images with adjacent playing time in the two image sets is less than the conversation topic similarity threshold value; the similarity degree of the scene aspect is determined by generating a description text of each frame of image in a plurality of frames of images through an image description algorithm and calculating the semantic similarity of the description text; the similarity degree of the conversation theme is determined by extracting subtitles of each frame of image in a plurality of frames of images in a character recognition or voice recognition mode and calculating the semantic similarity of the subtitles; obtaining at least one frame of preview image from each image set to obtain multiple frames of preview images, and displaying the multiple frames of preview images, wherein the position areas of the preview images on the display interface are different; determining a frame of first preview image meeting a first condition from the displayed plurality of frames of preview images, wherein the first condition is used for triggering progress jump operation; controlling the video to jump from the current playing progress to the corresponding progress of the first preview image in the video;
after the displaying the plurality of frames of preview images, the method further comprises:
in the process of receiving the second sliding operation, obtaining a corresponding second sliding track;
determining a preview image of which the position area contains the starting point position of the second sliding track and a preview image of which the position area contains the end point position of the second sliding track as the two frames of third preview images;
determining the corresponding progress of a third preview image with earlier playing time in the two frames of third preview images in the video as a starting progress, and determining the corresponding progress of a third preview image with later playing time in the video as a terminating progress; and returning to execute the step of obtaining multi-frame preview images from the multi-frame images contained in the video and positioned between the starting progress and the ending progress.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010789499.4A CN111818393B (en) | 2020-08-07 | 2020-08-07 | Video progress adjusting method and device and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010789499.4A CN111818393B (en) | 2020-08-07 | 2020-08-07 | Video progress adjusting method and device and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111818393A CN111818393A (en) | 2020-10-23 |
| CN111818393B true CN111818393B (en) | 2022-11-18 |
Family
ID=72863795
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010789499.4A Active CN111818393B (en) | 2020-08-07 | 2020-08-07 | Video progress adjusting method and device and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111818393B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112468869B (en) * | 2020-12-15 | 2022-12-06 | 北京字节跳动网络技术有限公司 | Multimedia file playing control method, device, equipment and medium |
| CN112437353B (en) * | 2020-12-15 | 2023-05-02 | 维沃移动通信有限公司 | Video processing method, video processing device, electronic apparatus, and readable storage medium |
| US11630958B2 (en) | 2021-06-02 | 2023-04-18 | Microsoft Technology Licensing, Llc | Determining topic labels for communication transcripts based on a trained generative summarization model |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4701958B2 (en) * | 2005-09-26 | 2011-06-15 | ソニー株式会社 | Image processing apparatus, image processing method, and program thereof |
| KR101531911B1 (en) * | 2008-09-30 | 2015-06-29 | 엘지전자 주식회사 | Opraing method of broadcasting receiver storing broadcasting program and broadcasting receiver enabling of the method |
| CN105516818B (en) * | 2015-12-23 | 2019-01-01 | 深圳Tcl数字技术有限公司 | The method for previewing and device of video playing progress |
-
2020
- 2020-08-07 CN CN202010789499.4A patent/CN111818393B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN111818393A (en) | 2020-10-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111818393B (en) | Video progress adjusting method and device and electronic equipment | |
| CN109803180B (en) | Video preview generation method and device, computer equipment and storage medium | |
| CN106156066B (en) | Page switching method, device and client | |
| EP3442238A1 (en) | Video frame capturing method and device | |
| WO2013018325A1 (en) | Information processing apparatus, information processing method, and computer program product | |
| US11924485B2 (en) | Method and system of displaying a video | |
| CN111225236B (en) | Method and device for generating video cover, electronic equipment and computer-readable storage medium | |
| JP2010152777A (en) | Content listing display device | |
| CN110475140B (en) | Bullet screen data processing method and device, computer readable storage medium and computer equipment | |
| US9372601B2 (en) | Information processing apparatus, information processing method, and program | |
| US8643672B2 (en) | Instant message analytics of historical conversations in relation to present communication | |
| CN112667118A (en) | Method, apparatus and computer readable medium for displaying historical chat messages | |
| CN111698565A (en) | Video playing method and device and electronic equipment | |
| CN113918522A (en) | File generation method and device and electronic equipment | |
| CN105933787A (en) | Video comment and processing method and device thereof, and server | |
| US20170161871A1 (en) | Method and electronic device for previewing picture on intelligent terminal | |
| CN109117053B (en) | Dynamic display method, device and equipment for interface content | |
| CN113806570A (en) | Image generation method and generation device, electronic device and storage medium | |
| CN113596555A (en) | Video playing method and device and electronic equipment | |
| Hürst et al. | HiStory: a hierarchical storyboard interface design for video browsing on mobile devices | |
| JP3989530B1 (en) | Recording device and program for the recording device | |
| CN110019862B (en) | Courseware recommendation method, device, equipment and storage medium | |
| CN112905921A (en) | Page content display method and device | |
| CN111641868A (en) | Preview video generation method and device and electronic equipment | |
| CN111954076A (en) | Resource display method and device and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |