CN116916106A

CN116916106A - Preview display method and device, electronic equipment and storage medium

Info

Publication number: CN116916106A
Application number: CN202310900503.3A
Authority: CN
Inventors: 邵峰
Original assignee: Beijing QIYI Century Science and Technology Co Ltd
Current assignee: Beijing QIYI Century Science and Technology Co Ltd
Priority date: 2023-07-21
Filing date: 2023-07-21
Publication date: 2023-10-20

Abstract

The embodiment of the invention provides a preview display method, a preview display device, electronic equipment and a storage medium, and relates to the technical field of image processing, wherein the method comprises the following steps: selecting at least one target time point from all target time points reached when the target video is fast-forwarded and/or fast-rewound according to the current playing time point; acquiring and preloading preview images corresponding to the at least one target time point respectively; determining a play time point reached by the fast-forward or fast-backward operation as a target play time point in response to the fast-forward or fast-backward operation with respect to the target video; determining a target preview image matched with the target playing time point from the preloaded preview images; and displaying the target preview. By the aid of the scheme, real-time display of the preview image can be achieved.

Description

Preview display method and device, electronic equipment and storage medium

Technical Field

The present invention relates to the field of image processing technologies, and in particular, to a preview display method, a preview display device, an electronic device, and a storage medium.

Background

When a user watches video on an electronic device such as a television, a mobile phone, a computer, etc., fast forward or fast backward of the video is a common operation, for example: the user may play video from content of interest, skip content that is not of interest, or repeat playing a piece of content of interest or unintelligible content, etc. When a user performs a fast-forward or fast-backward operation on a video, in order to facilitate the user to better understand the video content at the time point after fast-forward or fast-backward, a preview of a target video frame is typically displayed, where the target video frame is a video frame determined based on the time point after fast-forward or fast-backward.

In the related art, when a user performs a fast forward or fast backward operation on a video, a preview image may be loaded in real time.

When a user performs fast forward or fast backward operation on a video, if a mode of loading a preview image in real time in the related technology is adopted, the preview image may not be loaded so that the preview image cannot be displayed in time.

Disclosure of Invention

The embodiment of the invention aims to provide a preview display method, a preview display device, electronic equipment and a storage medium, so as to realize real-time display of a preview. The specific technical scheme is as follows:

in a first aspect of the present invention, there is provided a preview display method, including:

selecting at least one target time point from all target time points reached when the target video is fast-forwarded and/or fast-rewound according to the current playing time point;

acquiring and preloading preview images corresponding to the at least one target time point respectively; the preview corresponding to any target time point is a preview of a video frame played from the target video to the target time point;

determining a play time point reached by the fast-forward or fast-backward operation as a target play time point in response to the fast-forward or fast-backward operation with respect to the target video;

Determining a target preview image matched with the target playing time point from the preloaded preview images;

and displaying the target preview.

Optionally, the at least one target time point is a continuous time point among the target time points.

Optionally, the at least one target time point includes a target time point nearest to the current playing time point.

Optionally, the time difference between adjacent time points in the target time points is: a predetermined time step;

the target playing time point is a time point in the at least one target time point.

Optionally, the determining, from the preloaded preview images, a target preview image that matches the target playing time point includes:

and determining the preview image which is the same as the target playing time point from the preloaded preview images as a target preview image.

Optionally, the obtaining manner of the preview image corresponding to each of the at least one target time point includes:

acquiring initial preview images to be utilized in each initial preview image; each initial preview image is an image obtained by splicing preview images corresponding to at least two target time points in the target time points, and the initial preview image to be utilized comprises the preview images corresponding to the at least one target time point;

And extracting the preview images corresponding to the at least one target time point from the initial preview images to be utilized.

the obtaining the initial preview image to be utilized in each initial preview image comprises the following steps:

acquiring target information fed back by a server; wherein the target information includes: the acquisition address of each initial preview image, the preset time step and the target number of the preview images corresponding to partial target time points in each target time point contained in any initial preview image;

calculating index information of the preview images corresponding to the at least one target time point for each initial preview image based on the preset time step and the target number;

and acquiring the initial preview images to be utilized according to the index information and the acquisition addresses of the initial preview images.

Optionally, the target information further includes: target size information of the preview images corresponding to the at least one target time point respectively;

the extracting, from the initial preview image to be utilized, a preview image corresponding to each of the at least one target time point includes:

And cutting the initial preview image to be utilized based on the target size information, and extracting to obtain a preview image corresponding to each of the at least one target time point.

In a second aspect of the present invention, there is provided a preview display apparatus, the apparatus comprising:

the selecting module is used for selecting at least one target time point from all target time points reached when the target video is fast-forwarded and/or fast-rewound according to the current playing time point;

the preloading module is used for acquiring and preloading the preview images corresponding to the at least one target time point respectively; the preview corresponding to any target time point is a preview of a video frame played from the target video to the target time point;

a first determining module, configured to determine, as a target play time point, a play time point reached by a fast-forward or fast-backward operation in response to the fast-forward or fast-backward operation with respect to the target video;

the second determining module is used for determining a target preview image matched with the target playing time point from the preloaded preview images;

and the display module is used for displaying the target preview image.

Optionally, the second determining module is specifically configured to:

In a third aspect of the present invention, there is provided an electronic device including a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory perform communication with each other through the communication bus;

a memory for storing a computer program;

and the processor is used for realizing any one of the preview display method steps when executing the program stored in the memory.

In a fourth aspect of the present invention, there is provided a computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements any of the preview display method steps.

In yet another aspect of the present invention, there is also provided a computer program product containing instructions which, when run on a computer, cause the computer to perform any of the preview display methods described above.

According to the preview display method provided by the embodiment of the invention, each target time point reached when fast forward and/or fast backward operations are performed on the target video is estimated, and at least one target time point can be selected from the target time points based on the current playing time point; different from the mode of loading the preview images in real time in the related art, in the embodiment of the invention, the preview images corresponding to at least one target time point can be acquired and preloaded; at this time, if a fast forward or fast backward operation with respect to a target video is detected, the present invention may respond to the operation and determine a target play time point reached by the fast forward or fast backward operation, and at this time, a target preview image matching the target play time point may be determined from the preloaded preview images and displayed. Therefore, according to the embodiment of the invention, each target time point reached by fast forward and/or fast backward operation of the target video can be estimated, and the target preview images matched with the target playing time points can be displayed in real time when fast forward or fast backward is performed by preloading the preview images corresponding to at least one target time point respectively for the current playing time point. Therefore, the real-time display of the preview image can be realized through the scheme.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below.

FIG. 1 is an interface diagram of a real-time loading preview provided by the related art;

FIG. 2 is an interface diagram of a real-time loading preview after a fast forward or fast reverse operation provided by the related art;

FIG. 3 is a schematic flow chart of a preview display method according to an embodiment of the present invention;

FIG. 4 is a schematic diagram of another flow chart of a preview display method according to an embodiment of the present invention;

fig. 5 is a schematic structural diagram of a preview display device according to an embodiment of the present invention;

fig. 6 is a block diagram of an electronic device according to an embodiment of the present invention.

Detailed Description

The technical solutions in the embodiments of the present invention will be described below with reference to the accompanying drawings in the embodiments of the present invention.

Fast forward or fast reverse is a common operation when a user views a video by using an electronic device, and in order to facilitate the user to fast locate a desired position during fast forward or fast reverse and better understand the video content at the time point of fast forward or fast reverse, a preview of a target video frame is typically displayed, where the target video frame is a video frame determined based on the time point of fast forward or fast reverse.

The time point of the fast forward or fast backward operation of the user is random, and when the preview image is loaded, the preview image near the time point after the fast forward or fast backward operation is loaded in real time after the fast forward or fast backward operation of the user is finished can be waited for.

As shown in fig. 1, a video may have a duration of 00:45:34, i.e. 45 minutes 34 seconds, the current play time point is 00:08:16, i.e., 8 th minute and 16 second, when displaying the preview image, the preview images of a plurality of time points adjacent to the time point are normally loaded in real time, the preview images 1 to 6 are displayed, and the preview image of the time point closest to the current time point, i.e., the preview image 2, is displayed. Of course, 00:08:16 may also be the play time point after the fast forward or fast backward operation, at this time, the time point of the video frame in the preview fig. 2 in the video may not be 00:08:16, i.e. the point in time after the fast forward or fast reverse operation, may not be the same as the point in time of the displayed preview.

Moreover, the user can perform fast forward or fast backward operation on the video, and after the operation is finished, the fast forward playing time point 00 is as follows: 22:45, as shown in fig. 2, the preview cannot be loaded, and at this time, the preview at the time point after the fast forward or fast backward operation cannot be displayed. Fig. 1 and 2 are interfaces for loading the preview in real time, and are not interfaces for finally displaying the preview.

Based on the above, the embodiment of the invention provides a preview display method, a preview display device, electronic equipment and a storage medium, so as to realize real-time display of a preview.

The following first describes a preview display method provided by an embodiment of the present invention.

The preview display method provided by the embodiment of the invention can be applied to electronic equipment, wherein the electronic equipment can be terminal equipment, and the terminal equipment can be a television, a mobile phone, a computer and the like. The preview display method provided by the embodiment of the invention can be applied to any scene with preview display requirements, for example: in the video playing process, after the fast forward or fast backward operation is carried out on the video, the scene of the preview image of the time point after the fast forward or fast backward operation is displayed.

In addition, the execution subject of the preview display method provided by the embodiment of the present invention may be a preview display device. The preview display device may be, for example, functional software running on the terminal device, for example: the function software is used for displaying the preview image and can also have a video playing function; in addition, the preview display device may be a plug-in the existing client, for example: the plug-in the client for playing video, at this time, the preview display device may display a preview of the video played in the client.

The preview display method provided by the embodiment of the invention can comprise the following steps:

and displaying the target preview.

An exemplary description of a preview display method according to an embodiment of the present invention is provided below with reference to the accompanying drawings.

As shown in fig. 3, a preview display method provided by an embodiment of the present invention may include the following steps:

s301: selecting at least one target time point from all target time points reached when the target video is fast-forwarded and/or fast-rewound according to the current playing time point;

in the invention, each target time point reached when fast forward and/or fast backward operations are performed on the target video is estimated, and the target playing time point possibly reached when fast forward or fast backward operations are performed on the target video can be matched with one target time point in each target time point. Based on the current playing time point, at least one target time point can be selected from all target time points so as to preload the preview images corresponding to the at least one target time point; the triggering condition for selecting at least one target time point based on the current playing time point may include: the present invention is not limited in this regard, either during the playing of the target video, when the target video starts to play, or when the target video pauses, etc. At least one selected target time point, namely, a time point which can be reached after fast forward or fast backward operation is performed on the target video according to the current playing time point.

It should be noted that, for any target video, each target time point reached when the video is fast-forwarded and/or fast-rewound may be estimated, and the time intervals between two adjacent target time points in each target time point may be the same or different, for example: for a target video of one minute, each estimated target time point may be a time point of 10s, 20s, 30s, 40s, 50s, 60s, where the time interval between two adjacent target time points in each time point is the same; of course, each estimated target time point may be a time point of 5s, 10s, 20s, 30s, 35s, 40s, 50s, 60s, etc., and the time interval between two adjacent time points in each target time point is not limited in the present invention, and may be flexibly adjusted according to the actual requirement, the video length, the time point reached by the historical fast forward and fast backward operation, etc.

That is, the selection manner of the at least one target time may be: determining a target time point closest to the current playing time point from the target time points; and selecting at least one continuous target time point from the target time points based on the determined target time points to obtain at least one target time point.

At least one target time point includes a target time point closest to the current playing time point, and the at least one target time point belongs to a continuous time point in the target time points, for example: the target time points are 10s, 20s, 30s, 40s, 50s and 60s, and the target time points sequentially selected according to the time sequence are continuous target time points, for example: 10s, 20s, 30s; while the target time points randomly sampled from the target time points may be discrete time points, such as: 10s, 30s, 40s, 60s; in the invention, the target time point closest to the current playing time point can be selected sequentially according to the time sequence, and at least one target time point is obtained. For example, the current playing time point is a time point of 18s, at this time, the closest target time point of the current time point is a time point of 20s, and considering that the continuity of the time point can better predict and pre-determine the target playing time point reached by the fast-forward or fast-backward operation, at least one target time point is selected as follows: 10s, 20s, 30s, 40s, of course, 20s, 30s, 40s, etc. are also possible, and in the case that it is ensured that at least one target time point includes a target time point closest to the current time point, and at least one target time point belongs to a continuous time point in the respective target time points, the present invention does not limit the selected at least one time point.

In addition, it should be noted that the at least one selected target time point may be a predicted time point reached when the fast forward operation is performed on the target video, for example: the current playing time point may be 18s, and the at least one selected target time point may be 20s, 30s and 40s; alternatively, the at least one selected target time point may be a predicted time point reached when the target video is subjected to the fast-rewinding operation, for example: the current playing time point may be 18s, and the at least one selected target time point may be 10s; of course, since the fast forward or fast backward operation of the user cannot be accurately determined, the at least one selected target time point may also be a predicted time point reached when the fast forward or fast backward operation is performed on the target video, for example: the current playing time point is 18s, and the selected at least one target time point can be 10s, 20s, 30s and 40s.

Of course, in order to better predict the time point reached by the subsequent fast forward or fast backward operation, the at least one selected target time point may include a time point that may be reached after the fast forward operation is performed with respect to the current time point, and a time point that may be reached after the fast backward operation is performed with respect to the current time point.

S302: acquiring and preloading preview images corresponding to the at least one target time point respectively;

the preview corresponding to any target time point is a preview of a video frame played from the target video to the target time point;

the invention can pre-load the preview image, and can display the preview image of the time point after the fast forward or fast backward operation in real time after the fast forward or fast backward operation. The at least one selected target time point is: for the current playing time point, the time point which can be reached after the fast forward or fast backward operation is carried out on the target video; the time point reached after the fast forward or fast backward operation is performed on the target video still has certain uncertainty, so that the preview images corresponding to at least one target time point can be acquired and preloaded for at least one target time point, and one preview image can be selected from the preloaded preview images for display after the subsequent fast forward or fast backward operation is completed.

In addition, the manner of acquiring and preloading the preview images corresponding to the at least one target time point may be similar to the prior art, for example: obtaining at least one preview corresponding to each target time point from a server, and carrying out preloading locally on a client; or, obtaining the preview images corresponding to at least one target time point from the preview images locally stored by the client and preloading the preview images. That is, each target time point in each target time point may correspond to a preview image, and a preview image corresponding to each at least one target time point may be obtained from each target preview image for preloading; each target preview image can be stored in a server, and can be acquired by a mode of requesting the server; of course, it is reasonable that each target preview image may be stored in the client, or each target preview image may be acquired from the server in advance and stored.

It should be noted that, the preloading process of the preview image corresponding to each of the at least one target time point may be executed asynchronously with the playing of the target video, where the process of preloading the preview image is not felt by the user, and after the fast forward or fast backward operation, a preloaded preview image may be directly displayed in real time.

S303: determining a play time point reached by the fast-forward or fast-backward operation as a target play time point in response to the fast-forward or fast-backward operation with respect to the target video;

the user may issue a fast forward or a fast backward operation with respect to the target video, at which time the present invention may respond to the fast forward or fast backward operation with respect to the target video and determine a play time point reached by the fast forward or fast backward operation as a target play time point.

It should be noted that, the fast forward or fast backward operation on the target video may be: the user clicks one or more times the fast forward or fast reverse button, for example: clicking a fast forward button, clicking a fast reverse button twice, clicking a fast forward button five times, etc., as the present invention is not limited in this regard. If the electronic device is a television, the fast forward or fast backward button can be a fast forward or fast backward button on a remote controller or a fast forward or fast backward button on a television shell; if the electronic equipment is a computer, the fast forward or fast backward button can be a fast forward or fast backward button on a keyboard; if the electronic device is a mobile phone, the fast forward or fast backward button may be a fast forward or fast backward button on a screen.

The manner of determining the play time point reached by the fast forward or fast backward operation may be: determining a fast forward or fast reverse time indicated by the fast forward or fast reverse operation; and determining a playing time point reached by the fast-forward or fast-backward operation, namely a target playing time point, based on the current playing time point and the fast-forward or fast-backward time indicated by the fast-forward or fast-backward operation. For example: the fast forward or fast backward time indicated by the fast forward or fast backward operation is determined to be 20s, that is, the video is required to be fast forward or fast backward for 20s to be played or displayed, and the current playing time is 00:01:12, the play time point reached by the fast forward or fast reverse operation is 00:01:32.

s304: determining a target preview image matched with the target playing time point from the preloaded preview images;

the invention is preloaded with the preview images corresponding to at least one target time point, wherein the at least one target time point is a time point reached after fast forward and/or fast backward operation estimated for the current playing time point, and after the target playing time point is determined, the target preview image matched with the target playing time point can be determined from the preloaded preview images.

For example, from the preloaded preview images, a preview image closest to the target play time point may be determined as a target preview image; that is, the present invention can realize real-time display of the target preview at a time point after the fast forward or fast backward operation.

In one implementation, the time difference between adjacent time points in the target time points is: a predetermined time step;

In the invention, the time interval between two adjacent time points in each target time point can be the same, the time interval is a preset time step, the target playing time point is a time point in at least one target time point, at this time, the target playing time point after fast forward or fast backward operation is the same as the time point corresponding to one preview image in the preloaded preview image, and the time consistency between the preview image displayed in subsequent real time and the time point after fast forward or fast backward operation can be realized.

At least one target time point comprises a time point closest to the current playing time point, wherein the at least one target time point is a continuous time point in each target time point, and the time difference between adjacent time points in each target time point is as follows: a predetermined time step, for example: 10s; at this time, if the current playing time point is 18s, the preloaded preview images may be a, b, c, d, and the corresponding time points are 10s, 20s, 30s, and 40s, respectively. And the target play time point is a time point in at least one target time point, for example: the target play time point is the play time point of the 20 th s, and in this case, the preview b corresponding to the same time point as the 20 th s in the preloaded preview can be determined as the preview matching the target play time point.

In this case, the preview closest to the target play time point is not required to be determined as the preview matching the target play time point, and the time point corresponding to the preview matching the target play time point is the same as the target play time point, so that the consistency between the preview and the play time point can be realized.

S305: displaying the target preview image;

after determining the target preview image matched with the target playing time point, the target preview image can be displayed; for example, a target preview image may be displayed in an interface where a client plays a target video, where the target preview image may be displayed: the size of the displayed target preview image may be smaller than or equal to the size of the interface on which the target video is played, etc., which is not limited in the present invention.

It should be noted that, in the preview display method provided by the embodiment of the present invention, after the fast forward or fast backward operation of the target video is responded, the playing progress of the target video may be adjusted.

In addition, the preview display method provided by the embodiment of the present invention may also be applied to a scene where video playing starts, for example: the user starts playing the video scene from the historical playing progress.

At this time, the preview display method for the scene may include:

selecting at least one target time point from all target time points which are reached when the target video is fast-forward and/or fast-backward operated based on the historical playing time points of the target video; wherein, at least one target time point comprises the time point nearest to the historical playing time point, and at least one target time point belongs to the continuous time point in each target time point; the historical playing time point is the time point when the playing is finished when the target video is played last time;

and acquiring and preloading the preview images corresponding to the at least one target time point respectively.

At this time, when the target video is played from the historical playing time point, the preview image of at least one target time point corresponding to the historical playing time point is preloaded, and when the fast forward or fast backward operation is performed subsequently, the preview image of the time point after the fast forward or fast backward operation can be displayed in real time. In addition, the implementation manner of the preview display method in the scene of starting video playing is similar to that in the scene of performing fast forward or fast backward operation on video, and will not be described herein.

Optionally, in another embodiment of the present invention, the obtaining manner of the preview image corresponding to each of the at least one target time point includes steps A1-A2:

step A1: acquiring initial preview images to be utilized in each initial preview image;

each initial preview image is an image obtained by splicing preview images corresponding to at least two target time points in the target time points, and the initial preview image to be utilized comprises the preview images corresponding to the at least one target time point;

in the invention, the preview images corresponding to at least two target time points in each target time point are spliced to obtain each initial preview image, the initial preview image to be utilized in each initial preview image comprises the preview images corresponding to at least one target time point, when the preview images corresponding to at least one target time point are obtained, the initial preview image to be utilized can be obtained first, and then the preview images corresponding to at least one target time point can be extracted from the initial preview images.

Illustratively, the time difference between adjacent time points in the target time points is: a predetermined time step;

It may be appreciated that each initial preview may be stored in the server, or may be acquired in advance to the client, and the target information may be used to characterize the manner in which the initial preview is acquired, and the initial preview may be acquired later based on the target information. Therefore, when acquiring the preview image to be utilized, the target information may be acquired first, and the target information may be requested from the server in real time, or may be acquired from the server in advance; in the invention, the time difference of each target time point is a preset time step, the number of preview images corresponding to part of target time points in any initial preview image is a target number, and the index information of the preview image corresponding to at least one target time point for each initial preview image, namely any preview image in the preview images corresponding to at least one target time point, can be calculated according to the number of preview images corresponding to part of target time points in any initial preview image, and the index information is spliced to which initial preview image; and then, acquiring the initial preview to be utilized according to the index information and the acquisition addresses of the initial preview.

It should be noted that the number of targets corresponding to each initial preview may be the same or different, which is not limited in the present invention. For example, if the number of targets corresponding to each initial preview is the same, the number of targets may be 30, the predetermined time step may be 10s, and if each initial preview splices the previews corresponding to each target time point according to the time sequence of each target time point, and the total duration of a certain video is 45 minutes, the number of corresponding initial previews is 9; for the preview corresponding to the time point of 2368s, the index information of each corresponding initial preview is 8, that is, the preview corresponding to the time point of 2368s is spliced to the 8 th initial preview. At this time, the 8 th initial preview may be acquired as the initial preview to be utilized corresponding to the time point according to the index information and the acquisition address of each initial preview.

Step A2: extracting from the initial preview image to be utilized to obtain a preview image corresponding to each of the at least one target time point;

after the initial preview image to be utilized is obtained, the initial preview image to be utilized comprises a preview image corresponding to at least one target time point, and the preview image corresponding to each at least one target time point can be extracted from the initial preview image to be utilized.

The target information may further include target size information of a preview corresponding to each of the at least one target time point, for example: the size information, the position information, the coordinate axis, the direction information and the like can be based on the target size information, the initial preview image to be utilized can be cut, and the preview images corresponding to at least one target time point can be extracted.

It should be noted that, for different time points in at least one target time point, each target time point may correspond to an initial preview to be utilized, the initial preview to be utilized corresponding to each target time point may be the same or different, and the preview corresponding to the target time point may be extracted from the initial preview corresponding to each target time point in the same manner.

According to the preview display method provided by the embodiment of the invention, the preview images corresponding to each target time point are spliced to obtain each initial preview image, so that the storage quantity of the preview images can be reduced; in addition, in order to reduce the local pressure of the client, the preview images are usually stored in a server, and if the preview images corresponding to each target time point are acquired, each preview image usually needs to be sent once to acquire the preview images, and the preview images interact with the server for many times, so that network resources are wasted and the performance of the device is affected. By means of the initial preview, the number of images stored by the server can be reduced, and the interaction times of the client and the server are reduced.

The following describes a preview display method provided by the present invention in connection with another embodiment.

The main reason why the preview image cannot be loaded in advance at present is that the time point of the fast forward or fast backward operation of the user is random, and only after the fast forward or fast backward position is confirmed, the preview image of the corresponding time point can be loaded in real time.

The inventor researches that the fast forward or fast backward operation of the television end is different from that of the mobile phone computer end, the television uses a remote controller to perform fast forward or fast backward operation, the fast backward or fast forward operation generally corresponds to a left or right key on the remote controller, the remote controller operation is different from the operation of a finger on the mobile phone or the operation of a mouse on the computer, and the fast forward or fast backward position cannot be precisely selected during the fast forward or fast backward operation of the remote controller.

The remote controller cannot accurately fast forward or fast backward to a designated position, the app controls the fast forward by pressing the fast forward key for a few seconds, and based on the background, the idea of the invention mainly comprises the following points:

1. in the fast forward or fast backward operation on the television, each time the fast forward or fast backward position is a multiple of n seconds (n=10 is taken as an example in the invention), for example, the fast forward is started from 37 th second, the fast forward key is pressed to the position of 40 th second, the fast forward key is pressed to the position of 50 th second, the fast forward or fast backward position of the user can be predicted based on the fast forward or fast backward position, and the preview image of the predicted position is loaded in advance.

2. In order to ensure that the user can display the preview in real time by pressing the fast forward or fast backward key, the pre-loading of the preview is performed asynchronously in the background following the video playing, in the present invention, according to the current playing time point, each p preview sheets (p=5 is taken as an example herein) before and after loading, for example: the user plays 127 seconds, the preview images loaded in advance at this time correspond to 70 seconds, 80 seconds, 90 seconds, 100 seconds, 110 seconds, 120 seconds, 130 seconds, 140 seconds, 150 seconds, 160 seconds and 170 seconds (127 s is taken as the current position when 127 seconds adopt a calculation mode of the subsequent fast-forward or fast-backward position, the corresponding fast-forward or fast-backward frequency is 0, the calculated value is 120s, namely 127s is in the preset fast-forward and/or fast-backward position, the corresponding position is 120s, at this time, 120s and 5 preview images before and after the fast-forward or fast-backward key can be loaded in advance), and if the user presses the fast-forward or fast-backward key, the preview images are displayed in real time. The preview image is loaded in advance, and the position of the fast forward or fast backward of the user is adjusted in real time, for example, the user presses fast forward, the video jumps to 130 seconds, and the preview image of 80 seconds, 90 seconds, 100 seconds, 110 seconds, 120 seconds, 130 seconds, 140 seconds, 150 seconds, 160 seconds, 170 seconds and 180 seconds is loaded. And corresponding to the obtained and preloaded preview images corresponding to the at least one target time point respectively.

The player fast-forward or fast-backward is realized, and the position to which each fast-forward or fast-backward movement is moved is a multiple of n:

fast forward: sekposition=currentposition+sektimes n-currentPosition%n

Fast-backing: sekPosition=currentPosition- (sekTimes-1) n-currentPosition% n

The seekPosition is the position after fast forward or fast backward, the currentPosition is the current playing position, the seekTimes is the number of fast forward or fast backward times, the currentposition% n is the current playing position based on n remainder, and the% is the characterization remainder. For example: if the current playing position is 3s and the number of fast forward times is 1, the position seekposition=3+1×10-3%10=10 after fast forward, i.e. the position after fast forward is 10s.

3. Aiming at the problem that the time point of the preview image is not completely matched with the time point of fast forward or fast backward, the method combines the mechanism of fast forward to the multiple of n seconds, and the generated preview image is produced at intervals of n seconds, and the time point of the preview image is identical with the time point of fast forward or fast backward. And determining the preview image which is the same as the target playing time point from the preloaded preview images as a target preview image.

4. In order to save storage space and improve the performance of an app (Application program) request preview image, the invention combines a small preview image into a large image for storage, and the app requests the large image and then acquires the corresponding preview image. And extracting the preview images corresponding to the at least one target time point from the initial preview images to be utilized.

When the preview is generated, in order to save space and app memory of a server (such as a CDN server: content delivery network, content Delivery Network), the preview of the video is not generated every frame, but is generated at intervals of a certain time, and in the embodiment of the present invention, one preview is generated at intervals of n seconds. The time of a video is relatively long, such as: for 45 minutes of video, taking n=10 as an example, 270 Zhang Yulan pictures need to be generated, if each preview picture is stored as a single picture, the app needs to request 270 times when requesting, which wastes network resources and affects device performance. Based on this, in order to save storage space and reduce waste of network resources, in the present invention, m Zhang Yulan (m=30 is taken as an example in the present invention) is combined into one large graph according to time sequence, for 45 minutes of video, only 9 large graphs are needed, when app requests the address of preview graph from server, the server can return the following information (corresponding to the above target information):

the base address url (uniform resource locator, universal Resource Locator) of the consolidated large graph; according to the basic address and the indexes of the preview image and the large image, the corresponding large image can be obtained. (acquisition Address corresponding to each of the initial Preview images)

The size imageSize of each small preview; after the app obtains the large graph, cutting to obtain each preview graph according to the size; (target size information of the preview images corresponding to the at least one target time point, the size information of which can be set according to the size information of the preview images displayed in the history.)

Interval time (seconds) interval of the preview; i.e. n as described above. (corresponding to the predetermined time step described above)

The number mergeCount of preview images combined for each large image; that is, m (the number of objects of the preview images corresponding to some of the target time points included in any one of the initial preview images) is calculated by the app from m and n.

For example the following data:

the method for calculating the index of the large graph corresponding to the current playing time currentPosition of the video (unit second) comprises the following steps:

itemDuration＝interval*mergeCount

bigIndex＝

if(currentPosition％itemDuration＝＝0)currentPosition/itemDuration

else currentPosition/itemDuration+1

if the current playing time is a multiple of m×n, the index corresponding to the current playing time currentPosition is: currentPosition/(m×n); otherwise, the index corresponding to the current playing time currentPosition is: currentPosition/(m x n) +1. Wherein the calculated index is an integer.

Illustratively, the download address of the large graph may be:

http://www.example.com/xxx_bigIndex.jpg

if the current playing time of the video is 2368 seconds, the index of the corresponding large graph is 8.

As shown in fig. 4, the preview display method provided by the embodiment of the present invention may be implemented through interaction of the following modules: the device comprises a player, a downloading module, a local storage and a preview module.

Before playing the video, the player can asynchronously request the preview images from the downloading module, and the downloading module can circularly download all the preview images from the server and store the preview images in the local storage. The player can asynchronously request the downloading of the preview pictures to the downloading module, calculate the preview picture url corresponding to the current playing position based on the calculated indexes of the preview pictures and the large picture according to the current playing position, preferentially download the preview pictures of the current playing position, circularly download all the preview pictures, and can locally store the saved value of the downloaded preview pictures to save the memory space.

When the player starts to play, the preview image module can determine the current playing time point of the player, calculate the corresponding large image index according to the current playing time point, determine the file name of the stored large image according to the large image index, read the large image from the local storage, cut out the small image, and load the preview image in advance.

In addition, when the player is in fast forward or fast backward operation, the preview image of the time point of fast forward or fast backward can be displayed according to the preview image loaded in advance.

Specifically, when the player fast forwards and fast backwards, the player can transmit the fast forwards and fast backwards of the user to the preview module, and the preview module displays the preview to the player according to the time point of the fast forwards and fast backwards of the user; and after fast forward and fast backward, the playing position of the player is changed, the player can transmit the changed playing position to the preview image module, and the preview image module can read the large image from the local storage to cut out the small image according to the changed playing position, and load the preview image in advance according to the changed playing position. That is, in the present invention, when the play position is changed, the preloaded preview image is updated in real time.

Wherein the index of the preview in the large graph can be calculated according to the following method:

smallIndex＝(currentPosition％(interval*mergeCount))/interval

smallIndex, the index that characterizes the preview in the large graph.

Then, the preview image of the corresponding time point is cut through the bitmap file bitmap, and the cutting logic is as follows:

in the present invention, each preview in any large drawing is vertically arranged, for example: for the 1 st large image, 30 preview images are included, wherein the information of each preview image in the X-axis direction is the same, the information in the Y-axis direction is different, and the preview images can be sequentially 1-30 from top to bottom according to time sequence. In this case, when the preview of the play time point is cut by using the large map, the preview corresponding to the current play time point may be obtained by cutting from the large map according to parameters such as a bitmap corresponding to the large map, an X-axis direction start position, a preview height, and the preview index, a width of the preview, and a height of the preview. Of course, the preview images in any large image may be arranged laterally, which is not limited in the present invention.

According to the same method, obtaining p fast forward and backward preview images corresponding to the current time point, wherein the time point calculating method comprises the following steps:

forward[p]＝currentPosition-(currentPosition％10)+10*p

rewind[p]＝currentPosition-(currentPosition％10)-10*p

forward [ p ] is the point in time after fast forward, rewind [ p ] is the point in time after fast reverse.

At this time, a preview corresponding to the calculated point in time may be acquired and preloaded according to the point in time.

When the video is played, the current playing position of the video can be changed in real time, and in the invention, along with the change of the playing position, the preview image module can asynchronously load the preview image corresponding to the changed playing position in the background. Namely: the preview image module acquires the changed play position, reads the large image of the changed play position from the current storage, cuts out the small image, loads the preview image of the changed play position in advance, and can load p preview images before and after the changed play position in advance.

In addition, when the user clicks fast forward or fast backward, the preview image of the time point after fast forward or fast backward is displayed, and meanwhile, a new preview image is loaded in advance according to the fast forward or fast backward position of the user.

It should be emphasized that the preview display method provided by the embodiment of the present invention may be applied to electronic devices such as televisions, mobile phones, computers, etc., where for a computer, the fast forward or fast backward operation may be that a user clicks a fast forward or fast backward button on a keyboard, and for a mobile phone, the fast forward or fast backward operation may be that a user clicks a fast forward or fast backward button on a screen, and through the scheme of the present invention, the fast forward or fast backward button or button may fast forward a video to a play position that is multiple of n.

Therefore, according to the preview display method provided by the embodiment of the invention, according to the fact that the position after fast forwarding or fast rewinding is a multiple of n seconds, a plurality of preview images are set based on the position after fast forwarding or fast rewinding and are loaded in advance, when video fast forwarding or fast rewinding is performed, the preview images at the corresponding time points can be loaded in real time, the time of the loaded preview images is the same as the time point of fast forwarding or fast rewinding, the content contained at the time point after fast forwarding or fast rewinding can be accurately described by the displayed preview images, and user experience can be further improved.

In addition, aiming at the characteristics of a television end remote controller, the invention innovates that the time point after fast forward or fast backward is a multiple of n seconds, so that the time point of displacement during fast forward or fast backward can be prejudged, the preview image is loaded in advance, the generation time interval of the preview image is always consistent with the time step of fast forward or fast backward, and the displayed preview image is completely consistent with the time point; and in addition, a mode of combining a plurality of preview images into a large image saves the times of server storage and app request, and improves the equipment performance. Furthermore, when the user watches the video and performs fast forward or fast backward operation, the preview image can be accurately displayed in real time, and the user can conveniently position the content to be watched.

Based on the above method embodiment, the present invention further provides a preview display device, as shown in fig. 5, where the device includes:

the selecting module 510 is configured to select, based on a current playing time point, at least one target time point from target time points reached when the target video is fast-forwarded and/or fast-rewound in the estimated time points;

a preloading module 520, configured to acquire and preload a preview image corresponding to each of the at least one target time point; the preview corresponding to any target time point is a preview of a video frame played from the target video to the target time point;

a first determining module 530, configured to determine, as a target playing time point, a playing time point reached by the fast-forward or fast-backward operation in response to the fast-forward or fast-backward operation with respect to the target video;

a second determining module 540, configured to determine, from the preloaded preview images, a target preview image that matches the target playing time point;

and a display module 550, configured to display the target preview.

According to the preview display device provided by the embodiment of the invention, each target time point reached when fast forward and/or fast backward operations are performed on the target video is estimated, and at least one target time point can be selected from the target time points based on the current playing time point; different from the mode of loading the preview images in real time in the related art, in the embodiment of the invention, the preview images corresponding to at least one target time point can be acquired and preloaded; at this time, if a fast forward or fast backward operation with respect to a target video is detected, the present invention may respond to the operation and determine a target play time point reached by the fast forward or fast backward operation, and at this time, a target preview image matching the target play time point may be determined from the preloaded preview images and displayed. Therefore, according to the embodiment of the invention, each target time point reached by fast forward and/or fast backward operation of the target video can be estimated, and the target preview images matched with the target playing time points can be displayed in real time when fast forward or fast backward is performed by preloading the preview images corresponding to at least one target time point respectively for the current playing time point. Therefore, the real-time display of the preview image can be realized through the scheme.

Optionally, the second determining module is specifically configured to:

The embodiment of the invention also provides an electronic device, as shown in fig. 6, which comprises a processor 601, a communication interface 602, a memory 603 and a communication bus 604, wherein the processor 601, the communication interface 602 and the memory 603 complete communication with each other through the communication bus 604,

a memory 603 for storing a computer program;

the processor 601 is configured to implement any preview display method when executing a program stored in the memory 603.

The communication bus mentioned by the above terminal may be a peripheral component interconnect standard (Peripheral Component Interconnect, abbreviated as PCI) bus or an extended industry standard architecture (Extended Industry Standard Architecture, abbreviated as EISA) bus, etc. The communication bus may be classified as an address bus, a data bus, a control bus, or the like. For ease of illustration, the figures are shown with only one bold line, but not with only one bus or one type of bus.

The communication interface is used for communication between the terminal and other devices.

The memory may include random access memory (Random Access Memory, RAM) or non-volatile memory (non-volatile memory), such as at least one disk memory. Optionally, the memory may also be at least one memory device located remotely from the aforementioned processor.

The processor may be a general-purpose processor, including a central processing unit (Central Processing Unit, CPU for short), a network processor (Network Processor, NP for short), etc.; but also digital signal processors (Digital Signal Processor, DSP for short), application specific integrated circuits (Application Specific Integrated Circuit, ASIC for short), field-programmable gate arrays (Field-Programmable Gate Array, FPGA for short) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components.

In yet another embodiment of the present invention, there is also provided a computer readable storage medium having a computer program stored therein, which when executed by a processor, implements the preview display method according to any of the above embodiments.

In yet another embodiment of the present invention, a computer program product containing instructions that, when run on a computer, cause the computer to perform the preview display method of any of the above embodiments is also provided.

In the above embodiments, it may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, produces a flow or function in accordance with embodiments of the present invention, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable apparatus. The computer instructions may be stored in or transmitted from one computer-readable storage medium to another, for example, by wired (e.g., coaxial cable, optical fiber, digital Subscriber Line (DSL)), or wireless (e.g., infrared, wireless, microwave, etc.). The computer readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that contains an integration of one or more available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid State Disk (SSD)), etc.

It is noted that relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.

In this specification, each embodiment is described in a related manner, and identical and similar parts of each embodiment are all referred to each other, and each embodiment mainly describes differences from other embodiments. In particular, for the device embodiments, since they are substantially similar to the method embodiments, the description is relatively simple, and reference is made to the description of the method embodiments in part.

The foregoing description is only of the preferred embodiments of the present invention and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention are included in the protection scope of the present invention.

Claims

1. A preview display method, the method comprising:

and displaying the target preview.

2. The method of claim 1, wherein the at least one target point in time is a continuous point in time among the target points in time.

3. The method of claim 2, wherein the at least one target point in time comprises a target point in time that is closest to the current play point in time.

4. A method according to any one of claims 1-3, wherein the time difference between adjacent ones of the target time points is: a predetermined time step;

5. The method of claim 4, wherein determining a target preview image that matches the target play time point from the preloaded preview images comprises:

6. The method according to claim 1, wherein the obtaining manner of the preview image corresponding to each of the at least one target time point includes:

7. The method of claim 6, wherein the time difference between adjacent ones of the target time points is: a predetermined time step;

8. The method of claim 7, wherein the target information further comprises: target size information of the preview images corresponding to the at least one target time point respectively;

9. A preview display apparatus, the apparatus comprising:

And the display module is used for displaying the target preview image.

10. The electronic equipment is characterized by comprising a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory are communicated with each other through the communication bus;

a memory for storing a computer program;

a processor for carrying out the method steps of any one of claims 1-8 when executing a program stored on a memory.

11. A computer-readable storage medium, characterized in that the computer-readable storage medium has stored therein a computer program which, when executed by a processor, implements the method steps of any of claims 1-8.