CN111263170B

CN111263170B - Video playing method, device and equipment and readable storage medium

Info

Publication number: CN111263170B
Application number: CN202010052605.0A
Authority: CN
Inventors: 黄思军
Original assignee: Tencent Technology Shenzhen Co Ltd
Current assignee: Tencent Technology Shenzhen Co Ltd
Priority date: 2020-01-17
Filing date: 2020-01-17
Publication date: 2021-06-08
Anticipated expiration: 2040-01-17
Also published as: CN111263170A

Abstract

The embodiment of the application discloses a video playing method, a video playing device, video playing equipment and a readable storage medium; the method and the device for displaying the target video can display the video playing page, wherein the video playing page comprises a video picture of the target video, and the video picture comprises at least one object; when the attention duration of a user to the target object is not less than the preset duration, displaying video playing prompt information of the target object; and when a play confirmation instruction triggered based on the video play prompt information is detected, playing a target video clip containing a target object in the target video. According to the scheme, the video playing prompt information of the target object can be displayed when the attention time of the user to the target object is not less than the preset time, and when the playing confirmation instruction triggered based on the information is detected, the target video clip of the target object is directly played, so that the video playing efficiency is greatly improved.

Description

Video playing method, device and equipment and readable storage medium

Technical Field

The invention relates to the technical field of communication, in particular to a video playing method, a video playing device, video playing equipment and a readable storage medium.

Background

Currently, most video applications have a "watch only" function, that is, during playing video, a user can choose to watch only the play of his favorite actor and skip the play of a disliked actor during watching video (e.g., movies, tv shows) according to the individual likes and dislikes of the actor.

The current 'only see him' function requires a user to manually open a play menu in the video playing process, find and select a 'only see him' option in the play menu, and show head portraits of several actors in the video in the 'only see him' option, so that the user can select to watch video clips of the actors enjoyed by the user according to personal preferences.

In the research and practice process of the prior art, the inventor of the present invention finds that, in the prior art, a user needs to perform a series of operations during the video playing process to watch the video clip appearing in the target object, such an operation path is long and cumbersome, so that the efficiency of playing the video clip including the target object is greatly reduced.

Disclosure of Invention

The embodiment of the application provides a video playing method, a video playing device, video playing equipment and a readable storage medium, and the video playing efficiency can be improved.

The embodiment of the application provides a video playing method, which comprises the following steps:

displaying a video playing page, wherein the video playing page comprises a video picture of a target video, and the video picture comprises at least one object;

when the attention duration of a user to a target object is not less than the preset duration, displaying video playing prompt information of the target object;

and when a play confirmation instruction triggered based on the video play prompt information is detected, playing a target video clip containing the target object in the target video.

Correspondingly, an embodiment of the present application further provides a video playing apparatus, including:

the video playing system comprises a page display unit, a video playing unit and a video playing unit, wherein the page display unit is used for displaying a video playing page, the video playing page comprises a video picture of a target video, and the video picture comprises at least one object;

the information display unit is used for displaying video playing prompt information of the target object when the attention duration of a user to the target object is not less than the preset duration;

and the playing unit is used for playing a target video clip containing the target object in the target video when a playing confirmation instruction triggered based on the video playing prompt information is detected.

In some embodiments, the video playback page further includes a video playback control, and the information display unit is specifically configured to:

and when the triggering operation aiming at the video playing control is detected and the attention duration of the user to the target object is not less than the preset duration, displaying the video playing prompt information of the target object.

In some embodiments, the video playback apparatus further comprises: and the control display unit is used for displaying a progress indication control on the video playing page when a playing confirmation instruction triggered based on the video playing prompt information is detected, wherein the progress indication control comprises a segment identifier, and the segment identifier is used for indicating the playing time period of the target video segment.

In some embodiments, the video playing prompt information includes a play confirmation control, and the playing unit is specifically configured to:

and when the confirmation operation carried out on the confirmation playing control is detected, triggering a playing confirmation instruction, and playing a target video clip containing the target object in the target video.

In some embodiments, the video playback apparatus further includes an acquisition unit, and the acquisition unit includes:

the acquisition subunit is used for acquiring the attention point of the eyeball focus of the user on the current video picture;

the position acquisition subunit is used for acquiring the position of the attention point on the current video picture based on the duration of the attention point;

the identification subunit is used for carrying out object identification on the current video picture according to the position of the attention point on the current video picture;

and the duration acquisition subunit is used for acquiring the attention duration of the user to the target object according to the duration of the attention point when the target object is successfully identified.

In some embodiments, the duration obtaining subunit is specifically configured to:

updating the accumulated attention duration corresponding to the target object according to the duration of the attention point to obtain the updated accumulated attention duration;

and taking the updated accumulated attention duration as the attention duration of the user to the target object.

In some embodiments, the identifier subunit is specifically configured to:

generating a target identification area corresponding to the position according to the position of the attention point on the current video picture;

extracting the features of the image of the current video picture in the target identification area to obtain feature information;

and when the characteristic information is successfully matched with the characteristic information of the target object, determining that the target object is successfully identified.

In some embodiments, the identifier subunit is specifically configured to:

acquiring a preset feature library, wherein the preset feature library comprises feature information of a target object;

and matching the characteristic information with the characteristic information of the target object in a preset characteristic library.

In some embodiments, the preset feature library further comprises: the information display unit is specifically configured to:

acquiring object identification information of the target object from the preset feature library;

when the attention duration of a user to a target object is not less than the preset duration, acquiring preset video playing prompt information;

fusing the object identification information of the target object with the preset video playing prompt information to obtain the video playing prompt information of the target object;

and displaying the video playing prompt information of the target object.

In some embodiments, the playback unit is specifically configured to:

when a play confirmation instruction triggered based on the video play prompt information is detected, determining a target video picture containing the target object from the target video;

constructing a target video clip of the target object according to the playing time of the target video picture;

and playing the target video clip.

In some embodiments, the video playback apparatus further includes a determination unit configured to:

acquiring historical viewing information of the user, wherein the historical viewing information comprises at least one video viewed by the user;

counting the occurrence times of the objects in the video pictures of the at least one video to obtain the occurrence times of the objects;

and determining the target object according to the occurrence times of the objects.

Correspondingly, the present application further provides a computer device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement the steps in any of the video playing methods provided in the embodiments of the present application.

In addition, the embodiment of the present application further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the steps in any one of the video playing methods provided by the embodiments of the present application.

The method and the device for displaying the target video can display the video playing page, wherein the video playing page comprises a video picture of the target video, and the video picture comprises at least one object; when the attention duration of a user to a target object is not less than the preset duration, displaying video playing prompt information of the target object; and when a play confirmation instruction triggered based on the video play prompt information is detected, playing a target video clip containing the target object in the target video. According to the scheme, the video playing prompt information of the target object can be displayed when the fact that the attention duration of the user to the target object is not less than the preset duration is detected, and the target video clip containing the target object in the target video is directly played when the playing confirmation instruction triggered based on the video playing prompt information is detected, so that the efficiency of playing the target video clip is greatly improved.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.

Fig. 1a is a scene schematic diagram of a video playing method provided in an embodiment of the present application;

fig. 1b is a schematic flowchart of a video playing method provided in an embodiment of the present application;

fig. 1c is a schematic diagram illustrating a video playing page in the video playing method according to the embodiment of the present application;

FIG. 1d is a schematic display diagram of a "see only ta" control in a video playback page according to an embodiment of the present application;

fig. 1e is a schematic view illustrating display of video playing prompt information in a video playing page according to an embodiment of the present application;

fig. 1f is another schematic display diagram of video playing prompt information in a video playing page provided in the embodiment of the present application;

fig. 1g is a schematic display diagram of a playing target video segment in the video playing method provided in the embodiment of the present application;

fig. 2a is another schematic flowchart of a video playing method according to an embodiment of the present application;

fig. 2b is a scene schematic diagram of capturing a point of interest of a user on a video picture in a video playing method provided in the embodiment of the present application;

fig. 2c is a schematic flowchart illustrating object identification performed on a point of interest in a video playing method according to an embodiment of the present application;

fig. 2d is a schematic structural diagram of a block chain provided in an embodiment of the present application;

fig. 2e is another schematic structural diagram of a block chain provided in the embodiment of the present application;

fig. 3a is a schematic structural diagram of a video playback device according to an embodiment of the present application;

fig. 3b is a schematic structural diagram of a video playback device according to an embodiment of the present application;

fig. 3c is a schematic structural diagram of a video playback device according to an embodiment of the present application;

fig. 3d is a schematic structural diagram of a video playback device according to an embodiment of the present application;

fig. 4 is a schematic structural diagram of a computer device provided in an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

The embodiment of the application provides a video playing method, a video playing device, computer equipment and a computer readable storage medium. Specifically, the video playing method of the embodiment of the present application may be executed by a Computer device, where the Computer device may be a terminal or a server, and the terminal may be a mobile phone, a tablet Computer, a notebook Computer, an intelligent television, a wearable intelligent device, a Personal Computer (PC), and other devices; the terminal may include a client, which may be a video client or a browser client, etc. The server may be a single server or a server cluster composed of a plurality of servers.

For example, referring to fig. 1a, taking a computer device as an example of a terminal, the video playing system provided in the embodiment of the present application includes a terminal 10, a server 11, and the like; the terminal 10 and the server 11 are connected via a network, such as a wired or wireless network connection.

The terminal 10 may be configured to display a video playing page, where the video playing page includes a video frame of a target video, and the video frame includes at least one object; when detecting that the time length of the user concerning a target object is not less than the preset time length, displaying video playing prompt information of the target object; and when a play confirmation instruction triggered based on the video play prompt information is detected, playing a target video clip containing the target object in the target video.

The time length of the user focusing on the target object may be the time length of the user focusing on the target object directly detected by the terminal in the video playing process, or the detection of the time length of the user focusing on the target object triggered by the user on the terminal, and the detection process may be completed by the terminal 10 or the server 11, or completed by the terminal 10 and the server 11 together.

For example: the terminal 10 may collect a focus point of an eyeball focus of the user on the current video picture; acquiring the position of the attention point on the current video picture based on the duration of the attention point; the duration of the point of interest, the current video frame, and the position, e.g., coordinates, of the point of interest on the video frame are sent to the server 11, so that the server 11 detects the duration of the user's interest in the target object.

In an embodiment, after receiving the duration of the attention point, the current video picture, and the position of the attention point on the video picture, the server 11 performs object identification on the current video picture according to the position of the attention point on the current video picture; when the target object is successfully identified, acquiring the attention duration of the user to the target object according to the duration of the attention point; when the time length of the user concerning the target object is not less than the preset time length, the time length of the user concerning the target object is sent to the terminal 10, so that the terminal 10 displays the video playing prompt information of the target object according to the time length of the user concerning the target object.

The following are detailed below. It should be noted that the following description of the embodiments is not intended to limit the preferred order of the embodiments.

The embodiment of the application provides a video playing method, which can be executed by a terminal or a server, or can be executed by the terminal and the server together; the embodiment of the present application is described by taking an example in which a video playing method is executed by a terminal.

As shown in fig. 1b, the specific flow of the video playing method may be as follows:

101. and displaying a video playing page, wherein the video playing page comprises a video picture of the target video, and the video picture comprises at least one object.

The video playing page is a page for playing a target video, the target video may be any type of video, such as a television show, a movie, and the like, the target video may be composed of multiple frames of video frames, and at least one object included in the video frames may be a character object (i.e., an actor, such as a leading actor, a matching actor, and the like), an animal object (e.g., a cat, a dog, a bird, and the like), or an object (e.g., a mountain, water, a tree, and the like).

The video playing page can be displayed by a terminal such as a mobile phone, a notebook computer, a smart television and the like, and the video playing page can be provided by any software, for example, can be provided by a video client in the terminal.

For example, referring to fig. 1c, a video playback page may play a target video and display a video frame of the target video, where the video frame may include one or more actors.

102. And when the attention duration of the user to the target object is not less than the preset duration, displaying the video playing prompt information of the target object.

The time length of the target object focused by the user is the time length of the target object focused by the user in the video picture in the process of watching the video, the time length of the target object focused by the user can be generated in the process of playing the current video or in the process of watching the video by the user in a historical time period, wherein the historical time period can be the past half year, one month, one week or the like, and the historical time period can be set according to the requirements of practical application.

In an embodiment, the target object may be determined based on historical viewing information of the user, and specifically, the video playing method may further include:

acquiring historical viewing information of a user, wherein the historical viewing information comprises at least one video viewed by the user;

counting the occurrence times of the objects in the video pictures of at least one video to obtain the occurrence times of the objects;

For example, the number of occurrences of each object in the video frames of all videos viewed by the user may be counted according to the historical viewing record of the user, and then the object with the largest number of occurrences may be selected as the target object.

The video playing prompt information is information for prompting a user to perform playing operation on a target video, and the video playing prompt information can be expressed in various expression forms, for example, in forms of text, voice, image or image.

In one embodiment, the video playing page further includes a video playing control, which may be represented in various forms, such as icons, buttons, input boxes, and the like. And when the triggering operation of the user on the video playing control is detected, and the attention duration of the user on the target object is greater than or equal to the preset duration, displaying video playing prompt information of the target object. Specifically, the step of displaying the video playing prompt information of the target object when the attention duration of the user to the target object is not less than the preset duration may include: and when the triggering operation aiming at the video playing control is detected and the attention duration of the user to the target object is not less than the preset duration, displaying the video playing prompt information of the target object.

In this embodiment of the application, the triggering operation performed by the user for the video playing control may be understood as an opening operation of the video playing function by the user. The triggering operation of the user on the video playing control may be a triggering operation such as clicking, sliding, voice, gesture, or the like, or may be an operation of selecting the control and confirming the selection through a control device such as a remote controller.

For example, referring to fig. 1d, the video playing page further includes a video playing control, i.e., a "view only ta" control, which allows the user to turn on or off a function of playing only a video segment of the target video containing the target object (e.g., the actor "jia-a"). When the starting operation of the video playing function, such as clicking, sliding and the like, performed by the user aiming at the 'only see ta' control is detected, the attention duration of the user to the target object is detected, and when the attention duration of the user to the target object is detected to be not less than the preset duration, the video playing prompt information of the target object is displayed on the video playing page. Specifically, before the step "when the time length of interest of the user to the target object is not less than the preset time length, displaying the video playing prompt information of the target object", the method may further include:

collecting the focus of the eyeball of a user on the current video picture;

acquiring the position of the attention point on the current video picture based on the duration of the attention point;

according to the position of the attention point on the current video picture, carrying out object identification on the current video picture;

and when the target object is successfully identified, acquiring the attention duration of the user to the target object according to the attention duration.

The method for collecting the attention point of the eyeball focus of the user on the current video picture may be to collect a moving track of the eyeball focus of the user on the video picture in real time in the process of playing the target video, and the collecting mode may be various, for example, the moving track of the eyeball focus of the user on the video picture may be collected by starting a local camera process (i.e., a device where the video playing device is located, such as a terminal), for example, starting a front camera of the terminal to collect the moving track of the eyeball focus of the user on the video picture, where the moving track is obtained by connecting one or more attention points of the eyeball focus of the user on the video picture according to the sequence of attention time.

The duration of the attention point is the duration of the attention point of the user, and it should be noted that when the human eye pays attention to a certain stationary target, the eye still has 3 kinds of micro-motion eye jumps: wandering, tremor, and involuntary eye jumps. The shift in visual axis is an irregular, slow change in visual axis. When the fixation is performed on a stationary object at a point over a certain time (about 300 to 500 milliseconds), or when the image of the fixation point on the retina shows a tendency to move away from the fovea due to drift, an involuntary micro-jump of the eye is induced. In general, most fixations are accompanied by drift and tremor eye movements. When a stationary object is watched for a long time, drift, tremor and a slight involuntary eye jump can occur simultaneously. Therefore, the jitter amplitude of the eyeball focus of the user in the range of 15 pixels on the video picture can be ignored, namely the user can be considered to be looking at the same place.

In an embodiment, by sequentially detecting the durations of one or more attention points on the moving track, when the duration of the attention point is detected to be not less than the preset attention duration, the position, such as coordinates, of the attention point on the current video picture is calculated, and meanwhile, the current video picture (i.e., the video picture currently being played) in the playing process of the target video is acquired, such as captured. The current video frame may be captured in various manners, for example, the current video frame may be captured by using an image capture interface provided by a device where the video playing apparatus is located, such as an operating system of a terminal, and the captured current video frame may be stored in a Bitmap (Bitmap) file format. The position of the attention point on the current video picture is determined according to the captured current video picture, for example, the position coordinate of the attention point on the current video picture can be calculated according to the distance from the eyeball focus of the eyes to the current video picture, the angle of the eyeball focus when the attention point is watched by the eyeball focus relative to the horizontal line, and the coordinate origin (for example, the vertex corresponding to the upper left corner of the current video picture is used as the coordinate origin). It should be noted that, the position of the eyeball focus of the human eye on the current video picture may be located by an eye movement tracking technology, such as hough circle detection, threshold segmentation, gray level projection, template matching, neural network training, and the like, and all the algorithms that can be used to locate the eyeball focus belong to the scope of protection of the present application.

The preset attention duration may be 0.5 second, 1 second, 2 seconds or the like, and the preset attention duration may be set according to the requirements of the actual application.

In an embodiment, when the coordinates of the point of interest on the current video frame are calculated, object recognition may be performed on an image in a region near the coordinates according to the coordinates of the point of interest on the current video frame, so as to obtain a target object focused by the user, and specifically, the step "performing object recognition on the current video frame according to the position of the point of interest on the current video frame" may include:

performing feature extraction on an image of a current video picture in a target identification area to obtain feature information;

For example, according to the calculated coordinates of the attention point on the current video picture (that is, corresponding to a pixel point on the current video picture), 50 pixels are extended to the periphery by taking the coordinate point as a center to form a rectangular area, and the rectangle can be used as the target identification area. After the target recognition area is generated, feature extraction is carried out on the image of the current video picture in the target recognition area, the extracted feature information is matched with the feature information of the target object, and when the extracted feature information is successfully matched with the feature information of the target object, the target object can be determined to be successfully recognized. Specifically, the step "performing object recognition on the current video picture according to the position of the attention point on the current video picture" may further include:

For example, the feature information (i.e., the extracted feature information) may be respectively matched with the feature information of each object in the preset feature library, and when the feature information of the object matched with the extracted feature information exists in the preset feature library, the object is determined as the target object.

It should be noted that, performing object recognition on the current video picture may be understood as image recognition such as face recognition, and the algorithm used in the image recognition in the embodiment of the present application is not specifically limited, and all algorithms that can perform object recognition on the current video picture to acquire feature information of a target object belong to the protection scope of the present application. It should be noted that, in addition to the feature information of the target object that can be acquired through object recognition, the time period in which the target object appears in the target video can also be acquired.

In an embodiment, the preset feature library further includes object identification information of the target object, taking the target object as an actor, where the object identification information of the target object may be a name of the actor or an Identity mark (ID) corresponding to the actor, and when the target object is successfully identified on the current video picture, the accumulated time length of interest corresponding to the target object may be updated according to the time length of interest of the user to the point of interest, and the updated accumulated time length of interest is used as the time length of interest of the user to the target object, specifically, the step "obtaining the time length of interest of the user to the target object according to the time length of interest" may include:

In the embodiment of the application, each user corresponds to one data table, and the data table may include an Identifier of a client, that is, a Globally Unique Identifier (GUID), a login account of the user at the client, object identification information of a target object, attention duration of the user to the target object, and other information, where the attention duration of the user to the target object may be obtained by updating an accumulated attention duration corresponding to the target object, and the accumulated attention duration corresponding to the target object is obtained by accumulating attention durations of the user at an attention point (that is, duration of the attention point). In an embodiment, in the process of watching the target video next time, the video playing prompt information for the target object may be directly displayed according to the attention duration recorded in the data table for the target object.

In an embodiment, after object identification is performed on a target identification area corresponding to a point of interest of a user on a video image each time, identification information of an identified target object may be stored in a data table, specifically, if object identification information of the target object is not recorded in the data table, object identification information of the target object and accumulated time duration information of the user regarding the target object are newly added in the data table; otherwise, only the accumulated attention duration of the target object is updated. When the accumulated attention duration, that is, the attention duration of the user to the target object is greater than or equal to the preset duration, fusing the preset video playing prompt information and the object identification information of the target object to obtain and display the video playing prompt information of the target object, specifically, the preset feature library further includes the object identification information of the target object, and the step "when the attention duration of the user to the target object is not less than the preset duration, displaying the video playing prompt information of the target object" may include:

acquiring object identification information of a target object from a preset feature library;

fusing object identification information of the target object with preset video playing prompt information to obtain video playing prompt information of the target object;

and displaying the video playing prompt information of the target object.

For example, when the preset video playing prompt message is a text type message, the object identifier of the target object is embedded into the preset video playing prompt message as a name, so as to obtain the video playing prompt message of the target object, for example, with a character object as an example, referring to fig. 1e, when the user starts the video playing function such as clicking, sliding and the like for the "see only ta" button, and the time length of the user's attention to the actor "jia will exceed the preset time length, the video playing page will display the video playing prompt message corresponding to the actor" jia ": pressing the confirm key can only see the first person, and pressing the return key closes the prompt, wherein the first person is the name of the actor.

The preset time period may be 30 seconds, 1 minute, or 2 minutes, and the like, and the preset time period may be set according to the requirement of the actual application.

103. And when a play confirmation instruction triggered based on the video play prompt information is detected, playing a target video clip containing a target object in the target video.

The playing confirmation instruction is a confirmation instruction of one or more video segments in the playing target video triggered by the user according to the video playing prompt information, and the playing confirmation instruction can be triggered by the user through a control device such as a remote controller or a confirmation button or a confirmation control on the terminal device.

In an embodiment, the video playing prompt information includes a play confirmation control, and when a confirmation operation such as clicking, sliding, or selecting and the like performed on the play confirmation control is detected, a play confirmation instruction is triggered, and a target video clip including a target object in a target video is played, specifically, the step "when a play confirmation instruction triggered based on the video playing prompt information is detected, a target video clip including a target object in a target video is played" includes:

when the confirmation operation carried out on the confirmed playing control is detected, a playing confirmation instruction is triggered, and a target video clip containing the target object in the target video is played.

In an embodiment, the video playing prompt information may further include a cancel prompt control, and when detecting that a trigger operation, such as clicking, sliding, and the like, performed by the user with respect to the cancel prompt control, the video playing prompt information may be cancelled from being displayed. For example, referring to fig. 1f, when a confirmation operation, such as clicking, sliding, etc., performed by a user with respect to a confirmation play control, i.e., a "confirmation" button, is detected, a target video clip of a target object is played in a video play page; and when the confirmation operation, such as clicking, sliding and the like, performed by the user aiming at the cancel prompt control, namely the 'return' button is detected, the display of the video playing prompt information is cancelled.

In an embodiment, when a play confirmation instruction triggered based on video play prompt information is detected, a progress indication control is displayed on a video play page, and specifically, the video play method further includes:

when a play confirmation instruction triggered based on the video play prompt information is detected, displaying a progress indication control on a video play page, wherein the progress indication control comprises a segment identifier, and the segment identifier is used for indicating the play time period of a target video segment.

For example, referring to fig. 1g, when a play confirmation instruction triggered by the user based on the video play prompt information is detected, a plurality of target video segments containing target objects are identified on the progress indication control displayed on the video play page, and a video frame corresponding to the play start time point of the target video segment is displayed in the video play page (that is, the video frame jumps from the video play frame at 6 minutes and 40 seconds shown in fig. 1f to the video play frame at 4 minutes and 20 seconds shown in fig. 1 g) is displayed in the video play page from the current video frame currently being played.

It should be noted that, in the process of playing the target video segment, the user may still control the target video segment through the progress indication control, such as performing operations of forwarding, rewinding, and jumping on the target video segment.

In an embodiment, when a play confirmation instruction triggered based on the video play prompt information is detected, a target video picture including a target object may be determined from the target video, a target video clip of the target object may be constructed according to the play time of the target video picture, and the target video clip may be played. Specifically, the step "when a play confirmation instruction triggered based on the video play prompt information is detected, playing a target video segment containing a target object in a target video" may include:

when a play confirmation instruction triggered based on the video play prompt information is detected, determining a target video picture containing a target object from a target video;

constructing a target video clip of a target object according to the playing time of the target video frame;

and playing the target video clip.

The target video picture is a picture including a target object in a video picture of the target video, and there are various ways of determining the target video picture, for example, object recognition may be performed on each frame of video picture in the target video to determine the target video picture in which the target object appears, where the target video picture may be one or more target video pictures. Then, a target video clip of the target object is constructed according to the playing time of the target video picture, that is, the time point or the time period when the target video picture appears, wherein the construction mode may be various, for example, the construction mode may be constructed according to the playing time point or the time period interval between the time periods of each target video picture, for example, when the playing time interval of two adjacent target video pictures is less than the preset interval time, the two video pictures may be considered as one video clip of the target object, thereby one or more target video clips of the target object may be constructed, and then the target video clip is played.

The preset interval duration may be 30 seconds, 1 minute, or 2 minutes, and the like, and the preset interval duration may be set according to the requirements of the practical application, which is not described herein any more.

As can be seen from the above, the video playing page can be displayed in the embodiment of the application, wherein the video playing page includes a video picture of a target video, and the video picture includes at least one object; when the attention duration of a user to the target object is not less than the preset duration, displaying video playing prompt information of the target object; and when a play confirmation instruction triggered based on the video play prompt information is detected, playing a target video segment containing a target object in the target video. According to the scheme, the video playing prompt information of the target object can be displayed when the fact that the attention time length of the user to the target object is not less than the preset time length is detected, the target video clip containing the target object in the target video is directly played when the playing confirmation instruction triggered based on the video playing prompt information is detected, for example, when the attention time length of the user to a certain actor in the video is not less than the preset time length, the video clip playing prompt information aiming at the actor is displayed on a video playing page, and after the user confirms the prompt information, the video clip containing the actor can be directly jumped to play, so that the efficiency of playing the target video clip is greatly improved.

The method described in the above embodiments is further illustrated in detail by way of example.

In this embodiment, a video playing method is provided, which may be executed by a terminal or a server, or may be executed by both the terminal and the server.

As shown in fig. 2a, the specific flow of the video playing method may be as follows:

201. the terminal displays a video playing page, wherein the video playing page comprises a video picture of a target video, and the video picture comprises at least one object.

For example, referring to fig. 1c, the terminal may display a video playing page, which may play a target video and display a video frame of the target video, wherein the video frame may include one or more actors.

202. And the terminal collects the attention point of the eyeball focus of the user on the current video picture.

The method for acquiring the attention point of the eyeball focus of the user on the current video picture by the terminal may be various, for example, the attention point may be acquired by starting a local camera process (that is, a device where the video playing device is located, such as a terminal), for example, a front camera of the terminal is started to acquire a movement track of the eyeball focus of the user on the video picture, where the movement track is obtained by connecting one or more attention points of the eyeball focus of the user on the video picture according to the sequence of attention time.

In an embodiment, the video playing page further includes a video playing control, and when a triggering operation for the video playing control is detected and a time length of interest of a user for a target object is not less than a preset time length, the terminal displays video playing prompt information of the target object, for example, referring to fig. 1d, the video playing page further includes a video playing control, that is, a "view only ta" control, which can enable or disable a function of playing only a video segment containing the target object (such as actor "jia") in the target video. When the opening operation of the video playing function, such as clicking, sliding and the like, performed by the user for the "only see ta" control is detected, the terminal can be triggered to acquire the moving track of the eyeball focus of the user on the video picture, so that the focus of the eyeball focus of the user on the current video picture is obtained.

203. And the terminal acquires the position of the attention point on the current video picture based on the duration of the attention point.

When the terminal detects that the duration of the point of interest is not less than a preset second duration, calculating the position, such as coordinates, of the point of interest on a current video picture, and simultaneously acquiring, such as capturing, a current video picture (namely the video picture which is currently played) in the playing process of the target video. The current video frame may be captured in various manners, for example, the current video frame may be captured by using an image capture interface provided by a device where the video playing apparatus is located, such as an operating system of a terminal, and the captured current video frame may be stored in a Bitmap (Bitmap) file format. The position of the attention point on the current video picture is determined according to the captured current video picture, for example, the position coordinate of the attention point on the current video picture can be calculated according to the distance from the eyeball focus of the human eyes to the current video picture, the angle of the eyeball focus when the attention point is watched relative to the horizontal line, and the coordinate origin (for example, the vertex corresponding to the upper left corner of the current video picture is used as the coordinate origin). It should be noted that, the position of the eyeball focus of the human eye on the current video frame may be located by an eye movement tracking technique, such as hough circle detection, threshold segmentation, gray level projection, template matching, neural network training, and the like, and all the algorithms that can be used to locate the eyeball focus belong to the scope of protection of the present application.

The preset second time period may be 0.5 second, 1 second, 2 seconds, or the like, and the preset second time period may be set according to the requirement of the practical application.

In an embodiment, the terminal may combine the captured current video picture, the calculated position of the attention point, and the duration of the attention point to generate a complete eye movement trajectory protocol data packet, and transmit the data packet to the server, so that the server identifies the target object from the current video picture according to the position of the attention point on the current video picture, and obtains the duration of the attention of the user to the target object.

204. And the server identifies the object of the current video picture according to the position of the attention point on the current video picture.

For example, after the server takes the eyeball movement trajectory protocol data packet, the current video picture and the position of the attention point on the current video picture are analyzed from the data packet, and then, object recognition is performed on the current video picture according to the position of the attention point on the current video picture. Specifically, referring to fig. 2b, for example, based on the calculated coordinates of the attention point on the current video frame (i.e. corresponding to a pixel point on the current video frame), with the coordinate point as the center, 50 pixels are expanded to the horizontal and vertical directions to form a rectangular area, or, with the coordinate point as the center, 50 pixels as the radius and extending to the periphery to form a circular area, the image of the current video picture in the rectangular area or the circular area is subjected to feature extraction, and the extracted feature information is matched with the feature information of the target object, for example, the extracted feature information can be respectively matched with the feature information of each object in the preset feature library, when the feature information of the object matched with the extracted feature information exists in the preset feature library, the object can be determined as the target object, namely the target object is successfully identified.

205. When the target object is successfully identified, the server acquires the attention duration of the user to the target object according to the attention duration.

In an embodiment, the preset feature library further includes object identification information of the target object, taking the target object as an actor, where the object identification information of the target object may be a name of the actor or an Identity mark (ID) corresponding to the actor, and when the target object is successfully identified, the accumulated time length of interest corresponding to the target object may be updated according to the time length of interest of the user to the point of interest, and the updated accumulated time length of interest is used as the time length of interest of the user to the target object, specifically, the step "obtaining the time length of interest of the user to the target object according to the time length of the point of interest" may include:

In the embodiment of the application, each user corresponds to one data table, and the data table may include an Identifier of a client, that is, a Globally Unique Identifier (GUID), a login account of the user at the client, object identification information of a target object, attention duration of the user to the target object, and other information, where the attention duration of the user to the target object may be obtained by updating an accumulated attention duration corresponding to the target object, and the accumulated attention duration corresponding to the target object is obtained by accumulating attention durations of the user at an attention point (that is, duration of the attention point).

In an embodiment, after object identification is performed on a target identification area corresponding to a point of interest of a user on a video image each time, identification information of an identified target object may be stored in a data table, specifically, if object identification information of the target object is not recorded in the data table, object identification information of the target object and accumulated time duration information of the user regarding the target object are newly added in the data table; otherwise, only the accumulated attention duration of the target object is updated.

acquiring historical viewing information of a user, wherein the historical viewing information comprises at least one video viewed by the user; counting the occurrence times of the objects in the video pictures of at least one video to obtain the occurrence times of the objects; and determining the target object according to the occurrence times of the objects.

206. And when the attention duration of the user to the target object is not less than the preset duration, the terminal displays the video playing prompt information of the target object.

Specifically, the preset feature library further includes object identification information of the target object, and the step "when the duration of attention to the target object by the user is not less than the preset duration, the video playing prompt information of the target object is displayed", may include:

and displaying the video playing prompt information of the target object.

207. And when the terminal detects a play confirmation instruction triggered based on the video play prompt information, playing a target video clip containing the target object in the target video.

In an embodiment, the video playing prompt information may further include a cancel prompt control, and when detecting that a trigger operation, such as clicking, sliding, and the like, performed by the user with respect to the cancel prompt control, the video playing prompt information may be cancelled from being displayed. For example, taking a character object as an example, referring to fig. 1f, when a confirmation operation, such as clicking, sliding, etc., performed by a user with respect to a confirmation play control, i.e., a "confirmation" button is detected, a target video clip containing an actor "jia in a target video is played on a video play page; and when the confirmation operation, such as clicking, sliding and the like, performed by the user aiming at the cancel prompt control, namely the 'return' button is detected, the display of the video playing prompt information is cancelled.

The clip identifier is a control for identifying a playing time period (from a playing start time point to a playing end time point) of a target video clip, and the progress indication control is used for indicating and controlling a playing progress of the target video, for example, taking a character object as an example, referring to fig. 1g, when a playing confirmation instruction triggered by a user based on video playing prompt information is detected, a plurality of target video clips containing actor "a and a is identified on the progress indication control displayed on the video playing page, and a video frame corresponding to the playing start time point of the target video clip is jumped to be displayed in the video playing page from a current video frame currently being played to be displayed (i.e., the video frame is jumped to the video playing frame at the time point of 4 minutes and 20 seconds shown in fig. 1g from the video playing frame at the time point of 6 minutes and 40 seconds shown in fig. 1 f).

and playing the target video clip.

The target video picture is a picture including a target object in a video picture of the target video, and there are various ways of determining the target video picture, for example, object recognition may be performed on each frame of video picture in the target video to determine the target video picture in which the target object appears, where the target video picture may be one or more target video pictures. Then, a target video clip of the target object is constructed according to the playing time of the target video picture, that is, the time point or the time period when the target video picture appears, wherein the construction mode may be various, for example, the construction mode may be constructed according to the time length of the playing time point or the time period interval of each target video picture, for example, when the playing time interval of two adjacent target video pictures is less than the preset interval time length, the two video pictures may be considered as one video clip of the target object, thereby one or more target video clips of the target object may be constructed, and the terminal plays the target video clip.

In an embodiment, the video playing method provided by the embodiment of the present application may perform object identification on the current video picture according to the attention point and the attention duration of the eyeball focus of the user on the current video picture, and the identification result may be bound with the identifier of the client and the login account of the user at the client, where the process is shown in fig. 2 c.

In an embodiment, the target video segment in step 207 may also be stored into the blockchain. The blockchain system may be a distributed system formed by connecting clients, a plurality of nodes (any form of computing devices in an access network, such as servers and user terminals) through a network communication mode. Referring To fig. 2d, fig. 2d is an optional structural diagram of the distributed system 100 applied To a blockchain system according To an embodiment of the present invention, which is formed by a plurality of nodes (any form of computing devices in an access network, such as servers and user terminals) and clients, and a Peer-To-Peer (P2P, Peer To Peer) network is formed between the nodes, and the P2P Protocol is an application layer Protocol operating on a Transmission Control Protocol (TCP). In a distributed system, any machine, such as a server or a terminal, can join to become a node, and the node comprises a hardware layer, a middle layer, an operating system layer and an application layer.

Referring to the functions of each node in the blockchain system shown in fig. 2d, the functions involved include:

1) routing, a basic function that a node has, is used to support communication between nodes.

Besides the routing function, the node may also have the following functions:

2) the application is used for being deployed in a block chain, realizing specific services according to actual service requirements, recording data related to the realization functions to form recording data, carrying a digital signature in the recording data to represent a source of task data, and sending the recording data to other nodes in the block chain system, so that the other nodes add the recording data to a temporary block when the source and integrity of the recording data are verified successfully.

For example, the services implemented by the application include:

2.1) wallet, for providing the function of transaction of electronic money, including initiating transaction (i.e. sending the transaction record of current transaction to other nodes in the blockchain system, after the other nodes are successfully verified, storing the record data of transaction in the temporary blocks of the blockchain as the response of confirming the transaction is valid; of course, the wallet also supports the querying of the remaining electronic money in the electronic money address;

and 2.2) sharing the account book, wherein the shared account book is used for providing functions of operations such as storage, query and modification of account data, record data of the operations on the account data are sent to other nodes in the block chain system, and after the other nodes verify the validity, the record data are stored in a temporary block as a response for acknowledging that the account data are valid, and confirmation can be sent to the node initiating the operations.

2.3) Intelligent contracts, computerized agreements, which can enforce the terms of a contract, implemented by codes deployed on a shared ledger for execution when certain conditions are met, for completing automated transactions according to actual business requirement codes, such as querying the logistics status of goods purchased by a buyer, transferring the buyer's electronic money to the merchant's address after the buyer signs for the goods; of course, smart contracts are not limited to executing contracts for trading, but may also execute contracts that process received information.

3) And the Block chain comprises a series of blocks (blocks) which are mutually connected according to the generated chronological order, new blocks cannot be removed once being added into the Block chain, and recorded data submitted by nodes in the Block chain system are recorded in the blocks.

Referring to fig. 2e, fig. 2e is an optional schematic diagram of a Block Structure (Block Structure) according to an embodiment of the present invention, where each Block includes a hash value of a transaction record (hash value of the Block) stored in the Block and a hash value of a previous Block, and the blocks are connected by the hash value to form a Block chain. The block may include information such as a time stamp at the time of block generation. A block chain (Blockchain), which is essentially a decentralized database, is a string of data blocks associated by using cryptography, and each data block contains related information for verifying the validity (anti-counterfeiting) of the information and generating a next block.

In order to better implement the above method, an embodiment of the present application further provides a video playing apparatus.

For example, as shown in fig. 3a, the video playing apparatus may include a page display unit 301, an information display unit 302, a playing unit 303, and the like, as follows:

a page display unit 301, configured to display a video playback page, where the video playback page includes a video frame of a target video, and the video frame includes at least one object;

the information display unit 302 is configured to display video playing prompt information of a target object when a user focuses on the target object for a duration not less than a preset duration;

a playing unit 303, configured to play a target video segment containing the target object in the target video when a play confirmation instruction triggered based on the video play prompt information is detected.

In some embodiments, the video playing page further includes a video playing control, and the information display unit 302 is specifically configured to:

In some embodiments, referring to fig. 3b, the video playing apparatus further comprises: a control display unit 304, configured to display a progress indication control on the video playing page when a play confirmation instruction triggered based on the video playing prompt information is detected, where the progress indication control includes a segment identifier, and the segment identifier is used to indicate a playing time period of the target video segment.

In some embodiments, the video playing prompting information includes a play confirmation control, and the playing unit 303 is specifically configured to:

In some embodiments, referring to fig. 3c, the video playing apparatus further includes an obtaining unit 305, where the obtaining unit includes:

the collecting sub-unit 3051 is configured to collect a focus of an eyeball of a user on a current video picture;

a position obtaining subunit 3052, configured to obtain, based on a duration of the attention point, a position of the attention point on the current video frame;

the identification subunit 3053, configured to perform object identification on the current video picture according to the position of the attention point on the current video picture;

and a duration obtaining subunit 3054, configured to obtain, based on the successfully identified target object, a duration of interest of the user for the target object according to the duration of the point of interest.

In some embodiments, the duration obtaining subunit 3024 is specifically configured to:

In some embodiments, the identifier unit 3023 is specifically configured to:

In some embodiments, the preset feature library further comprises: the object identification information of the target object, the information display unit 302 is specifically configured to:

and displaying the video playing prompt information of the target object.

In some embodiments, the playing unit 303 is specifically configured to:

and playing the target video clip.

In some embodiments, referring to fig. 3d, the video playing apparatus further comprises a determining unit 306 configured to:

In a specific implementation, the above units may be implemented as independent entities, or may be combined arbitrarily to be implemented as the same or several entities, and the specific implementation of the above units may refer to the foregoing method embodiments, which are not described herein again.

As can be seen from the above, the video playing apparatus in the embodiment of the present application can display a video playing page through the page display unit 301, where the video playing page includes a video frame of a target video, and the video frame includes at least one object; displaying, by the information display unit 302, video play prompt information of the target object when a user's attention duration to the target object is not less than a preset duration; when a play confirmation instruction triggered based on the video play prompt information is detected, a target video segment containing a target object in the target video is played by the playing unit 303. According to the scheme, the video playing prompt information of the target object can be displayed when the fact that the attention duration of the user to the target object is not less than the preset duration is detected, and the target video clip containing the target object in the target video is directly played when the playing confirmation instruction triggered based on the video playing prompt information is detected, so that the efficiency of playing the target video clip is greatly improved.

The embodiment of the present application further provides a computer device, as shown in fig. 4, which shows a schematic structural diagram of the computer device according to the embodiment of the present application, specifically:

the computer device may include components such as a processor 401 of one or more processing cores, memory 402 of one or more computer-readable storage media, a power supply 403, and an input unit 404. Those skilled in the art will appreciate that the computer device configuration illustrated in FIG. 4 does not constitute a limitation of computer devices, and may include more or fewer components than those illustrated, or some components may be combined, or a different arrangement of components. Wherein:

the processor 401 is a control center of the computer device, connects various parts of the entire computer device using various interfaces and lines, and performs various functions of the computer device and processes data by running or executing software programs and/or modules stored in the memory 402 and calling data stored in the memory 402, thereby monitoring the computer device as a whole. Optionally, processor 401 may include one or more processing cores; preferably, the processor 401 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 401.

The memory 402 may be used to store software programs and modules, and the processor 401 executes various functional applications and data processing by operating the software programs and modules stored in the memory 402. The memory 402 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program (such as a sound playing function, an image playing function, etc.) required by at least one function, and the like; the storage data area may store data created according to use of the computer device, and the like. Further, the memory 402 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device. Accordingly, the memory 402 may also include a memory controller to provide the processor 401 access to the memory 402.

The computer device further comprises a power supply 403 for supplying power to the various components, and preferably, the power supply 403 is logically connected to the processor 401 via a power management system, so that functions of managing charging, discharging, and power consumption are implemented via the power management system. The power supply 403 may also include any component of one or more dc or ac power sources, recharging systems, power failure detection circuitry, power converters or inverters, power status indicators, and the like.

The computer device may also include an input unit 404, the input unit 404 being operable to receive input numeric or character information and to generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function control.

Although not shown, the computer device may further include a display unit and the like, which are not described in detail herein. Specifically, in this embodiment, the processor 401 in the computer device loads the executable file corresponding to the process of one or more application programs into the memory 402 according to the following instructions, and the processor 401 runs the application programs stored in the memory 402, thereby implementing various functions as follows:

displaying a video playing page, wherein the video playing page comprises a video picture of a target video, and the video picture comprises at least one object; when the attention duration of a user to the target object is not less than the preset duration, displaying video playing prompt information of the target object; and when a play confirmation instruction triggered based on the video play prompt information is detected, playing a target video segment containing a target object in the target video.

The above operations can be referred to the previous embodiments specifically, and are not described herein.

As can be seen from the above, the computer device according to the embodiment of the present application may display a video playback page, where the video playback page includes a video frame of a target video, and the video frame includes at least one object; when the attention duration of a user to the target object is not less than the preset duration, displaying video playing prompt information of the target object; and when a play confirmation instruction triggered based on the video play prompt information is detected, playing a target video segment containing a target object in the target video. According to the scheme, the video playing prompt information of the target object can be displayed when the fact that the attention duration of the user to the target object is not less than the preset duration is detected, and the target video clip containing the target object in the target video is directly played when the playing confirmation instruction triggered based on the video playing prompt information is detected, so that the efficiency of playing the target video clip is greatly improved.

It will be understood by those skilled in the art that all or part of the steps of the methods of the above embodiments may be performed by instructions or by associated hardware controlled by the instructions, which may be stored in a computer readable storage medium and loaded and executed by a processor.

To this end, an embodiment of the present application provides a computer-readable storage medium, in which a computer program is stored, where the computer program can be loaded by a processor to execute the steps in any one of the video playing methods provided in the embodiment of the present application. For example, the computer program may perform the steps of:

The above operations can be implemented in the foregoing embodiments, and are not described in detail herein.

Wherein the computer-readable storage medium may include: read Only Memory (ROM), Random Access Memory (RAM), magnetic or optical disks, and the like.

Since the instructions stored in the computer-readable storage medium can execute the steps in any video playing method provided in the embodiments of the present application, beneficial effects that can be achieved by any video playing method provided in the embodiments of the present application can be achieved, for details, see the foregoing embodiments, and are not described herein again.

The video playing method, the video playing apparatus, the computer device and the computer readable storage medium provided in the embodiments of the present application are described in detail above, and a specific example is applied in the present application to illustrate the principle and the implementation of the present invention, and the description of the above embodiments is only used to help understanding the method and the core idea of the present invention; meanwhile, for those skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

Claims

1. A video playback method, comprising:

when the attention duration of a user to a target object is not less than a preset duration, displaying video playing prompt information of the target object, wherein the attention duration is the accumulated attention duration of the user to the target object in the video playing process, the target object is an object which is interested by the user in the target video, and the determination process of the target object comprises the following steps: acquiring a target identification area corresponding to the focus point on the current video picture based on the duration of the focus point of the user on the current video picture; extracting the features of the image of the current video picture in the target identification area to obtain feature information; when the feature information is successfully matched with the feature information of the target object, determining that the target object is successfully identified;

and when a play confirmation instruction triggered based on the video play prompt information is detected, playing a target video clip containing the target object in the target video so as to play a video clip which is interested by a user in the target video.

2. The method according to claim 1, wherein the video playback page further includes a video playback control, and the displaying the video playback prompt information of the target object when the user focuses on the target object for a duration not less than a preset duration includes:

3. The method of claim 1, further comprising:

when a play confirmation instruction triggered based on the video play prompt information is detected, displaying a progress indication control on the video play page, wherein the progress indication control comprises a segment identifier, and the segment identifier is used for indicating the play time period of the target video segment.

4. The method according to claim 1, wherein the video playing prompt message includes a play confirmation control, and the playing a target video segment containing the target object in the target video when a play confirmation instruction triggered based on the video playing prompt message is detected comprises:

5. The method according to claim 1, wherein before displaying the video playing prompt message of the target object when the user focuses on the target object for a duration not less than a preset duration, the method further comprises:

collecting the focus of the eyeball of a user on the current video picture;

6. The method according to claim 5, wherein the obtaining the attention duration of the user to the target object according to the attention duration comprises:

7. The method of claim 5, wherein the performing object recognition on the current video picture according to the position of the point of interest on the current video picture comprises:

8. The method of claim 7, further comprising:

9. The method of claim 8, wherein the pre-defined feature library further comprises: the method for displaying the video playing prompt information of the target object when the attention duration of the user to the target object is not less than the preset duration comprises the following steps:

and displaying the video playing prompt information of the target object.

10. The method according to claim 1, wherein the playing a target video segment containing the target object in the target video when the play confirmation instruction triggered based on the video play prompt information is detected comprises:

and playing the target video clip.

11. The method of claim 1, further comprising:

12. A video playback apparatus, comprising:

an information display unit, configured to display video playing prompt information of a target object when a time length of interest of a user to the target object is not less than a preset time length, where the time length of interest is an accumulated time length of interest of the user to the target object in a video playing process, and the target object is an object that is interested in the user in the target video, and the determination process of the target object includes: acquiring a target identification area corresponding to the focus point on the current video picture based on the duration of the focus point of the user on the current video picture; extracting the features of the image of the current video picture in the target identification area to obtain feature information; when the feature information is successfully matched with the feature information of the target object, determining that the target object is successfully identified;

and the playing unit is used for playing the target video clip containing the target object in the target video when a playing confirmation instruction triggered based on the video playing prompt information is detected, so as to play the video clip which is interested by the user in the target video.

13. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the steps of the method according to any of claims 1-11 are implemented when the program is executed by the processor.

14. A computer-readable storage medium, on which a computer program is stored, wherein the computer program, when being executed by a processor, carries out the steps of the method according to any one of claims 1-11.