CN108366278B

CN108366278B - User interaction implementation method and device in video playing

Info

Publication number: CN108366278B
Application number: CN201810103049.8A
Authority: CN
Inventors: 苏豪
Original assignee: Beijing QIYI Century Science and Technology Co Ltd
Current assignee: Beijing QIYI Century Science and Technology Co Ltd
Priority date: 2018-02-01
Filing date: 2018-02-01
Publication date: 2020-08-28
Anticipated expiration: 2038-02-01
Also published as: CN108366278A

Abstract

The embodiment of the invention provides a method and a device for realizing user interaction in video playing, wherein the method comprises the following steps: the method comprises the steps that a client receives on-demand request information of a user for a target video, sends the request information to an on-demand server, receives address information and a time line stream file of the target video fed back by the on-demand server, the time line stream file at least comprises time information, the target video is played on a video playing interface according to the address information of the target video, a preset interaction interface is displayed to the user when the target video is played to each time point in the time information according to the time information in the time line stream file of the target video, interaction information input by the user on the interaction interface is received, the interaction information is sent to the on-demand server, and the interaction information sent by the on-demand server is received and displayed. By applying the scheme provided by the embodiment of the invention, the user interaction mode can be increased in the process of watching the video by the user, and the interactivity of video on demand is improved.

Description

User interaction implementation method and device in video playing

Technical Field

The invention relates to the technical field of multimedia application, in particular to a method and a device for realizing user interaction in video playing.

Background

At present, with the vigorous development of internet videos, video on demand can play corresponding video programs according to the needs of users, thus fundamentally overcoming the defect that users watch television passively in the past, and being favored by users due to the characteristics of higher video playing quality, capability of playing back and the like. In the existing video-on-demand mode, a user cannot participate in the video-on-demand watching process like watching a live video, and no user interaction operation exists.

The existing video processing mainly aims at the processing of the video program production process in the early stage and the video clip in the later stage after the video program production is completed.

However, the inventor finds that the prior art has at least the following problems in the process of implementing the invention:

the existing processing aiming at the video program production in the early stage and the video clip in the later stage after the video program production does not relate to the interactive operation with the user, and in the process of watching the video on demand, if the user has emotional touch on a certain plot or character of the video, the interactive processing with the user is lacked, so that the interactivity in the process of watching the video on demand is poor.

Disclosure of Invention

The embodiment of the invention aims to provide a method and a device for realizing user interaction in video playing, so as to increase user interaction modes in the process of watching videos by users and improve the interactivity of video on demand. The specific technical scheme is as follows:

in order to achieve the above object, an embodiment of the present invention discloses a method for implementing user interaction in video playing, which is applied to a client, and the method includes:

receiving on-demand request information of a user for a target video;

sending the on-demand request information to an on-demand server;

receiving address information and a time line stream file of the target video fed back by the on-demand server, wherein the time line stream file of the target video at least comprises time information; the time line stream file of the target video is acquired by the on-demand server from a pre-stored time line stream file;

playing the target video on a video playing interface according to the address information of the target video;

displaying a preset interactive interface to a user when the target video is played to each time point in the time information according to the time information in the time line stream file of the target video;

receiving interactive information input by a user on the interactive interface, and sending the interactive information to the on-demand server;

and receiving and displaying the interactive information sent by the on-demand server.

Optionally, the time information in the timeline stream file further includes: the duration corresponding to each time point;

the displaying a preset interactive interface to a user when the target video is played to each time point in the time information according to the time information in the time line stream file of the target video comprises:

and displaying a preset interactive interface to a user in the duration corresponding to each time point according to each time point and the corresponding duration when the target video is played to each time point.

Optionally, the step of receiving and displaying the interactive information sent by the on-demand server includes:

and receiving the interactive information sent by the on-demand server, and displaying the interactive information on the video playing interface.

The embodiment of the invention discloses a user interaction realizing method in video playing, which is applied to an on-demand server and comprises the following steps:

receiving on-demand request information of a user for a target video, which is sent by a client;

acquiring address information of the target video according to the on-demand request information;

acquiring a timeline stream file corresponding to the target video from a prestored timeline stream file, wherein the timeline stream file corresponding to the target video at least comprises time information;

feeding back the address information and the time line stream file of the target video to the client;

receiving interactive information sent by the client;

and sending the interaction information received from the client to all clients currently playing the target video for display.

Optionally, the pre-stored timeline stream file is: and processing the stored original video file stream of the target video in advance through a video filter VFC system, extracting a time line stream file corresponding to the target video, and storing the time line stream file in the on-demand server.

Optionally, the step of processing, by a VFC system, an original video file stream of the stored target video in advance, extracting a time line stream file corresponding to the target video, and storing the time line stream file in the on-demand server includes:

acquiring an original video file stream of the stored target video;

sampling preprocessing is carried out on an original video file stream of the target video by using the VFC system;

acquiring an image data stream Sx of the original video file stream; the image data stream Sx is the time point in the original video file stream and the image corresponding to the time point;

matching the acquired image data stream Sx with preset template data by using a video filter VFC algorithm to acquire a scene frame element SFE; the scene frame element SFE includes: time information in the original video file stream and a video clip corresponding to the time information; the time information includes: a point in time corresponding to a video segment;

combining the obtained scene frame elements SFE into a timeline stream file according to a time sequence;

and storing the time line stream file in the on-demand server.

Optionally, the time information in the scene frame element SFE further includes: the duration corresponding to the time point;

the preset template data includes: character images, keywords, dynamic effects and wonderful scene data preset for the target video;

the matching of the acquired image data stream Sx and preset template data by using a video filter VFC algorithm to acquire a scene frame element SFE comprises the following steps:

matching the acquired image data stream Sx with preset character images, keywords, dynamic effects and wonderful scene data by using a video filter VFC algorithm to acquire a scene frame element SFE;

before combining the obtained scene frame elements SFE into a timeline stream file according to a time sequence, the method further includes:

and judging whether redundant data exists in the acquired scene frame element SFE according to the keywords, the character images, the time points in the scene frame element SFE and the corresponding duration, and filtering the redundant data.

In order to achieve the above object, an embodiment of the present invention discloses a device for implementing user interaction in video playing, which is applied to a client, and the device includes:

the first receiving module is used for receiving the on-demand request information of the target video from the user;

the first sending module is used for sending the on-demand request information to an on-demand server;

a second receiving module, configured to receive address information and a timeline stream file of the target video, where the timeline stream file of the target video at least includes time information, and the target video is fed back by the on-demand server; the time line stream file of the target video is acquired by the on-demand server from a pre-stored time line stream file;

the playing module is used for playing the target video on a video playing interface according to the address information of the target video;

the display module is used for displaying a preset interactive interface to a user when the target video is played to each time point in the time information according to the time information in the time line stream file of the target video;

the second sending module is used for receiving the interactive information input by the user on the interactive interface and sending the interactive information to the on-demand server;

and the display module is used for receiving and displaying the interactive information sent by the on-demand server.

Optionally, the time information in the timeline stream file of the target video received by the second receiving module further includes: the duration corresponding to each time point;

the display module is specifically configured to:

Optionally, the display module is specifically configured to:

The embodiment of the invention discloses a user interaction realizing device in video playing, which is applied to an on-demand server and comprises the following components:

the third receiving module is used for receiving the on-demand request information of the user for the target video, which is sent by the client;

the first acquisition module is used for acquiring the address information of the target video according to the on-demand request information;

a second obtaining module, configured to obtain a timeline stream file corresponding to the target video from a pre-stored timeline stream file, where the timeline stream file corresponding to the target video at least includes time information;

the third sending module is used for feeding back the address information and the time line stream file of the target video to the client;

the fourth receiving module is used for receiving the interactive information sent by the client;

and the fourth sending module is used for sending the interactive information received from the client to all clients currently playing the target video for displaying.

Optionally, the apparatus further comprises an audit module;

the auditing module is used for auditing the received interactive information according to a preset rule before sending the interactive information received from the client to all clients currently playing the target video for display;

the fourth sending module is specifically configured to: and sending the interactive information which is received from the client and passes the verification to all the clients currently playing the target video for displaying.

Optionally, the apparatus further comprises: and the file storage module is used for processing the stored original video file stream of the target video in advance through a video filter VFC system, extracting a time line stream file corresponding to the target video, and storing the time line stream file corresponding to the target video in the on-demand server.

Optionally, the file storage module includes:

a third obtaining sub-module, configured to obtain an original video file stream of the stored target video;

the preprocessing submodule is used for sampling and preprocessing an original video file stream of the target video by using the VFC system;

a fourth obtaining submodule, configured to obtain an image data stream Sx of the original video file stream; the image data stream Sx is the time point in the original video file stream and the image corresponding to the time point;

a fifth obtaining sub-module, configured to match the obtained image data stream Sx with preset template data by using a video filter VFC algorithm, and obtain a scene frame element SFE; the scene frame element SFE includes: time information in the original video file stream and a video clip corresponding to the time information; the time information includes: a point in time corresponding to a video segment;

the combination submodule is used for combining the obtained scene frame elements SFE into a time line stream file according to the time sequence;

and the file storage submodule is used for storing the time line stream file in the on-demand server.

Optionally, the time information in the scene frame element SFE acquired by the fifth acquiring sub-module further includes: the duration corresponding to the time point;

the fifth obtaining sub-module is specifically configured to:

the file storage module further comprises: a data filtering submodule;

and the data filtering submodule is used for judging whether redundant data exists in the acquired scene frame element SFE according to the keywords, the character images, the time points in the scene frame element SFE and the corresponding duration before the acquired scene frame element SFE is combined into a time line stream file according to the time sequence, and filtering the redundant data.

In another aspect of the implementation of the present invention, there is also provided a client device, which is characterized by comprising a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory complete communication with each other through the communication bus;

a memory for storing a computer program;

the processor is configured to implement any of the method steps of the first aspect disclosed in the embodiment of the present invention, applied to the client, when executing the program stored in the memory.

In another aspect of the implementation of the present invention, there is also provided a live video server, which is characterized by comprising a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory complete communication with each other through the communication bus;

a memory for storing a computer program;

the processor is configured to implement any of the method steps of the first aspect disclosed in the embodiments of the present invention, as applied to the on-demand server, when executing the program stored in the memory.

In yet another aspect of the present invention, there is also provided a computer-readable storage medium, which stores instructions that, when executed on a computer, cause the computer to execute any one of the above-mentioned methods for implementing user interaction in video playing.

In another aspect of the present invention, an embodiment of the present invention further provides a computer program product containing instructions, which when run on a computer, causes the computer to execute any one of the above-mentioned methods for implementing user interaction in video playing.

The embodiment of the invention provides a method and a device for realizing user interaction in video playing, wherein in the process of carrying out target video on demand at a client, on-demand request information is sent to an on-demand server; after receiving the on-demand request information, the on-demand server acquires the address information of the target video, acquires a time line stream file corresponding to the target video from a pre-stored time line stream file, and then feeds back the address information of the target video and the time line stream file containing the time information to the client; after receiving information fed back by an on-demand server, a client plays a target video on a video playing interface according to address information and a time line stream file of the target video fed back by the on-demand server, displays a preset interactive interface to a user when the target video is played to each time point of time information in the time line stream file of the target video, receives interactive information input by the user on the interactive interface, and sends the interactive information to the on-demand server; the on-demand server receives the interactive information sent by the client and then sends the interactive information received from the client to all the clients currently playing the target video for display, so that a user interaction mode is increased in the process of watching the video by a user, and the interactivity of video on demand is improved. Of course, it is not necessary for any product or method of practicing the invention to achieve all of the above-described advantages at the same time.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below.

Fig. 1 is a flowchart of a first method for implementing user interaction during video playing according to an embodiment of the present invention;

fig. 2 is a flowchart of a user interaction implementing method in a second video playing according to an embodiment of the present invention;

fig. 3 is another flowchart of a user interaction implementing method in a second video playing according to an embodiment of the present invention;

FIG. 4 is a flowchart of a method for retrieving and storing a video timeline stream file according to an embodiment of the present invention;

FIG. 5 is another flow chart of a method for retrieving and storing a video timeline stream file in an embodiment of the present invention;

fig. 6 is a schematic structural diagram of a first apparatus for implementing user interaction according to an embodiment of the present invention;

fig. 7 is a schematic structural diagram of a second user interaction implementing device according to an embodiment of the present invention;

fig. 8 is another schematic structural diagram of a second user interaction implementing device according to an embodiment of the present invention;

FIG. 9 is a schematic structural diagram of a file storage module according to an embodiment of the present invention;

FIG. 10 is a diagram illustrating another structure of a file storage module according to an embodiment of the present invention;

fig. 11 is a schematic structural diagram of a client device according to an embodiment of the present invention;

fig. 12 is a schematic structural diagram of a live video server according to an embodiment of the present invention.

Detailed Description

The technical solution in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention.

Fig. 1 is a first method for implementing user interaction in video playing, which is applied to a client, and includes:

s110, receiving the request information of the user for the target video on demand.

In the embodiment of the invention, when a user needs to request the video at the client, the user directly requests the target video at the client, the client receives the request information of the user for requesting the target video, and the request information can include the video identifier of the target video.

The client in the embodiment of the present invention may be a handheld device such as a mobile phone, a tablet computer, a palmtop computer, and the like, and may also be a terminal device such as a desktop computer, and a specific form of the client that may be targeted by the embodiment of the present invention is not limited herein.

And S120, sending the on-demand request information to an on-demand server.

In the embodiment of the invention, after receiving the on-demand request information of the target video from the user, the client transmits the on-demand request information and the video identifier of the target video contained in the on-demand request information to the on-demand server together.

The on-demand server in the embodiment of the present invention may be a CMS (Content Management System) movie server, or may be another server capable of implementing video on demand.

S130, receiving the address information and the time line stream file of the target video fed back by the on-demand server; the time line stream file of the target video at least comprises time information; and the time line stream file of the target video is acquired by the on-demand server from the pre-stored time line stream file.

In the embodiment of the invention, after the client forwards the received on-demand request information of the target video from the user and the video identifier of the target video contained in the on-demand request information to the on-demand server, the client receives the address information and the time line stream file corresponding to the target video fed back by the on-demand server. The address information corresponding to the target video may be: storing address information of original data of the target video; the time line stream file corresponding to the target video is: the method comprises the steps that the on-demand server obtains a pre-stored time line stream file, and the time line stream file at least comprises time information.

S140, according to the address information of the target video, the target video is played on a video playing interface.

In the embodiment of the present invention, the client may play the target video on the video playing interface of the client according to the address information of the target video fed back by the on-demand server, that is, according to the address information of the original data of the target video.

S150, according to the time information in the time line stream file of the target video, when the target video is played to each time point in the time information, displaying a preset interactive interface for a user.

Optionally, the time information in the timeline stream file includes: the time point.

In the embodiment of the invention, the client detects the playing progress of the target video in real time while playing the target video, and when the target video is played to each time point in the timeline stream file corresponding to the target video, a preset interactive interface is displayed for a user. The preset interactive interface may be an interactive interface made in advance at the client side, and the interface may include an input area, an expression area, an article area, and the like.

In other embodiments, the time information in the timeline stream file includes, in addition to all time points, the duration corresponding to each time point. In this case, the presenting of the preset interactive interface to the user may include:

and displaying a preset interactive interface to a user in the duration corresponding to each time point according to each time point and the corresponding duration when the target video is played to each time point. That is to say, when the video is played to a time point, a preset interactive interface starts to be displayed, the displayed duration is the duration, and after the duration is displayed, the interactive interface can be closed and is not displayed any more.

And S160, receiving the interactive information input by the user on the interactive interface, and sending the interactive information to the on-demand server.

In the embodiment of the present invention, the timeline stream file may further include information such as a highlight scene, a dynamic effect, a keyword, and a commodity, and when the target video is played to a certain time point in the time information in the timeline stream file, the user may perform comment or screenshot forwarding and the like in the interactive interface displayed in the duration corresponding to the time point according to the highlight scene and the dynamic effect, participate in a fan interaction and the like according to the keyword, and may participate in purchasing or cooperate with a merchant according to the commodity, and may also perform interactive operations such as comment and send flowers for a person, a scene, a dynamic effect and the like in the interactive interface displayed in the duration corresponding to the time point. The preset interactive interface display position may be at any displayable position of the video playing interface, which is not limited in the embodiment of the present invention. Of course, the present application is only described in the above implementation manner, and the content included in the timeline stream file and the information and manner of interaction performed by the user in the interactive interface in practical applications are not limited thereto.

The client receives the interactive information input by the user on the interactive interface, wherein the interactive information can be any one of the interactive information, and then forwards the received interactive information to the on-demand server.

And S170, receiving and displaying the interactive information sent by the on-demand server.

In the embodiment of the invention, after receiving the interactive information sent by the on-demand server, the client can display the interactive information on the video playing interface. The display mode of the interactive information on the video playing interface may be in a bullet screen mode in the video playing interface, may also be in a window mode at other positions of the playing interface, and may also be in a cladding mode in the playing interface.

On the basis of the user interaction implementation method in video playing shown in fig. 1, in an optional embodiment of the present invention, the on-demand server sends interaction information received from each client that is watching the same video to the clients for display. That is to say, after the client receives the interactive information sent by the on-demand server, the interactive information displayed on the video playing interface includes not only the interactive information sent by the client itself, but also the interactive information sent by other clients. In this way, the user who sees the displayed interactive information can also comment again according to the interactive information displayed on the video playing interface.

The first method for implementing user interaction in video playing provided by the embodiments of the present invention is to send a video-on-demand request message to a video-on-demand server during a process of a client performing a target video-on-demand, play a target video on a video playing interface according to address information and a timeline stream file of the target video fed back by the video-on-demand server after receiving information fed back by the video-on-demand server, display a preset interaction interface to a user when the target video is played to each time point of time information in the timeline stream file of the target video, receive interaction information input by the user on the interaction interface, send the interaction information to the video-on-demand server, display the interaction information on the video playing interface after receiving the interaction information sent by the video-on-demand server, and implement an additional user interaction mode during a process of watching a video by the user, the interactivity of the video on demand is improved.

Fig. 2 is a method for implementing user interaction in a second video playing process, which is applied to an on-demand server, and the method may include:

s210, receiving the request information of the user for the target video on demand sent by the client.

In the embodiment of the invention, after receiving the on-demand request information of the target video, the client forwards the on-demand request information containing the target video identifier to the on-demand server, and the on-demand server receives the on-demand request information of the target video, sent by the client, of the user containing the target video identifier.

S220, according to the request information, obtaining the address information of the target video.

In the embodiment of the invention, after receiving the on-demand request information which is sent by the client and contains the target video identification, the on-demand server searches and acquires the address information corresponding to the target video according to the video identification of the target video. In the embodiment of the present invention, according to the video identifier of the target video, the address information corresponding to the target video may be searched in the local database of the on-demand server, and the address information corresponding to the target video may also be acquired from other servers.

And S230, acquiring a time line stream file corresponding to the target video from a pre-stored time line stream file, wherein the time line stream file corresponding to the target video at least comprises time information.

In the embodiment of the invention, after receiving on-demand request information which is sent by a client and contains a target video identifier, an on-demand server searches and obtains address information of the target video, and at the same time, behind or in front of the address information, searches and obtains a time line stream file corresponding to the target video from a pre-stored time line stream file according to the video identifier of the target video; and the time line stream file corresponding to the target video at least comprises time information.

An optional implementation manner is that, according to the video identifier of the target video, whether the video identifier has a corresponding timeline stream file is searched in a local database of an on-demand server, and if the video identifier has the corresponding timeline stream file, the timeline stream file corresponding to the video identifier is obtained, that is, the timeline stream file corresponding to the target video. The pre-stored timeline stream file may be pre-stored in a local database by the on-demand server, or pre-stored in a database of the on-demand server by another server capable of realizing video on-demand. The specific method for acquiring the pre-stored timeline stream file will be described in detail below, and will not be described herein again. Of course, the present application is only described in the above implementation manner, and the manner of acquiring the timeline stream file pre-stored in the actual application and the timeline stream file corresponding to the target video is not limited to this.

And S240, feeding back the address information and the time line stream file of the target video to the client.

And after the on-demand server acquires the address information and the time line stream file of the target video, feeding back the acquired address information and the time line stream file of the target video to the client. If the on-demand server does not find the timeline stream file corresponding to the video identifier in the local database in step S230, the on-demand server only feeds back the acquired address information of the target video to the client.

And S250, receiving the interactive information sent by the client.

In the embodiment of the invention, after the on-demand server feeds back the address information and the time line stream file of the target video to the client, the client plays the target video on a video playing interface according to the address information of the target video. When the target video is played to each time point in the time information in the corresponding time line stream file, a preset interactive interface is displayed to a user, then the interactive information input by the user on the interactive interface is forwarded to the on-demand server, and the on-demand server receives the interactive information sent by the client.

And S260, sending the interactive information received from the client to all the clients currently playing the target video for display.

In an implementation manner of the embodiment of the present invention, after receiving the interactive information sent by the client, the on-demand server feeds back the interactive information to all clients currently playing the target video in real time for display, and the content included in the interactive information and the display manner of the interactive information by the client are described in detail in the first embodiment above, and are not described again here.

The second method for implementing user interaction in video playing provided by the embodiment of the present invention is that after receiving a request message for a target video from a user, which is sent by a client and contains a target video identifier, an on-demand server obtains address information of the target video, obtains a timeline stream file corresponding to the target video from a pre-stored timeline stream file, then feeds back the address information of the target video and the timeline stream file containing the time information to the client, the client plays the target video on a video playing interface according to the address information of the target video, when the target video is played to each time point in the time information in the timeline stream file corresponding to the target video, a preset interactive interface is displayed to the user, and then the interactive information input by the user on the interactive interface is forwarded to the on-demand server, and the on-demand server receives the interactive information sent by the client and finally sends the interactive information received from the client to all clients currently playing the target video for display, so that a user interaction mode is increased in the process of watching the video by the user, and the interactivity of video on demand is improved.

Fig. 3 is another method for implementing user interaction in a second video playback, which is applied to an on-demand server, according to an embodiment of the present invention, and steps S310 to S350 in the method are respectively the same as steps S210 to S250 in the method shown in fig. 2, and the present invention is not described herein again.

And S360, auditing the received interactive information according to a preset rule.

In an implementation manner of the embodiment of the present invention, referring to the embodiment shown in fig. 1, the client receives the interaction information input by the user on the interaction interface, where the interaction information may be comments, flowers, and the like performed on characters, scenes, dynamic effects, and the like. After receiving the interactive information sent by the client, the on-demand server may check the comments in the interactive information according to a preset rule. The mode of performing the review according to the preset rule may be to review whether the comment has an inappropriate word, an illiterate speech, or the like. Of course, the present application is only described in the foregoing implementation manner, and the manner of auditing the interaction information according to the preset rule in practical application is not limited to this.

And S370, sending the interactive information which is received from the client and passes the verification to all the clients currently playing the target video for displaying.

In step S360, after the on-demand server checks the received interactive information according to a preset rule, the on-demand server sends the interactive information received from the client that passes the check to all clients currently playing the target video for display; and filtering the interaction information received from the client terminal, which is not passed by the audit.

In another method for implementing user interaction in video playing according to the second embodiment of the present invention, an on-demand server receives an on-demand request message for a target video from a user, which is sent by a client and includes a target video identifier, obtains address information of the target video, obtains a timeline stream file corresponding to the target video from a pre-stored timeline stream file, and then feeds back the address information of the target video and the timeline stream file including the time information to the client, the client plays the target video on a video playing interface according to the address information of the target video, when the target video is played to each time point in time information in the timeline stream file corresponding to the target video, a preset interactive interface is displayed to the user, and then the interactive information input by the user on the interactive interface is forwarded to the on-demand server, and the on-demand server receives the interactive information sent by the client and finally sends the interactive information received from the client to all clients currently playing the target video for display, so that a user interaction mode is increased in the process of watching the video by the user, and the interactivity of video on demand is improved. And the on-demand server checks the received interactive information and sends the checked interactive information to all clients currently playing the target video for display, so that the interactive information seen by the client users is more civilized and the user experience is better.

Fig. 4 is a method for acquiring and storing a video timeline stream file according to an embodiment of the present invention, which may include:

s410, obtaining the stored original video file stream of the target video.

In the embodiment of the present invention, the CMS movie server is configured to store data for APP access of a client or other application. If the on-demand server is a CMS movie server, the original video file stream saved for the target video may be obtained from other servers capable of implementing video on demand, and if the on-demand server is a general server capable of implementing video on demand, the original video file stream saved for the target video may be directly obtained from the server capable of implementing video on demand.

And S420, sampling and preprocessing the original video file stream of the target video by using a video filter VFC system.

In the embodiment of the present invention, a video Filter vfc (video Filter center) system may perform sampling preprocessing on the acquired original video file stream of the saved target video. The sampling preprocessing method may be to perform frame-by-frame image detection on data corresponding to an original video file stream of a target video, and perform extraction according to a preset time interval, where the preset time interval in practical application may be set according to practical requirements, for example, set to be extraction once in 5 seconds or 10 seconds.

S430, acquiring an image data stream Sx of the original video file stream; the image data stream Sx is: and time points and corresponding images in the original video file stream.

In the embodiment of the invention, the VFC system is used for sampling and preprocessing the original video file stream of the target video, the obtained image frame data stream is expressed as Sx, the Sx represents one scene in a series of scenes of the original video, and the image data stream Sx is the time point in the original video file stream and the image corresponding to the time point.

S440, matching the acquired image data stream Sx with preset template data by using a video filter VFC algorithm to acquire a scene frame element SFE; the scene frame element SFE includes: time information in the original video file stream and a video clip corresponding to the time information; the time information includes: corresponding to the point in time of the video segment.

Optionally, the preset template data includes: character images, keywords, dynamic effects and wonderful scene data preset for the target video;

then, the matching the acquired image data stream Sx with preset template data by using a video filter VFC algorithm to acquire a scene frame element SFE includes:

in practical applications, the preset template data may include the character image, the keyword, the animation and the highlight scene data preset for the target video, and those skilled in the art may add required data, such as commodities, according to the needs.

And matching the acquired image data stream Sx with preset character images, keywords, dynamic effects and wonderful scene data by using a video filter VFC algorithm to acquire a scene frame element SFE. One implementation may be that the video filter VFC algorithm includes a plurality of other algorithms, such as person identification, article identification, and the like, and may use a person identification algorithm in the video filter VFC algorithm to identify persons in the image in the acquired image data stream Sx and a person image preset in the template data one by one, and match the image data; and identifying the objects in the image in the acquired image data stream Sx and the preset scene objects in the template data one by using an object identification algorithm in a video filter VFC algorithm, and matching the image data.

An implementation manner of the embodiment of the present invention may be that, after matching the acquired image data stream Sx with preset character images, keywords, animation, and highlight Scene data by using a video filter VFC algorithm, corresponding video segments are generated from image data with a higher matching degree between the image data stream Sx and preset template data in the same Scene or similar scenes in a close time interval and corresponding time of the image data, and the image data is used as Scene Frame Elements (SFE), and then the Scene frame elements SFE may include: time information and a video clip corresponding to the time information in an original video file stream, wherein the time information may include: corresponding to the point in time of the video segment.

S450, combining the obtained scene frame elements SFE into a time line stream file according to the time sequence.

Optionally, the time information in the scene frame element SFE further includes: and the time point of the video clip corresponds to the duration.

An implementation manner of the embodiment of the present invention may be that, for the obtained scene frame elements SFE, the time point of the obtained scene frame elements SFE may be used as a mark to obtain the duration corresponding to each scene frame element, the scene frame elements SFE are sorted according to the time point of each scene frame element SFE, and all the sequenced scene frame elements SFE are placed in one file to be combined into a timeline stream file, so that the timeline stream file includes the time information and the video clip corresponding to the time information, where the time information includes the time point and the duration corresponding to the time point.

Another implementation manner of the embodiment of the present invention may be that, for the obtained scene frame elements SFE, each scene frame element SFE may be encoded by using a time point thereof as a tag, and characters, objects, durations, keywords, dynamic effects, and the like in a video segment corresponding to the scene frame element are extracted, that is, a sequence frame data stream of a current scene frame element is extracted, and then sorted according to the time point of each scene frame element SFE, and all the sequenced scene frame elements SFE are placed in one file to be combined into a timeline stream file, so that the timeline stream file includes sequence frame data of time information, and video segments, characters, objects, durations, keywords, dynamic effects, and the like corresponding to the time information. For specific application of the timeline stream file, reference may be made to an embodiment of a user interaction implementation method in video playing according to the first embodiment of the present invention, and details are not described here again.

And S460, storing the time line stream file in the on-demand server.

In the embodiment of the invention, if the on-demand server is a CMS film server, time line stream files acquired from other servers capable of realizing video on-demand are stored in the CMS film server; if the on-demand server is a server capable of realizing video on-demand generally, the acquired time line stream file can be directly stored in a database of the server.

In practical application, for the combined timeline stream file, one storage manner may be to serialize the timeline stream file, and then store the serialized data, where one storage format may be:

wherein, data is a code, time is a time point, duration is a duration, name is a name of a person or an article, url is a resource locator address, and count is a counter.

It is to be understood that the present application is only described in the above embodiments, and the format and the manner of serialization and storage of the timeline stream file in practical applications are not limited thereto.

The method for acquiring and storing the video timeline stream file in the embodiment of the invention comprises the steps of firstly preprocessing an original video file stream of a target video by using a video filter VFC system to acquire an image data stream Sx, then matching the acquired image data stream Sx with preset character images, keywords, dynamic effects and highlight scene data by using a video filter VFC algorithm to acquire a scene frame element SFE, further generating the timeline stream file corresponding to the target video, and displaying an interactive interface to a user according to the timeline stream file in the process of video playing of a client, thereby increasing a user interactive mode in the process of watching the video by the user and improving the interactivity of video on demand.

Fig. 5 is another method for acquiring and storing a video timeline stream file according to an embodiment of the present invention, where steps S510 to S540, S560, and S570 in the method are respectively the same as steps S410 to S460 in the method shown in fig. 4, and are not described herein again.

S550, judging whether redundant data exist in the obtained scene frame element SFE according to the keywords, the character images, the time points in the scene frame element SFE and the corresponding duration, and filtering the redundant data.

In the embodiment of the present invention, for the obtained scene frame element SFE, whether redundant data exists in the obtained scene frame element SFE may be determined according to a keyword, a character image, a time point in the scene frame element SFE, and a duration corresponding to the time point. One implementation method may be that, according to the time point of each obtained scene frame element SFE and the duration corresponding to the time point, it is determined whether redundant data exists at the time point within the duration, if there is redundancy, the first redundant scene frame element SFE is retained, and other redundant scene frame elements SFE are filtered out. Of course, the present application is only described in the above implementation manner, and the manner of determining whether the scene frame element SFE has redundancy in practical application is not limited to this.

The other method for acquiring and storing the video timeline stream file in the embodiment of the invention comprises the steps of firstly preprocessing an original video file stream of a target video by using a video filter VFC system to acquire an image data stream Sx, then matching the acquired image data stream Sx with preset character images, keywords, dynamic effects and highlight scene data by using a video filter VFC algorithm to acquire a scene frame element SFE, and further generating the timeline stream file corresponding to the target video, wherein an interactive interface can be displayed to a user according to the timeline stream file in the process of video playing of a client, so that a user interactive mode is increased in the process of watching the video by the user, and the interactivity of video on demand is improved.

Corresponding to the foregoing method for implementing user interaction in video playing, in another aspect of the present invention, a device for implementing user interaction in video playing is also provided. Fig. 6 is a schematic structural diagram of a first user interaction implementing apparatus provided in an embodiment of the present invention, which is applied to a client, and the apparatus includes:

a first receiving module 610, configured to receive on-demand request information of a user for a target video;

a first sending module 620, configured to send the on-demand request information to an on-demand server;

a second receiving module 630, configured to receive address information and a timeline stream file of the target video, where the timeline stream file of the target video at least includes time information, and the address information and the timeline stream file are fed back by the on-demand server; the time line stream file of the target video is acquired by the on-demand server from a pre-stored time line stream file;

the playing module 640 is configured to play the target video on a video playing interface according to the address information of the target video;

the display module 650 is configured to display a preset interactive interface to a user according to time information in the timeline stream file of the target video when the target video is played to each time point in the time information;

a second sending module 660, configured to receive the interaction information input by the user on the interaction interface, and send the interaction information to the on-demand server;

and the display module 670 is configured to receive and display the interactive information sent by the on-demand server.

The first user interaction implementation device provided in the embodiments of the present invention sends, in a process of performing a target video on demand at a client, on-demand request information to an on-demand server, plays, in a video playing interface, a target video according to address information and a timeline stream file of the target video fed back by the on-demand server after receiving information fed back by the on-demand server, displays, to a user, a preset interaction interface when the target video is played to each time point of time information in the timeline stream file of the target video, receives interaction information input by the user at the interaction interface, sends the interaction information to the on-demand server, displays, in the video playing interface, the interaction information after receiving the interaction information sent by the on-demand server, and implements an increase in a user interaction mode in a process of viewing a video by the user, the interactivity of the video on demand is improved.

It should be noted that the apparatus according to the embodiment of the present invention is an apparatus corresponding to the user interaction implementation method shown in fig. 1, and all embodiments of the user interaction implementation method shown in fig. 1 are applicable to the apparatus and can achieve the same or similar beneficial effects.

the display module is specifically configured to:

Optionally, the display module is specifically configured to:

Fig. 7 is a schematic structural diagram of a second user interaction implementing device according to an embodiment of the present invention, which is applied to an on-demand server, and includes:

a third receiving module 710, configured to receive on-demand request information of a user for a target video, where the request information is sent by a client;

a first obtaining module 720, configured to obtain address information of the target video according to the on-demand request information;

a second obtaining module 730, configured to obtain, from a pre-stored timeline stream file, a timeline stream file corresponding to the target video, where the timeline stream file corresponding to the target video at least includes time information;

a third sending module 740, configured to feed back address information and a timeline stream file of the target video to the client;

a fourth receiving module 750, configured to receive the interaction information sent by the client;

a fourth sending module 760, configured to send the interaction information received from the client to all clients currently playing the target video for display.

In the second apparatus for implementing user interaction provided in the embodiments of the present invention, after receiving a request message for a target video from a user, the request message including a target video identifier, sent by a client, the on-demand server obtains address information of the target video, obtains a timeline stream file corresponding to the target video from a pre-stored timeline stream file, and then feeds back the address information of the target video and the timeline stream file including the time information to the client, the client plays the target video on a video playing interface according to the address information of the target video, when the target video is played to each time point in the time information in the timeline stream file corresponding to the target video, the client displays a preset interactive interface to the user, and then forwards interactive information input by the user on the interactive interface to the on-demand server, and the on-demand server receives the interactive information sent by the client, and finally, the interactive information received from the client is sent to all the clients currently playing the target video for display, so that the user interaction mode is increased in the process of watching the video by the user, and the video-on-demand interactivity is improved.

It should be noted that the apparatus according to the embodiment of the present invention is an apparatus corresponding to the method for user interaction implementation shown in fig. 2, and all embodiments of the method for user interaction implementation shown in fig. 1 are applicable to the apparatus and can achieve the same or similar beneficial effects.

a third receiving module 810, configured to receive on-demand request information of a user for a target video, where the request information is sent by a client;

a first obtaining module 820, configured to obtain address information of the target video according to the on-demand request information;

a second obtaining module 830, configured to obtain a timeline stream file corresponding to the target video from a pre-stored timeline stream file, where the timeline stream file corresponding to the target video at least includes time information;

a third sending module 840, configured to feed back the address information and the timeline stream file of the target video to the client;

a fourth receiving module 850, configured to receive the interaction information sent by the client;

the auditing module 860 is used for auditing the received interactive information according to a preset rule;

a fourth sending module 870, configured to send the interaction information received from the client that is passed through the audit to all clients currently playing the target video for display.

In another apparatus for implementing user interaction in video playing of the second embodiment, after receiving, by an on-demand server, on-demand request information of a user for a target video, the request information including a target video identifier sent by a client, the on-demand server obtains address information of the target video, obtains a timeline stream file corresponding to the target video from a timeline stream file stored in advance, feeds back the address information of the target video and the timeline stream file including the time information to the client, plays the target video on a video playing interface according to the address information of the target video, displays a preset interaction interface to the user when the target video is played to each time point in time information in the timeline stream file corresponding to the target video, and forwards interaction information input by the user on the interaction interface to the on-demand server, and the on-demand server receives the interactive information sent by the client and finally sends the interactive information received from the client to all clients currently playing the target video for display, so that a user interaction mode is increased in the process of watching the video by the user, and the interactivity of video on demand is improved. And the on-demand server checks the received interactive information and sends the checked interactive information to all clients currently playing the target video for display, so that the interactive information seen by the client users is more civilized and the user experience is better.

It should be noted that the apparatus according to the embodiment of the present invention is an apparatus corresponding to the another method implemented by user interaction shown in fig. 3, and all embodiments of the another method implemented by user interaction shown in fig. 3 are applicable to the apparatus and can achieve the same or similar beneficial effects.

In other embodiments of the present invention, the user interaction implementing apparatus may further include: and the file storage module is used for processing the stored original video file stream of the target video in advance through a video filter VFC system, extracting a time line stream file corresponding to the target video, and storing the time line stream file corresponding to the target video in the on-demand server.

Specifically, as shown in fig. 9, fig. 9 is a schematic structural diagram of a file storage module in an embodiment of the present invention, where the apparatus includes:

a third obtaining sub-module 910, configured to obtain an original video file stream of the stored target video;

a pre-processing submodule 920, configured to perform sampling pre-processing on an original video file stream of the target video by using a video filter VFC system;

a fourth obtaining sub-module 930, configured to obtain an image data stream Sx of the original video file stream; the image data stream Sx is the time point in the original video file stream and the image corresponding to the time point;

a fifth obtaining sub-module 940, configured to match the obtained image data stream Sx with preset template data by using a video filter VFC algorithm, to obtain a scene frame element SFE; the scene frame element SFE includes: time information in the original video file stream and a video clip corresponding to the time information; the time information includes: a point in time corresponding to a video segment;

a combining submodule 950, configured to combine the obtained scene frame elements SFE into a timeline stream file according to a time sequence;

a file storage sub-module 960, configured to store the timeline stream file in the on-demand server.

The file storage module in the embodiment of the invention firstly uses a video filter VFC system to preprocess an original video file stream of the target video to obtain an image data stream Sx, then uses a video filter VFC algorithm to match the obtained image data stream Sx with preset character images, keywords, dynamic effects and wonderful scene data to obtain a scene frame element SFE, and further generates a time line stream file corresponding to the target video, and can show an interactive interface to a user according to the time line stream file in the process of playing the video by a client, thereby increasing a user interactive mode in the process of watching the video by the user and improving the interactivity of video on demand.

It should be noted that the apparatus according to the embodiment of the present invention is an apparatus corresponding to the method for acquiring and storing a video timeline stream file shown in fig. 4, and all embodiments of the method for acquiring and storing a video timeline stream file shown in fig. 4 are applicable to the apparatus and can achieve the same or similar beneficial effects.

Fig. 10 is another schematic structural diagram of a file storage module in an embodiment of the present invention, where the apparatus includes:

a third obtaining sub-module 101, configured to obtain an original video file stream of the stored target video;

the preprocessing submodule 102 is configured to perform sampling preprocessing on an original video file stream of the target video by using a video filter VFC system;

a fourth obtaining submodule 103, configured to obtain an image data stream Sx of the original video file stream; the image data stream Sx is the time point in the original video file stream and the image corresponding to the time point;

a fifth obtaining sub-module 104, configured to match the obtained image data stream Sx with preset template data by using a video filter VFC algorithm, so as to obtain a scene frame element SFE; the scene frame element SFE includes: time information in the original video file stream and a video clip corresponding to the time information; the time information includes: a point in time corresponding to a video segment;

the data filtering sub-module 105 is configured to, before combining the obtained scene frame elements SFE into a timeline stream file according to a time sequence, determine whether redundant data exists in the obtained scene frame elements SFE according to the keywords, the character images, time points in the scene frame elements SFE and duration corresponding to the time points, and filter the redundant data;

a combining submodule 106, configured to combine the obtained scene frame elements SFE into a timeline stream file according to a time sequence;

and the file storage submodule 107 is configured to store the timeline stream file in the on-demand server.

In the file storage module in the embodiment of the invention, firstly, a video filter VFC system is used for preprocessing an original video file stream of the target video to obtain an image data stream Sx, then, a video filter VFC algorithm is used for matching the obtained image data stream Sx with preset character images, keywords, dynamic effects and wonderful scene data to obtain a scene frame element SFE, and further, a time line stream file corresponding to the target video is generated, and an interactive interface can be displayed to a user according to the time line stream file in the process of playing the video at a client, so that a user interactive mode is increased in the process of watching the video by the user, and the interactivity of video on demand is improved.

It should be noted that the apparatus according to the embodiment of the present invention is an apparatus corresponding to the another method for acquiring and storing a video timeline stream file shown in fig. 5, and all embodiments of the another method for acquiring and storing a video timeline stream file shown in fig. 5 are applicable to the apparatus and can achieve the same or similar beneficial effects.

Fig. 11 is a schematic structural diagram of the client device provided in the embodiment of the present invention, and includes a processor 111, a communication interface 112, a memory 113, and a communication bus 114, where the processor 111, the communication interface 112, and the memory 113 complete mutual communication through the communication bus 114;

a memory 113 for storing a computer program;

the processor 111, when executing the program stored in the memory 113, implements the following steps:

receiving on-demand request information of a user for a target video;

sending the on-demand request information to an on-demand server;

The client device provided by the embodiment of the invention has the advantages that in the process of carrying out target video-on-demand by the client, sending request information to the on-demand server, receiving the information fed back by the on-demand server, according to the address information and the time line stream file of the target video fed back by the on-demand server, playing the target video on a video playing interface, when the target video is played to each time point of the time information in the time line stream file of the target video, displaying a preset interactive interface to a user, receiving interactive information input by the user on the interactive interface, and sends the interactive information to the on-demand server, after receiving the interactive information sent by the on-demand server, and displaying the interactive information on the video playing interface, so that a user interaction mode is increased in the process of watching the video by the user, and the interactivity of video on demand is improved.

Fig. 12 is a schematic structural diagram of a live video server according to an embodiment of the present invention, and includes a processor 121, a communication interface 122, a memory 123 and a communication bus 124, where the processor 121, the communication interface 122, and the memory 123 complete communication with each other through the communication bus 124;

a memory 123 for storing a computer program;

the processor 121, when executing the program stored in the memory 123, implements the following steps:

receiving interactive information sent by the client;

In the live video broadcast server provided by the embodiment of the invention, after receiving the on-demand request information of the target video from the user, which is sent by the client and contains the target video identifier, of the target video, the on-demand server obtains the address information of the target video, obtains the time line stream file corresponding to the target video from the pre-stored time line stream file, then feeds back the address information of the target video and the time line stream file containing the time information to the client, the client plays the target video on the video play interface according to the address information of the target video, when the target video is played to each time point in the time information in the time line stream file corresponding to the target video, the preset interactive interface is displayed to the user, then the interactive information input by the user on the interactive interface is forwarded to the on-demand server, and the on-demand server receives the interactive information sent by the client, and finally, the interactive information received from the client is sent to all the clients currently playing the target video for display, so that the user interaction mode is increased in the process of watching the video by the user, and the video-on-demand interactivity is improved.

The communication bus mentioned in the electronic device may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The communication bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown, but this does not mean that there is only one bus or one type of bus.

The communication interface is used for communication between the electronic equipment and other equipment.

The Memory may include a Random Access Memory (RAM) or a non-volatile Memory (non-volatile Memory), such as at least one disk Memory. Optionally, the memory may also be at least one memory device located remotely from the processor.

The Processor may be a general-purpose Processor, and includes a Central Processing Unit (CPU), a Network Processor (NP), and the like; the device can also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, a discrete Gate or transistor logic device, or a discrete hardware component.

In another embodiment of the present invention, a computer-readable storage medium is further provided, where instructions are stored in the computer-readable storage medium, and when the instructions are executed on a computer, the computer is caused to execute the method for implementing user interaction in video playing described in any of the above embodiments, so as to obtain the same technical effect.

In another embodiment of the present invention, a computer program product containing instructions is further provided, which when run on a computer, causes the computer to execute the method for implementing user interaction in video playing described in any of the above embodiments, so as to obtain the same technical effect.

In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, cause the processes or functions described in accordance with the embodiments of the invention to occur, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, from one website site, computer, server, or data center to another website site, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, Digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that incorporates one or more of the available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., Solid State Disk (SSD)), among others.

It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. The term "comprising", without further limitation, means that the element so defined is not excluded from the group consisting of additional identical elements in the process, method, article, or apparatus that comprises the element.

All the embodiments in the present specification are described in a related manner, and the same and similar parts among the embodiments may be referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, as for the apparatus and device embodiments, since they are substantially similar to the method embodiments, the description is relatively simple, and reference may be made to some descriptions of the method embodiments for relevant points.

The above description is only for the preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention shall fall within the protection scope of the present invention.

Claims

1. A method for realizing user interaction in video playing is characterized in that the method is applied to a client and comprises the following steps:

receiving on-demand request information of a user for a target video;

sending the on-demand request information to an on-demand server;

receiving address information and a time line stream file of the target video fed back by the on-demand server, wherein the time line stream file of the target video at least comprises time information; the time line stream file of the target video is acquired by the on-demand server from a pre-stored time line stream file; the pre-stored timeline stream file is: processing an original video file stream of the stored target video in advance through a video filter VFC system, extracting a time line stream file corresponding to the target video, and storing the time line stream file in the on-demand server;

receiving and displaying the interactive information sent by the on-demand server;

the step of processing the stored original video file stream of the target video in advance through a video filter VFC system, extracting a time line stream file corresponding to the target video, and storing the time line stream file in the on-demand server includes:

acquiring an original video file stream of the stored target video;

and storing the time line stream file in the on-demand server.

2. The method of claim 1, wherein the time information in the timeline stream file further comprises: the duration corresponding to each time point;

3. The method of claim 1, wherein the step of receiving and displaying the interactive information sent by the on-demand server comprises:

4. A user interaction realizing method in video playing is characterized in that the method is applied to an on-demand server and comprises the following steps:

acquiring a timeline stream file corresponding to the target video from a prestored timeline stream file, wherein the timeline stream file corresponding to the target video at least comprises time information; the pre-stored timeline stream file is: processing an original video file stream of the stored target video in advance through a video filter VFC system, extracting a time line stream file corresponding to the target video, and storing the time line stream file in the on-demand server;

receiving interactive information sent by the client;

sending the interactive information received from the client to all clients currently playing the target video for display;

acquiring an original video file stream of the stored target video;

and storing the time line stream file in the on-demand server.

5. The method of claim 4, further comprising, before sending the interaction information received from the client to all clients currently playing the target video for display:

auditing the received interactive information according to a preset rule;

the sending of the interaction information received from the client to all clients currently playing the target video for display includes: and sending the interactive information which is received from the client and passes the verification to all the clients currently playing the target video for displaying.

6. The method of claim 4, wherein the temporal information in the scene frame element SFE further comprises: the duration corresponding to the time point;

7. A user interaction realizing device in video playing is characterized in that the device is applied to a client and comprises:

a second receiving module, configured to receive address information and a timeline stream file of the target video, where the timeline stream file of the target video at least includes time information, and the target video is fed back by the on-demand server; the time line stream file of the target video is acquired by the on-demand server from a pre-stored time line stream file; the pre-stored timeline stream file is: processing an original video file stream of the stored target video in advance through a video filter VFC system, extracting a time line stream file corresponding to the target video, and storing the time line stream file in the on-demand server;

the display module is used for receiving and displaying the interactive information sent by the on-demand server;

the processing is performed on the stored original video file stream of the target video by a video filter VFC system in advance, a time line stream file corresponding to the target video is extracted and obtained, and is stored in the on-demand server, and the processing includes:

acquiring an original video file stream of the stored target video;

and storing the time line stream file in the on-demand server.

8. The apparatus of claim 7, wherein the time information in the timeline stream file of the target video received by the second receiving module further comprises: the duration corresponding to each time point;

the display module is specifically configured to:

9. The apparatus of claim 7, wherein the display module is specifically configured to:

10. A user interaction realizing device in video playing is characterized in that the device is applied to an on-demand server and comprises the following components:

the file storage module is used for processing an original video file stream of the stored target video in advance through a video filter VFC system, extracting a time line stream file corresponding to the target video, and storing the time line stream file corresponding to the target video in the on-demand server;

the fourth sending module is used for sending the interactive information received from the client to all clients currently playing the target video for displaying;

the file storage module comprises:

11. The apparatus of claim 10, further comprising an audit module;

12. The apparatus of claim 10, wherein the time information in the scene frame element SFE obtained by the fifth obtaining sub-module further comprises: the duration corresponding to the time point;

the fifth obtaining sub-module is specifically configured to:

the file storage module further comprises: a data filtering submodule;

13. The client device is characterized by comprising a processor, a communication interface, a memory and a communication bus, wherein the processor and the communication interface are used for realizing mutual communication by the memory through the communication bus;

a memory for storing a computer program;

a processor for implementing the method steps of any of claims 1 to 3 when executing a program stored in the memory.

14. A video live broadcast server is characterized by comprising a processor, a communication interface, a memory and a communication bus, wherein the processor and the communication interface are used for finishing mutual communication through the communication bus by the memory;

a memory for storing a computer program;

a processor for implementing the method steps of any of claims 4 to 6 when executing a program stored in the memory.