WO2017166622A1

WO2017166622A1 - Video playing method, playing terminal and media server

Info

Publication number: WO2017166622A1
Application number: PCT/CN2016/096640
Authority: WO
Inventors: 赵雨; 郭建伟; 李时斌; 牛晓雷; 王若韬
Original assignee: 乐视控股（北京）有限公司; 乐视网信息技术（北京）股份有限公司
Priority date: 2016-03-28
Filing date: 2016-08-25
Publication date: 2017-10-05
Also published as: CN105847998A

Abstract

A video playing method, a playing terminal and a media server. The method comprises: receiving information about a current frame sent by a playing terminal in a paused state, and looking for a pre-set dotted mark associated with the current frame according to the information about the current frame; receiving interaction instruction information occurring in the current frame and being sent by the playing terminal, and looking for an interaction object identifier corresponding to the pre-set dotted mark associated with the current frame according to the interaction instruction information; and generating interaction response data for the interaction object identifier according to the interaction instruction information, and sending the interaction response data back to the playing terminal. Therefore, corresponding interaction response data can be generated for a plot and a character and the like corresponding to the current frame according to an interaction instruction, so that a user can initiate an interaction with a video content at any time without leaving a playing region, and can establish a correlation between the interaction content and the video plot and character.

Description

Video playing method, playing terminal and media server

This application claims priority to Chinese Patent Application No. 201610184398.8, entitled "A Video Playback Method, Playback Terminal, and Media Server", filed on March 28, 2016, the entire contents of which are incorporated by reference. In this application.

Technical field

The present invention relates to the field of video technologies, and in particular, to a video playing method and apparatus.

Background technique

At present, when a user watches a video at a terminal, the existing interactive area and the video playing area are independent of each other, and the user views the video in the video playing area (such as the playing window of the playing terminal), and in the interactive area (such as a comment) District, like area) Enter a comment or like to interact. Especially for mobile terminals such as mobile phones, when the user watches the video in the full screen mode, the user needs to exit the full screen mode to realize the interaction with the video; and the interactive content in the interactive area has no relationship with the video playback progress.

For example, when a user watches a movie with a mobile phone, when the user wants to participate in the interaction, only the interactive area can be called up, and then the interactive content is input in the interactive area, and the user can only view the entire content. The frequency content interacts and cannot interact with the video plot in real time.

Summary of the invention

The embodiment of the invention provides a video playing method, a playing terminal and a media server, which are used to solve the technical problem that real-time interaction with video plots, characters and the like cannot be realized in the prior art.

The embodiment of the invention provides a video playing method, which is applied to a media server, and includes:

Receiving information of the current frame sent by the playing terminal in the suspended playing state, and searching for the preset stria mark associated with the current frame according to the information of the current frame;

Receiving, by the playing terminal, the interaction instruction information that is generated in the current frame, and searching, according to the interaction instruction information, an interaction object identifier corresponding to the preset puncturing mark associated with the current frame;

And generating, according to the interaction instruction information, interaction response data for the interaction object identifier, and returning the interaction response data to the play terminal.

The embodiment of the invention provides a video playing method, which is applied to a playing terminal, and includes:

Initiating a video source acquisition request to the media server to play the obtained video source;

Suspending playback of the video source when a pause control command is detected;

In the pause play state, receiving an interaction instruction input by the user in the play area, generating interaction instruction information according to the interaction instruction, and transmitting the information of the current frame and the interaction instruction information to the media server;

Receiving and displaying the interactive response data generated by the media server according to the interaction instruction information.

An embodiment of the present invention provides a media server, including:

a dot mark search module, configured to receive information about a current frame sent by the play terminal in a pause play state, and search for a preset check mark associated with the current frame according to the information of the current frame;

The interactive object search module is configured to receive the interaction instruction information that is sent by the play terminal and that is generated in the current frame, and search for the interactive object identifier corresponding to the preset check mark associated with the current frame according to the interaction instruction information;

The response data generating module is configured to generate interaction response data for the interactive object identifier according to the interaction instruction information, and return the interaction response data to the playing terminal.

An embodiment of the present invention provides a playback terminal, including:

a data receiving module, configured to initiate a video source acquisition request to the media server, and play the obtained video source;

The instruction monitoring module is configured to pause playing the video source when the pause control command is monitored; and, in the pause play state, receive an interaction instruction input by the user in the play area, and generate an interaction instruction according to the interaction instruction. Information, and transmitting the information of the current frame and the interactive instruction information to the media server;

The interactive response receiving module is configured to receive and display the interactive response data generated by the media server according to the interaction instruction information.

The embodiment of the present invention further provides a non-transitory computer readable storage medium, wherein the non-transitory computer readable storage medium stores computer executable instructions for executing any of the above videos. Play method.

An embodiment of the present invention further provides an electronic device, including: one or more processors; and a memory; wherein the memory stores instructions executable by the one or more processors, the instructions being Set to perform any of the above video playback methods.

Embodiments of the present invention also provide a computer program product comprising a computer program stored on a non-transitory computer readable storage medium, the computer program comprising program instructions, when the program instructions are executed by a computer The computer is caused to perform any of the above video playback methods.

The video playing method, the playing terminal, and the media server provided by the embodiment of the present invention record the interactive object identifier in the video source by using the preset dot mark. When the interactive command information generated by the user in the video playing area is monitored, the current frame may be used according to the current frame. Information and interactive instruction information, find out the interactive object identifier for which the interactive instruction information is targeted, thereby achieving interaction with the Object interaction. Throughout the interaction, users can initiate real-time interactions with video content without leaving the play area or exiting full screen mode.

DRAWINGS

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, a brief description of the drawings used in the embodiments or the prior art description will be briefly described below. Obviously, the drawings in the following description It is a certain embodiment of the present invention, and other drawings can be obtained from those skilled in the art without any creative work.

FIG. 1 is a flowchart of a video playing method according to an embodiment of the present invention;

2 is a flowchart of a video playing method according to an embodiment of the present invention;

3a, 3b, and 3c are schematic diagrams of an interactive interface in an embodiment of the present invention;

4 is a schematic structural diagram of a media server according to an embodiment of the present invention;

FIG. 5 is a schematic structural diagram of a playback terminal according to an embodiment of the present disclosure;

FIG. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.

detailed description

In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the following will be combined The embodiments of the present invention are clearly and completely described in the embodiments of the present invention. It is obvious that the described embodiments are a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.

The embodiment of the invention provides a video playing method, a playing terminal and a media server, which can be applied to a video playing scene. When a user watches a video program at a terminal, it is very desirable to be able to immerse the viewing, especially in some wonderful episodes of the video program. , or the superb acting of some actors, will give users the urge to interact instantly. However, the existing interaction method usually needs to input interactive content in the interactive area set up outside the video playing area, that is, the user needs to leave from the currently immersed watching video program, and then call out the interactive area, and the cumbersome operation will give Users are very inconvenient, especially when users are immersed in full-screen mode, they need to exit full-screen mode and call up the interactive area. Even if the user calls up the interactive area, it can't interact with the exciting episodes or the actors' superb acting in real time, but can only express the interactive content in the form of texts. The real-time and targeted content of the interactive content will be large. discount.

The video playing method, the playing terminal, and the media server provided by the embodiment of the present invention establish an interactive instruction between the video episode corresponding to the current frame, a character, a scene, and the like, by interacting with an interactive instruction input by the user in the video playing area. Correspondence and interaction The instruction generates corresponding interaction response data for the interactive object identifier corresponding to the current frame, so that the user can initiate interaction with the video content at any time without leaving the play area or exiting the full screen mode, and the interactive response data will be associated with the corresponding video plot and character. The association is established, so that the user can directly realize the real-time interaction of the video plot and the character.

In addition, the video playing method, the playing terminal, and the media server provided in the embodiments of the present invention are also applicable to other scenarios in which the video interacts with the video, which is not limited by the present invention.

The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention.

Referring to FIG. 1, an embodiment of the present invention provides a video playing method, including:

S101. Receive information about a current frame that is sent by the playback terminal in a pause play state, and search for a preset check mark associated with the current frame according to the information of the current frame.

S102. Receive interaction instruction information that is sent by the playback terminal in the current frame, and search for an interaction object identifier corresponding to the preset management tag associated with the current frame according to the interaction instruction information.

S103. Generate interaction response data for the interaction object identifier according to the interaction instruction information, and return the interaction response data to the play terminal.

Specifically, in order to ensure that the interactive instruction of the user establishes an interactive association with an interactive object such as a story or a character corresponding to the video, before the video source is sent to the playing terminal for playing, the preset dot tag corresponding to the video source may be created, and the preset dot is set. The tag is used to mark the video source, which can mark the video plot, the characteristics of the target area contained in the video, the relative position of the target area, and so on. The video source may have multiple preset dot markers, and each preset dot marker may be associated with a specific video frame or associated with multiple video frames, for example, for a video story, running through the video playing timeline. A set of video frames can associate a preset dot tag corresponding to the video story to each of the set of video frames.

The preset dot markers of the video source may correspond to one or more interactive object identifiers. The corresponding relationship between the preset check mark and the interactive object identifier may be configured in the preset check mark, or a configuration relationship table may be established, and the one or more interactive object identifiers corresponding to the preset check mark may be found through the configuration relationship table. . The interactive object identifier may be the video scenario identifier, the target identifier, the character identifier, and the like mentioned above, wherein the video episode identifier may be a theme name of the episode, the character identifier may be a character name of the character, an actor name, and the like. The interaction object identifier may adopt different setting manners according to different situations, which is not limited by the embodiment of the present invention.

The S101 can be based on the information of the current frame sent by the playing terminal in the suspended playing state. First find the location of the current frame, and then find the preset dot tag associated with the current frame. For example, the video data in the media server may be retrieved according to the identifier of the video source included in the information of the current frame, the corresponding time point of the current frame on the time axis of the video source playing, or the number of the current frame, and the like, thereby being used in the video data. Finding the position of the current frame; for example, comparing the time point corresponding to the current frame on the time axis with the time point association table carried in the preset dot mark to find the preset dot mark associated with the current frame, wherein The preset check mark associated with the current frame may be one or more.

When the S102 receives the interactive instruction information that is generated in the current frame, the S102 obtains the interactive object identifier corresponding to the preset preset check mark according to the preset check mark associated with the current frame found in S101. S103 will generate interactive response data for the interactive object identifier according to the interaction instruction information and return to the playing terminal.

The video playing method provided by the embodiment of the present invention records the interactive object identifier in the video source by using the preset dot mark. When the interactive command information generated by the user in the video playing area is monitored, the information according to the current frame and the interactive instruction may be used. The information is used to find the identifier of the interactive object to which the interactive instruction information is directed, so that interaction with the interactive object can be realized. Throughout the interaction, users can initiate real-time interactions with video content without leaving the play area or exiting full screen mode.

In an optional embodiment, the interaction instruction information includes coordinates of the interaction instruction, and the interaction object identifier corresponding to the preset check mark associated with the current frame is obtained according to the interaction instruction information, and the method may be:

Determining, according to the information of the current frame, whether the current frame has an associated preset check mark;

Obtaining a target area in the current frame when the current frame has an associated preset hit mark;

Determining whether a coordinate of the interactive instruction exists in a target area in the current frame, and if a coordinate of the interaction instruction exists in a target area in the current frame, searching for a preset management point associated with the current frame Mark the corresponding interactive object ID.

Specifically, the frame picture corresponding to the current frame may be extracted according to the information of the current frame and the target area in the frame picture is identified;

Generating corresponding target area information for the identified target area in the frame picture;

Searching for one or more target area information of the frame picture, whether there is target area information corresponding to the interaction instruction information, for example, by comparing coordinates of the interaction instruction included in the interaction instruction information with the target area The coordinate range of the target area included in the information, determining whether the coordinates of the interactive instruction are included in the coordinate range of the target area, if If yes, the target area is considered to be the target area corresponding to the interaction instruction.

Preferably, by comparing the coordinates of the interaction instruction included in the interaction instruction information with the coordinate range of the target area included in the target area information, determining whether the coordinates of the interaction instruction are included in the coordinate range of the target area, Specifically, the instruction coordinates and the contour coordinates are defined in a unified coordinate system to perform coordinate comparison.

The interactive instruction occurs in the play area, and the picture of the video frame is spread over the entire play area, that is, according to the coordinate conversion, the instruction coordinate of the interactive instruction generated by the user in the play area can be converted into the frame picture of the video frame. As described above, the target area information corresponding to the frame picture includes contour coordinates. Therefore, comparing the converted instruction coordinates with the contour coordinates of each target area information, it can be determined whether the instruction coordinates include Within the contour coordinates, the target area for which the interactive instruction is directed is determined. The interaction of the interactive instruction and the target area into the same coordinate system for judging the correspondence relationship can effectively improve the accuracy of the judgment, thereby facilitating an accurate response to the user's interactive instructions.

It should be noted that the correspondence between the interaction instruction information and the target area information may also be implemented by the playback terminal, and only the contour coordinates included in each target area information corresponding to the current frame are sent to the playback terminal, and the playback terminal performs the conversion. The comparison between the instruction coordinates and the contour coordinates of each target area information is also possible, and the scheme and its variants also belong to the scope of protection of the present invention. Wai.

In this embodiment, the preset dot mark associated with the current frame includes target area information of each target area in the current frame, and the target area information may record the contour feature, the coordinate range, and each target area of the target area. Relative positional relationship and so on. The target area may include a character outline, an item outline, a background outline, and the like, and one or more target areas may be identified for the frame picture.

In addition, the target area in the frame picture may be identified according to the interaction instruction information sent by the monitored playing terminal, wherein the operation of identifying the target area in the frame picture may also be performed by the user who receives the sending of the playing terminal. The execution of the intent to interact begins. The user wants to interact with the intent to monitor whether the user triggers the interactive mode button in the playing terminal. For example, the function button of the playing terminal is provided with a trigger interactive mode button. After the user triggers the button, the S103 can start. The image recognition operation of the frame picture is prepared for interaction when the interactive instruction information is received, thereby making an interactive response faster.

The searching for the target area information corresponding to the interaction instruction information in the one or more target area information of the frame picture refers to searching whether there is a user in the one or more target areas that the user wants to interact with. Object. For example, if the user wants to initiate an interaction for the character A in the current frame, the user will enter an interactive instruction in the target area of the character A, after that, The coordinate can be used as a matching condition to find the target area of the character A corresponding to the interactive instruction input by the user; and if the interactive instruction input by the user does not occur within any target area, the interactive instruction input by the user cannot be found. Target area.

As described above, the preset check mark corresponding to the video source may include information related to each target area, for example, according to the correspondence between the information related to the target area included in the preset dot mark and the identifier of the interactive object. An interactive object identifier matching the searched target area is found. For example, the interactive object identifier matching the contour feature may be searched according to the contour feature of the target area, so that the correspondence between the interaction instruction and the interactive object is established through the target area. In addition, when the matched target object information is matched according to the searched target area information, the range of the searched preset check mark may be a preset check mark at the current frame, or may be a preset check mark associated with the current frame. For example, if the target area is identified as a person, the current frame may be associated with all preset check marks including the person area information in advance, so that the interactive object identifier corresponding to all the preset check marks associated with the current frame may be searched for. The interactive object corresponding to the character area.

In this embodiment, if there are multiple interaction object identifiers corresponding to the interaction instruction information, the interaction response data for the interaction object identifier may be separately generated according to the interaction instruction information; or, according to the Multiple interactive object targets corresponding to interactive instruction information The generating a selection query command transmits the selection query command to the playing terminal, and generates interactive response data for the interactive object identifier selected by the user according to the user selection result returned by the playing terminal.

For example, when the outlines of the characters A and B are recognized in the frame picture of the current frame, and the outline areas of the characters A and B overlap, when the interactive instruction input by the user happens to happen in the overlapping area, the interaction with the above can be found. Two interactive object identifiers corresponding to the instruction information, one is an interactive object identifier including the identifier of the character A, and the other is an interactive object identifier including the identifier of the character B. In this case, according to a preset rule, according to the user input The interactive instructions respectively generate interactive response data for the interactive object identifier containing the identity of the character A and the interactive object identifier containing the identity of the character B. If the rule of interactive response data is selected according to the user selection, the interactive theme that can generate the names of the character A and the character B respectively is sent to the playing terminal for the user to select, and the targeted interactive response data is generated according to the selection returned by the user, thereby More accurately achieve the interactive effects that users expect.

In an optional embodiment, if any target area is not recognized in the current frame, or the interactive instruction input by the user is not targeted to any target area, for example, the interactive instruction does not occur in any target area, the interaction instruction information cannot be matched. Corresponding target area information. In this case, the following processing methods can be used:

When the current frame has an associated preset dot mark, the interactive object identifier corresponding to the preset dot mark associated with the current frame is acquired.

Specifically, it will directly look up whether there is a preset dot tag associated with the current frame. If yes, all the interactive object identifiers corresponding to the found preset dot markers are used as interactive themes, and the interactive response data is generated separately; or the plurality of interactive object identifiers corresponding to the found preset dot markers are generated to generate an interactive theme. Sending to the playing terminal for the user to select, and generating interactive response data for the interactive object identifier selected by the user according to the user's selection; if there is no preset check mark associated with the current frame, the search can continue to be found on the video playing timeline. The preset dot mark closest to the current frame can be generated by querying the user or directly determining it as the found preset dot mark, and continuing the above manner.

It should be noted that the foregoing matching rules, range rules, and the like may be selected or used in combination according to actual conditions, which is not limited by the present invention.

Preferably, in the embodiment of the present invention, the interaction instruction information includes the following parameters:

One or more of command coordinates, clicks, single click duration, sliding direction, number of slides, gesture track, number of presses, press force, and press duration.

The form of the interactive instructions may be different for different terminals. For example, for a touch screen terminal, the interactive instructions will be generated in the form of sliding, pressing, and the like. The media server may preset a correspondence between each parameter in the interactive instruction information and an interaction response manner, for example, a light click instruction corresponding to a point, an upward sliding instruction corresponding to a point, a downward sliding corresponding point, and a light press. Time is 5 per 2s, and so on. In the embodiment of the present invention, the generating the interaction response data for the interaction object identifier according to the interaction instruction information refers to calculating the interaction response data according to the parameter in the interaction instruction information, for example, according to the duration of the pressing or The length of the single-click duration is used to calculate the added value of the number of praises. The longer the length of time, the higher the value of the praise.

In addition, the interactive response data can be used for data statistics in the media server, and the result of the data statistics can be displayed outside the play area or the play area, for example, the total number of clicks received by the character A in the video can be counted, and the like The total number is the sum of the number of likes of all users to character A. Of course, the interactive response data can also be directly returned to the playing terminal for display. For example, when the user continuously presses the character A position, the number of clicks caused by the user's pressing operation is displayed to the user in an animated manner.

Referring to FIG. 2, an embodiment of the present invention provides a video playing method, including:

S201. Initiate a video source acquisition request to the media server, and play the obtained video source.

S202. When the pause control command is monitored, the video source is paused to be played.

S203, in the pause play state, receiving an interaction instruction input by the user in the play area, generating interaction instruction information according to the interaction instruction, and transmitting the information of the current frame and the interaction instruction information to the media server;

S204. Receive interactive response data generated by the media server according to the interaction instruction information and display the data.

In the embodiment of the present invention, the play terminal has a built-in correspondence between the gesture and the response operation of the play terminal, and may include, for example:

Touch gestures, corresponding to the operation of arousing the progress bar and function buttons;

Press the gesture again to correspond to the operation of suspending the currently playing video;

The cursor clicks the pause button, corresponding to the operation of suspending the currently playing video; and so on.

In S202, according to any gesture input by the user corresponding to the operation of suspending the currently playing video, the playing terminal can be switched to the pause playing state.

In the paused play state, the S203 continues to monitor the interactive command input by the user and generates interactive command information, which should be associated with the interactive instruction information preset in the media server. The interaction instruction information in the correspondence between the number and the interactive response mode corresponds to; and the information of the current frame and the information of the interactive instruction are also sent to the media server. The information of the current frame includes: a time point corresponding to the current frame on the playing time axis of the video source, an identifier of the current frame, and the like for identifying a position of the current frame in the video source.

For the touch screen terminal, the 3D touch touch technology can also be used to input and recognize the interactive command in the embodiment. For example, the user can provide three interactive commands to interact with the video content, which are light touch, light press, and heavy press:

Touch is a traditional way, also called click, tap, characterized by small click strength, short click time;

Tap to keep the same strength as tapping, but the contact time is long (>1 second);

Re-pressing is to increase the click strength, and the mobile device gives vibration feedback at the same time, indicating that the strength has been reached.

For the interaction instruction input by the user, S203 generates corresponding interaction instruction information, where the interaction instruction information includes: instruction coordinates, click times, single click duration, sliding direction, number of slides, gesture track, number of presses, pressing force, Press one or more parameters in the duration. When the user inputs an interactive command in the play area, the frame corresponding to the current frame is drawn. The face is full or proportionally displayed in the play area, so the coordinates on the screen or the coordinates in the play area can be converted to the coordinates in the frame picture according to the interactive command input by the user, and the converted coordinates are As the instruction coordinate of the interactive instruction.

The interaction response data in S204 can be displayed in multiple ways, such as displaying the interactive theme in the interactive area, or displaying the interactive theme of interest according to the user's request. Preferably, S204 includes:

Receiving the interaction response data returned by the media server, and displaying an interaction animation included in the interaction response data in a corresponding position of the play area according to the instruction coordinates in the interaction instruction information.

According to the interaction instruction input by the user in the play area, S204 sends the interactive instruction to the media server in real time, and the generated interactive response data is returned to the play area for display by the media server's judgment, calculation, etc., in order to realize In order to facilitate the user to visually see the interaction result, in the embodiment, the interaction response data includes an interaction animation, and the interaction animation will display the interaction result through a predetermined animation form, for example, when the interaction When the command is lightly pressed for 5 seconds, the interactive response data obtained by the media server is calculated as 5 praises, and the animations of the five red hearts are displayed in the play area. Preferably, the interactive animation can be displayed around the coordinates of the interactive instruction in the play area to indicate Animations are generated in response to interactive instructions to enhance the user's interactive experience.

The video playing method provided in this embodiment can be applied to the playing terminal, and the interaction instruction input by the user in the playing area is monitored, and the interactive instruction information is generated and sent to the media server, so that the media server can according to the interactive instruction information. The calculation generates interactive response data. The user can obtain the interactive response data after inputting the interactive instruction in the play area, and the interactive operation of the video content can be realized without leaving the play area, and the interactive response data can be displayed in the play area in the form of interactive animation, and the user no longer needs to adjust The interactive area is used to input and view interactive content, realizing real-time interaction.

In the following, a detailed description of the embodiment will be made by taking a user watching a movie and praising the main character B in the process of watching the movie to realize the video interaction.

Referring to FIG. 3a, currently the state of full-screen playback, the user thinks that the emotions conveyed by the eyes of the actor B in the current picture are very accurate, and the acting skills are superb, the user can tap the screen of the mobile phone to evoke the progress bar and function buttons of the playing terminal; as shown in FIG. 3b After the user touches the pause button, the video is paused; after that, the user taps the trigger interaction mode button (not shown), at this time, the playback terminal sends the information of the current frame to the media server, such as the current frame. When the playing time is 00:30:25, the media server can find the frame picture corresponding to the current frame according to the playing time of the current frame, and the found frame picture will be the same as the currently displayed picture in the mobile phone screen, and the media server finds the same. The frame picture performs image recognition, and recognizes that the frame picture contains two character outlines, and the play terminal receives an interactive instruction that the user inputs a tap for 10 seconds in the face of the actor B in the play area by listening, and the interaction instruction is The corresponding interactive instruction information is sent to the media server, and the instruction coordinates of the media server finding the interactive instruction are included in the outline coordinates of one of the character outlines, and then preset corresponding to the movie according to the found feature of the character outline. The dot mark matches the interactive object identifier including the actor B's identifier. At this point, the media server completes the correspondence between the interactive command and the interactive object identifier; then, the media server continues to input the "light tap 10s" interactive command input by the user. According to the preset calculation rule, the interactive result of calculating the interaction instruction is 5 praises, and the interaction result is associated with the interaction object identifier including the identifier of the actor B, and generates 5 interactive responses for the actor B. Data, the media server will generate interactive results according to the predetermined animation template. The interactive animation of the red heart in turn is sent to the playing terminal; as shown in FIG. 3c, the playing terminal displays the interactive animation in the vicinity of the screen coordinates of the interactive command according to the instruction coordinates of the interactive instruction. The user can see the interactive animation of five red hearts in the head position of the actor B that he taps, so as to know the interaction result caused by the interactive instruction.

Throughout the interaction process, the user does not need to exit the full screen mode, and can interact with the actors or plots in the movie in real time, and the interactive results can be visually displayed in the play area, interacting At the end, the user simply clicks the play button again to continue watching the movie, and then repeats the interaction process if a new person or plot is desired to be interacted with.

Referring to FIG. 4, an embodiment of the present invention provides a media server, including:

The dot mark search module 11 is configured to receive information about a current frame sent by the play terminal in a pause play state, and search for a preset check mark associated with the current frame according to the information of the current frame;

The interactive object search module 12 is configured to receive the interaction instruction information that is sent by the play terminal and that is generated in the current frame, and search for the interactive object identifier corresponding to the preset check mark associated with the current frame according to the interaction instruction information. ;

The response data generating module 13 is configured to generate interaction response data for the interactive object identifier according to the interaction instruction information, and return the interaction response data to the playing terminal.

In an optional embodiment, the interactive object search module 12 is specifically configured to:

Determining whether the coordinates of the interactive instruction are present in a target area in the current frame, And if the coordinate of the interaction instruction exists in the target area in the current frame, searching for an interaction object identifier corresponding to the preset puncturing mark associated with the current frame;

The interactive instruction information includes coordinates of the interactive instruction.

The media server provided by the embodiment of the present invention records the interaction object identifier in the video source by using the preset dot mark. When the user interacts with the instruction information generated in the video play area, the information according to the current frame and the information of the interactive instruction may be used. And finding an identifier of the interaction object targeted by the interaction instruction information, so as to implement interaction with the interaction object. Throughout the interaction, users can initiate real-time interactions with video content without leaving the play area or exiting full screen mode.

Referring to FIG. 5, an embodiment of the present invention provides a playback terminal, including:

The data receiving module 21 is configured to initiate a video source acquisition request to the media server, and play the obtained video source;

The instruction monitoring module 22 is configured to pause playing the video source when the pause control instruction is monitored; and, in the pause play state, receive an interaction instruction input by the user in the play area, and generate an interaction according to the interaction instruction. Commanding information, and transmitting information of the current frame and the interactive instruction information to the media server;

The interactive response receiving module 23 is configured to receive and display the interactive response data generated by the media server according to the interaction instruction information.

Specifically, the instruction monitoring module 22 can switch the playing terminal to the pause playing state according to any gesture input by the user corresponding to the operation of suspending the currently playing video.

In the paused play state, the instruction monitoring module 22 continues to listen to the interactive instruction input by the user and generates interactive instruction information, and the interactive instruction information should be in correspondence with each parameter and the interactive response mode in the interactive instruction information preset in the media server. The interactive instruction information corresponds to; and the information of the current frame and the information of the interactive instruction are also sent to the media server. The information of the current frame includes: a time point corresponding to the current frame on the playing time axis of the video source, an identifier of the current frame, and the like for identifying a position of the current frame in the video source.

For the interaction instruction input by the user, the instruction monitoring module 22 generates corresponding interaction instruction information, where the interaction instruction information includes: instruction coordinates, click times, and single click duration One or more parameters of the interval, the sliding direction, the number of slides, the gesture track, the number of presses, the pressing force, and the pressing duration. When the user inputs an interactive instruction in the play area, since the frame picture corresponding to the current frame is full or proportionally displayed in the play area, the coordinates on the screen or the coordinates in the play area may be converted according to the interactive instruction input by the user. It is the coordinates in the frame picture, and the converted coordinates are used as the instruction coordinates of the interactive instruction.

In an optional embodiment, the interaction response receiving module 23 is specifically configured to:

The interactive response receiving module 23 sends the interactive instruction to the media server in real time according to the interaction instruction input by the user in the playing area, and the generated interactive response data is returned to the playing area through the judgment, calculation, and the like of the media server. In the embodiment, the interactive response data includes an interactive animation, and the interactive animation will display the interactive result through a predetermined animation form, in order to facilitate the user to visually see the interactive result. For example, when the interactive command is tapped for 5 seconds, the interactive response data obtained by the media server is 5, and the animation of 5 red hearts can be displayed in the play area. Preferably, the interactive animation can be displayed in the sitting area of the interactive instruction Around the mark, to show that the animation is generated in response to interactive instructions, enhancing the user's interactive experience.

The playing terminal provided by the embodiment of the present invention sends the interactive instruction information to the media server by monitoring the interactive command input by the user in the playing area, so that the media server can calculate and generate the interactive response data according to the interactive instruction information. The user can obtain the interactive response data after inputting the interactive instruction in the play area, and the interactive operation of the video content can be realized without leaving the play area, and the interactive response data can be displayed in the play area in the form of interactive animation, and the user no longer needs to adjust The interactive area is used to input and view interactive content, realizing real-time interaction.

The embodiment of the present application further provides a non-transitory computer readable storage medium, where the non-transitory computer readable storage medium stores computer executable instructions, which can be executed in any of the foregoing method embodiments. Video playback method.

FIG. 6 is a schematic structural diagram of hardware of an electronic device for performing a video playing method according to an embodiment of the present disclosure. As shown in FIG. 6, the device includes:

One or more processors 610 and memory 620, one processor 610 is taken as an example in FIG.

The apparatus that performs the video playing method may further include: an input device 630 and an output device 640.

The processor 610, the memory 620, the input device 630, and the output device 640 may be connected by a bus or other means, as exemplified by a bus connection in FIG.

The memory 620 is used as a non-transitory computer readable storage medium, and can be used to store a non-transitory software program, a non-transitory computer executable program, and a module, such as a program instruction/module corresponding to the video playing method in the embodiment of the present application ( For example, the dot mark search module 11, the interactive object search module 12, and the response data generating module 13 shown in FIG. 4, or the data receiving module 21, the command listening module 22, and the interactive response receiving module 23 shown in FIG. 5) . The processor 610 performs various functional applications and data processing of the electronic device by running non-transitory software programs, instructions, and modules stored in the memory 620, that is, implementing the video broadcasting of the foregoing method embodiment. Put the method.

The memory 620 can include a storage program area and a storage data area, wherein the storage program area can store an operating system, an application required for at least one function; and the storage data area can be stored according to the video playback device (such as the media server described in FIG. 4) , or the data created by the use of the playback terminal described in FIG. 5, etc. Moreover, memory 620 can include high speed random access memory, and can also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid state storage device. In some embodiments, memory 620 can optionally include memory remotely located relative to processor 610, which can be connected to the video playback device over a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.

Input device 630 can receive input numeric or character information and generate key signal inputs related to user settings and function control of the video playback device. The output device 640 can include a display device such as a display screen.

The one or more modules are stored in the memory 620, and when executed by the one or more processors 610, perform a video playback method in any of the above method embodiments.

The above products can perform the methods provided by the embodiments of the present application, and have the corresponding functional modules and beneficial effects of the execution method. For technical details that are not described in detail in this embodiment, reference may be made to the method provided by the embodiments of the present application.

The electronic device of the embodiment of the invention exists in various forms, including but not limited to:

(1) Mobile communication devices: These devices are characterized by mobile communication functions and are mainly aimed at providing voice and data communication. Such terminals include: smart phones (such as iPhone), multimedia phones, functional phones, and low-end phones.

(2) Ultra-mobile personal computer equipment: This type of equipment belongs to the category of personal computers, has computing and processing functions, and generally has mobile Internet access. Such terminals include: PDAs, MIDs, and UMPC devices, such as the iPad.

(3) Portable entertainment devices: These devices can display and play multimedia content. Such equipment These include: audio, video players (such as iPods), handheld game consoles, e-books, and smart toys and portable car navigation devices.

(4) Server: A device that provides computing services. The server consists of a processor, a hard disk, a memory, a system bus, etc. The server is similar to a general-purpose computer architecture, but because of the need to provide highly reliable services, processing power and stability High reliability in terms of reliability, security, scalability, and manageability.

(5) Other electronic devices with data interaction functions.

It should be noted that those skilled in the art can understand that all or part of the processes in the foregoing embodiments can be implemented by a computer program to instruct related hardware, and the program can be stored in a non-transitory computer. In reading the storage medium, the program, when executed, may include the flow of an embodiment of the methods as described above. The storage medium may be a magnetic disk, an optical disk, a read only memory (ROM), or a random access memory (RAM).

The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separate, and the components displayed as units may or may not be physical units, ie may be located A place, or it can be distributed to multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the embodiment. Those of ordinary skill in the art can understand and implement without deliberate labor.

Through the description of the above embodiments, those skilled in the art can clearly understand The various embodiments may be implemented by means of software plus a necessary general hardware platform, and of course also by hardware. Based on such understanding, the above-described technical solutions may be embodied in the form of software products in essence or in the form of software products, which may be stored in a computer readable storage medium such as ROM/RAM, magnetic Discs, optical discs, etc., include instructions for causing a computer device (which may be a personal computer, server, or network device, etc.) to perform the methods described in various embodiments or portions of the embodiments.

It should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and are not limited thereto; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that The technical solutions described in the foregoing embodiments are modified, or the equivalents of the technical features are replaced. The modifications and substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

A video playing method, which is applied to a media server, including:

Receiving information of the current frame sent by the playing terminal in the suspended playing state, and searching for the preset stria mark associated with the current frame according to the information of the current frame;

Receiving, by the playing terminal, the interaction instruction information that is generated in the current frame, and searching, according to the interaction instruction information, an interaction object identifier corresponding to the preset puncturing mark associated with the current frame;

And generating, according to the interaction instruction information, interaction response data for the interaction object identifier, and returning the interaction response data to the play terminal.
The method according to claim 1, wherein the interaction instruction information includes coordinates of the interaction instruction, and the interaction instruction information is used to search for an interaction object identifier corresponding to the preset management mark associated with the current frame. include:

Determining, according to the information of the current frame, whether the current frame has an associated preset check mark;

Obtaining a target area in the current frame when the current frame has an associated preset hit mark;

Determining whether a coordinate of the interactive instruction exists in a target area in the current frame, and if a coordinate of the interaction instruction exists in a target area in the current frame, searching for a preset management point associated with the current frame Mark the corresponding interactive object ID.
The method according to claim 1, wherein the searching for the interactive object identifier corresponding to the preset dot tag associated with the current frame according to the interaction instruction information comprises:

Determining, according to the information of the current frame, whether the current frame has an associated preset check mark;

When the current frame has an associated preset dot mark, the interactive object identifier corresponding to the preset dot mark associated with the current frame is acquired.
The method of claim 1, wherein the interactive instruction information comprises:

One or more of command coordinates, clicks, single click duration, sliding direction, number of slides, gesture track, number of presses, press force, and press duration.
A video playing method, which is applied to a playing terminal, including:

Initiating a video source acquisition request to the media server to play the obtained video source;

Suspending playback of the video source when a pause control command is detected;

In the pause play state, receiving an interaction instruction input by the user in the play area, generating interaction instruction information according to the interaction instruction, and transmitting the information of the current frame and the interaction instruction information to the media server;

Receiving and displaying the interactive response data generated by the media server according to the interaction instruction information.
The method according to claim 5, wherein the receiving, by the media server, the interactive response data generated according to the interaction instruction information and displaying the information comprises:

Receiving the interaction response data returned by the media server, and displaying an interaction animation included in the interaction response data in a corresponding position of the play area according to the instruction coordinates in the interaction instruction information.
The method of claim 5, wherein the interactive instruction information comprises:

One or more of command coordinates, clicks, single click duration, sliding direction, number of slides, gesture track, number of presses, press force, and press duration.
A media server, comprising:

a dot mark search module, configured to receive information about a current frame sent by the play terminal in a pause play state, and search for a preset check mark associated with the current frame according to the information of the current frame;

The interactive object search module is configured to receive the interaction instruction information that is sent by the play terminal and that is generated in the current frame, and search for the interactive object identifier corresponding to the preset check mark associated with the current frame according to the interaction instruction information;

The response data generating module is configured to generate interaction response data for the interactive object identifier according to the interaction instruction information, and return the interaction response data to the playing terminal.
The media server according to claim 8, wherein the interactive object search module is configured to:

Determining, according to the information of the current frame, whether the current frame has an associated preset Point mark

Obtaining a target area in the current frame when the current frame has an associated preset hit mark;

Determining whether a coordinate of the interactive instruction exists in a target area in the current frame, and if a coordinate of the interaction instruction exists in a target area in the current frame, searching for a preset management point associated with the current frame Mark the corresponding interactive object identifier;

The interactive instruction information includes coordinates of the interactive instruction.
The media server according to claim 8, wherein the interactive object search module is configured to:

Determining, according to the information of the current frame, whether the current frame has an associated preset check mark;

When the current frame has an associated preset dot mark, the interactive object identifier corresponding to the preset dot mark associated with the current frame is acquired.
The media server according to claim 9, wherein the interactive instruction information comprises:

One or more of command coordinates, clicks, single click duration, sliding direction, number of slides, gesture track, number of presses, press force, and press duration.
A playback terminal, comprising:

a data receiving module, configured to initiate a video source acquisition request to the media server, and play the obtained video source;

The instruction monitoring module is configured to pause playing the video source when the pause control command is monitored; and, in the pause play state, receive an interaction instruction input by the user in the play area, and generate an interaction instruction according to the interaction instruction. Information, and transmitting the information of the current frame and the interactive instruction information to the media server;

The interactive response receiving module is configured to receive and display the interactive response data generated by the media server according to the interaction instruction information.
The playback terminal according to claim 12, wherein the interactive response receiving module is configured to:

Receiving the interaction response data returned by the media server, and displaying the interaction response data in a corresponding position of the play area according to the instruction coordinates in the interaction instruction information Interactive animation included in .
The playback terminal according to claim 12, wherein the interactive instruction information comprises:

One or more of command coordinates, clicks, single click duration, sliding direction, number of slides, gesture track, number of presses, press force, and press duration.
A non-transitory computer readable storage medium storing computer executable instructions, the computer executable instructions being set to:

Receiving information of the current frame sent by the playing terminal in the suspended playing state, and searching for the preset stria mark associated with the current frame according to the information of the current frame;

Receiving, by the playing terminal, the interaction instruction information that is generated in the current frame, and searching, according to the interaction instruction information, an interaction object identifier corresponding to the preset puncturing mark associated with the current frame;

And generating, according to the interaction instruction information, interaction response data for the interaction object identifier, and returning the interaction response data to the play terminal.
A non-transitory computer readable storage medium storing computer executable instructions, the computer executable instructions being set to:

Initiating a video source acquisition request to the media server to play the obtained video source;

Suspending playback of the video source when a pause control command is detected;

In the pause play state, receiving an interaction instruction input by the user in the play area, generating interaction instruction information according to the interaction instruction, and transmitting the information of the current frame and the interaction instruction information to the media server;

Receiving and displaying the interactive response data generated by the media server according to the interaction instruction information.
An electronic device comprising:

At least one processor; and,

a memory communicatively coupled to the at least one processor; wherein

The memory stores instructions executable by the one processor, the instructions being executed by the at least one processor to enable the at least one processor to:

Receiving information of a current frame sent by the playback terminal in a paused play state, and according to the The information of the current frame is used to find a preset check mark associated with the current frame;

Receiving, by the playing terminal, the interaction instruction information that is generated in the current frame, and searching, according to the interaction instruction information, an interaction object identifier corresponding to the preset puncturing mark associated with the current frame;

And generating, according to the interaction instruction information, interaction response data for the interaction object identifier, and returning the interaction response data to the play terminal.
The electronic device according to claim 17, wherein the interaction instruction information includes coordinates of an interaction instruction, and the interaction object identifier is used to search for an interaction object identifier corresponding to the preset dot mark associated with the current frame according to the interaction instruction information. ,include:

Determining, according to the information of the current frame, whether the current frame has an associated preset check mark;

Obtaining a target area in the current frame when the current frame has an associated preset hit mark;

Determining whether a coordinate of the interactive instruction exists in a target area in the current frame, and if a coordinate of the interaction instruction exists in a target area in the current frame, searching for a preset management point associated with the current frame Mark the corresponding interactive object ID.
The electronic device according to claim 17, wherein the searching for the interactive object identifier corresponding to the preset dot tag associated with the current frame according to the interaction instruction information comprises:

Determining, according to the information of the current frame, whether the current frame has an associated preset check mark;

When the current frame has an associated preset dot mark, the interactive object identifier corresponding to the preset dot mark associated with the current frame is acquired.
The electronic device according to claim 17, wherein the interactive instruction information comprises:

One or more of command coordinates, clicks, single click duration, sliding direction, number of slides, gesture track, number of presses, press force, and press duration.
An electronic device comprising:

At least one processor; and,

a memory communicatively coupled to the at least one processor; wherein

The memory stores instructions executable by the one processor, the instructions being executed by the at least one processor to enable the at least one processor to:

Initiating a video source acquisition request to the media server to play the obtained video source;

Suspending playback of the video source when a pause control command is detected;

In the pause play state, receiving an interaction instruction input by the user in the play area, generating interaction instruction information according to the interaction instruction, and transmitting the information of the current frame and the interaction instruction information to the media server;

Receiving and displaying the interactive response data generated by the media server according to the interaction instruction information.
The electronic device according to claim 21, wherein the receiving, by the media server, the interactive response data generated according to the interaction instruction information is displayed, including:

Receiving the interaction response data returned by the media server, and displaying an interaction animation included in the interaction response data in a corresponding position of the play area according to the instruction coordinates in the interaction instruction information.
The electronic device according to claim 21, wherein the interactive instruction information comprises:

One or more of command coordinates, clicks, single click duration, sliding direction, number of slides, gesture track, number of presses, press force, and press duration.
A computer program product comprising a computer program stored on a non-transitory computer readable storage medium, the computer program comprising program instructions that, when executed by a computer, cause the computer to execute The method of any one of claims 1 to 7.