WO2015043415A1

WO2015043415A1 - Method, device and system for video content interaction

Info

Publication number: WO2015043415A1
Application number: PCT/CN2014/086833
Authority: WO
Inventors: 陶建良; 林洋
Original assignee: 乐视网信息技术（北京）股份有限公司
Priority date: 2013-09-29
Filing date: 2014-09-18
Publication date: 2015-04-02
Also published as: CN103533396B; CN103533396A

Abstract

A method for video content interaction is disclosed in the embodiments of the present application. The method includes: a video resource server receives a target video playing request; the video resource server provides the target video data according to the target video playing request, and returns, according to the target video data, expanded search results based on the target video data, so that selected search results can be presented based on the selection for the expanded search results during loading and playing the target video. Another method for video content interaction and a device and system for video content interaction are also disclosed in the embodiments of the present application. The embodiments of the present application can realize video content interaction.

Description

Video content interaction method, device and system

This application claims priority to Chinese Patent Application No. 201310456047.4, entitled "A Video Content Interaction Method, Apparatus and System", filed on September 29, 2013, the prior application The entire contents are incorporated herein by reference.

Technical field

The present application relates to the field of video technologies, and in particular, to a video content interaction method, apparatus, and system.

Background technique

With the development of Internet technology, following the way in which texts display information, video has become an important way for people to understand information, obtain information, and entertain themselves. A video website or video service node on the Internet can provide a large amount of online video resources for use. The playback mode of the video resource is usually that the user terminal initiates a play request to the target video, and the server that stores the video resource returns the target video to the user terminal for viewing through the network. However, as people's demand for video playback increases, this simple passive video playback method is increasingly unable to meet the needs. Some playback systems with interactive nature of video content have emerged in the prior art. For example, the video editing dot system (pre-stored by the video editor based on the video content and time "point of view", when played to the point of view to the user), video link advertisement (video ad editor based on video content and time) Customized ads, pop-up ads when playing to the point in time of the ad), video-adhesive ads, etc.

However, the so-called video content interactions performed by these systems cannot actually be considered as video content interactions in the strict sense. Because the video content interaction should be based on the information flow interaction between the video resource providing end and the end user (playing terminal) of the video resource, and the above system is mainly located at the perspective of the non-video resource playing terminal, and the video resource Producers, providers, operators, etc. pre-set fixed content, as the end user of the video resource, do not participate in the interaction, in some cases, these related resources pushed to the user may become the normal viewing of video resources by the user. obstacle. It can be seen that there is no video content interaction method and related system based on the video resource playing terminal in the prior art.

Summary of the invention

To solve the above technical problem, the embodiment of the present application provides a video content interaction method, device, and system thereof to implement interaction of video content.

In one aspect, the video content interaction method provided by the embodiment of the present application includes:

The video resource server receives the target video play request;

The video resource server provides the target video data according to the target video playback request, and returns an extended search result based on the target video data according to the target video data, so as to display the selected search according to the selection of the extended search result during the target video loading and playing process. result.

On the other hand, the embodiment of the present application further provides another video content interaction method. The method includes:

The video playing terminal sends the target video playing request, so that the opposite end side of the video playing terminal provides the target video data according to the target video playing request, and returns the extended search result based on the target video data according to the target video data;

The video playing terminal displays the selected search result according to the selection of the extended search result during the target video loading and playing.

In still another aspect, an embodiment of the present application further provides a video content interaction method, where the method includes:

The video playing terminal sends a target video playing request;

The video resource server receives the target video play request, and provides target video data according to the target video play request, and returns an extended search result based on the target video data to the video play terminal according to the target video data;

The video playing terminal receives the target video data and the expanded search result based on the target video data, and displays the selected search result according to the selection of the extended search result during the target video loading and playing. In another aspect, an embodiment of the present application further provides a video content interaction apparatus. The device comprises: a video request receiving unit, a video data providing unit and a search result returning unit, wherein:

The video request receiving unit is configured to receive a target video playing request;

The video data providing unit is configured to provide target video data according to a target video playing request;

The search result returning unit is configured to return an extended search result based on the target video data according to the target video data, so as to present the selected search result according to the selection of the extended search result during the target video loading and playing.

In another aspect, the embodiment of the present application further provides another video content interaction apparatus. The device comprises: a video request sending unit and a search result presenting unit, wherein:

The video request sending unit is configured to send a target video playing request, so that the opposite end side of the device provides target video data according to the target video playing request, and returns an extended search result based on the target video data according to the target video data;

The search result presentation unit is configured to display the selected search result according to the selection of the extended search result during the target video loading and playing process.

In another aspect, the embodiment of the present application further provides a video content interaction system. The system comprises: a video request sending unit, a video request receiving unit, a video data providing unit, a search result returning unit and a search result presenting unit, wherein:

The video request sending unit is configured to send a target video playing request;

The search result returning unit is configured to return an extended search result based on the target video data according to the target video data;

In another aspect, the embodiment of the present application further provides a video content interaction method, where the method includes:

The video resource server receives the target video play request;

The video resource server provides the target video data according to the target video playback request, and transmits the extended search result based on the target video data according to the target video data.

The video playing terminal sends a target video playing request;

The video playing terminal receives the target video data in response to the target video playing request, and the expanded search result based on the target video data;

In another aspect, the embodiment of the present application further provides a video content interaction apparatus, where the apparatus includes: a video request receiving unit, a video data providing unit, and a search result returning unit, where:

The search result returning unit is configured to send an extended search result based on the target video data according to the target video data.

In another aspect, the embodiment of the present application further provides a video content interaction apparatus, where the apparatus includes: a video request sending unit, a data receiving unit, and a search result presenting unit, where:

The data receiving unit is configured to receive target video data in response to the target video play request, and an extended search result based on the target video data;

The video content interaction method, device and system provided by the embodiments of the present application can provide a search result based on the target video during the playback of the target video content, and display the selected search result after selecting and determining the search result. Compared with the prior art, the embodiment of the present application can provide the target video association information as complete as possible through the extended search result, so that the video playback terminal no longer only obtains a single target video information, thereby enhancing the richness of the video content interaction. On the other hand, the search results displayed on the video playback terminal depend on the selection of the extended search results, and the user can select the appropriate content according to his or her own interests, so that the displayed content can satisfy the user's needs to a large extent, and the video playback is improved. On the other hand, the search result displayed on the video playing terminal is based on the search result of the target video data itself, and the search result obtained by the user's on-demand target video will be different, so that the video playing terminal can display the real-time related information, and the enhanced The timeliness of video interaction; in another aspect, in the process of implementing video content interaction, a lot of work is performed by the server, and the video playback terminal side only needs to select and confirm the search result, and does not need to separately search for related information of the target video. , reducing the user's The degree of complexity, and enhance the convenience of interactive video content.

DRAWINGS

1 is a flowchart of Embodiment 1 of a video content interaction method according to the present application;

2 is a flowchart of Embodiment 2 of a video content interaction method according to the present application;

3 is a flowchart of Embodiment 3 of a video content interaction method according to the present application;

Figure 4 (a) is a schematic diagram showing the display of text type search results;

Figure 4 (b) is a schematic diagram showing the search results of the picture type;

Figure 4 (c) is a schematic diagram showing the display of video type search results;

FIG. 5(a) is a structural block diagram of a server-side video content interaction apparatus according to the present application;

FIG. 5(b) is a structural block diagram of a video content interaction device based on a video terminal side according to the present application;

FIG. 5(c) is a structural block diagram of a video content interaction system of the present application.

detailed description

The technical solutions in the embodiments of the present application are clearly and completely described in the following, in which the technical solutions in the embodiments of the present application are clearly and completely described. The embodiments are only a part of the embodiments of the present application, and not all of them. Based on the embodiments in the present application, those of ordinary skill in the art will be able to do without creative work. All other embodiments obtained are intended to fall within the scope of the present disclosure.

Refer to FIG. 1 , which shows a flow of an embodiment (the first embodiment) of the video content interaction method provided by the present application, where the process includes:

Step S101: The video resource server receives the target video play request.

Step S102: The video resource server provides target video data according to the target video play request, and returns an extended search result based on the target video data according to the target video data, so as to select and display according to the selection of the extended search result during the target video loading and playing process. Fixed search results.

The video resource server in this embodiment can be used to provide video resources (ie, target video data), and various specific functions can be integrated on the server or specific functions can be implemented by calling other function modules based on actual needs. The "providing video resources" described herein does not mean that the server must be a direct producer of video resources, but merely indicates that information interaction with the video playing terminal is realized through the server, and the video resources on the server may be directly The generated video, for example, uploaded by the video resource server manager itself; or obtained from other servers and temporarily stored on the server. During the actual operation, the video resource server of the present application preferably adopts a CDN (Content Delivery Network) node server. The basic idea of CDN is to avoid the bottlenecks on the Internet that affect the speed and stability of data transmission, so that the content is transmitted faster and more stable. By placing such a CDN node server throughout the network, an intelligent virtual network based on the Internet can be constructed, so that comprehensive information can be obtained in real time according to network traffic and connection and load status of each node, and distance and response time to users. The user's request is redirected to the node server closest to the user. When the nearest node server returns data to the user, the user can also obtain the required content and improve the response speed of the user to obtain related resources.

The "search result" in this embodiment is different from the general search result obtained by the search engine in the general sense, and it has three characteristics: First, the search result is "based on" the target video data. This indicates that the search result is closely related to the target video. Since the application needs to realize the interaction of the video content, if all the search results about the video are likely to affect the normal interaction, the user of the video playing terminal is excessively interfered. The search results based on the target video data excludes which less targeted and less relevant video information enters the interactive environment, reducing or not having a bad influence on the normal level of interaction. Second, the search results are “dependent” on the target video data, which is different from the traditional ones that first obtain the “seeing point” through the artificial viewing of the target video, and then the person converts the “seeing point” into the search keyword through the human intelligence, and then The process of manual search based on this keyword. Third, the search results are "extended" search results. The expanded search results here have two meanings: relative In the case of the target video, the video terminal is no longer only the target video itself, but also includes related information closely related to the target video, which realizes the “expansion” of the target video; compared with the subsequent selected search results. Based on the needs of interaction, the associated information that is ultimately displayed on the video playback terminal is not all of the search results, but part of the search results, so the former is "extended" relative to the latter. In order to facilitate the distinction between the two concepts and to embody the above connotation, the present application refers to the search result based on the target video data as “extended search result” and the displayed search result as “selected search result”.

The above embodiment obtains the target video data and the extended search result based on the target video data by analyzing the target video playback request, and then displays the selected search result according to the selection of the extended search result during the target video loading and playing process. . Compared with the prior art, the technical solution has achieved various technical effects:

(1) The solution of the embodiment can provide the target video association information as perfect as possible by providing the extended search result, and expand the probability that the user of the video screen playing terminal obtains more related information based on the target video, and the related information can be embodied. For text, picture, audio, video, animation and other types, the video player terminal no longer only obtains the target video of single form and single content, thereby greatly enhancing the richness of video content interaction;

(2) The search result finally presented by the scheme of the embodiment in the video playing terminal depends on the selection of the extended search result, so that the user can select the appropriate content according to his or her own interests, and excludes the user who is most concerned despite the fact that the target video data is obtained. Which "interference" information enables the content to be displayed to meet the needs of users to a greater extent, and has better pertinence, thereby improving the accuracy of video content interaction;

(3) The search result displayed by the video playback terminal of the solution in this embodiment is based on the search result of the target video data itself, and the target video that the user clicks at different times, moods, and environments is different, and the target video that the user clicks on is obtained differently. The search results will also be different, so that the video playing terminal can display the current real-time associated information, thereby enhancing the timeliness of the video interaction;

(4) In the implementation of the video content interaction process in the embodiment, a large amount of work is performed by the server, and the video playback terminal side only needs to select and confirm the extended search result, and does not need to obtain related information of the target video. The traditional keyword based on “seeing point” is searched separately or searched again, which reduces the complexity of user usage and enhances the convenience of video content interaction.

In addition, it should be noted that the foregoing embodiment may be completely described from the perspective of a video resource server. At this time, after receiving the target video playing request, the video resource server requests the device (device) and the like to the sending target based on the request. Provide target video data and send it according to target video data Get extended search results.

In the step S102 of the foregoing embodiment, after the target video data is obtained according to the target video playback request, the operation of returning the extended search result based on the target video data according to the target video data is performed on the premise that the target video data is first acquired. Extended search results. In the actual application process, the extended search result based on the target video data can be combined with different technologies to form a plurality of specific implementation manners. For example, the data about the target video category may be extracted from the target video data to determine the category of the target video, and then the extended search result based on the target video data may be obtained according to the category, where the category may be a category of the theme (eg, Documentaries, TV series, variety shows, current affairs news, etc.) can also be categories of content (such as politics, economics, culture, law, education, etc.). Assuming that the type of the target video determined by the extracted data is a documentary or a culture class, the documentary and the culture class can be directly used as the description information of the video keyword, and the video resource stored on the video resource server is searched for the category matching. Video resources are used as extended search results; specific video keywords can also be formed based on the characteristics of "documentary" and "culture", and the keyword is submitted to the search engine for automatic retrieval, and the search result is used as an extended search result. .

Also for example, the above-obtained expanded search results may be implemented based on image analysis techniques. Since the video resource is image data, the target video data can be parsed to obtain continuous video image data, and then the image analysis system analyzes the video images, and the image analysis system can perform pattern video recognition on the target video data. Analyze, describe, classify and interpret, finally generate video keywords, and then submit these video keywords to search engines for search. According to certain strategies, search engines use specific computer programs to search for information from the Internet, and then perform information on the information. Organize and process, then give extended search results.

On the basis of obtaining the extended search result based on the target video data and returning the extended search result to the video playing terminal, in order to further enhance the interactive content of the video content, various measures can be taken. For the sake of simplicity, two illustrative measures are provided below:

First, after generating the video keyword, the keyword list is first returned to the video playing terminal, and after being selected by the video playing terminal, the video resource server searches for the extended search result according to the selection result. In the actual running process, although the video keyword can be generated based on the target video data, and the search result is obtained based on the keyword, but some keywords in the video keywords may not be the user's interest at all. Content, search results based on such video keywords are naturally unlikely to meet the user's final expectations. To this end, the generated video keyword list can be first submitted to the user of the video playing terminal for selection and confirmation, and then the video key selected according to the selection. The word is searched, and since the video keyword is determined by the user's choice, the search result thus obtained can greatly increase the probability of "hitting" the user's intention. In addition, this method can also reduce the burden of the video resource server, so that the video resource server does not search all video keywords generated based on the target video data, but only searches for certain video keywords determined by the user, saving The processing resources are processed.

Second, before the video resource server returns the extended search result to the video playing terminal, it is determined whether the video content interaction trigger message is received, and the extended search result is executed only when received. The video content interaction trigger message may reflect the "intention" of the user of the video playing terminal. In some cases, the user may not want to interact with the video content at a certain moment. In this case, returning the extended search result to the user may affect the The user's normal viewing of the target video, therefore, it is possible to set a "switch" (partial switch) to turn the extended search result back to the user, and when the user's content interaction trigger message is received, the "switch" is turned on, by This confirms that the user wishes to provide extended information other than the target video; otherwise, the "switch" is turned off, thereby confirming that the user does not currently want to receive an extended message other than the target video.

It should be noted that the video content interaction trigger message may be different at different time points on the video resource server side. For example, when the video content trigger message is not received during or before the target video data is obtained according to the target video playback request, the operation of obtaining the video image data according to the target video data and subsequent operations may be omitted; After the video image data is obtained and the video content interaction trigger message is not received during or before the generation of the video keyword, the search result may not be searched according to the video keyword or the video may not be generated according to the video image data. The operation of the keyword. In summary, if the video content interaction trigger message is not received, all operations performed by the video resource server for the video content interaction may be suspended. When the video content interaction trigger message is received at a later time, the operations are continued.

Here we need to discuss a special case: the user does not open the video content interactive "switch" at the beginning of watching the video, that is, the video resource server does not receive the video content interaction trigger message, and the video playing terminal normally plays the target video, but when playing After a period of time, the user wants to know about the extended information about the target video, that is, the video content interaction "switch" is turned on. At this time, the video resource server will receive the video content interaction trigger message, and the foregoing stop operation will be resumed or performed. In this case, the foregoing step of "obtaining extended search results according to the target video data" is based on the entire target video data, or only based on the target video data after receiving the video content interaction trigger message time to obtain search results. In fact, usually, if the user turns on the video halfway through the target video, The content interaction "switch" indicates that the previous content may not be the content that the user is interested in. At this time, the target video data that has already been played is used as the basis for searching for the extended information, which may result in the accuracy and the targetedness of the search result. Therefore, in this case, the application preferably only uses the target video data after receiving the video content interaction trigger message time as the basis for obtaining the extended search result, that is, the target video data after the time when the video content is triggered. The video image data is obtained by analysis, and then the video image data in this case is analyzed to generate a video keyword, and the search is performed based on the keyword to obtain an expanded search result.

The two measures for enhancing the interaction of video content provided above may be used alone or in combination. When used together, the first interaction is realized by determining whether the video content interaction trigger message is received to identify whether the user needs to interact with the video content, and the interaction is a "big" interaction, that is, determining whether the user is currently The target video extension message is needed; the second interaction is realized by returning the video keyword to the video playback terminal for the user to select, and the interaction is a "small" interaction, that is, in the case of determining that the user needs to interact with the video content, It is further determined by the user whether the video keyword currently pushed by the user system is a keyword corresponding to the extended information that it needs. Through these two interactions, the final extended search results will be more in line with user expectations and improve the relevance of video content interaction.

In fact, the second interaction method mentioned above can further advance the operation in time, that is, when the video resource server receives the target video playback request. After the video resource server receives the target video play request, it determines whether the video play terminal needs to perform video content interaction by identifying the target video play request, and if necessary, performs a series of operations on the interaction, and if not, the entire target During the video playback process, the interactive operation of the video content is not performed by default, which is equivalent to setting a “master switch” (of course, the master switch can change the state through the aforementioned partial switch, for example, the “main switch” prohibits the video screen. In the case of content interaction, the video content interaction trigger message is received during the target video playback, that is, the local switch is turned on, and the default state of the main switch setting will be changed). In the specific implementation, a field bit may be set in the target video play request, which is specifically used to identify whether the video content interaction trigger is needed. When the flag bit is true (for example, the value of the flag bit is “1”), the video is explained. The user of the playback terminal wants to interact with the video content; when the flag is false (for example, the value of the flag bit is “0”), the user of the video playback terminal does not want to interact with the video content, and the video is not played. Related operations for content interaction. As can be seen from the above, the "master switch" can be activated by setting the video content trigger flag in the target video play request. When the switch is turned on, the video content can be interactive during the entire target video playback process. Otherwise, no video content interaction takes place. Of course, in the actual operation process, as described above, the aforementioned "local switch" can be combined with the "main switch" here, that is, when the main switch is set to allow video content interaction, the user is allowed to be at certain moments. Set the temporary prohibition of video content interaction; when the main switch is set to not interact with video content, the user is also allowed to set the video content interaction operation at certain moments. This is fully able to meet the various needs of users in different situations.

In order to explain the technical solution of the present application, the technical solution of the present application will be explained below by a more specific embodiment (Embodiment 2). Referring to Figure 2, there is shown the flow of this embodiment. The process includes:

Step S201: The CDN node server receives a target video play request, where the target video play request includes a video content interaction flag bit;

This step sets a special field in the usual target video play request to identify whether video content interaction is required. In a specific implementation, a setting interface or a dedicated interface may be provided. The user of the video playing terminal sets a flag bit in the interface or through a dedicated interface, and the device responsible for sending the target video playing request to the CDN node server encapsulates the setting content into the video playing request. Among them.

Step S202: The CDN node server provides target video data according to the target video play request.

Step S203: determining whether the video content interaction flag bit in the target video play request is set to true, if yes, executing step S204; if not, executing step S203 (a): playing the target video data;

The step is used to detect the setting of the video content interaction flag bit in the target video play request. If the flag is true, it is determined that the user of the video play terminal wishes to perform video content interaction, in which case performing interaction on the video content is performed. Step; otherwise, if the video content interaction is not desired, the target video data is directly returned to the video playing terminal for playing. It should be noted that step S202 is a “public” step, that is, whether or not video content interaction is required, the target video data needs to be returned in order to complete the normal video playing function, only when the user selects the video content interaction. In addition to performing normal video playback, presentation of search results based on target video data is also performed. Based on such considerations, step S202 may actually be placed after step S203, that is, after determining whether the target video play request has a video content interaction flag, if the flag is true, the CDN node server provides the target video to the video play terminal. Data for performing target video playback, or subsequent steps of performing video content interaction, ultimately presenting search results based on the target video data to the user; if the flag is false, the CDN node server provides the target video data to the video playback terminal for proceeding Normal target video playback.

Step S204: The CDN node server invokes the HTTPLive Encoder of the HLS to parse the target video data to obtain video image data.

HLS is an abbreviation of Http Live Streaming, which means HTTP streaming live broadcast technology, which implements video playback based on HTTP streaming media communication protocol. It divides the overall data stream into a series of small HTTP-based file download streams, and each short block loaded by each download is embedded as a whole in an infinite stream of transport data. The HLS contains the HTTPLiveEncoder service, which is the core service of real-time transcoding of video content in HLS. Through this service, the target video data can be parsed to obtain video image data. Here, the CDN node server calls the HTTPLiveEncoder service of HLS, which can be an internal call or an external call. The former refers to directly embedding the functional layer of the HTTPLiveEncoder service in the CDN node server, and calling it directly by calling the function library; The HTTPLiveEncoder service is a functional entity that is independent of the CDN node server and is called by the relevant interface when the CDN node server needs it to implement the required functions.

Step S205: The CDN node server invokes the image analysis system to perform pixel and image analysis on the video image data to generate a video keyword;

After obtaining the video image data through the foregoing steps, the CDN node server invokes the related functions of the image analysis system to perform multi-layer analysis on the video image data, which may be pixel analysis, image analysis, or a combination of the two. Through the analysis of the image system, a series of video keyword lists are obtained, and the keyword list can be submitted to the next step to perform the retrieval. Of course, as described above, the video keyword list may be returned to the user of the video playing terminal, and the video keyword list is selected by the user, and then the selected result is returned to the CDN node server, and then enters according to the selected Video keyword search steps.

Step S206: The CDN node server invokes the search engine to search to obtain the extended search result, and returns the extended search result based on the target video, so as to display the selected search result according to the selection of the extended search result during the target video loading and playing process. ;

After getting the list of video keywords, the CDN node server can call the search engine to search. When searching, the searched database may be a database system maintained by the CDN node server itself for "local search", or the video keywords may be submitted to a dedicated web search engine, and the search tasks are implemented by these search engines. After the search is completed, the CDN node server returns the search result to the user of the video playing terminal through the HTTP channel, and then can provide a program interface, and the user selects the search results, and displays the search result selected by the user in various friendly manners. Out Come.

The video content interaction method mentioned in the above is mainly the description from the video resource server side. In fact, the present application also provides an embodiment of the video content interaction method described in the video playing terminal side (Embodiment 3). Referring to Figure 3, there is shown the flow of this embodiment. This embodiment includes:

Step S301: The video playing terminal sends the target video playing request, so that the opposite end of the video playing terminal provides the target video data according to the target video playing request, and returns the extended search result based on the target video data according to the target video data;

Step S302: The video playing terminal displays the selected search result according to the selection of the extended search result during the target video loading and playing process.

This embodiment can also achieve the technical effects of the foregoing embodiments, and various modifications can be made to the embodiment to obtain various variant implementations. To avoid repetition, it will not be described here. The following mainly discusses how the video playing terminal performs presentation after obtaining the target video and the search result based on the target video data.

In the case that the user needs to interact with the video content, the video playing terminal will obtain two aspects of data: one is the target video data for normal video playback; the other is the selected search result obtained for realizing the interaction of the video content. When the data of these two aspects are played on the same video playing terminal, there is a problem that resources are "coordinated". For example, if the selected search result is also a video, then the selected video will be played in the currently playing video, and resource competition will occur, resulting in resource utilization conflict. To this end, the play (or presentation) of both must be arranged in a coordinated manner. During the actual operation, there may be multiple specific ways to achieve the coordinated display of the target video and the selected search results. The present application provides two exemplary implementations herein, and those skilled in the art may according to the object of the present invention. On this basis, we have expanded various ways to meet actual needs:

One is to differentiate the presentation based on the type of search results selected. The reason for the difference is that the specific form of the search result based on the target video data may be extensive, for example, it may be news, consultation, multimedia, animation, picture, etc., between different types of search results and the target video being played. Whether there is conflict and the depth of conflict are different, the difference presentation can resolve the most suitable presentation according to the characteristics of different search results.

The second is to display the selected search results in a preset fixed position. Since the playing of the current target video is the main task that the video playing terminal needs to implement, the display of the selected search result should not affect or hinder the completion of the main task, and therefore, the display position of the search result can be set in the completion of the main task. Affects the corner position of a smaller video playback form because of the usual situation based on video playback In this case, the video content in the center of the video play form is usually critical and critical, and the video content in the corner position is usually auxiliary, or a form is opened separately to open a window. The body is equivalent to re-opening a processing thread. In the case where the computing power of the processor corresponding to the video playing terminal is not too bad, it is usually possible to operate independently without hindering each other.

Of course, the best way is to combine the first and second methods above. For example, the categories of the selected search results are first distinguished, and then different preset positions are selected according to different categories for display, specifically:

When the selected search result is a text type, since the search result of the text type does not form a big conflict with the current video play on the sound resource and the picture resource, in this case, see FIG. 4(a). It can be displayed that the search result is set at the edge of the screen of the playback target video. "Edge" can be the corner of any target video screen, because even if these places are covered, it will not have a critical impact on the normal playback of the target video, for example, it can be the upper edge (shown by the dotted line in the figure), the lower edge Or the left and right edges, scrolling in the form of a horizontal bar to display the text as a search result. In this way, the user of the video playing terminal can understand the content of the video normally by watching the target video, and can obtain the extended information of the text related to the currently broadcasted video and the screen, thereby satisfying the timeliness of the interaction of the video content. Richness, convenience and other requirements.

When the selected search result is a picture type, since the picture type usually needs to occupy a certain position space, the picture may compete with the currently played target video to form a resource, and the picture needs to be placed at a specific position, the specific position. It can be another separate form from the target video playback form, or it can be part of the target video playback form, or an associated location with a small overlap area with the target video playback window. In general, you can choose the location to place according to the size of the image. If the image is small, you can display the image in the four corners of the form where the target video is loaded and played (see Figure 4(b)), because these locations It usually has less impact on the playback of the target video; if the image is larger, it is better to display it in a separate location.

When the selected search result is an audio type, since the audio needs to occupy the sound channel, the video will directly collide with the currently playing video, so the playback target video can be paused and the search result of the playback audio type is loaded. After the search result is played, it will automatically or manually switch back to the original target video.

When the selected search result is a video type, based on the same reason as the above audio type, the loading and playing of the current target video may be suspended, and the search result of the video type is displayed within the target video playing range (see FIG. 4(c). )), that is, the formation of "picture in picture".

In addition to the above-mentioned categories according to the search results and preset positions, in the actual application process, it may be necessary to set a control bar, through which the search position of the search results is displayed, and the progress is displayed.

In addition, it should be noted that the foregoing embodiment may be completely described from the perspective of a video playing terminal. At this time, the video playing terminal sends a target video playing request, receives target video data in response to the target video playing request, and based on the target video data. The expanded search result; then, the video playback terminal presents the selected search result according to the selection of the extended search result during the target video loading and playing.

The foregoing content details the method for interacting video content of the present application from the video resource server and the video playing terminal side. In fact, from the overall process of video content interaction, the method description process of the foregoing embodiment may be combined. The interaction of the video content is realized through information interaction between the video resource server and the video playing terminal. In addition, in addition to the above-described method embodiments, correspondingly, the present application also provides a video content interaction device described from the video resource server side and the video playing terminal side. Referring to FIG. 5, wherein: FIG. 5(a) shows a video content interaction device described from a video resource server side, the interaction device can be embedded as a function module in a video resource server, or can function as a stand-alone device; Fig. 5(b) shows a video content interactive device described from the side of the video playing terminal, which can be embedded as a function module in the video playing terminal or function as a stand-alone device. In the apparatus shown in FIG. 5(a), a video request receiving unit 5a11, a video data providing unit 5a12, and a search result returning unit 5a13 are included, wherein:

a video request receiving unit 5a11, configured to receive a target video playing request;

a video data providing unit 5a12, configured to provide target video data according to a target video playing request;

The search result returning unit 5a13 is configured to return an extended search result based on the target video data according to the target video data, so as to present the selected search result according to the selection of the extended search result during the target video loading and playing.

It is worth noting that in the actual application process, the search result returning unit 5a13 may only care about the work done by itself, without regard to the specific purpose that the work done by the terminal device may be used by other terminal devices, that is to say, The search result returning unit 5a13 can be described in such a manner that the search result returning unit 5a13 is for returning the expanded search result based on the target video data based on the target video data.

In the apparatus shown in FIG. 5(b), a video request transmitting unit 5b11 and a search result presenting unit 5b12 are included, wherein:

a video request sending unit 5b11, configured to send a target video playing request, so that the opposite end side of the device provides target video data according to the target video playing request, and returns an extended search result based on the target video data according to the target video data;

The search result presentation unit 5b12 is configured to display the selected search result according to the selection of the extended search result during the target video loading and playing.

By the same token, the functions implemented by the video request sending unit 5b11 herein can be described as being used for transmitting a target video playing request, and the request may be used by other terminals to achieve a specific purpose, as shown in FIG. 5(b). From the perspective, don't worry too much.

In addition to the related devices described above from the video resource server side and the video playback side, the present application also provides an embodiment of integrating the two devices into one system. Referring to Figure 5(c), the figure shows the structural composition of the system. The system includes a video request transmitting unit 5c11, a video request receiving unit 5c12, a video data providing unit 5c13, a search result returning unit 5c14, and a search result presenting unit 5c15, wherein:

a video request sending unit 5c11, configured to send a target video playing request;

a video request receiving unit 5c12, configured to receive a target video playing request;

a video data providing unit 5c13, configured to provide target video data according to the target video playing request;

The search result returning unit 5c14 is configured to return an extended search result based on the target video data according to the target video data;

The search result presentation unit 5c15 is configured to display the selected search result according to the selection of the extended search result during the target video loading and playing.

The video request sending unit and the search result presenting unit in the above system embodiment may be located as a whole on the video playing terminal side, and the video request receiving unit, the video data providing unit and the search result returning unit may be located as a whole on the video resource server side. These two entities can be wired or wireless. In addition, regarding the working principle of the above devices and systems, the technical effects obtained can be referred to the foregoing method embodiments, and are not described herein to avoid repetition.

It should be noted that, for the sake of simplicity of description, the above-described embodiments of the present specification and various modified implementations of the embodiments are mainly described as being different from other embodiments or modifications, and the same similar parts are used in each case. See each other. In particular, the apparatus and system embodiments are only briefly described in order to avoid repetition, and the contents of the foregoing method embodiments may be referred to when understanding the apparatus and system embodiments. The units of the apparatus and system embodiments described above may or may not be physically separate, and may be located in one place or distributed to multiple network environments. In the actual application process, some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment, and those skilled in the art can understand and implement without any creative work.

The above description is only a specific embodiment of the present application, and it should be noted that those skilled in the art can also make several improvements and retouchings without departing from the principles of the present application. It should be considered as the scope of protection of this application.

Claims

A video content interaction method, the method comprising:

The video resource server receives the target video play request;

The video resource server provides the target video data according to the target video playback request, and returns an extended search result based on the target video data according to the target video data, so as to display the selected search according to the selection of the extended search result during the target video loading and playing process. result.
The method according to claim 1, wherein the video resource server returns an extended search result based on the target video data according to the target video data, including:

The video resource server parses the target video data to obtain video image data, analyzes the video image data to generate a video keyword, searches according to the video keyword to obtain an extended search result, and returns the extended search result.
The method according to claim 2, wherein the video resource server returns the video keyword list after analyzing the video image data to generate a video keyword, and after receiving the selection result of the video keyword list, Searching for selected video keywords to obtain extended search results.
The method according to any one of claims 1 to 3, wherein the video resource server determines whether a video content interaction trigger message is received before returning the extended search result, and if yes, performing a return to the Steps to expand the search results.
The method according to claim 4, wherein if the received video content interaction trigger message is in the target video loading and playing process, the video resource server parses the target video data to obtain video image data, which is specifically based on The target video data after the time when the video content interaction trigger message is received is parsed to obtain video image data.
The method according to claim 5, wherein the video resource server is a content distribution network (CDN) node server, and the method is specifically:

The CDN node server receives the target video play request;

The CDN node server provides target video data according to the target video playback request, and calls the HLS HTTPLive Encoder to parse the target video data to obtain video image data, and call the image analysis system to perform pixel and image analysis on the video image data to generate video keywords, and call the search. The engine searches for extended search results.
The method of claim 4, wherein if the video content is received interactively The message is that the video content interaction request is set in the target video play request before the video resource server provides the target video data, and the determining whether the video content trigger message is received is:

Determining whether the video content interaction flag in the target video play request is set to true, and if so, determining to receive the video content interaction trigger message.
A video content interaction method, the method comprising:

The video playing terminal sends the target video playing request, so that the opposite end side of the video playing terminal provides the target video data according to the target video playing request, and returns the extended search result based on the target video data according to the target video data;

The video playing terminal displays the selected search result according to the selection of the extended search result during the target video loading and playing.
The method according to claim 8, wherein the displaying of the extended search result by the video playing terminal during the loading of the playing target video comprises:

The video playing terminal displays the selected search results according to their types according to the selection of the extended search result during the loading of the playing target video, and/or displays the selected search results in a preset fixed position.
The method of claim 9 wherein a presentation control bar is provided, and the video playback terminal controls the presentation of the selected search results via the control strip.
The method according to claim 9 or 10, wherein the displaying the selected search result is specifically:

If the search result is a text type, performing text scrolling on the search result of the text type at the edge of the form of the target video loading and playing;

If the search result is a picture type, the search result of the picture type is displayed at any of the four corners of the form of the target video loading play;

If the search result is an audio type, suspending loading of the play target video, loading a search result that plays the audio type;

If the search result is a video type, the playback target video is paused, and the search result of the video type is displayed within the target video playback range.
A video content interaction method, the method comprising:

The video playing terminal sends a target video playing request;

The video resource server receives the target video play request, and provides the target video data according to the target video play request, and returns the target video data to the video play terminal according to the target video data. Extended search results;

The video playing terminal receives the target video data and the expanded search result based on the target video data, and displays the selected search result according to the selection of the extended search result during the target video loading and playing.
A video content interaction device, comprising: a video request receiving unit, a video data providing unit, and a search result returning unit, wherein:

The video request receiving unit is configured to receive a target video playing request;

The video data providing unit is configured to provide target video data according to a target video playing request;

The search result returning unit is configured to return an extended search result based on the target video data according to the target video data, so as to present the selected search result according to the selection of the extended search result during the target video loading and playing.
A video content interaction device, comprising: a video request sending unit and a search result presentation unit, wherein:

The video request sending unit is configured to send a target video playing request, so that the opposite end side of the device provides target video data according to the target video playing request, and returns an extended search result based on the target video data according to the target video data;

The search result presentation unit is configured to display the selected search result according to the selection of the extended search result during the target video loading and playing process.
A video content interaction system, comprising: a video request sending unit, a video request receiving unit, a video data providing unit, a search result returning unit, and a search result presenting unit, wherein:

The video request sending unit is configured to send a target video playing request;

The video request receiving unit is configured to receive a target video playing request;

The video data providing unit is configured to provide target video data according to a target video playing request;

The search result returning unit is configured to return an extended search result based on the target video data according to the target video data;

The search result presentation unit is configured to display the selected search result according to the selection of the extended search result during the target video loading and playing process.
A video content interaction method, the method comprising:

The video resource server receives the target video play request;

The video resource server provides target video data according to the target video playback request, and according to the target The video data is transmitted based on the expanded search results of the target video data.
A video content interaction method, the method comprising:

The video playing terminal sends a target video playing request;

The video playing terminal receives the target video data in response to the target video playing request, and the expanded search result based on the target video data;

The video playing terminal displays the selected search result according to the selection of the extended search result during the target video loading and playing.
A video content interaction device, comprising: a video request receiving unit, a video data providing unit, and a search result returning unit, wherein:

The video request receiving unit is configured to receive a target video playing request;

The video data providing unit is configured to provide target video data according to a target video playing request;

The search result returning unit is configured to send an extended search result based on the target video data according to the target video data.
A video content interaction device, comprising: a video request sending unit, a data receiving unit, and a search result presenting unit, wherein:

The video request sending unit is configured to send a target video playing request;

The data receiving unit is configured to receive target video data in response to the target video play request, and an extended search result based on the target video data;

The search result presentation unit is configured to display the selected search result according to the selection of the extended search result during the target video loading and playing process.