WO2014100936A1

WO2014100936A1 - Method, platform, and system for manufacturing associated information library of video and for playing video

Info

Publication number: WO2014100936A1
Application number: PCT/CN2012/087295
Authority: WO
Inventors: 杨素娟
Original assignee: 华为技术有限公司
Priority date: 2012-12-24
Filing date: 2012-12-24
Publication date: 2014-07-03
Also published as: CN104041063B; CN104041063A

Abstract

The present invention relates to the field of computers. Embodiments of the present invention provide a method, a platform, and a system for manufacturing an associated information library of a video and for playing the video. The method comprises: obtaining, from an original video, one or more continuous video frames according to life cycles of different targets to be set; determining, in one or more continuous video frames corresponding to one target, profile information and a display priority of the preset target in each video frame; and fabricating an associated information library of the original video according to the profile information and the display priority of the target in each video frame. In the present invention, one or more continuous video frames are obtained from an original video according to life cycles corresponding to targets, and profile information and a display priority of a target preset by a video production user are determined in the one or more continuous video frames, which solves the defect of the prior art that related information is blank when the target is overlapped by the background or other targets in the associated information library.

Description

Method, platform and system for video related information library production and video playing

The present invention relates to the field of computers, and in particular, to a method, a platform and a system for video related information library creation and video playing. Background technique

The interactive video can display the specific information of the person or thing in the video, such as the introduction information of the characters in the video, the detailed introduction information of the clothes worn by the characters in the video, etc., and can provide the viewer with convenient and highly targeted services. Therefore, it has broad application prospects.

The existing interactive video production and display methods mainly include: First, segmenting one or more target objects from the entire video according to the contour matching manner; second, automatically classifying the segmented one or more target objects, each The target object corresponds to the basic information of a target object. The basic information of the target object can be customized by the developer. For example, if a target object is a piece of clothing, the corresponding brand description, price information, purchase address, etc. of the clothes will be It is saved in the basic information of the clothing target object; thirdly, when it is detected that the video of the video viewing user points to the target object in the video screen, the content to be displayed in the basic information of the target object is displayed to the viewing user.

In the process of implementing the present invention, the inventors have found that at least the following problems exist in the prior art: When there are multiple target objects in the same picture and each target object overlaps, the basic information of matching and displaying the target object cannot be normally implemented. The content displayed. Summary of the invention

In view of this, the embodiments of the present invention provide a method, a platform, and a system for creating and storing a video related information library, so as to solve the problem of poor interactive video production in the prior art. The technical solution is as follows:

In one aspect, a method for creating a related information library of a video is provided, the method comprising: acquiring one or more consecutive picture frames from an original video according to a period of existence of different target objects to be set;

Determining the predetermined target in one or more consecutive picture frames corresponding to one target object The contour information of the object in each picture frame and the priority of the display;

And generating, according to the contour information of the target object in each picture frame and the priority of the display, the associated information library of the original video, where the related information library is a file read when playing the interactive video, and the target is saved. Basic information of the object and video interaction information, wherein the basic information of the target object includes content for display; the video interaction information includes contour information of the target object included in each picture frame and priority of display .

In a first possible implementation manner of the first aspect, the method further determines, before the contour information of the pre-selected target object in each picture frame, in the one or more consecutive picture frames corresponding to the target object Includes:

Display target object setting interface;

Displaying a target object setting interface; setting an object in a region determined by the video production user in the target object setting interface as a target object, and classifying the determined region contour information as the first target object Profile information, and carried in the video interaction information;

Establishing a correspondence between the first contour information of the target object carried in the video interaction information and the basic information of the target object defined by the video production user for the target object.

With reference to the first possible implementation manner of the first aspect, in a second possible implementation manner, after the object in the area determined by the video production user in the target object setting interface is set as the target object, the method further includes :

Obtaining the contour information of the target object in the determined region by using the contour extraction algorithm, and classifying the second contour information of the target object, and carrying the information in the video interaction information;

Establishing a correspondence between the second contour information of the target object carried in the video interaction information and the basic information of the target object defined by the video production user for the set target object.

With reference to the second possible implementation of the first aspect, in a third possible implementation, the determining, in the one or more consecutive picture frames corresponding to the target object, the preset target object in each picture frame The contour information in the details includes:

Obtaining feature information of the target object in the determined area, and calculating, by using a target tracking algorithm, first contour information and second contour information of the target object of the remaining ones of the one or more consecutive picture frames, and carrying In the video interaction information.

With reference to the first aspect, or the first possible implementation manner of the first aspect, in a fourth possible implementation, the basic information of the target object includes: an identifier of the target object, a name text of the target object, and a detailed One or more of an info text, image link, or video link; The correspondence between the first contour information of the target object carried in the video interaction information and the basic information of the target object defined by the video production user for the target object is specifically:

Establishing an association relationship between the first contour information of the target object carried in the video interaction information and the identifier of the target object, the name text of the target object, the detailed information text, the image link, or the video link .

In conjunction with the third possible or fourth possible implementation of the first aspect, in a fifth possible implementation, the method includes:

Setting an area corresponding to the first contour information of the target object in each picture frame as the first interaction area of the target object in each picture frame;

Setting an area corresponding to the second contour information of the target object in each picture frame as a second interaction area of the target object in each picture frame;

When the video playback platform detects a predefined operation of the first interaction area and the second interaction area by the user, displaying the target object corresponding to the second interaction area to be displayed in a more specific manner than the first interaction area. content.

In a second aspect, a video playing method is provided, where the method includes:

Parsing the original video and the associated information base of the original video, acquiring basic information and video interaction information of the target object in the associated information base of the original video, where the video interaction information includes a target object included in each picture frame The outline information and the priority of the display, the basic information of the target object contains the content for display;

When a predefined operation of the interaction area corresponding to the contour information of the target object in the currently played picture frame is detected, the basic information of the target object corresponding to the target object in the interaction area is displayed according to the displayed priority level. The content to be displayed.

In a first possible implementation manner of the second aspect, when there are multiple target objects in the currently played picture frame, and the interaction areas corresponding to the multiple target objects overlap, the priority according to the display The content to be displayed in the basic information of the target object corresponding to the target object in the interaction area includes:

The content to be displayed in the basic information of the target object corresponding to the target object having the higher priority displayed in the plurality of target objects is displayed.

In a second possible implementation manner of the second aspect, when there are multiple target objects in the currently played picture frame, and the interaction areas corresponding to the multiple target objects overlap, the displaying according to the The size of the priority value displays the content to be displayed in the basic information of the target object corresponding to the target object in the interaction area, and specifically includes:

The content to be displayed in the basic information of each target object corresponding to the plurality of target objects is displayed in descending order of the displayed priority.

With reference to the second aspect, the first possible implementation of the second aspect, or the second possible implementation of the second aspect, in a third possible implementation,

The predefined operations include at least one of a mouse pointing operation, a mouse click operation, a touch pen touch, a pointing movement operation of the mouse within the video, or a touch click operation.

The third aspect provides a video related information library creation platform, where the platform includes: an acquiring module, configured to acquire one or more consecutive picture frames from the original video according to the existence period of the different target objects to be set;

a contour information determining module, configured to determine, in one or more consecutive picture frames corresponding to a target object acquired by the acquiring module, contour information of the target object in each picture frame; the priority of the display is determined a module, configured to determine, in one or more consecutive picture frames corresponding to a target object acquired by the acquiring module, a preset priority of display of the target object in each picture frame;

And an associated information base creating module, configured to create an associated information base of the original video according to the contour information of the target object in each picture frame and the priority of the display, where the related information library is used for playing the interactive video The read file, the basic information of the target object and the video interaction information are saved; wherein the basic information of the target object includes content for display; the video interaction information includes a target object included in each picture frame The outline information and the priority of the display.

In a first possible implementation manner of the third aspect, the platform further includes:

Setting a display module for displaying a target object setting interface;

a first target object setting module, configured to set an object in a region determined by the video production user in the target object setting interface displayed by the setting display module as a target object, and set the determined region contour information The first contour information classified as the target object, and carried in the video interaction information;

The first correspondence establishing module is configured to establish a correspondence between the first contour information of the target object carried in the video interaction information and the basic information of the target object defined by the video production user for the target object.

In conjunction with the first possible implementation of the third aspect, in a second possible implementation, the platform further includes: a second target object setting module, configured to acquire contour information of the target object in the determined region by using a contour extraction algorithm, and classify the second contour information of the target object into the video mutual information; The relationship establishing module is configured to establish a correspondence between the second contour information of the target object carried in the video interaction information and the basic information of the target object defined by the video production user for the set target object.

With reference to the second possible implementation of the third aspect, in the third possible implementation manner of the third aspect, the profile information determining module includes:

a feature information acquiring unit, configured to acquire feature information of the target object in the determined region; a tracking unit, configured to calculate, by using a target tracking algorithm, a first target object of the remaining frame frames in the one or more consecutive picture frames The contour information and the second contour information are carried in the video interaction information.

With reference to the third aspect, or the first possible implementation manner of the third aspect, in a fourth possible implementation manner of the third aspect, the basic information of the target object includes: an identifier of the target object, and a target object One or more of a name text, a detailed information text, a picture link, or a video link; the first correspondence establishing module is specifically configured to establish first contour information of the target object carried in the video interaction information, and the The association of one or more of the identity of the target object, the name text of the target object, the detail text, the image link, or the video link.

With reference to the third possible implementation manner of the third aspect, or the fourth possible implementation manner of the third aspect, in a fifth possible implementation manner, the platform further includes: an interaction area setting module;

The interaction area setting module includes:

a first setting unit, configured to set an area corresponding to the first contour information of the target object in each picture frame as the first interaction area of the target object in each picture frame;

a second setting unit, configured to set an area corresponding to the second contour information of the target object in each picture frame as a second interaction area of the target object in each picture frame;

A fourth aspect provides a video related information base creation platform, where the platform includes: an I/O interface, a processor, a memory, and a display;

The processor is connected to the memory; one end of the I/O interface is connected to the processor and the memory, and the other end is connected to the display;

The processor is configured to obtain from the original video according to the existence period of different target objects to be set Take one to more consecutive picture frames;

The processor is further configured to determine contour information of the target object in each picture frame that is preset in one or more consecutive picture frames corresponding to a target object;

The processor is further configured to determine, in one or more consecutive picture frames corresponding to a target object, a priority of displaying the preset target object in each picture frame;

The processor is further configured to create an association information library of the original video according to the contour information of the target object in each picture frame and the priority of the display, where the related information library is used for playing the interactive video. The read file, the basic information of the target object and the video interaction information are saved; wherein the basic information of the target object includes content for display; the video interaction information includes a target object included in each picture frame The outline information and the priority of the display.

In a first possible implementation of the fourth aspect,

The processor is further configured to display a target object setting interface in the display;

The processor is further configured to set an object in a region determined by the video production user in the target object setting interface as a target object, and classify the determined region contour information as the first contour information of the target object, And carried in the video interaction information;

The processor is further configured to establish a correspondence between a target object carried in the video interaction information and basic information of a target object that is created by the video production user for the set target object.

In a second possible implementation of the fourth aspect,

The processor is further configured to acquire contour information of the target object in the determined region by using a contour extraction algorithm, and classify the second contour information of the target object, and carry the information in the video mutual information;

The processor is further configured to establish a correspondence between the second contour information of the target object carried in the video interaction information and the basic information of the target object that is set by the video production user for the set target object. .

With reference to the second possible implementation manner of the fourth aspect, in a third possible implementation, the processor is further configured to acquire feature information of the target object in the determined area, and calculate by using a target tracking algorithm The first contour information and the second contour information of the target object of the remaining ones of the one or more consecutive picture frames are carried in the video interaction information.

With reference to the fourth aspect, or the first possible implementation manner of the fourth aspect, in a fourth possible implementation manner of the fourth aspect, the basic information of the target object includes: an identifier of the target object, and a target object One or more of a name text, a detailed information text, a picture link, or a video link; the processor is specifically configured to establish a first round of the target object carried in the video interaction information An association relationship of the profile information with one or more of an identification of the target object, a name text of the target object, a detailed information text, a picture link, or a video link.

In combination with the third possible implementation manner of the fourth aspect or the fourth possible implementation manner of the fourth aspect, in a fifth possible implementation manner of the fourth aspect, the processor is further configured to The area corresponding to the first contour information of the target object is set as the first interaction area of the target object in each picture frame; and the area corresponding to the second contour information of the target object in each picture frame is set as the each picture a second interaction area of the target object in the frame;

A fifth aspect provides a video playing platform, where the platform includes:

a parsing module, configured to parse the original video and the associated information base of the original video, and obtain basic information and video interaction information of the target object in the associated information base of the original video, where the video interaction information includes each picture frame The outline information of the target object and the priority of the display, the basic information of the target object containing the content for display;

The information display module is configured to: when detecting a predefined operation of the interaction area corresponding to the contour information of the target object in the currently played picture frame, the display corresponding to the target object in the interaction area according to the displayed priority The content to be displayed in the basic information of the target object.

In a first possible implementation manner of the fifth aspect, the information display module is further configured to: a plurality of target objects exist in the currently played picture frame, and the interaction areas corresponding to the multiple target objects overlap And displaying content to be displayed in basic information of the target object corresponding to the target object with higher priority displayed in the plurality of target objects.

In a second possible implementation manner of the fifth aspect, the information display module is further configured to: a plurality of target objects exist in the currently played picture frame, and the interaction areas corresponding to the multiple target objects overlap The content to be displayed in the basic information of each target object corresponding to the plurality of target objects is displayed in order according to the priority of the displayed priority.

A sixth aspect provides a video playing platform, where the platform includes: an I/O interface, a processor, a memory, and a display;

The processor, configured to parse an original information and an associated information base of the original video, to obtain the The basic information of the target object and the video interaction information in the associated information base of the original video, where the video interaction information includes the outline information of the target object included in each picture frame and the priority of the display, and the basic information of the target object Contains content for display;

The processor is further configured to: when detecting a predefined operation of the interaction area set by the interaction area setting module corresponding to the contour information of the target object in the currently played picture frame, according to the displayed priority, The content to be displayed in the basic information of the target object corresponding to the target object in the interaction area is displayed in the display.

In a first possible implementation of the sixth aspect

The processor is further configured to: when there are multiple target objects in the currently played picture frame, and the interaction areas corresponding to the multiple target objects overlap, display the multiple target objects in the display The content to be displayed in the basic information of the target object corresponding to the higher priority target object displayed in the middle.

In a second possible implementation of the sixth aspect,

The processor is further configured to: when there are multiple target objects in the currently played picture frame, and the interaction areas corresponding to the multiple target objects overlap, according to the order of priority of the display, from high to low, The content to be displayed in the basic information of each target object corresponding to the plurality of target objects is displayed in the display in order.

The seventh aspect provides a video related information library production and video playing system, wherein the system includes:

The video association information library creation platform according to the above third aspect, and the video playback platform as described in the fifth aspect above.

The beneficial effects of the technical solutions provided by the embodiments of the present invention are:

Resolving the current information by acquiring one or more consecutive picture frames from the original video according to the existence period corresponding to the target, and determining the contour information and the priority of the display of the target object preset by the video production user in the one or more consecutive picture frames In the related information library produced in the technology, there is a shortage of related information blanks when the target object is covered by the background or other objects. DRAWINGS

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings used in the description of the embodiments will be briefly described below. It is obvious that the drawings in the following description are only some embodiments of the present invention. For those of ordinary skill in the art, without creative efforts, Other drawings can also be obtained from these figures.

1 is a flow chart of a method for fabricating a related information library of a video according to an embodiment of the present invention;

2 is a flow chart of a method for fabricating a related information base of a video according to another embodiment of the present invention;

FIG. 3 is a flowchart of calculating a difference between adjacent frames according to another embodiment of the present invention; FIG.

4 is a schematic diagram of a target object setting interface according to another embodiment of the present invention;

5 is a schematic diagram of priority adjustment of a target object display according to another embodiment of the present invention; FIG. 6 is a structural diagram of a related information library of a video according to another embodiment of the present invention;

FIG. 7 is a flowchart of a method for playing a video according to an embodiment of the present invention; FIG.

FIG. 8 is a flowchart of a method for playing a video according to another embodiment of the present invention; FIG.

FIG. 9 is a structural diagram of an apparatus for creating a related information base of a video according to an embodiment of the present invention; FIG.

FIG. 10 is a structural diagram of an apparatus for creating a related information base of a video according to another embodiment of the present invention; FIG.

FIG. 11 is a structural diagram of an apparatus for creating a related information base of a video according to an embodiment of the present invention; FIG.

FIG. 12 is a structural diagram of an apparatus for creating a related information base of a video according to another embodiment of the present invention; FIG.

FIG. 13 is a structural diagram of a device of a video playing platform according to an embodiment of the present invention; FIG.

FIG. 14 is a structural diagram of a device of a video playing platform according to another embodiment of the present invention; FIG.

FIG. 15 is a structural diagram of a device of a video playing platform according to an embodiment of the present invention; FIG.

16 is a structural diagram of a device of a video playing platform according to another embodiment of the present invention;

17 is a system configuration diagram of a related information library creation and video playback system for video according to an embodiment of the present invention;

FIG. 18 is a flowchart showing the working process of the related information library creation and video playing system of the video according to an embodiment of the present invention. detailed description

The embodiments of the present invention will be further described in detail below with reference to the accompanying drawings. FIG. 1 is a flowchart of a method for fabricating a related information base of a video according to an embodiment of the present invention. The method may include:

Step 101: Acquire one or more consecutive picture frames from the original video according to the existence period of different target objects to be set;

Step 102: Determine, in one or more consecutive picture frames corresponding to a target object, contour information and a priority of the display of the preset target object in each picture frame;

Step 103: Create an association information library of the original video according to the contour information of the target object in each picture frame and the priority of the display, where the associated information library is a file read when playing the interactive video, and the basic object of the target object is saved. Information and video interaction information; wherein the basic information of the target object includes content for display; the video interaction information includes contour information of the target object included in each picture frame and a priority of the display.

In summary, the method for creating a related information library of a video provided by the embodiment of the present invention acquires one or more consecutive picture frames from the original video according to the existence period corresponding to the target, and determines the video production in the one or more consecutive picture frames. The contour information of the target object preset by the user and the priority of the display solve the problem that the related information in the prior art is insufficient for the target object to be covered by the background or other objects. For further description of the method for creating a related information library of the video provided in the previous embodiment, please refer to FIG. 2, which is a flowchart of a method for fabricating a related information library of a video according to another embodiment of the present invention. Can include:

Step 201: The production platform acquires one or more consecutive picture frames from the original video according to the existence period of different target objects to be set;

A video file consists of a series of picture frames, each picture frame being an image picture. In the video, a target object may exist only in a certain period. When the target object is subjected to contour extraction and tracking, only the frame frame containing the target object needs to be processed. Therefore, one or more consecutive picture frames may be acquired from the original video according to the existence period of different target objects to be set, and the one or more consecutive picture frames may be referred to as one picture frame group, and the production platform separately for each picture frame group The processing is performed, so that the video production user separately sets the target object in the corresponding picture frame for different scenes, where each picture frame group includes at least one picture frame.

Considering that a target object changes little in the same scene, for example, the clothes of the same person in the same scene generally do not change, therefore, according to the existence period of different target objects to be set When acquiring one or more consecutive picture frames from the original video, it may be considered to divide the video into a series of picture frame groups according to different scenes.

In an actual application, it may be determined whether two adjacent picture frames are abrupt frames to determine whether two adjacent picture frames belong to the same scene. It is generally believed that there are two main types of switching between shots in a video: mutations and gradations. Mutations are sudden changes between shots that are typically done between two frames of image. Gradient changes slowly from one lens to another, typically extending a dozen or tens of frames. In the same video scene, the background of the video object is the same or similar. Therefore, the lens of the same scene can be considered as a gradation lens, and a series of consecutive picture frames corresponding to the gradation lens between the two abrupt lenses are divided into one. Picture frame group. In this embodiment, HSV (Hue, Saturation, Value, Chroma, Saturation, Luminance) histogram eigenvalues are used to detect the lens boundary, and an adaptive lens detection based on inter-frame difference and non-adjacent inter-frame difference is used. method. Among them, the adaptive method based on the difference between adjacent frames can detect the abrupt lens well, and the adaptive method based on the difference between non-adjacent frames can detect the gradual lens well. The combination of the two will be very good. Detect various types of mutations and gradient lenses. Referring to the flowchart for calculating the inter-frame difference value shown in FIG. 3, the embodiment of the present invention uses an adaptive detection method based on the difference between adjacent frames as an example to introduce the lens detection method in detail:

Where a is a preset lens boundary detection threshold coefficient, and the statistical result indicates that "the general 5~6 is optimal; the NFD (the adjacent frame difference) video stream is adjacent to two frames. Inter-frame difference; Mean is the average of the difference between frames in the window; Sum is the sum of the differences between adjacent frames; Count is the cumulative number of differences between frames.

The specific process of the algorithm is as follows:

Step 1 program starts;

Step 2, when reading the picture frame for the first time, reading the adjacent two frames of the video stream, starting from the first frame and the second frame; if not reading the picture frame for the first time, reading only one frame of the image;

Step 3 converts the read picture frame image into an HSV model and quantizes it into 72 color spaces, and calculates a histogram;

Step 4 calculates a difference NFD from the histogram of the previous frame image;

Step 5 determines whether the NFD is less than α times of Mean, and if so, it indicates that there is a gradation between the read frame and the previous frame, and proceeds to step 6, otherwise it is a mutation, and proceeds to step 7;

Step 6 accumulates statistical information; Step 7, resets the statistical information.

The calculation method of the adaptive detection method based on the difference between the non-adjacent frames is similar to the above-described adaptive detection method based on the difference between the adjacent frames, except that the read picture frame is a non-adjacent frame, and this embodiment No longer. Step 202: The production platform displays a target object setting interface, and sets an object in a region determined by the video production user in the target object setting interface as a target object, and classifies the determined region contour information as the target object. The first contour information is carried in the video interaction information;

The contour information corresponding to the target object may include the first contour information and the second contour information, where the first contour information may be contour information manually determined by the video production user, and the second contour information may be contour information of the target object itself. . The contour information may specifically be an area i or a coordinate indicating an area included in the outline.

The production platform can provide the target object setting function to the video production user. Specifically, the target object setting interface can be displayed to the video production user, and the video production user sets one or more for each picture frame group in the target object setting interface. The target object is classified into the first contour information of the target object, and the first contour information is carried in the video interaction information. The contour information may specifically be the coordinates of the determined area. For example, the target object setting interface diagram shown in FIG. 4, wherein the car is the target object, the outline of the dotted frame pointed by the mouse is the contour of the area defined by the video production user, and the contour information corresponding to the dotted frame is the car's First contour information.

Step 203: The production platform establishes a correspondence between the first contour information of the target object carried in the video interaction information and the basic information of the target object defined by the video production user for the target object. After the video production user sets the target object, Basic information about the respective target objects can be defined for the set target objects. For example, if the target object in the frame group a is a car, the video production user can name the car, detailed information (such as manufacturer name, place of production, price information, preferential information, official website link, etc.), the car's Related pictures, videos, etc. are formulated as basic information of the target object of the target object. It should be noted that, for the same person or object in different scenes, different target objects may be set according to the situation. For example, a certain character A wears a coat of a certain brand style in the picture frame group a, and is in the picture frame group a. When the target object 1 is set and the character A wears another brand style trousers in another picture frame group b, the video production user can set the character A as the target object 3 in the picture frame group b. And the basic information of the corresponding target object is formulated as the basic information of the trousers of the brand style.

The production platform classifies the determined area contour information into the first contour information of the target object, and carries the first contour information of the target object carried in the video interaction information and the video production user as the target after being carried in the video interaction information. The correspondence between the basic information of the target object formulated by the object.

Step 204: The production platform uses the contour extraction algorithm to obtain the contour information of the target object in the determined region, and is classified into the second contour information of the target object, and is carried in the video interaction information. After the production platform classifies the region contour information determined by the video production user as the first contour information of the target object, the contour extraction algorithm is further used to obtain the contour information of the target object in the determined region, and is classified as the target object. Two contour information, and carried in the video interaction information. Still taking the target setting interface diagram shown in FIG. 4 as an example, the production platform may use the contour extraction algorithm to obtain the contour information of the automobile in the map, and classify the contour information of the automobile into the second contour information of the automobile, and The second profile information is carried in the video interaction information. The contour extraction algorithm can be implemented by using the prior art, and details are not described in this embodiment.

Step 205: The production platform establishes a correspondence between the second contour information of the target object carried in the video interaction information and the basic information of the target object defined by the video production user for the set target object.

Correspondingly, the production platform classifies the contour information of the target object obtained by the contour extraction algorithm into the second contour information of the target object, and after being carried in the video interaction information, the second object of the target object carried in the video interaction information is also required to be established. The correspondence between the contour information and the basic information of the target object defined by the video production user for the target object.

Step 206: The production platform acquires feature information of the target object in the determined region, and uses the target tracking algorithm to calculate first contour information and second contour information of the target object of the remaining frame frames in the one or more consecutive picture frames, and Carry in the video interaction information;

The production platform can acquire the feature information of the target object that is generated by the video production user, and automatically determine the specific region of the target object in each of the remaining frame frames of the corresponding picture frame group by using the target tracking algorithm, and obtain the corresponding first contour information. And the second contour information, and the first contour information and the second contour information of the target object in each picture frame are carried in the video interaction information. This step is also referred to as the target object trajectory generation, and can be implemented based on a specific algorithm, such as a TLD (Tracking, Learning, Detecting, Tracking, Learning, Detection) algorithm, and the algorithm of the present invention does not perform the target object trajectory generation. Specifically limited.

It should be noted that, in practical applications, the production platform may not extract the second contour information of the target object. In this case, the production platform only needs to use the target tracking algorithm to calculate the target object of the remaining image frames in the one or more consecutive picture frames. The first contour information is sufficient.

Step 207: Set an area corresponding to the first contour information and the second contour information of the target object in each picture frame as a first interaction area and a second interaction area of the target object in each picture frame;

The production platform sets an area corresponding to the first contour information of the target object in each picture frame as a first interaction area of the target object in each picture frame, and a second contour letter of the target object in each picture frame The area corresponding to the information is set as the second interaction area of the target object in each picture frame, so that the video playing platform compares the first interaction area when detecting the predefined operation of the first interaction area and the second interaction area by the user. A more specific manner displays the content of the target object corresponding to the second interaction area to be displayed.

The contour information may be an area coordinate, and the production platform sets the corresponding area in the picture frame as an interaction area according to the area coordinates indicated by the contour information of the target object in each picture frame.

Similarly, if the production platform does not extract the second contour information of the target object, only the region corresponding to the first contour information of the target object in each screen frame needs to be set as the first interaction region of the target object in each screen frame. can.

Step 208: The production platform displays a target object priority setting interface, and sets a priority of display in each frame frame according to an operation instruction of the video creation user in the target object priority setting interface.

When there are multiple target objects in a certain frame, the target areas of the multiple target objects may overlap. In this case, the video production user needs to set the display priority for the overlapping target objects, so that the video playing platform can The basic information corresponding to the higher priority target object that is preferentially displayed in the overlapping target area. For details, refer to the priority adjustment diagram of the target object display shown in FIG. 5, where the target object is the character A, and the display level is the priority displayed by the target object, and the target object A is displayed in the picture frame. The number of display levels in the 0 to picture frame 156 is set to 9, by which the video production user can freely define the priority of display of each target object in each picture frame. The production platform saves the priority of the display of the target object to subsequently add the priority of the display of the target object to the associated information base of the video.

Step 209: The production platform creates an associated information library of the original video according to the contour information of the target object in each picture frame, where the related information library is a file that is read when playing the interactive video, and saves basic information of the target object and Video interaction information, wherein the basic information of the target object includes content for display.

Specifically, the production platform saves the contour information (including the first contour information and the second contour information) of the target object in each picture frame, and the correspondence relationship between the target object and the basic information of the target object in a file, where the file is called The associated information library of the original video can be in XML (Extensible Markup Language) file format or database format, and finally used by the video playback platform.

Taking an association information base structure diagram shown in FIG. 6 as an example, the related information base may include original video basic information, basic information of a target object, and video interaction information. Where the base of the target object This information includes the identifier of each target object and the content to be displayed, such as one or more of the name text, detailed information text, image link or video link of each target object; the video interaction information includes: The identifier of the target object, the outline information of the target object included in each screen frame, and the priority of the display of the target object included in each screen frame. The mapping between the first contour information of the target object carried in the video interaction information and the basic information of the target object defined by the video production user for the target object is created in the step 203, which is specifically carried in the video interaction information. The first contour information of the target object is associated with one or more of the identifier of the target object, the name text of the target object, the detailed information text, the image link, or the video link; in step 205, the production platform establishes the video interaction Corresponding relationship between the second contour information of the target object carried in the information and the basic information of the target object defined by the video production user for the set target object, specifically for establishing the second contour information of the target object carried in the video interaction information An association with one or more of the identity of the target object, the name text of the target object, the detail text, the image link, or the video link.

It should be noted that the related information database shown in FIG. 6 stores the basic information of the target object and the video interaction information in two different storage structures, and associates with the identifier of the target object, and in actual application, The basic information of the target object and the video interaction information and the corresponding relationship are stored in the same storage structure, which is not specifically limited in this embodiment.

The method for creating a related information library of a video provided by the embodiment of the present invention firstly obtains one or more consecutive picture frames from the original video, and then determines the target object and extracts the contour information in one of the picture frames according to the manual operation of the video production user. Finally, the target tracking algorithm is used to determine the contour information of the target object in each of the one or more picture frames, and the semi-automatic target object contour information extraction method is compared with the existing object-based segmentation and classification method. In terms of accuracy and efficiency, there has been further improvement.

In addition to the above-mentioned accuracy and efficiency improvement, the method for creating a related information library of a video provided by the embodiment of the present invention also adopts a method for distinguishing display between the first contour and the second contour, which is more in line with the user's law of receiving information, that is, The interaction area is from far to near corresponding to the display of information from as little as possible. Referring to FIG. 7, a flowchart of a method for playing a video according to an embodiment of the present invention is shown. The video playing method can be used to play an interactive video to a video on demand user on a video playing platform and interact with the user according to the operation of the video on demand user. The video playing method can include: Step 301: Parse the association information library of the original video and the original video, and obtain basic information and video interaction information of the target object saved in the associated information base of the original video, where the video interaction information includes the contour of the target object included in each picture frame. The priority of the information and display, the basic information of the target object contains the content for display;

Step 302: When detecting a predefined operation on the interaction area corresponding to the contour information of the target object in the picture frame currently played by the user, displaying the basic information of the target object corresponding to the target object in the interaction area according to the displayed priority The content to be displayed in the message.

In summary, the video playing method provided by the embodiment of the present invention analyzes the associated information library of the original video and the original video, and displays the priority according to the target object in the associated information base and the basic information of the target object to be displayed. The content displays the interactive video to the target user, and solves the problem in the prior art that when there are multiple target objects in the same screen and each target object overlaps, the content to be displayed in the basic information of matching and displaying the target object cannot be normally realized. For a more detailed description of the video playing method provided in the previous embodiment, please refer to FIG. 8 , which is a flowchart of a method for playing a video according to another embodiment of the present invention. The video playing method can be used to play an interactive video to a video on demand user on a video playing platform and interact with the user according to the operation of the video on demand user. The video playing method can include:

Step 401: The video playing platform parses the association information library of the original video and the original video, and acquires basic information and video interaction information of the target object saved in the associated information base of the original video, where the video interaction information includes the target included in each picture frame. The outline information of the object and the priority of the display, the basic information of the target object contains the content for the display;

The associated information base includes at least basic information of the target object and video interaction information; the basic information of the target object includes the identifier of each target object and the content to be displayed, for example: name text of each target object, detailed information text One or more of a picture link or a video link; the video interaction information includes: an identifier of a target object included in each picture frame, contour information of a target object included in each picture frame, and a target object included in each picture frame The priority of the display; the specific associated information base can be as shown in Figure 6.

Step 402: When detecting a predefined operation of the interaction area corresponding to the contour information of the target object in the currently played picture frame, displaying the target object corresponding to the target object in the interaction area according to the displayed priority The content to be displayed in the basic information.

Specifically, when the video playing platform detects a predefined operation of the interaction area by the user, querying the The content to be displayed in the basic information of the target object associated with the contour information corresponding to the interaction area is displayed to the user.

Among them, the user can have a plurality of predefined operations on the interactive area, such as a mouse pointing operation, a mouse click operation, a touch pen sensing, a mouse pointing movement operation within the video, or a touch click operation. When the video playing platform detects the user's predefined operation on the interactive area, for example, the mouse points to the target area, the content to be displayed in the basic information of the target object corresponding to the interactive area may be queried and displayed to the user.

In addition, there are many kinds of content to be displayed in the basic information of the target object to the user, such as:

The content to be displayed in the basic information of the target object may be divided into the summary content corresponding to the target object (such as the name of the target object) and the specific content corresponding to the target object (such as a detailed text description of the target object, related pictures or videos, etc.), The target object can be configured with two interaction areas, that is, the first interaction area and the second interaction area, in one picture frame. Therefore, the content to be displayed in the basic information of the display target object can be divided into two display modes, that is, The first display mode and the second display mode.

When the operation of the first interaction area of the target object is detected, the content to be displayed in the basic information of the target object may be displayed to the user according to the first display manner; when the operation of the second interaction area of the target object is detected, The content to be displayed in the basic information of the target object may be displayed to the user according to the second display mode. The first display mode and the second display mode may be different, for example: the first display mode is to display the summary content of the target object next to the target object, and the second display mode is to display the target object next to the target object. Specific content;

Or,

The first display mode is to display the first interactive area or the second interactive area corresponding to the target object in the target object area, and the second display mode is to display the specific content of the target object next to the target object;

Or,

The first display mode is to display the specific content of the target object semi-transparent next to the target object, and the second display mode is to cover the specific content of the target object next to the target object.

In addition, if there are multiple target objects in the currently played picture frame, and the interaction areas corresponding to the multiple target objects overlap, when the video playing platform detects the predefined operation of the interaction area by the user, according to the displayed priority, Displaying content to be displayed in the basic information of the target object corresponding to the target object with higher priority displayed in the plurality of target objects, for example, if the two target objects a and b correspond to If the interaction area overlaps, and the display of the target object a has a higher priority, only the content to be displayed in the basic information of the target object corresponding to the target object a is displayed; or, the display priority is displayed in descending order of priority. The content to be displayed in the basic information of each target object corresponding to the target objects a and b, for example, the target object a with the highest priority is displayed, and the background of the content to be displayed is darker, and the target object with lower priority is displayed. The background of the content to be displayed corresponding to b is lighter.

In summary, the video playing method provided by the embodiment of the present invention receives an interactive information library of the original video and the original video, and displays an interactive video to the target user according to the priority displayed by the target object in the associated information database, and On the basis of this, the presentation manner of the associated information base is enriched, and the specific information for providing the interactive information according to the target redemption display priority is provided, which avoids the redundancy of the presentation provided by all the information in the prior art; The information transition provided by this solution also makes the processing more efficient, without providing all the associated information for each interaction as in the prior art. Referring to FIG. 9, FIG. 9 is a structural diagram of an apparatus for creating a platform of a related information library of a video according to an embodiment of the present invention. The video's associated repository creation platform can be used to create the associated information base necessary to play interactive video. The associated information base production platform of the video may include:

The obtaining module 501 is configured to acquire one or more consecutive picture frames from the original video according to the existence period of the different target objects to be set;

The contour information determining module 502 is configured to determine contour information of a preset target object in each picture frame in one or more consecutive picture frames acquired by the obtaining module 501;

The displayed priority determining module 503 is configured to determine, in the one or more consecutive picture frames acquired by the obtaining module 501, a priority of display of the preset target object in each picture frame;

The associated information base creating module 504 is configured to create a related information library of the original video according to the contour information of the target object in each picture frame and the priority of the display, where the related information library is a file read when playing the interactive video. The basic information of the target object and the video interaction information are saved; wherein the basic information of the target object includes the content to be displayed; the video interaction information includes the contour information of the target object included in each picture frame and the priority of the display. .

In summary, the association information base of the video provided by the embodiment of the present invention acquires one or more consecutive picture frames from the original video according to the existence period corresponding to the target, and determines the video production in the one or more consecutive picture frames. The contour information of the target object preset by the user and the priority of the display solve the problem that the related information in the prior art is insufficient for the target object to be covered by the background or other objects. FIG. 10 is a structural diagram of an apparatus for creating a related information base of a video according to another embodiment of the present invention. The video's associated repository production platform can be used to create a library of associated information needed to play interactive video. The associated information base production platform of the video may include:

The obtaining module 601 is configured to acquire one or more consecutive picture frames according to different scenarios. The contour information determining module 602 is configured to determine, in the one or more consecutive picture frames acquired by the obtaining module 601, a preset target object in each Outline information in frame frames;

The displayed priority determining module 603 is configured to determine, in the one or more consecutive picture frames acquired by the obtaining module 601, a priority of display of the preset target object in each picture frame;

The associated information base creating module 604 is configured to create a related information library of the original video according to the contour information of the target object in each picture frame and the priority of the display, where the related information library is a file read when playing the interactive video. The basic information of the target object and the video interaction information are saved; wherein the basic information of the target object includes the content to be displayed; the video interaction information includes the contour information of the target object included in each picture frame and the priority of the display. .

The video related database creation platform also includes:

a setting display module 605, configured to display a target object setting interface;

The first target object setting module 606 is configured to set an object in the region determined by the video creation user in the target object setting interface displayed by the setting display module 605 as the target object, and set the determined region contour information. The first contour information classified as the target object, and carried in the video interaction information;

The first correspondence establishing module 607 is configured to establish a correspondence between the first contour information of the target object carried in the video interaction information and the basic information of the target object defined by the video production user for the target object.

The basic information of the target object includes: one or more of an identifier of the target object, a name text of the target object, a detailed information text, a picture link, or a video link;

The first correspondence establishing module 607 is specifically configured to establish a first contour information of the target object carried in the video interaction information, an identifier of the target object, a name text of the target object, a detailed information text, a picture link, or a video link. One or more associations.

The video related database creation platform also includes:

a second target object setting module 608, configured to acquire contour information of the target object in the determined region by using a contour extraction algorithm, and classify the second contour information of the target object, and carry the information in the video mutual information; The second correspondence establishing module 609 is configured to establish a correspondence between the second contour information of the target object carried in the video interaction information and the basic information of the target object defined by the video production user for the target object.

In addition, the contour information determining module 602 includes:

The feature information acquiring unit 602a is configured to acquire feature information of the target object in the determined region; the tracking unit 602b is configured to calculate, by using the target tracking algorithm, the first contour information of the target object of the remaining frame frames in the one or more consecutive picture frames And the second contour information, and carried in the video interaction information.

The platform further includes: an interaction area setting module 610;

The interaction area setting module 610 includes:

a first setting unit 610a, configured to set an area corresponding to the first contour information of the target object in each picture frame as a first interaction area of the target object in each picture frame;

a second setting unit 610b, configured to set an area corresponding to the second contour information of the target object in each picture frame as a second interaction area of the target object in each picture frame;

When the video playing platform detects the predefined operation of the first interaction area and the second interaction area by the user, displaying the content to be displayed of the target object corresponding to the second interaction area in a more specific manner than the first interaction area. .

In summary, the related information library creation platform of the video provided by the embodiment of the present invention firstly obtains one or more consecutive picture frames from the original video, and then determines the target object in one of the picture frames according to the manual operation of the video production user. And extracting contour information, and finally using the target tracking algorithm to determine contour information of the target object in each of the one or more picture frames, the semi-automatic target object contour information extraction method is compared with the existing object-based object In terms of segmentation and classification methods, accuracy and efficiency have been further improved.

In addition to the above-mentioned improvements in accuracy and efficiency, the associated information base creation platform of the video provided by the embodiment of the present invention also adopts a method for distinguishing display between the first contour and the second contour, which is more in line with the user's law of receiving information, that is, The interaction area is from far to near corresponding to the display of information from as little as possible. FIG. 11 is a structural diagram of a device for creating a related information base of a video according to an embodiment of the present invention. The associated information base creation platform of the video may be used to create an associated information base necessary for playing interactive video. . The associated information base production platform of the video may include: at least one I/O interface 001, at least one processor 002, such as a CPU, a memory 003, and a display 004; the memory 003 may include a high speed RAM memory, and may also include non-unstable Memory (non-volatile memory), such as at least one disk storage. The memory 003 can optionally include at least one storage device located remotely from the aforementioned processor 002. In some embodiments, the memory 003 stores the following elements, modules or data structures, or a subset thereof, or their extension set:

Operating system 0031, which contains various programs for implementing various basic services and handling hardware-based tasks;

The application module 0032 includes one or a combination of the following modules: an acquisition module, a contour information determination module, a displayed priority determination module, and an associated information base creation module. The function of the above module may refer to the description part of the device structure diagram shown in FIG. , will not repeat them here.

The processor 002 is connected to the memory 003; the I/O interface 001 is connected to the processor 002 and the memory 003, and the other end is connected to the display 004;

The processor 002 is configured to obtain one or more consecutive picture frames from the original video according to the existence period of different target objects to be set;

The processor 002 is further configured to determine contour information of the preset target object in each picture frame in one or more consecutive picture frames corresponding to a target object;

The processor 002 is further configured to determine, in one or more consecutive picture frames corresponding to a target object, a priority of display of the preset target object in each picture frame;

The processor 002 is further configured to create a related information library of the original video according to the contour information of the target object in each picture frame and the priority of the display, where the related information library is a file that is read when playing the interactive video, and is saved. The basic information of the target object and the video interaction information, wherein the basic information of the target object includes the content to be displayed; the video interaction information includes the outline information of the target object included in each picture frame and the priority of the display.

In summary, the association information base of the video provided by the embodiment of the present invention acquires one or more consecutive picture frames from the original video according to the existence period corresponding to the target, and determines the video production in the one or more consecutive picture frames. The contour information of the target object preset by the user and the priority of the display solve the problem that the related information in the prior art is insufficient for the target object to be covered by the background or other objects. Referring to FIG. 12, it is a structural diagram of a device for creating a related information library of a video according to another embodiment of the present invention. The associated information base of the video can be used to create related information necessary for playing interactive video. Library. The associated information base production platform of the video may include at least one I/O connection Port 005, at least one processor 006, such as CPU, memory 007, and display 008; memory 007 may include high speed RAM memory, and may also include non-volatile memory, such as at least one disk memory. The memory 007 can optionally include at least one storage device located remotely from the aforementioned processor 006. In some embodiments, memory 007 stores the following elements, modules or data structures, or a subset thereof, or their extension set:

Operating system 0071, which contains various programs for implementing various basic services and handling hardware-based tasks;

The application module 0072 includes one or a combination of the following modules: an acquisition module, a contour information determination module, a displayed priority determination module, an associated information base creation module, a setting display module, a first target object setting module, and a first correspondence relationship. The module, the second target object setting module, the second correspondence relationship establishing module, and the interaction area setting module are provided. The function of the above module may be referred to the description of the device structure diagram shown in FIG. 10, and details are not described herein again.

The processor 006 is connected to the memory 007; the I/O interface 005 is connected to the processor 006 and the memory 007, and the other end is connected to the display 008;

The processor 006 is configured to obtain one or more consecutive picture frames from the original video according to the existence period of different target objects to be set;

The processor 006 is further configured to determine contour information of the preset target object in each picture frame in one or more consecutive picture frames corresponding to a target object;

The processor 006 is further configured to determine, in one or more consecutive picture frames corresponding to a target object, a priority of display of the preset target object in each picture frame;

The processor 006 is further configured to create a related information library of the original video according to the contour information of the target object in each picture frame and the priority of the display, where the related information library is a file that is read when playing the interactive video, and is saved. The basic information of the target object and the video interaction information, wherein the basic information of the target object includes the content to be displayed; the video interaction information includes the outline information of the target object included in each picture frame and the priority of the display.

The processor 006 is further configured to display a target object setting interface on the display 008;

The processor 006 is further configured to set an object in the area determined by the video production user in the target object setting interface as the target object, and classify the determined area contour information as the first contour information of the target object, and Carry in the video interaction information;

The processor 006 is further configured to establish a correspondence between the target object carried in the video interaction information and the basic information of the target object defined by the video production user for the set target object. The basic information of the target object includes: one or more of an identifier of the target object, a name text of the target object, a detailed information text, a picture link, or a video link;

The processor 006 is specifically configured to establish the first contour information of the target object carried in the video interaction information, the identifier of the target object, the name text of the target object, the detailed information text, the image link, or the video link. Relationship.

The processor 006 is further configured to use the contour extraction algorithm to obtain the contour information of the target object in the determined region, and classify the second contour information of the target object, and carry the information in the video mutual information;

The processor 006 is further configured to establish a correspondence between the second contour information of the target object carried in the video interaction information and the basic information of the target object defined by the video production user for the set target object.

The processor 006 is further configured to acquire feature information of the target object in the determined region, and calculate, by using a target tracking algorithm, first contour information and second contour information of the target object of the remaining frame frames in the one or more consecutive picture frames. And carried in the video interaction information.

The processor 006 is further configured to: set an area corresponding to the first contour information of the target object in each picture frame as a first interaction area of the target object in each picture frame; and set a second contour of the target object in each picture frame The area corresponding to the information is set as the second interaction area of the target object in each picture frame; so that the video playing platform detects the user's predefined operations on the first interaction area and the second interaction area, compared to the first interaction area. A more specific manner displays the content of the target object corresponding to the second interaction area to be displayed.

In addition to the above-mentioned improvements in accuracy and efficiency, the associated information base creation platform of the video provided by the embodiment of the present invention also adopts a method for distinguishing display between the first contour and the second contour, which is more in line with the user's law of receiving information, that is, The interaction area is from far to near corresponding to the display of information from as little as possible. FIG. 13 is a structural diagram of a device of a video playing platform according to an embodiment of the present invention. The video playing platform may be used to play an interactive video to a video on demand user. The video plays flat The station can include:

The parsing module 701 is configured to parse the associated information base of the original video and the original video, and obtain basic information and video interaction information of the target object saved in the associated information base of the original video, where the video interaction information includes the target included in each picture frame. The outline information of the object and the priority of the display, the basic information of the target object contains the content for the display;

The information display module 702 is configured to: when detecting a predefined operation of the interaction area corresponding to the contour information of the target object in the currently played picture frame by the user, displaying, according to the displayed priority, the target object corresponding to the target object in the interaction area The content to be displayed in the basic information of the target object.

In summary, the video playing platform provided by the embodiment of the present invention parses the associated information library of the original video and the original video, and displays the priority according to the target object in the associated information base and the basic information of the target object to be displayed. The content displays the interactive video to the target user, and solves the problem in the prior art that when there are multiple target objects in the same screen and each target object overlaps, the content to be displayed in the basic information of matching and displaying the target object cannot be normally realized. Referring to FIG. 14, a structural diagram of a device of a video playing platform according to another embodiment of the present invention is shown. The video playback platform can be used to play interactive video to a video on demand user. The video playback platform can include:

The parsing module 801 is configured to parse the associated information base of the original video and the original video, and obtain basic information and video interaction information of the target object saved in the associated information base of the original video, where the video interaction information includes the target included in each picture frame. The outline information of the object and the priority of the display, the basic information of the target object contains the content for the display;

The information display module 802 is configured to: when detecting a predefined operation of the interaction area corresponding to the contour information of the target object in the currently played picture frame by the user, displaying, according to the displayed priority, the target object corresponding to the target object in the interaction area The content to be displayed in the basic information of the target object.

The basic information of the target object further includes an identifier of the target object corresponding to the basic information of each target object, and the video interaction information further includes an identifier of the target object included in each screen frame.

In addition, the information display module 802 displays to the user the content to be displayed in the basic information of the target object, which may be more than four types, such as:

The content to be displayed in the basic information of the target object may be divided into the summary content corresponding to the target object (such as the name of the target object) and the specific content corresponding to the target object (such as a detailed text description of the target object, related pictures or videos, etc.), The target object can be set to two in one frame. The interaction area, that is, the first interaction area and the second interaction area, can be divided into two display modes, that is, the first display mode and the second display mode, in the basic information of the display target object.

When the operation of the first interaction area of the target object is detected, the information display module 802 may display the content to be displayed in the basic information of the target object to the user according to the first display manner; when the second interaction area to the target object is detected During the operation, the information display module 802 can display the content to be displayed in the basic information of the target object to the user according to the second display manner. The first display mode and the second display mode may have more than four types, for example:

The first display mode is to display the summary content of the target object next to the target object, and the second display mode is to display the specific content of the target object next to the target object;

Or,

The information display module 802 is further configured to: when there are multiple target objects in the currently played picture frame, and the interaction areas corresponding to the multiple target objects overlap, display the target objects with higher priority displayed in the plurality of target objects The content to be displayed in the basic information of the target object.

Alternatively, the information display module 802 is further configured to: when there are multiple target objects in the currently played picture frame, and the interaction areas corresponding to the multiple target objects overlap, according to the order of priority of the display, from high to low, in order The inner valley to be displayed in the basic information of each target object corresponding to the plurality of target objects is displayed.

In summary, the video playing platform provided by the embodiment of the present invention receives the associated information library of the original video and the original video, and displays the interactive video to the target user according to the priority displayed by the target object in the associated information library, and On the basis of this, the presentation manner of the associated information base is enriched, and the specific information for providing the interactive information according to the target redemption display priority is provided, which avoids the redundancy of the presentation provided by all the information in the prior art; The information transition provided by this solution also makes the processing more efficient, without providing all the associated information for each interaction as in the prior art. Referring to FIG. 15, an apparatus structure of a video playing platform according to an embodiment of the present invention is shown. Figure. The video playback platform can be used to play interactive video to a video on demand user. The video playing platform may include: at least one I/O interface 009, at least one processor 010, such as a CPU, a memory 011, and a display 012; the memory 011 may include a high speed RAM memory, and may also include a non-unstable memory (non- Volatile memory ), such as at least one disk storage. The memory 011 can optionally include at least one storage device located remotely from the aforementioned processor 010. In some embodiments, memory 011 stores the following elements, modules or data structures, or a subset thereof, or their extension set:

Operating system 0111, containing various programs for implementing various basic services and handling hardware-based tasks;

The application module 0112 includes one or a combination of the following modules: a parsing module and an information display module. For the function of the above module, refer to the description of the device structure diagram shown in FIG. 13 , and details are not described herein again.

The processor 010 is connected to the memory 011; the I/O interface 009 is connected to the processor 010 and the memory 011, and the other end is connected to the display 012;

The processor 010 is configured to receive an association information library of the original video and the original video, and obtain basic information and video interaction information of the target object saved in the associated information base of the original video, where the video interaction information includes the target included in each picture frame. The outline information of the object and the priority of the display, the basic information of the target object contains the content for the display;

The processor 010 is further configured to: when detecting a predefined operation of the interaction area set by the interaction area setting module corresponding to the contour information of the target object in the currently played picture frame, according to the displayed priority, in the display 012 The content to be displayed in the basic information of the target object corresponding to the target object in the interaction area is displayed.

In summary, the video playing platform provided by the embodiment of the present invention parses the associated information library of the original video and the original video, and displays the priority according to the target object in the associated information base and the basic information of the target object to be displayed. The content displays the interactive video to the target user, and solves the problem in the prior art that when there are multiple target objects in the same screen and each target object overlaps, the content to be displayed in the basic information of matching and displaying the target object cannot be normally realized. Referring to FIG. 16, which is a structural diagram of a device of a video playing platform according to another embodiment of the present invention. The video playback platform can be used to play interactive video to a video on demand user. The video playing platform may include: at least one I/O interface 013, at least one processor 014, such as a CPU, a memory 015, and a display 016; the memory 015 may include a high speed RAM memory, and may also include Non-volatile memory, such as at least one disk storage. The memory 015 can optionally include at least one storage device located remotely from the aforementioned processor 014. In some embodiments, memory 015 stores the following elements, modules or data structures, or a subset thereof, or their extension set:

Operating system 0151, which contains various programs for implementing various basic services and handling hardware-based tasks;

The application module 0152 includes one or a combination of the following modules: a parsing module and an information display module. For the function of the above module, refer to the description of the device structure diagram shown in FIG. 14 , and details are not described herein again.

The processor 014 is connected to the memory 015; the I/O interface 013 is connected to the processor 014 and the memory 015, and the other end is connected to the display 016;

The processor 014 is configured to parse the associated information library of the original video and the original video, and obtain basic information and video interaction information of the target object saved in the associated information base of the original video, where the video interaction information includes the target included in each picture frame. The outline information of the object and the priority of the display, the basic information of the target object contains the content for the display;

The processor 014 is further configured to: when detecting a predefined operation of the interaction area set by the interaction area setting module corresponding to the contour information of the target object in the currently played picture frame, according to the displayed priority, in the display 016 The content to be displayed in the basic information of the target object corresponding to the target object in the interaction area is displayed.

In addition, the processor 014 displays the basic information of the target object to the user, and the content to be displayed may be more than four types, for example:

When detecting the operation of the first interaction area of the target object, the processor 014 may display the content to be displayed in the basic information of the target object to the user in the display 016 according to the first display manner; when detecting the target object During the operation of the second interaction area, the processor 014 may display the content to be displayed in the basic information of the target object to the user in the display 016 according to the second display mode. The first display mode and the second display mode may have multiple types, such as:

The first display mode is to display the summary content of the target object next to the target object, and the second display side Is to display the specific content of the target object next to the target object;

Or,

The processor 014 is further configured to: when there are multiple target objects in the currently played picture frame, and the interaction areas corresponding to the multiple target objects overlap, displaying the higher priority displayed in the multiple target objects in the display 016 The content to be displayed in the basic information of the target object corresponding to the target object.

The processor 014 is further configured to: when there are multiple target objects in the currently played picture frame, and the interaction areas corresponding to the multiple target objects overlap, according to the priority of the display from high to low, in the display 016 The content to be displayed in the basic information of each target object corresponding to the plurality of target objects is sequentially displayed.

In summary, the video playing platform provided by the embodiment of the present invention receives the associated information library of the original video and the original video, and displays the interactive video to the target user according to the priority displayed by the target object in the associated information library, and On the basis of this, the presentation manner of the associated information base is enriched, and the specific information for providing the interactive information according to the target redemption display priority is provided, which avoids the redundancy of the presentation provided by all the information in the prior art; The information transition provided by this solution also makes the processing more efficient, without providing all the associated information for each interaction as in the prior art. Referring to FIG. 17, a system configuration diagram of a system for creating and storing video related information of a video provided by an embodiment of the present invention is shown. The system for creating and playing video related information of the video can be applied to create and play interactively. Video. The system for the related information library creation and video playback of the video may include: a related information library creation platform 1110 and a video playback platform 1120 of the video provided by the foregoing embodiment.

In the actual application, the video related information library production platform and the video playing platform process the original video to generate an associated information library, and the specific flow of playing the interactive video according to this is shown in FIG. 18. The associated database creation platform 904 of the video creates an associated information base according to the original video, and stores the original video together with the corresponding associated information base into the video server 902. Among them, the system will also close the video. The content corresponding to the link in the information repository is stored in the video associated content library; when playing the video, the video playing platform 901 obtains the original video and the corresponding associated information base, and displays the interaction to the user according to the original video and its associated information base. The video playing platform sends a request to the associated content server 903 according to the link in the associated information library, and obtains the corresponding link in the saved video related content library, when the content pointed to by the link in the associated information library needs to be displayed to the user. Corresponding content, and in the actual implementation process, the optional video playing platform 901 and the video server 902 can be completed by means of online play and online interaction. That is, the video is transmitted to the video playing platform in real time by the video server 902, and the interactive information from the video playing platform is also acquired by the video server 902 to the associated content server 903, and the communication channel established with the video playing platform 901 is utilized. Sent to the video playing platform, as shown by the dashed line in the figure, the request and transmission process between the video playing platform 901 and the associated content server 903 is no longer needed, but by the dotted line between the video server 902 and the associated content server 903. The indicated channel is complete.

In the actual implementation process, the optional video playing platform 901 and the video server 902 can be completed by means of online play and local interaction, or by a local download play and local interaction. At this time, the associated information base is directly sent to the video playing platform 901 via the video server 902 and stored in the video playing platform 901; then the interactive information generated by the user's interactive actions is maintained by the video playing platform 901 itself. And the content server 903 is associated with the link in the associated information base to obtain. At this time, the communication channel indicated by the broken line in FIG. 18 is no longer needed, and the communication between the video playing platform 901 and the associated content server 903 is also indicated by the "request" and "send" indicated by the solid line in the figure. carry out. In summary, the system for creating and storing video related information of the video provided by the embodiment of the present invention presents the interaction relationship of each platform in the present invention and its role in the system from the system level. It should be noted that, in the related information library creation platform and the video playing platform provided by the foregoing embodiments, when the related information base and the video playing video are created, only the division of the above functional modules is illustrated. In practical applications, The above function assignment is completed by different functional modules, that is, the internal structure of the platform is divided into different functional modules to complete all or part of the functions described above. In addition, the related information library creation platform of the video and the video playback platform and the video related information library creation method and the video playback method embodiment are the same concept, and the specific implementation process is described in the method embodiment, and details are not described herein again. . A person skilled in the art may understand that all or part of the steps of implementing the above embodiments may be completed by hardware, or may be instructed by a program to execute related hardware, and the program may be stored in a computer readable storage medium. The storage medium mentioned may be a read only memory, a magnetic disk or an optical disk or the like. The above is only the preferred embodiment of the present invention, and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc., which are within the spirit and scope of the present invention, should be included in the protection of the present invention. Within the scope.

Claims

claims

1. A method for making a video associated information database, characterized in that the method includes: acquiring one or more continuous picture frames from the original video according to the existence periods of different target objects to be set;

Determine the preset outline information and display priority of the target object in each picture frame in one or more consecutive picture frames corresponding to a target object;

Create an associated information library of the original video based on the outline information and display priority of the target object in each picture frame. The associated information library is a file read when playing interactive videos. The association The information library stores basic information of the target object and video interaction information, wherein the basic information of the target object includes content to be displayed; the video interaction information includes outline information of the target object contained in each picture frame. and display priority.

2. The method for making a video related information database according to claim 1, characterized in that, in one or more continuous picture frames corresponding to a target object, it is determined that the pre-selected target object is in each picture frame. Before the contour information and display priority, the method further includes:

Display the target object setting interface; set the object in the area defined by the video production user in the target object setting interface as the target object, and classify the defined area outline information as the first target object Contour information and carried in video interactive information;

Establish a corresponding relationship between the first outline information of the target object carried in the video interaction information and the basic information of the target object specified by the video production user for the target object.

3. The method for creating a video related information database according to claim 2, wherein the object in the area defined by the video production user in the target object setting interface is set as a target pair utilization profile. The extraction algorithm obtains the contour information of the target object in the predetermined area, classifies it as the second contour information of the target object, and carries it in the video interaction information;

A correspondence relationship is established between the second outline information of the target object carried in the video interaction information and the basic information of the target object formulated by the video production user for the set target object.

4. The method for making a video related information database according to claim 3, characterized in that: Determining the preset outline information of the target object in each picture frame in one or more consecutive picture frames corresponding to a target object specifically includes:

Obtain the characteristic information of the target object in the defined area, and use the target tracking algorithm to calculate the first contour information and the second contour information of the target object in the remaining picture frames in the one or more continuous picture frames, and carry them in In video interactive information.

5. The method for making a video related information database according to claim 1 or 2, characterized in that the basic information of the target object includes: the identification of the target object, the name text of the target object, and the detailed information text. , one or more of a picture link or a video link; Bei'J

The establishment of the corresponding relationship between the first outline information of the target object carried in the video interaction information and the basic information of the target object formulated by the video production user for the target object is specifically: establishing the video interaction information The association relationship between the first outline information of the target object carried in and one or more of the identification of the target object, the name text, the detailed information text, the picture link or the video link of the target object.

6. The method for creating a video-related information database according to claim 4 or 5, characterized in that the method includes:

Set the area corresponding to the first outline information of the target object in each picture frame as the first interaction area of the target object in each picture frame;

Set the area corresponding to the second outline information of the target object in each picture frame as the second interaction area of the target object in each picture frame;

So that when the video playback platform detects the user's predefined operation on the first interactive area and the second interactive area, it displays the to-be-displayed target object corresponding to the second interactive area in a more specific manner than the first interactive area. content.

7. A video playback method, characterized in that the method includes:

Analyze the original video and the associated information database of the original video, and obtain the basic information and video interaction information of the target object in the associated information database of the original video. The video interaction information includes the target contained in each frame. The outline information and display priority of the object, the basic information of the target object includes the content to be displayed;

When it is detected that the user has an interactive area corresponding to the outline information of the target object in the currently played frame. During the predefined operation of the domain, the content to be displayed in the basic information of the target object in the interaction area is displayed according to the display priority.

8. The video playback method according to claim 7, wherein when there are multiple target objects in the currently played picture frame, and the interaction areas corresponding to the multiple target objects overlap, the The content to be displayed in the basic information of the target object corresponding to the target object in the interaction area is displayed according to the display priority, specifically including:

Display the content to be displayed in the basic information of the target object corresponding to the target object with higher priority displayed among the plurality of target objects.

9. The video playback method according to claim 7, wherein when there are multiple target objects in the currently played picture frame, and the interaction areas corresponding to the multiple target objects overlap, the The content to be displayed in the basic information of the target object corresponding to the target object in the interaction area is displayed according to the size of the displayed priority value, specifically including:

The content to be displayed in the basic information of each target object corresponding to the plurality of target objects is displayed in order of display priority from high to low.

10. The video playback method according to any one of claims 7 to 9, characterized in that the predefined operations at least include mouse pointing operations, mouse clicking operations, touch pen sensing, mouse pointing and moving operations within the video, or One or more of the touch and click operations.

11. A video related information database production platform, characterized in that the platform includes: an acquisition module, used to acquire one or more continuous picture frames from the original video according to the existence cycles of different target objects to be set;

A contour information determination module, configured to determine the preset contour information of the target object in each picture frame in one or more consecutive picture frames of a target object obtained by the acquisition module;

A display priority determination module, configured to determine the preset display priority of the target object in each picture frame in one or more consecutive picture frames of a target object obtained by the acquisition module;

An associated information database production module, configured to create an associated information database of the original video based on the outline information and display priority of the target object in each frame, where the associated information database is used for playback The file read during interactive video saves the basic information of the target object and the video interaction information; wherein the basic information of the target object includes the content to be displayed; the video interaction information includes the content in each picture frame Contains outline information and display priority of the target object.

12. The video related information database production platform according to claim 11, characterized in that the platform further includes:

Setting display module, used to display the target object setting interface;

The first target object setting module is used to set the object in the area specified by the video production user in the target object setting interface displayed by the setting display module as the target object, and set the area outline information of the area Classified as the first contour information of the target object and carried in the video interaction information;

A first correspondence establishment module, configured to establish a correspondence between the first outline information of the target object carried in the video interaction information and the basic information of the target object formulated by the video production user for the target object. .

13. The video related information database production platform according to claim 12, characterized in that the platform further includes:

The second target object setting module is used to obtain the contour information of the target object in the predetermined area by using the contour extraction algorithm, and classify it as the second contour information of the target object, and carry it in the video mutual information;

A second correspondence establishment module, configured to establish a correspondence between the second outline information of the target object carried in the video interaction information and the basic information of the target object formulated by the video production user for the set target object. relation.

14. The video related information database production platform according to claim 13, characterized in that the outline information determination module includes:

a feature information acquisition unit, used to acquire the feature information of the target object in the predetermined area; a tracking unit, used to calculate the first value of the target object in the remaining picture frames in the one or more continuous picture frames using a target tracking algorithm The contour information and the second contour information are carried in the video interactive information.

15. The video related information database production platform according to claim 11 or 12, characterized in that the basic information of the target object includes: the identification of the target object, the name of the target object One or more of title text, detailed information text, picture link or video link;

The first correspondence establishment module is specifically used to establish the first outline information of the target object carried in the video interaction information and the identification of the target object, the name text, detailed information text, and picture link of the target object. Or the association between one or more of the video links.

16. The video related information database production platform according to claim 14 or 15, characterized in that the platform further includes: an interactive area setting module;

The interactive area setting module includes:

A first setting unit configured to set the area corresponding to the first outline information of the target object in each picture frame as the first interaction area of the target object in each picture frame;

A second setting unit configured to set the area corresponding to the second outline information of the target object in each picture frame as the second interaction area of the target object in each picture frame;

17. A video related information database production platform, characterized in that the platform includes: I/O interface, processor, memory and display;

The processor is used to obtain one or more continuous picture frames from the original video according to the existence periods of different target objects to be set;

The processor is also configured to determine the preset outline information of the target object in each picture frame in one or more consecutive picture frames corresponding to a target object;

The processor is also configured to determine the preset priority of displaying the target object in each picture frame in one or more consecutive picture frames corresponding to a target object;

The processor is also configured to create an associated information library of the original video based on the outline information and display priority of the target object in each picture frame. The associated information library is used for playing interactive videos. The read file saves the basic information of the target object and the video interaction information; wherein, the basic information of the target object includes the content to be displayed; the video interaction information includes the target object contained in each picture frame. outline information and display priority.

18. The video related information database production platform according to claim 17, characterized in that the processor is also used to display a target object setting interface on the display;

The processor is also configured to set the object in the area defined by the video production user in the target object setting interface as the target object, and classify the contour information of the defined area as the first contour information of the target object, And carried in the video interactive information;

The processor is also configured to establish a correspondence between the target object carried in the video interaction information and the basic information of the target object formulated by the video production user for the set target object.

19. The video related information database production platform according to claim 17, characterized in that the processor is also configured to use a contour extraction algorithm to obtain the contour information of the target object in the predetermined area, and classify it into the The second contour information of the target object is carried in the video mutual information;

The processor is also configured to establish a correspondence between the second outline information of the target object carried in the video interaction information and the basic information of the target object formulated by the video production user for the set target object. .

20. The video related information database production platform according to claim 18, characterized in that the processor is also used to obtain the characteristic information of the target object in the predetermined area, and use the target tracking algorithm to calculate The first contour information and the second contour information of the target object in the remaining picture frames in the one or more continuous picture frames are carried in the video interaction information.

21. The video related information database production platform according to claim 17 or 18, characterized in that the basic information of the target object includes: the identification of the target object, the name text of the target object, and the detailed information text. , one or more of image links or video links;

The processor is specifically configured to establish the first outline information of the target object carried in the video interaction information and the identification of the target object, the name text, detailed information text, picture link or video link of the target object. one or more relationships.

22. The video related information database production platform according to claim 20 or 21, characterized in that,

The processor is also configured to convert the area corresponding to the first outline information of the target object in each picture frame into Set as the first interaction area of the target object in each picture frame; Set the area corresponding to the second outline information of the target object in each picture frame as the second interaction area of the target object in each picture frame;

23. A video playback platform, characterized in that the platform includes:

An analysis module, used to analyze the original video and the associated information database of the original video, and obtain the basic information of the target object and the video interaction information in the associated information database of the original video. The video interaction information includes each picture frame. The outline information and display priority of the target object contained in , the basic information of the target object includes the content to be displayed;

An information display module, configured to, when detecting a user's predefined operation on an interaction area corresponding to the outline information of a target object in the currently played picture frame, display the target object corresponding to the interaction area according to the displayed priority. The content to be displayed in the basic information of the target object.

24. The video playback platform according to claim 23, wherein the information display module is further configured to: There are multiple target objects in the currently played picture frame, and the multiple target objects correspond to When the interactive areas overlap, the content to be displayed in the basic information of the target object corresponding to the target object with a higher priority among the multiple target objects is displayed.

25. The video playback platform according to claim 23, wherein the information display module is further configured to: There are multiple target objects in the currently played picture frame, and the multiple target objects correspond to When the interactive areas overlap, the content to be displayed in the basic information of each target object corresponding to the plurality of target objects is displayed in order according to the display priority from high to low.

26. A video playback platform, characterized in that the platform includes: an I/O interface, a processor, a memory and a display;

The processor is used to parse the original video and the associated information library of the original video, and obtain the The basic information of the target object and the video interaction information in the associated information library of the original video. The video interaction information includes the outline information and display priority of the target object contained in each picture frame. The basic information of the target object Contains content for display;

The processor is also configured to, when detecting the user's predefined operation on the interactive area set by the interactive area setting module corresponding to the outline information of the target object in the currently played picture frame, based on the display priority, in the The content to be displayed in the basic information of the target object corresponding to the target object in the interaction area is displayed on the display.

27. The video playback platform according to claim 26, characterized in that,

The processor is also configured to display the multiple target objects on the display when there are multiple target objects in the currently played picture frame and the interaction areas corresponding to the multiple target objects overlap. The content to be displayed in the basic information of the target object corresponding to the higher priority target object displayed in

28. The video playback platform according to claim 26, characterized in that,

The processor is also configured to: when there are multiple target objects in the currently played picture frame and the interaction areas corresponding to the multiple target objects overlap, in order from high to low according to the display priority, The content to be displayed in the basic information of each target object corresponding to the plurality of target objects is displayed on the display in sequence.

29. A system for creating a video related information database and playing video, characterized in that the system includes:

The video related information database production platform as described in any one of claims 11 to 16 and the video playback platform as described in any one of claims 23 to 25.