WO2014100936A1 - Procédé, plateforme et système de création de bibliothèque d'informations associées de vidéos et de lecture des vidéos - Google Patents

Procédé, plateforme et système de création de bibliothèque d'informations associées de vidéos et de lecture des vidéos Download PDF

Info

Publication number
WO2014100936A1
WO2014100936A1 PCT/CN2012/087295 CN2012087295W WO2014100936A1 WO 2014100936 A1 WO2014100936 A1 WO 2014100936A1 CN 2012087295 W CN2012087295 W CN 2012087295W WO 2014100936 A1 WO2014100936 A1 WO 2014100936A1
Authority
WO
WIPO (PCT)
Prior art keywords
target object
information
video
interaction
displayed
Prior art date
Application number
PCT/CN2012/087295
Other languages
English (en)
Chinese (zh)
Inventor
杨素娟
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to PCT/CN2012/087295 priority Critical patent/WO2014100936A1/fr
Priority to CN201280002756.9A priority patent/CN104041063B/zh
Publication of WO2014100936A1 publication Critical patent/WO2014100936A1/fr

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/414Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
    • H04N21/4143Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance embedded in a Personal Computer [PC]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/485End-user interface for client configuration
    • H04N21/4854End-user interface for client configuration for modifying image parameters, e.g. image brightness, contrast
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65Transmission of management data between client and server
    • H04N21/654Transmission by server directed to the client
    • H04N21/6547Transmission by server directed to the client comprising parameters, e.g. for client setup
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65Transmission of management data between client and server
    • H04N21/658Transmission by the client directed to the server
    • H04N21/6587Control parameters, e.g. trick play commands, viewpoint selection
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81Monomedia components thereof
    • H04N21/8126Monomedia components thereof involving additional data, e.g. news, sports, stocks, weather forecasts
    • H04N21/8133Monomedia components thereof involving additional data, e.g. news, sports, stocks, weather forecasts specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video program

Definitions

  • the present invention relates to the field of computers, and in particular, to a method, a platform and a system for video related information library creation and video playing. Background technique
  • the interactive video can display the specific information of the person or thing in the video, such as the introduction information of the characters in the video, the detailed introduction information of the clothes worn by the characters in the video, etc., and can provide the viewer with convenient and highly targeted services. Therefore, it has broad application prospects.
  • the existing interactive video production and display methods mainly include: First, segmenting one or more target objects from the entire video according to the contour matching manner; second, automatically classifying the segmented one or more target objects, each The target object corresponds to the basic information of a target object.
  • the basic information of the target object can be customized by the developer. For example, if a target object is a piece of clothing, the corresponding brand description, price information, purchase address, etc. of the clothes will be It is saved in the basic information of the clothing target object; thirdly, when it is detected that the video of the video viewing user points to the target object in the video screen, the content to be displayed in the basic information of the target object is displayed to the viewing user.
  • the embodiments of the present invention provide a method, a platform, and a system for creating and storing a video related information library, so as to solve the problem of poor interactive video production in the prior art.
  • the technical solution is as follows:
  • a method for creating a related information library of a video comprising: acquiring one or more consecutive picture frames from an original video according to a period of existence of different target objects to be set;
  • Determining the predetermined target in one or more consecutive picture frames corresponding to one target object The contour information of the object in each picture frame and the priority of the display;
  • Displaying a target object setting interface setting an object in a region determined by the video production user in the target object setting interface as a target object, and classifying the determined region contour information as the first target object Profile information, and carried in the video interaction information;
  • the determining, in the one or more consecutive picture frames corresponding to the target object, the preset target object in each picture frame includes:
  • the basic information of the target object includes: an identifier of the target object, a name text of the target object, and a detailed One or more of an info text, image link, or video link;
  • the correspondence between the first contour information of the target object carried in the video interaction information and the basic information of the target object defined by the video production user for the target object is specifically:
  • the method includes:
  • a video playing method where the method includes:
  • Parsing the original video and the associated information base of the original video acquiring basic information and video interaction information of the target object in the associated information base of the original video, where the video interaction information includes a target object included in each picture frame
  • the outline information and the priority of the display the basic information of the target object contains the content for display;
  • the content to be displayed in the basic information of the target object corresponding to the target object having the higher priority displayed in the plurality of target objects is displayed.
  • the displaying according to the The size of the priority value displays the content to be displayed in the basic information of the target object corresponding to the target object in the interaction area, and specifically includes:
  • the content to be displayed in the basic information of each target object corresponding to the plurality of target objects is displayed in descending order of the displayed priority.
  • the third aspect provides a video related information library creation platform, where the platform includes: an acquiring module, configured to acquire one or more consecutive picture frames from the original video according to the existence period of the different target objects to be set;
  • a contour information determining module configured to determine, in one or more consecutive picture frames corresponding to a target object acquired by the acquiring module, contour information of the target object in each picture frame; the priority of the display is determined a module, configured to determine, in one or more consecutive picture frames corresponding to a target object acquired by the acquiring module, a preset priority of display of the target object in each picture frame;
  • an associated information base creating module configured to create an associated information base of the original video according to the contour information of the target object in each picture frame and the priority of the display, where the related information library is used for playing the interactive video
  • the read file, the basic information of the target object and the video interaction information are saved; wherein the basic information of the target object includes content for display; the video interaction information includes a target object included in each picture frame The outline information and the priority of the display.
  • the platform further includes:
  • a first target object setting module configured to set an object in a region determined by the video production user in the target object setting interface displayed by the setting display module as a target object, and set the determined region contour information The first contour information classified as the target object, and carried in the video interaction information;
  • the first correspondence establishing module is configured to establish a correspondence between the first contour information of the target object carried in the video interaction information and the basic information of the target object defined by the video production user for the target object.
  • the platform further includes: a second target object setting module, configured to acquire contour information of the target object in the determined region by using a contour extraction algorithm, and classify the second contour information of the target object into the video mutual information;
  • the relationship establishing module is configured to establish a correspondence between the second contour information of the target object carried in the video interaction information and the basic information of the target object defined by the video production user for the set target object.
  • the profile information determining module includes:
  • a feature information acquiring unit configured to acquire feature information of the target object in the determined region
  • a tracking unit configured to calculate, by using a target tracking algorithm, a first target object of the remaining frame frames in the one or more consecutive picture frames
  • the contour information and the second contour information are carried in the video interaction information.
  • the basic information of the target object includes: an identifier of the target object, and a target object One or more of a name text, a detailed information text, a picture link, or a video link; the first correspondence establishing module is specifically configured to establish first contour information of the target object carried in the video interaction information, and the The association of one or more of the identity of the target object, the name text of the target object, the detail text, the image link, or the video link.
  • the platform further includes: an interaction area setting module;
  • the interaction area setting module includes:
  • a first setting unit configured to set an area corresponding to the first contour information of the target object in each picture frame as the first interaction area of the target object in each picture frame;
  • a second setting unit configured to set an area corresponding to the second contour information of the target object in each picture frame as a second interaction area of the target object in each picture frame;
  • a fourth aspect provides a video related information base creation platform, where the platform includes: an I/O interface, a processor, a memory, and a display;
  • the processor is connected to the memory; one end of the I/O interface is connected to the processor and the memory, and the other end is connected to the display;
  • the processor is further configured to determine contour information of the target object in each picture frame that is preset in one or more consecutive picture frames corresponding to a target object;
  • the processor is further configured to determine, in one or more consecutive picture frames corresponding to a target object, a priority of displaying the preset target object in each picture frame;
  • the processor is further configured to create an association information library of the original video according to the contour information of the target object in each picture frame and the priority of the display, where the related information library is used for playing the interactive video.
  • the read file, the basic information of the target object and the video interaction information are saved; wherein the basic information of the target object includes content for display; the video interaction information includes a target object included in each picture frame The outline information and the priority of the display.
  • the processor is further configured to display a target object setting interface in the display;
  • the processor is further configured to set an object in a region determined by the video production user in the target object setting interface as a target object, and classify the determined region contour information as the first contour information of the target object, And carried in the video interaction information;
  • the processor is further configured to establish a correspondence between a target object carried in the video interaction information and basic information of a target object that is created by the video production user for the set target object.
  • the processor is further configured to acquire contour information of the target object in the determined region by using a contour extraction algorithm, and classify the second contour information of the target object, and carry the information in the video mutual information;
  • the processor is further configured to establish a correspondence between the second contour information of the target object carried in the video interaction information and the basic information of the target object that is set by the video production user for the set target object. .
  • the processor is further configured to acquire feature information of the target object in the determined area, and calculate by using a target tracking algorithm The first contour information and the second contour information of the target object of the remaining ones of the one or more consecutive picture frames are carried in the video interaction information.
  • the basic information of the target object includes: an identifier of the target object, and a target object One or more of a name text, a detailed information text, a picture link, or a video link; the processor is specifically configured to establish a first round of the target object carried in the video interaction information An association relationship of the profile information with one or more of an identification of the target object, a name text of the target object, a detailed information text, a picture link, or a video link.
  • the processor is further configured to The area corresponding to the first contour information of the target object is set as the first interaction area of the target object in each picture frame; and the area corresponding to the second contour information of the target object in each picture frame is set as the each picture a second interaction area of the target object in the frame;
  • the video playback platform When the video playback platform detects a predefined operation of the first interaction area and the second interaction area by the user, displaying the target object corresponding to the second interaction area to be displayed in a more specific manner than the first interaction area. content.
  • a fifth aspect provides a video playing platform, where the platform includes:
  • a parsing module configured to parse the original video and the associated information base of the original video, and obtain basic information and video interaction information of the target object in the associated information base of the original video, where the video interaction information includes each picture frame The outline information of the target object and the priority of the display, the basic information of the target object containing the content for display;
  • the information display module is configured to: when detecting a predefined operation of the interaction area corresponding to the contour information of the target object in the currently played picture frame, the display corresponding to the target object in the interaction area according to the displayed priority The content to be displayed in the basic information of the target object.
  • the information display module is further configured to: a plurality of target objects exist in the currently played picture frame, and the interaction areas corresponding to the multiple target objects overlap And displaying content to be displayed in basic information of the target object corresponding to the target object with higher priority displayed in the plurality of target objects.
  • the information display module is further configured to: a plurality of target objects exist in the currently played picture frame, and the interaction areas corresponding to the multiple target objects overlap
  • the content to be displayed in the basic information of each target object corresponding to the plurality of target objects is displayed in order according to the priority of the displayed priority.
  • a sixth aspect provides a video playing platform, where the platform includes: an I/O interface, a processor, a memory, and a display;
  • the processor is connected to the memory; one end of the I/O interface is connected to the processor and the memory, and the other end is connected to the display;
  • the processor configured to parse an original information and an associated information base of the original video, to obtain the The basic information of the target object and the video interaction information in the associated information base of the original video, where the video interaction information includes the outline information of the target object included in each picture frame and the priority of the display, and the basic information of the target object Contains content for display;
  • the processor is further configured to: when detecting a predefined operation of the interaction area set by the interaction area setting module corresponding to the contour information of the target object in the currently played picture frame, according to the displayed priority, The content to be displayed in the basic information of the target object corresponding to the target object in the interaction area is displayed in the display.
  • the processor is further configured to: when there are multiple target objects in the currently played picture frame, and the interaction areas corresponding to the multiple target objects overlap, display the multiple target objects in the display The content to be displayed in the basic information of the target object corresponding to the higher priority target object displayed in the middle.
  • the seventh aspect provides a video related information library production and video playing system, wherein the system includes:
  • FIG. 1 is a flow chart of a method for fabricating a related information library of a video according to an embodiment of the present invention
  • FIG. 2 is a flow chart of a method for fabricating a related information base of a video according to another embodiment of the present invention
  • FIG. 4 is a schematic diagram of a target object setting interface according to another embodiment of the present invention.
  • FIG. 5 is a schematic diagram of priority adjustment of a target object display according to another embodiment of the present invention
  • FIG. 6 is a structural diagram of a related information library of a video according to another embodiment of the present invention.
  • FIG. 8 is a flowchart of a method for playing a video according to another embodiment of the present invention.
  • FIG. 9 is a structural diagram of an apparatus for creating a related information base of a video according to an embodiment of the present invention.
  • FIG. 10 is a structural diagram of an apparatus for creating a related information base of a video according to another embodiment of the present invention.
  • FIG. 11 is a structural diagram of an apparatus for creating a related information base of a video according to an embodiment of the present invention.
  • FIG. 14 is a structural diagram of a device of a video playing platform according to another embodiment of the present invention.
  • 16 is a structural diagram of a device of a video playing platform according to another embodiment of the present invention.
  • FIG. 18 is a flowchart showing the working process of the related information library creation and video playing system of the video according to an embodiment of the present invention. detailed description
  • FIG. 1 is a flowchart of a method for fabricating a related information base of a video according to an embodiment of the present invention.
  • the method may include:
  • Step 101 Acquire one or more consecutive picture frames from the original video according to the existence period of different target objects to be set;
  • Step 102 Determine, in one or more consecutive picture frames corresponding to a target object, contour information and a priority of the display of the preset target object in each picture frame;
  • Step 103 Create an association information library of the original video according to the contour information of the target object in each picture frame and the priority of the display, where the associated information library is a file read when playing the interactive video, and the basic object of the target object is saved.
  • Information and video interaction information wherein the basic information of the target object includes content for display; the video interaction information includes contour information of the target object included in each picture frame and a priority of the display.
  • Step 201 The production platform acquires one or more consecutive picture frames from the original video according to the existence period of different target objects to be set;
  • a video file consists of a series of picture frames, each picture frame being an image picture.
  • a target object may exist only in a certain period.
  • the target object is subjected to contour extraction and tracking, only the frame frame containing the target object needs to be processed. Therefore, one or more consecutive picture frames may be acquired from the original video according to the existence period of different target objects to be set, and the one or more consecutive picture frames may be referred to as one picture frame group, and the production platform separately for each picture frame group
  • the processing is performed, so that the video production user separately sets the target object in the corresponding picture frame for different scenes, where each picture frame group includes at least one picture frame.
  • a target object changes little in the same scene, for example, the clothes of the same person in the same scene generally do not change, therefore, according to the existence period of different target objects to be set
  • it may be considered to divide the video into a series of picture frame groups according to different scenes.
  • HSV Human, Saturation, Value, Chroma, Saturation, Luminance histogram eigenvalues are used to detect the lens boundary, and an adaptive lens detection based on inter-frame difference and non-adjacent inter-frame difference is used. method.
  • the adaptive method based on the difference between adjacent frames can detect the abrupt lens well, and the adaptive method based on the difference between non-adjacent frames can detect the gradual lens well. The combination of the two will be very good. Detect various types of mutations and gradient lenses. Referring to the flowchart for calculating the inter-frame difference value shown in FIG. 3, the embodiment of the present invention uses an adaptive detection method based on the difference between adjacent frames as an example to introduce the lens detection method in detail:
  • a is a preset lens boundary detection threshold coefficient, and the statistical result indicates that "the general 5 ⁇ 6 is optimal; the NFD (the adjacent frame difference) video stream is adjacent to two frames. Inter-frame difference; Mean is the average of the difference between frames in the window; Sum is the sum of the differences between adjacent frames; Count is the cumulative number of differences between frames.
  • Step 3 converts the read picture frame image into an HSV model and quantizes it into 72 color spaces, and calculates a histogram
  • Step 4 calculates a difference NFD from the histogram of the previous frame image
  • Step 5 determines whether the NFD is less than ⁇ times of Mean, and if so, it indicates that there is a gradation between the read frame and the previous frame, and proceeds to step 6, otherwise it is a mutation, and proceeds to step 7;
  • Step 202 The production platform displays a target object setting interface, and sets an object in a region determined by the video production user in the target object setting interface as a target object, and classifies the determined region contour information as the target object.
  • the first contour information is carried in the video interaction information;
  • the contour information corresponding to the target object may include the first contour information and the second contour information, where the first contour information may be contour information manually determined by the video production user, and the second contour information may be contour information of the target object itself.
  • the contour information may specifically be an area i or a coordinate indicating an area included in the outline.
  • Step 203 The production platform establishes a correspondence between the first contour information of the target object carried in the video interaction information and the basic information of the target object defined by the video production user for the target object.
  • Basic information about the respective target objects can be defined for the set target objects. For example, if the target object in the frame group a is a car, the video production user can name the car, detailed information (such as manufacturer name, place of production, price information, preferential information, official website link, etc.), the car's Related pictures, videos, etc. are formulated as basic information of the target object of the target object. It should be noted that, for the same person or object in different scenes, different target objects may be set according to the situation.
  • the production platform classifies the determined area contour information into the first contour information of the target object, and carries the first contour information of the target object carried in the video interaction information and the video production user as the target after being carried in the video interaction information.
  • Step 204 The production platform uses the contour extraction algorithm to obtain the contour information of the target object in the determined region, and is classified into the second contour information of the target object, and is carried in the video interaction information.
  • the contour extraction algorithm is further used to obtain the contour information of the target object in the determined region, and is classified as the target object. Two contour information, and carried in the video interaction information.
  • the production platform may use the contour extraction algorithm to obtain the contour information of the automobile in the map, and classify the contour information of the automobile into the second contour information of the automobile, and The second profile information is carried in the video interaction information.
  • the contour extraction algorithm can be implemented by using the prior art, and details are not described in this embodiment.
  • Step 205 The production platform establishes a correspondence between the second contour information of the target object carried in the video interaction information and the basic information of the target object defined by the video production user for the set target object.
  • the production platform classifies the contour information of the target object obtained by the contour extraction algorithm into the second contour information of the target object, and after being carried in the video interaction information, the second object of the target object carried in the video interaction information is also required to be established.
  • Step 206 The production platform acquires feature information of the target object in the determined region, and uses the target tracking algorithm to calculate first contour information and second contour information of the target object of the remaining frame frames in the one or more consecutive picture frames, and Carry in the video interaction information;
  • the production platform can acquire the feature information of the target object that is generated by the video production user, and automatically determine the specific region of the target object in each of the remaining frame frames of the corresponding picture frame group by using the target tracking algorithm, and obtain the corresponding first contour information. And the second contour information, and the first contour information and the second contour information of the target object in each picture frame are carried in the video interaction information.
  • This step is also referred to as the target object trajectory generation, and can be implemented based on a specific algorithm, such as a TLD (Tracking, Learning, Detecting, Tracking, Learning, Detection) algorithm, and the algorithm of the present invention does not perform the target object trajectory generation. Specifically limited.
  • the production platform may not extract the second contour information of the target object.
  • the production platform only needs to use the target tracking algorithm to calculate the target object of the remaining image frames in the one or more consecutive picture frames.
  • the first contour information is sufficient.
  • Step 207 Set an area corresponding to the first contour information and the second contour information of the target object in each picture frame as a first interaction area and a second interaction area of the target object in each picture frame;
  • the production platform sets an area corresponding to the first contour information of the target object in each picture frame as a first interaction area of the target object in each picture frame, and a second contour letter of the target object in each picture frame
  • the area corresponding to the information is set as the second interaction area of the target object in each picture frame, so that the video playing platform compares the first interaction area when detecting the predefined operation of the first interaction area and the second interaction area by the user.
  • a more specific manner displays the content of the target object corresponding to the second interaction area to be displayed.
  • the contour information may be an area coordinate
  • the production platform sets the corresponding area in the picture frame as an interaction area according to the area coordinates indicated by the contour information of the target object in each picture frame.
  • the production platform does not extract the second contour information of the target object, only the region corresponding to the first contour information of the target object in each screen frame needs to be set as the first interaction region of the target object in each screen frame. can.
  • Step 208 The production platform displays a target object priority setting interface, and sets a priority of display in each frame frame according to an operation instruction of the video creation user in the target object priority setting interface.
  • the video production user needs to set the display priority for the overlapping target objects, so that the video playing platform can
  • the basic information corresponding to the higher priority target object that is preferentially displayed in the overlapping target area For details, refer to the priority adjustment diagram of the target object display shown in FIG. 5, where the target object is the character A, and the display level is the priority displayed by the target object, and the target object A is displayed in the picture frame.
  • the number of display levels in the 0 to picture frame 156 is set to 9, by which the video production user can freely define the priority of display of each target object in each picture frame.
  • the production platform saves the priority of the display of the target object to subsequently add the priority of the display of the target object to the associated information base of the video.
  • Step 209 The production platform creates an associated information library of the original video according to the contour information of the target object in each picture frame, where the related information library is a file that is read when playing the interactive video, and saves basic information of the target object and Video interaction information, wherein the basic information of the target object includes content for display.
  • the related information library is a file that is read when playing the interactive video
  • the production platform saves the contour information (including the first contour information and the second contour information) of the target object in each picture frame, and the correspondence relationship between the target object and the basic information of the target object in a file, where the file is called
  • the associated information library of the original video can be in XML (Extensible Markup Language) file format or database format, and finally used by the video playback platform.
  • the related information base may include original video basic information, basic information of a target object, and video interaction information.
  • This information includes the identifier of each target object and the content to be displayed, such as one or more of the name text, detailed information text, image link or video link of each target object;
  • the video interaction information includes: The identifier of the target object, the outline information of the target object included in each screen frame, and the priority of the display of the target object included in each screen frame.
  • the mapping between the first contour information of the target object carried in the video interaction information and the basic information of the target object defined by the video production user for the target object is created in the step 203, which is specifically carried in the video interaction information.
  • the first contour information of the target object is associated with one or more of the identifier of the target object, the name text of the target object, the detailed information text, the image link, or the video link; in step 205, the production platform establishes the video interaction Corresponding relationship between the second contour information of the target object carried in the information and the basic information of the target object defined by the video production user for the set target object, specifically for establishing the second contour information of the target object carried in the video interaction information An association with one or more of the identity of the target object, the name text of the target object, the detail text, the image link, or the video link.
  • the related information database shown in FIG. 6 stores the basic information of the target object and the video interaction information in two different storage structures, and associates with the identifier of the target object, and in actual application, The basic information of the target object and the video interaction information and the corresponding relationship are stored in the same storage structure, which is not specifically limited in this embodiment.
  • the method for creating a related information library of a video provided by the embodiment of the present invention firstly obtains one or more consecutive picture frames from the original video, and then determines the target object and extracts the contour information in one of the picture frames according to the manual operation of the video production user. Finally, the target tracking algorithm is used to determine the contour information of the target object in each of the one or more picture frames, and the semi-automatic target object contour information extraction method is compared with the existing object-based segmentation and classification method. In terms of accuracy and efficiency, there has been further improvement.
  • the video playing method can include: Step 301: Parse the association information library of the original video and the original video, and obtain basic information and video interaction information of the target object saved in the associated information base of the original video, where the video interaction information includes the contour of the target object included in each picture frame.
  • the priority of the information and display, the basic information of the target object contains the content for display;
  • Step 302 When detecting a predefined operation on the interaction area corresponding to the contour information of the target object in the picture frame currently played by the user, displaying the basic information of the target object corresponding to the target object in the interaction area according to the displayed priority The content to be displayed in the message.
  • Step 401 The video playing platform parses the association information library of the original video and the original video, and acquires basic information and video interaction information of the target object saved in the associated information base of the original video, where the video interaction information includes the target included in each picture frame.
  • the outline information of the object and the priority of the display, the basic information of the target object contains the content for the display;
  • the associated information base includes at least basic information of the target object and video interaction information;
  • the basic information of the target object includes the identifier of each target object and the content to be displayed, for example: name text of each target object, detailed information text One or more of a picture link or a video link;
  • the video interaction information includes: an identifier of a target object included in each picture frame, contour information of a target object included in each picture frame, and a target object included in each picture frame
  • the priority of the display; the specific associated information base can be as shown in Figure 6.
  • Step 402 When detecting a predefined operation of the interaction area corresponding to the contour information of the target object in the currently played picture frame, displaying the target object corresponding to the target object in the interaction area according to the displayed priority The content to be displayed in the basic information.
  • the video playing platform detects a predefined operation of the interaction area by the user, querying the The content to be displayed in the basic information of the target object associated with the contour information corresponding to the interaction area is displayed to the user.
  • the user can have a plurality of predefined operations on the interactive area, such as a mouse pointing operation, a mouse click operation, a touch pen sensing, a mouse pointing movement operation within the video, or a touch click operation.
  • a mouse pointing operation such as a mouse pointing operation, a mouse click operation, a touch pen sensing, a mouse pointing movement operation within the video, or a touch click operation.
  • the video playing platform detects the user's predefined operation on the interactive area, for example, the mouse points to the target area, the content to be displayed in the basic information of the target object corresponding to the interactive area may be queried and displayed to the user.
  • the content to be displayed in the basic information of the target object may be divided into the summary content corresponding to the target object (such as the name of the target object) and the specific content corresponding to the target object (such as a detailed text description of the target object, related pictures or videos, etc.),
  • the target object can be configured with two interaction areas, that is, the first interaction area and the second interaction area, in one picture frame. Therefore, the content to be displayed in the basic information of the display target object can be divided into two display modes, that is, The first display mode and the second display mode.
  • the content to be displayed in the basic information of the target object may be displayed to the user according to the first display manner; when the operation of the second interaction area of the target object is detected, The content to be displayed in the basic information of the target object may be displayed to the user according to the second display mode.
  • the first display mode and the second display mode may be different, for example: the first display mode is to display the summary content of the target object next to the target object, and the second display mode is to display the target object next to the target object. Specific content;
  • the first display mode is to display the first interactive area or the second interactive area corresponding to the target object in the target object area
  • the second display mode is to display the specific content of the target object next to the target object
  • the first display mode is to display the specific content of the target object semi-transparent next to the target object
  • the second display mode is to cover the specific content of the target object next to the target object
  • the video playing platform detects the predefined operation of the interaction area by the user, according to the displayed priority, Displaying content to be displayed in the basic information of the target object corresponding to the target object with higher priority displayed in the plurality of target objects, for example, if the two target objects a and b correspond to If the interaction area overlaps, and the display of the target object a has a higher priority, only the content to be displayed in the basic information of the target object corresponding to the target object a is displayed; or, the display priority is displayed in descending order of priority.
  • the video playing method receives an interactive information library of the original video and the original video, and displays an interactive video to the target user according to the priority displayed by the target object in the associated information database, and On the basis of this, the presentation manner of the associated information base is enriched, and the specific information for providing the interactive information according to the target redemption display priority is provided, which avoids the redundancy of the presentation provided by all the information in the prior art;
  • the information transition provided by this solution also makes the processing more efficient, without providing all the associated information for each interaction as in the prior art.
  • FIG. 9 is a structural diagram of an apparatus for creating a platform of a related information library of a video according to an embodiment of the present invention.
  • the video's associated repository creation platform can be used to create the associated information base necessary to play interactive video.
  • the associated information base production platform of the video may include:
  • the obtaining module 501 is configured to acquire one or more consecutive picture frames from the original video according to the existence period of the different target objects to be set;
  • the contour information determining module 502 is configured to determine contour information of a preset target object in each picture frame in one or more consecutive picture frames acquired by the obtaining module 501;
  • the associated information base creating module 504 is configured to create a related information library of the original video according to the contour information of the target object in each picture frame and the priority of the display, where the related information library is a file read when playing the interactive video.
  • the basic information of the target object and the video interaction information are saved; wherein the basic information of the target object includes the content to be displayed; the video interaction information includes the contour information of the target object included in each picture frame and the priority of the display. .
  • the association information base of the video acquires one or more consecutive picture frames from the original video according to the existence period corresponding to the target, and determines the video production in the one or more consecutive picture frames.
  • the contour information of the target object preset by the user and the priority of the display solve the problem that the related information in the prior art is insufficient for the target object to be covered by the background or other objects.
  • FIG. 10 is a structural diagram of an apparatus for creating a related information base of a video according to another embodiment of the present invention.
  • the video's associated repository production platform can be used to create a library of associated information needed to play interactive video.
  • the associated information base production platform of the video may include:
  • the obtaining module 601 is configured to acquire one or more consecutive picture frames according to different scenarios.
  • the contour information determining module 602 is configured to determine, in the one or more consecutive picture frames acquired by the obtaining module 601, a preset target object in each Outline information in frame frames;
  • the displayed priority determining module 603 is configured to determine, in the one or more consecutive picture frames acquired by the obtaining module 601, a priority of display of the preset target object in each picture frame;
  • the associated information base creating module 604 is configured to create a related information library of the original video according to the contour information of the target object in each picture frame and the priority of the display, where the related information library is a file read when playing the interactive video.
  • the basic information of the target object and the video interaction information are saved; wherein the basic information of the target object includes the content to be displayed; the video interaction information includes the contour information of the target object included in each picture frame and the priority of the display. .
  • the video related database creation platform also includes:
  • a setting display module 605, configured to display a target object setting interface
  • the first target object setting module 606 is configured to set an object in the region determined by the video creation user in the target object setting interface displayed by the setting display module 605 as the target object, and set the determined region contour information.
  • the first correspondence establishing module 607 is configured to establish a correspondence between the first contour information of the target object carried in the video interaction information and the basic information of the target object defined by the video production user for the target object.
  • the basic information of the target object includes: one or more of an identifier of the target object, a name text of the target object, a detailed information text, a picture link, or a video link;
  • the first correspondence establishing module 607 is specifically configured to establish a first contour information of the target object carried in the video interaction information, an identifier of the target object, a name text of the target object, a detailed information text, a picture link, or a video link. One or more associations.
  • the video related database creation platform also includes:
  • a second target object setting module 608 configured to acquire contour information of the target object in the determined region by using a contour extraction algorithm, and classify the second contour information of the target object, and carry the information in the video mutual information;
  • the second correspondence establishing module 609 is configured to establish a correspondence between the second contour information of the target object carried in the video interaction information and the basic information of the target object defined by the video production user for the target object.
  • the contour information determining module 602 includes:
  • the feature information acquiring unit 602a is configured to acquire feature information of the target object in the determined region; the tracking unit 602b is configured to calculate, by using the target tracking algorithm, the first contour information of the target object of the remaining frame frames in the one or more consecutive picture frames And the second contour information, and carried in the video interaction information.
  • the platform further includes: an interaction area setting module 610;
  • the interaction area setting module 610 includes:
  • a first setting unit 610a configured to set an area corresponding to the first contour information of the target object in each picture frame as a first interaction area of the target object in each picture frame;
  • a second setting unit 610b configured to set an area corresponding to the second contour information of the target object in each picture frame as a second interaction area of the target object in each picture frame;
  • the video playing platform When the video playing platform detects the predefined operation of the first interaction area and the second interaction area by the user, displaying the content to be displayed of the target object corresponding to the second interaction area in a more specific manner than the first interaction area. .
  • the related information library creation platform of the video provided by the embodiment of the present invention firstly obtains one or more consecutive picture frames from the original video, and then determines the target object in one of the picture frames according to the manual operation of the video production user. And extracting contour information, and finally using the target tracking algorithm to determine contour information of the target object in each of the one or more picture frames, the semi-automatic target object contour information extraction method is compared with the existing object-based object In terms of segmentation and classification methods, accuracy and efficiency have been further improved.
  • the associated information base creation platform of the video provided by the embodiment of the present invention also adopts a method for distinguishing display between the first contour and the second contour, which is more in line with the user's law of receiving information, that is, The interaction area is from far to near corresponding to the display of information from as little as possible.
  • FIG. 11 is a structural diagram of a device for creating a related information base of a video according to an embodiment of the present invention.
  • the associated information base creation platform of the video may be used to create an associated information base necessary for playing interactive video. .
  • the associated information base production platform of the video may include: at least one I/O interface 001, at least one processor 002, such as a CPU, a memory 003, and a display 004; the memory 003 may include a high speed RAM memory, and may also include non-unstable Memory (non-volatile memory), such as at least one disk storage.
  • the memory 003 can optionally include at least one storage device located remotely from the aforementioned processor 002.
  • the memory 003 stores the following elements, modules or data structures, or a subset thereof, or their extension set:
  • Operating system 0031 which contains various programs for implementing various basic services and handling hardware-based tasks;
  • the application module 0032 includes one or a combination of the following modules: an acquisition module, a contour information determination module, a displayed priority determination module, and an associated information base creation module.
  • the function of the above module may refer to the description part of the device structure diagram shown in FIG. , will not repeat them here.
  • the processor 002 is connected to the memory 003;
  • the I/O interface 001 is connected to the processor 002 and the memory 003, and the other end is connected to the display 004;
  • the processor 002 is configured to obtain one or more consecutive picture frames from the original video according to the existence period of different target objects to be set;
  • the processor 002 is further configured to determine contour information of the preset target object in each picture frame in one or more consecutive picture frames corresponding to a target object;
  • the processor 002 is further configured to determine, in one or more consecutive picture frames corresponding to a target object, a priority of display of the preset target object in each picture frame;
  • the processor 002 is further configured to create a related information library of the original video according to the contour information of the target object in each picture frame and the priority of the display, where the related information library is a file that is read when playing the interactive video, and is saved.
  • the basic information of the target object and the video interaction information wherein the basic information of the target object includes the content to be displayed; the video interaction information includes the outline information of the target object included in each picture frame and the priority of the display.
  • the association information base of the video acquires one or more consecutive picture frames from the original video according to the existence period corresponding to the target, and determines the video production in the one or more consecutive picture frames.
  • the contour information of the target object preset by the user and the priority of the display solve the problem that the related information in the prior art is insufficient for the target object to be covered by the background or other objects.
  • FIG. 12 it is a structural diagram of a device for creating a related information library of a video according to another embodiment of the present invention.
  • the associated information base of the video can be used to create related information necessary for playing interactive video. Library.
  • the associated information base production platform of the video may include at least one I/O connection Port 005, at least one processor 006, such as CPU, memory 007, and display 008; memory 007 may include high speed RAM memory, and may also include non-volatile memory, such as at least one disk memory.
  • the memory 007 can optionally include at least one storage device located remotely from the aforementioned processor 006.
  • memory 007 stores the following elements, modules or data structures, or a subset thereof, or their extension set:
  • the application module 0072 includes one or a combination of the following modules: an acquisition module, a contour information determination module, a displayed priority determination module, an associated information base creation module, a setting display module, a first target object setting module, and a first correspondence relationship.
  • the module, the second target object setting module, the second correspondence relationship establishing module, and the interaction area setting module are provided.
  • the function of the above module may be referred to the description of the device structure diagram shown in FIG. 10, and details are not described herein again.
  • the processor 006 is connected to the memory 007;
  • the I/O interface 005 is connected to the processor 006 and the memory 007, and the other end is connected to the display 008;
  • the processor 006 is configured to obtain one or more consecutive picture frames from the original video according to the existence period of different target objects to be set;
  • the processor 006 is further configured to determine contour information of the preset target object in each picture frame in one or more consecutive picture frames corresponding to a target object;
  • the processor 006 is further configured to display a target object setting interface on the display 008;
  • the processor 006 is further configured to set an object in the area determined by the video production user in the target object setting interface as the target object, and classify the determined area contour information as the first contour information of the target object, and Carry in the video interaction information;
  • the processor 006 is further configured to establish a correspondence between the target object carried in the video interaction information and the basic information of the target object defined by the video production user for the set target object.
  • the basic information of the target object includes: one or more of an identifier of the target object, a name text of the target object, a detailed information text, a picture link, or a video link;
  • the processor 006 is specifically configured to establish the first contour information of the target object carried in the video interaction information, the identifier of the target object, the name text of the target object, the detailed information text, the image link, or the video link. Relationship.
  • the processor 006 is further configured to use the contour extraction algorithm to obtain the contour information of the target object in the determined region, and classify the second contour information of the target object, and carry the information in the video mutual information;
  • the processor 006 is further configured to establish a correspondence between the second contour information of the target object carried in the video interaction information and the basic information of the target object defined by the video production user for the set target object.
  • the processor 006 is further configured to acquire feature information of the target object in the determined region, and calculate, by using a target tracking algorithm, first contour information and second contour information of the target object of the remaining frame frames in the one or more consecutive picture frames. And carried in the video interaction information.
  • the related information library creation platform of the video provided by the embodiment of the present invention firstly obtains one or more consecutive picture frames from the original video, and then determines the target object in one of the picture frames according to the manual operation of the video production user. And extracting contour information, and finally using the target tracking algorithm to determine contour information of the target object in each of the one or more picture frames, the semi-automatic target object contour information extraction method is compared with the existing object-based object In terms of segmentation and classification methods, accuracy and efficiency have been further improved.
  • FIG. 13 is a structural diagram of a device of a video playing platform according to an embodiment of the present invention.
  • the video playing platform may be used to play an interactive video to a video on demand user.
  • the video plays flat
  • the station can include:
  • the parsing module 701 is configured to parse the associated information base of the original video and the original video, and obtain basic information and video interaction information of the target object saved in the associated information base of the original video, where the video interaction information includes the target included in each picture frame.
  • the outline information of the object and the priority of the display, the basic information of the target object contains the content for the display;
  • the information display module 702 is configured to: when detecting a predefined operation of the interaction area corresponding to the contour information of the target object in the currently played picture frame by the user, displaying, according to the displayed priority, the target object corresponding to the target object in the interaction area The content to be displayed in the basic information of the target object.
  • the parsing module 801 is configured to parse the associated information base of the original video and the original video, and obtain basic information and video interaction information of the target object saved in the associated information base of the original video, where the video interaction information includes the target included in each picture frame.
  • the outline information of the object and the priority of the display, the basic information of the target object contains the content for the display;
  • the information display module 802 displays to the user the content to be displayed in the basic information of the target object, which may be more than four types, such as:
  • the content to be displayed in the basic information of the target object may be divided into the summary content corresponding to the target object (such as the name of the target object) and the specific content corresponding to the target object (such as a detailed text description of the target object, related pictures or videos, etc.),
  • the target object can be set to two in one frame.
  • the interaction area that is, the first interaction area and the second interaction area, can be divided into two display modes, that is, the first display mode and the second display mode, in the basic information of the display target object.
  • the first display mode is to display the summary content of the target object next to the target object
  • the second display mode is to display the specific content of the target object next to the target object
  • the first display mode is to display the first interactive area or the second interactive area corresponding to the target object in the target object area
  • the second display mode is to display the specific content of the target object next to the target object
  • the first display mode is to display the specific content of the target object semi-transparent next to the target object
  • the second display mode is to cover the specific content of the target object next to the target object
  • the information display module 802 is further configured to: when there are multiple target objects in the currently played picture frame, and the interaction areas corresponding to the multiple target objects overlap, display the target objects with higher priority displayed in the plurality of target objects The content to be displayed in the basic information of the target object.
  • the information display module 802 is further configured to: when there are multiple target objects in the currently played picture frame, and the interaction areas corresponding to the multiple target objects overlap, according to the order of priority of the display, from high to low, in order The inner valley to be displayed in the basic information of each target object corresponding to the plurality of target objects is displayed.
  • the video playing platform receives the associated information library of the original video and the original video, and displays the interactive video to the target user according to the priority displayed by the target object in the associated information library, and On the basis of this, the presentation manner of the associated information base is enriched, and the specific information for providing the interactive information according to the target redemption display priority is provided, which avoids the redundancy of the presentation provided by all the information in the prior art;
  • the information transition provided by this solution also makes the processing more efficient, without providing all the associated information for each interaction as in the prior art.
  • FIG. 15 an apparatus structure of a video playing platform according to an embodiment of the present invention is shown. Figure.
  • the video playback platform can be used to play interactive video to a video on demand user.
  • the video playing platform may include: at least one I/O interface 009, at least one processor 010, such as a CPU, a memory 011, and a display 012; the memory 011 may include a high speed RAM memory, and may also include a non-unstable memory (non- Volatile memory ), such as at least one disk storage.
  • the memory 011 can optionally include at least one storage device located remotely from the aforementioned processor 010. In some embodiments, memory 011 stores the following elements, modules or data structures, or a subset thereof, or their extension set:
  • Operating system 0111 containing various programs for implementing various basic services and handling hardware-based tasks
  • the application module 0112 includes one or a combination of the following modules: a parsing module and an information display module.
  • a parsing module For the function of the above module, refer to the description of the device structure diagram shown in FIG. 13 , and details are not described herein again.
  • the processor 010 is connected to the memory 011;
  • the I/O interface 009 is connected to the processor 010 and the memory 011, and the other end is connected to the display 012;
  • the processor 010 is configured to receive an association information library of the original video and the original video, and obtain basic information and video interaction information of the target object saved in the associated information base of the original video, where the video interaction information includes the target included in each picture frame.
  • the outline information of the object and the priority of the display, the basic information of the target object contains the content for the display;
  • the processor 010 is further configured to: when detecting a predefined operation of the interaction area set by the interaction area setting module corresponding to the contour information of the target object in the currently played picture frame, according to the displayed priority, in the display 012 The content to be displayed in the basic information of the target object corresponding to the target object in the interaction area is displayed.
  • the video playing platform parses the associated information library of the original video and the original video, and displays the priority according to the target object in the associated information base and the basic information of the target object to be displayed.
  • the content displays the interactive video to the target user, and solves the problem in the prior art that when there are multiple target objects in the same screen and each target object overlaps, the content to be displayed in the basic information of matching and displaying the target object cannot be normally realized.
  • FIG. 16 which is a structural diagram of a device of a video playing platform according to another embodiment of the present invention.
  • the video playback platform can be used to play interactive video to a video on demand user.
  • the video playing platform may include: at least one I/O interface 013, at least one processor 014, such as a CPU, a memory 015, and a display 016; the memory 015 may include a high speed RAM memory, and may also include Non-volatile memory, such as at least one disk storage.
  • the memory 015 can optionally include at least one storage device located remotely from the aforementioned processor 014. In some embodiments, memory 015 stores the following elements, modules or data structures, or a subset thereof, or their extension set:
  • Operating system 0151 which contains various programs for implementing various basic services and handling hardware-based tasks
  • the application module 0152 includes one or a combination of the following modules: a parsing module and an information display module.
  • a parsing module For the function of the above module, refer to the description of the device structure diagram shown in FIG. 14 , and details are not described herein again.
  • the processor 014 is connected to the memory 015;
  • the I/O interface 013 is connected to the processor 014 and the memory 015, and the other end is connected to the display 016;
  • the processor 014 is further configured to: when detecting a predefined operation of the interaction area set by the interaction area setting module corresponding to the contour information of the target object in the currently played picture frame, according to the displayed priority, in the display 016 The content to be displayed in the basic information of the target object corresponding to the target object in the interaction area is displayed.
  • the processor 014 displays the basic information of the target object to the user, and the content to be displayed may be more than four types, for example:
  • the content to be displayed in the basic information of the target object may be divided into the summary content corresponding to the target object (such as the name of the target object) and the specific content corresponding to the target object (such as a detailed text description of the target object, related pictures or videos, etc.),
  • the target object can be configured with two interaction areas, that is, the first interaction area and the second interaction area, in one picture frame. Therefore, the content to be displayed in the basic information of the display target object can be divided into two display modes, that is, The first display mode and the second display mode.
  • the processor 014 may display the content to be displayed in the basic information of the target object to the user in the display 016 according to the first display manner; when detecting the target object During the operation of the second interaction area, the processor 014 may display the content to be displayed in the basic information of the target object to the user in the display 016 according to the second display mode.
  • the first display mode and the second display mode may have multiple types, such as:
  • the first display mode is to display the summary content of the target object next to the target object, and the second display side Is to display the specific content of the target object next to the target object;
  • the first display mode is to display the first interactive area or the second interactive area corresponding to the target object in the target object area
  • the second display mode is to display the specific content of the target object next to the target object
  • the first display mode is to display the specific content of the target object semi-transparent next to the target object
  • the second display mode is to cover the specific content of the target object next to the target object
  • the processor 014 is further configured to: when there are multiple target objects in the currently played picture frame, and the interaction areas corresponding to the multiple target objects overlap, displaying the higher priority displayed in the multiple target objects in the display 016 The content to be displayed in the basic information of the target object corresponding to the target object.
  • the processor 014 is further configured to: when there are multiple target objects in the currently played picture frame, and the interaction areas corresponding to the multiple target objects overlap, according to the priority of the display from high to low, in the display 016
  • the content to be displayed in the basic information of each target object corresponding to the plurality of target objects is sequentially displayed.
  • the video playing platform receives the associated information library of the original video and the original video, and displays the interactive video to the target user according to the priority displayed by the target object in the associated information library, and On the basis of this, the presentation manner of the associated information base is enriched, and the specific information for providing the interactive information according to the target redemption display priority is provided, which avoids the redundancy of the presentation provided by all the information in the prior art;
  • the information transition provided by this solution also makes the processing more efficient, without providing all the associated information for each interaction as in the prior art.
  • FIG. 17 a system configuration diagram of a system for creating and storing video related information of a video provided by an embodiment of the present invention is shown.
  • the system for creating and playing video related information of the video can be applied to create and play interactively.
  • Video The system for the related information library creation and video playback of the video may include: a related information library creation platform 1110 and a video playback platform 1120 of the video provided by the foregoing embodiment.
  • the video related information library production platform and the video playing platform process the original video to generate an associated information library, and the specific flow of playing the interactive video according to this is shown in FIG. 18.
  • the associated database creation platform 904 of the video creates an associated information base according to the original video, and stores the original video together with the corresponding associated information base into the video server 902. Among them, the system will also close the video.
  • the content corresponding to the link in the information repository is stored in the video associated content library; when playing the video, the video playing platform 901 obtains the original video and the corresponding associated information base, and displays the interaction to the user according to the original video and its associated information base.
  • the video playing platform sends a request to the associated content server 903 according to the link in the associated information library, and obtains the corresponding link in the saved video related content library, when the content pointed to by the link in the associated information library needs to be displayed to the user.
  • the optional video playing platform 901 and the video server 902 can be completed by means of online play and online interaction. That is, the video is transmitted to the video playing platform in real time by the video server 902, and the interactive information from the video playing platform is also acquired by the video server 902 to the associated content server 903, and the communication channel established with the video playing platform 901 is utilized.
  • the optional video playing platform 901 and the video server 902 can be completed by means of online play and local interaction, or by a local download play and local interaction.
  • the associated information base is directly sent to the video playing platform 901 via the video server 902 and stored in the video playing platform 901; then the interactive information generated by the user's interactive actions is maintained by the video playing platform 901 itself.
  • the content server 903 is associated with the link in the associated information base to obtain.
  • the communication channel indicated by the broken line in FIG. 18 is no longer needed, and the communication between the video playing platform 901 and the associated content server 903 is also indicated by the "request" and "send” indicated by the solid line in the figure. carry out.
  • the system for creating and storing video related information of the video presented by the embodiment of the present invention presents the interaction relationship of each platform in the present invention and its role in the system from the system level.
  • the related information library creation platform and the video playing platform provided by the foregoing embodiments, when the related information base and the video playing video are created, only the division of the above functional modules is illustrated. In practical applications, The above function assignment is completed by different functional modules, that is, the internal structure of the platform is divided into different functional modules to complete all or part of the functions described above.
  • the related information library creation platform of the video and the video playback platform and the video related information library creation method and the video playback method embodiment are the same concept, and the specific implementation process is described in the method embodiment, and details are not described herein again.
  • a person skilled in the art may understand that all or part of the steps of implementing the above embodiments may be completed by hardware, or may be instructed by a program to execute related hardware, and the program may be stored in a computer readable storage medium.
  • the storage medium mentioned may be a read only memory, a magnetic disk or an optical disk or the like.
  • the above is only the preferred embodiment of the present invention, and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc., which are within the spirit and scope of the present invention, should be included in the protection of the present invention. Within the scope.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • General Engineering & Computer Science (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

La présente invention concerne le domaine des ordinateurs. Selon des modes de réalisation, l'invention concerne un procédé, une plateforme et un système destinés à bâtir une bibliothèque d'informations associées d'une vidéo et à lire la vidéo. Le procédé comprend les étapes suivantes : obtenir, à partir d'une vidéo originale, une ou plusieurs trames vidéo continues, en fonction des cycles de vie de différentes cibles à définir; déterminer, dans une ou plusieurs trames vidéo continues correspondant à une cible, des informations de profil et une priorité d'affichage de la cible prédéfinie dans chaque trame vidéo; puis créer une bibliothèque d'informations associées relative à la vidéo d'origine selon les informations de profil et la priorité d'affichage de la cible dans chaque trame vidéo. Dans la présente invention, une ou plusieurs trames vidéo continues sont obtenues à partir d'une vidéo d'origine, en fonction des cycles de vie correspondant aux cibles, puis des informations de profil et une priorité d'affichage d'une cible prédéfinie par un utilisateur de la production vidéo sont déterminées dans la ou les trames vidéo continues, ce qui résout l'inconvénient de l'état de la technique, selon lequel les informations associées sont vides lorsque la cible est recouverte par l'arrière-plan ou d'autres cibles dans la bibliothèque d'informations associées.
PCT/CN2012/087295 2012-12-24 2012-12-24 Procédé, plateforme et système de création de bibliothèque d'informations associées de vidéos et de lecture des vidéos WO2014100936A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/CN2012/087295 WO2014100936A1 (fr) 2012-12-24 2012-12-24 Procédé, plateforme et système de création de bibliothèque d'informations associées de vidéos et de lecture des vidéos
CN201280002756.9A CN104041063B (zh) 2012-12-24 2012-12-24 视频的关联信息库制作和视频播放的方法、平台及系统

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2012/087295 WO2014100936A1 (fr) 2012-12-24 2012-12-24 Procédé, plateforme et système de création de bibliothèque d'informations associées de vidéos et de lecture des vidéos

Publications (1)

Publication Number Publication Date
WO2014100936A1 true WO2014100936A1 (fr) 2014-07-03

Family

ID=51019628

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2012/087295 WO2014100936A1 (fr) 2012-12-24 2012-12-24 Procédé, plateforme et système de création de bibliothèque d'informations associées de vidéos et de lecture des vidéos

Country Status (2)

Country Link
CN (1) CN104041063B (fr)
WO (1) WO2014100936A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106662920A (zh) * 2014-10-22 2017-05-10 华为技术有限公司 交互式视频生成

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018043143A1 (fr) * 2016-08-30 2018-03-08 ソニー株式会社 Dispositif et procédé de transmission, dispositif et procédé de réception
CN107871190B (zh) * 2016-09-23 2021-12-14 阿里巴巴集团控股有限公司 一种业务指标监控方法及装置
TWI656792B (zh) * 2017-01-12 2019-04-11 沈國曄 跨平台播放互動影片之方法
CN108600822A (zh) * 2018-05-24 2018-09-28 安徽质在智能科技有限公司 在线购物视频信息播放方法和系统
CN108769688B (zh) * 2018-05-24 2021-09-03 西华师范大学 视频编解码方法
CN108769808B (zh) * 2018-05-24 2021-01-29 浙报融媒体科技(浙江)有限责任公司 交互式视频播放方法和系统
CN112218160A (zh) * 2020-10-12 2021-01-12 北京达佳互联信息技术有限公司 视频转换方法及装置和视频转换设备及存储介质

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1503554A (zh) * 2002-11-21 2004-06-09 余明和 一种制作电视广告的内容暨插播广告于电视节目上的装置及方法
CN101035261A (zh) * 2007-04-11 2007-09-12 宁波大学 一种交互式多视点视频系统的图像信号处理方法
CN102376061A (zh) * 2011-08-26 2012-03-14 浙江工业大学 基于全方位视觉的消费者购买行为分析装置

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010109773A (ja) * 2008-10-30 2010-05-13 Koichi Sumida 情報提供システム、コンテンツ配信装置およびコンテンツ視聴用の端末装置
CN101489139B (zh) * 2009-01-21 2010-11-10 北京大学 基于视觉显著度的视频广告关联方法与系统
CN102232220B (zh) * 2010-10-29 2014-04-30 华为技术有限公司 一种视频兴趣物体提取与关联的方法及系统
CN102419945A (zh) * 2011-12-09 2012-04-18 上海聚力传媒技术有限公司 用于在视频中呈现展现信息的方法、装置、设备和系统

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1503554A (zh) * 2002-11-21 2004-06-09 余明和 一种制作电视广告的内容暨插播广告于电视节目上的装置及方法
CN101035261A (zh) * 2007-04-11 2007-09-12 宁波大学 一种交互式多视点视频系统的图像信号处理方法
CN102376061A (zh) * 2011-08-26 2012-03-14 浙江工业大学 基于全方位视觉的消费者购买行为分析装置

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106662920A (zh) * 2014-10-22 2017-05-10 华为技术有限公司 交互式视频生成
CN106662920B (zh) * 2014-10-22 2020-11-06 华为技术有限公司 交互式视频生成
CN112449253A (zh) * 2014-10-22 2021-03-05 华为技术有限公司 交互式视频生成

Also Published As

Publication number Publication date
CN104041063B (zh) 2017-11-24
CN104041063A (zh) 2014-09-10

Similar Documents

Publication Publication Date Title
WO2014100936A1 (fr) Procédé, plateforme et système de création de bibliothèque d'informations associées de vidéos et de lecture des vidéos
WO2021082668A1 (fr) Procédé d'édition d'écran de commentaires défilants, terminal intelligent et support de stockage
US9118886B2 (en) Annotating general objects in video
US9047376B2 (en) Augmenting video with facial recognition
US11551424B2 (en) Interaction analysis systems and methods
JP5533861B2 (ja) 表示制御装置、表示制御方法、及び、プログラム
US20160050465A1 (en) Dynamically targeted ad augmentation in video
CN102467661B (zh) 多媒体设备及其控制方法
JP2011223287A (ja) 情報処理装置、情報処理方法、及び、プログラム
US11100368B2 (en) Accelerated training of an image classifier
CN108509893A (zh) 基于微表情识别的影视评分方法、存储介质及智能终端
WO2022089170A1 (fr) Procédé et appareil d'identification de zone de sous-titres, et dispositif et support de stockage
KR102102164B1 (ko) 영상 전처리 방법, 장치 및 컴퓨터 프로그램
CN104969240B (zh) 用于图像处理的方法和系统
CN113766296A (zh) 直播画面的展示方法和装置
CN105657514A (zh) 一种在移动设备浏览器中视频播放关键信息的方法及装置
CN105979366A (zh) 智能电视及其内容推荐的方法、装置
WO2023056835A1 (fr) Procédé et appareil de génération de couverture vidéo, et dispositif électronique et support lisible
CN106851395B (zh) 视频播放方法和播放器
US20170013309A1 (en) System and method for product placement
CN110418148A (zh) 视频生成方法、视频生成设备及可读存储介质
US20220171202A1 (en) Information processing apparatus, information processing method, and program
CN105975054A (zh) 一种信息处理方法和装置
CN111768729A (zh) 一种vr场景自动解说方法、系统和存储介质
CN115115976A (zh) 视频处理方法、装置、电子设备及存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12891110

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 12891110

Country of ref document: EP

Kind code of ref document: A1