TWI497959B - Scene extraction and playback system, method and its recording media - Google Patents

Description

Scene capture and playback system, method and recording medium thereof

The present invention relates to a summary capture and play system and method for a scene, and a recording medium thereof, and particularly to a summary capture and play system and method for scenes for extracting a desired media segment by scene description information Record media.

In the prior art, media materials are mostly used in linear playback. The video playback software provides a timeline corresponding to the playing media data. The user can click on the timeline or drag the axis latch on the timeline to determine the video playback segment.

However, when a user is unfamiliar with the content of the media material, if the user wants to create a summary material for the media material, the user needs to spend more time searching for the desired video scene. Secondly, the accuracy of the drag of the axle latch depends on the length of the time axis. If the time axis is too short, it is difficult for the user to drag the axle latch to the required fixed point, which will increase the user's operation trouble. Third, if users want to obtain targeted images or audio from media materials, or further construct appropriate media summary information for media materials, they must manually perform timeline control operations, and cannot directly find relevant information. Video scene. Fourth, in order to improve the accuracy of image capture, it is generally necessary to use at least one of a specific image capture program, software and tools. The above problems will not only increase the cost of media capture, but also increase the complexity of user operations, and users cannot make personalized choices. Selectively viewing the desired segments, the freedom of media operation is relatively low.

Therefore, how to simplify the acquisition, control and operation of media materials, and provide a customized media control technology that meets the needs of users, is a topic that manufacturers should consider.

In order to solve the above problems, the present invention discloses a scene abstracting and playing system, method and recording medium thereof, which are used as a media selection basis by using scene description information to provide a media section required by a user.

The summary capture and play system of the scene disclosed by the present invention comprises a media providing device, a description server device, a scene server device and a terminal device.

This media providing device is used to provide a media material. The terminal device is configured to input a summary capture instruction. The description server is configured to receive the media data to provide scene description information of the scene segment corresponding to the media data, and each scene description information records the playing content of the corresponding scene segment. The scene servo device is configured to obtain a summary capture instruction, and analyze the recorded content of each scene description information according to the summary capture instruction, and extract a plurality of partial scene segments from the media data according to the analysis result to form a media summary data, and The media summary data is output to the terminal device.

The method for extracting and playing the scene of the present invention includes: providing a media data by a media providing device; then receiving the media data by a description server, and providing a scene film corresponding to the media data The scene description information of the segment, each of the scene description information records the content of the scene segment corresponding to the scene; the scene servo device obtains a summary capture instruction provided by the terminal device; and the scene servo device retrieves the instruction according to the summary The recorded content of each scene description information is analyzed, and a plurality of partial scene segments are extracted from the media data to form a media summary data; and the scene summary device outputs the media summary data to the terminal device.

In addition, the present invention also discloses a recording medium that stores an executable code readable by an electronic device. A summary capture and playback method of a scene is executed when the electronic device reads the code. This method is as described above.

The invention is characterized in that the present invention provides targeted media description data by analyzing the scene description information, and the user does not need to spend more time to find the desired video scene. Secondly, the user can obtain the required media summary data without worrying about the timeline control operation of the media data, which not only can maintain the accuracy of the scene video, but also simplify the complexity of the image control, and avoid the user's difficulty in dragging the axis. The operability of the fixed point of the latch to the demand. Third, by capturing the targeted scene segments, the user can obtain the required scene segments at one time, and construct appropriate media summary data for the media data, which not only forms a customized media control that meets the user's needs, but also can Reduce the complexity of user operations. Fourth, by analyzing the scene description information and the provision of the media summary data, the user can preview/listen to the outline content of the media material and select whether to play the entire content of the media material.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The preferred embodiments of the present invention will be described in detail below with reference to the drawings.

1 is a schematic diagram of a schematic capture and playback system architecture of a scenario in accordance with an embodiment of the present invention. This system can be applied to devices, devices or systems with media playback capabilities, and the configuration type is not limited. The summary capture and playback system of this scenario includes a client side (Client Side) and a server side (Server Side), and devices and devices at both ends are connected through a network. The server includes a media supply device 10 (Media Supply Equipment), a description server device 20 (Scene Description Server), and a scene server device 30 (Scene Server). The client includes more than one terminal device (End Device), which is a user's electronic device, such as a personal computer (PC), a notebook (NoteBook), a tablet (Tablet PC), a smart phone (Smart). Phone), Set-Top Box (STB), etc., have a human-machine interface for user manipulation and an electronic device that connects to the network. In this example, a terminal device 40 will be described.

The media providing device 10 is configured to provide a media data 11 (Media data). This media material 11 can be an overall image, audio or video material, or stream data that is transmitted in real time. The media providing device 10 may be a device that is in the same place as the description of the server device 20 and the scene server device 30, or a third-party device (Third-Party Equipment). The mode in which the media providing device 10 outputs the media material 11 includes: broadcast, broadband, and Wired and wireless data transmission methods such as cable transmission (Community Antenna Television, Community Antenna Television, Cable Television, CATV), Internet Protocol Television (IPTV), etc. are also not limited.

The media providing device 10 includes a hardware having a media supply capability, or a composition of at least one type of a unit, a component, a device, a device, and a system, which are combined with a software and a hardware. The media material 11 includes a plurality of scene segments of different contents. For example, when the media material 11 is image data, the image data is an image segment having more than one content such as a target, a scene, a character, and the like. Another example is that the media material 11 is a voice data (Voice Data), and the audio data is an audio segment having more than one content such as a treble, a bass, a voice, a music, and the like.

When the description of the media data 11 is obtained by the servo device 20, the scene description information 21 corresponding to the media material 11 is provided. The scene description information 21 is an annotation material for interpreting the media material 11 or the scene segment included in the media material 11. In this embodiment, each scene description information 21 records the playing content of the corresponding scene segment. The scenario description information 21 is provided as follows: (1) The description of the scenario description information 21 is performed by the description server device 20 directly according to the media content 11 or the content of the scene segment; (2) the corresponding media material 11 is obtained from the external device. Scene description information 21.

The terminal device 40 includes a data input interface for the user to input data, and also has the ability to play media. The presentation end of the interface of the terminal device 40 depends on the needs of the designer and is not limited. The user utilizes the terminal device 40 Use the input a summary command 41 (Summary Collect Command).

The summary capture command 41 refers to a request condition (Request Condition) input by the user when the user wants to seek a specific media segment from the media material 11, and the search condition is the media material 11 or the scene segment. Play content. For example, when the media material 11 is a recorded image of a basketball game, the user inputs a score map of the favorite player's goal, or a three-point shooting score of all the athletes of the event, or a three-point shooting score of the favorite player. Screen...etc. Seeking conditions like this. For another example, when the media material 11 is a musical material of a opera type, the user inputs the solo performance of the opera actress, or the pure music piece to play... and the like.

The scene servo device 30 obtains the summary capture instruction 41 and the media material 11, but the source of the media data 11 is the description of the servo device 20 or the media providing device 10. The scene servo device 30 analyzes the play content recorded in each scene description information 21 according to the summary capture instruction 41, and forms a plurality of partial scene segments 32 from the media data 11 according to the analysis result, and forms the scene segments into a media summary data. 31 to output to the terminal device 40.

However, the types of seeking conditions included in the summary capture instruction 41 are as follows:

(1) This summary capture instruction 41 includes a content specification information. When the scene servo device 30 analyzes the record information of each scene description information 21 according to the summary capture instruction 41, the scene description information 21 corresponding to the content designation information is obtained, and the local field corresponding to the scene description information 21 is taken out. The scene segment 32 is formed to form a media summary material 31.

(2) The scene servo device 30 first classifies each scene description information 21 according to the record information of each scene description information 21, and then divides one or more scene segment data 33 from the media material 11 according to the classification result. The summary capture instruction 41 includes a content specification material. When the scene servo device 30 analyzes the record information of each scene description information 21 according to the content designation data, one or more target scene segment data 33 are taken out from all the scene segment data 33 to form the media summary data 31.

Moreover, the summary retrieval instruction 41 may include more than one seeking condition, and may also include a plurality of different retrieval demand seeking conditions. The scene servo device 30 is capable of forming one or more media summary data 31 from the media material 11 in accordance with each of the seeking conditions.

After receiving the one or more media summary materials 31, the terminal device 40 plays the game or presents it as a list. The user plays the selected one or more media summary data 31 through the control interface of the terminal device 40.

Further, the scene servo device 30 obtains the data dependency relationship of each scene description information 21 or the category of the data attribute to classify the scene description information 21 according to the record information of each scene description information 21, and divides the scene description information 21 according to the classification result. A plurality of scene clip data 33. The scene servo device 30 constructs each scene segment data 33 into a media play tree structure according to the data dependency, data attribute and data level relationship of each scene description information 21. When the scene servo device 30 obtains the summary capture instruction 41, the related field is extracted from the media play tree structure according to the summary capture instruction 41. The segment data 33 is formed to form a media summary material 31. Moreover, the summary capture instruction 41 can also include a tree structure level data that records a tree hierarchy of the media playback tree structure. When the scene servo device 30 obtains the summary capture instruction 41, only at least one of the partial scene segments 32 and/or the scene segment data 33 is extracted from the media playback tree structure from the tree hierarchy specified by the tree structure level data to form Media summary information 31.

However, the interface of the terminal device 40 can also present an input field of the media play tree structure, and the user inputs each search condition into each field according to the data dependency relationship of each search condition or the category of the data attribute. The scene servo device 30 serves as a basis for capturing and classifying the scene segment.

However, the media providing device 10 is also provided with a plurality of media materials 11 and the scenario description information 21 corresponding to each media material 11 is provided by the description server device 20. When the user inputs the summary capture command 41 by using the terminal device 40, the user can set different search conditions for each media material 11, or set the search conditions for all the media materials 11, depending on the needs of the user.

The scene server device 30 analyzes the related scene description information 21 according to the summary capturing instruction 41, and forms one or more media summary data 31 from each of the media materials 11 to be transmitted back to the terminal device 40.

However, the captured segment, the scene description information 21, the media playing tree structure, the playing media, etc., are retrieved and stored in the scene server 30 for use in providing the secondary media summary data 31 for the job. What's more, the media summary data 31 constructed by the scene segment provides the work. It can be stored in the terminal device 40 for direct access and playback of the playback soft/hardware of the terminal device 40.

2 is a schematic flowchart of a summary capture and play method of a scenario in the embodiment of the present invention. FIG. 3 to FIG. 4 are schematic diagrams showing details of a summary capture and playback method in a scenario according to an embodiment of the present invention. Please refer to Figure 1 to Figure 3 for help. The flow of this method is as follows:

A media material 11 is provided by a media providing device 10 (step S110). As described above, the media material 11 provided by the media providing device 10 can be an overall image, audio or video material, or stream data that is transmitted in real time. The media data 11 transmission mode includes: broadcast, broadband transmission, wired transmission, network protocol transmission, etc., and other wired and wireless data transmission methods.

The media data 11 is received by a description server device 20, and the scene description information 21 corresponding to the media material 11 is provided, and each scene description information 21 records the content of the corresponding scene segment (step S120). As described above, the scene description information 21 is provided in the following manner: (1) The description of the scene description information 21 is performed by the description server device 20 directly according to the broadcast content of the media material 11 or the scene segment; (2) the medium is obtained from the external device. The scene description information 21 corresponding to the data 11.

A summary capture command 41 provided by the terminal device 40 is obtained by a scene servo device 30 (step S130). The summary capture instruction 41 refers to a search condition input by the user when the user wants to seek a specific media segment from the media material 11. Seeking conditions for media material 11 or scene film The playback content of the segment.

The scene servo device 30 analyzes the play content recorded in each scene description information 21 according to the summary capture instruction 41, and extracts the partial scene segment 32 from the media material 11 according to the analysis result to form a media summary data 31 (step S140). In this step, according to the difference of the search conditions included in the summary capture instruction 41, the mode in which the scene servo device 30 takes out the partial scene segment 32 is also different. described as follows:

(1) As shown in FIG. 1 and FIG. 3, each scene description information 21 stores the play content of its corresponding scene segment, and the summary capture instruction 41 includes content designation information. In this step, when the scene server 30 analyzes the content of the scene description information 21 according to the summary capturing instruction 41, the scene servo device 30 obtains a plurality of target scene description information whose recording information conforms to the content specifying information (step S142). Thereafter, the scene servo device 30 forms the local scene segment 32 corresponding to the target scene description information into the media summary data 31 (step S148).

(3) As shown in FIG. 1 and FIG. 4, the scene servo device 30 classifies each scene description information 21 according to the record information of each scene description information 21, and divides a plurality of scene segment data 33 from the media material 11 according to the classification result. The summary capture instruction 41 includes a content specification material. In this step, the scene server 30 analyzes the record information of each scene description information 21 according to the content specification data (step S143), and extracts at least one target scene segment data 33 from all the scene segment data 33 to form the media summary data 31. (Step S149).

Thereafter, the media summary data 31 is output from the scene servo device 30 to the terminal device 40 (step S150). When the terminal device 40 receives the one or more media summary data 31, it is played, or presented as a list, or stored in the terminal device 40. The user plays the selected one or more media summary data 31 through the control interface of the terminal device 40.

FIG. 5 is a schematic diagram of a process of constructing a media play tree structure according to an embodiment of the present invention. Please cooperate with Figure 1 to facilitate understanding. This method includes:

The scene servo device 30 obtains the data dependency relationship of each scene description information 21 or the category of the data attribute to classify the scene description information 21 according to the record information of each scene description information 21, and divides the plurality according to the classification result. Scene clip data 33 (step S210).

The scene segment device 33 constructs each scene segment data 33 into a media play tree structure according to the data dependency, data attribute and data level relationship of each scene description information 21 (step S220).

Therefore, in step S140, when the scene servo device 30 obtains the summary capture instruction 41, the partial scene segment is extracted from the media play tree structure according to the summary capture instruction 41 to form the media summary data 31.

6 to FIG. 9 are schematic diagrams showing the context of media control according to an embodiment of the present invention. Here, the media material 11 is described by a recorded image of a basketball game.

FIG. 6 is a schematic diagram of a media hierarchy according to an embodiment of the present invention. Recorded images of basketball games can be divided into different image levels. The highest level, It is the video of the whole game; the second is the video of each section; the video of the close-up is again. The entire video is composed of a plurality of scene segments and corresponds to the scene description information 21.

FIG. 7 is a schematic diagram of scene description information according to an embodiment of the present invention, which presents a scene description of a basketball game image and a scene corresponding time.

When the user only wants to view the summary screen of the "3rd round three-point scoring screen", the "third-third three-point scoring screen" can be set as the content specifying information in the summary capturing command 41. The scene servo device 30 will take the countdown of the third game "11:39", "09:16", "08:58", "07:47", etc., corresponding to the "third game three-point scoring scene" Time point. The scene servo device 30 captures the corresponding scene segment data 33 forward, backward or centered at the same time point, and combines them to form the media summary data 31 for the relevant terminal device to play.

FIG. 8 is a schematic diagram showing the formation of media summary data according to an embodiment of the present invention. It is assumed that the scene segment of the "third game three-point scoring screen" is included in the scene segments P1, P3, and P5. The scene servo device 30 extracts the scene segments P1, P3, and P5 from the media material 11, and forms the above-mentioned media summary data 31 for the related terminal device to play.

FIG. 9 is a schematic structural diagram of a media play tree according to an embodiment of the present invention. Here, the image hierarchy shown in FIG. 6 can be constructed as the data-dependent relationship of the abstract capture instruction 41 or the category of the data attribute, and the entire recorded image, the scene description information 21 or the scene segment data 33 can be constructed as A media playback tree structure.

The first layer of this media playback tree structure is the entire game video. The second layer is the branch of the first layer of video, which is the video of each section. The third layer is the branch of the second layer of video, which is a close-up video of the two sides in the game. The fourth layer is the branch of the third layer video, which is a close-up video of the specific players in the game.

After the summary capture instruction 41 is set by the user, the scene servo device 30 extracts the required scene segment data 33 according to the content designation data included in the summary capture instruction 41, and forms a desired scene segment data 33 to form The media summary material 31 is transmitted to the terminal device 40.

However, the scene servo device 30 does not need to take into account the above-mentioned image hierarchy, but extracts the scene segment data 33 of any level according to the first target scene description information 42 to form the above-mentioned media segment data. In addition, the media summary data 31 can also include a tree structure level data, which specifies that the scene server device 30 can retrieve the level of the scene segment data 33 from the media tree structure.

In the above, it is merely described that the present invention is an embodiment or an embodiment of the technical means for solving the problem, and is not intended to limit the scope of implementation of the present invention. That is, the equivalent changes and modifications made in accordance with the scope of the patent application of the present invention or the scope of the invention are covered by the scope of the invention.

10‧‧‧Media supply equipment

11‧‧‧Media Information

20‧‧‧Description of servo equipment

21‧‧‧Scenario description information

30‧‧‧Scenario Servo Device

31‧‧‧Media summary information

32‧‧‧Part scene clips

33‧‧‧Scenario data

40‧‧‧ Terminal devices

41‧‧‧Summary capture instruction

P1~P6‧‧‧Scenario

S110~S150‧‧‧Steps

S210~S220‧‧‧Steps

FIG. 1 is a schematic structural diagram of a summary capture and play system of a scenario according to an embodiment of the present invention.

FIG. 2 is a schematic flowchart diagram of a method for extracting and playing a summary of a scenario according to an embodiment of the present invention.

FIG. 3 to FIG. 4 are schematic diagrams showing details of a summary capture and playback method of a scenario according to an embodiment of the present invention.

FIG. 5 is a schematic diagram showing a process of constructing a media play tree structure according to an embodiment of the present invention.

FIG. 6 is a schematic diagram of a media hierarchy according to an embodiment of the present invention.

FIG. 7 is a schematic diagram of scene description information according to an embodiment of the present invention.

FIG. 8 is a schematic diagram showing the formation of media summary data according to an embodiment of the present invention.

FIG. 9 is a schematic structural diagram of a media play tree according to an embodiment of the present invention.

S110~S150‧‧‧Steps

Claims (10)

A summary and capture system for a scene, comprising: a media providing device for providing a media data; and a description server device for receiving the media data to provide a scene description information corresponding to a segment of the media data Each scene description information records the content of the scene segment corresponding to the scene segment; a scene server device is configured to obtain a summary capture instruction and the media data, and analyze each scene description information according to the summary capture instruction. The recorded content is extracted from the media data according to the analysis result to form a media summary data and output, wherein the scene servo device classifies each scene description information according to the record information of each scene description information. According to the classification result, a plurality of scene segment data are divided from the media data, and each scene segment data is constructed into a media playing tree structure according to the data dependency, the data attribute and the data hierarchical relationship of each scene description. When the scene servo device obtains the summary capture instruction, Receiving, by the summary capture instruction, at least one of the scene segment data from the media play tree structure to form the media summary data; and a terminal device for inputting the summary capture instruction and obtaining the media summary data . The summary capture and play system of the scenario described in claim 1 , wherein the summary capture instruction includes a content specifying information, and the scene server analyzes each scene description information according to the summary capture instruction. And obtaining a plurality of target scene description information corresponding to the specified information of the content, and extracting the partial scene segments corresponding to the target scene description information to form the media summary data. The summary capture and play system of the scenario described in claim 1 , wherein the scene servo device classifies each scene description information according to the record information of each scene description information, and divides the scene description information according to the classification result. And outputting a plurality of scene segment data, the summary capturing instruction includes a content specifying data, and the scene servo device analyzes the recording information of each scene description information according to the content specifying data, and extracts at least one target scene segment from the scene segment data. Information to form the media summary data. The summary capture and play system of the scenario described in claim 1 , wherein the summary capture instruction includes a tree structure level data, and the scene servo device plays a tree from the media according to a tree level recorded by the tree structure level data. The structure extracts at least one of the scene segment data to form the media summary data. A summary and playback method for a scene, comprising: providing a media data by a media providing device; receiving the media data by a description server device, and providing scene description information corresponding to the scene segment of the media data, each of the The scene description information records the content of the scene segment corresponding to the scene segment; a scene server provides a summary capture instruction provided by the terminal device; and the scene servo device analyzes each of the scenes according to the summary capture command. The scenario describes the content of the recorded content, and extracts a plurality of partial scene segments from the media data according to the analysis result to form a media summary data, wherein the scene servo device describes the data dependency relationship or data according to the scene. The category of the attribute is used to classify each of the scene description information, and the plurality of scene segment data are divided according to the classification result; the scene servo device describes the data dependency, the data attribute and the data hierarchy relationship of the information according to each scene description. The scene segment data is constructed as a media play tree structure, wherein the scene server device extracts the partial scene segments from the media play tree structure according to the summary capture instruction to form the media summary data; and the scene server device The media summary data is output to the terminal device. The method for extracting and playing a summary of the scenario described in claim 5, wherein each of the scene description information stores a play content corresponding to the scene segment, and the summary capture instruction includes a content designation information, and The scene servo device analyzes each scene description information according to the summary capture instruction, and the step of extracting the partial scene segments from the media data to form a media summary data includes: when the scene servo device analyzes the summary according to the summary When the scene description information is obtained, the plurality of target scene description information that the record information meets the content specification information is obtained; and the partial scene segments corresponding to the target scene description information are retrieved by the scene server device to form the media summary data. Abstract drawing and playing party for the scenario described in item 5 of the patent application scope The method, wherein the scene servo device classifies each scene description information according to the record information of each scene description information, and divides a plurality of scene segment data from the media data according to the classification result, where the summary capture instruction includes a content designation And the step of analyzing, by the scene server, the scene description information according to the summary capture instruction, and extracting the partial scene segments from the media data to form a media summary data, the step of: determining, by the scene servo device, the content The specified data is used to analyze the record information of each scene description information, and at least one target scene segment data is taken out from the scene segment data to form the media summary data. A recording medium storing an executable code readable by an electronic device, and executing a method for extracting and playing a scene when the electronic device reads the code, the method comprising the steps of: providing a medium by a media providing device Receiving the media data by a description server, and providing scene description information corresponding to the scene segment of the media data, each scene description information recording the content of the corresponding scene segment; obtaining a scene servo device a summary capture instruction provided by the terminal device; the scene servo device analyzes the play content recorded in each scene description information according to the summary capture instruction, and extracts a plurality of partial scene segments from the media data to form a media according to the analysis result. The summary data, wherein the scene servo device classifies each scene description information according to the data dependency relationship or the category of the data attribute of each scene description information, and divides the plurality of scene fragments according to the classification result. The scene servo device constructs the scene segment data into a media play tree structure according to the data dependency, the data attribute and the data hierarchy relationship of the scene description information, wherein the scene servo device captures the instruction according to the summary And extracting the partial scene segments from the media play tree structure to form the media summary data; and outputting the media summary data to the terminal device by the scene server device. The recording medium of claim 8, wherein each of the scene description information stores a play content corresponding to the scene segment, the summary capture instruction includes a content designation information, and the scene servo device is based on the abstract The step of extracting the scene description information from the media data to form the media summary data from the media data includes: when the scene servo device analyzes each scene description information according to the summary capture instruction, Obtaining a plurality of target scene description information corresponding to the specified information of the content; and acquiring, by the scene server device, the partial scene segments corresponding to the target scene description information to form the media summary data. The recording medium according to claim 8 , wherein the scene servo device classifies each scene description information according to the record information of each scene description information, and divides a plurality of scene segment data from the media data according to the classification result. The summary capture instruction includes a content specifying data, and the scene server analyzes each scene description information according to the summary capture instruction, and extracts the partial scene segments from the media data. The step of forming a media summary data includes: analyzing, by the scene server, the record information of each scene description information according to the content specification data, and extracting at least one target scene segment data from the scene segment data to form the media summary. data.