KR102247532B1 - Method, server and system for providing video scene collection - Google Patents

Abstract

The aggregate view providing server divides the content into a plurality of scenes, a metadata processing unit that processes metadata for objects in each scene, a metadata base that stores the processed metadata, and a specific object among the metadata. It is configured to include a group view organizer that selects and organizes metadata to generate a metafile, and a metafile execution unit that controls a VOD server based on the metafile.

Description

How to provide video footage collection, server and system {METHOD, SERVER AND SYSTEM FOR PROVIDING VIDEO SCENE COLLECTION}

The present invention relates to a method, a server, and a system for providing video scene collection.

One of the important services provided by IPTV, cable TV, and OTT (Over The Top) media providers is the Video On Demand (VOD) service. Viewers' viewing patterns may vary by genre, such as dramas, movies, and documentaries. Services that reflect the desire to consume various contents are being tried. With respect to such a method for providing a summary view, Korean Patent Publication No. 10-1999-0044496, which is a prior art, relates to a system and method for generating a summary video using a representative image. Disclosed is a configuration for generating a summary video using all or part of it.

It is intended to provide a new viewing experience to viewers by utilizing the contents owned by content providers or broadcasters, and to provide a new viewing method that benefits both operators and viewers by expanding content exposure opportunities. The purpose of this study is to provide a method, a server, and a system for providing a collection view that can automatically extract metadata for each scene by analyzing the meaning of objects included in the content and convert it into a database to generate a collection view for each specific object. Moa view providing method, server, and a method that can provide streaming of newly organized Moa view content to viewers by creating a meta file by extracting and organizing the metadata of a specific object from the metadata DB, and processing the meta file in the media server. We want to provide a system.

As a technical means for achieving the above-described technical problem, an embodiment of the present invention is a metadata processing unit for dividing content into a plurality of scenes and processing metadata for objects in each scene in a collection view providing server. , A metadata base that stores the processed metadata, a metafile generator that selects and organizes metadata for a specific object among the metadata to generate a metafile, and controls a VOD server based on the metafile. It is possible to provide a gathered view providing server including a VOD server control unit.

In addition, another embodiment of the present invention, in the moai view providing system, including a client terminal, a moai view providing server and a VOD server, the moai view providing server processes metadata for objects in content, and the A meta file is created based on metadata, and the VOD server is controlled based on the meta file, and the VOD server delivers a collection stream to the client terminal through the control of the collection server, and the client The terminal may provide a system for providing a moai view, which outputs the moai view stream.

In addition, another embodiment of the present invention is a method for providing a summary view, the steps of dividing content into a plurality of scenes, processing metadata for objects in each scene, and converting the metadata into a metadata base. Storing in, selecting and organizing metadata for a specific object among the metadata, generating a metadata file, and controlling a VOD server based on the metadata. can do.

The above-described problem solving means are merely exemplary and should not be construed as limiting the present invention. In addition to the above-described exemplary embodiments, there may be additional embodiments described in the drawings and detailed description of the invention.

According to any one of the above-described problem solving means of the present invention, a collection view providing method capable of providing a new viewing experience to viewers by gathering and organizing scenes in which a specific object included in one content or a plurality of contents appears, Servers and systems can be provided. It is possible to provide a method, a server, and a system for providing a collection view that can automatically generate a collection view for each specific object by analyzing the meaning of objects included in the content, extracting metadata for each scene, and converting it into a DB. When collecting and viewing scenes for multiple contents, the existing VOD contents management and storage may not be affected by creating only metafiles that control to be continuously played, rather than creating new contents separate from the original contents. It is possible to provide a method, a server, and a system that can reduce the risk of intellectual property infringement that may be caused by processing original content. A collection that can be applied in various ways to the production of a video learning textbook or a video clip of a specific subject by providing a collection of objects including a specific person, a specific object, a specific sound, a specific subtitle, a specific place, and a specific natural shape. Provision methods, servers and systems can be provided.

1 is a block diagram of a system for providing a summary view according to an embodiment of the present invention.
2 is a block diagram of a server for providing a summary view according to an embodiment of the present invention.
3 is a configuration diagram of a metadata processing unit according to an embodiment of the present invention.
4 is a block diagram of an object analysis unit according to an embodiment of the present invention.
5 is a flowchart illustrating a process of providing a collection view according to an embodiment of the present invention.
6 is a flowchart illustrating a method for providing a summary view according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those of ordinary skill in the art can easily implement the present invention. However, the present invention may be implemented in various different forms and is not limited to the embodiments described herein. In the drawings, parts irrelevant to the description are omitted in order to clearly describe the present invention, and similar reference numerals are attached to similar parts throughout the specification.

Throughout the specification, when a part is said to be "connected" with another part, this includes not only "directly connected" but also "electrically connected" with another element interposed therebetween. . In addition, when a part "includes" a certain component, it means that other components may be further included, and one or more other features, not excluding other components, unless specifically stated to the contrary. It is to be understood that it does not preclude the presence or addition of any number, step, action, component, part, or combination thereof.

In the present specification, the term "unit" includes a unit realized by hardware, a unit realized by software, and a unit realized using both. Further, one unit may be realized by using two or more hardware, or two or more units may be realized by one piece of hardware.

In this specification, some of the operations or functions described as being performed by the terminal or device may be performed instead in a server connected to the terminal or device. Likewise, some of the operations or functions described as being performed by the server may also be performed by a terminal or device connected to the server.

Hereinafter, an embodiment of the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram of a system for providing a summary view according to an embodiment of the present invention. Referring to FIG. 1, a collection view providing system 1 may include a collection view providing server 100, a VOD server 200, and a client terminal 300. The moai view providing server 100, the VOD server 200, and the client terminal 300 shown in FIG. 1 exemplarily illustrate components that can be controlled by the moai view providing system 1.

Each component of the system 1 for providing a summary view of FIG. 1 is generally connected through a network. A network refers to a connection structure that enables information exchange between nodes such as terminals and servers, and examples of such networks are Wi-Fi, Bluetooth, Internet, and Local Area (LAN). Network), Wireless Local Area Network (LAN), Wide Area Network (WAN), Personal Area Network (PAN), 3G, 4G, LTE, etc., but are not limited thereto.

The aggregate view providing server 100 may divide the content into a plurality of scenes, detect and recognize an object in each divided scene, and generate metadata for the object. In this case, the metadata may include an object name of a corresponding object, a content ID of a content including the object, and temporal location information of a scene in which the object appears in the content.

The aggregate view providing server 100 may store processed metadata in a metadata base, and may generate a metadata file by selecting and organizing metadata for a specific object from among the stored metadata. In this case, the metafile may be created by continuously attaching metadata for a specific object, and a method of organizing the metadata may be various.

The collection view providing server 100 may provide a collection view for a specific object to the client terminal 300 in a streaming format by controlling the VOD server 200 based on the generated metafile. The gathered view providing server 100 will be described in detail with reference to FIG. 2.

The VOD server 200 may store and manage content obtained from a content provider, and deliver the content to viewers. The VOD server 200 may encrypt and store content obtained from a content provider.

The VOD server 200 may deliver the video collection stream to the client terminal 300 through the control of the video collection providing server 100. The VOD server 200 may provide a group view by continuously streaming video scene fragments expressed in a playlist of a metafile without interruption.

In order to continuously stream different scenes of different contents within an appropriate time, the VOD server 200 may store scenes to be streamed after the scene currently being streamed into a memory in advance.

The client terminal 300 may be a set-top box (STB) or a mobile terminal, but is not limited thereto. The client terminal 300 may receive a name of an object of interest from a viewer through a user interface, and may output a streamed collection of images received from the VOD server 200. In this case, the name of the object of interest may be input by providing a list of characters or a list of objects of interest through the UI in advance, and the viewer selects the object of interest. Alternatively, the viewer can directly enter the keyword. The input object name of interest is sent to the meta file management unit through the meta information input unit and can be used to search the meta file.

2 is a block diagram of a server for providing a summary view according to an embodiment of the present invention. Referring to FIG. 2, the group view providing server 100 includes a metadata processing unit 110, a metadata base 120, a group view organizer 130, a meta file management unit 140, and a meta file execution unit 150. And a meta information input unit 160.

The metadata processing unit 110 may classify a scene from content and automatically extract metadata through object analysis in the scene. The metadata may include an object name of an object, a content ID of a content including the object, and a temporal position of a scene in which the object appears in the content. In this case, the content ID may include the name of the content file and the storage location of the content file, and the temporal location of the scene may include the start time of the scene and the end time of the scene, but are not limited thereto. Hereinafter, the metadata processing unit 110 will be described in more detail with reference to FIGS. 3 and 4.

3 is a configuration diagram of the metadata processing unit 110 according to an embodiment of the present invention. Referring to FIG. 3, the metadata processing unit 110 includes a scene/shot analysis unit 112 that divides content into scene units, and an object analysis unit 114 that detects an object in the divided scene and recognizes the detected object. It may include.

The scene/shot analysis unit 112 may classify one content into a scene unit, and one scene may be composed of several shots. The object analysis unit 114 may include an object detector 116 and an object recognizer 118, and the object detector 114 may detect an object in units of every frame or at a predetermined frame interval, and the object recognizer 118 Can recognize the object name of the detected object. Hereinafter, the object analysis unit 114 will be described in more detail with reference to FIG. 4.

4 is a block diagram of an object analysis unit 114 according to an embodiment of the present invention. Referring to FIG. 4, the object analysis unit 114 includes a face detector 1161, an object detector 1162, a person detector 1163, a landmark detector 1164, an acoustic detector 1165, a caption detector 1166, and the like. It may include an object detector of, but is not limited thereto. In addition, the object analysis unit 114 includes an expression classifier 1180, a face recognizer 1181, an object recognizer 1182, a behavior recognizer 1183, a person recognizer 1184, a place recognizer 1185, and a sound recognizer 1186. , A speech recognizer 1187, an emotion classifier 1188, and an object recognizer such as a text recognizer 1189, but are not limited thereto.

The object analysis unit 114 according to an embodiment of the present invention may automatically analyze various objects through various object detectors and object recognizers. In this case, the object may include a specific person, a specific object, a specific sound, a specific subtitle, a specific place, and a specific natural phenomenon.

When only the scenes of a movie or drama filmed in a specific place are picked and collected, the historical and cultural understanding of the place can be enhanced, and it can help to remember the place for a long time along with the story in the content. In addition, if you collect only scenes in which specific object objects, such as dogs, cats, snakes, lions, etc., appear, or extract scenes that express specific natural phenomena, such as volcanic activity, the ecology and habits of objects, and the process of volcanic activity. It can be used as an excellent educational material for studying etc. In addition, it can also be used to create materials for marketing and product promotion by collecting scenes in which specific sounds, subtitles, costumes, and glasses appear.

Returning to FIG. 2 again, the metadata processing unit 110 may receive video signals and audio signals carried in the scene and pass them through various object detectors and recognizers. Can be extracted. A specific algorithm for detecting and recognizing an object may use known methods, and the method of detecting and recognizing an object is not limited to a specific method in the present invention.

As described above, the metadata processing unit 110 according to an embodiment of the present invention automatically extracts metadata, so that it is possible to extract metadata for an amount of work that could not be handled manually. For example, gathering by singers appearing in a specific music program, gathering by corners in a specific entertainment program, etc. are enough work to be performed manually, but a specific person appears for all music programs or all entertainment programs. When trying to gather a scene or stage/corner, the amount of work that cannot be handled by hand is expected. The metadata processing unit according to an embodiment of the present invention may process metadata even in the latter case.

The metadata base 120 may store metadata processed by the metadata processing unit 110.

The group view organizer 130 may search for metadata for a specific object among the metadata stored in the metadata processing unit 110 and generate a metafile by organizing the searched metadata.

The group view organizer 130 may generate a meta file in real time at the request of a viewer, or may generate a meta file in advance for an object that may be of interest to the viewer.

The group view organizer 130 may generate a meta file by concatenating the metadata retrieved from the metadata processing unit 110 in succession. In other words, the metafile may include metadata, that is, the content ID and time information of the original video, and is not created by processing the original content. Therefore, it is possible to avoid or reduce the risk of intellectual property infringement that may occur by processing the original content. The actual implementation of the metafile can be implemented in XML (Extensible MakeUp Language) language.

The group view organizer 130 may automatically organize the searched metadata, and there may be various methods for the knitting method. For example, in the case of setting the total viewable time by the user, a scene of interest may be preferentially organized by various priority methods to be described below, and when personal identification is possible, a customized program according to the user's tendency is also possible.

Hereinafter, various prioritization methods for organizing the collection will be described. However, the method of knitting the group is not interpreted as being limited to the methods described herein, and may be organized by various methods.

When organizing a collection of specific people within a single content, that is, when organizing a collection of specific people only for a specific episode of a movie or drama, organize the scenes in which a specific person appears in chronological order. , It is possible to arrange by listing the longest scene among scenes in which a specific person appears, or by prioritizing the sensibility growth side through the emotion information extracted from the facial expression or voice of a specific person.

In the case of organizing a collection for a specific person over multiple episodes of a series, that is, when organizing a collection for a series such as a soap opera in which a specific person appears over several episodes, the episodes are arranged in ascending order from the first episode. Thus, it is possible to organize, preferentially organize the scenes of the popular episode with the most viewing history. Popular content can be found by analyzing the viewing logs of all users. In the present invention, no specific analysis method is specified.

In the case of organizing a collection of a specific person across multiple contents, that is, when a collection of scenes from different contents in which a specific person has appeared, first organize the scenes of popular contents with the most viewing history. A method such as first organizing scenes in the latest content is possible.

When an individual is identified and a personalized collection is organized, that is, when a viewer requests a collection service within a personalized service, the collection can be organized based on the viewer's viewing tendency. For example, scenes of a specific person appearing in content of a genre that a viewer prefers may be prioritized. In this case, the viewing tendency of the user may be determined using log information of the user.

The gathering organizer 130 may organize a metafile by gathering only scenes in which actor Lee Byung-jun appears in episode 49 of the drama "Wangane Family". In addition, it is possible to create a metafile by collecting only scenes in which Lee Byung-jun appears in all episodes of the drama, and it is also possible to create a meta-file by collecting only scenes in which Lee Byung-jun appears in all dramas or movies in which actor Lee Byung-jun appeared.

The metafile management unit 140 maintains, manages, and updates the metafile generated by the group view organizer 130, and receives the object name of interest from the client terminal through the meta information input unit 160, You can perform a function to search for the object name.

As a result of searching for the name of the object of interest received from the client terminal, the metafile management unit 140 transmits the stored metafile to the metafile execution unit 150 when the metafile for the object is previously created and stored, If the metafile for the object does not exist, the group view organizer 130 may request the creation of the metafile.

The metafile execution unit 150 may transmit a control signal to the VOD server based on the metafile. The metafile execution unit 150 may control the VOD server while parsing the metafile so that the VOD server can stream the collection.

For example, the metafile execution unit 150 may analyze the XML syntax written in the metafile line by line, and inform the VOD server of which scene of which content is to be streamed at any moment. Since the metafile includes a list of playback information such as content ID and time information of the scene in which the object appears, by providing playback information to the VOD server, the VOD server can deliver the aggregated view output stream to the client terminal.

The metafile execution unit 150 may store scenes to be streamed after the currently streaming scene in the memory in advance so that the VOD server can continuously stream different scenes of different contents within an appropriate time.

The meta information input unit 160 may receive an object name of interest from a client terminal and transmit it to the meta file management unit 140. The transferred object name of interest may be used by the metafile management unit 140 to search for a metafile. Hereinafter, a method for providing a group view according to an embodiment of the present invention will be described in detail with reference to FIGS. 5 and 6.

5 is a flowchart illustrating a process of providing a collection view according to an embodiment of the present invention. Referring to FIG. 5, content is acquired and registered from a content provider 500 (S520), and the registered content is encrypted (S540) and stored in the VOD server 200. In this case, the content may be copied and delivered to the collection view providing server 100. The metadata processing unit 110 of the aggregate view providing server 100 analyzes the object in the content based on the video signal and the audio signal of the transmitted content, processes the metadata, and stores the processed metadata in the metadata base. I can.

The group view organizer 130 may create and store a meta file by searching and organizing the meta data stored in the meta database. When the meta information input unit 160 of the aggregate view providing server receives the object name of interest from the client terminal 300, it can inquire whether the meta file for the object is stored in the meta file management unit 140, and the object If the metafile for is not saved, a metafile can be newly created and executed. If the metafile for the object is saved, the saved metafile can be executed.

The metafile execution unit 150 may control the VOD server based on the created or stored metafile so that the VOD server 200 transmits the collection stream to the client terminal 300, and the client terminal 300 delivers You can print the collected collection. Hereinafter, a flow of a method for providing a collection view according to an embodiment of the present invention will be described with reference to FIG. 6.

6 is a flowchart illustrating a method for providing a summary view according to an embodiment of the present invention. Referring to FIG. 6, the server for providing a collection of contents according to an embodiment of the present invention obtains content from a content provider (S600) and copies the obtained content (S602). The aggregate view providing server performs object analysis on the copied content (S604), automatically extracts metadata from the content, and stores the extracted metadata in the metadata metadata base (S606). The gathered view providing server organizes the gathered view using metadata (S608), that is, creates a metafile, and manages the generated metafile (S610). Thereafter, when an object name is input from the client terminal (S611), it is inquired whether a metafile for the input object name has been previously created (S612). In the search result (S614), if the corresponding metafile does not exist, the process returns to the group view organization step (S608). If the corresponding metafile exists, the stored metafile is executed (S616). The collection view providing server controls the VOD server based on the metafile (S618), and accordingly, the VOD server transmits the collection view stream to the client terminal (S620).

In the present invention, it has been proposed that a server of a broadcasting service provider proactively provides a collection service, but this collection operation may be provided by a client. It can be extended so that the client accesses the location (URL) of the corresponding scene of the corresponding content while performing XML analysis by receiving the metafile from the server to provide the aggregate view service for the corresponding object.

The above-described method for providing a summary view may be implemented in the form of a computer program stored in a medium, or may be implemented in the form of a recording medium including instructions executable by a computer such as a program module executed by a computer. Computer-readable media can be any available media that can be accessed by a computer, and includes both volatile and nonvolatile media, removable and non-removable media. Further, the computer-readable medium may include both computer storage media and communication media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Communication media typically includes computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave, or other transmission mechanism, and includes any information delivery media.

The above description of the present invention is for illustrative purposes only, and those of ordinary skill in the art to which the present invention pertains will be able to understand that other specific forms can be easily modified without changing the technical spirit or essential features of the present invention will be. Therefore, it should be understood that the embodiments described above are illustrative and non-limiting in all respects. For example, each component described as a single type may be implemented in a distributed manner, and similarly, components described as being distributed may also be implemented in a combined form.

The scope of the present invention is indicated by the claims to be described later rather than the detailed description, and all changes or modified forms derived from the meaning and scope of the claims and their equivalent concepts should be construed as being included in the scope of the present invention. do.

100: server providing collection view
200: VOD server
300: client terminal

Claims (21)

In the collect view providing server,
A metadata processing unit for dividing content into a plurality of scenes and processing metadata for objects in each scene;
A metadata base for storing the processed metadata;
A group view organizer that selects and organizes meta data for a specific object among the meta data to generate a meta file; And
Metafile execution unit controlling a VOD server based on the metafile
Including,
The metafile is created by concatenating the metadata for a specific object,
The group view organizer creates the meta file by first organizing specific metadata based on a preset priority,
The metadata processing unit,
And an object analysis unit that automatically detects an object in the scene by inputting each of the divided plurality of scenes to various object detectors and object recognizers, and recognizes the detected object.
The method of claim 1,
The metadata processing unit,
Scene/shot analysis unit that divides the content into scene units
A server that provides a gather view further comprising a.
The method of claim 1,
The object includes one or more of a specific person, a specific object, a specific sound, a specific subtitle, a specific place, and a specific natural phenomenon.
The method of claim 1,
The metadata includes an object name of the object, a content ID of a content including the object, and temporal location information of a scene in which the object appears.
The method of claim 1,
The metadata processing unit automatically extracts the metadata of the object based on the video signal and the audio signal of the scene.
The method of claim 1,
A metafile management unit that performs one or more of storage, management, update, and inquiry of the metafile; And
Meta information input unit that receives the object name of interest from the client device
A server that provides a gather view further comprising a.
The method of claim 6,
The meta information input unit transfers the name of the object of interest received from the client device to the meta file management unit,
The meta-file management unit inquires a meta-file corresponding to the received object name of interest, and, if a corresponding meta-file does not exist, requests the creation of a meta-file to the group view organizer.
The method of claim 1,
The gathered view organizer organizes the metadata for the specific object based on one or more of a temporal sequence of the scene or an order with a large viewing history.
The method of claim 1,
The gathered view organizer grasps the propensity of the client based on log information of the client, and generates a customized metafile based on the propensity.
In the collection view providing system,
Client terminal;
A collection server; And
VOD server
Including,
The aggregate view providing server processes metadata for objects in content, generates a metafile based on the metadata, and controls the VOD server based on the metafile,
The VOD server transmits a collection stream to the client terminal through the control of the collection view providing server, and
The client terminal outputs the collection stream,
The metafile is created by concatenating the metadata for a specific object,
The aggregate view providing server creates the meta file by first organizing specific metadata based on a preset priority,
The collected view providing server,
By inputting each of a plurality of divided scenes to various object detectors and object recognizers to automatically detect an object in the scene, and to recognize the detected object, a summary view providing system.
The method of claim 10,
The metadata includes the object name of the object, the content ID of the content including the object, and temporal location information of the scene in which the object appears.
The method of claim 10,
The client terminal transmits a name of an object of interest to the server for providing a collection of views, and the server for providing a view of a collection inquires or generates a meta file corresponding to the name of the object of interest.
The method of claim 10,
The gathered view providing server organizes the metadata for the object based on one or more of a temporal sequence of a scene or an order with a large viewing history.
The method of claim 10,
The gathered view providing server grasps the propensity of the client based on the log information of the client, and generates a customized metafile based on the propensity.
In the method of providing a collection view,
Dividing the content into a plurality of scenes and processing metadata for objects in each scene;
Storing the metadata in a metadata base;
Selecting and organizing metadata for a specific object from among the metadata to create a metadata file;
Controlling a VOD server based on the metafile
Including,
The metafile is created by concatenating the metadata for a specific object,
The generating of the meta-file includes first organizing specific metadata based on a preset priority to generate the meta-file,
The step of processing the metadata,
And automatically detecting an object in the scene by inputting each of the divided plurality of scenes to various object detectors and object recognizers, and recognizing the detected object.
The method of claim 15,
Receiving an object of interest name from a client terminal;
Retrieving a metafile corresponding to the received object name of interest in the metadata base; And
Creating a new metafile when there is no metafile corresponding to the name of the object of interest
A method of providing a collection view that further includes.
The method of claim 15,
The object includes one or more of a specific person, a specific object, a specific sound, a specific subtitle, a specific place, and a specific natural phenomenon.
The method of claim 15,
The metadata includes an object name of the object, a content ID of a content including the object, and temporal location information of a scene in which the object appears.
The method of claim 15,
The metadata is automatically extracted based on the video signal and the audio signal of the scene.
The method of claim 15,
The generating of the meta-file comprises generating a meta-file by organizing metadata for the specific object based on one or more of a temporal sequence of a scene or an order with a large viewing history.
The method of claim 15,
The generating of the meta-file comprises determining a tendency of the client based on log information of the client, and generating a customized meta file based on the disposition.

Images