KR20130085665A - System and method for providing meta information cobined with content in smart tv environment - Google Patents

Abstract

PURPOSE: A system and a method for providing meta information combined with a content in a smart TV environment are provided to enable anyone to generate and manage meta information of a product showed in a video content without limitation on space and time, and provide interaction with users who watches the video content upon meta information added to the content in a more convenient environment. CONSTITUTION: An interworking unit sends a request for an N-screen service which enables a video content playing on a TV to concurrently play on a user terminal, a mobile device of a user. A retrieve unit retrieves metadata related to the video content from a management server in which metadata stores. A display unit augments and displays the video content with the metadata while playing the video content through the user terminal. A meta information is generated when a seller make an annotation to an interesting object included in the video content. [Reference numerals] (AA,NN) User; (BB) Individual site connection; (CC,QQ) Statistics; (DD,RR) Native place culture; (EE,SS) History and art; (FF,TT) Tourism; (GG) Aim a global file system (for document); (HH) Untyped document link; (II) Additional DB connection by website; (JJ) Data Silo isolation intensification; (MM) System; (OO) Obtain signle connection related information; (PP,KK) Ontology; (UU) Global database (link between objects); (VV) Share data by website; (WW) Convenient use; (XX) Structurization/semantic disambiguation

Description

SYSTEM AND METHOD FOR PROVIDING META INFORMATION COBINED WITH CONTENT IN SMART TV ENVIRONMENT}

Embodiments of the present invention relate to a video content and virtual object interworking system and method for synthesizing and providing product meta information capable of interacting with a user in TV content in a smart TV environment.

Just as the market for smart devices such as smart TVs, smart pads (tablets), and smart phones is growing, the information retrieval market and consumption market using them are also growing.

In the midst of the flood of information, users are no longer searching for more easy, faster and more accurate information retrieval than more information retrieval. Especially, as smart devices capable of internet communication are spreading widely, they want to know what they want to know on the fly. The culture of searching right away is being created.

Korean Patent Registration No. 10-0928717 (Registration date November 19, 2009) divides the screen displayed on the TV into an AV content area separate from the linked content area, and displays the AV content of the broadcast program in the AV content area. Disclosed is a technology for displaying various advertisement contents linked with contents on an associated content area.

In the past, indirect advertising using advertising content has been a method in which the seller registers and manages meta information about a product through a separate medium or platform, and thus, there is a problem that product meta information may not be freely registered or maintained due to space and time constraints. .

In addition, in the related art, a means for purchasing a product related to an advertisement content in a TV environment is provided, but in a TV environment, when a user searches for or purchases a product while watching an AV content, another user watching the AV content together It can be a distraction to the user. In addition, in the TV environment, there is still a lack of operational flexibility for checking information or searching the Internet, so that the user may interact with the user such as checking or searching for detailed information related to a product or moving to a shopping mall to purchase the corresponding product. There are limitations and inconveniences in having.

Accordingly, the present specification proposes a system and method for generating and managing meta information of a product appearing in video content anytime and anywhere in a smart TV environment without time and space constraints. In addition, the present specification proposes a system and method for effectively providing a user who is watching video content through a TV to interact with meta information added to the content.

Provides a system and method for anyone to create and manage meta information of products appearing in video contents anytime, anywhere without limitations in time and space in smart TV environment.

The present invention provides a system and a method for providing a user who is watching a video content with interaction with meta information added to the content in a more convenient environment.

An interlocking unit for requesting an N Screen (Network Screen) service so that video content being played on a TV is simultaneously played on a user terminal which is a user's mobile device according to a user's request; A searcher for accessing a management server storing meta information related to video content and searching for meta information; And a display unit for augmenting and displaying meta information on video content being played through the user terminal. In this case, the meta information may be generated by annotating the object of interest included in the video content by the seller.

According to an aspect, the meta information includes at least one of a product category, a product price, a product description, shipping information, and a URL address associated with an object of interest, and the video content is provided by the seller through N screen service according to the seller's request. It may be generated through the annotation function provided on the seller terminal in the environment played in the seller terminal.

According to another aspect, the meta information may be targeting information set by the seller, wherein the searcher extracts the user's profile information from information on the Internet related to the user, and searches for meta information whose profile information matches the targeting information. You can search.

According to another aspect, the display method of the meta information may be set by the seller, and the display unit may display the meta information according to the display method when an interaction for viewing the meta information is input from the user.

According to another aspect, when the object of interest appears in the video view in which the video content is displayed, the display unit may combine and display the metadata view in which the meta information is displayed and the video view.

According to another aspect, the display unit may display the meta information along the moving path indicating the position of the object of interest in the video content, and may display the region and the position information of the object of interest corresponding to the meta information.

According to another aspect, the movement path may be stored in association with meta information, or the display may track the location of the object of interest using at least one of an image tracking technique and an image interpolation technique.

In the video content and virtual object interworking system for synthesizing the video content and the virtual object, the method of synthesizing the meta information about the virtual object is simultaneously performed on the user terminal, which is the video content being played on the TV, at the user's request. Requesting an N Screen service; Retrieving meta information by accessing a management server storing meta data related to video content; And augmenting and displaying meta information on the video content being played through the user terminal. In this case, the meta information may be generated by annotating the object of interest included in the video content by the seller.

By running the N-screen service on the video content that is being watched on the smart TV on the mobile device and generating product meta information on the video content, anyone can easily register and manage the meta information anytime and anywhere without time and space constraints.

In addition, when the N screen service is executed through the mobile device with respect to the video content viewed through the smart TV, product meta information related to the video content may be synthesized and displayed through the user view of the mobile device. Therefore, the user's accessibility and convenience can be improved because the user's interaction with the user on the product meta information is provided in the mobile device which is more flexible in operation.

1 illustrates a conceptual diagram of a system for linking video content and a virtual object in a smart TV environment according to an embodiment of the present invention.
2 and 3 are diagrams illustrating LOD concepts for generating meta information about a virtual object according to an embodiment of the present invention.
4 is a block diagram illustrating a configuration of generating meta information in a video content and virtual object interworking system according to an embodiment of the present invention.
5 is a diagram illustrating a scenario for generating meta information according to an embodiment of the present invention.
6 is a flowchart illustrating a method of generating meta information in a video content and virtual object interworking system according to an embodiment of the present invention.
7 and 8 are exemplary screens for explaining an annotation function for meta information according to an embodiment of the present invention.
9 is an exemplary screen for explaining an environment setting function for meta information according to an embodiment of the present invention.
FIG. 10 is a block diagram illustrating a configuration of synthesizing meta information to video content in a video content and virtual object interworking system according to an embodiment of the present invention.
11 illustrates a scenario for synthesizing video content and meta information according to an embodiment of the present invention.
12 is a flowchart illustrating a method of synthesizing meta information into video content in a video content and virtual object interworking system according to an embodiment of the present invention.
FIG. 13 is an exemplary screen illustrating a method of synthesizing video content and meta information according to an embodiment of the present invention.
14 is an exemplary screen for describing a screen display method for meta information according to an embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

Embodiments of the present invention relate to a video content and virtual object interworking system and a method thereof, wherein a buyer receives video content (eg, VOD) received from a content server (general broadcasting station, IPTV broadcasting station, cable TV, YouTube, etc.). When the user wants to view meta information (virtual objects) related to the corresponding content while watching on a smart TV, the meta information (virtual object) added by the seller of the product to the contents is effectively provided to the user.

1 illustrates a conceptual diagram of a system for linking video content and a virtual object in a smart TV environment according to an embodiment of the present invention.

For example, if a user is watching a video content in which a man is riding a skateboard through the smart TV 101, and wants to view product information of a helmet worn by a man, his smart pad 102 may be used. The N screen service is executed by using (Here, 'N screen service' means a service capable of viewing the same video content on a smart TV and a smart pad.). Accordingly, the 'video content and virtual object interworking system' is a meta-information added by the merchandise sellers associated with the video content when the user takes a predetermined interaction action (eg, lifting the smart pad) in the smart pad. The video content may be overlapped (enhanced) and provided to the user's smart pad 102. Furthermore, the 'video content and virtual object interworking system' analyzes the profile information of the user and the profile information of friends set up with the user, and then, among the information added by various product sellers for the video content, the meta information suitable for the user. Can be selected and provided to the smart pad 102 of the user.

The meta information displayed on the smart pad 102 can interact with the user such as selection (click), information retrieval, and moving to a shopping mall to purchase a product, so that the user selects the information displayed on his smart pad 102. As a result, the semantic web (internet) may be connected to view the information of the corresponding product in detail.

To use 'Video Content and Virtual Object Interworking System', the following process is essential.

1. The seller needs to select a specific area of the video and add the product information as metadata in order to connect the product with the video for sale or information provision. Vendor-added meta-information must exist separately from the video and provide functionality to add, delete, modify, share, and reuse the information.

2. When the user wants to receive the information (the time of using the N-screen service on the smart pad and lifting the smart pad), a process of combining video and meta information, that is, augmenting and displaying meta information on the video is required. .

In addition, an example in which the 'video content and virtual object interworking system' is applicable is as follows.

1. If the meta information related to the current video content is displayed on the smart pad and the shopping mall is connected to the displayed meta information, the user can move to the shopping mall where the user can purchase the product by selecting the meta information.

2. If the information of the products added by the sellers must use local information (chain stores in each region-eg Pizza Hut, etc.), when the user selects the corresponding meta information, It can be ordered by connecting with local chain stores.

3. If the amount of metadata added by the seller is large, provide a personalized service. By comparing the range of customers targeted by the seller to the personal information of the user who wants to view current product information, the seller may provide personalized information corresponding to common factors between the seller and the user. For example, if the user's interest is a sport such as a skateboard, it provides information such as shoes and a helmet. If the user is interested in clothes such as clothes, the user provides customized information about T-shirts and pants.

The video content and virtual object interworking system and method thereof according to the present invention may be classified into a configuration for generating meta information related to video content and a configuration for synthesizing and displaying meta information on the video content.

In the present embodiment, a video content and virtual object interworking system and method for generating meta information may be implemented in a mobile device of a seller (hereinafter, referred to as a 'seller terminal'). The video content and virtual object interworking system and method for synthesizing the video content and the meta information may be implemented in a user's mobile device (hereinafter, referred to as a user terminal). Here, the seller terminal and the user terminal may be a device having a CPU, and examples thereof may include, but are not limited to, a mobile dedicated smart device such as a tablet, a smart phone, and a smart pad. The embodiments may be implemented as an application dedicated to a mobile terminal such as a tablet, a smart phone, a smart pad, and the like.

1st Example

A video content and virtual object interworking system for generating meta information and a method of generating meta information using the same will be described.

First, the video content and virtual object interworking system according to the present embodiment may generate meta information related to video content in an LOD (Linking Open Data) based environment.

LOD is a concrete way to implement the Data Web, which is represented by the Semantic Web, and each site on the Internet uses RDF (Resource Description Framework) format data and uses the Representational State Transfer (REST) protocol on the Internet. Say what you offer.

The main functions of LOD are as follows.

(1) Data can be published and shared on the web.

(2) Data can be accessed and used through URI, and can be expressed on the web using HTTP protocol.

(3) URIs can be linked to each other to data mashup / reuse.

Accordingly, the importance of LOD is summarized as follows.

(1) reusable data

-URI link for each data entity allows continuous reuse from outside. (See Fig. 2)

(2) Reduced data redundancy and maintenance costs

-Reduces overall management cost by preventing unnecessary data duplication.

-Manages specialty data and maintains by connecting external data except core data.

(3) Data standardization possible

-Because it uses semantic web standard RDF format, it can be used in present and future semantic web application services.

-Define a semantic web standard for the concept, using its own URI and ontology.

(4) Maximize data interoperability and integrate data

-It can be used in parallel between the system and the data, not the system's subordination through the accessibility through the web of the Internet.

-Available in WOA (Web Oriented Architecture) format, it is possible to implement various data utilization services on semantic web.

(5) Value-added creation by network effect

-New data can be created by sharing data with each other.

-It can be applied effectively such as semantic search. (See Fig. 3)

4 is a block diagram illustrating a configuration of generating meta information in a video content and virtual object interworking system according to an embodiment of the present invention. Video content and virtual object interworking systems enable multiple sellers to collaborate on advertising their products. That is, when viewing the video content and generating information about the object of interest included in the video content, anyone can annotate at a desired time point. Annotation methods for the object of interest included in the video content may vary. In the annotation method provided in the present embodiment, meta information may be added by touching a location to be annotated using a touch screen.

As shown in FIG. 4, the video content and virtual object interworking system according to the first embodiment may include a linker 410, an annotation unit 420, and a setting unit 430.

The interlocking unit 410 may request the N screen service so that video content being played on the smart TV is simultaneously played on the seller terminal at the seller's request. At this time, the same video content is played on the smart TV and the seller terminal.

The annotation unit 420 may provide an annotation function for the video content when the seller selects an object of interest included in the video content being played on the seller terminal (that is, when selecting a specific product appearing in the video content). Accordingly, when the seller inputs meta information about the object of interest, the meta information input by the seller may be annotated to the object.

The annotation unit 420 may include an annotation tool for receiving meta information including at least one of a product category, a product price, a product description, shipping information, and a URL address related to the object of interest when the seller selects a specific object of interest from the video content. You can run In this case, the annotation tool may include an input tool for selecting and inputting data corresponding to meta information from information on the semantic web through a linking open data (LOD) structure, and an input tool for directly entering information by a seller. have.

The annotation unit 420 may store and maintain meta information input by a seller through an annotation tool in a management server 440 separate from a content server that stores and maintains video content. At this time, the management server 440 may provide a semantic web environment based on LOD so that the seller may delete, modify, add, reuse, and share the meta information. Then, the annotation unit 420 tracks the position of the object of interest annotated by the seller using at least one of an image tracking technique or an image interpolation technique in the video content, and then the seller inputs a moving path indicating the position of the object of interest. It can be stored in association with meta information. Here, the image tracking technique or the image interpolation technique is the same as the conventional technique. When the object included in the video content is selected by the seller, the image tracking technique is automatically displayed on the screen from the next frame using the image signal of the selected object. You can track the location of an object. Meanwhile, in the case of image interpolation technology, when an object included in the video content is selected by the seller, the moving path of the object can be tracked by repeatedly storing the process of selecting the object at regular intervals while the content is being played. have. That is, the meta information may include area and location information about the object of interest. In the case of the object of interest, when an object that the seller wants to annotate appears while viewing the content, the user directly designates an object area (eg, a rectangle, a circle, a polygon, etc.) using a finger, or a predetermined area based on a point touched by the seller. Can be automatically assigned as an object area. When the tracking of the object selected by the seller is completed by using image tracking or image interpolation, the position information (x-axis, Y-axis) of the entire path of the object is displayed from the first frame of the content to the last frame of the tracking. It can be annotated.

The setting unit 430 may provide a configuration function for the meta information through the seller terminal when the input for the meta information is completed, and thus targeting the seller to provide the meta information using the configuration function. Information (eg, gender, age group, occupation, region, etc.), and a display method for displaying meta information on the screen of the user terminal may be directly set. At this time, the targeting information and the display method of the meta information are also stored in the management server 440 to be deleted, modified, added, reused, and shared by the seller.

Referring to FIG. 5, a scenario of generating meta information by a seller is as follows.

① The seller selects and views the video content existing in the content server 503 on the smart TV 501.

(2) The seller wants to generate additional information (metadata) about the product when the product of interest (the product he wants to sell) appears while watching the video content.

The seller executes an application related to the "video content and virtual object interworking system" in the seller terminal 502, which is his mobile device.

④ 'Video content and virtual object interworking system' uses N screen service from content server 503. At this time, the same video content is played on the smart TV 501 and the seller terminal 502.

⑤ The seller selects (eg, touches or clicks) the corresponding product appearing in the video content on the screen executed in the seller terminal 502. At this time, the video content played back on the seller terminal 502 is paused, and the annotation tool is executed on the screen.

⑥ The seller selects which category the product belongs to through the annotation tool in the structure of ontology (LOD), and then displays the information (product price, product description, shipping information, product image, URL address, etc.) to the user. Enter.

⑦ In addition, when the above-described input of the meta information is completed, an input tool related to an environment setting function is executed on the screen of the seller terminal 502. Therefore, the seller can directly input the user's disposition (personal profile) (eg, age 20s, gender, male, occupation, and location in Seoul) as the targeting information of the meta information. Can be.

⑧ When the seller completes input of the targeting information, it specifies how to display the meta information on the user's screen. One of the display methods shown in FIG. 14 to be described below is selected.

⑨ When all data on the meta information is input by the seller, the meta information, targeting information, and display method are annotated to the corresponding object and stored in the management server 440.

6 is a flowchart illustrating a method of generating meta information in a video content and virtual object interworking system according to an embodiment of the present invention. In the method for generating meta information according to the present embodiment, respective steps may be performed by the video content and virtual object interworking system according to the first embodiment described with reference to FIG. 4.

The video content and virtual object interworking system may request the N screen service so that video content being played on the smart TV is simultaneously played on the seller terminal according to the seller's request. At this time, the same video content is played on the smart TV and the seller terminal.

In operation 610, when the video content and the virtual object interworking system select a specific object of interest from the video content being played on the seller terminal by the seller, an annotation tool capable of inputting meta information about the object on the screen of the seller terminal is provided. Run Referring to FIG. 7, the annotation tool 710 may include a category selection window 711 for inputting a product category in a semantic web environment based on an LOD, a product name input window 712 for inputting a product name, and a product price. Price input window 713 for input, a URL input window 714 for inputting a URL address of a shopping mall where a product can be purchased, a detailed information input window 715 for inputting a product description or shipping information, and a product image input Thumbnail input window 716, and various menus (save, initialize, cancel, etc.). That is, when a seller clicks on a desired product while viewing content through the seller terminal, a screen for inputting information (product name, price, shopping mall address, detailed description, image of the product, etc.) of the corresponding product is displayed. .

In operation 620, the video content and virtual object interworking system may select a class (category) to which the corresponding product belongs from a predefined LOD in order for the seller to input information of the corresponding product. In this case, the seller may select a product class and then select a lower class to give the information of the corresponding product more clearly. As such, the video content and virtual object interworking system can implement a structure that can be inferred when searching for meta information by providing an environment in which the correct class (category) of the corresponding product is selected. In addition, the video content and virtual object interworking system directly receives the corresponding information from the seller through the input windows 712 to 716 except for the category selection window 711 or when the seller specifies the lowest class, the video content and virtual object interworking system belong to the corresponding subclass. Specific information may be selected and input from among information on products.

In operation 630, the video content and virtual object interworking system may provide an environment in which addition and correction may be made to meta information input by the seller. 8 is an example screen on which information of a product selected by a seller is displayed on a screen. In this case, the seller can modify the information of the corresponding product, and if the 'save' button is input, the information of the corresponding product is updated in the LOD.

In operation 640, the video content and virtual object interworking system sets the targeting information and the display method of the product information according to the seller's selection before storing the product information (ie, meta information) input by the seller. As illustrated in FIG. 9, the video content and virtual object interworking system may display an environment setting screen 910 for setting targeting information and a display method on a screen of a seller terminal when input of product information is completed by a seller. Can be. Thus, the seller can set the range of customers to display the product information and how to display on the user's screen. Here, the range of the customer means information such as age group, gender, region, interests, occupation, country, etc. The display method may be selected by specifying one of the display methods shown in FIG. 14.

In operation 650, the video content and virtual object interworking system may store, maintain and manage the meta information, the targeting information, and the display method in the management server when all data on the meta information is completed by the seller.

As described above, according to an embodiment of the present invention, by executing the N-screen service for the video content that is watched on the smart TV on the mobile device, the product meta information related to the video content is generated, so that anyone can easily meta anywhere anytime without time and space constraints. Information can be registered and managed.

Second Example

A video content and virtual object interworking system for synthesizing video content and meta information and a method of synthesizing meta information using the same will be described.

FIG. 10 is a block diagram illustrating a configuration of synthesizing meta information to video content in a video content and virtual object interworking system according to an embodiment of the present invention.

As shown in FIG. 10, the video content and virtual object interworking system according to the second embodiment may include a linkage unit 1010, a search unit 1020, and a display unit 1030.

The interlocking unit 1010 may request an N screen service such that video content being played on the smart TV is simultaneously played on the user terminal according to a user's request. At this time, the same video content is played on the smart TV and the user terminal.

The search unit 1020 accesses the management server 1040 and searches for meta information related to the video content. In this case, the searcher 1020 may extract profile information of the user from information on the Internet related to the user, and then search for meta information in which the targeting information matches the profile information of the user among meta information related to the video content. . Information on the Internet that is relevant to you may include your personal information (e.g., hobbies, occupation, age, gender, etc.) that you create when you register on the Internet, your search history on search engines, the nature of your "favorite" site, This may include a nature of a web site (eg, a blog, a cafe, etc.) established with a user, interest information of a web site operator established with a user, interest information of another user preset by the user, and the like.

The display unit 1030 may amplify and display meta information on the video content being played through the user terminal. In this case, when an interaction for viewing meta information is input from the user, the display unit 1030 may display the meta information according to the display method set by the seller. In particular, the display unit 1030 generates a user view by synthesizing the metadata view and the video view when an object of interest annotated with meta information appears in the video view displaying the video content, and then displays the generated user view on the screen. I can display it. The display unit 1030 may display corresponding meta information according to a moving path indicating a location of the object of interest in which the meta information is annotated in the video content. In this case, the moving path of the object of interest may be annotated in association with the corresponding meta information, or the display unit 1030 may directly track the location of the object of interest using at least one of an image tracking technique and an image interpolation technique. That is, the display unit 1030 may display the area and / or the location of the object on the screen according to the movement path of the object of interest present in the meta information while the video content is being played.

Referring to FIG. 11, a scenario of synthesizing video content and a virtual object according to a user's request is as follows.

① The user selects and watches video content existing in the content server 1103 on the smart TV 1101.

② While the user is watching video content, a product of interest appears and wants to see additional information (metadata) about the product.

③ The user executes an application related to the "video content and virtual object interworking system" in the user terminal 1102 which is his mobile device.

④ 'Video content and virtual object interworking system' uses N screen service from content server 1103. At this time, the same content is played on the smart TV 1101 and the user terminal 1102.

⑤ The 'video content and virtual object interworking system' accesses the management server 1040 and searches for meta information related to the video content currently being viewed by the user.

⑥ At this time, the 'video content and virtual object interworking system' determines the propensity of the user by analyzing the user's profile existing in the information 1104 on the Internet, for example, social networks (Facebook, Twitter, etc.) to provide customized information. do.

⑦ The user takes a predetermined interaction operation (eg, lifting a smart pad) in the user terminal 1102 to view information of goods appearing in the video content being played through the user terminal 1102.

⑧ 'Video content and virtual object interworking system' displays and displays the customized information provided from the management server 1040 with the video content being played on the user terminal 1102. In this case, the 'video content and virtual object interworking system' may synthesize and display video content and meta information according to a display method set by a seller.

⑨ If the user selects the product information displayed on his user terminal 1102, he / she moves to the shopping mall 1105 connected with the product information, and can purchase the corresponding product at the shopping mall 1105.

12 is a flowchart illustrating a method of synthesizing meta information into video content in a video content and virtual object interworking system according to an embodiment of the present invention. In the meta information synthesizing method according to the present embodiment, respective steps may be performed by the video content and virtual object interworking system according to the second embodiment described with reference to FIG. 10.

In step 1210, the user selects and views the video content existing in the content server through the smart TV.

In operation 1220, the video content and virtual object interworking system requests an N-screen service so that video content being played on the smart TV is simultaneously played on the user terminal, which is the user's mobile device, according to the user's request. At this time, the video content being played on the smart TV is simultaneously played on the user terminal.

In step 1230, the video content and virtual object interworking system recognizes the user's request through the user terminal, that is, an interaction (eg, lifting the user terminal) to view meta information related to the video content being played.

In operation 1240, the video content and virtual object interworking system may display the meta information on the video content by combining the video view and the metadata view in the user view through the user terminal. The display device that a user sees in a user terminal such as a smart pad is a user view. As shown in FIG. 13, the information of the video view 1310 and the metadata view 1320 is synthesized (overlayed) to generate a user view 1330, and the user view 1330 is shown to the user. . That is, video view 1310 is the same as normal video play. Video content selected by the user from the content server is played in the video view 1310. Subsequently, at the request of the user (operating to lift the user terminal), the information of the metadata in the management server is displayed in the metadata view 1320, and the user is in a state in which the two views are combined (user view 1330). ).

In operation 1250, the video content and virtual object interworking system provides a service linked to the corresponding object such as moving to a shopping mall when a user selects a specific object after checking meta information displayed on the video content. In this case, an event such that the user selects by hand and moves to a shopping mall of the corresponding product selects objects of the metadata view 1320.

14 is an exemplary screen for describing a screen display method for meta information according to an embodiment of the present invention. All information about the merchandise object is already annotated by the seller, and the display method is also set in advance by the seller. Furthermore, the meta information displayed on the user terminal may be modified according to the user's selection signal.

As a method of augmenting and displaying meta information in video content,

1. a method of outputting only the product list on one side of the screen (Fig. 14a), 2. a method of simply outputting the product list and respective product information (Fig. 14b), 3. a screen for the product list and the product information for each product A method of outputting with the position on the screen (FIG. 14C), 4. a method of directly outputting the product list to each position on the screen (FIG. 14D), 5. a method of directly outputting the product list and simple information to each position on the screen (FIG. 14e), 6. How to output the product list and simple information directly to the position on the screen only the product selected by the user (Fig. 14f), 7. Only the product list, if you select the product displayed on one side of the screen, only the selected product There is a method of directly outputting the product list and simple information at the position on the screen (Fig. 14g), 8. The method of outputting the product list in a separate area by dividing the screen so that the video content is not hidden (Fig. 14h), but It is not limited.

In the above method of displaying meta information in the video content and virtual object interworking system, when the video is played along with the product information on the smart device, a toggle function (view information / hide information) is displayed on the screen for the product information by the user's request. You can control the display. That is, when the user takes an operation of lifting the user terminal while watching the video content through the user terminal in the N service environment, product information annotated by the seller is displayed on the content being played, and again lifting the user terminal. If you take the product information can be automatically hidden to hide. Using the toggle function can avoid the indirect advertising and can be used in a way that does not give the user a feeling of rejection.

As described above, according to an embodiment of the present invention, when the N-screen service is executed through the mobile device with respect to the video content viewed through the smart TV, product meta information related to the video content is synthesized through the user view of the mobile device. I can display it. Therefore, the user's accessibility and convenience can be improved because the user's interaction with the user on the product meta information is provided in the mobile device which is more flexible in operation.

The meta-information generating method and the meta-information synthesizing method according to an embodiment of the present invention may be implemented in the form of program instructions that can be executed by various computer means and recorded in a computer readable medium. In particular, the embodiments may be configured as a mobile terminal dedicated application (for example, in the form of a smartphone application, a feature phone virtual machine (VM), etc.). It may be configured to be executed by at least one processor running in the smart device.

The computer readable medium may include program instructions, data files, data structures, etc. alone or in combination. The program instructions recorded on the medium may be those specially designed and constructed for the present invention or may be available to those skilled in the art of computer software. In addition, the above-described file system can be recorded in a computer-readable recording medium.

As described above, the present invention has been described by way of limited embodiments and drawings, but the present invention is not limited to the above embodiments, and those skilled in the art to which the present invention pertains various modifications and variations from such descriptions. This is possible.

Therefore, the scope of the present invention should not be limited to the described embodiments, but should be determined by the equivalents of the claims, as well as the claims.

400, 1000: video content and virtual object interworking system
410: linkage
420: annotation section
430: Setting unit
1010: linkage
1020: search
1030: display unit

Claims (8)

An interlocking unit requesting an N Screen (Network Screen) service so that video content being played on a TV is simultaneously played on a user terminal which is the mobile device of the user according to a user's request;
A search unit for accessing a management server storing meta information related to the video content and searching for the meta information; And
A display unit for augmenting and displaying the meta information on the video content being played through the user terminal
Lt; / RTI >
The meta information is,
Generated by annotating the object of interest included in the video content by the seller
Video content and virtual object interworking system, characterized in that. The method of claim 1,
The meta information is,
At least one of a product category, a product price, a product description, shipping information, and a URL address related to the object of interest is included.
The video content is generated through an annotation function provided on the seller terminal in an environment that is played on the seller terminal which is the mobile device of the seller through the N screen service at the seller's request.
Video content and virtual object interworking system, characterized in that. The method of claim 1,
The meta information is targeting information set by the seller,
The search unit may search,
Extracting profile information of the user from information on the Internet related to the user to retrieve the meta information whose profile information matches the targeting information;
Video content and virtual object interworking system, characterized in that. The method of claim 1,
The meta information is set in a display manner by the seller,
The display unit includes:
Displaying the meta information according to the display method when an interaction for viewing the meta information is input from the user;
Video content and virtual object interworking system, characterized in that. The method of claim 1,
The display unit includes:
Combining and displaying the metadata view and the video view in which the meta information is displayed when the object of interest appears in a video view in which the video content is displayed.
Video content and virtual object interworking system, characterized in that. The method of claim 1,
The display unit includes:
Displaying the meta information according to a moving path indicating a position of the object of interest in the video content, and displaying area and position information of the object of interest corresponding to the meta information.
Video content and virtual object interworking system, characterized in that. The method according to claim 6,
The moving path is stored in association with the meta information, or the display unit tracks the position of the object of interest using at least one of an image tracking technique and an image interpolation technique.
Video content and virtual object interworking system, characterized in that. A method of synthesizing meta information about a virtual object in a video content and virtual object interworking system for synthesizing video content and a virtual object, the method comprising:
Requesting an N Screen (Network Screen) service so that video content being played on a TV is simultaneously played on a user terminal which is the mobile device of the user according to a user's request;
Accessing a management server storing meta data related to the video content and retrieving the meta information; And
Augmenting and displaying the meta information on the video content being played through the user terminal;
Lt; / RTI >
The meta information is,
Generated by annotating the object of interest included in the video content by the seller
Meta information synthesis method characterized in that.

Images