KR101453884B1 - Smart-TV with user specific and logotional advertisement function - Google Patents

Abstract

The present invention relates to a smart TV having a customized emotional advertising function. The present invention relates to a method and apparatus for receiving broadcast content and an advertisement tag content packetized from a broadcast content server through a broadcast communication network in order to implement broadcast content in a streaming manner in units of broadcasting frames, module; And extracting only a plurality of pieces of tag data that are matched with the user detailed information among the tag data constituting the advertisement tag contents, extracting only the advertisement object referred to by the extracted tag data, A user-customized module that allows explicit advertising to be performed; . Accordingly, it is possible to provide a precisely targeted advertisement tailored to the user by avoiding the conventional one-size-fits-all advertising form, and to provide an interest-inducing effect to the user.

Description

{Smart-TV with user specific and logotional advertisement function}

The present invention relates to a smart TV having a user-customized emotional advertisement function, and more particularly, to a smart TV having a user-tailored emotional advertisement function, and more specifically, To provide a sensible advertisement for minimizing the interference with viewing of broadcast contents and inducing interest to the user by maximizing the effect of the user on the smart TV while providing implicitly to the viewer of the smart TV The present invention relates to a smart TV having a sensibility advertisement function for a television set.

The main purpose of content or advertising is to increase the effectiveness of broadcasting. Conventionally, a method of separating contents and advertisements separately and viewing them separately or inserting advertisements in contents to expose them in broadcast contents without knowing the advertisement is mainly used.

On the other hand, the method of exposing to broadcast contents has a problem in that when the viewer does not know whether the advertisement is advertisement or is indifferent, there is no effect of targeting on the advertisement at all.

In addition, the conventional advertisement is not precisely targeted to viewers, resulting in a nonsensical advertisement. In addition, there is a problem in that interest is not generated by providing identical advertisement contents to all viewers in a uniform manner.

Accordingly, in order to solve the conventional problems in the related art, it is required to develop a new technology for maximizing the effect of advertisement and relieving inconvenience to people who want to view only broadcast contents.

[Related Technical Literature]

1. A smart pad having an advertisement system and an advertising system and method thereof (Patent Application No. 10-2011-0032083)

2. System and method for providing advertisement through a moving picture medium running on a smart device (Patent Application No. 10-2011-0107272)

3. Smart advertising information offer system (Patent Application No. 10-2011-0000401)

SUMMARY OF THE INVENTION The present invention has been made to solve the above problems, and it is an object of the present invention to provide a method and a system for providing a highly targeted advertising in a personalized manner, It is intended to provide smart TV.

In addition, the present invention provides a smart TV having a user-customized emotional advertisement function for minimizing the inconvenience of viewing, which is a side effect of maximizing the effect of the advertisement provided by the advertiser.

In addition, the present invention minimizes the viewing disturbance to the broadcast contents by providing it indirectly and implicitly to the user who watches the smart TV, and enables the detailed advertisement detail information to be provided through explicit advertisement when necessary And a smart TV having a user-tailored emotional advertisement function.

However, the objects of the present invention are not limited to the above-mentioned objects, and other objects not mentioned can be clearly understood by those skilled in the art from the following description.

In order to achieve the above object, a smart TV having a user-customized emotional advertisement function according to an embodiment of the present invention is a smart TV that is packetized from a broadcast content server through a broadcast communication network A broadcast content processing module for receiving the broadcast content and the advertisement tag content and separating the broadcast content and the advertisement tag content; And extracting only a plurality of pieces of tag data that are matched with the user detailed information among the tag data constituting the advertisement tag contents, extracting only the advertisement object referred to by the extracted tag data, A user-customized module that allows explicit advertising to be performed; .

Preferably, the user-customized module prepares to replace the user image information, which is called according to the reception of the user's name input signal from the voice receiving unit, with a character on the broadcast content for each broadcasting frame in the implicit advertisement implementation.

The smart TV according to the present invention may further include an advertisement conversion indicator for explicit advertisement conversion for an advertisement object matched with the extracted tag data included in the advertisement tag content and an indication indicator for the matching advertisement object An implicit advertisement implementation module that notifies the user of the implementation of the broadcast content in a frame-by-frame streaming manner to an output unit; .

It is also preferable that the user-customized module prepares to replace the user image information called according to the reception of the user's name input signal from the voice receiving unit, with the characters on the broadcast contents of the broadcast output frame in the explicit advertisement implementation .

In addition, the smart TV according to the present invention may further include a tag marking unit for marking an advertisement object matching the extracted tag data included in a currently broadcast broadcasting frame of the broadcast content when the advertisement switching indicator selection signal is received through the input interface An explicit ad implementation module that performs explicit advertising; .

In addition, in the smart TV according to the present invention, when a selection signal for one of a plurality of advertisement objects is received through the input interface during the execution of the explicit advertisement, the Smart TV transmits the motion gesture input signal An advertisement object purchasing module for determining that the purchase request is a purchase request and performing a purchase procedure; .

In addition, the user-customized module extracts advertiser target information from tag data for each advertisement object constituting the advertisement tag content, and then matches the user image information photographed by the camera unit among a plurality of pieces of user image information previously stored in the storage unit If the user detailed information corresponding to the extracted user image information is stored in advance, only the tag data matching each of the advertiser target information and the user detailed information is extracted, and an explicit advertisement and an implicit It is desirable to be used for advertising.

Preferably, the user-customized module extracts user image information of a similar range from among a plurality of user image information stored in advance, after identifying the pixels included in the image information.

In addition, it is preferable that the characteristics of the pixels included in the image information are extracted from the shape of the pixel, the color of the pixel, the line formed by the pixel, and the shape in which the pixel changes with the passage of time.

In addition, the user image information extraction of the similar range may be performed by using various user image information included in each of the previously stored user image information, the user image being skewed, the inverse skew, .

The user-customized module may further include an extracting unit for extracting a purchase confirmation text stored in advance in the storage unit for the advertisement object having the purchase history information in each of the extracted tag data, It is preferable to prepare the broadcast content for each broadcasting frame.

The user-customized module may further include an extracting unit for extracting a purchase confirmation text stored in advance in the storage unit for the advertisement object having the purchase history information in each of the extracted tag data, It is preferable to prepare the broadcast content for each broadcasting frame.

In addition, the broadcast content processing module may set a location tracking marking for tracking of each advertisement object using image information included in the extracted tag data.

In addition, the implicit advertisement implementing module implements the implied indicator that reflects the implicit effect of the advertisement object on which the position tracking marking is set to the output unit after setting the implicit effect on the advertising object with the position tracking marking set therein And implementing the tracking effect for the ambiguity indicator for each of the advertisement objects for which the position tracking marking is set when the broadcast content is implemented in a streaming manner in units of broadcasting frames by the output unit.

The explicit advertisement implementation module receives the selection signal for one of the object markers for each of the advertisement objects together with the broadcast content to the output unit when receiving the advertisement conversion indicator selection signal, Tag data, and implementing tracking by using an object marker for an advertisement object in which the position tracking marking is set when the broadcast content is implemented in the streaming method in units of the broadcasting frame by the output unit.

The user-customized module extracts only the tag data matched by the voice search and extracts only the tag data matched by the typing information received from the remote controller only to the advertisement object referred to by the extracted tag data, It is preferable that the implicit advertisement and the explicit advertisement are performed in the frame-by-frame streaming scheme implementation for the broadcast content only for the advertisement object referred to by the data.

The smart TV having the user-customized emotional advertisement method based on the smart TV and the user-customized emotional advertisement function according to the embodiment of the present invention can provide a highly targeted advertisement that is customized to the user, In addition, it provides an interesting effect to the user.

In addition, according to another embodiment of the present invention, a smart TV having a smart TV-based user-customized emotional advertisement method and a user-customized emotional advertisement function is used as a side effect of maximizing the effect of an advertisement provided by an advertiser, Thereby providing an effect of minimizing the incentive.

In addition, according to another embodiment of the present invention, a Smart TV-based user-tailored emotional advertisement method and a smart TV having a user-tailored emotional advertisement function are provided so as not to be viewed directly but implicitly Thus, it is possible to provide specific advertisement detail information by providing explicit advertisement when necessary while minimizing interference with viewing of broadcast contents.

1 is a diagram illustrating an entire system in which a Smart TV-based user-customized emotional advertisement method according to an exemplary embodiment of the present invention is implemented;
Fig. 2 is a diagram showing a configuration of a smart TV in Fig. 1; Fig.
3 is a conceptual diagram for explaining an implicit advertisement according to an embodiment of the present invention;
Figs. 4 to 5 are conceptual diagrams for explaining a user-customized advertisement. Fig.
FIG. 6 is a flowchart illustrating a process of providing a customized advertisement among Smart TV-based user-customized emotional advertisement methods according to an exemplary embodiment of the present invention.
FIG. 7 is a flowchart illustrating a process of providing a user image conversion type advertisement among smart TV-based user-customized emotional advertisement methods according to an exemplary embodiment of the present invention.
FIG. 8 is a flowchart showing a smart TV-based user-customized emotional advertisement method according to an embodiment of the present invention.
FIG. 9 is a flowchart specifically illustrating a smart TV-based user-customized emotional advertising method of FIG. 8;

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, a detailed description of preferred embodiments of the present invention will be given with reference to the accompanying drawings. In the following description of the present invention, detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear.

In the present specification, when any one element 'transmits' data or signals to another element, the element can transmit the data or signal directly to the other element, and through at least one other element Data or signal can be transmitted to another component.

1 is a diagram illustrating an entire system in which a Smart TV-based user-customized emotional advertisement method according to an exemplary embodiment of the present invention is implemented. 1, the entire system in which the smart TV-based emotional advertisement method is implemented includes a smart TV 10, a remote controller 20, a broadcast communication network 30, a broadcast content server 40, a smart mobile device 50, A data communication network 60 and an affiliated advertiser terminal group 70.

1, the smart TV 10 is formed as a set-top box separate type having a separate set-top box (STB) and performs data transmission / reception with the broadcast content server 40 through the broadcast communication network 30 Alternatively, it may be formed as a set-top box-integrated type and perform data transmission / reception with the broadcast content server 40 without a separate set-top box (STB).

The broadcast communication network 30 is a high-speed wired or bridged periodic network for broadcasting in the form of a large capacity, a long-distance voice, and a data service, and may be a wired or wireless Internet. The broadcast communication network 30 plays a role for the broadcast content server 40 to transmit the broadcast content to the smart TV 10 and other systems for broadcasting.

The broadcast content server 40 includes a broadcast DB 41 and an advertisement DB 42. Also, in this specification, a DB may mean a functional and structural combination of software and hardware for storing information corresponding to each database. The DB may be implemented as at least one table, and may further include a separate DBMS (Database Management System) for searching, storing, and managing information stored in the database. Also, it can be implemented in various ways such as a linked-list, a tree, and a relational database, and includes all data storage media and data structures capable of storing information corresponding to a database.

The broadcast content server 40 receives the advertisement data through the data communication network 60 from each of the affiliated advertiser terminals constituting the affiliated advertiser terminal group 70 for each of the advertisement objects included in the broadcast content stored in the broadcast DB 41 do. In this case, it is preferable that the advertisement data include image information and advertisement detailed information for each advertisement object, and it is preferable that the advertisement data is received by receiving broadcast data of each broadcast content when the advertisement data is received.

Here, the data communication network 60 may be a high-speed period network of a large communication network capable of a large-capacity, long-distance voice and data service, and may be a next generation wired and wireless network for providing Internet or high-speed multimedia service. When the data communication network 60 is a mobile communication network, it may be a synchronous mobile communication network or an asynchronous mobile communication network. As an embodiment of the asynchronous mobile communication network, a WCDMA (Wideband Code Division Multiple Access) communication network is exemplified. In this case, although not shown in the drawing, the data communication network 60 may include a Radio Network Controller (RNC). Meanwhile, although the WCDMA network is exemplified, it may be a next generation communication network such as a 3G LTE network or a 4G network, or an IP network based on other IP. The data communication network 60 serves to transmit signals and data between the broadcasting contents server 40, a plurality of advertiser terminal units constituting the advertiser terminal group 70, and other systems.

On the other hand, the broadcast content server 40 generates tag data for each of the advertisement objects, and then all the generated tag data are numbered and stored in the advertisement DB 42 as advertisement tag contents. Meanwhile, in an embodiment of the present invention, the broadcast content server 40 preferably includes image information and advertisement detail information for use in object recognition for each advertisement object received at the time of generating each tag data, It is preferable that the advertisement DB 42 divides the broadcasting contents into broadcasting transmission frames and stores the metadata together with the respective advertisement tag contents when the advertisement contents are stored.

The broadcast content server 40 transmits the broadcast content stored in the broadcast DB 41 and the advertisement DB 42 in response to a request for listening to the broadcast content stored in the broadcast DB 41 of the smart TV 10 through the broadcast communication network 30. [ And transmits the packetized content to the smart TV 10 through the broadcast communication network 30. [

The smart mobile device 50 is provided for confirming detailed information on the advertisement object based on the touch screen when the user of the smart TV 10 wants detailed information on the advertisement object according to the explicit advertisement implementation after the implicit advertisement implementation do.

Fig. 2 is a diagram showing a configuration of the smart TV 10 in Fig. 3 is a conceptual diagram for explaining an implicit advertisement according to an embodiment of the present invention. 4 to 5 are conceptual diagrams illustrating a user-customized advertisement.

2, the smart TV 10 includes an output unit 11, a sensing unit 12, an input interface 13, a control operation unit 14, a storage unit 15, and a wired / wireless communication module 16, .

The input interface 13 includes an input unit 13a, a remote control signal receiving unit 13b, a camera unit 13c, and a voice receiving unit 13d. Here, as an example of the voice receiving unit 13d, a microphone generally used can be formed in the edge region of the smart TV 10. [ The control operation unit 14 includes a broadcast content processing module 14a, an implicit advertisement implementation module 14b, an explicit advertisement implementation module 14c and an advertisement object purchase module 14d and a user customization module 14e do. Herein, a module may mean a functional and structural combination of hardware for carrying out the technical idea of the present invention and software for driving the hardware. For example, the module may mean a logical unit of a predetermined code and a hardware resource for executing the predetermined code, and it does not necessarily mean a physically connected code or a kind of hardware. Can be easily deduced to the average expert in the field of < / RTI >

Hereinafter, the entire system in which the Smart TV-based emotional advertisement method is implemented will be described in detail, focusing on the configuration of the control operation unit 14. [ The broadcast content processing module 14a controls the wired / wireless communication module 16 to receive the packetized broadcast content and the advertisement tag content from the broadcast content server 40 through the broadcast communication network 30 in a streaming manner for each broadcast transmission frame , And receives broadcasting contents and advertisement tag contents packetized in units of broadcast transmission frames. The broadcast content processing module 14a separates the broadcast content and the advertisement tag content from the packet in the broadcast transmission frame unit, and then prepares for implementation of the broadcast content in the output unit 11 in a frame-by-frame streaming manner.

More specifically, the broadcast content processing module 14a receives the broadcast content stored in the broadcast DB 41 of the smart TV 10 from the broadcast content server 40 through the broadcast communication network 30, And controls the module 16. The broadcast content processing module 14a transmits the broadcast content stored in the broadcast DB 41 of the broadcast content server 40 and the advertisement tag content stored in the advertisement DB 42 of the broadcast content server 40 to the broadcast transmission frame And controls the wired / wireless communication module 16 to receive from the broadcasting contents server 40 through the broadcasting communication network 30 in a packetized state.

The broadcast content processing module 14a separates the packetized broadcast content and the advertisement tag content received from the broadcast content server 40 in a streaming manner on a broadcast broadcast frame basis, Reads the tag data for each advertisement object, and stores the tag data in the storage unit 15.

The broadcast content processing module 14a sets the location tracking marking for tracking for each advertisement object using the image information included in the tag data for each of the read advertisement objects. Here, the position tracking marking serves as a marker for tracking each advertisement object in the implementation of the advertisement object to the output unit 11 according to each broadcast transmission frame on the advertisement content. More specifically, even if the position of each of the advertisement objects is changed or the stereoscopic view is changed on the broadcast content according to the setting of the position tracking marking, the realtime change data due to the position change or stereoscopic view change is automatically generated by the broadcast content processing module 14a And is stored in the storage unit 15 so that the position of the advertisement object on the UI screen realized on the output unit 11 is automatically tracked by using the stored real-time change data when tracking the advertisement object.

The broadcast content processing module 14a may further perform object recognition for automatically performing recognition of an object other than the advertisement object in broadcast contents of each broadcast transmission frame in an additional process.

That is, the broadcast content processing module 14a performs object recognition for an object that is not read as tag data for each advertisement object of the advertisement tag content received in a streaming manner for each broadcast transmission frame. It is preferable that the broadcast content processing module 14a individually performs recognition of each of the stereoscopic viewpoints at the time of object recognition for each recognition object.

The broadcast content processing module 14a transmits a query message to the broadcast content server 40 through the broadcast communication network 30 for the recognized object, and when there is additional tag data for the object to be recognized, And controls the communication module 16. The broadcast content processing module 14a performs object recognition on the image information of the broadcast content for each recognition object and sets a position tracking marking for tracking on the recognition object. Here, the position tracking marking for tracking each recognition object is implemented by UI screen of the output unit 11 for each broadcast transmission frame on the broadcast content, when the position on the UI screen of each recognition object is changed or the stereoscopic view is changed The real time change data corresponding to the change of the position of each recognition object or the change of the stereoscopic view is automatically generated by the broadcast content processing module 14a and stored in the storage unit 15 of the smart TV, And is set so that the stored real-time change data is used to automatically track the position of the recognition object on the UI screen implemented on the output unit 11. [

The broadcast content processing module 14a implements the advertisement conversion indicator in the output unit 11 and receives the streaming method in units of broadcasting frames to start outputting the broadcasting contents in the buffering state on the storage unit 15 .

The implicit advertisement implementing module 14b implements the advertisement conversion indicator in the output unit 11 according to the start of outputting the broadcast content of the broadcast content processing module 14a, And implements an implicit indicator for each advertising object in which the implicit effect is reflected.

More specifically, the implicit advertisement implementation module 14b establishes an implicit effect on the recognized object to which the position tracking marking is set, the advertisement object to which the position tracking marking is set. Here, the implicit effect implies a user interface effect for indirectly recognizing the broadcast contents in the streaming manner implicitly to the user of the smart TV 10 before the explicit exposure of the advertisement object and the recognition object .

In an embodiment of the present invention, a subliminal effect may be used as an implicit effect, and a subliminal effect may be one of a plurality of broadcast images including an advertisement object constituting a broadcast transmission frame And inserting an empty-image containing only an implicit indicator (see FIG. 3).

As shown in FIG. 3, the color change setting for a skirt and the backlight setting for a shoe can be an example of an advertisement object or a recognition object in an empty image for a subliminal effect. Another example is the adver, status bar, icon, and border color settings for an object or a recognized object.

The implicit advertisement implementing module 14b implements an implicit indicator according to the setting of the implicit effect for the advertisement object and the recognition object together with the broadcasting contents for each broadcasting transmission frame to the output unit 11. [ As described above, the hint indicator can be implemented as a color change, an halo, an ad bar, a status bar, an icon, and a border color for an advertisement object or a recognition object.

The implicit advertisement implementing module 14b implements the tracking effect on the advertising object or the implicit indicator for each recognition object according to the time flow for the broadcasting contents for each broadcasting transmission frame to the output unit 11. [ Here, the tracking effect means to implement the position or shape of the indictor according to the object recognition for the object to be marked with the position tracking marking and the object to be recognized with the position tracking marking.

The implicit advertisement implementation module 14b waits for the advertisement switching indicator selection signal from the input interface 13 for explicit advertisement switching and then determines whether or not to receive the advertisement switching indicator selection signal and transmits the advertisement switching indicator selection signal to the explicit advertisement implementation module 14c to terminate the implicit ad output process.

The explicit advertisement implementing module 14c receives the advertisement switching indicator selection signal through the input interface 13 and displays the object corresponding to the advertisement object for the advertisement object matched with the tag data included in the currently broadcast broadcasting frame, Perform an explicit advertisement according to the marker implementation.

More specifically, the explicit advertisement implementing module 14c sends the advertisement switching indicator selection signal to the output unit 11 when the advertisement switching indicator selection signal is received by the implicit advertisement implementing module 14b, An object marker is implemented for the object and the recognition object, and the advertisement is implemented through the tag data for the advertisement object or the recognition object selected when the object marker is selected.

On the other hand, when the explicit advertisement implementing module 14c receives a selection input for one of the object markers, the explicit advertisement implementing module 14c generates a selection mark in accordance with the recognition data previously stored in the storage unit 15 through the sensing unit 12 . As one example, when the sensing unit 12 is implemented as a recognition module of a camera photographing system, a recognition signal may be recognized as a selection signal at a place where a user's eyes are frequently seen as a result of eye recognition through a camera photographing, And recognizing an object marker corresponding to the advertisement object matching the interest category information stored on the storage unit 15 with respect to the user.

The explicit advertisement implementing module 14c implements a tracking effect using an object marker according to an advertisement object or an object marker according to a flow of broadcast contents for each broadcasting frame to the output unit 11. [ Here, the tracking effect means to convert the position of the object marker according to the object recognition for the object to be marked with the position tracking marking and the object to be recognized with the position tracking marking.

The explicit advertisement implementing module 14c waits for receiving a selection signal for a plurality of advertisement objects and a plurality of recognition objects from the input interface 13. [

The explicit advertisement implementation module 14c notifies the advertisement object purchase module 14d of the determination result through determination of whether or not the selection signal is received for one of a plurality of advertisement objects and a plurality of recognition objects, Complete.

As a result of the explicit advertisement implementation module 14c, when the advertisement selection module 14d receives the selection signal for one of the plurality of advertisement objects through the input interface 13 in the process of performing the explicit advertisement, When the motion gesture input signal through the input interface 13 is received, it is determined that the purchase request is made and the purchase procedure is performed.

More specifically, the advertisement purchase module 14d receives a motion gesture input signal from the remote controller 20 for a selected advertisement object or a recognized object, in response to a selection signal for one of a plurality of advertisement objects and a plurality of objects to be recognized, And receives a motion gesture input signal through the input unit 13a or receives a motion gesture input signal to the input unit 13a, and recognizes the received target object as a purchase request for a recognized object or a recognition target object.

The customized module 14e comprises customized advertising means 14e-1 and user implementation means 14e-2.

When the broadcasting contents and the advertisement tag contents are separated from the packetized contents received through the broadcast communication server 30 in the streaming manner for each broadcasting transmission frame through the broadcasting communication network 30, the customized advertisement means 14e- The advertiser target information is extracted from the tag data of each advertisement object constituting the tag content.

At this time, the advertiser target information may mean age and gender information set by the advertiser for each advertisement object, and it is preferably included in the broadcast content server 40 when the tag data is generated.

The customized advertisement means 14e-1 acquires user image information by user's photographing using the camera unit 13c among the input interface 13. [

The customized advertisement means 14e-1 specifies the pixels included in the acquired image information. The customized advertisement means 14e-1 specifies the pixels included in the acquired image information. Here, the specification of the pixels included in the image information means extracting the characteristics of the pixels from the lightness and darkness of the pixels, the colors of the pixels, the lines formed by the pixels, and the shapes in which the pixels change with the passage of time.

The customized advertisement means 14e-1 extracts user image information of a similar range among a plurality of pieces of user image information previously stored on the storage unit 15 according to the pixel specification included in the image information. Here, at least one user image information using the smart TV 10 is stored in the storage unit 15 for extracting user image information in a similar range. Each user image information includes various user image information, Inclined, inverted, slightly angled, and the like.

The customized advertisement unit 14e-1 determines whether the user detailed information corresponding to the user image information extracted in the similar range is stored in the storage unit 15 in advance.

If the user detailed information is stored in advance as a result of the determination, the smart TV 10 displays the advertiser target information extracted from the tag data for each advertisement object constituting the advertisement tag content, And notifies the broadcast content processing module 14a that the extracted tag data is to be read only for the extracted tag data.

Here, the customized advertisement means 14e-1 can extract only the tag data that matches the age and gender included in the advertiser target information, and the user age and gender included in the user detailed information. On the other hand, if the user detailed information is not stored in advance as a result of the determination, the customized advertisement means 14e-1 notifies the broadcast content processing module 14a to read all the tag data included in the advertisement tag content.

In another embodiment other than the user-customized tag data extraction method described above, the customized advertisement means 14e-1 can extract only the tag data matched by voice search. That is, the customized advertisement means 14e-1 extracts the tag data matching the search information among the tag data of each advertisement object according to the advertisement object search information received through the voice receiving unit 13d of the input interface 13, To the broadcast content processing module 14a so as to read only the content.

Here, the voice receiving unit 13d receives advertisement object search information including person name information, relationship information, and the like, which are included in the advertisement object that can be included in each tag data by the micro user. Accordingly, when the same information as the search information is included in the tag data, the smart TV 10 extracts it and performs reading for the implementation of the broadcast content.

In another embodiment other than the user-customized tag data extracting method, the customized advertising means 14e-1 searches only the tag data matching with the typing information through the search by inputting the user's typing information using the remote controller 20 Can be extracted. That is, the customized advertisement unit 14e-1 receives the typing information among the tag data of each advertisement object in accordance with the reception of the typing information for searching for the advertisement object from the remote controller 20 through the remote control signal receiving unit 13b of the input interface 13 And notifies the broadcast content processing module 14a of the reading to perform reading for the broadcast content implementation.

On the other hand, the user implementing means 14e-2 sends the customized advertising means 14e-1 to the customized advertising means 14e-1 when the reading process by extracting only the tag data of the user- From the user detailed information stored on the storage unit 15 after the user name information matching the user image information extracted by the user interface information extracting unit 13d from the voice receiving unit 13d of the input interface 13, And waits for reception.

Then, the user implementing means 14e-2 performs three-dimensional stereoscopic conversion on the user image information extracted by the customized advertisement means 14e-1, and prepares to implement broadcasting contents for each broadcasting frame in the broadcasting contents do. An example of a screen in which a character of a broadcast content is replaced with a user image by the three-dimensional stereoscopic transformation is implemented as shown in FIG. 4 in the case of an implicit advertisement, and as shown in FIG. 5 in an explicit advertisement.

The user implementing means 14e-2 transmits the purchase confirmation text previously specified on the storage unit 15 to the advertisement object or the recognition object having the purchase history information in the tag data read by the broadcast content processing module 14a Thereby preparing a broadcast content implementation per broadcast transmission frame including purchase confirmation text. On the other hand, as shown in Figs. 4 and 5, the purchase confirmation text is implemented as "How do you like to use XXX ?," so that the user can easily recognize the advertisement object or the recognition object purchased by the user. Meanwhile, it is preferable that the purchase confirmation text is applied equally to a tracking effect to be described later.

FIG. 6 is a flowchart illustrating a process of providing a customized advertisement among smart TV-based user-customized emotional advertisement methods according to an exemplary embodiment of the present invention. 1 to 6, the smart TV 10 includes a broadcast content server 40 and a broadcast content server 40. The smart TV 10 broadcasts the broadcast content received through the broadcast communication network 30 in a streaming manner for each broadcast transmission frame from the broadcast content server 40, (S14a).

After step S14a, the smart TV 10 extracts advertiser target information from the tag data for each advertisement object constituting the advertisement tag content (S14b).

The advertiser target information may indicate age and gender information set by the advertiser for each advertisement object, and it is preferably included in the broadcast content server 40 when the tag data is generated.

After step S14b, the smart TV 10 acquires user image information by user's photographing using the camera unit 13c among the input interface 13 (S14c).

After step S14d, the smart TV 10 identifies pixels included in the image information acquired in step S14c (S14d). Here, the specification of the pixels included in the image information means extracting the characteristics of the pixels from the lightness and darkness of the pixels, the colors of the pixels, the lines formed by the pixels, and the shapes in which the pixels change with the passage of time.

After step S14d, the smart TV 10 extracts user image information of a similar range of a plurality of user image information stored in advance on the storage unit 15 according to the pixel specification included in the image information (S14e). Here, at least one user image information using the smart TV 10 is stored in the storage unit 15 for extracting user image information in a similar range. Each user image information includes various user image information, Inclined, inverted, slightly angled, and the like.

After step S14e, the smart TV 10 determines whether the user detailed information corresponding to the user image information extracted in the similar range is stored in advance in the storage unit 15 (S14f).

If it is determined in step S14f that the user detailed information has been stored in advance, the smart TV 10 extracts only the tag data that matches the advertiser target information extracted in step S14b and the user detailed information from the advertisement tag content Reading is performed (S14g). Here, the smart TV 10 can extract only the tag data that matches the age and sex included in the advertiser target information, and the user age and gender included in the user detailed information.

On the other hand, if it is determined in step S14f that the user detailed information is not stored in advance, the smart TV 10 reads all tag data included in the advertisement tag content (S14h).

Then, after step S14a, the smart TV 10 can extract only the tag data matched by voice search, in other embodiments than the tag data extracting method according to steps S14b to S14g. That is, the smart TV 10 extracts the tag data matching the search information among the tag data of each advertisement object according to the advertisement object search information received through the voice receiving unit 13d of the input interface 13, (S14i).

Here, the voice receiving unit 13d receives advertisement object search information including person name information, relationship information, and the like, which are included in the advertisement object that can be included in each tag data by the micro user. Accordingly, when the same information as the search information is included in the tag data, the smart TV 10 extracts it and performs reading for the implementation of the broadcast content.

In addition, after step S14a, the smart TV 10 may search for the user by inputting the typing information using the remote controller 20, as another embodiment other than the tag data extracting method according to steps S14b to S14g Only the tag data matching with the typing information can be extracted. That is, when the Smart TV 10 is matched with the typing information among the tag data of each advertisement object in accordance with reception of the typing information for searching for the advertisement object from the remote controller 20 through the remote control signal receiver 13b of the input interface 13 And performs reading for the broadcast content implementation (S14j).

7 is a flowchart illustrating a process of providing a user image conversion type advertisement among Smart TV-based user-customized emotional advertisement methods according to an embodiment of the present invention. Referring to FIGS. 1 to 7, when the process for reading only the tag data for the user-customized advertisement object in FIG. 6 is completed, the smart TV 10 matches the user image information extracted in step S14e From the user detailed information stored on the storage unit 15 and waits for the user name input signal corresponding to the user name from the voice receiving unit 13d of the input interface 13 (S18a or S26a ).

Thereafter, the smart TV 10 performs three-dimensional stereoscopic conversion on the user image information extracted in step S14e to prepare an implementation of the broadcast content for each broadcast frame in the broadcast content (S18b or S26b).

Thereafter, the smart TV 10 extracts the purchase confirmation text previously specified on the storage unit 15 for the advertisement object or the recognition object having the purchase history information in each of the tag data read in step S14f, (S18c or S26c) is prepared for broadcasting contents per broadcasting transmission frame including text.

8 is a flowchart illustrating a smart TV-based emotional advertisement method according to an embodiment of the present invention. Referring to FIGS. 1 to 8, the smart TV 10 receives the packetized broadcast content and the advertisement tag content from the broadcast content server 40 through the broadcast communication network 30 in a streaming manner for each broadcast transmission frame, And the advertisement tag content, and prepares for implementation of the streaming method in the output unit 11 in units of broadcasting frames for broadcasting contents (S10). .

Here, the broadcast communication network 30 is a high-speed wired or bridged termi- nal network for broadcasting in the form of a large capacity, a long-distance voice, and a data service, and may be a wired or wireless Internet. The broadcast communication network 30 plays a role for the broadcast content server 40 to transmit the broadcast content to the smart TV 10 and other systems for broadcasting.

On the other hand, the broadcast content server 40 includes a broadcast DB 41 and an advertisement DB 42. Also, in this specification, a DB may mean a functional and structural combination of software and hardware for storing information corresponding to each database. The DB may be implemented as at least one table, and may further include a separate DBMS (Database Management System) for searching, storing, and managing information stored in the database. Also, it can be implemented in various ways such as a linked-list, a tree, and a relational database, and includes all data storage media and data structures capable of storing information corresponding to a database.

After step S10, the smart TV 10 is an implicit advertisement outputting process. The smart TV 10 is implemented in accordance with the temporal flow of the broadcasting contents to the output unit 11 for each broadcast broadcasting frame, and the advertisement switching indicator and the indication indicators (S20).

 After step S20, the smart TV 10 receives the advertisement switching indicator selection signal through the input interface 13, and performs the flow of the broadcasting contents to the output unit 11 according to the temporal flow, An explicit advertisement according to the implementation of the object markers for the advertisement object is performed in the separated advertisement tag contents according to the process of S30.

After receiving the selection signal for one of the plurality of advertisement objects through the input interface 13 in the process of performing the explicit advertisement by the step S30 after the step S30, When a motion gesture input signal through the input interface 13 is received, it is determined that the purchase request is made and a purchase procedure is performed (S40).

FIG. 9 is a specific flowchart of steps (S10) to (S40) of the smart TV-based user-customized emotional advertisement method of FIG. 1 to 9, the broadcast content server 40 transmits the broadcast content stored in the broadcast DB 41 to each of the affiliated advertiser terminal units 70 constituting the affiliated advertiser terminal group 70 for each of the advertisement objects included in the broadcast content, (Step S11). Here, the data communication network 60 may be a high-speed period network of a large communication network capable of a large-capacity, long-distance voice and data service, and may be a next generation wired and wireless network for providing Internet or high-speed multimedia service. When the data communication network 60 is a mobile communication network, it may be a synchronous mobile communication network or an asynchronous mobile communication network. As an embodiment of the asynchronous mobile communication network, a WCDMA (Wideband Code Division Multiple Access) communication network is exemplified. In this case, although not shown in the drawing, the data communication network 60 may include a Radio Network Controller (RNC). Meanwhile, although the WCDMA network is exemplified, it may be a next generation communication network such as a 3G LTE network or a 4G network, or an IP network based on other IP. The data communication network 60 serves to transmit signals and data between the broadcasting contents server 40, a plurality of advertiser terminal units constituting the advertiser terminal group 70, and other systems.

It is preferable that the advertisement data include image information for each advertisement object, and it is preferable that the advertisement data is received by receiving broadcast data of each broadcast content when the advertisement data is received. Also, in this specification, a DB may mean a functional and structural combination of software and hardware for storing information corresponding to each database. The DB may be implemented as at least one table, and may further include a separate DBMS (Database Management System) for searching, storing, and managing information stored in the database. Also, it can be implemented in various ways such as a linked-list, a tree, and a relational database, and includes all data storage media and data structures capable of storing information corresponding to a database.

The broadcast content server 40 generates tag data for each of the advertisement objects, and then all the generated tag data is numbered and stored in the advertisement DB 42 as advertisement tag contents (S12). Meanwhile, in one embodiment of the present invention, the broadcast content server 40 preferably includes image information for use in object recognition for each advertisement object received in step S11 when each tag data is generated And the advertisement DB 42, it is preferable to generate meta data according to the broadcasting broadcasting frames of the broadcasting contents and to store the metadata together with the respective advertisement tag contents.

After the step S12, the broadcast content server 40 transmits the broadcast content 41 stored in the broadcast DB 41 in response to a request for listening to the broadcast content stored in the broadcast DB 41 of the smart TV 10 through the broadcast communication network 30, And the advertisement DB contents stored in the advertisement DB 42 are packetized for each broadcasting transmission frame and transmitted to the smart TV 10 through the broadcasting communication network 30 (S13).

In step S13, the smart TV 10 separates the packetized broadcast content received from the broadcast content server 40 in a streaming manner for each broadcast transmission frame and the advertisement tag content, Tag data per object is read (S14). At this time, reading of the tag data for each advertisement object is performed only for the user-customized tag data according to the process of FIG. 6.

After step S14, the smart TV 10 sets up a position tracking marking for tracking for each advertisement object using the image information included in the tag data for each advertisement object read in step S14 (S15). Here, the position tracking marking serves as a marker for tracking each advertisement object in the implementation of the advertisement object to the output unit 11 according to each broadcasting transmission frame on the advertisement content. More specifically, even if the position of each of the advertisement objects is changed or the stereoscopic view is changed on the broadcast content in accordance with the setting of the position tracking marking in step S15, the real time change data according to the position change or stereoscopic view change is automatically transmitted to the smart TV 10 And stored in the storage unit 15 so that the position of the advertisement object on the UI screen realized on the output unit 11 is automatically tracked by utilizing the stored real time change data at the time of tracking for the advertisement object .

On the other hand, after step S15, the smart TV 10 may further perform step S16, which is an object recognition process for automatically recognizing an object other than the advertisement object in the broadcast content as an additional process. It is preferable that the smart TV 10 individually performs recognition of each of the stereoscopic viewpoints at the time of object recognition for each recognition object.

In step S16, in step S14, the smart TV 10 performs object recognition for an object that is not read as tag data for each advertisement object of the advertisement tag content received in a streaming manner for each broadcasting frame in step S14 S16a). After step S16a, the smart TV 10 transmits additional tag data for the recognition object in accordance with the transmission of the query message to the broadcast content server 40 through the broadcast communication network 30 for the recognition object recognized in step S16a And further receives (S16b). After step S16b, the smart TV 10 performs object recognition on the image information of the broadcast content for each recognition object and sets a position tracking marking for tracking on the recognition object (S16c).

Here, the position tracking marking for tracking each recognition object is implemented by UI screen of the output unit 11 for each broadcast transmission frame on the broadcast content, when the position on the UI screen of each recognition object is changed or the stereoscopic view is changed The real time change data according to the position change of each recognition object or the change of the stereoscopic view is automatically generated by the smart TV 10 and stored in the storage unit 15 of the smart TV, Change data is utilized so that the position of the recognition object on the UI screen implemented on the output unit 11 is automatically tracked.

After step S15 or step S16, the smart TV 10 implements the advertisement conversion indicator in the output unit 11 and prepares to start outputting the broadcast content for each broadcasting frame in a streaming manner (S17 ), The broadcast content preparation process for each broadcast transmission frame in step S10 is completed. On the other hand, after step S17, by receiving the voice input from the user for the user's name by the steps S18a to S18c as shown in Fig. 7, the character included in the broadcast content with the image matched with the called user And the process of preparing for implementation in the output unit 11 is performed (S18).

After performing the step S10 according to the steps S11 to S17, the smart TV 10 displays the advertisement object with the position tracking marking set in step S15, and the recognition object with the position tracking marking set in step S16c Lt; RTI ID = 0.0 > (S21). ≪ / RTI > Here, the implicit effect implies a user interface effect for indirectly recognizing the broadcast contents in the streaming manner implicitly to the user of the smart TV 10 before the explicit exposure of the advertisement object and the recognition object .

In the embodiment of the present invention, a subliminal effect may be used as an implicit effect, and a subliminal effect may include an indication indicator (not shown) between broadcast images including an advertisement object constituting a broadcast transmission frame (See FIG. 3). In this case, as shown in FIG.

As shown in FIG. 3, the color change setting for a skirt and the backlight setting for a shoe can be an example of an advertisement object or a recognition object in an empty image for a subliminal effect. Another example is the adver, status bar, icon, and border color settings for an object or a recognized object.

After step S21, the smart TV 10 implements an implied indicator reflecting the implicit effect of the advertisement object and the recognition object together with the broadcasting contents for each broadcasting transmission frame to the output unit 11 (S22). As described above, the hint indicator can be implemented as a color change, an halo, an ad bar, a status bar, an icon, and a border color for an advertisement object or a recognition object.

After step S22, the smart TV 10 implements the tracking effect for the advertisement indicator for each advertisement object or the recognition object according to the flow of time with respect to the broadcasting contents for each broadcast transmission frame to the output unit 11 (S23) . Here, the tracking effect is implemented by transforming the location or shape of the indictor according to the object recognition for the object to be marked with the position tracking marking in step S15 and the object to be recognized with the position tracking marking in step S16c .

After step S23, the smart TV 10 waits for the advertisement switching indicator selection signal from the input interface 13 for explicit advertisement switching (S24), and judges whether or not to receive the advertisement switching indicator selection signal (S25), and ends the implicit advertisement output process. On the other hand, after step S25, if a voice input is made from the user to the user's name by steps S26a to S26c as shown in FIG. 7, It is a feature of the present invention that the person is converted and the preparation for implementation to the output unit 11 is performed (S26).

If the advertisement switching indicator selection signal is received in step S25, the Smart TV 10 implements the object marker for the advertisement object and the recognition object along with the broadcasting contents for each broadcasting frame to the output unit 11, When the marker is selected, the advertisement is implemented through the tag data of the selected advertisement object or the recognition object (S31).

On the other hand, when the smart TV 10 receives a selection input for one of the object markers, the smart TV 10 can be performed in a manner corresponding to recognition data previously stored in the storage unit 15 via the sensing unit 12 have. As one example, when the sensing unit 12 is implemented as a recognition module of a camera photographing system, a recognition signal may be recognized as a selection signal at a place where a user's eyes are frequently seen as a result of eye recognition through a camera photographing, And recognizing an object marker corresponding to the advertisement object matching the interest category information stored on the storage unit 15 with respect to the user.

After step S31, the smart TV 10 implements the tracking effect using the object markers for each advertisement object or the recognition object according to the flow of the broadcasting contents for each broadcasting frame to the output unit 11 (S32). Here, the tracking effect is implemented by transforming the position of the object marker according to the object recognition for the object to be marked with the position tracking marking in step S15 and the object to be recognized with the position tracking marking in step S16c.

After step S32, the smart TV 10 waits for a selection signal for one of a plurality of advertisement objects and a plurality of recognition objects from the input interface 13 (S33).

After step S33, the smart TV 10 determines whether to receive a selection signal for one of a plurality of advertisement objects and a plurality of recognition objects (S34), and completes execution of the explicit advertisement.

As a result of the determination in step S34, in the case of a selection signal for one of a plurality of advertisement objects and a plurality of recognition objects, the smart TV 10 displays a purchase procedure through the motion gesture for the advertisement object or the recognition object selected in step S34 (S40).

More specifically, the smart TV 10 receives the motion gesture input signal from the remote controller 20 for the selected advertisement object or the recognition object through the remote control signal receiving unit 13b or receives the motion gesture input signal to the input unit 13a And recognizes it as a purchase request for a selected advertisement object or a recognition object at the time of inputting a motion gesture, and performs a purchase process.

The present invention can also be embodied as computer-readable codes on a computer-readable recording medium. A computer-readable recording medium includes all kinds of recording apparatuses in which data that can be read by a computer system is stored.

Examples of the computer-readable recording medium include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device and the like, and also implemented in the form of a carrier wave (for example, transmission over the Internet) .

The computer readable recording medium may also be distributed over a networked computer system so that computer readable code can be stored and executed in a distributed manner. And functional programs, codes, and code segments for implementing the present invention can be easily inferred by programmers skilled in the art to which the present invention pertains.

As described above, preferred embodiments of the present invention have been disclosed in the present specification and drawings, and although specific terms have been used, they have been used only in a general sense to easily describe the technical contents of the present invention and to facilitate understanding of the invention , And are not intended to limit the scope of the present invention. It is to be understood by those skilled in the art that other modifications based on the technical idea of the present invention are possible in addition to the embodiments disclosed herein.

10: Smart TV
11: Output section
12: sensing unit
13: Input Interface
13a:
13b: Remote control signal receiving section
13c:
13d:
14:
14a: broadcast content processing module
14b: Implicit ad implementation module
14c: Explicit ad implementation module
14d: Advertisement object purchase module
14e: Customized modules
14e-1: Customized advertising means
14e-2: user implementation means
15:
16: Wired / wireless communication module
STB: Set-top box
20: Remote control
30: Broadcasting network
40: broadcast content server
50: Smart mobile devices
60: Data communication network
70: Associated advertiser terminal group

Claims (16)

A broadcast content processing module for receiving the broadcast content and the advertisement tag content packetized from the broadcast content server through the broadcast communication network to implement the broadcast content in the streaming method for each broadcast frame, and separating the broadcast content and the advertisement tag content;
Only the content matching the user detailed information among the plurality of tag data constituting the advertisement tag content is extracted and only the advertisement object referred to by the extracted tag data is displayed in the frame streaming method for the broadcast content, A user-customized module that allows an advertisement to be performed; / RTI >
Wherein the user-customized module prepares to replace the user image information, which is called according to the reception of the user's name input signal from the voice receiving unit, with a character on the broadcasting contents for each broadcasting frame in the implementation of the implicit advertisement. Smart TV with function.
delete The method according to claim 1,
An advertisement conversion indicator for explicit advertisement conversion for an advertisement object matched with the extracted tag data included in the advertisement tag content, and an indication indicator for each matched advertisement object in a frame unit An implicit advertisement implementation module for notifying the user of the streaming scheme; And a smart TV having a user-customized emotional advertisement function.
4. The system of claim 3,
Wherein the user advertisement information preparation function is configured to replace the user image information that has been called according to the reception of the user name input signal from the voice receiving unit, with a character on the broadcast content for each broadcast transmission frame upon implementation of the explicit advertisement. One Smart TV.
The method of claim 4,
An explicit advertisement implementation for performing an explicit advertisement according to the implementation of the object marker on the advertisement object matched with the extracted tag data included in the broadcast transmission frame currently implemented in the broadcast content when the advertisement conversion indicator selection signal is received through the input interface module; And a smart TV having a user-customized emotional advertisement function.
The method of claim 5,
When receiving a selection signal for one of a plurality of advertisement objects through the input interface, when the motion gesture input signal is received through the input interface for the selected advertisement object, An advertisement target purchase module for performing a procedure; And a smart TV having a user-customized emotional advertisement function.
The system of claim 1, wherein the user-
Extracting advertiser target information from tag data for each advertisement object constituting the advertisement tag content, extracting user image information matched with user image information photographed by the camera unit among a plurality of user image information previously stored in the storage unit,
When the user detailed information corresponding to the extracted user image information is stored in advance, only the tag data matching each of the advertiser target information and the user detailed information is extracted and used for the explicit advertisement and the implicit advertisement Smart TV with user-tailored emotional advertising function.
The system of claim 7, wherein the user-
Wherein the user information extracting unit extracts user image information of a similar range from among a plurality of user image information stored in advance, after identifying pixels included in the image information.
9. The image processing method according to claim 8,
Wherein characteristics of a pixel are extracted from a shape in which the brightness and darkness of the pixel, the color of the pixel, the line formed by the pixel, and the shape of the pixel change with the passage of time.
10. The image processing method according to claim 9,
Wherein the user information is performed by using various user image self information contained in each of the plurality of user image information stored in advance and the user image is skewed, inverted, and a slight angle is inclined. .
The system of claim 1, wherein the user-
Extracting a purchase confirmation text stored in advance in the storage unit with respect to the advertisement object having the purchase history information in each of the extracted tag data and then transmitting the broadcast content implementation for each broadcast transmission frame including the purchase confirmation text for the implicit advertisement And a smart TV having a user-customized emotional advertisement function.
The system of claim 5, wherein the user-
Extracting a purchase confirmation text stored in advance in a storage unit for an advertisement object having purchase history information in each of the extracted tag data, and transmitting the broadcast content implementation for each broadcast transmission frame including the purchase confirmation text for the explicit advertisement And a smart TV having a user-customized emotional advertisement function.
The broadcast content processing module according to claim 10,
And setting a location tracking marking for tracking of each advertisement object using the image information included in the extracted tag data.
delete delete The system of claim 1, wherein the user-
Only the tag data matched by the voice search is extracted and only the tag data matched by the typing information received from the remote controller is extracted only for the advertisement object referred to by the extracted tag data, Wherein the smart TV is configured to perform an implicit advertisement and an explicit advertisement when implementing a frame-by-frame streaming scheme for the broadcast content.

Images