KR101510747B1 - Smart-TV with motion sensing and logotional advertisement function - Google Patents

Abstract

The present invention relates to a smart TV having a motion sensing and emotional advertising function. The present invention relates to a method and apparatus for receiving broadcast content and an advertisement tag content packetized from a broadcast content server through a broadcast communication network in order to realize broadcast content in a streaming method in units of broadcasting frames, separating the broadcast content and the advertisement tag content, A broadcasting contents processing module for preparing a frame-by-frame streaming method implementation for the broadcasting contents; An implicit advertisement implementation module for implementing an implicit indicator for an advertisement object matching each tag data included in the advertisement tag content until a user's explicit advertisement conversion request is implemented in a frame-by-frame streaming manner to an output unit for the broadcast content; ; And when it is determined that the image information obtained through the camera unit included in the input interface after being converted to the explicit advertisement refers to the selection region for one of the advertisement objects in one motion among the plurality of motion pattern information, A user sensing module for extracting advertisement detailed information included in the tag data for the selected advertisement object and implementing the extracted advertisement detailed information as the selection signal for the selected advertisement object; .

Description

{Smart-TV with motion sensing and logotial advertisement function}

The present invention relates to a smart TV having a motion sensing and emotional advertisement function, and more particularly, to a smart TV having a motion sensing and emotional advertisement function, which maximizes the effect of an advertisement provided by an advertiser, The present invention relates to a smart TV having a motion sensing and emotional advertisement function for providing an emotional advertisement for maximizing user's convenience through selection of an advertisement object using a user's motion pattern.

The main purpose of content or advertising is to increase the effectiveness of broadcasting. Conventionally, a method of separating contents from an advertisement and separately viewing the contents, or a method of exposing an advertisement product to a person or a background in the broadcast contents without knowing whether the advertisement is an advertisement by inserting the advertisement into the contents is mainly used.

However, there has been a problem that it is inconvenient for people who want to watch only contents by separating the contents and the advertisement and providing commercial broadcasting separately.

On the other hand, there is a problem in that a method of exposing an advertisement product to a person or a background in broadcasting contents does not have any targeting effect on the advertisement if the viewer does not know whether the advertisement is an advertisement or is indifferent.

In addition, there has been a problem of inconvenience that a user has to access and select through a plurality of categories when selecting an advertisement.

Accordingly, in order to solve the problems in the related art, not only the effect of the advertisement is maximized, but also the inconvenience in selecting the advertisement for the users who want to view only the broadcast contents, It is required to develop a new technology to solve the problem.

[Related Technical Literature]

1. A smart pad having an advertisement system and an advertising system and method thereof (Patent Application No. 10-2011-0032083)

2. System and method for providing advertisement through a moving picture medium running on a smart device (Patent Application No. 10-2011-0107272)

3. Smart advertising information offer system (Patent Application No. 10-2011-0000401)

SUMMARY OF THE INVENTION The present invention has been made to solve the above-mentioned problems, and it is an object of the present invention to maximize the effect of an advertisement provided by an advertiser, to provide a suggestion directly to a user watching a smart TV, And to provide a smart TV equipped with a motion sensing and emotional advertisement function for maximizing user's convenience through selection of an advertisement object.

In addition, the present invention minimizes the viewing disturbance to the broadcast contents by providing it indirectly and implicitly to the user who watches the smart TV, and enables the detailed advertisement detail information to be provided through explicit advertisement when necessary And to provide a smart TV having motion sensing and emotional advertising functions.

However, the objects of the present invention are not limited to the above-mentioned objects, and other objects not mentioned can be clearly understood by those skilled in the art from the following description.

In order to achieve the above object, a smart TV having a motion sensing and emotional advertisement function according to an embodiment of the present invention is a streaming method in a broadcasting frame unit, A broadcast content processing module for receiving the broadcast content and the advertisement tag content and separating the broadcast content and the advertisement tag content to prepare a frame-by-frame streaming method implementation for the broadcast content; An implicit advertisement implementation module for implementing an implicit indicator for an advertisement object matching each tag data included in the advertisement tag content until a user's explicit advertisement conversion request is implemented in a frame-by-frame streaming manner to an output unit for the broadcast content; ; And when it is determined that the image information obtained through the camera unit included in the input interface after being converted to the explicit advertisement refers to the selection region for one of the advertisement objects in one motion among the plurality of motion pattern information, A user sensing module for extracting advertisement detailed information included in the tag data for the selected advertisement object and implementing the extracted advertisement detailed information as the selection signal for the selected advertisement object; .

In this case, the implicit advertisement implementation module may include an advertisement conversion indicator for explicit advertisement conversion for an advertisement object matched with each tag data included in the advertisement tag content, and an indication indicator for the advertisement object, It is preferable to make the user aware of the streaming method in units of frames to the outputting unit.

In addition, the present invention performs an explicit advertisement according to the implementation of an object markers for an advertisement object matched with each tag data included in a broadcast transmission frame currently being implemented among broadcast contents when the advertisement switching indicator selection signal is received through the input interface An explicit ad implementation module; .

In addition, when receiving a selection signal for one of a plurality of advertisement objects through the input interface during the execution of the explicit advertisement, when the motion gesture input signal is received through the input interface for the selected advertisement object, An advertisement object purchasing module for determining a request and performing a purchase procedure; .

In addition, the user sensing module may implement a one-line advertisement using a plurality of tag data included in the advertisement tag content, using the standby power in a power off state of the smart TV, as the output unit.

The user sensing module, when receiving the one-line advertisement selection signal through the input interface, implements the advertisement detailed information included in the tag data corresponding to the selected one-line advertisement as the output unit, It is preferable to implement a preview screen of the user's appearance through three-dimensional modeling through mapping to the user image information stored in advance in the storage unit with respect to the advertisement object.

The user sensing module may request a coupon for an advertisement object corresponding to the selected one advertisement to the broadcasting contents server through the broadcasting communication network when receiving the SNS publicity selection signal from the input interface .

In addition, the user sensing module may acquire image information through real-time photographing of the user through the camera unit, specify a pixel included in the acquired image information, and determine, based on the pixel information included in the image information, Extracts a motion pattern of a similar range from a plurality of motion pattern information stored in advance in the motion pattern of the similar range, extracts the selected area from the UI screen implemented by the output unit by the three-dimensional perspective method for the motion pattern of the similar range, It is preferable to extract the advertisement detailed information included in the tag data for the selected advertisement object and implement the extracted advertisement detailed information as the output unit.

Preferably, the user sensing module implements a preview of a user's appearance through three-dimensional modeling through mapping to user image information stored in advance in the storage unit for the selected advertisement object.

In addition, the user sensing module requests the coupon for the selected advertisement object to the broadcasting contents server through the broadcasting communication network in response to receiving the SNS publicity selection signal from the input interface, and receives the coupon.

In addition, the broadcast content processing module may be configured to separate the packetized broadcast content and the advertisement tag content, and then read the tag data for each advertisement object included in the separated advertisement tag content, It is desirable to set a position tracking marking for tracking for each advertising object using image information included in the data.

In addition, the position tracking marking for tracking each of the advertisement objects may be implemented when the position on the UI screen of each of the advertisement objects changes in a UI screen of the output unit in units of each broadcast transmission frame on the broadcast content, It is preferable that the real-time change data is generated automatically according to the position change or the stereoscopic view change even if the viewpoint is changed, and the real-time change data is set so as to utilize the real-time change data stored at the time of tracking after being stored in the storage unit.

In addition, the implicit advertisement implementation module may set the implicit effect on the advertisement object with the position tracking marking set, and implement the implicit indicator that reflects the implicit effect on the advertisement object in which the position tracking marking is set to the output section And implementing the tracking effect for the ambiguity indicator for each of the advertisement objects for which the position tracking marking is set when the broadcast content is implemented in a streaming manner in units of broadcasting frames by the output unit.

In addition, the implication effect may include a sub-limit effect for indirectly recognizing a user of the smart TV implicitly before an explicit exposure of the advertisement object in which the position tracking marking is set, when the broadcast content is implemented in a streaming manner (subliminal effect).

In addition, the subliminal effect is performed by inserting an empty-image including only the indictor indicator between broadcasting images including each advertisement object constituting the broadcast transmission frame .

The explicit advertisement implementation module may receive a selection signal for one of the object markers for each of the advertisement objects to implement an advertisement through tag data for the selected advertisement object, It is preferable to implement a tracking effect using object markers for each of the advertisement objects for which the position tracking marking is set.

Preferably, the selection signal for one of the object markers is received by receiving a motion gesture input signal from a remote controller for the object marker via a remote control signal receiving unit or receiving a motion gesture input signal to an input unit.

The smart TV having the motion sensing and emotional advertisement functions according to the embodiment of the present invention maximizes the effect of the advertisement provided by the advertiser and provides the user who views the smart TV directly without being viewed and implicitly However, the present invention provides an advantage of maximizing the convenience of the user by selecting the advertisement object using the user's motion pattern.

In addition, the smart TV having the motion sensing and emotional advertisement function according to another embodiment of the present invention can minimize the inconvenience of viewing, which is a side effect of maximizing the effect of the advertisement provided by the advertiser do.

In addition, a smart TV having a motion sensing and emotional advertisement function according to another embodiment of the present invention can be provided directly and not implicitly to a user viewing a smart TV, thereby minimizing interference with viewing of broadcast content If necessary, it is possible to provide specific advertisement detailed information through explicit advertisement provision.

1 is a diagram illustrating an entire system in which a motion sensing and smart TV-based emotional advertisement method according to an embodiment of the present invention is implemented;
Fig. 2 is a diagram showing a configuration of the smart TV in Fig. 1. Fig.
3 is a conceptual diagram for explaining an implicit advertisement according to an embodiment of the present invention;
4 and 5 are conceptual diagrams for explaining a motion sensing technique according to an embodiment of the present invention.
FIG. 6 is a flowchart illustrating a sensible advertisement method using standby power in a power off state of a smart TV among the motion sensing and smart TV based emotional advertisement methods according to an embodiment of the present invention.
FIG. 7 is a flowchart illustrating a motion sensing process for an advertisement object or a recognition object among the motion sensing and smart TV-based emotional advertisement methods according to the embodiment of the present invention.
FIG. 8 is a general flowchart showing a motion sensing and smart TV-based emotional advertisement method according to an embodiment of the present invention; FIG.
FIG. 9 is a specific flowchart of the steps of the motion sensing and smart TV-based emotional advertisement method of FIG.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, a detailed description of preferred embodiments of the present invention will be given with reference to the accompanying drawings. In the following description of the present invention, detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear.

In the present specification, when any one element 'transmits' data or signals to another element, the element can transmit the data or signal directly to the other element, and through at least one other element Data or signal can be transmitted to another component.

FIG. 1 is a diagram illustrating an entire system in which a motion sensing and smart TV-based emotional advertisement method according to an embodiment of the present invention is implemented. Referring to FIG. 1, a whole system in which a motion sensing and smart TV-based emotional advertisement method is implemented includes a smart TV 10, a remote controller 20, a broadcast communication network 30, a broadcast content server 40, 50, a data communication network 60, an affiliated advertiser terminal group 70, and an SNS server 80.

1, the smart TV 10 is formed as a set-top box separate type having a separate set-top box (STB) and performs data transmission / reception with the broadcast content server 40 through the broadcast communication network 30 Alternatively, it may be formed as a set-top box-integrated type and perform data transmission / reception with the broadcast content server 40 without a separate set-top box (STB).

The broadcast communication network 30 is a high-speed wired or bridged periodic network for broadcasting in the form of a large capacity, a long-distance voice, and a data service, and may be a wired or wireless Internet. The broadcast communication network 30 plays a role for the broadcast content server 40 to transmit the broadcast content to the smart TV 10 and other systems for broadcasting.

The broadcast content server 40 includes a broadcast DB 41 and an advertisement DB 42. Also, in this specification, a DB may mean a functional and structural combination of software and hardware for storing information corresponding to each database. The DB may be implemented as at least one table, and may further include a separate DBMS (Database Management System) for searching, storing, and managing information stored in the database. Also, it can be implemented in various ways such as a linked-list, a tree, and a relational database, and includes all data storage media and data structures capable of storing information corresponding to a database.

The broadcast content server 40 receives the advertisement data through the data communication network 60 from each of the affiliated advertiser terminals constituting the affiliated advertiser terminal group 70 for each of the advertisement objects included in the broadcast content stored in the broadcast DB 41 do. In this case, it is preferable that the advertisement data include image information and advertisement detailed information for each advertisement object, and it is preferable that the advertisement data is received by receiving broadcast data of each broadcast content when the advertisement data is received.

Here, the data communication network 60 may be a high-speed period network of a large communication network capable of a large-capacity, long-distance voice and data service, and may be a next generation wired and wireless network for providing Internet or high-speed multimedia service. When the data communication network 60 is a mobile communication network, it may be a synchronous mobile communication network or an asynchronous mobile communication network. As an embodiment of the asynchronous mobile communication network, a WCDMA (Wideband Code Division Multiple Access) communication network is exemplified. In this case, although not shown in the drawing, the data communication network 60 may include a Radio Network Controller (RNC). Meanwhile, although the WCDMA network is exemplified, it may be a next generation communication network such as a 3G LTE network or a 4G network, or an IP network based on other IP. The data communication network 60 serves to transmit signals and data between the broadcasting contents server 40, a plurality of advertiser terminal units constituting the advertiser terminal group 70, and other systems.

On the other hand, the broadcast content server 40 generates tag data for each of the advertisement objects, and then all the generated tag data are numbered and stored in the advertisement DB 42 as advertisement tag contents. Meanwhile, in an embodiment of the present invention, the broadcast content server 40 preferably includes image information and advertisement detail information for use in object recognition for each advertisement object received at the time of generating each tag data, It is preferable that the advertisement DB 42 divides the broadcasting contents into broadcasting transmission frames and stores the metadata together with the respective advertisement tag contents when the advertisement contents are stored.

The broadcast content server 40 transmits the broadcast content stored in the broadcast DB 41 and the advertisement DB 42 in response to a request for listening to the broadcast content stored in the broadcast DB 41 of the smart TV 10 through the broadcast communication network 30. [ And transmits the packetized advertisement tag contents to the smart TV 10 through the broadcast communication network 30 (S13).

The smart mobile device 50 is provided for confirming detailed information on the advertisement object based on the touch screen when the user of the smart TV 10 wants detailed information on the advertisement object according to the explicit advertisement implementation after the implicit advertisement implementation do.

Fig. 2 is a diagram showing a configuration of the smart TV 10 in Fig. 3 is a conceptual diagram for explaining an implicit advertisement according to an embodiment of the present invention. 4 and 5 are conceptual diagrams illustrating a motion sensing technique according to an embodiment of the present invention. 2, the smart TV 10 includes an output unit 11, a sensing unit 12, an input interface 13, a control operation unit 14, a storage unit 15, and a wired / wireless communication module 16, .

The input interface 13 includes an input unit 13a, a remote control signal receiving unit 13b, and a camera unit 13c. The control operation unit 14 includes a broadcast content processing module 14a, an implicit advertisement implementation module 14b, an explicit advertisement implementation module 14c, an advertisement object purchase module 14d and a user sensing module 14e do. Herein, a module may mean a functional and structural combination of hardware for carrying out the technical idea of the present invention and software for driving the hardware. For example, the module may mean a logical unit of a predetermined code and a hardware resource for executing the predetermined code, and it does not necessarily mean a physically connected code or a kind of hardware. Can be easily deduced to the average expert in the field of < / RTI >

Hereinafter, the entire system in which the Smart TV-based emotional advertisement method is implemented will be described in detail, focusing on the configuration of the control operation unit 14. [ The broadcast content processing module 14a controls the wired / wireless communication module 16 to receive the packetized broadcast content and the advertisement tag content from the broadcast content server 40 through the broadcast communication network 30 in a streaming manner for each broadcast transmission frame , And receives broadcasting contents and advertisement tag contents packetized in units of broadcast transmission frames. The broadcast content processing module 14a separates the broadcast content and the advertisement tag content from the packet in the broadcast transmission frame unit, and then prepares for implementation of the broadcast content in the output unit 11 in a frame-by-frame streaming manner.

More specifically, the broadcast content processing module 14a receives the broadcast content stored in the broadcast DB 41 of the smart TV 10 from the broadcast content server 40 through the broadcast communication network 30, And controls the module 16. The broadcast content processing module 14a transmits the broadcast content stored in the broadcast DB 41 of the broadcast content server 40 and the advertisement tag content stored in the advertisement DB 42 of the broadcast content server 40 to the broadcast transmission frame And controls the wired / wireless communication module 16 to receive from the broadcasting contents server 40 through the broadcasting communication network 30 in a packetized state.

The broadcast content processing module 14a separates the packetized broadcast content and the advertisement tag content received from the broadcast content server 40 in a streaming manner on a broadcast broadcast frame basis, Reads the tag data for each advertisement object, and stores the tag data in the storage unit 15.

The broadcast content processing module 14a sets the location tracking marking for tracking for each advertisement object using the image information included in the tag data for each of the read advertisement objects. Here, the position tracking marking serves as a marker for tracking each advertisement object in the implementation of the advertisement object to the output unit 11 according to each broadcast transmission frame on the advertisement content. More specifically, even if the position of each of the advertisement objects is changed or the stereoscopic view is changed on the broadcast content according to the setting of the position tracking marking, the realtime change data due to the position change or stereoscopic view change is automatically generated by the broadcast content processing module 14a And is stored in the storage unit 15 so that the position of the advertisement object on the UI screen realized on the output unit 11 is automatically tracked by using the stored real-time change data when tracking the advertisement object.

The broadcast content processing module 14a may further perform object recognition for automatically performing recognition of an object other than the advertisement object in broadcast contents of each broadcast transmission frame in an additional process.

That is, the broadcast content processing module 14a performs object recognition for an object that is not read as tag data for each advertisement object of the advertisement tag content received in a streaming manner for each broadcast transmission frame. It is preferable that the broadcast content processing module 14a individually performs recognition of each of the stereoscopic viewpoints at the time of object recognition for each recognition object.

The broadcast content processing module 14a transmits a query message to the broadcast content server 40 through the broadcast communication network 30 for the recognized object, and when there is additional tag data for the object to be recognized, And controls the communication module 16. The broadcast content processing module 14a performs object recognition on the image information of the broadcast content for each recognition object and sets a position tracking marking for tracking on the recognition object. Here, the position tracking marking for tracking each recognition object is implemented by UI screen of the output unit 11 for each broadcast transmission frame on the broadcast content, when the position on the UI screen of each recognition object is changed or the stereoscopic view is changed The real time change data corresponding to the change of the position of each recognition object or the change of the stereoscopic view is automatically generated by the broadcast content processing module 14a and stored in the storage unit 15 of the smart TV, And is set so that the stored real-time change data is used to automatically track the position of the recognition object on the UI screen implemented on the output unit 11. [

The broadcast content processing module 14a implements the advertisement conversion indicator in the output unit 11 and receives the streaming method in units of broadcasting frames to start outputting the broadcasting contents in the buffering state on the storage unit 15 .

The implicit advertisement implementing module 14b implements the advertisement conversion indicator in the output unit 11 according to the start of outputting the broadcast content of the broadcast content processing module 14a, And implements an implicit indicator for each advertising object in which the implicit effect is reflected.

More specifically, the implicit advertisement implementation module 14b establishes an implicit effect on the recognized object to which the position tracking marking is set, the advertisement object to which the position tracking marking is set. Here, the implicit effect implies a user interface effect for indirectly recognizing the broadcast contents in the streaming manner implicitly to the user of the smart TV 10 before the explicit exposure of the advertisement object and the recognition object .

In an embodiment of the present invention, a subliminal effect may be used as an implicit effect, and a subliminal effect may be one of a plurality of broadcast images including an advertisement object constituting a broadcast transmission frame And inserting an empty-image containing only an implicit indicator (see FIG. 3).

As shown in FIG. 3, the color change setting for a skirt and the backlight setting for a shoe can be an example of an advertisement object or a recognition object in an empty image for a subliminal effect. Another example is the adver, status bar, icon, and border color settings for an object or a recognized object.

The implicit advertisement implementing module 14b implements an implicit indicator according to the setting of the implicit effect for the advertisement object and the recognition object together with the broadcasting contents for each broadcasting transmission frame to the output unit 11. [ As described above, the hint indicator can be implemented as a color change, an halo, an ad bar, a status bar, an icon, and a border color for an advertisement object or a recognition object.

The implicit advertisement implementing module 14b implements the tracking effect on the advertising object or the implicit indicator for each recognition object according to the time flow for the broadcasting contents for each broadcasting transmission frame to the output unit 11. [ Here, the tracking effect means to implement the position or shape of the indictor according to the object recognition for the object to be marked with the position tracking marking and the object to be recognized with the position tracking marking.

The implicit advertisement implementation module 14b waits for the advertisement switching indicator selection signal from the input interface 13 for explicit advertisement switching and then determines whether or not to receive the advertisement switching indicator selection signal and transmits the advertisement switching indicator selection signal to the explicit advertisement implementation module 14c to terminate the implicit ad output process.

The explicit advertisement implementing module 14c receives the advertisement switching indicator selection signal through the input interface 13 and displays the object corresponding to the advertisement object for the advertisement object matched with the tag data included in the currently broadcast broadcasting frame, (See A1 and A2 in Fig. 4).

More specifically, the explicit advertisement implementing module 14c sends the advertisement switching indicator selection signal to the output unit 11 when the advertisement switching indicator selection signal is received by the implicit advertisement implementing module 14b, An object marker is implemented for the object and the recognition object, and the advertisement is implemented through the tag data for the advertisement object or the recognition object selected when the object marker is selected.

On the other hand, when the explicit advertisement implementing module 14c receives a selection input for one of the object markers, the explicit advertisement implementing module 14c generates a selection mark in accordance with the recognition data previously stored in the storage unit 15 through the sensing unit 12 . As one example, when the sensing unit 12 is implemented as a recognition module of a camera photographing system, a recognition signal may be recognized as a selection signal at a place where a user's eyes are frequently seen as a result of eye recognition through a camera photographing, And recognizing an object marker corresponding to the advertisement object matching the interest category information stored on the storage unit 15 with respect to the user.

The explicit advertisement implementing module 14c implements a tracking effect using an object marker according to an advertisement object or an object marker according to a flow of broadcast contents for each broadcasting frame to the output unit 11. [ Here, the tracking effect means to convert the position of the object marker according to the object recognition for the object to be marked with the position tracking marking and the object to be recognized with the position tracking marking.

The explicit advertisement implementing module 14c waits for receiving a selection signal for a plurality of advertisement objects and a plurality of recognition objects from the input interface 13. [

The explicit advertisement implementation module 14c notifies the advertisement object purchase module 14d of the determination result through determination of whether or not the selection signal is received for one of a plurality of advertisement objects and a plurality of recognition objects, Complete.

As a result of the explicit advertisement implementation module 14c, when the advertisement selection module 14d receives the selection signal for one of the plurality of advertisement objects through the input interface 13 in the process of performing the explicit advertisement, When the motion gesture input signal through the input interface 13 is received, it is determined that the purchase request is made and the purchase procedure is performed.

More specifically, the advertisement purchase module 14d receives a motion gesture input signal from the remote controller 20 for a selected advertisement object or a recognized object, in response to a selection signal for one of a plurality of advertisement objects and a plurality of objects to be recognized, And receives a motion gesture input signal through the input unit 13a or receives a motion gesture input signal to the input unit 13a, and recognizes the received target object as a purchase request for a recognized object or a recognition target object.

The user sensing module 14e includes a waiting advertisement means 14e-1 and a motion advertisement means 14e-2. First, the waiting advertisement means 14e-1 executes the broadcasting contents by the broadcast content processing module 14a and outputs the broadcasting contents to the output unit 11 in a streaming manner in units of broadcasting frames And operates on the premise that the power is off.

The standby advertisement unit 14e-1 implements a one-line advertisement using a plurality of tag data included in the advertisement tag content in the output unit 11 by using the standby power in the power off state.

The waiting advertisement unit 14e-1 receives a one-line advertisement selection signal from the input unit 13a of the input interface 13 by the user or receives an advertisement selection signal from the remote controller 20 through the remote control signal receiving unit 13b , The detailed information of the advertisement included in the tag data corresponding to the selected one-line advertisement is implemented in the output unit 11.

The waiting advertisement unit 14e-1 displays a user preview screen through three-dimensional modeling through mapping to the user image information stored in the storage unit 15 for the advertisement object corresponding to the selected one-line advertisement to the output unit 11 ).

The waiting advertisement means 14e-1 waits for reception of the SNS PR selection signal from the input unit 13a or the remote control signal receiving unit 13b of the input interface 13.

The waiting advertisement unit 14e-1 controls the wired / wireless communication module 16 to request and receive the coupon for the selected advertisement object from the broadcasting contents server 40 through the broadcasting communication network 30 when the SNS publicity selection signal is received So that the coupon received at the time of purchase for the selected advertisement object can be used. Meanwhile, the waiting advertisement unit 14e-1 controls the wired / wireless communication module 16 to register the preview screen information of the user's appearance through three-dimensional modeling into the user account of the SNS server 80 through the data communication network 60 .

On the other hand, the waiting advertisement means 14e-1 has been described with reference to the advertisement object for convenience of explanation, but the same applies to the object to be recognized.

Next, the motion advertisement means 14e-2 transmits an explicit advertisement to the output unit 11 by the implicit advertisement implementing module 14b in a state in which an implicit advertisement using the implied indicator for the advertised object and the recognized object is performed. Module 14c to an explicit advertisement using an object marker, and then operates on the assumption that it waits to receive a selection signal for one of a plurality of advertising objects and a plurality of recognition objects from the input interface 13.

First, the motion advertisement means 14e-2 acquires image information through real-time shooting of the user through the camera unit 13c of the input interface 13.

The motion advertisement means 14e-2 specifies the pixels included in the acquired image information. Here, the specification of the pixels included in the image information means extracting the characteristics of the pixels from the lightness and darkness of the pixels, the colors of the pixels, the lines formed by the pixels, and the shapes in which the pixels change with the passage of time.

The motion advertisement means 14e-2 extracts motion patterns of a similar range from the plurality of motion pattern information stored in the storage unit 15 according to the pixels included in the image information. Here, if there are a plurality of motion patterns in the similar range, only the closest motion pattern is extracted. Here, the motion pattern information may include motion pattern information that is hand-held in the direction in which the advertisement object or the recognition object is implemented, a pattern pointed by the foot or the finger, and motion pattern information that recognizes enlargement of the user's pupil. It is possible to expand the fingerprint recognition pattern information through the fingerprint sensor attached to the remote controller 20. Meanwhile, FIG. 4 is an example showing a pattern pointed by using the toe in the state of explicit advertisement implementation. 5 is a diagram illustrating that an advertisement object or a recognition object can be selected using a motion pattern indicated by an implied indicator in an implicit advertisement implementation state.

Various motion pattern information is stored in the storage unit 15 for extracting motion patterns. Various motion pattern information includes various motion pattern information, a skew of various motion patterns, a reversed one, And the like.

The motion advertisement means 14e-2 extracts the selected region from the UI screen implemented by the output unit 11 by the three-dimensional perspective method for the motion pattern of the similar range.

The motion advertisement means 14e-2 determines the selection signal for the advertisement object or the recognition object corresponding to the extracted selection region.

The motion advertisement means 14e-2 extracts the advertisement detailed information included in the tag data for the selected advertisement object or the recognition object and implements the extracted advertisement detailed information in the output unit 11. [

The motion advertisement means 14e-2 implements the preview of the user's appearance through the three-dimensional modeling through mapping to the user image information stored in the storage unit 15 for the selected advertisement object or the recognition object in the output unit 11 do.

The motion advertisement means 14e-2 waits for reception of the SNS PR selection signal from the input unit 13a or the remote control signal receiving unit 13b among the input interface 13.

The motion advertisement means 14e-2 controls the wired / wireless communication module 16 to request and receive the coupon for the selected advertisement object from the broadcasting contents server 40 through the broadcasting communication network 30 when the SNS publicity selection signal is received Thereby making it possible to use the received coupon when purchasing the selected advertisement object. Meanwhile, the motion advertisement unit 14e-2 controls the wired / wireless communication module 16 to register the user's preview screen information through the three-dimensional modeling in the user account of the SNS server 80 through the data communication network 60 .

FIG. 6 is a flowchart illustrating a sensibility advertisement method using standby power in the power off state of the smart TV 10 among the sensory advertisement methods based on motion sensing and smart TV according to the embodiment of the present invention. 1 to 6, the smart TV 10 receives broadcasting contents and advertisement tag contents packetized from the broadcasting contents server 40 through the broadcasting communication network 30 in a streaming manner for each broadcasting transmission frame, It is assumed that the power is turned off in a state in which the broadcasting contents are separated into an output unit 11 in a streaming manner in units of broadcasting frames for broadcasting contents.

The smart TV 10 implements a one-line advertisement using a plurality of tag data included in the advertisement tag content in the output unit 11 by using standby power in a power off state (S1).

After step S1, the smart TV 10 receives a one-line advertisement selection signal from the input unit 13a of the input interface 13 by the user or selects an advertisement from the remote controller 20 through the remote control signal receiver 13b Upon receipt of the signal, the output unit 11 implements the advertisement detail information included in the tag data corresponding to the selected one-line advertisement (S2).

After step S3, the smart TV 10 displays a preview screen of the user's appearance through three-dimensional modeling through mapping to user image information stored in the storage unit 15 for the advertisement object corresponding to the selected one-line advertisement (Step S3).

After step S3, the smart TV 10 waits to receive the SNS PR selection signal from the input unit 13a or the remote control signal receiver 13b of the input interface 13 (S4).

After step S4, the smart TV 10 determines whether the SNS PR selection signal has been received (S5).

If the SNS publicity selection signal is received in step S5, the smart TV S10 requests the broadcast content server 40 via the broadcast communication network 30 for a coupon for the selected advertisement object, You can use the received coupon when making a purchase for the selected advertising object.

Meanwhile, although FIG. 6 has been described with reference to an advertisement object for convenience of explanation, the same is applied to an object to be recognized.

FIG. 7 is a flowchart illustrating a motion sensing process for an advertisement object or a recognition object among the motion sensing and smart TV-based emotional advertisement methods according to an exemplary embodiment of the present invention. Referring to FIGS. 1 to 7, in the motion sensing process according to FIG. 7, the smart TV 10 displays an advertisement in an implicit advertisement using an indication indicator for an advertisement object and a recognition target, After switching to an explicit advertisement using a marker, it is assumed that a selection signal is awaited from a plurality of advertisement objects and a plurality of recognition objects from the input interface 13.

First, the smart TV 10 acquires image information through real-time shooting of the user through the camera unit 13c of the input interface 13 (S34a).

After step S34a, the smart TV 10 specifies pixels included in the image information acquired in step S34a (S34b). Here, the specification of the pixels included in the image information means extracting the characteristics of the pixels from the lightness and darkness of the pixels, the colors of the pixels, the lines formed by the pixels, and the shapes in which the pixels change with the passage of time.

After step S34b, the smart TV 10 extracts a similar range of motion patterns from the plurality of motion pattern information stored in the storage unit 15 according to the pixels included in the image information (S34c). Here, if there are a plurality of motion patterns in the similar range, only the closest motion pattern is extracted. The motion pattern information may include motion pattern information, a pattern pointed by a foot or a finger, and motion pattern information for recognizing enlargement of the user's pupil, in a direction in which the advertisement object or the recognition object is implemented by hand. It is possible to expand the fingerprint recognition pattern information through the fingerprint sensor attached to the remote controller 20.

Various motion pattern information is stored in the storage unit 15 for extracting motion patterns. Various motion pattern information includes various motion pattern information, a skew of various motion patterns, a reversed one, And the like.

After step S34c, the smart TV 10 extracts the selected area from the UI screen implemented by the output unit 11 by the three-dimensional perspective method for the motion pattern of the similar range (S34d).

After step S34d, the smart TV 10 judges it as a selection signal for the advertisement object or the recognition object corresponding to the extracted selection area (S34e).

After step S34e, the smart TV 10 extracts the advertisement detailed information included in the tag data for the advertisement object or the object selected in step S34e and implements the detailed information in the output unit 11 (S34f).

After step S34f, the smart TV 10 displays a preview screen of the user's appearance through three-dimensional modeling through mapping to the user image information stored in advance in the storage unit 15 for the selected advertisement object or the recognized object, ) (S34g).

After step S34g, the smart TV 10 waits for reception of the SNS PR selection signal from the input unit 13a or the remote control signal receiving unit 13b of the input interface 13 (S34h).

After step S34h, the smart TV 10 determines whether the SNS PR selection signal has been received (S34i).

When the SNS publicity selection signal is received as a result of the determination in step S34i, the smart TV S10 requests the broadcast content server 40 through the broadcast communication network 30 to receive the coupon for the selected advertisement object (S34j) So that the received coupon can be used when purchasing the selected advertising object.

8 is a general flowchart illustrating a motion sensing and smart TV-based emotional advertisement method according to an embodiment of the present invention. 1 to 8, the smart TV 10 receives packetized broadcast content and advertisement tag content from the broadcast content server 40 through the broadcast communication network 30 in a streaming manner for each broadcast transmission frame, And the advertisement tag content, and prepares for implementation of the streaming method in the output unit 11 in units of broadcasting frames for broadcasting contents (S10).

Here, the broadcast communication network 30 is a high-speed wired or bridged termi- nal network for broadcasting in the form of a large capacity, a long-distance voice, and a data service, and may be a wired or wireless Internet. The broadcast communication network 30 plays a role for the broadcast content server 40 to transmit the broadcast content to the smart TV 10 and other systems for broadcasting.

On the other hand, the broadcast content server 40 includes a broadcast DB 41 and an advertisement DB 42. Also, in this specification, a DB may mean a functional and structural combination of software and hardware for storing information corresponding to each database. The DB may be implemented as at least one table, and may further include a separate DBMS (Database Management System) for searching, storing, and managing information stored in the database. Also, it can be implemented in various ways such as a linked-list, a tree, and a relational database, and includes all data storage media and data structures capable of storing information corresponding to a database.

After step S10, the smart TV 10 is an implicit advertisement outputting process. The smart TV 10 is implemented in accordance with the temporal flow of the broadcasting contents to the output unit 11 for each broadcast broadcasting frame, and the advertisement switching indicator and the indication indicators (S20).

If a state in which the power of the smart TV 10 is turned off is set between the step S10 and the step S20, a one-line advertisement for the advertisement object using the standby power described in Fig. 6 can be performed .

 After step S20, the smart TV 10 receives the advertisement switching indicator selection signal through the input interface 13, and performs the flow of the broadcasting contents to the output unit 11 according to the temporal flow, An explicit advertisement according to the implementation of the object markers for the advertisement object is performed in the separated advertisement tag contents according to the process of S30.

After receiving the selection signal for one of the plurality of advertisement objects through the input interface 13 in the process of performing the explicit advertisement by the step S30 after the step S30, When a motion gesture input signal through the input interface 13 is received, it is determined that the purchase request is made and a purchase procedure is performed (S40).

FIG. 9 is a specific flowchart of steps (S10) to (S40) of the motion sensing and smart TV-based emotional advertisement method of FIG.

1 to 9, the broadcast content server 40 transmits the broadcast content stored in the broadcast DB 41 to each of the affiliated advertiser terminal units 70 constituting the affiliated advertiser terminal group 70 for each of the advertisement objects included in the broadcast content, (Step S11). Here, the data communication network 60 may be a high-speed period network of a large communication network capable of a large-capacity, long-distance voice and data service, and may be a next generation wired and wireless network for providing Internet or high-speed multimedia service. When the data communication network 60 is a mobile communication network, it may be a synchronous mobile communication network or an asynchronous mobile communication network. As an embodiment of the asynchronous mobile communication network, a WCDMA (Wideband Code Division Multiple Access) communication network is exemplified. In this case, although not shown in the drawing, the data communication network 60 may include a Radio Network Controller (RNC). Meanwhile, although the WCDMA network is exemplified, it may be a next generation communication network such as a 3G LTE network or a 4G network, or an IP network based on other IP. The data communication network 60 serves to transmit signals and data between the broadcasting contents server 40, a plurality of advertiser terminal units constituting the advertiser terminal group 70, and other systems.

It is preferable that the advertisement data include image information for each advertisement object, and it is preferable that the advertisement data is received by receiving broadcast data of each broadcast content when the advertisement data is received. Also, in this specification, a DB may mean a functional and structural combination of software and hardware for storing information corresponding to each database. The DB may be implemented as at least one table, and may further include a separate DBMS (Database Management System) for searching, storing, and managing information stored in the database. Also, it can be implemented in various ways such as a linked-list, a tree, and a relational database, and includes all data storage media and data structures capable of storing information corresponding to a database.

The broadcast content server 40 generates tag data for each of the advertisement objects, and then all the generated tag data is numbered and stored in the advertisement DB 42 as advertisement tag contents (S12). Meanwhile, in one embodiment of the present invention, the broadcast content server 40 preferably includes image information for use in object recognition for each advertisement object received in step S11 when each tag data is generated And the advertisement DB 42, it is preferable to generate meta data according to the broadcasting broadcasting frames of the broadcasting contents and to store the metadata together with the respective advertisement tag contents.

After the step S12, the broadcast content server 40 transmits the broadcast content 41 stored in the broadcast DB 41 in response to a request for listening to the broadcast content stored in the broadcast DB 41 of the smart TV 10 through the broadcast communication network 30, And the advertisement DB contents stored in the advertisement DB 42 are packetized for each broadcasting transmission frame and transmitted to the smart TV 10 through the broadcasting communication network 30 (S13).

In step S13, the smart TV 10 separates the packetized broadcast content received from the broadcast content server 40 in a streaming manner for each broadcast transmission frame and the advertisement tag content, Tag data per object is read (S14).

After step S14, the smart TV 10 sets up a position tracking marking for tracking for each advertisement object using the image information included in the tag data for each advertisement object read in step S14 (S15). Here, the position tracking marking serves as a marker for tracking each advertisement object in the implementation of the advertisement object to the output unit 11 according to each broadcasting transmission frame on the advertisement content. More specifically, even if the position of each of the advertisement objects is changed or the stereoscopic view is changed on the broadcast content in accordance with the setting of the position tracking marking in step S15, the real time change data according to the position change or stereoscopic view change is automatically transmitted to the smart TV 10 And stored in the storage unit 15 so that the position of the advertisement object on the UI screen realized on the output unit 11 is automatically tracked by utilizing the stored real time change data at the time of tracking for the advertisement object .

On the other hand, after step S15, the smart TV 10 may further perform step S16, which is an object recognition process of automatically recognizing an object other than the advertisement object in the broadcast content as an additional process. It is preferable that the smart TV 10 individually performs recognition of each of the stereoscopic viewpoints at the time of object recognition for each recognition object.

In step S16, in step S14, the smart TV 10 performs object recognition for an object that is not read as tag data for each advertisement object of the advertisement tag content received in a streaming manner for each broadcasting frame in step S14 S16a). After step S16a, the smart TV 10 transmits additional tag data for the recognition object in accordance with the transmission of the query message to the broadcast content server 40 through the broadcast communication network 30 for the recognition object recognized in step S16a And further receives (S16b). After step S16b, the smart TV 10 performs object recognition on the image information of the broadcast content for each recognition object and sets a position tracking marking for tracking on the recognition object (S16c).

Here, the position tracking marking for tracking each recognition object is implemented by UI screen of the output unit 11 for each broadcast transmission frame on the broadcast content, when the position on the UI screen of each recognition object is changed or the stereoscopic view is changed The real time change data according to the position change of each recognition object or the change of the stereoscopic view is automatically generated by the smart TV 10 and stored in the storage unit 15 of the smart TV, Change data is utilized so that the position of the recognition object on the UI screen implemented on the output unit 11 is automatically tracked.

After step S15 or step S16, the smart TV 10 implements the advertisement conversion indicator in the output unit 11 and prepares to start outputting the broadcast content for each broadcasting frame in a streaming manner (S17 ), The broadcast content preparation process for each broadcast transmission frame in step S10 is completed.

When the power of the smart TV 10 is turned off between the step S17 and a step S21 to be described later, the advertisement object using the standby power and the one-line advertisement Can be performed.

After performing the step S10 according to the steps S11 to S17, the smart TV 10 displays the advertisement object with the position tracking marking set in step S15, and the recognition object with the position tracking marking set in step S16c Lt; RTI ID = 0.0 > (S21). ≪ / RTI > Here, the implicit effect implies a user interface effect for indirectly recognizing the broadcast contents in the streaming manner implicitly to the user of the smart TV 10 before the explicit exposure of the advertisement object and the recognition object .

In the embodiment of the present invention, a subliminal effect may be used as an implicit effect, and a subliminal effect may include an indication indicator (not shown) between broadcast images including an advertisement object constituting a broadcast transmission frame (See FIG. 3). In this case, as shown in FIG.

As shown in FIG. 3, the color change setting for a skirt and the backlight setting for a shoe can be an example of an advertisement object or a recognition object in an empty image for a subliminal effect. Another example is the adver, status bar, icon, and border color settings for an object or a recognized object.

After step S21, the smart TV 10 implements an implied indicator reflecting the implicit effect of the advertisement object and the recognition object together with the broadcasting contents for each broadcasting transmission frame to the output unit 11 (S22). As described above, the hint indicator can be implemented as a color change, an halo, an ad bar, a status bar, an icon, and a border color for an advertisement object or a recognition object.

After step S22, the smart TV 10 implements the tracking effect for the advertisement indicator for each advertisement object or the recognition object according to the flow of time with respect to the broadcasting contents for each broadcast transmission frame to the output unit 11 (S23) . Here, the tracking effect is implemented by transforming the location or shape of the indictor according to the object recognition for the object to be marked with the position tracking marking in step S15 and the object to be recognized with the position tracking marking in step S16c .

After step S23, the smart TV 10 waits for the advertisement switching indicator selection signal from the input interface 13 for explicit advertisement switching (S24), and judges whether or not to receive the advertisement switching indicator selection signal (S25), and ends the implicit advertisement output process.

If the advertisement switching indicator selection signal is received in step S25, the Smart TV 10 implements the object marker for the advertisement object and the recognition object along with the broadcasting contents for each broadcasting frame to the output unit 11, When the marker is selected, the advertisement is implemented through the tag data of the selected advertisement object or the recognition object (S31).

On the other hand, when the smart TV 10 receives a selection input for one of the object markers, the smart TV 10 can be performed in a manner corresponding to recognition data previously stored in the storage unit 15 via the sensing unit 12 have. As one example, when the sensing unit 12 is implemented as a recognition module of a camera photographing system, a recognition signal may be recognized as a selection signal at a place where a user's eyes are frequently seen as a result of eye recognition through a camera photographing, And recognizing an object marker corresponding to the advertisement object matching the interest category information stored on the storage unit 15 with respect to the user.

After step S31, the smart TV 10 implements the tracking effect using the object markers for each advertisement object or the recognition object according to the flow of the broadcasting contents for each broadcasting frame to the output unit 11 (S32). Here, the tracking effect is implemented by transforming the position of the object marker according to the object recognition for the object to be marked with the position tracking marking in step S15 and the object to be recognized with the position tracking marking in step S16c.

After step S32, the smart TV 10 waits for a selection signal for one of a plurality of advertisement objects and a plurality of recognition objects from the input interface 13 (S33).

After step S33, the smart TV 10 determines whether to receive a selection signal for one of a plurality of advertisement objects and a plurality of recognition objects (S34), and completes execution of the explicit advertisement. On the other hand, when the selection signal is received for one of the advertisement object and the recognition object in step S34, it is preferably performed through the motion sensing process in FIG.

As a result of the determination in step S34, upon receipt of a selection signal for one of a plurality of advertisement objects and a plurality of recognition objects, the Smart TV 10 performs a purchase procedure through a motion gesture on the advertisement object or the recognition object selected in step S34 (S40).

More specifically, the smart TV 10 receives the motion gesture input signal from the remote controller 20 for the selected advertisement object or the recognition object through the remote control signal receiving unit 13b or receives the motion gesture input signal to the input unit 13a And recognizes it as a purchase request for a selected advertisement object or a recognition object at the time of inputting a motion gesture, and performs a purchase process.

The present invention can also be embodied as computer-readable codes on a computer-readable recording medium. A computer-readable recording medium includes all kinds of recording apparatuses in which data that can be read by a computer system is stored.

Examples of the computer-readable recording medium include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device and the like, and also implemented in the form of a carrier wave (for example, transmission over the Internet) .

The computer readable recording medium may also be distributed over a networked computer system so that computer readable code can be stored and executed in a distributed manner. And functional programs, codes, and code segments for implementing the present invention can be easily inferred by programmers skilled in the art to which the present invention pertains.

As described above, preferred embodiments of the present invention have been disclosed in the present specification and drawings, and although specific terms have been used, they have been used only in a general sense to easily describe the technical contents of the present invention and to facilitate understanding of the invention , And are not intended to limit the scope of the present invention. It is to be understood by those skilled in the art that other modifications based on the technical idea of the present invention are possible in addition to the embodiments disclosed herein.

10: Smart TV
11: Output section
12: sensing unit
13: Input Interface
13a:
13b: Remote control signal receiving section
13c:
14:
14a: broadcast content processing module
14b: Implicit ad implementation module
14c: Explicit ad implementation module
14d: Advertisement object purchase module
14e: User Sensing Module
14e-1: Standby advertising means
14e-2: Motion advertisement means
15:
16: Wired / wireless communication module
STB: Set-top box
20: Remote control
30: Broadcasting network
40: broadcast content server
50: Smart mobile devices
60: Data communication network
70: Associated advertiser terminal group
80: SNS server

Claims (17)

A broadcast content processing module for preparing a frame-by-frame streaming scheme for the broadcast content by separating the broadcast content and the advertisement tag content;
An implicit advertisement implementation module for implementing an implicit indicator for an advertisement object matched with each tag data included in the advertisement tag content in a streaming manner; And
A user sensing module for implementing a one-line advertisement using a plurality of tag data included in the advertisement tag contents as an output unit by using standby power in a power OFF state of the smart TV; And a smart TV having a motion sensing and emotional advertisement function.
The method of claim 1,
An advertisement switching indicator for explicit advertisement switching of an advertisement object matched with each tag data included in the advertisement tag content, and an indication indicator for each of the advertisement objects, And a smart TV having a motion sensing and emotional advertisement function.
The method of claim 2,
An explicit advertisement implementation module for performing an explicit advertisement according to an object marker implementation for an advertisement object matched with each tag data included in a broadcasting frame currently being implemented among broadcast contents when receiving an advertisement conversion indicator selection signal through an input interface; And a smart TV having a motion sensing and emotional advertisement function.
The method of claim 3,
When receiving a selection signal for one of a plurality of advertisement objects through the input interface, when the motion gesture input signal is received through the input interface for the selected advertisement object, An advertisement target purchase module for performing a procedure; And a smart TV having a motion sensing and emotional advertisement function.
delete 5. The apparatus of claim 4,
When the one-line advertisement selection signal is received through the input interface, the output unit may implement the advertisement detailed information included in the tag data corresponding to the selected one-line advertisement, and the advertisement object corresponding to the selected one- And a preview screen of a user's appearance through three-dimensional modeling through mapping to pre-stored user image information is implemented as the output unit.
7. The apparatus of claim 6,
When receiving the SNS publicity selection signal from the input interface, requests coupons for the advertisement object corresponding to the selected advertisement to the broadcasting contents server through the broadcasting communication network and receives the coupon from the broadcasting contents server One Smart TV.
The system of claim 1, wherein the user sensing module comprises:
And acquires image information through real-time photographing of the user through the camera unit, specifies pixels included in the acquired image information,
A motion pattern of a similar range is extracted from a plurality of motion pattern information stored in advance in the storage unit according to the pixel specification included in the image information, and the motion pattern of the similar range is extracted from the UI screen implemented by the output unit by the three- The selected area is extracted,
Extracting advertisement detail information included in the tag data for the selected advertisement object by determining the selection signal for the advertisement object corresponding to the extracted selection area, and implementing the extracted advertisement detailed information as the output unit Smart TV.
The system of claim 8,
Wherein the output unit is implemented with a preview screen of a user's appearance through three-dimensional modeling through mapping to user image information stored in advance in the storage unit with respect to a selected advertisement object.
[12] The method of claim 9,
Wherein the smart TV requests and receives a coupon for the selected advertisement object from the input interface through the broadcast communication network in response to the reception of the SNS publicity selection signal from the input interface.
The broadcast content processing module according to claim 10,
The method comprising the steps of: dividing the packetized broadcast content and the advertisement tag content, and reading the tag data for each advertisement object included in the separated advertisement tag content, using the image information included in the tag data for each advertisement object; And setting a location tracking marking for tracking of an advertisement object.
12. The method of claim 11, wherein the location tracking marking for tracking for each advertised object comprises:
When the position on the UI screen of each of the advertisement objects is changed or the stereoscopic view is changed in the UI screen of the output unit in units of each broadcast transmission frame on the broadcast content, Wherein the real-time change data is set so as to utilize the real-time change data stored at the time of tracking after the real-time change data is generated and stored in the storage unit.
delete delete delete delete delete

Images