KR20140075655A - Method for providing logotional advertisement using object recognition based on smart-TV - Google Patents

Abstract

The present invention relates to a method for providing an emotional advertisement using object recognition based on a smart TV. The method for providing an emotional advertisement using object recognition based on a smart TV includes a first step of receiving packaged broadcasting content and advertisement tag content from a broadcasting content server through a broadcasting communication network to separate the broadcasting content from the advertisement tag content in order to implement the broadcasting content through a streaming scheme in units of broadcasting transmission frames by a smart TV; a second step of preparing the implementation of the streaming scheme in units of broadcasting transmission frames with respect to the broadcasting content for at least one recognition object by recognizing each object which is not read as tag data for advertisement objects constituting the advertisement tag content by the smart TV; and a third step of allowing a user to recognize an advertisement switch indicator for explicit advertisement switch with respect to all of the advertisement objects and recognition objects and an implicit indicator with respect to each advertisement object and each recognition object as well as implementing the indicators through a streaming scheme in units of frames to an output unit with respect to the broadcasting content.

Description

TECHNICAL FIELD [0001] The present invention relates to a Smart TV-based emotional advertisement method using object recognition,

The present invention relates to a smart TV-based emotional advertisement method using object recognition, and more specifically, to a smart TV-based emotional advertisement method that not only performs an advertisement for a general object other than an advertisement domain provided in a smart TV, The present invention relates to a smart TV-based emotional advertisement method using object recognition to provide an invisible emotional advertisement for minimizing interference with viewing of broadcast contents by allowing the advertisement to be directly and not directly seen.

The main purpose of content or advertising is to increase the effectiveness of broadcasting. Therefore, conventionally, a method of separating the contents from the advertisement and separately viewing the contents has been mainly used.

However, there has been a problem that it is inconvenient for people who want to watch only contents by separating the contents and the advertisement and providing commercial broadcasting separately.

In addition, if a smart TV user cares about a product other than an advertisement object by performing an advertisement in a preset manner for a specific product in the broadcast content, there may be a restriction that it is difficult to acquire information and purchase information.

Accordingly, in order to solve the conventional problems in the related art, not only the scope of the advertisement object is expanded on the basis of the user, but also the effect on the advertisement is maximized, New technology development is required.

[Related Technical Literature]

1. A smart pad having an advertisement system and an advertising system and method thereof (Patent Application No. 10-2011-0032083)

2. System and method for providing advertisement through a moving picture medium running on a smart device (Patent Application No. 10-2011-0107272)

3. Smart advertising information offer system (Patent Application No. 10-2011-0000401)

SUMMARY OF THE INVENTION The present invention has been made to solve the above-mentioned problems, and it is an object of the present invention to not only allow advertisement for a general object other than an advertisement area provided in a smart TV, The present invention provides a smart TV-based emotional advertisement method using object recognition for providing an invisible emotional advertisement for minimizing interference with viewing of broadcast contents.

In addition, the present invention minimizes the inconvenience of viewing, which is a side effect of maximizing the effect of the advertisement provided by the advertiser, but also provides the viewer of the broadcast contents The present invention is to provide a smart TV equipped with an object recognition sensibility advertisement function for minimizing interference with viewing of contents and providing detailed advertisement detail information by providing explicit advertisement when necessary.

However, the objects of the present invention are not limited to the above-mentioned objects, and other objects not mentioned can be clearly understood by those skilled in the art from the following description.

In order to achieve the above object, in a Smart TV-based emotional advertisement method using object recognition according to an embodiment of the present invention, a Smart TV is a streaming method in units of broadcasting frames, A first step of receiving the packetized broadcast content and the advertisement tag content from the broadcast content and the advertisement tag content; The smart TV prepares to implement a frame-by-frame streaming method for at least one or more recognized objects through object recognition for each of the objects that are not read as tag data for each advertisement object constituting the advertisement tag content A second step; And an advertisement conversion indicator for converting an advertisement for an explicit advertisement conversion of both the advertisement object and the recognition object of the smart TV, and an advertisement conversion indicator for displaying an advertisement indicator for each advertisement object and each recognition object in a frame unit A third step of recognizing the user with a streaming method; And a control unit.

At this time, the object recognition in the second step may include a tag data existence type corresponding to an advertisement object matching the tag data with the smart TV, a tag data existence ratio corresponding to a general object that does not match with the tag data, And is performed only for the tag data no-existence type after being divided into an existing type (Tag data no-existence).

The object recognition in the second step may include, before or after receiving the broadcast content, product pattern information for determining whether the smart TV is a product for each of the objects, Receiving the content data from the content server at a predetermined cycle, storing the content data, and then performing the processing.

In the second step, the smart TV acquires image information on an object that is not read as tag data for each advertisement object of the advertisement tag content; A 2-2 step of identifying a pixel included in each piece of image information acquired by the smart TV for discriminating whether or not the image information for the obtained object is a product; And a second step of the smart TV recognizing the product as a product when the characteristic of the specified pixel and the product pattern information of one of the plurality of products include similar characteristics, and recognizing the product as an object; And a control unit.

In the step 2-2, the smart TV utilizes various product pattern information stored in advance to identify a product in each image information, and the product pattern information includes various product pattern information, A reverse one, and a slightly inclined angle.

In addition, the specification of the pixels in the second-2 stage may be performed in such a manner that the contrast and darkness of the pixels included in each image information acquired by the smart TV, the color of the pixels, the lines formed by the pixels, And extracts the characteristics of the form.

In addition, the step 2-3 is characterized by determining that the smart TV is in a similar range to a product having product pattern information having pixels having characteristics similar to those of one pixel of the image information.

In addition, after the third step, when the smart TV receives the advertisement switching indicator selection signal through the input interface, the smart TV transmits an object marker for the advertisement object or the recognition target matching with the tag data included in the broadcast transmission frame, A fourth step of performing an explicit advertisement according to the implementation; And further comprising:

In addition, after the fourth step, when the smart TV receives a selection signal for one of a plurality of advertisement objects and a plurality of recognition objects through the input interface during the execution of the explicit advertisement, A fifth step of determining that the purchase request is a purchase request when the motion gesture input signal is received through the input interface; And further comprising:

In the second step, the smart TV reads the tag data for each advertisement object included in the separated advertisement tag contents. And (2-2) setting location tracking marking for tracking of each advertisement object by using the image information included in the tag data of each advertisement object by the smart TV. A second step of the smart TV performing object recognition on at least one or more objects not read as tag data for each advertisement object on the advertisement tag contents; (2-4) receiving additional tag data for each recognition subject in response to transmission of a query message to the broadcast content server through the broadcast communication network for the recognized recognition object; And (2-5) the smart TV performs object recognition on the broadcast content for each recognition object and sets a position tracking marking for tracking on the recognition object. And further comprising:

In addition, the position tracking marking for tracking each of the recognition objects in the step 2-5 may be implemented in a UI screen of the output unit in units of each broadcast transmission frame on the broadcast content, The real time change data corresponding to the position change or the stereoscopic view change is automatically generated and stored in the storage unit of the smart TV to utilize the stored real time change data at the time of tracking .

The third step may include a third step (3-1) in which the smart TV sets an implicit effect on the advertisement object and the recognition object in which the position tracking marking is set; (3-2) the smart TV realizes the implied indicator reflecting the implied effect of the advertisement object and the recognized object with the position tracking marking set to the output unit; A third step of implementing a tracking effect on an indication indicator for each of the advertisement object and the recognition object in which the position tracking marking is set when the smart TV realizes broadcasting contents in a streaming manner in units of broadcasting frames by the output unit; And (3-4) the Smart TV waits for reception of an advertisement switching indicator selection signal from an input interface for an explicit advertisement switching; And further comprising:

In addition, the implication effect of the step 3-2 may be such that, when the broadcast content is implemented in a streaming manner, it is implicitly given to the user of the smart TV indirectly before the explicit exposure of the advertisement object and the recognition object, And is a subliminal effect for recognizing the user.

In addition, the subliminal effect in step 3-2 may include an empty-image including only the indictor indicator between broadcasting images including each advertisement object constituting the broadcast transmission frame ) Is inserted in a manner to be described later.

Further, the ambiguity indicator in the step 3-2 is characterized by one of a color change setting, a backlight setting, an adver setting, a status bar setting, an icon setting, and a border color setting.

In addition, in the step 3-3, when the smart TV realizes a tracking effect for an indications indicator for each of the advertised object and the recognized object for which the position tracking marking is set, And the position and shape of the indictor according to the object recognition are also converted and implemented.

In the step (3-3), the smart TV may compare the image information included in the broadcast content with the image information acquired for each recognition object for each recognition object.

In the step 3-3, the smart TV specifies pixels included in the image information included in the broadcast content for each recognition object, in step 3-3 (a). And when the smart TV includes the characteristics of the specified pixel with respect to the image information of each recognition object and the image information acquired for each object includes similar characteristics, it is determined that the position tracking mark is a position or stereoscopic view (B) a tracking effect is implemented by moving to a position of image information corresponding to a changed recognition object; And a control unit.

In addition, in the fourth step, when the smart TV receives the advertisement switching indicator selection signal, the output unit receives a selection signal for one of the object markers for the advertisement object and the recognition object together with the broadcast content A step 4-1 of implementing an advertisement through tag data of a selected advertisement object or a recognition object; A step 4-2 of implementing a tracking effect using an object marker for each of an advertisement object and a recognition object in which the location tracking marking is set when the broadcasting contents are implemented in the streaming method of the broadcasting frame in the smart TV; And a step S4 of the Smart TV receiving a selection signal for one of the object markers for each of the advertisement object and the recognition object from the input interface. And a control unit.

In addition, the step 4-2 may include: (a) 4-2 (a) for the smart TV to specify pixels included in the image information included in the broadcast content for each recognition object; And when the smart TV includes the characteristics of the specified pixel with respect to the image information of each recognition object and the image information acquired for each object includes similar characteristics, it is determined that the position tracking mark is a position or stereoscopic view (B) performing a tracking effect by moving the image information to a position of image information corresponding to the changed recognition object; And a control unit.

The smart TV-based emotional advertisement room using the object recognition according to the embodiment of the present invention not only allows advertisement for a general object other than the advertisement domain provided in the smart TV to be performed, It is possible to provide an invisible emotional advertisement in order to minimize the interference with the viewing of the broadcast contents.

In addition, the smart TV-based emotional advertisement method using the object recognition according to another embodiment of the present invention can be provided directly to the user who watches the smart TV and is implicitly provided, thereby minimizing the viewing disturbance for the broadcast contents, It is possible to provide detailed advertisement detail information through explicit advertisement providing at the time of the advertisement.

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a diagram illustrating an entire system in which a smart TV-based emotional advertisement method using object recognition according to an embodiment of the present invention is implemented; FIG.
Fig. 2 is a diagram showing a configuration of a smart TV in Fig. 1; Fig.
3 is a conceptual diagram illustrating an object recognition technique for an object other than an advertisement object included in broadcast content according to an exemplary embodiment of the present invention.
4 is a conceptual diagram illustrating an implicit advertisement according to an embodiment of the present invention;
FIG. 5 is a flowchart specifically illustrating an object recognition process in a smart TV-based emotional advertisement method using object recognition according to an exemplary embodiment of the present invention.
FIG. 6 is a flowchart specifically illustrating a process of setting a location tracking mark after recognizing an object among smart TV-based emotional advertisement methods using object recognition according to an embodiment of the present invention.
FIG. 7 is a general flowchart showing a smart TV-based emotional advertisement method according to an embodiment of the present invention; FIG.
FIG. 8 is a flowchart for explaining each step of the smart TV-based emotional advertisement method of FIG. 7;

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, a detailed description of preferred embodiments of the present invention will be given with reference to the accompanying drawings. In the following description of the present invention, detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear.

In the present specification, when any one element 'transmits' data or signals to another element, the element can transmit the data or signal directly to the other element, and through at least one other element Data or signal can be transmitted to another component.

1 is a diagram illustrating an entire system in which a smart TV-based emotional advertisement method using object recognition according to an embodiment of the present invention is implemented. 1, the entire system in which the smart TV-based emotional advertisement method is implemented includes a smart TV 10, a remote controller 20, a broadcast communication network 30, a broadcast content server 40, a smart mobile device 50, A data communication network 60 and an affiliated advertiser terminal group 70.

1, the smart TV 10 is formed as a set-top box separate type having a separate set-top box (STB) and performs data transmission / reception with the broadcast content server 40 through the broadcast communication network 30 Alternatively, it may be formed as a set-top box-integrated type and perform data transmission / reception with the broadcast content server 40 without a separate set-top box (STB).

The smart TV 10 performs an implicit and explicit advertisement for each of the advertisement objects corresponding to the tag data constituting the tag content received together with the broadcast content. In addition, the smart TV 10 according to the present invention is characterized in that it further provides an implicit and explicit advertisement through object recognition for an object other than the advertisement object included in the broadcast content.

The broadcast communication network 30 is a high-speed wired or bridged periodic network for broadcasting in the form of a large capacity, a long-distance voice, and a data service, and may be a wired or wireless Internet. The broadcast communication network 30 plays a role for the broadcast content server 40 to transmit the broadcast content to the smart TV 10 and other systems for broadcasting.

The broadcast content server 40 includes a broadcast DB 41 and an advertisement DB 42. Also, in this specification, a DB may mean a functional and structural combination of software and hardware for storing information corresponding to each database. The DB may be implemented as at least one table, and may further include a separate DBMS (Database Management System) for searching, storing, and managing information stored in the database. Also, it can be implemented in various ways such as a linked-list, a tree, and a relational database, and includes all data storage media and data structures capable of storing information corresponding to a database.

The broadcast content server 40 receives the advertisement data through the data communication network 60 from each of the affiliated advertiser terminals constituting the affiliated advertiser terminal group 70 for each of the advertisement objects included in the broadcast content stored in the broadcast DB 41 do. In this case, it is preferable that the advertisement data include image information and advertisement detailed information for each advertisement object, and it is preferable that the advertisement data is received by receiving broadcast data of each broadcast content when the advertisement data is received.

Here, the data communication network 60 may be a high-speed period network of a large communication network capable of a large-capacity, long-distance voice and data service, and may be a next generation wired and wireless network for providing Internet or high-speed multimedia service. When the data communication network 60 is a mobile communication network, it may be a synchronous mobile communication network or an asynchronous mobile communication network. As an embodiment of the asynchronous mobile communication network, a WCDMA (Wideband Code Division Multiple Access) communication network is exemplified. In this case, although not shown in the drawing, the data communication network 60 may include a Radio Network Controller (RNC). Meanwhile, although the WCDMA network is exemplified, it may be a next generation communication network such as a 3G LTE network or a 4G network, or an IP network based on other IP. The data communication network 60 serves to transmit signals and data between the broadcasting contents server 40, a plurality of advertiser terminal units constituting the advertiser terminal group 70, and other systems.

On the other hand, the broadcast content server 40 generates tag data for each of the advertisement objects, and then all the generated tag data are numbered and stored in the advertisement DB 42 as advertisement tag contents. Meanwhile, in an embodiment of the present invention, the broadcast content server 40 preferably includes image information and advertisement detail information for use in object recognition for each advertisement object received at the time of generating each tag data, It is preferable that the advertisement DB 42 divides the broadcasting contents into broadcasting transmission frames and stores the metadata together with the respective advertisement tag contents when the advertisement contents are stored.

The broadcast content server 40 transmits the broadcast content stored in the broadcast DB 41 and the advertisement DB 42 in response to a request for listening to the broadcast content stored in the broadcast DB 41 of the smart TV 10 through the broadcast communication network 30. [ And transmits the packetized advertisement tag contents to the smart TV 10 through the broadcast communication network 30 (S13).

The smart mobile device 50 is provided for confirming detailed information on the advertisement object based on the touch screen when the user of the smart TV 10 wants detailed information on the advertisement object according to the explicit advertisement implementation after the implicit advertisement implementation do.

Fig. 2 is a diagram showing a configuration of the smart TV 10 in Fig. 3 is a conceptual diagram illustrating an object recognition technique for an object other than an advertisement object included in broadcast content according to an exemplary embodiment of the present invention. 4 is a conceptual diagram for explaining an implicit advertisement according to an embodiment of the present invention. 2, the smart TV 10 includes an output unit 11, a sensing unit 12, an input interface 13, a control operation unit 14, a storage unit 15, and a wired / wireless communication module 16, .

The input interface 13 includes an input unit 13a and a remote control signal receiving unit 13b. The control operation unit 14 includes a broadcast content processing module 14a, an implicit advertisement implementation module 14b, an explicit advertisement implementation module 14c, an advertisement object purchase module 14d and an object recognition module 14e do. Herein, a module may mean a functional and structural combination of hardware for carrying out the technical idea of the present invention and software for driving the hardware. For example, the module may mean a logical unit of a predetermined code and a hardware resource for executing the predetermined code, and it does not necessarily mean a physically connected code or a kind of hardware. Can be easily deduced to the average expert in the field of < / RTI >

Hereinafter, the entire system in which the Smart TV-based emotional advertisement method is implemented will be described in detail, focusing on the configuration of the control operation unit 14. [ The broadcast content processing module 14a controls the wired / wireless communication module 16 to receive the packetized broadcast content and the advertisement tag content from the broadcast content server 40 through the broadcast communication network 30 in a streaming manner for each broadcast transmission frame , And receives broadcasting contents and advertisement tag contents packetized in units of broadcast transmission frames. The broadcast content processing module 14a separates the broadcast content and the advertisement tag content from the packet in the broadcast transmission frame unit, and then prepares for implementation of the broadcast content in the output unit 11 in a frame-by-frame streaming manner.

More specifically, the broadcast content processing module 14a receives the broadcast content stored in the broadcast DB 41 of the smart TV 10 from the broadcast content server 40 through the broadcast communication network 30, And controls the module 16. The broadcast content processing module 14a transmits the broadcast content stored in the broadcast DB 41 of the broadcast content server 40 and the advertisement tag content stored in the advertisement DB 42 of the broadcast content server 40 to the broadcast transmission frame And controls the wired / wireless communication module 16 to receive from the broadcasting contents server 40 through the broadcasting communication network 30 in a packetized state.

The broadcast content processing module 14a separates the packetized broadcast content and the advertisement tag content received from the broadcast content server 40 in a streaming manner on a broadcast broadcast frame basis, Reads the tag data for each advertisement object, and stores the tag data in the storage unit 15.

The broadcast content processing module 14a sets the location tracking marking for tracking for each advertisement object using the image information included in the tag data for each of the read advertisement objects. Here, the position tracking marking serves as a marker for tracking each advertisement object in the implementation of the advertisement object to the output unit 11 according to each broadcast transmission frame on the advertisement content. More specifically, even if the position of each of the advertisement objects is changed or the stereoscopic view is changed on the broadcast content according to the setting of the position tracking marking, the realtime change data due to the position change or stereoscopic view change is automatically generated by the broadcast content processing module 14a And is stored in the storage unit 15 so that the position of the advertisement object on the UI screen realized on the output unit 11 is automatically tracked by using the stored real-time change data when tracking the advertisement object.

The broadcast content processing module 14a may further perform object recognition for automatically performing recognition of an object other than the advertisement object in broadcast contents of each broadcast transmission frame in an additional process.

That is, the broadcast content processing module 14a performs object recognition for an object that is not read as tag data for each advertisement object of the advertisement tag content received in a streaming manner for each broadcast transmission frame. It is preferable that the broadcast content processing module 14a individually performs recognition of each of the stereoscopic viewpoints at the time of object recognition for each recognition object.

The broadcast content processing module 14a transmits a query message to the broadcast content server 40 through the broadcast communication network 30 for the recognized object, and when there is additional tag data for the object to be recognized, And controls the communication module 16. The broadcast content processing module 14a performs object recognition on the image information of the broadcast content for each recognition object and sets a position tracking marking for tracking on the recognition object. Here, the position tracking marking for tracking each recognition object is implemented by UI screen of the output unit 11 for each broadcast transmission frame on the broadcast content, when the position on the UI screen of each recognition object is changed or the stereoscopic view is changed The real time change data corresponding to the change of the position of each recognition object or the change of the stereoscopic view is automatically generated by the broadcast content processing module 14a and stored in the storage unit 15 of the smart TV, And is set so that the stored real-time change data is used to automatically track the position of the recognition object on the UI screen implemented on the output unit 11. [

The broadcast content processing module 14a implements the advertisement conversion indicator in the output unit 11 and receives the streaming method in units of broadcasting frames to start outputting the broadcasting contents in the buffering state on the storage unit 15 .

The object recognition process for the recognition object other than the advertisement object through the linkage between the broadcast content processing module 14a and the object recognition module 14e will be described in detail in the following description of the object recognition module 14e.

The implicit advertisement implementing module 14b implements the advertisement conversion indicator in the output unit 11 according to the start of outputting the broadcast content of the broadcast content processing module 14a, And implements an implicit indicator for each advertising object in which the implicit effect is reflected.

More specifically, the implicit advertisement implementation module 14b establishes an implicit effect on the recognized object to which the position tracking marking is set, the advertisement object to which the position tracking marking is set. Here, the implicit effect implies a user interface effect for indirectly recognizing the broadcast contents in the streaming manner implicitly to the user of the smart TV 10 before the explicit exposure of the advertisement object and the recognition object .

In an embodiment of the present invention, a subliminal effect may be used as an implicit effect, and a subliminal effect may be one of a plurality of broadcast images including an advertisement object constituting a broadcast transmission frame And inserting an empty-image containing only an implicit indicator (see FIG. 4).

On the other hand, an example of the color change setting for the skirt and the backlight setting for the shoe can be exemplified with respect to the advertisement object or the recognition object in the empty image for the subliminal effect as shown in Fig. 4, Another example is the adver, status bar, icon, and border color settings for an object or a recognized object.

The implicit advertisement implementing module 14b implements an implicit indicator according to the setting of the implicit effect for the advertisement object and the recognition object together with the broadcasting contents for each broadcasting transmission frame to the output unit 11. [ As described above, the hint indicator can be implemented as a color change, an halo, an ad bar, a status bar, an icon, and a border color for an advertisement object or a recognition object.

The implicit advertisement implementing module 14b implements the tracking effect on the advertising object or the implicit indicator for each recognition object according to the time flow for the broadcasting contents for each broadcasting transmission frame to the output unit 11. [ At this time, the implicit advertisement implementing module 14b is not directly performed in implementing the tracking effect on the recognition object, but is performed through a request to the position tracking marking means 14e-2 to be described later.

Here, the tracking effect means to implement the position or shape of the indictor according to the object recognition for the object to be marked with the position tracking marking and the object to be recognized with the position tracking marking.

The implicit advertisement implementation module 14b waits for the advertisement switching indicator selection signal from the input interface 13 for explicit advertisement switching and then determines whether or not to receive the advertisement switching indicator selection signal and transmits the advertisement switching indicator selection signal to the explicit advertisement implementation module 14c to terminate the implicit ad output process.

The explicit advertisement implementing module 14c receives the advertisement switching indicator selection signal through the input interface 13 and displays the object corresponding to the advertisement object for the advertisement object matched with the tag data included in the currently broadcast broadcasting frame, Perform an explicit advertisement according to the marker implementation.

More specifically, the explicit advertisement implementing module 14c sends the advertisement switching indicator selection signal to the output unit 11 when the advertisement switching indicator selection signal is received by the implicit advertisement implementing module 14b, An object marker is implemented for the object and the recognition object, and the advertisement is implemented through the tag data for the advertisement object or the recognition object selected when the object marker is selected.

On the other hand, when the explicit advertisement implementing module 14c receives a selection input for one of the object markers, the explicit advertisement implementing module 14c generates a selection mark in accordance with the recognition data previously stored in the storage unit 15 through the sensing unit 12 . As one example, when the sensing unit 12 is implemented as a recognition module of a camera photographing system, a recognition signal may be recognized as a selection signal at a place where a user's eyes are frequently seen as a result of eye recognition through a camera photographing, And recognizing an object marker corresponding to the advertisement object matching the interest category information stored on the storage unit 15 with respect to the user.

The explicit advertisement implementing module 14c implements a tracking effect using an object marker according to an advertisement object or an object marker according to a flow of broadcast contents for each broadcasting frame to the output unit 11. [ At this time, the explicit advertisement implementing module 14c is not directly performed in implementing the tracking effect on the recognition object but is performed through a request to the position tracking marking means 14e-2 to be described later.

Here, the tracking effect means to convert the position of the object marker according to the object recognition for the object to be marked with the position tracking marking and the object to be recognized with the position tracking marking.

The explicit advertisement implementing module 14c waits for receiving a selection signal for a plurality of advertisement objects and a plurality of recognition objects from the input interface 13. [

The explicit advertisement implementation module 14c notifies the advertisement object purchase module 14d of the determination result through determination of whether or not the selection signal is received for one of a plurality of advertisement objects and a plurality of recognition objects, Complete.

As a result of the explicit advertisement implementation module 14c, when the advertisement selection module 14d receives the selection signal for one of the plurality of advertisement objects through the input interface 13 in the process of performing the explicit advertisement, When the motion gesture input signal through the input interface 13 is received, it is determined that the purchase request is made and the purchase procedure is performed.

More specifically, the advertisement purchase module 14d receives a motion gesture input signal from the remote controller 20 for a selected advertisement object or a recognized object, in response to a selection signal for one of a plurality of advertisement objects and a plurality of objects to be recognized, And receives a motion gesture input signal through the input unit 13a or receives a motion gesture input signal to the input unit 13a, and recognizes the received target object as a purchase request for a recognized object or a recognition target object.

The object recognition module 14e is divided into object recognition means 14e-1 and position tracking marking means 14e-1. First, when the broadcast content processed by the broadcast content processing module 14a and the broadcast content and the advertisement tag content for the advertisement tag content are separated from each other by the broadcast content processing module 14a, the object recognition means 14e- And acquires image information about an object that is not read with star tag data. That is, referring to FIG. 3, in the case of object recognition by the object recognizing means 14e-1, a tag data existence type corresponding to the advertisement object matching with the tag data, (Tag data no-existence) corresponding to a general object which is not a tag object, and only for the latter tag data no-existence.

Here, each tag data contains information on one advertisement object. On the other hand, the object recognizing means 14e-1 obtains image information based on digital data obtained by converting an analog video signal obtained at the time of photographing of an object. To this end, product pattern information for discriminating a product to an object It is preferable to receive the broadcast content from the broadcast content server 40 through the broadcast communication network 30 at a preset period before storing or storing the received broadcast content in the storage unit 15 before or after receiving the broadcast content.

 The object recognizing means 14e-1 specifies a pixel included in each image information acquired for discriminating whether or not the acquired image information for each object is a product. More specifically, the object recognizing means 14e-1 utilizes various product pattern information stored in the storage unit 15 in order to discriminate the products from each image information, and the various product pattern information itself or the inclined The product of the image information is compared with the pattern of the product included in the image information, and the product in the image information is discriminated. In the first step for product discrimination, the object recognizing means 14e-1 recognizes the pixels included in each acquired image information, that is, the lightness and darkness of the pixel, the color of the pixel, the line formed by the pixel, And extracts the characteristics of the pixel from the shape or the like which changes according to the flow.

The object recognizing means 14e-1 judges the product characteristic of the pixel specified for each object and the product pattern information of one of the plurality of products stored in the storage unit 15 as similar products, and recognizes the product as an object . More specifically, the object recognizing means 14e-1 determines the similarity range in which the product pattern information having the pixels including the characteristics similar to those of the pixels for one piece of image information specified for each object exists. That is, the object recognizing means 14e-1 judges the pixel from which the characteristic is extracted to be the reference pixel, judges the similarity between the reference pixel and the surrounding pixels, and judges the same product if the similarity is determined. Here, the similarity is a concept that includes a difference in brightness between pixels or a difference in distance between pixels.

After the object recognition unit 14e-1 recognizes the object, the position tracking marking unit 14e-2 sets the position tracking mark by the broadcast content processing module 14a, Implements the tracking effect when an implicit advertisement by the explicit advertisement implementation module 14b is performed or an explicit advertisement by the explicit advertisement implementation module 14c is performed.

In other words, the position tracking marking means 14e-2 is a means for comparing the image information included in the broadcast content with the image information acquired by the object recognition means 14e-1 for each of the objects to be recognized, The pixel included in the image information included in the broadcast content is specified for each recognition object as a first step for discriminating whether or not each recognition object is included in the broadcast content.

To be more specific, the position tracking marking means 14e-2 automatically applies the tracking effect according to the position change or the stereoscopic view change even if the position of the recognition object is changed or the stereoscopic view is changed when the pixel included in the image information is changed The image information specifies all the pixel characteristics of the pattern information itself or the inclined, inverted, slightly inclined, and the like of the image information. In addition, the position tracking marking means 14e-2 determines the characteristics of the pixel from the shape of the pixel included in the image information, such as the contrast and darkness of the pixel, the color of the pixel, the line formed by the pixel, .

The position tracking marking means 14e-2 may be used as the same recognition object when the characteristic of the pixel specified for the image information of each recognition object and the image information acquired by the object recognition means 14e-1 include similar characteristics And the position tracking mark is moved to the position of the image information corresponding to the recognized recognition object by changing the position or stereoscopic view to implement the tracking effect.

FIG. 5 is a flowchart specifically illustrating an object recognition process in a smart TV-based emotional advertisement method using object recognition according to an embodiment of the present invention. 1 to 5, the smart TV 10 receives packetized broadcast content and advertisement tag content from the broadcast content server 40 through the broadcast communication network 30 in a streaming manner for each broadcast transmission frame, And then obtains image information of an object that is not read with the tag data of each advertisement object of the advertisement tag content (S1). In the case of object recognition by the smart TV 10, the tag data existence type corresponding to the advertisement object matched with the tag data and the tag data existence ratio corresponding to the general object which does not match the tag data And is performed only for the latter tag data no-existence (Tag data no-existence).

Here, each tag data contains information on one advertisement object. On the other hand, the smart TV 10 acquires image information on the basis of the converted digital data of the analog video signal obtained at the time of photographing the object. To this end, the smart TV 10 receives product pattern information for discriminating the product of the object, It is preferable that the broadcast content server 40 receives the broadcast content from the broadcast content server 40 via the broadcast communication network 30 at a predetermined period and stores the received content in the storage unit 15.

After step S1, the smart TV 10 specifies a pixel included in each image information acquired for discriminating whether or not the image information about the object acquired in step S1 is a product (S2). More specifically, the smart TV 10 utilizes various product pattern information stored in advance in the storage unit 15 in order to identify a product in each image information. The various items of the product pattern information or the inclination of various product patterns, And a product of the product in the image information is compared with the pattern of the product included in the image information. The step S2 of the first step for product discrimination is performed by the smart TV 10 in accordance with the specification of the pixels included in each image information acquired in the step S1, Line, and a shape in which pixels change with time, and the like.

After step S2, the smart TV 10 determines that the product characteristic of the pixel specified in step S2 and the product pattern information of one of the plurality of products stored in the storage unit 15 include similar characteristics, (S3). More specifically, the smart TV 10 determines the similarity range in which the product pattern information having the pixels including characteristics similar to those of the pixels for one piece of image information specified in step S2. That is, the smart TV 10 determines that the pixel from which the characteristic is extracted is the reference pixel, judges the similarity between the reference pixel and the surrounding pixels, and determines that the product is the same if the similarity is determined. Here, the similarity is a concept that includes a difference in brightness between pixels or a difference in distance between pixels.

FIG. 6 is a flowchart specifically illustrating a process of implementing a tracking effect using a location tracking mark after setting a location tracking mark after recognizing an object among smart TV-based emotional advertisement methods using object recognition according to an embodiment of the present invention. Referring to FIGS. 1 to 6, after the object recognition for the recognition object other than the advertisement object as shown in FIG. 5 is completed on the broadcast content, the smart TV 10 displays the advertisement object, the implicit advertisement for the recognition object, And performs a position tracking marking process for applying the tracking technique used. Hereinafter, as shown in FIG. 6, when a tracking effect is applied to an implicit indicator in an implicit advertisement using a position tracking mark for a recognition object, or when a tracking effect using an object marker is recognized in an explicit advertisement, an implicit indicator or an object marker And the object recognition technique for the corresponding recognized object is specifically shown.

The smart TV 10 compares the image information included in the broadcast content with the image information acquired in step S1 of FIG. 5 for each of the recognized objects with respect to each of the recognized objects, As a first step for discrimination, the pixels included in the image information included in the broadcast content are specified for each recognition object (S4).

More specifically, in order to apply the tracking effect according to the position change or the stereoscopic view change, even if the position of the object to be recognized is changed or the stereoscopic view is changed when the pixel included in the image information is changed, Specifies all pixel characteristics for a tilted, inverted, or slightly angled tilt of information or image information. In addition, the smart TV 10 extracts characteristics of a pixel from the brightness and darkness of a pixel, the color of the pixel, the line formed by the pixel, and the shape in which the pixel changes with the passage of time when specifying a pixel included in the image information.

After step S4, if the characteristic of the specified pixel with respect to the image information of each recognition object in step S5 and the image information acquired in step S1 include similar characteristics, It is determined that the object is the object and the position tracking mark is changed in position or stereoscopic view to move to the position of the image information corresponding to the implemented object to be recognized (S5), thereby implementing the tracking effect.

FIG. 7 is a general flowchart showing a smart TV-based emotional advertisement method according to an embodiment of the present invention. 1 to 7, the smart TV 10 receives the packetized broadcast content and the advertisement tag content from the broadcast content server 40 through the broadcast communication network 30 in a streaming manner for each broadcast transmission frame, And the advertisement tag content, and prepares for implementation of the streaming method in the output unit 11 in units of broadcasting frames for broadcasting contents (S10).

Here, the broadcast communication network 30 is a high-speed wired or bridged termi- nal network for broadcasting in the form of a large capacity, a long-distance voice, and a data service, and may be a wired or wireless Internet. The broadcast communication network 30 plays a role for the broadcast content server 40 to transmit the broadcast content to the smart TV 10 and other systems for broadcasting.

On the other hand, the broadcast content server 40 includes a broadcast DB 41 and an advertisement DB 42. Also, in this specification, a DB may mean a functional and structural combination of software and hardware for storing information corresponding to each database. The DB may be implemented as at least one table, and may further include a separate DBMS (Database Management System) for searching, storing, and managing information stored in the database. Also, it can be implemented in various ways such as a linked-list, a tree, and a relational database, and includes all data storage media and data structures capable of storing information corresponding to a database.

After step S10, the smart TV 10 is an implicit advertisement outputting process. The smart TV 10 is implemented in accordance with the temporal flow of the broadcasting contents to the output unit 11 for each broadcast broadcasting frame, and the advertisement switching indicator and the indication indicators (S20).

 After step S20, the smart TV 10 receives the advertisement switching indicator selection signal through the input interface 13, and performs the flow of the broadcasting contents to the output unit 11 according to the temporal flow, An explicit advertisement according to the implementation of the object markers for the advertisement object is performed in the separated advertisement tag contents according to the process of S30.

After receiving the selection signal for one of the plurality of advertisement objects through the input interface 13 in the process of performing the explicit advertisement by the step S30 after the step S30, When a motion gesture input signal through the input interface 13 is received, it is determined that the purchase request is made and a purchase procedure is performed (S40).

FIG. 8 is a specific flowchart of steps (S10) to (S40) of the smart TV-based emotional advertisement method of FIG. 1 to 8, the broadcast content server 40 transmits the broadcast content stored in the broadcast DB 41 from each affiliated advertiser terminal constituting the affiliated advertiser terminal group 70 to each of the advertisement objects included in the broadcast content, (Step S11). Here, the data communication network 60 may be a high-speed period network of a large communication network capable of a large-capacity, long-distance voice and data service, and may be a next generation wired and wireless network for providing Internet or high-speed multimedia service. When the data communication network 60 is a mobile communication network, it may be a synchronous mobile communication network or an asynchronous mobile communication network. As an embodiment of the asynchronous mobile communication network, a WCDMA (Wideband Code Division Multiple Access) communication network is exemplified. In this case, although not shown in the drawing, the data communication network 60 may include a Radio Network Controller (RNC). Meanwhile, although the WCDMA network is exemplified, it may be a next generation communication network such as a 3G LTE network or a 4G network, or an IP network based on other IP. The data communication network 60 serves to transmit signals and data between the broadcasting contents server 40, a plurality of advertiser terminal units constituting the advertiser terminal group 70, and other systems.

It is preferable that the advertisement data include image information for each advertisement object, and it is preferable that the advertisement data is received by receiving broadcast data of each broadcast content when the advertisement data is received. Also, in this specification, a DB may mean a functional and structural combination of software and hardware for storing information corresponding to each database. The DB may be implemented as at least one table, and may further include a separate DBMS (Database Management System) for searching, storing, and managing information stored in the database. Also, it can be implemented in various ways such as a linked-list, a tree, and a relational database, and includes all data storage media and data structures capable of storing information corresponding to a database.

The broadcast content server 40 generates tag data for each of the advertisement objects, and then all the generated tag data is numbered and stored in the advertisement DB 42 as advertisement tag contents (S12). Meanwhile, in one embodiment of the present invention, the broadcast content server 40 preferably includes image information for use in object recognition for each advertisement object received in step S11 when each tag data is generated And the advertisement DB 42, it is preferable to generate meta data according to the broadcasting broadcasting frames of the broadcasting contents and to store the metadata together with the respective advertisement tag contents.

After the step S12, the broadcast content server 40 transmits the broadcast content 41 stored in the broadcast DB 41 in response to a request for listening to the broadcast content stored in the broadcast DB 41 of the smart TV 10 through the broadcast communication network 30, And the advertisement DB contents stored in the advertisement DB 42 are packetized for each broadcasting transmission frame and transmitted to the smart TV 10 through the broadcasting communication network 30 (S13).

In step S13, the smart TV 10 separates the packetized broadcast content received from the broadcast content server 40 in a streaming manner for each broadcast transmission frame and the advertisement tag content, Tag data per object is read (S14).

After step S14, the smart TV 10 sets up a position tracking marking for tracking for each advertisement object using the image information included in the tag data for each advertisement object read in step S14 (S15). Here, the position tracking marking serves as a marker for tracking each advertisement object in the implementation of the advertisement object to the output unit 11 according to each broadcasting transmission frame on the advertisement content. More specifically, even if the position of each of the advertisement objects is changed or the stereoscopic view is changed on the broadcast content in accordance with the setting of the position tracking marking in step S15, the real time change data according to the position change or stereoscopic view change is automatically transmitted to the smart TV 10 And stored in the storage unit 15 so that the position of the advertisement object on the UI screen realized on the output unit 11 is automatically tracked by utilizing the stored real time change data at the time of tracking for the advertisement object .

On the other hand, after step S15, the smart TV 10 may further perform step S16, which is an object recognition process for automatically recognizing an object other than the advertisement object in the broadcast content as an additional process. It is preferable that the smart TV 10 individually performs recognition of each of the stereoscopic viewpoints at the time of object recognition for each recognition object.

In step S16, in step S14, the smart TV 10 performs object recognition for an object that is not read as tag data for each advertisement object of the advertisement tag content received in a streaming manner for each broadcasting frame in step S14 S16a). At this time, the object recognition process for the object is preferably implemented by the algorithm described in FIG.

After step S16a, the smart TV 10 transmits additional tag data for the recognition object in accordance with the transmission of the query message to the broadcast content server 40 through the broadcast communication network 30 for the recognition object recognized in step S16a And further receives (S16b). After step S16b, the smart TV 10 performs object recognition on the image information of the broadcast content for each recognition object and sets a position tracking marking for tracking on the recognition object (S16c).

Here, the position tracking marking for tracking each recognition object is implemented by UI screen of the output unit 11 for each broadcast transmission frame on the broadcast content, when the position on the UI screen of each recognition object is changed or the stereoscopic view is changed The real time change data according to the position change of each recognition object or the change of the stereoscopic view is automatically generated by the smart TV 10 and stored in the storage unit 15 of the smart TV, Change data is utilized so that the position of the recognition object on the UI screen implemented on the output unit 11 is automatically tracked.

After step S15 or step S16, the smart TV 10 implements the advertisement conversion indicator in the output unit 11 and prepares to start outputting the broadcast content for each broadcasting frame in a streaming manner (S17 ), The broadcast content preparation process for each broadcast transmission frame in step S10 is completed.

After performing the step S10 according to the steps S11 to S17, the smart TV 10 displays the advertisement object with the position tracking marking set in step S15, and the recognition object with the position tracking marking set in step S16c Lt; RTI ID = 0.0 > (S21). ≪ / RTI > Here, the implicit effect implies a user interface effect for indirectly recognizing the broadcast contents in the streaming manner implicitly to the user of the smart TV 10 before the explicit exposure of the advertisement object and the recognition object .

In the embodiment of the present invention, a subliminal effect may be used as an implicit effect, and a subliminal effect may include an indication indicator (not shown) between broadcast images including an advertisement object constituting a broadcast transmission frame (See Fig. 4). In this case, as shown in Fig.

On the other hand, an example of the color change setting for the skirt and the backlight setting for the shoe can be exemplified with respect to the advertisement object or the recognition object in the empty image for the subliminal effect as shown in Fig. 4, Another example is the adver, status bar, icon, and border color settings for an object or a recognized object.

After step S21, the smart TV 10 implements an implied indicator reflecting the implicit effect of the advertisement object and the recognition object together with the broadcasting contents for each broadcasting transmission frame to the output unit 11 (S22). As described above, the hint indicator can be implemented as a color change, an halo, an ad bar, a status bar, an icon, and a border color for an advertisement object or a recognition object.

After step S22, the smart TV 10 implements the tracking effect for the advertisement indicator for each advertisement object or the recognition object according to the flow of time with respect to the broadcasting contents for each broadcast transmission frame to the output unit 11 (S23) . At this time, the tracking effect is preferably implemented by the algorithm described in FIG.

Here, the tracking effect is implemented by transforming the location or shape of the indictor according to the object recognition for the object to be marked with the position tracking marking in step S15 and the object to be recognized with the position tracking marking in step S16c .

After step S23, the smart TV 10 waits for the advertisement switching indicator selection signal from the input interface 13 for explicit advertisement switching (S24), and judges whether or not to receive the advertisement switching indicator selection signal (S25), and ends the implicit advertisement output process.

If the advertisement switching indicator selection signal is received in step S25, the Smart TV 10 implements the object marker for the advertisement object and the recognition object along with the broadcasting contents for each broadcasting frame to the output unit 11, When the marker is selected, the advertisement is implemented through the tag data of the selected advertisement object or the recognition object (S31).

On the other hand, when the smart TV 10 receives a selection input for one of the object markers, the smart TV 10 can be performed in a manner corresponding to recognition data previously stored in the storage unit 15 via the sensing unit 12 have. As one example, when the sensing unit 12 is implemented as a recognition module of a camera photographing system, a recognition signal may be recognized as a selection signal at a place where a user's eyes are frequently seen as a result of eye recognition through a camera photographing, And recognizing an object marker corresponding to the advertisement object matching the interest category information stored on the storage unit 15 with respect to the user.

After step S31, the smart TV 10 implements the tracking effect using the object markers for each advertisement object or the recognition object according to the flow of the broadcasting contents for each broadcasting frame to the output unit 11 (S32). At this time, the tracking effect is preferably implemented by the algorithm described in FIG.

Here, the tracking effect is implemented by transforming the position of the object marker according to the object recognition for the object to be marked with the position tracking marking in step S15 and the object to be recognized with the position tracking marking in step S16c.

After step S32, the smart TV 10 waits for a selection signal for one of a plurality of advertisement objects and a plurality of recognition objects from the input interface 13 (S33).

After step S33, the smart TV 10 determines whether to receive a selection signal for one of a plurality of advertisement objects and a plurality of recognition objects (S34), and completes execution of the explicit advertisement.

As a result of the determination in step S34, in the case of a selection signal for one of a plurality of advertisement objects and a plurality of recognition objects, the smart TV 10 displays a purchase procedure through the motion gesture for the advertisement object or the recognition object selected in step S34 (S40).

More specifically, the smart TV 10 receives the motion gesture input signal from the remote controller 20 for the selected advertisement object or the recognition object through the remote control signal receiving unit 13b or receives the motion gesture input signal to the input unit 13a And recognizes it as a purchase request for a selected advertisement object or a recognition object at the time of inputting a motion gesture, and performs a purchase process.

The present invention can also be embodied as computer-readable codes on a computer-readable recording medium. A computer-readable recording medium includes all kinds of recording apparatuses in which data that can be read by a computer system is stored.

Examples of the computer-readable recording medium include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device and the like, and also implemented in the form of a carrier wave (for example, transmission over the Internet) .

The computer readable recording medium may also be distributed over a networked computer system so that computer readable code can be stored and executed in a distributed manner. And functional programs, codes, and code segments for implementing the present invention can be easily inferred by programmers skilled in the art to which the present invention pertains.

As described above, preferred embodiments of the present invention have been disclosed in the present specification and drawings, and although specific terms have been used, they have been used only in a general sense to easily describe the technical contents of the present invention and to facilitate understanding of the invention , And are not intended to limit the scope of the present invention. It is to be understood by those skilled in the art that other modifications based on the technical idea of the present invention are possible in addition to the embodiments disclosed herein.

10: Smart TV
11: Output section
12: sensing unit
13: Input Interface
13a:
13b: Remote control signal receiving section
14:
14a: broadcast content processing module
14b: Implicit ad implementation module
14c: Explicit ad implementation module
14d: Advertisement object purchase module
14e: object recognition module
14e-1: Object recognition means
14e-2: Position tracking marking means
15:
16: Wired / wireless communication module
STB: Set-top box
20: Remote control
30: Broadcasting network
40: broadcast content server
50: Smart mobile devices
60: Data communication network
70: Associated advertiser terminal group

Claims (20)

A first step of receiving a packetized broadcast content and an ad tag content from a broadcast content server through a broadcast communication network and implementing the broadcast content in a streaming manner in units of broadcasting frames by a smart TV to separate the broadcast content and the advertisement tag content ; And
The smart TV prepares to implement a frame-by-frame streaming method for at least one or more recognized objects through object recognition for each of the objects that are not read as tag data for each advertisement object constituting the advertisement tag content A second step; And
An advertisement switching indicator for switching an advertisement for explicit advertisement switching of both the advertisement object and the recognition object, and a display unit for displaying the advertisement indicator and the implied indicator for each recognition object to the output unit for the broadcast content, A third step of recognizing the user with a streaming method; And a smart TV based emotional advertisement method using object recognition.
The method according to claim 1, wherein the object recognition in the second step comprises:
A tag data existence type corresponding to an advertisement object matching the tag data and a tag data no-existence type corresponding to a general object which does not match the tag data And the tag data is only performed for the tag data no-existence type. The smart TV-based emotional advertisement method using the object recognition is performed.
The method according to claim 2,
The smart TV receives and stores product pattern information for determining whether the smart TV is a product for each of the objects at a predetermined cycle from the broadcast content server via the broadcast communication network before or after receiving the broadcast content A smart TV-based emotional advertisement method using object recognition, characterized by performing the method.
4. The method of claim 3,
A second step of the Smart TV obtaining image information of an object not read by the tag data of each advertisement object of the advertisement tag contents;
A 2-2 step of identifying a pixel included in each piece of image information acquired by the smart TV for discriminating whether or not the image information for the obtained object is a product; And
A second step of the smart TV recognizing the product as a product when the characteristic of the specified pixel and the product pattern information of one of the plurality of products include similar characteristics; And a smart TV based emotional advertisement method using object recognition.
[5] The method of claim 4,
The smart TV utilizes various product pattern information stored in advance to identify a product in each image information,
The product-
A Smart TV-based emotional advertisement method using object recognition, characterized by including various product pattern information, a slanting of various product patterns, an inversion, and a slight angle inclination.
The method according to claim 4, wherein the specification of the pixels in the second-
Characterized by extracting characteristics of the brightness and darkness of the pixels included in each image information acquired by the smart TV, the color of the pixels, the line formed by the pixels, and the shape in which the pixels change with the passage of time, Smart TV based emotional advertising method using.
5. The method of claim 4,
Wherein the smart TV determines that the smart TV is in a similar range to a product having product pattern information having pixels having characteristics similar to those of one pixel of the image information.
5. The method of claim 4, wherein after the third step,
When the Smart TV receives the advertisement switching indicator selection signal through the input interface, performs an explicit advertisement according to the implementation of the target markers on the advertisement object or the recognition object matching with each tag data included in the broadcast transmission frame currently implemented in the broadcast content Step 4; The method of claim 1, further comprising the steps of:
The method as claimed in claim 8,
When the Smart TV receives a selection signal for one of a plurality of advertisement objects and a plurality of recognition objects through the input interface during the execution of the explicit advertisement, A fifth step of judging a purchase request when the input signal is received and performing a purchase procedure; The method of claim 1, further comprising the steps of:
10. The method according to claim 9,
A second step of reading the tag data of each advertisement object included in the separated advertisement tag contents; And
A second step (2-2) of setting the location tracking marking for tracking for each of the advertisement objects using the image information included in the tag data for each advertisement object;
A second step of the smart TV performing object recognition on at least one or more objects not read as tag data for each advertisement object on the advertisement tag contents;
(2-4) receiving additional tag data for each recognition subject in response to transmission of a query message to the broadcast content server through the broadcast communication network for the recognized recognition object; And
A 2-5 step of the smart TV performing object recognition on the broadcast content for each recognition object and setting a position tracking marking for tracking the recognition object; The method of claim 1, further comprising the steps of:
[Claim 10] The method of claim 10, wherein in step 2-5,
When the position on the UI screen of each recognition object is changed or the stereoscopic view is changed in the UI screen of the output unit in units of each broadcast transmission frame on the broadcast content, Wherein the real-time change data is generated so as to be stored in the storage unit of the smart TV, and then utilized to utilize the real-time change data stored at the time of tracking.
11. The method of claim 10,
A third step of the Smart TV setting an implicit effect on the advertisement object and the recognition object on which the position tracking marking is set;
(3-2) the smart TV realizes the implied indicator reflecting the implied effect of the advertisement object and the recognized object with the position tracking marking set to the output unit;
A third step of implementing a tracking effect on an indication indicator for each of the advertisement object and the recognition object in which the position tracking marking is set when the smart TV realizes broadcasting contents in a streaming manner in units of broadcasting frames by the output unit; And
3-4) the Smart TV waits for reception of the advertisement switching indicator selection signal from the input interface for explicit advertisement switching; The method of claim 1, further comprising the steps of:
[12] The method of claim 12,
A subliminal effect for indirectly recognizing a user of the smart TV implicitly before an explicit exposure of an advertisement object and a recognition object in which the location tracking marking is set when the broadcast content is implemented in a streaming manner; And a smart TV based emotional advertisement method using object recognition.
[14] The method of claim 13, wherein the subliminal effect of step 3-2)
And an empty-image including only the implied indicator is inserted between broadcast images including each of the advertisement objects constituting the broadcast transmission frame. Smart TV based emotional advertising method.
[12] The method of claim 12,
A Smart TV based emotional advertisement method using object recognition, characterized by color change setting, backlight setting, ad bar setting, status bar setting, icon setting, and border color setting.
The method as claimed in claim 12,
When implementing the tracking effect on the indications of each of the advertisement object and the recognition object in which the smart TV is set with the position tracking marking,
Wherein the position and shape of the ambiguity indicator according to the object recognition for each of the advertisement object and the recognition object set with the position tracking marking are also converted and implemented to realize the smart television based emotional advertising method using the object recognition.
The method as claimed in claim 12,
Wherein the smart TV is performed by comparing the image information included in the broadcast content with the image information acquired for each recognition object with respect to each recognition object.
18. The method of claim 17,
3-3 (a) in which the smart TV identifies a pixel included in image information included in the broadcast content for each recognition object; And
When the smart TV determines that the characteristic of the specified pixel with respect to the image information of each recognition object and the image information acquired for each object include similar characteristics, the position tracking mark is determined as the same recognition object and the position or stereoscopic view is changed (B) a tracking effect is realized by moving the image information to a position of image information corresponding to the recognized object to be implemented; And a smart TV based emotional advertisement method using object recognition.
19. The method of claim 18,
When the smart TV receives the advertisement switching indicator selection signal, the output unit receives a selection signal for one of the object markers and the object markers for the advertisement object and the recognition object together with the broadcast content, A step 4-1 of implementing the advertisement through the tag data for the advertisement data;
A step 4-2 of implementing a tracking effect using an object marker for each of an advertisement object and a recognition object in which the location tracking marking is set when the broadcasting contents are implemented in the streaming method of the broadcasting frame in the smart TV; And
A step S4 of the Smart TV receiving a selection signal for one of the object markers for each of the advertisement object and the recognition object from the input interface; And a smart TV based emotional advertisement method using object recognition.
[19] The method of claim 19,
4-2 (a) for the smart TV to identify pixels included in the image information included in the broadcast content for each recognition object; And
When the smart TV determines that the characteristic of the specified pixel with respect to the image information of each recognition object and the image information acquired for each object include similar characteristics, the position tracking mark is determined as the same recognition object and the position or stereoscopic view is changed (B) performing a tracking effect by moving to a position of image information corresponding to a recognized object to be implemented; And a smart TV based emotional advertisement method using object recognition.

Images