KR101506717B1 - Smart-TV with logotional advertisement function by object recognition - Google Patents

Abstract

The present invention relates to a smart TV having an object recognition sensibility advertisement function. The present invention relates to a method and apparatus for receiving broadcast content and an advertisement tag content packetized from a broadcast content server through a broadcast communication network to implement broadcast content in a streaming manner in units of broadcasting frames, separating the broadcast content from the advertisement tag content, A broadcast content processing module for preparing a frame-by-frame streaming method implementation for at least one or more recognized objects through object recognition for each of the objects that are not read with tag data for each advertisement object constituting the advertisement tag content; And an advertisement switching indicator for switching an advertisement for explicit advertisement switching for both the advertisement object and the recognition object, and an advertisement indicator for each of the advertisement object and each recognition object in a frame-by-frame streaming manner to the output unit for the broadcast content An implicit ad implementation module that notifies the user of the implementation of the ad; .

Description

{Smart-TV with logotype advertisement function by object recognition}

The present invention relates to a smart TV having an object recognition sensibility advertisement function, and more particularly, to a smart TV having an object recognition sensibility advertisement function, and more specifically, To provide an invisible emotional advertisement in order to minimize interference with viewing of broadcast contents by directly providing a non-visible and implicitly provided advertisement.

The main purpose of content or advertising is to increase the effectiveness of broadcasting. Therefore, conventionally, a method of separating the contents from the advertisement and separately viewing the contents has been mainly used.

However, there has been a problem that it is inconvenient for people who want to watch only contents by separating the contents and the advertisement and providing commercial broadcasting separately.

In addition, if a smart TV user cares about a product other than an advertisement object by performing an advertisement in a preset manner for a specific product in the broadcast content, there may be a restriction that it is difficult to acquire information and purchase information.

Accordingly, in order to solve the conventional problems in the related art, not only the scope of the advertisement object is expanded on the basis of the user, but also the effect on the advertisement is maximized, New technology development is required.

[Related Technical Literature]

1. A smart pad having an advertisement system and an advertising system and method thereof (Patent Application No. 10-2011-0032083)

2. System and method for providing advertisement through a moving picture medium running on a smart device (Patent Application No. 10-2011-0107272)

3. Smart advertising information offer system (Patent Application No. 10-2011-0000401)

SUMMARY OF THE INVENTION The present invention has been made to solve the above-mentioned problems, and it is an object of the present invention to not only allow advertisement for a general object other than an advertisement area provided in a smart TV, So as to provide an invisible emotional advertisement for minimizing the viewing disturbance on the broadcast content.

In addition, the present invention minimizes the inconvenience of viewing, which is a side effect of maximizing the effect of the advertisement provided by the advertiser, but also provides the viewer of the broadcast contents The present invention is to provide a smart TV having an object recognition sensibility advertisement function capable of providing detailed advertisement detail information through explicit advertisement provision when necessary while minimizing the viewing disturbance.

However, the objects of the present invention are not limited to the above-mentioned objects, and other objects not mentioned can be clearly understood by those skilled in the art from the following description.

In order to accomplish the above object, a smart TV having an object recognition / emotional advertisement function according to an embodiment of the present invention is a streaming method in a broadcast transmission frame unit, packetized from a broadcast content server through a broadcast communication network The broadcast content and the advertisement tag content, separating the broadcast content from the advertisement tag content, and recognizing at least one or more of the broadcast content and the advertisement tag content through object recognition for each of the objects not read as tag data for each advertisement object constituting the advertisement tag content A broadcast content processing module for preparing a frame-by-frame streaming method implementation of the broadcast content with respect to a recognition object; And an advertisement switching indicator for switching an advertisement for explicit advertisement switching for both the advertisement object and the recognition object, and an advertisement indicator for each of the advertisement object and each recognition object in a frame-by-frame streaming manner to the output unit for the broadcast content An implicit ad implementation module that notifies the user of the implementation of the ad; . At this time, the implied indicator may be a user interface effect for indirectly recognizing the broadcast contents in a streaming manner implicitly to the user of the smart TV 10 before the explicit exposure of the advertisement object and the recognition object. And the implicit indicator may be a subliminal effect. Also, the hint indicator can be implemented as a color change, a halo, an ad bar, a status bar, an icon, and a border color for an advertisement object or a recognition object.

At this time, according to a request of the broadcast content processing module for object recognition, a tag data existence corresponding to an advertisement object matching with the tag data and a tag data existence corresponding to a general object not matching with the tag data An object recognition module for performing tag data no-existence only after being divided into non-existent type (Tag data no-existence); Further comprising:

The object recognition module may receive product pattern information for determining whether the product is a product for each of the objects at a preset cycle from the broadcast content server through the broadcast communication network before or after receiving the broadcast content And then stores the result in the storage unit.

In addition, the object recognition module may acquire image information about an object that is not read with tag data for each advertisement object of the advertisement tag content, and determines whether each of the image information about the acquired object is a product or not Object recognizing means for recognizing a product included in each acquired image information as a product when the characteristics of the specified pixel and product pattern information of one of the plurality of products include similar characteristics and recognizing the product as an object; And a control unit.

Also, the object recognizing means uses various pre-stored product pattern information for discriminating a product in each image information, and the product pattern information includes various product pattern information, a slant of various product patterns, And a slightly inclined angle.

In addition, the object recognizing means recognizes characteristics of the contrast and darkness of the pixels included in each image information acquired at the time of specifying the pixel, the color of the pixel, the line formed by the pixel, and the shape of the pixel varying with time .

In addition, the object recognizing unit may determine that the smart TV is in a range similar to a product having product pattern information having pixels having characteristics similar to the pixel characteristics of one image information.

In addition, when an advertisement switching indicator selection signal is received through an input interface, an advertisement object matching with each tag data included in a currently broadcast broadcasting frame among broadcast contents or an explicit advertisement for performing an explicit advertisement according to an object marker implementation for a recognition object Ad implementation module; Further comprising:

When the selection signal for one of the plurality of advertisement objects and the plurality of recognition objects is received through the input interface in the course of performing the explicit advertisement, the input gesture input signal An advertisement object purchasing module for determining that the purchase request is a purchase request and performing a purchase procedure; Further comprising:

The broadcast content processing module reads the tag data for each advertisement object included in the separated advertisement tag content, and then reads the tag data for each advertisement object using the image information included in the tag data for each advertisement object, And setting a position tracking marking for tracking.

When the object recognition by the object recognition module is completed for at least one or more objects that are not read with the tag data for each advertisement object on the advertisement tag content, The method of claim 1, further comprising the steps of: receiving supplemental tag data for each recognition object in response to transmitting a query message to the broadcast content server via a communication network, performing object recognition on the broadcast content for each recognition object, And setting the position tracking marking for the light source.

In addition, the position tracking marking for tracking each of the recognized objects may be implemented by changing the position on the UI screen of each of the recognized objects when the implementation is implemented on the UI screen of the output unit in units of each broadcast transmission frame on the broadcast content, Real time change data according to the position change or the stereoscopic view change is automatically generated even if the stereoscopic view is changed, and is stored in the storage unit of the smart TV, and then the real time change data stored at the time of tracking is utilized. do.

In addition, the implicit advertisement implementation module may set an implicit effect on the advertisement object and the recognition object set with the position tracking marking, and may further include a setting unit that sets the location tracking marking on the advertisement object and the recognition object, Wherein the object recognition module notifies the object recognition module of the broadcast content when the broadcast content is implemented in a streaming manner in units of broadcasting frames to the output unit by the object recognition module, So that the tracking effect on the indicator is realized.

In addition, the implicit advertisement implementation module is characterized by waiting for reception of an advertisement switching indicator selection signal from an input interface for explicit advertisement switching.

In addition, the implicit effect may be such that when the broadcast content is implemented in a streaming manner, the advertisement is indirectly recognized indirectly to the user of the smart TV implicitly before the explicit exposure of the advertisement object and the recognition object, And is characterized by being a subliminal effect.

In addition, the subliminal effect is performed by inserting an empty-image including only the indictor indicator between broadcasting images including each advertisement object constituting the broadcast transmission frame .

Further, the indictment indicator is characterized by one of a color change setting, a backlight setting, an adver setting, a status bar setting, an icon setting, and a border color setting.

In addition, the implicit advertisement implementing module may be configured such that, when implementing the tracking effect for the ambiguity indicator for each of the advertisement object and the recognition object for which the position tracking marking is set, And the position and shape of the implicit indicator are also transformed and implemented.

In addition, the object recognition module may include a position tracking marking means for implementing a tracking effect on the implied indicator by comparing the image information included in the broadcast content with the image information acquired for each recognized object, ; Further comprising:

In addition, the position tracking marking means may specify the pixel included in the image information included in the broadcast content for each recognition object, and then determine the characteristics of the pixel specified for the image information of each recognition object, When the image information includes similar characteristics, the position tracking mark is determined as the same recognition object, and the position or the stereoscopic view is changed to move to the position of the image information corresponding to the implemented recognition object, thereby realizing the tracking effect .

In addition, the explicit advertisement implementation module may receive a selection signal for one of the object markers and the object markers for the advertisement object and the recognition object, together with the broadcast content, to the output unit when receiving the advertisement conversion indicator selection signal, And an object marker for each of the advertisement object and the recognition object in which the position tracking marking is set when the broadcast content is implemented in the streaming method in units of the broadcasting frame by the output unit, And notifies the object recognition module that the tracking effect is implemented.

In addition, the explicit advertisement implementation module may wait for receiving a selection signal for one of the object markers for the advertisement object and the recognition object from the input interface.

In addition, the tracking marking unit may identify a pixel included in the image information included in the broadcast content for each recognition object in the tracking effect for the object markers, And when the image information acquired for each object includes similar characteristics, it is determined that the same object is recognized, and the position tracking mark is changed to the position of the image information corresponding to the implemented recognition object by changing the position or stereoscopic view Thereby realizing a tracking effect.

The smart TV having the object recognizing sensibility advertisement function according to the embodiment of the present invention can not only perform an advertisement for a general object other than the advertisement area provided in the smart TV, It is possible to provide an invisible emotional advertisement in order to minimize the interference with the viewing of the broadcast contents.

In addition, the smart TV having the object recognizing sensibility advertisement function according to another embodiment of the present invention can be provided directly to the user who watches the smart TV, but not implicitly, thereby minimizing the viewing disturbance to the broadcast contents, It is possible to provide specific advertisement detailed information through explicit advertisement provision.

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a diagram illustrating an entire system in which a smart TV-based emotional advertisement method using object recognition according to an embodiment of the present invention is implemented; FIG.
Fig. 2 is a diagram showing a configuration of a smart TV in Fig. 1; Fig.
3 is a conceptual diagram illustrating an object recognition technique for an object other than an advertisement object included in broadcast content according to an exemplary embodiment of the present invention.
4 is a conceptual diagram illustrating an implicit advertisement according to an embodiment of the present invention;
FIG. 5 is a flowchart specifically illustrating an object recognition process in a smart TV-based emotional advertisement method using object recognition according to an exemplary embodiment of the present invention.
FIG. 6 is a flowchart specifically illustrating a process of setting a location tracking mark after recognizing an object among smart TV-based emotional advertisement methods using object recognition according to an embodiment of the present invention.
FIG. 7 is a general flowchart showing a smart TV-based emotional advertisement method according to an embodiment of the present invention; FIG.
FIG. 8 is a flowchart for explaining each step of the smart TV-based emotional advertisement method of FIG. 7;

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, a detailed description of preferred embodiments of the present invention will be given with reference to the accompanying drawings. In the following description of the present invention, detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear.

In the present specification, when any one element 'transmits' data or signals to another element, the element can transmit the data or signal directly to the other element, and through at least one other element Data or signal can be transmitted to another component.

1 is a diagram illustrating an entire system in which a smart TV-based emotional advertisement method using object recognition according to an embodiment of the present invention is implemented. 1, the entire system in which the smart TV-based emotional advertisement method is implemented includes a smart TV 10, a remote controller 20, a broadcast communication network 30, a broadcast content server 40, a smart mobile device 50, A data communication network 60 and an affiliated advertiser terminal group 70.

1, the smart TV 10 is formed as a set-top box separate type having a separate set-top box (STB) and performs data transmission / reception with the broadcast content server 40 through the broadcast communication network 30 Alternatively, it may be formed as a set-top box-integrated type and perform data transmission / reception with the broadcast content server 40 without a separate set-top box (STB).

The smart TV 10 performs an implicit and explicit advertisement for each of the advertisement objects corresponding to the tag data constituting the tag content received together with the broadcast content. In addition, the smart TV 10 according to the present invention is characterized in that it further provides an implicit and explicit advertisement through object recognition for an object other than the advertisement object included in the broadcast content.

The broadcast communication network 30 is a high-speed wired or bridged periodic network for broadcasting in the form of a large capacity, a long-distance voice, and a data service, and may be a wired or wireless Internet. The broadcast communication network 30 plays a role for the broadcast content server 40 to transmit the broadcast content to the smart TV 10 and other systems for broadcasting.

The broadcast content server 40 includes a broadcast DB 41 and an advertisement DB 42. Also, in this specification, a DB may mean a functional and structural combination of software and hardware for storing information corresponding to each database. The DB may be implemented as at least one table, and may further include a separate DBMS (Database Management System) for searching, storing, and managing information stored in the database. Also, it can be implemented in various ways such as a linked-list, a tree, and a relational database, and includes all data storage media and data structures capable of storing information corresponding to a database.

The broadcast content server 40 receives the advertisement data through the data communication network 60 from each of the affiliated advertiser terminals constituting the affiliated advertiser terminal group 70 for each of the advertisement objects included in the broadcast content stored in the broadcast DB 41 do. In this case, it is preferable that the advertisement data include image information and advertisement detailed information for each advertisement object, and it is preferable that the advertisement data is received by receiving broadcast data of each broadcast content when the advertisement data is received.

Here, the data communication network 60 may be a high-speed period network of a large communication network capable of a large-capacity, long-distance voice and data service, and may be a next generation wired and wireless network for providing Internet or high-speed multimedia service. When the data communication network 60 is a mobile communication network, it may be a synchronous mobile communication network or an asynchronous mobile communication network. As an embodiment of the asynchronous mobile communication network, a WCDMA (Wideband Code Division Multiple Access) communication network is exemplified. In this case, although not shown in the drawing, the data communication network 60 may include a Radio Network Controller (RNC). Meanwhile, although the WCDMA network is exemplified, it may be a next generation communication network such as a 3G LTE network or a 4G network, or an IP network based on other IP. The data communication network 60 serves to transmit signals and data between the broadcasting contents server 40, a plurality of advertiser terminal units constituting the advertiser terminal group 70, and other systems.

On the other hand, the broadcast content server 40 generates tag data for each of the advertisement objects, and then all the generated tag data are numbered and stored in the advertisement DB 42 as advertisement tag contents. Meanwhile, in an embodiment of the present invention, the broadcast content server 40 preferably includes image information and advertisement detail information for use in object recognition for each advertisement object received at the time of generating each tag data, It is preferable that the advertisement DB 42 divides the broadcasting contents into broadcasting transmission frames and stores the metadata together with the respective advertisement tag contents when the advertisement contents are stored.

The broadcast content server 40 transmits the broadcast content stored in the broadcast DB 41 and the advertisement DB 42 in response to a request for listening to the broadcast content stored in the broadcast DB 41 of the smart TV 10 through the broadcast communication network 30. [ And transmits the packetized advertisement tag contents to the smart TV 10 through the broadcast communication network 30 (S13).

The smart mobile device 50 is provided for confirming detailed information on the advertisement object based on the touch screen when the user of the smart TV 10 wants detailed information on the advertisement object according to the explicit advertisement implementation after the implicit advertisement implementation do.

Fig. 2 is a diagram showing a configuration of the smart TV 10 in Fig. 3 is a conceptual diagram illustrating an object recognition technique for an object other than an advertisement object included in broadcast content according to an exemplary embodiment of the present invention. 4 is a conceptual diagram for explaining an implicit advertisement according to an embodiment of the present invention. 2, the smart TV 10 includes an output unit 11, a sensing unit 12, an input interface 13, a control operation unit 14, a storage unit 15, and a wired / wireless communication module 16, .

The input interface 13 includes an input unit 13a and a remote control signal receiving unit 13b. The control operation unit 14 includes a broadcast content processing module 14a, an implicit advertisement implementation module 14b, an explicit advertisement implementation module 14c, an advertisement object purchase module 14d and an object recognition module 14e do. Herein, a module may mean a functional and structural combination of hardware for carrying out the technical idea of the present invention and software for driving the hardware. For example, the module may mean a logical unit of a predetermined code and a hardware resource for executing the predetermined code, and it does not necessarily mean a physically connected code or a kind of hardware. Can be easily deduced to the average expert in the field of < / RTI >

Hereinafter, the entire system in which the Smart TV-based emotional advertisement method is implemented will be described in detail, focusing on the configuration of the control operation unit 14. [ The broadcast content processing module 14a controls the wired / wireless communication module 16 to receive the packetized broadcast content and the advertisement tag content from the broadcast content server 40 through the broadcast communication network 30 in a streaming manner for each broadcast transmission frame , And receives broadcasting contents and advertisement tag contents packetized in units of broadcast transmission frames. The broadcast content processing module 14a separates the broadcast content and the advertisement tag content from the packet in the broadcast transmission frame unit, and then prepares for implementation of the broadcast content in the output unit 11 in a frame-by-frame streaming manner.

More specifically, the broadcast content processing module 14a receives the broadcast content stored in the broadcast DB 41 of the smart TV 10 from the broadcast content server 40 through the broadcast communication network 30, And controls the module 16. The broadcast content processing module 14a transmits the broadcast content stored in the broadcast DB 41 of the broadcast content server 40 and the advertisement tag content stored in the advertisement DB 42 of the broadcast content server 40 to the broadcast transmission frame And controls the wired / wireless communication module 16 to receive from the broadcasting contents server 40 through the broadcasting communication network 30 in a packetized state.

The broadcast content processing module 14a separates the packetized broadcast content and the advertisement tag content received from the broadcast content server 40 in a streaming manner on a broadcast broadcast frame basis, Reads the tag data for each advertisement object, and stores the tag data in the storage unit 15.

The broadcast content processing module 14a sets the location tracking marking for tracking for each advertisement object using the image information included in the tag data for each of the read advertisement objects. Here, the position tracking marking serves as a marker for tracking each advertisement object in the implementation of the advertisement object to the output unit 11 according to each broadcast transmission frame on the advertisement content. More specifically, even if the position of each of the advertisement objects is changed or the stereoscopic view is changed on the broadcast content according to the setting of the position tracking marking, the realtime change data due to the position change or stereoscopic view change is automatically generated by the broadcast content processing module 14a And is stored in the storage unit 15 so that the position of the advertisement object on the UI screen realized on the output unit 11 is automatically tracked by using the stored real-time change data when tracking the advertisement object.

The broadcast content processing module 14a may further perform object recognition for automatically performing recognition of an object other than the advertisement object in broadcast contents of each broadcast transmission frame in an additional process.

That is, the broadcast content processing module 14a performs object recognition for an object that is not read as tag data for each advertisement object of the advertisement tag content received in a streaming manner for each broadcast transmission frame. It is preferable that the broadcast content processing module 14a individually performs recognition of each of the stereoscopic viewpoints at the time of object recognition for each recognition object.

The broadcast content processing module 14a transmits a query message to the broadcast content server 40 through the broadcast communication network 30 for the recognized object, and when there is additional tag data for the object to be recognized, And controls the communication module 16. The broadcast content processing module 14a performs object recognition on the image information of the broadcast content for each recognition object and sets a position tracking marking for tracking on the recognition object. Here, the position tracking marking for tracking each recognition object is implemented by UI screen of the output unit 11 for each broadcast transmission frame on the broadcast content, when the position on the UI screen of each recognition object is changed or the stereoscopic view is changed The real time change data corresponding to the change of the position of each recognition object or the change of the stereoscopic view is automatically generated by the broadcast content processing module 14a and stored in the storage unit 15 of the smart TV, And is set so that the stored real-time change data is used to automatically track the position of the recognition object on the UI screen implemented on the output unit 11. [

The broadcast content processing module 14a implements the advertisement conversion indicator in the output unit 11 and receives the streaming method in units of broadcasting frames to start outputting the broadcasting contents in the buffering state on the storage unit 15 .

The object recognition process for the recognition object other than the advertisement object through the linkage between the broadcast content processing module 14a and the object recognition module 14e will be described in detail in the following description of the object recognition module 14e.

The implicit advertisement implementing module 14b implements the advertisement conversion indicator in the output unit 11 according to the start of outputting the broadcast content of the broadcast content processing module 14a, And implements an implicit indicator for each advertising object in which the implicit effect is reflected.

More specifically, the implicit advertisement implementation module 14b establishes an implicit effect on the recognized object to which the position tracking marking is set, the advertisement object to which the position tracking marking is set. Here, the implicit effect implies a user interface effect for indirectly recognizing the broadcast contents in the streaming manner implicitly to the user of the smart TV 10 before the explicit exposure of the advertisement object and the recognition object .

In an embodiment of the present invention, a subliminal effect may be used as an implicit effect, and a subliminal effect may be one of a plurality of broadcast images including an advertisement object constituting a broadcast transmission frame And inserting an empty-image containing only an implicit indicator (see FIG. 4).

On the other hand, an example of the color change setting for the skirt and the backlight setting for the shoe can be exemplified with respect to the advertisement object or the recognition object in the empty image for the subliminal effect as shown in Fig. 4, Another example is the adver, status bar, icon, and border color settings for an object or a recognized object.

The implicit advertisement implementing module 14b implements an implicit indicator according to the setting of the implicit effect for the advertisement object and the recognition object together with the broadcasting contents for each broadcasting transmission frame to the output unit 11. [ As described above, the hint indicator can be implemented as a color change, an halo, an ad bar, a status bar, an icon, and a border color for an advertisement object or a recognition object.

The implicit advertisement implementing module 14b implements the tracking effect on the advertising object or the implicit indicator for each recognition object according to the time flow for the broadcasting contents for each broadcasting transmission frame to the output unit 11. [ At this time, the implicit advertisement implementing module 14b is not directly performed in implementing the tracking effect on the recognition object, but is performed through a request to the position tracking marking means 14e-2 to be described later.

Here, the tracking effect means to implement the position or shape of the indictor according to the object recognition for the object to be marked with the position tracking marking and the object to be recognized with the position tracking marking.

The implicit advertisement implementation module 14b waits for the advertisement switching indicator selection signal from the input interface 13 for explicit advertisement switching and then determines whether or not to receive the advertisement switching indicator selection signal and transmits the advertisement switching indicator selection signal to the explicit advertisement implementation module 14c to terminate the implicit ad output process.

The explicit advertisement implementing module 14c receives the advertisement switching indicator selection signal through the input interface 13 and displays the object corresponding to the advertisement object for the advertisement object matched with the tag data included in the currently broadcast broadcasting frame, Perform an explicit advertisement according to the marker implementation.

More specifically, the explicit advertisement implementing module 14c sends the advertisement switching indicator selection signal to the output unit 11 when the advertisement switching indicator selection signal is received by the implicit advertisement implementing module 14b, An object marker is implemented for the object and the recognition object, and the advertisement is implemented through the tag data for the advertisement object or the recognition object selected when the object marker is selected.

On the other hand, when the explicit advertisement implementing module 14c receives a selection input for one of the object markers, the explicit advertisement implementing module 14c generates a selection mark in accordance with the recognition data previously stored in the storage unit 15 through the sensing unit 12 . As one example, when the sensing unit 12 is implemented as a recognition module of a camera photographing system, a recognition signal may be recognized as a selection signal at a place where a user's eyes are frequently seen as a result of eye recognition through a camera photographing, And recognizing an object marker corresponding to the advertisement object matching the interest category information stored on the storage unit 15 with respect to the user.

The explicit advertisement implementing module 14c implements a tracking effect using an object marker according to an advertisement object or an object marker according to a flow of broadcast contents for each broadcasting frame to the output unit 11. [ At this time, the explicit advertisement implementing module 14c is not directly performed in implementing the tracking effect on the recognition object but is performed through a request to the position tracking marking means 14e-2 to be described later.

Here, the tracking effect means to convert the position of the object marker according to the object recognition for the object to be marked with the position tracking marking and the object to be recognized with the position tracking marking.

The explicit advertisement implementing module 14c waits for receiving a selection signal for a plurality of advertisement objects and a plurality of recognition objects from the input interface 13. [

The explicit advertisement implementation module 14c notifies the advertisement object purchase module 14d of the determination result through determination of whether or not the selection signal is received for one of a plurality of advertisement objects and a plurality of recognition objects, Complete.

As a result of the explicit advertisement implementation module 14c, when the advertisement selection module 14d receives the selection signal for one of the plurality of advertisement objects through the input interface 13 in the process of performing the explicit advertisement, When the motion gesture input signal through the input interface 13 is received, it is determined that the purchase request is made and the purchase procedure is performed.

More specifically, the advertisement purchase module 14d receives a motion gesture input signal from the remote controller 20 for a selected advertisement object or a recognized object, in response to a selection signal for one of a plurality of advertisement objects and a plurality of objects to be recognized, And receives a motion gesture input signal through the input unit 13a or receives a motion gesture input signal to the input unit 13a, and recognizes the received target object as a purchase request for a recognized object or a recognition target object.

The object recognition module 14e is divided into object recognition means 14e-1 and position tracking marking means 14e-1. First, when the broadcast content processed by the broadcast content processing module 14a and the broadcast content and the advertisement tag content for the advertisement tag content are separated from each other by the broadcast content processing module 14a, the object recognition means 14e- And acquires image information about an object that is not read with star tag data. That is, referring to FIG. 3, in the case of object recognition by the object recognizing means 14e-1, a tag data existence type corresponding to the advertisement object matching with the tag data, (Tag data no-existence) corresponding to a general object which is not a tag object, and only for the latter tag data no-existence.

Here, each tag data contains information on one advertisement object. On the other hand, the object recognizing means 14e-1 obtains image information based on digital data obtained by converting an analog video signal obtained at the time of photographing of an object. To this end, product pattern information for discriminating a product to an object It is preferable to receive the broadcast content from the broadcast content server 40 through the broadcast communication network 30 at a preset period before storing or storing the received broadcast content in the storage unit 15 before or after receiving the broadcast content.

 The object recognizing means 14e-1 specifies a pixel included in each image information acquired for discriminating whether or not the acquired image information for each object is a product. More specifically, the object recognizing means 14e-1 utilizes various product pattern information stored in the storage unit 15 in order to discriminate the products from each image information, and the various product pattern information itself or the inclined The product of the image information is compared with the pattern of the product included in the image information, and the product in the image information is discriminated. In the first step for product discrimination, the object recognizing means 14e-1 recognizes the pixels included in each acquired image information, that is, the lightness and darkness of the pixel, the color of the pixel, the line formed by the pixel, And extracts the characteristics of the pixel from the shape or the like which changes according to the flow.

The object recognizing means 14e-1 judges the product characteristic of the pixel specified for each object and the product pattern information of one of the plurality of products stored in the storage unit 15 as similar products, and recognizes the product as an object . More specifically, the object recognizing means 14e-1 determines the similarity range in which the product pattern information having the pixels including the characteristics similar to those of the pixels for one piece of image information specified for each object exists. That is, the object recognizing means 14e-1 judges the pixel from which the characteristic is extracted to be the reference pixel, judges the similarity between the reference pixel and the surrounding pixels, and judges the same product if the similarity is determined. Here, the similarity is a concept that includes a difference in brightness between pixels or a difference in distance between pixels.

After the object recognition unit 14e-1 recognizes the object, the position tracking marking unit 14e-2 sets the position tracking mark by the broadcast content processing module 14a, Implements the tracking effect when an implicit advertisement by the explicit advertisement implementation module 14b is performed or an explicit advertisement by the explicit advertisement implementation module 14c is performed.

In other words, the position tracking marking means 14e-2 is a means for comparing the image information included in the broadcast content with the image information acquired by the object recognition means 14e-1 for each of the objects to be recognized, The pixel included in the image information included in the broadcast content is specified for each recognition object as a first step for discriminating whether or not each recognition object is included in the broadcast content.

To be more specific, the position tracking marking means 14e-2 automatically applies the tracking effect according to the position change or the stereoscopic view change even if the position of the recognition object is changed or the stereoscopic view is changed when the pixel included in the image information is changed The image information specifies all the pixel characteristics of the pattern information itself or the inclined, inverted, slightly inclined, and the like of the image information. In addition, the position tracking marking means 14e-2 determines the characteristics of the pixel from the shape of the pixel included in the image information, such as the contrast and darkness of the pixel, the color of the pixel, the line formed by the pixel, .

The position tracking marking means 14e-2 may be used as the same recognition object when the characteristic of the pixel specified for the image information of each recognition object and the image information acquired by the object recognition means 14e-1 include similar characteristics And the position tracking mark is moved to the position of the image information corresponding to the recognized recognition object by changing the position or stereoscopic view to implement the tracking effect.

FIG. 5 is a flowchart specifically illustrating an object recognition process in a smart TV-based emotional advertisement method using object recognition according to an embodiment of the present invention. 1 to 5, the smart TV 10 receives packetized broadcast content and advertisement tag content from the broadcast content server 40 through the broadcast communication network 30 in a streaming manner for each broadcast transmission frame, And then obtains image information of an object that is not read with the tag data of each advertisement object of the advertisement tag content (S1). In the case of object recognition by the smart TV 10, the tag data existence type corresponding to the advertisement object matched with the tag data and the tag data existence ratio corresponding to the general object which does not match the tag data And is performed only for the latter tag data no-existence (Tag data no-existence).

Here, each tag data contains information on one advertisement object. On the other hand, the smart TV 10 acquires image information on the basis of the converted digital data of the analog video signal obtained at the time of photographing the object. To this end, the smart TV 10 receives product pattern information for discriminating the product of the object, It is preferable that the broadcast content server 40 receives the broadcast content from the broadcast content server 40 via the broadcast communication network 30 at a predetermined period and stores the received content in the storage unit 15.

After step S1, the smart TV 10 specifies a pixel included in each image information acquired for discriminating whether or not the image information about the object acquired in step S1 is a product (S2). More specifically, the smart TV 10 utilizes various product pattern information stored in advance in the storage unit 15 in order to identify a product in each image information. The various items of the product pattern information or the inclination of various product patterns, And a product of the product in the image information is compared with the pattern of the product included in the image information. The step S2 of the first step for product discrimination is performed by the smart TV 10 in accordance with the specification of the pixels included in each image information acquired in the step S1, Line, and a shape in which pixels change with time, and the like.

After step S2, the smart TV 10 determines that the product characteristic of the pixel specified in step S2 and the product pattern information of one of the plurality of products stored in the storage unit 15 include similar characteristics, (S3). More specifically, the smart TV 10 determines the similarity range in which the product pattern information having the pixels including characteristics similar to those of the pixels for one piece of image information specified in step S2. That is, the smart TV 10 determines that the pixel from which the characteristic is extracted is the reference pixel, judges the similarity between the reference pixel and the surrounding pixels, and determines that the product is the same if the similarity is determined. Here, the similarity is a concept that includes a difference in brightness between pixels or a difference in distance between pixels.

FIG. 6 is a flowchart specifically illustrating a process of implementing a tracking effect using a location tracking mark after setting a location tracking mark after recognizing an object among smart TV-based emotional advertisement methods using object recognition according to an embodiment of the present invention. Referring to FIGS. 1 to 6, after the object recognition for the recognition object other than the advertisement object as shown in FIG. 5 is completed on the broadcast content, the smart TV 10 displays the advertisement object, the implicit advertisement for the recognition object, And performs a position tracking marking process for applying the tracking technique used. Hereinafter, as shown in FIG. 6, when a tracking effect is applied to an implicit indicator in an implicit advertisement using a position tracking mark for a recognition object, or when a tracking effect using an object marker is recognized in an explicit advertisement, an implicit indicator or an object marker And the object recognition technique for the corresponding recognized object is specifically shown.

The smart TV 10 compares the image information included in the broadcast content with the image information acquired in step S1 of FIG. 5 for each of the recognized objects with respect to each of the recognized objects, As a first step for discrimination, the pixels included in the image information included in the broadcast content are specified for each recognition object (S4).

More specifically, in order to apply the tracking effect according to the position change or the stereoscopic view change, even if the position of the object to be recognized is changed or the stereoscopic view is changed when the pixel included in the image information is changed, Specifies all pixel characteristics for a tilted, inverted, or slightly angled tilt of information or image information. In addition, the smart TV 10 extracts characteristics of a pixel from the brightness and darkness of a pixel, the color of the pixel, the line formed by the pixel, and the shape in which the pixel changes with the passage of time when specifying a pixel included in the image information.

After step S4, if the characteristic of the specified pixel with respect to the image information of each recognition object in step S5 and the image information acquired in step S1 include similar characteristics, It is determined that the object is the object and the position tracking mark is changed in position or stereoscopic view to move to the position of the image information corresponding to the implemented object to be recognized (S5), thereby implementing the tracking effect.

FIG. 7 is a general flowchart showing a smart TV-based emotional advertisement method according to an embodiment of the present invention. 1 to 7, the smart TV 10 receives the packetized broadcast content and the advertisement tag content from the broadcast content server 40 through the broadcast communication network 30 in a streaming manner for each broadcast transmission frame, And the advertisement tag content, and prepares for implementation of the streaming method in the output unit 11 in units of broadcasting frames for broadcasting contents (S10).

Here, the broadcast communication network 30 is a high-speed wired or bridged termi- nal network for broadcasting in the form of a large capacity, a long-distance voice, and a data service, and may be a wired or wireless Internet. The broadcast communication network 30 plays a role for the broadcast content server 40 to transmit the broadcast content to the smart TV 10 and other systems for broadcasting.

On the other hand, the broadcast content server 40 includes a broadcast DB 41 and an advertisement DB 42. Also, in this specification, a DB may mean a functional and structural combination of software and hardware for storing information corresponding to each database. The DB may be implemented as at least one table, and may further include a separate DBMS (Database Management System) for searching, storing, and managing information stored in the database. Also, it can be implemented in various ways such as a linked-list, a tree, and a relational database, and includes all data storage media and data structures capable of storing information corresponding to a database.

After step S10, the smart TV 10 is an implicit advertisement outputting process. The smart TV 10 is implemented in accordance with the temporal flow of the broadcasting contents to the output unit 11 for each broadcast broadcasting frame, and the advertisement switching indicator and the indication indicators (S20).

 After step S20, the smart TV 10 receives the advertisement switching indicator selection signal through the input interface 13, and performs the flow of the broadcasting contents to the output unit 11 according to the temporal flow, An explicit advertisement according to the implementation of the object markers for the advertisement object is performed in the separated advertisement tag contents according to the process of S30.

After receiving the selection signal for one of the plurality of advertisement objects through the input interface 13 in the process of performing the explicit advertisement by the step S30 after the step S30, When a motion gesture input signal through the input interface 13 is received, it is determined that the purchase request is made and a purchase procedure is performed (S40).

FIG. 8 is a specific flowchart of steps (S10) to (S40) of the smart TV-based emotional advertisement method of FIG. 1 to 8, the broadcast content server 40 transmits the broadcast content stored in the broadcast DB 41 from each affiliated advertiser terminal constituting the affiliated advertiser terminal group 70 to each of the advertisement objects included in the broadcast content, (Step S11). Here, the data communication network 60 may be a high-speed period network of a large communication network capable of a large-capacity, long-distance voice and data service, and may be a next generation wired and wireless network for providing Internet or high-speed multimedia service. When the data communication network 60 is a mobile communication network, it may be a synchronous mobile communication network or an asynchronous mobile communication network. As an embodiment of the asynchronous mobile communication network, a WCDMA (Wideband Code Division Multiple Access) communication network is exemplified. In this case, although not shown in the drawing, the data communication network 60 may include a Radio Network Controller (RNC). Meanwhile, although the WCDMA network is exemplified, it may be a next generation communication network such as a 3G LTE network or a 4G network, or an IP network based on other IP. The data communication network 60 serves to transmit signals and data between the broadcasting contents server 40, a plurality of advertiser terminal units constituting the advertiser terminal group 70, and other systems.

It is preferable that the advertisement data include image information for each advertisement object, and it is preferable that the advertisement data is received by receiving broadcast data of each broadcast content when the advertisement data is received. Also, in this specification, a DB may mean a functional and structural combination of software and hardware for storing information corresponding to each database. The DB may be implemented as at least one table, and may further include a separate DBMS (Database Management System) for searching, storing, and managing information stored in the database. Also, it can be implemented in various ways such as a linked-list, a tree, and a relational database, and includes all data storage media and data structures capable of storing information corresponding to a database.

The broadcast content server 40 generates tag data for each of the advertisement objects, and then all the generated tag data is numbered and stored in the advertisement DB 42 as advertisement tag contents (S12). Meanwhile, in one embodiment of the present invention, the broadcast content server 40 preferably includes image information for use in object recognition for each advertisement object received in step S11 when each tag data is generated And the advertisement DB 42, it is preferable to generate meta data according to the broadcasting broadcasting frames of the broadcasting contents and to store the metadata together with the respective advertisement tag contents.

After the step S12, the broadcast content server 40 transmits the broadcast content 41 stored in the broadcast DB 41 in response to a request for listening to the broadcast content stored in the broadcast DB 41 of the smart TV 10 through the broadcast communication network 30, And the advertisement DB contents stored in the advertisement DB 42 are packetized for each broadcasting transmission frame and transmitted to the smart TV 10 through the broadcasting communication network 30 (S13).

In step S13, the smart TV 10 separates the packetized broadcast content received from the broadcast content server 40 in a streaming manner for each broadcast transmission frame and the advertisement tag content, Tag data per object is read (S14).

After step S14, the smart TV 10 sets up a position tracking marking for tracking for each advertisement object using the image information included in the tag data for each advertisement object read in step S14 (S15). Here, the position tracking marking serves as a marker for tracking each advertisement object in the implementation of the advertisement object to the output unit 11 according to each broadcasting transmission frame on the advertisement content. More specifically, even if the position of each of the advertisement objects is changed or the stereoscopic view is changed on the broadcast content in accordance with the setting of the position tracking marking in step S15, the real time change data according to the position change or stereoscopic view change is automatically transmitted to the smart TV 10 And stored in the storage unit 15 so that the position of the advertisement object on the UI screen realized on the output unit 11 is automatically tracked by utilizing the stored real time change data at the time of tracking for the advertisement object .

On the other hand, after step S15, the smart TV 10 may further perform step S16, which is an object recognition process for automatically recognizing an object other than the advertisement object in the broadcast content as an additional process. It is preferable that the smart TV 10 individually performs recognition of each of the stereoscopic viewpoints at the time of object recognition for each recognition object.

In step S16, in step S14, the smart TV 10 performs object recognition for an object that is not read as tag data for each advertisement object of the advertisement tag content received in a streaming manner for each broadcasting frame in step S14 S16a). At this time, the object recognition process for the object is preferably implemented by the algorithm described in FIG.

After step S16a, the smart TV 10 transmits additional tag data for the recognition object in accordance with the transmission of the query message to the broadcast content server 40 through the broadcast communication network 30 for the recognition object recognized in step S16a And further receives (S16b). After step S16b, the smart TV 10 performs object recognition on the image information of the broadcast content for each recognition object and sets a position tracking marking for tracking on the recognition object (S16c).

Here, the position tracking marking for tracking each recognition object is implemented by UI screen of the output unit 11 for each broadcast transmission frame on the broadcast content, when the position on the UI screen of each recognition object is changed or the stereoscopic view is changed The real time change data according to the position change of each recognition object or the change of the stereoscopic view is automatically generated by the smart TV 10 and stored in the storage unit 15 of the smart TV, Change data is utilized so that the position of the recognition object on the UI screen implemented on the output unit 11 is automatically tracked.

After step S15 or step S16, the smart TV 10 implements the advertisement conversion indicator in the output unit 11 and prepares to start outputting the broadcast content for each broadcasting frame in a streaming manner (S17 ), The broadcast content preparation process for each broadcast transmission frame in step S10 is completed.

After performing the step S10 according to the steps S11 to S17, the smart TV 10 displays the advertisement object with the position tracking marking set in step S15, and the recognition object with the position tracking marking set in step S16c Lt; RTI ID = 0.0 > (S21). ≪ / RTI > Here, the implicit effect implies a user interface effect for indirectly recognizing the broadcast contents in the streaming manner implicitly to the user of the smart TV 10 before the explicit exposure of the advertisement object and the recognition object .

In the embodiment of the present invention, a subliminal effect may be used as an implicit effect, and a subliminal effect may include an indication indicator (not shown) between broadcast images including an advertisement object constituting a broadcast transmission frame (See Fig. 4). In this case, as shown in Fig.

On the other hand, an example of the color change setting for the skirt and the backlight setting for the shoe can be exemplified with respect to the advertisement object or the recognition object in the empty image for the subliminal effect as shown in Fig. 4, Another example is the adver, status bar, icon, and border color settings for an object or a recognized object.

After step S21, the smart TV 10 implements an implied indicator reflecting the implicit effect of the advertisement object and the recognition object together with the broadcasting contents for each broadcasting transmission frame to the output unit 11 (S22). As described above, the hint indicator can be implemented as a color change, an halo, an ad bar, a status bar, an icon, and a border color for an advertisement object or a recognition object.

After step S22, the smart TV 10 implements the tracking effect for the advertisement indicator for each advertisement object or the recognition object according to the flow of time with respect to the broadcasting contents for each broadcast transmission frame to the output unit 11 (S23) . At this time, the tracking effect is preferably implemented by the algorithm described in FIG.

Here, the tracking effect is implemented by transforming the location or shape of the indictor according to the object recognition for the object to be marked with the position tracking marking in step S15 and the object to be recognized with the position tracking marking in step S16c .

After step S23, the smart TV 10 waits for the advertisement switching indicator selection signal from the input interface 13 for explicit advertisement switching (S24), and judges whether or not to receive the advertisement switching indicator selection signal (S25), and ends the implicit advertisement output process.

If the advertisement switching indicator selection signal is received in step S25, the Smart TV 10 implements the object marker for the advertisement object and the recognition object along with the broadcasting contents for each broadcasting frame to the output unit 11, When the marker is selected, the advertisement is implemented through the tag data of the selected advertisement object or the recognition object (S31).

On the other hand, when the smart TV 10 receives a selection input for one of the object markers, the smart TV 10 can be performed in a manner corresponding to recognition data previously stored in the storage unit 15 via the sensing unit 12 have. As one example, when the sensing unit 12 is implemented as a recognition module of a camera photographing system, a recognition signal may be recognized as a selection signal at a place where a user's eyes are frequently seen as a result of eye recognition through a camera photographing, And recognizing an object marker corresponding to the advertisement object matching the interest category information stored on the storage unit 15 with respect to the user.

After step S31, the smart TV 10 implements the tracking effect using the object markers for each advertisement object or the recognition object according to the flow of the broadcasting contents for each broadcasting frame to the output unit 11 (S32). At this time, the tracking effect is preferably implemented by the algorithm described in FIG.

Here, the tracking effect is implemented by transforming the position of the object marker according to the object recognition for the object to be marked with the position tracking marking in step S15 and the object to be recognized with the position tracking marking in step S16c.

After step S32, the smart TV 10 waits for a selection signal for one of a plurality of advertisement objects and a plurality of recognition objects from the input interface 13 (S33).

After step S33, the smart TV 10 determines whether to receive a selection signal for one of a plurality of advertisement objects and a plurality of recognition objects (S34), and completes execution of the explicit advertisement.

As a result of the determination in step S34, in the case of a selection signal for one of a plurality of advertisement objects and a plurality of recognition objects, the smart TV 10 displays a purchase procedure through the motion gesture for the advertisement object or the recognition object selected in step S34 (S40).

More specifically, the smart TV 10 receives the motion gesture input signal from the remote controller 20 for the selected advertisement object or the recognition object through the remote control signal receiving unit 13b or receives the motion gesture input signal to the input unit 13a And recognizes it as a purchase request for a selected advertisement object or a recognition object at the time of inputting a motion gesture, and performs a purchase process.

The present invention can also be embodied as computer-readable codes on a computer-readable recording medium. A computer-readable recording medium includes all kinds of recording apparatuses in which data that can be read by a computer system is stored.

Examples of the computer-readable recording medium include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device and the like, and also implemented in the form of a carrier wave (for example, transmission over the Internet) .

The computer readable recording medium may also be distributed over a networked computer system so that computer readable code can be stored and executed in a distributed manner. And functional programs, codes, and code segments for implementing the present invention can be easily inferred by programmers skilled in the art to which the present invention pertains.

As described above, preferred embodiments of the present invention have been disclosed in the present specification and drawings, and although specific terms have been used, they have been used only in a general sense to easily describe the technical contents of the present invention and to facilitate understanding of the invention , And are not intended to limit the scope of the present invention. It is to be understood by those skilled in the art that other modifications based on the technical idea of the present invention are possible in addition to the embodiments disclosed herein.

10: Smart TV
11: Output section
12: sensing unit
13: Input Interface
13a:
13b: Remote control signal receiving section
14:
14a: broadcast content processing module
14b: Implicit ad implementation module
14c: Explicit ad implementation module
14d: Advertisement object purchase module
14e: object recognition module
14e-1: Object recognition means
14e-2: Position tracking marking means
15:
16: Wired / wireless communication module
STB: Set-top box
20: Remote control
30: Broadcasting network
40: broadcast content server
50: Smart mobile devices
60: Data communication network
70: Associated advertiser terminal group

Claims (23)

The broadcast content and the advertisement tag content packetized from the broadcast content server through the broadcast communication network to implement the broadcast content in a streaming method in units of broadcasting frames, separates the broadcast content from the advertisement tag content, A broadcast content processing module for preparing a frame-by-frame streaming method implementation for the broadcast content for at least one or more recognized objects through object recognition for each of the objects that are not read with tag data for each advertisement object constituting the broadcast content; And
An advertisement switching indicator for switching an advertisement for an explicit advertisement switching for both an advertisement object and a recognition object; and an advertisement switching indicator for switching the advertisement indicator and the implied indicator for each recognition object to the output unit for the broadcast content in a frame- An implicit ad implementation module that recognizes the user with the implementation; A smart TV having an object recognition sensibility advertisement function.
The method according to claim 1,
A tag data existence type corresponding to an advertisement object matched with the tag data and a tag data existence corresponding to a general object that does not match the tag data in accordance with a request of the broadcast content processing module for object recognition An object recognition module for performing tag data no-existence only after tag data no-existence; And a smart TV having an object recognition sensibility advertisement function using object recognition.
The image processing apparatus according to claim 2,
The control unit receives product pattern information for determining whether the product is a product for each of the objects before or after receiving the broadcast content at a preset cycle from the broadcast content server through the broadcast communication network and stores the product pattern information in the storage unit A smart TV having an object recognition sensibility advertisement function.
4. The apparatus according to claim 3,
The image information of an object which is not read by the tag data of each advertisement object of the advertisement tag contents is acquired, and the image information of each of the image information of the acquired object is included in each image information acquired for discriminating whether the product is a product Object recognizing means for recognizing the product as a product when the characteristic of the specified pixel and the product pattern information of one of the plurality of products include similar characteristics after identifying the pixel and recognizing the product as an object; A smart TV having an object recognition sensibility advertisement function.
The image processing apparatus according to claim 4,
Various product pattern information stored in advance for identifying a product in each image information is utilized,
The product-
A smart TV having an object recognition sensibility advertisement function, characterized in that it includes a variety of product pattern information, an inclination of various product patterns, an inverse and a slight angle of inclination.
The image processing apparatus according to claim 4,
Characterized by extracting characteristics of a shape of a pixel included in each image information acquired at the time of specifying the pixel, a color of the pixel, a color of the pixel, a line formed by the pixel, and a shape in which the pixel changes with the passage of time Smart TV with emotional advertisement function.
The image processing apparatus according to claim 4,
Wherein the smart TV determines that the smart TV is in a similarity range to a product having product pattern information having pixels having characteristics similar to those of one pixel of the image information.
The method of claim 4,
An explicit advertisement that performs an explicit advertisement according to the implementation of the object marker on the object to be recognized or the object to be recognized that matches each tag data included in the broadcasting frame currently being implemented in the broadcasting contents when the advertisement switching indicator selection signal is received through the input interface Implementation module; And a smart TV having an object recognition sensibility advertisement function.
The method of claim 8,
When receiving a selection signal for one of a plurality of advertisement objects and a plurality of recognition objects through the input interface, the motion gesture input signal is received through the input interface for the selected advertisement object and the recognition object An advertisement object purchasing module for determining a purchase request and performing a purchase procedure; And a smart TV having an object recognition sensibility advertisement function.
The broadcast content processing module according to claim 9,
The tag data for each advertisement object included in the separated advertisement tag content is read and then the position for tracking the advertisement object using the image information included in the tag data for each advertisement object And the tracking marking is set.
The broadcast content processing module according to claim 10,
When the object recognition by the object recognition module is completed for at least one object that is not read as the tag data for each advertisement object on the advertisement tag content, the recognition of the recognized object to the broadcast content server via the broadcast communication network Receiving additional tag data for each recognition object according to transmission of a query message, performing object recognition on the broadcast content for each recognition object, and setting a position tracking marking for tracking on the recognition object Smart TV with object recognition and emotional advertising features.
12. The method of claim 11, wherein the location tracking marking for tracking for each recognized object comprises:
When the position on the UI screen of each recognition object is changed or the stereoscopic view is changed in the UI screen of the output unit in units of each broadcast transmission frame on the broadcast content, Wherein the smart TV is configured to generate real-time change data, store the real-time change data in the storage unit of the smart TV, and utilize the real-time change data stored at the time of tracking.
12. The system of claim 11,
Wherein the indication indicator is configured to set an implicit effect on the advertisement object and the recognition object to which the position tracking marking is set and reflect the implied effect of the advertisement object and the recognition object on which the position tracking marking is set,
The object recognition module notifies the object recognition module of the broadcasting contents when the broadcasting contents are implemented in a streaming manner in units of broadcast transmission frames to the output unit, and the tracking effect for the indications of each of the advertisement objects and the recognition objects set with the position tracking marking is implemented The smart TV having the object recognizing sensitivity advertisement function.
Claim 14 has been abandoned due to the setting registration fee. 14. The system of claim 13,
And a waiting for receipt of an advertisement switching indicator selection signal from an input interface for explicit advertisement switching.
Claim 15 is abandoned in the setting registration fee payment. 14. The method of claim 13,
A subliminal effect for indirectly recognizing a user of the smart TV implicitly before an explicit exposure of an advertisement object and a recognition object in which the location tracking marking is set when the broadcast content is implemented in a streaming manner; A smart TV having an object recognition sensibility advertisement function.
Claim 16 has been abandoned due to the setting registration fee. 16. The method of claim 15,
And an empty-image including only the indictor indicator is inserted between broadcasting images including each advertisement object constituting the broadcast transmission frame. Smart TV with function.
Claim 17 has been abandoned due to the setting registration fee. 14. The apparatus of claim 13,
A smart TV having an object recognition emotional advertisement function, characterized by a color change setting, a backlight setting, an ad bar setting, a status bar setting, an icon setting, and a border color setting.
Claim 18 has been abandoned due to the setting registration fee. 14. The system of claim 13,
The location and shape of the ambiguity indicator according to the object recognition for each of the advertisement object and the recognition object set with the position tracking marking are transformed together with the tracking indicator for the ambiguity indicator for each of the advertisement object and the recognition object, So as to realize the object recognition sensibility advertisement function.
Claim 19 is abandoned in setting registration fee. 14. The system of claim 13,
Position tracking marking means for implementing a tracking effect on the ambiguity indicator by comparing the image information included in the broadcast content with the image information acquired for each recognition subject for each recognition subject; And a smart TV having an object recognition sensibility advertisement function.
Claim 20 has been abandoned due to the setting registration fee. 21. The apparatus according to claim 19,
When the pixels included in the image information included in the broadcast content are specified for each recognition object and the characteristics of the pixel specified for the image information of each recognition object and the image information acquired for each object include similar characteristics And the tracking effect is realized by moving the position tracking mark to the position of the image information corresponding to the implemented recognition object by changing the position or stereoscopic view by determining the same as the recognition target object. TV.
Claim 21 has been abandoned due to the setting registration fee. 21. The system of claim 20,
When the advertisement switching indicator selection signal is received, the output unit receives a selection signal for one of the object markers and the object markers for the advertisement object and the recognition object together with the broadcast content, ≪ RTI ID = 0.0 >
And notifies the object recognizing module that a tracking effect using object markers for each of the advertisement object and the recognition object, in which the position tracking marking is set, is implemented when the broadcast content is implemented in the streaming method in units of broadcasting frames, Smart TV with object recognition sensibility advertisement function.
Claim 22 is abandoned in setting registration fee. 23. The system of claim 21,
And receiving a selection signal for one of the object markers for each of the advertisement object and the recognition object from the input interface.
Claim 23 has been abandoned due to the setting registration fee. 23. The apparatus according to claim 21,
In implementing the tracking effect for the object markers, a pixel included in the image information included in the broadcast content is identified for each recognition object, and the characteristics of the specified pixel with respect to the image information of each recognition object, When the image information includes similar characteristics, the position tracking mark is determined as the same recognition object, and the position or the stereoscopic view is changed to move to the position of the image information corresponding to the implemented recognition object, thereby implementing the tracking effect Smart TV with object recognition sensibility advertisement function.

Images