KR101536283B1 - Smart-TV with logotional advertisement function - Google Patents

Abstract

The present invention relates to a smart TV having an emotional advertisement function, and more particularly, to a smart TV having a sensible advertisement function, in which a broadcast content is streamed in units of broadcasting frames, A broadcast content processing module for controlling the module and preparing a frame streaming method implementation for the broadcast content by separating the broadcast content and the advertisement tag content; An advertisement switching indicator for explicit advertisement switching of an advertisement object matched with each tag data included in the advertisement tag content, and an indication indicator for each of the advertisement objects, An implicit advertisement implementation module for recognizing the user with the implementation of the advertisement module; And when a selection signal for the advertisement switching indicator for switching from the implicit advertisement to the explicit advertisement is received in a state in which the flash mode is set up, A flash function module for implementing color images only for the color image; .

Description

{Smart-TV with logotional advertisement function}

The present invention relates to a smart TV having an emotional advertisement function, and more particularly, to a smart TV having an emotional advertisement function, maximizing the effect of an advertisement provided by an advertiser, The method comprising: providing an invisible emotional advertisement for minimizing a viewing disturbance on a broadcast content by causing an advertisement for a flash-imprinted area to be performed by emphasizing a user interface screen area of interest on a broadcast content by a flash function; The present invention relates to a smart TV having an emotional advertisement function for maximizing the effect of an advertisement provided by an advertiser and allowing a user viewing the smart TV to obtain desired advertisement information by direct selection of a desired item.

The main purpose of content or advertising is to increase the effectiveness of broadcasting. Therefore, conventionally, a method of separating the contents from the advertisement and separately viewing the contents has been mainly used.

However, there has been a problem that it is inconvenient for people who want to watch only contents by separating the contents and the advertisement and providing commercial broadcasting separately.

On the other hand, a method of exposing to a person or a background in broadcasting contents has not been achieved so far. If the viewer does not know whether the advertisement is an advertisement or is indifferent to the advertisement, there is a problem that no targeting effect on the advertisement occurs at all.

Accordingly, in order to solve the conventional problems in the related art, it is required to develop a new technology for maximizing the effect of advertisement and relieving inconvenience to people who want to view only broadcast contents.

[Related Technical Literature]

1. A smart pad having an advertisement system and an advertising system and method thereof (Patent Application No. 10-2011-0032083)

2. System and method for providing advertisement through a moving picture medium running on a smart device (Patent Application No. 10-2011-0107272)

3. Smart advertising information offer system (Patent Application No. 10-2011-0000401)

SUMMARY OF THE INVENTION The present invention has been made to solve the above problems, and it is an object of the present invention to provide a smart TV for minimizing inconvenience of viewing, which is a side effect of maximizing the effect of an advertisement provided by an advertiser.

In addition, the present invention minimizes the viewing disturbance to the broadcast contents by providing it indirectly and implicitly to the user who watches the smart TV, and enables the detailed advertisement detail information to be provided through explicit advertisement when necessary And to provide a smart TV having a sensibility advertisement function.

In addition, since the advertisement for the flash-filled area is performed by emphasizing through the flash function on the user interface screen area in which the user is interested in the broadcast contents, the user who views the smart TV can directly And to provide a smart TV having a sensitivity advertisement function for obtaining advertisement information.

However, the objects of the present invention are not limited to the above-mentioned objects, and other objects not mentioned can be clearly understood by those skilled in the art from the following description.

In order to achieve the above object, a smart TV having an emotional advertisement function according to an exemplary embodiment of the present invention is a smart TV having a broadcast advertisement frame function, And a broadcast content processing module for controlling the wired / wireless communication module to receive the advertisement tag content and separating the broadcast content and the advertisement tag content and preparing a frame-by-frame streaming scheme implementation for the broadcast content; An advertisement switching indicator for explicit advertisement switching of an advertisement object matched with each tag data included in the advertisement tag content, and an indication indicator for each of the advertisement objects, An implicit advertisement implementation module for recognizing the user with the implementation of the advertisement module; And when a selection signal for the advertisement switching indicator for switching from the implicit advertisement to the explicit advertisement is received in a state in which the flash mode is set up, A flash function module for implementing color images only for the color image; .

In addition, the smart TV performs an explicit advertisement according to the implementation of the object markers for the advertisement object matching with the tag data included in the currently broadcast broadcasting frame among the broadcast contents when receiving the advertisement conversion indicator selection signal through the input interface An explicit ad implementation module; As shown in FIG.

In addition, the smart TV receives a selection signal for one of a plurality of advertisement objects through the input interface in the process of performing the explicit advertisement, and then receives the motion gesture input signal through the input interface for the selected advertisement object An advertisement object purchasing module for determining a request and performing a purchase procedure; As shown in FIG.

At this time, the broadcast content processing module separates the packetized broadcast content and the advertisement tag content, reads the tag data for each advertisement object included in the separated advertisement tag content, It is possible to set a position tracking marking for tracking for each advertisement object using the image information included in the data.

In addition, the broadcast content processing module may perform object recognition on the broadcast content for each recognition object, and may set a position tracking marking for tracking the recognition object.

In addition, the broadcast content processing module may individually recognize each of the stereoscopic viewpoints at the time of object recognition of the respective objects to be recognized.

On the other hand, the position tracking marking for tracking each of the recognized objects may be implemented by changing the position on the UI screen of each recognized object in the UI screen of the output unit in units of each broadcast transmission frame on the broadcast content, Time change data according to the position change or the stereoscopic view change is automatically generated and stored in the storage unit of the smart TV, and then the real-time change data stored at the time of tracking is utilized.

Meanwhile, the flash function module can be implemented by applying a highlight effect to an advertisement object included in the preset area.

In addition, the flash function module may include: a monochrome image implementing unit for converting a color image into a monochrome image upon implementation by a streaming method in units of broadcasting frames for the broadcast content according to reception of a selection signal for the advertisement switching indicator; . ≪ / RTI >

In addition, the flash function module may include: flash implementing means for, when receiving a flash function button input signal input signal from the remote controller, detecting a position indicated on a UI screen realized by the position sensor of the remote controller using the position sensing unit; As shown in FIG.

Meanwhile, the flash implementing means may convert the color image into a color image when implemented in a streaming method in units of broadcasting frame by only a predetermined area from the position information detected by the position sensing unit.

When the Smart TV receives the OK button input signal input signal from the remote controller, the flash function module displays advertisement detailed information about the advertisement object included in the preset area in the currently implemented broadcast content, An advertisement information implementing unit that implements advertisement information; As shown in FIG.

Meanwhile, the advertisement information implementing means moves the smart TV to the shopping cart folder on the storage unit upon receiving the selection input through the remote controller or the input unit for one of the advertisement objects included in the predetermined area, And can be implemented as the output unit in a streaming manner for each transmission frame.

On the other hand, the position sensor is an optical sensor that periodically irradiates an optical signal of a preset frequency, and is a relative position that moves on a two-dimensional plane formed by x-axis and z-axis in a three- To the position sensing unit.

In addition, the position sensing unit performs light reception on the optical signal of the predetermined frequency, provides the position information detected on the two-dimensional plane to the flash function module in real time, Can be implemented on the UI screen of the output unit.

In the meantime, the implicit advertisement implementation module may set an implicit effect on the advertisement object and the recognition target object in which the position tracking marking is set, and output the advertisement object and the recognition object, And a smart TV having the emotional advertisement function.

In addition, the implicit effect may be such that when the broadcast content is implemented in a streaming manner, the advertisement is indirectly recognized indirectly to the user of the smart TV implicitly before the explicit exposure of the advertisement object and the recognition object, It may be a subliminal effect.

Meanwhile, the subliminal effect is performed by inserting an empty-image including only the indictor indicator between broadcasting images including each advertisement object constituting the broadcast transmission frame .

In addition, the indictment indicator can be set to one of a color change setting, a backlight setting, an adver setting, a status bar setting, an icon setting, and a border color setting.

Meanwhile, the implicit advertisement implementation module implements a tracking effect on an implicit indicator for each of an advertisement object and a recognition object in which the position tracking marking is set when implementing broadcast content in a streaming manner in units of broadcasting frames by the output unit, And may wait for reception of an advertisement switching indicator selection signal from the input interface for explicit advertisement switching.

In addition, the implicit advertisement module may be configured such that when the smart TV realizes a tracking effect on an implicit indicator for each of an advertisement object and a recognition object for which position tracking marking is set, The position and shape of the implicit indicator according to the object recognition can be also transformed and implemented.

The explicit advertisement implementation module receives the selection signal for one of the object markers for the advertisement object and the recognition object along with the broadcast content to the output unit when receiving the advertisement conversion indicator selection signal, The advertisement can be implemented through the tag data for the selected advertisement object or the recognition object.

The explicit advertisement implementation module may implement a tracking effect using an object marker for each of the advertisement object and the recognition object in which the location tracking marking is set when the broadcast content is implemented in the streaming method in units of the broadcasting frame by the output unit .

In addition, the explicit advertisement implementation module can wait for receiving a selection signal for one of the object markers for the advertisement object and the recognition object from the input interface.

On the other hand, reception of the selection signal for one of the object markers is performed by the explicit advertisement implementation module receiving the motion gesture input signal from the remote controller for the object marker via the remote control signal receiving unit, receiving the motion gesture input signal Of course.

The smart TV having the emotional advertisement function according to the embodiment of the present invention provides the effect of minimizing the inconvenience of viewing, which is a side effect of maximizing the effect of the advertisement provided by the advertiser.

In addition, the smart TV having the emotional advertisement function according to another embodiment of the present invention can be provided directly to the user who watches the smart TV, but is implicitly provided, thereby minimizing interference to the viewing of the broadcast content, It is possible to provide specific advertisement detail information through the provision of the advertisement.

In addition, since the advertisement for the flash-filled area is performed by emphasizing through the flash function on the user interface screen area in which the user is interested in the broadcast contents, the user who views the smart TV can directly Thereby providing an effect of obtaining advertisement information.

1 is a diagram illustrating an entire system in which a smart TV-based emotional advertisement method using a flash function according to an exemplary embodiment of the present invention is implemented;
Fig. 2 is a diagram showing a configuration of a smart TV in Fig. 1; Fig.
3 is a conceptual diagram for explaining an implicit advertisement according to an embodiment of the present invention;
4 and 5 are conceptual diagrams for explaining a flash function according to an embodiment of the present invention;
FIG. 6 is a flowchart illustrating a process of implementing a flash function among emotion advertisement methods using a smart TV-based flash function according to an exemplary embodiment of the present invention.
FIG. 7 is a flowchart illustrating an emotional advertisement method using a smart TV-based flash function according to an exemplary embodiment of the present invention.
FIG. 8 is a flowchart specifically illustrating each step of the emotional advertisement method using the smart TV-based flash function of FIG. 7;

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, a detailed description of preferred embodiments of the present invention will be given with reference to the accompanying drawings. In the following description of the present invention, detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear.

In the present specification, when any one element 'transmits' data or a signal to another element, the element can transmit the data or signal directly to the other element, and the at least one other element Data or signal can be transmitted to another component.

FIG. 1 is a diagram illustrating an entire system in which a smart TV-based emotional advertisement method using a flash function according to an exemplary embodiment of the present invention is implemented. Referring to FIG. 1, an overall system in which a smart TV-based emotional advertisement method using a flash function is implemented includes a smart TV 10, a remote controller 20, a broadcast communication network 30, a broadcast content server 40, (50), a data communication network (60), and an affiliated advertiser terminal group (70).

1, the smart TV 10 is formed as a set-top box separate type having a separate set-top box (STB) and performs data transmission / reception with the broadcast content server 40 through the broadcast communication network 30 Alternatively, it may be formed as a set-top box-integrated type and perform data transmission / reception with the broadcast content server 40 without a separate set-top box (STB).

The broadcast communication network 30 is a high-speed wired or bridged periodic network for broadcasting in the form of a large capacity, a long-distance voice, and a data service, and may be a wired or wireless Internet. The broadcast communication network 30 plays a role for the broadcast content server 40 to transmit the broadcast content to the smart TV 10 and other systems for broadcasting.

The broadcast content server 40 includes a broadcast DB 41 and an advertisement DB 42. Also, in this specification, a DB may mean a functional and structural combination of software and hardware for storing information corresponding to each database. The DB may be implemented as at least one table, and may further include a separate DBMS (Database Management System) for searching, storing, and managing information stored in the database. Also, it can be implemented in various ways such as a linked-list, a tree, and a relational database, and includes all data storage media and data structures capable of storing information corresponding to a database.

The broadcast content server 40 receives the advertisement data through the data communication network 60 from each of the affiliated advertiser terminals constituting the affiliated advertiser terminal group 70 for each of the advertisement objects included in the broadcast content stored in the broadcast DB 41 do. In this case, it is preferable that the advertisement data include image information and advertisement detailed information for each advertisement object, and it is preferable that the advertisement data is received by receiving broadcast data of each broadcast content when the advertisement data is received.

Here, the data communication network 60 may be a high-speed period network of a large communication network capable of a large-capacity, long-distance voice and data service, and may be a next generation wired and wireless network for providing Internet or high-speed multimedia service. When the data communication network 60 is a mobile communication network, it may be a synchronous mobile communication network or an asynchronous mobile communication network. As an embodiment of the asynchronous mobile communication network, a WCDMA (Wideband Code Division Multiple Access) communication network is exemplified. In this case, although not shown in the drawing, the data communication network 60 may include a Radio Network Controller (RNC). Meanwhile, although the WCDMA network is exemplified, it may be a next generation communication network such as a 3G LTE network or a 4G network, or an IP network based on other IP. The data communication network 60 serves to transmit signals and data between the broadcasting contents server 40, a plurality of advertiser terminal units constituting the advertiser terminal group 70, and other systems.

On the other hand, the broadcast content server 40 generates tag data for each of the advertisement objects, and then all the generated tag data are numbered and stored in the advertisement DB 42 as advertisement tag contents. Meanwhile, in an embodiment of the present invention, the broadcast content server 40 preferably includes image information and advertisement detail information for use in object recognition for each advertisement object received at the time of generating each tag data, It is preferable that the advertisement DB 42 divides the broadcasting contents into broadcasting transmission frames and stores the metadata together with the respective advertisement tag contents when the advertisement contents are stored.

The broadcast content server 40 transmits the broadcast content stored in the broadcast DB 41 and the advertisement DB 42 in response to a request for listening to the broadcast content stored in the broadcast DB 41 of the smart TV 10 through the broadcast communication network 30. [ And transmits the packetized advertisement tag contents to the smart TV 10 through the broadcast communication network 30 (S13).

The smart mobile device 50 is provided for confirming detailed information on the advertisement object based on the touch screen when the user of the smart TV 10 wants detailed information on the advertisement object according to the explicit advertisement implementation after the implicit advertisement implementation do.

Fig. 2 is a diagram showing a configuration of the smart TV 10 in Fig. 3 is a conceptual diagram for explaining an implicit advertisement according to an embodiment of the present invention. 4 and 5 are conceptual diagrams for explaining a flash function according to an embodiment of the present invention. 2, the smart TV 10 includes an output unit 11, a sensing unit 12, an input interface 13, a control operation unit 14, a storage unit 15, and a wired / wireless communication module 16, .

The input interface 13 includes an input unit 13a, a remote control signal receiving unit 13b, and a position sensing unit 13c. The control operation unit 14 includes a broadcast content processing module 14a, an implicit advertisement implementation module 14b, an explicit advertisement implementation module 14c, an advertisement object purchase module 14d and a flash function module 14e do. Herein, a module may mean a functional and structural combination of hardware for carrying out the technical idea of the present invention and software for driving the hardware. For example, the module may mean a logical unit of a predetermined code and a hardware resource for executing the predetermined code, and it does not necessarily mean a physically connected code or a kind of hardware. Can be easily deduced to the average expert in the field of < / RTI >

Hereinafter, the entire system in which the Smart TV-based emotional advertisement method is implemented will be described in detail, focusing on the configuration of the control operation unit 14. [ The broadcast content processing module 14a controls the wired / wireless communication module 16 to receive the packetized broadcast content and the advertisement tag content from the broadcast content server 40 through the broadcast communication network 30 in a streaming manner for each broadcast transmission frame , And receives broadcasting contents and advertisement tag contents packetized in units of broadcast transmission frames. The broadcast content processing module 14a separates the broadcast content and the advertisement tag content from the packet in the broadcast transmission frame unit, and then prepares for implementation of the broadcast content in the output unit 11 in a frame-by-frame streaming manner.

More specifically, the broadcast content processing module 14a receives the broadcast content stored in the broadcast DB 41 of the smart TV 10 from the broadcast content server 40 through the broadcast communication network 30, And controls the module 16. The broadcast content processing module 14a transmits the broadcast content stored in the broadcast DB 41 of the broadcast content server 40 and the advertisement tag content stored in the advertisement DB 42 of the broadcast content server 40 to the broadcast transmission frame And controls the wired / wireless communication module 16 to receive from the broadcasting contents server 40 through the broadcasting communication network 30 in a packetized state.

The broadcast content processing module 14a separates the packetized broadcast content and the advertisement tag content received from the broadcast content server 40 in a streaming manner on a broadcast broadcast frame basis, Reads the tag data for each advertisement object, and stores the tag data in the storage unit 15.

The broadcast content processing module 14a sets the location tracking marking for tracking for each advertisement object using the image information included in the tag data for each of the read advertisement objects. Here, the position tracking marking serves as a marker for tracking each advertisement object in the implementation of the advertisement object to the output unit 11 according to each broadcast transmission frame on the advertisement content. More specifically, even if the position of each of the advertisement objects is changed or the stereoscopic view is changed on the broadcast content according to the setting of the position tracking marking, the realtime change data due to the position change or stereoscopic view change is automatically generated by the broadcast content processing module 14a And is stored in the storage unit 15 so that the position of the advertisement object on the UI screen realized on the output unit 11 is automatically tracked by using the stored real-time change data when tracking the advertisement object.

The broadcast content processing module 14a may further perform object recognition for automatically performing recognition of an object other than the advertisement object in broadcast contents of each broadcast transmission frame in an additional process.

That is, the broadcast content processing module 14a performs object recognition for an object that is not read as tag data for each advertisement object of the advertisement tag content received in a streaming manner for each broadcast transmission frame. It is preferable that the broadcast content processing module 14a individually performs recognition of each of the stereoscopic viewpoints at the time of object recognition for each recognition object.

The broadcast content processing module 14a transmits a query message to the broadcast content server 40 through the broadcast communication network 30 for the recognized object, and when there is additional tag data for the object to be recognized, And controls the communication module 16. The broadcast content processing module 14a performs object recognition on the image information of the broadcast content for each recognition object and sets a position tracking marking for tracking on the recognition object. Here, the position tracking marking for tracking each recognition object is implemented by UI screen of the output unit 11 for each broadcast transmission frame on the broadcast content, when the position on the UI screen of each recognition object is changed or the stereoscopic view is changed The real time change data corresponding to the change of the position of each recognition object or the change of the stereoscopic view is automatically generated by the broadcast content processing module 14a and stored in the storage unit 15 of the smart TV, And is set so that the stored real-time change data is used to automatically track the position of the recognition object on the UI screen implemented on the output unit 11. [

The broadcast content processing module 14a implements the advertisement conversion indicator in the output unit 11 and receives the streaming method in units of broadcasting frames to start outputting the broadcasting contents in the buffering state on the storage unit 15 .

The implicit advertisement implementing module 14b implements the advertisement conversion indicator in the output unit 11 according to the start of outputting the broadcast content of the broadcast content processing module 14a, And implements an implicit indicator for each advertising object in which the implicit effect is reflected.

More specifically, the implicit advertisement implementation module 14b establishes an implicit effect on the recognized object to which the position tracking marking is set, the advertisement object to which the position tracking marking is set. Here, the implicit effect implies a user interface effect for indirectly recognizing the broadcast contents in the streaming manner implicitly to the user of the smart TV 10 before the explicit exposure of the advertisement object and the recognition object .

In an embodiment of the present invention, a subliminal effect may be used as an implicit effect, and a subliminal effect may be one of a plurality of broadcast images including an advertisement object constituting a broadcast transmission frame And inserting an empty-image containing only an implicit indicator (see FIG. 3).

As shown in FIG. 3, the color change setting for a skirt and the backlight setting for a shoe can be an example of an advertisement object or a recognition object in an empty image for a subliminal effect. Another example is the adver, status bar, icon, and border color settings for an object or a recognized object.

The implicit advertisement implementing module 14b implements an implicit indicator according to the setting of the implicit effect for the advertisement object and the recognition object together with the broadcasting contents for each broadcasting transmission frame to the output unit 11. [ As described above, the hint indicator can be implemented as a color change, an halo, an ad bar, a status bar, an icon, and a border color for an advertisement object or a recognition object.

The implicit advertisement implementing module 14b implements the tracking effect on the advertising object or the implicit indicator for each recognition object according to the time flow for the broadcasting contents for each broadcasting transmission frame to the output unit 11. [ Here, the tracking effect means to implement the position or shape of the indictor according to the object recognition for the object to be marked with the position tracking marking and the object to be recognized with the position tracking marking.

The implicit advertisement implementation module 14b waits for the advertisement switching indicator selection signal from the input interface 13 for explicit advertisement switching and then determines whether or not to receive the advertisement switching indicator selection signal and transmits the advertisement switching indicator selection signal to the explicit advertisement implementation module 14c to terminate the implicit ad output process.

The explicit advertisement implementing module 14c receives the advertisement switching indicator selection signal through the input interface 13 and displays the object corresponding to the advertisement object for the advertisement object matched with the tag data included in the currently broadcast broadcasting frame, Perform an explicit advertisement according to the marker implementation.

More specifically, the explicit advertisement implementing module 14c sends the advertisement switching indicator selection signal to the output unit 11 when the advertisement switching indicator selection signal is received by the implicit advertisement implementing module 14b, An object marker is implemented for the object and the recognition object, and the advertisement is implemented through the tag data for the advertisement object or the recognition object selected when the object marker is selected.

On the other hand, when the explicit advertisement implementing module 14c receives a selection input for one of the object markers, the explicit advertisement implementing module 14c generates a selection mark in accordance with the recognition data previously stored in the storage unit 15 through the sensing unit 12 . As one example, when the sensing unit 12 is implemented as a recognition module of a camera photographing system, a recognition signal may be recognized as a selection signal at a place where a user's eyes are frequently seen as a result of eye recognition through a camera photographing, And recognizing an object marker corresponding to the advertisement object matching the interest category information stored on the storage unit 15 with respect to the user.

The explicit advertisement implementing module 14c implements a tracking effect using an object marker according to an advertisement object or an object marker according to a flow of broadcast contents for each broadcasting frame to the output unit 11. [ Here, the tracking effect means to convert the position of the object marker according to the object recognition for the object to be marked with the position tracking marking and the object to be recognized with the position tracking marking.

The explicit advertisement implementing module 14c waits for receiving a selection signal for a plurality of advertisement objects and a plurality of recognition objects from the input interface 13. [

The explicit advertisement implementation module 14c notifies the advertisement object purchase module 14d of the determination result through determination of whether or not the selection signal is received for one of a plurality of advertisement objects and a plurality of recognition objects, Complete.

As a result of the explicit advertisement implementation module 14c, when the advertisement selection module 14d receives the selection signal for one of the plurality of advertisement objects through the input interface 13 in the process of performing the explicit advertisement, When the motion gesture input signal through the input interface 13 is received, it is determined that the purchase request is made and the purchase procedure is performed.

More specifically, the advertisement purchase module 14d receives a motion gesture input signal from the remote controller 20 for a selected advertisement object or a recognized object, in response to a selection signal for one of a plurality of advertisement objects and a plurality of objects to be recognized, And receives a motion gesture input signal through the input unit 13a or receives a motion gesture input signal to the input unit 13a, and recognizes the received target object as a purchase request for a recognized object or a recognition target object.

The flash function module 14e includes a monochrome image implementation means 14e-1, a flash implementation means 14e-2 and an advertisement information implementation means 14e-3. The remote controller 20 must be provided with a flash function button 21, a position sensor 22 and an OK button 23 for interlocking with the flash function module 14e (see FIG. 1). Preparing the implementation of the broadcast content by the broadcast content processing module 14a in the output unit 11 in a streaming manner in units of broadcast output frames for the broadcast content through separation of the broadcast content and the advertisement tag content, , The advertisement conversion indicator is used as an implicit advertisement output process by using the tag data constituting the advertisement tag content by the advertisement function, and the flash function module 14e, Lt; / RTI >

Hereinafter, each component constituting the flash function module 14e will be described in detail. The black-and-white image implementation unit 14e-1 may be configured to perform the black-and-white image implementation unit 14e-1, when the selection signal for the advertisement conversion indicator for the explicit advertisement implementation is received after the implicit advertisement implementation by the implicit advertisement implementation module 14b is performed, It is determined whether the smart TV 10 is set to the flash mode. Here, the smart TV 10 is driven in the normal mode and the flash mode. The selection of the normal mode and the flash mode is performed before reception of the selection signal for the advertisement switching indicator through the remote controller 20 or the input unit 13a of the user desirable.

When it is determined that the monochrome image implementing means 14e-1 is set to the flash mode, the monochrome image implementing means 14e-1 converts the color image into a monochrome image when implemented with a streaming method in units of broadcasting frames for broadcasting contents.

The flash implementing means 14e-2 receives the flash function button input signal input signal from the remote controller 20 according to the user's input of the flash function button on the remote controller 20, By using the position sensing unit 13c, the position indicated on the UI screen of the output unit 11. [ Here, the position sensor 22 is an optical sensor that periodically irradiates an optical signal of a preset frequency, and is a relative position that moves on a two-dimensional plane formed by x-axis and z-axis in a three- May be transmitted to the position sensing unit 13c. Accordingly, the position sensing unit 13c performs light reception on the optical signal of a predetermined frequency and provides the position information detected on the two-dimensional plane to the flash implementing means 14e-2 in real time, -2) on the UI screen of the output unit 11 in real time.

The flash implementing unit 14e-2 controls the output unit 11 so as to convert only a predetermined area from the position information detected by the position sensing unit 13c into a color image upon implementation by a streaming method in units of broadcasting frames do. The UI screen can be implemented as shown in FIG.

The advertisement information implementing means 14e-3 extracts an advertisement object and a recognition object contained in a preset area in the broadcasting contents currently implemented in the output unit 11, The highlight effect is implemented. Here, the highlight effect can be realized by a glowing effect or a fluorescent color effect on the advertisement object and the recognition object, and the UI screen according to this can be as shown in FIG.

The advertisement information implementing means 14e-3 receives the OK button input signal input signal from the remote controller 20 in accordance with the user's input of the OK button on the remote controller 20, And the advertisement detail information for the advertisement object and the recognition object included in the predetermined area in the content. At this time, the advertisement information implementing means 14e-3 divides the lower end of the UI screen implemented by the output unit 11 into separate advertisement object detail information regions, and implements one side (left or right side) of the UI screen And can be divided into shopping cart areas (see FIG. 5).

The advertisement information implementing means 14e-3 moves the advertisement information to the shopping cart folder on the storage unit 15 upon selection through the remote controller 20 or the input unit 13a of the advertisement object and the recognition object included in the preset area And the broadcast contents are implemented in the output unit 11 in a streaming manner for each broadcasting transmission frame.

6 is a flowchart illustrating a process of implementing a flash function among emotion advertisement methods using a smart TV-based flash function according to an exemplary embodiment of the present invention. 1 to 6, the smart TV 10 receives broadcasting contents and advertisement tag contents packetized from the broadcasting contents server 40 through the broadcasting communication network 30 in a streaming manner for each broadcasting transmission frame, And prepares for implementation of the streaming method in the output unit 11 in units of broadcasting frames for broadcasting contents. Thereafter, the smart TV 10 assumes that it implements an implicit advertisement output process using the tag data constituting the advertisement tag content, an advertisement conversion indicator, and an implicit indicator for each advertising object matching with each tag data.

Thereafter, the smart TV 10 confirms whether the flash mode is set when a selection signal for the advertisement conversion indicator for explicit advertisement implementation is received. Here, the smart TV 10 is driven in the normal mode and the flash mode. The selection of the normal mode and the flash mode is performed before reception of the selection signal for the advertisement switching indicator through the remote controller 20 or the input unit 13a of the user desirable.

When it is determined that the smart TV 10 is set to the flash mode, the color TV is converted into a monochrome image by implementing a streaming method in units of broadcasting frames for broadcasting contents (S27a).

After receiving the flash function button input signal input signal from the remote controller 20 according to the input of the user's flash function button on the remote controller 20 after the step S27a, The position sensing unit 13c detects the position of the output unit 11 on the UI screen of the output unit 11 (S27b). Here, the position sensor 22 is an optical sensor that periodically irradiates an optical signal of a preset frequency, and is a relative position that moves on a two-dimensional plane formed by x-axis and z-axis in a three- May be transmitted to the position sensing unit 13c. Accordingly, the position sensing unit 13c performs light reception on the optical signal of a preset frequency, and realizes the position information detected on the two-dimensional plane in real time by the output unit 11, Immediately.

After step S27b, the smart TV 10 converts only the preset area from the position information detected by the position sensing unit 13c in step S27b into a color image in the case of implementation in the streaming method of broadcasting frame by frame (S27c).

After step S27c, the smart TV 10 extracts an advertisement object and a recognition object included in a preset area from the broadcasting contents currently being implemented in the output unit 11 in step S27c, And a highlight effect is implemented so that the user can conveniently distinguish the object to be recognized (S27d). Here, the highlight effect can be realized by a sparkling effect or a fluorescent color effect on the advertisement object and the recognition object.

After receiving the confirmation button input signal input signal from the remote controller 20 according to the user's input of the confirmation button on the remote controller 20 after the step S27d, the smart TV 10 is currently implemented as the output unit 11 The advertisement detail information for the advertisement object and the recognition object included in the preset area in the broadcasting contents is implemented (S27e). At this time, the smart TV 10 divides the lower part of the UI screen implemented by the output unit 11 into separate advertisement object detail information areas, and divides one side (left or right side) of the UI screen into a shopping cart area As shown in FIG.

After step S27e, the smart TV 10 is moved to the shopping cart folder on the storage unit 15 at the time of selection through the remote controller 20 or the input unit 13a of the user for the advertisement object and the recognition object included in the preset area And the broadcast content is implemented in the output unit 11 in a streaming manner for each broadcast transmission frame (S27f), and then the flow returns to step S23c.

7 is a flowchart illustrating an emotional advertisement method using a smart TV-based flash function according to an exemplary embodiment of the present invention. 1 to 7, the smart TV 10 receives the packetized broadcast content and the advertisement tag content from the broadcast content server 40 through the broadcast communication network 30 in a streaming manner for each broadcast transmission frame, And the advertisement tag content, and prepares for implementation of the streaming method in the output unit 11 in units of broadcasting frames for broadcasting contents (S10).

Here, the broadcast communication network 30 is a high-speed wired or bridged termi- nal network for broadcasting in the form of a large capacity, a long-distance voice, and a data service, and may be a wired or wireless Internet. The broadcast communication network 30 plays a role for the broadcast content server 40 to transmit the broadcast content to the smart TV 10 and other systems for broadcasting.

On the other hand, the broadcast content server 40 includes a broadcast DB 41 and an advertisement DB 42. Also, in this specification, a DB may mean a functional and structural combination of software and hardware for storing information corresponding to each database. The DB may be implemented as at least one table, and may further include a separate DBMS (Database Management System) for searching, storing, and managing information stored in the database. Also, it can be implemented in various ways such as a linked-list, a tree, and a relational database, and includes all data storage media and data structures capable of storing information corresponding to a database.

After step S10, the smart TV 10 is an implicit advertisement outputting process. The smart TV 10 is implemented in accordance with the temporal flow of the broadcasting contents to the output unit 11 for each broadcast broadcasting frame, and the advertisement switching indicator and the indication indicators (S20).

After step S20, the smart TV 10 determines whether or not the flash mode is set upon reception of the advertisement switching indicator selection signal through the input interface 13 (S26).

If it is determined in step S26 that the flash mode has been set, the smart TV 10 performs the temporal flow of the broadcast content for each frame to the output unit 11, Function is implemented through the procedure shown in FIG. 6 (S27).

On the other hand, if it is determined in step S26 that the broadcast mode is not set to the flash mode and the broadcast mode is set to the normal mode, the broadcast content for each frame is temporally flowed to the output unit 11, An explicit advertisement according to the implementation of the object markers for the advertisement object is performed in the advertisement tag content (S30).

After receiving the selection signal for one of the plurality of advertisement objects through the input interface 13 in the process of performing the explicit advertisement by the step S30 after the step S30, If a motion gesture input signal through the input interface 13 is received, it is determined that the purchase request is made and a purchase procedure is performed (S40).

FIG. 8 is a detailed flowchart of steps (S10) to (S40) of the emotional advertisement method using the smart TV-based flash function of FIG.

1 to 8, the broadcast content server 40 transmits the broadcast content stored in the broadcast DB 41 from each affiliated advertiser terminal constituting the affiliated advertiser terminal group 70 to each of the advertisement objects included in the broadcast content, (Step S11). Here, the data communication network 60 may be a high-speed period network of a large communication network capable of a large-capacity, long-distance voice and data service, and may be a next generation wired and wireless network for providing Internet or high-speed multimedia service. When the data communication network 60 is a mobile communication network, it may be a synchronous mobile communication network or an asynchronous mobile communication network. As an embodiment of the asynchronous mobile communication network, a WCDMA (Wideband Code Division Multiple Access) communication network is exemplified. In this case, although not shown in the drawing, the data communication network 60 may include a Radio Network Controller (RNC). Meanwhile, although the WCDMA network is exemplified, it may be a next generation communication network such as a 3G LTE network or a 4G network, or an IP network based on other IP. The data communication network 60 serves to transmit signals and data between the broadcasting contents server 40, a plurality of advertiser terminal units constituting the advertiser terminal group 70, and other systems.

It is preferable that the advertisement data include image information for each advertisement object, and it is preferable that the advertisement data is received by receiving broadcast data of each broadcast content when the advertisement data is received. Also, in this specification, a DB may mean a functional and structural combination of software and hardware for storing information corresponding to each database. The DB may be implemented as at least one table, and may further include a separate DBMS (Database Management System) for searching, storing, and managing information stored in the database. Also, it can be implemented in various ways such as a linked-list, a tree, and a relational database, and includes all data storage media and data structures capable of storing information corresponding to a database.

The broadcast content server 40 generates tag data for each of the advertisement objects, and then all the generated tag data is numbered and stored in the advertisement DB 42 as advertisement tag contents (S12). Meanwhile, in one embodiment of the present invention, the broadcast content server 40 preferably includes image information for use in object recognition for each advertisement object received in step S11 when each tag data is generated And the advertisement DB 42, it is preferable to generate meta data according to the broadcasting broadcasting frames of the broadcasting contents and to store the metadata together with the respective advertisement tag contents.

After the step S12, the broadcast content server 40 transmits the broadcast content 41 stored in the broadcast DB 41 in response to a request for listening to the broadcast content stored in the broadcast DB 41 of the smart TV 10 through the broadcast communication network 30, And the advertisement DB contents stored in the advertisement DB 42 are packetized for each broadcasting transmission frame and transmitted to the smart TV 10 through the broadcasting communication network 30 (S13).

In step S13, the smart TV 10 separates the packetized broadcast content received from the broadcast content server 40 in a streaming manner for each broadcast transmission frame and the advertisement tag content, Tag data per object is read (S14).

After step S14, the smart TV 10 sets up a position tracking marking for tracking for each advertisement object using the image information included in the tag data for each advertisement object read in step S14 (S15). Here, the position tracking marking serves as a marker for tracking each advertisement object in the implementation of the advertisement object to the output unit 11 according to each broadcasting transmission frame on the advertisement content. More specifically, even if the position of each of the advertisement objects is changed or the stereoscopic view is changed on the broadcast content in accordance with the setting of the position tracking marking in step S15, the real time change data according to the position change or stereoscopic view change is automatically transmitted to the smart TV 10 And stored in the storage unit 15 so that the position of the advertisement object on the UI screen realized on the output unit 11 is automatically tracked by utilizing the stored real time change data at the time of tracking for the advertisement object .

On the other hand, after step S15, the smart TV 10 may further perform step S16, which is an object recognition process for automatically recognizing an object other than the advertisement object in the broadcast content as an additional process. It is preferable that the smart TV 10 individually performs recognition of each of the stereoscopic viewpoints at the time of object recognition for each recognition object.

In step S16, in step S14, the smart TV 10 performs object recognition for an object that is not read as tag data for each advertisement object of the advertisement tag content received in a streaming manner for each broadcasting frame in step S14 S16a). After step S16a, the smart TV 10 transmits additional tag data for the recognition object in accordance with the transmission of the query message to the broadcast content server 40 through the broadcast communication network 30 for the recognition object recognized in step S16a And further receives (S16b). After step S16b, the smart TV 10 performs object recognition on the image information of the broadcast content for each recognition object and sets a position tracking marking for tracking on the recognition object (S16c).

Here, the position tracking marking for tracking each recognition object is implemented by UI screen of the output unit 11 for each broadcast transmission frame on the broadcast content, when the position on the UI screen of each recognition object is changed or the stereoscopic view is changed The real time change data according to the position change of each recognition object or the change of the stereoscopic view is automatically generated by the smart TV 10 and stored in the storage unit 15 of the smart TV, Change data is utilized so that the position of the recognition object on the UI screen implemented on the output unit 11 is automatically tracked.

After step S15 or step S16, the smart TV 10 implements the advertisement conversion indicator in the output unit 11 and prepares to start outputting the broadcast content for each broadcasting frame in a streaming manner (S17 ), The broadcast content preparation process for each broadcast transmission frame in step S10 is completed.

After performing the step S10 according to the steps S11 to S17, the smart TV 10 displays the advertisement object with the position tracking marking set in step S15, and the recognition object with the position tracking marking set in step S16c Lt; RTI ID = 0.0 > (S21). ≪ / RTI > Here, the implicit effect implies a user interface effect for indirectly recognizing the broadcast contents in the streaming manner implicitly to the user of the smart TV 10 before the explicit exposure of the advertisement object and the recognition object .

In the embodiment of the present invention, a subliminal effect may be used as an implicit effect, and a subliminal effect may include an indication indicator (not shown) between broadcast images including an advertisement object constituting a broadcast transmission frame (See FIG. 3). In this case, as shown in FIG.

As shown in FIG. 3, the color change setting for a skirt and the backlight setting for a shoe can be an example of an advertisement object or a recognition object in an empty image for a subliminal effect. Another example is the adver, status bar, icon, and border color settings for an object or a recognized object.

After step S21, the smart TV 10 implements an implied indicator reflecting the implicit effect of the advertisement object and the recognition object together with the broadcasting contents for each broadcasting transmission frame to the output unit 11 (S22). As described above, the hint indicator can be implemented as a color change, an halo, an ad bar, a status bar, an icon, and a border color for an advertisement object or a recognition object.

After step S22, the smart TV 10 implements the tracking effect for the advertisement indicator for each advertisement object or the recognition object according to the flow of time with respect to the broadcasting contents for each broadcast transmission frame to the output unit 11 (S23) . Here, the tracking effect is implemented by transforming the location or shape of the indictor according to the object recognition for the object to be marked with the position tracking marking in step S15 and the object to be recognized with the position tracking marking in step S16c .

After step S23, the smart TV 10 waits for the advertisement switching indicator selection signal from the input interface 13 for explicit advertisement switching (S24), and judges whether or not to receive the advertisement switching indicator selection signal (S25), and ends the implicit advertisement output process.

If it is determined in step S25 that the advertisement switching indicator selection signal is received, the smart TV 10 determines whether the flash mode is set (S26).

If it is determined in step S26 that the flash mode has been set, the smart TV 10 performs the temporal flow of the broadcast content for each frame to the output unit 11, The process of steps S27a to S27f of implementing the function of FIG. 6 described above may be performed, and then the process may proceed to step S31 or may proceed to the purchase process of step S40.

On the other hand, in the case of the normal mode, not the flash mode, according to the determination of step S26, the smart TV 10 implements the object marker for the advertisement object and the recognition object together with the broadcasting contents for each broadcasting frame to the output unit 11 , The advertisement is implemented through the tag data of the advertisement object or the object selected when the object marker is selected (S31).

On the other hand, when the smart TV 10 receives a selection input for one of the object markers, the smart TV 10 can be performed in a manner corresponding to recognition data previously stored in the storage unit 15 via the sensing unit 12 have. As one example, when the sensing unit 12 is implemented as a recognition module of a camera photographing system, a recognition signal may be recognized as a selection signal at a place where a user's eyes are frequently seen as a result of eye recognition through a camera photographing, And recognizing an object marker corresponding to the advertisement object matching the interest category information stored on the storage unit 15 with respect to the user.

After step S31, the smart TV 10 implements the tracking effect using the object markers for each advertisement object or the recognition object according to the flow of the broadcasting contents for each broadcasting frame to the output unit 11 (S32). Here, the tracking effect is implemented by transforming the position of the object marker according to the object recognition for the object to be marked with the position tracking marking in step S15 and the object to be recognized with the position tracking marking in step S16c.

After step S32, the smart TV 10 waits for a selection signal for one of a plurality of advertisement objects and a plurality of recognition objects from the input interface 13 (S33).

After step S33, the smart TV 10 determines whether to receive a selection signal for one of a plurality of advertisement objects and a plurality of recognition objects (S34), and completes execution of the explicit advertisement.

As a result of the determination in step S34, in the case of a selection signal for one of a plurality of advertisement objects and a plurality of recognition objects, the smart TV 10 displays a purchase procedure through the motion gesture for the advertisement object or the recognition object selected in step S34 (S40).

More specifically, the smart TV 10 receives the motion gesture input signal from the remote controller 20 for the selected advertisement object or the recognition object through the remote control signal receiving unit 13b or receives the motion gesture input signal to the input unit 13a And recognizes it as a purchase request for a selected advertisement object or a recognition object at the time of inputting a motion gesture, and performs a purchase process.

The present invention can also be embodied as computer-readable codes on a computer-readable recording medium. A computer-readable recording medium includes all kinds of recording apparatuses in which data that can be read by a computer system is stored.

Examples of the computer-readable recording medium include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device and the like, and also implemented in the form of a carrier wave (for example, transmission over the Internet) .

The computer readable recording medium may also be distributed over a networked computer system so that computer readable code can be stored and executed in a distributed manner. And functional programs, codes, and code segments for implementing the present invention can be easily inferred by programmers skilled in the art to which the present invention pertains.

As described above, preferred embodiments of the present invention have been disclosed in the present specification and drawings, and although specific terms have been used, they have been used only in a general sense to easily describe the technical contents of the present invention and to facilitate understanding of the invention , And are not intended to limit the scope of the present invention. It is to be understood by those skilled in the art that other modifications based on the technical idea of the present invention are possible in addition to the embodiments disclosed herein.

10: Smart TV
11: Output section
12: sensing unit
13: Input Interface
13a:
13b: Remote control signal receiving section
13c: Position sensing unit
14:
14a: broadcast content processing module
14b: Implicit ad implementation module
14c: Explicit ad implementation module
14d: Advertisement object purchase module
14e: Flash function module
14e-1: Means for implementing a monochrome image
14e-2: flash implementation means
14e-3: means for implementing advertisement information
15:
16: Wired / wireless communication module
STB: Set-top box
20: Remote control
21: Flash function button
22: Position sensor
23: OK button
30: Broadcasting network
40: broadcast content server
50: Smart mobile devices
60: Data communication network
70: Associated advertiser terminal group

Claims (27)

Controlling the wired / wireless communication module to receive the packetized broadcast content and the ad tag content from the broadcast content server through the broadcast communication network in order to realize the broadcast content in a streaming method in units of broadcasting frames, separating the broadcast content from the advertisement tag content A broadcast content processing module for preparing a frame-by-frame streaming method implementation for the broadcast content;
An advertisement switching indicator for explicit advertisement switching of an advertisement object matched with each tag data included in the advertisement tag content, and an indication indicator for each of the advertisement objects, An implicit advertisement implementation module for recognizing the user with the implementation of the advertisement module; And
When a selection signal for the advertisement switching indicator for switching from the implicit advertisement to the explicit advertisement is received in a state in which the flash mode is set, the position information indicated by the position information indicated on the UI screen of the output unit, A flash function module for realizing color images only; And a smart TV having a sensible advertisement function. The method according to claim 1,
An explicit advertisement implementation module for performing an explicit advertisement according to an object marker implementation for an advertisement object matched with each tag data included in a broadcasting frame currently being implemented among broadcast contents when receiving an advertisement conversion indicator selection signal through an input interface; And a smart TV having a sensibility advertisement function. 3. The method of claim 2,
The method comprising the steps of: receiving a selection signal for one of a plurality of advertisement objects through the input interface, determining a purchase request according to reception of a motion gesture input signal through the input interface for a selected advertisement object, An advertisement object purchasing module that performs an advertisement object purchase module; And a smart TV having a sensibility advertisement function. The method of claim 3,
The broadcast content processing module includes:
The method comprising the steps of: reading the tag data for each advertisement object included in the separated advertisement tag content by separating the packetized broadcast content and the advertisement tag content, reading the tag data by using the image information included in the tag data for each advertisement object, And a location tracking marking for tracking the advertisement object is set. 5. The method of claim 4,
Wherein the location tracking marking for tracking for each advertising object comprises:
When the position on the UI screen of each of the advertisement objects is changed or the stereoscopic view is changed in the UI screen of the output unit in units of each broadcast transmission frame on the broadcast content, Wherein the smart TV is configured to generate real-time change data, store the real-time change data in a storage unit of the smart TV, and utilize the real-time change data stored at the time of tracking. Claim 6 has been abandoned due to the setting registration fee. Claim 6 has been abandoned due to the setting registration fee. Claim 7 has been abandoned due to the setting registration fee. Claim 7 has been abandoned due to the setting registration fee. Claim 8 has been abandoned due to the setting registration fee. Claim 8 has been abandoned due to the setting registration fee. Claim 9 has been abandoned due to the setting registration fee. Claim 9 has been abandoned due to the setting registration fee. The method according to claim 2 or 3,
The flash function module,
And a highlight effect is applied to an advertisement object included in the predetermined area to implement the emotional advertisement function. The method according to claim 2 or 3,
The flash function module,
A black-and-white image implementing unit for converting a color image into a monochrome image when the selection signal is received by the advertisement switching indicator and implementing the streaming method in units of broadcasting frames for the broadcast content; And a smart TV having a sensible advertisement function. 12. The method of claim 11,
The flash function module,
A flash implementing means for, when receiving a flash function button input signal input signal from the remote control, detecting a position indicated by the position sensor on the UI screen implemented by the position sensor of the remote controller using the position sensing unit; And a smart TV having a sensibility advertisement function. 13. The method of claim 12,
Wherein the flash implementing means comprises:
Wherein the smart TV is implemented by converting only a predetermined area from the location information detected by the location sensing unit into a color image when implemented in a streaming method in units of broadcasting frames. 14. The method of claim 13,
The flash function module,
And an advertisement information implementing means for implementing advertisement detail information on an advertisement object contained in the preset area in the currently implemented broadcast content, when the smart TV receives an OK button input signal input signal from the remote controller, ; And a smart TV having a sensibility advertisement function. 15. The method of claim 14,
Wherein the advertisement information implementing means comprises:
The smart TV moves to the shopping cart folder on the storage unit when receiving the selection input through the remote controller or the input unit for one of the advertisement objects included in the predetermined area, and again transmits the broadcast content to the output unit The smart TV having the emotional advertisement function. 13. The method of claim 12,
Wherein the position sensor comprises:
An optical sensor for periodically irradiating an optical signal of a predetermined frequency with a relative position moving on a two-dimensional plane formed by x-axis and z-axis in a three-dimensional space consisting of x, y and z axes to the position sensing unit A smart TV having a sensibility advertisement function. 17. The method of claim 16,
The position sensing unit includes:
Dimensional plane, the position information received on the two-dimensional plane is provided to the flash function module in real time, and the position received in real time by the flash function module is transmitted to the UI The smart TV having the emotional advertisement function. Claim 18 has been abandoned due to the setting registration fee. Claim 18 has been abandoned due to the setting registration fee. Claim 19 is abandoned in setting registration fee. Claim 19 is abandoned in setting registration fee. Claim 20 has been abandoned due to the setting registration fee. Claim 20 has been abandoned due to the setting registration fee. Claim 21 has been abandoned due to the setting registration fee. Claim 21 has been abandoned due to the setting registration fee. Claim 22 is abandoned in setting registration fee. Claim 22 is abandoned in setting registration fee. Claim 23 has been abandoned due to the setting registration fee. Claim 23 has been abandoned due to the setting registration fee. Claim 24 is abandoned in setting registration fee. 23. The method of claim 22,
The explicit ad implementation module includes:
When the advertisement switching indicator selection signal is received, the output unit receives a selection signal for one of the object markers and the object markers for the advertisement object and the recognition object together with the broadcast content, And the advertisement is implemented through the smart advertisement function. Claim 25 is abandoned in setting registration fee. Claim 25 is abandoned in setting registration fee. Claim 26 is abandoned in setting registration fee. Claim 26 is abandoned in setting registration fee. Claim 27 is abandoned due to the setting registration fee. Claim 27 is abandoned due to the setting registration fee.

Images