KR20090044221A - Method for providing interactive advertisement file authoring service, method and system for providing moving picture including interactive advertisement - Google Patents

Abstract

The present invention provides a bidirectional advertisement information file authoring service for a video object and a method for providing a bidirectional advertisement containing video by an authored file, and more particularly, through a bidirectional ad authoring program for a video object, In addition, the present invention provides a service for authoring an interactive advertisement information file that enables a video viewer to check the product information in both directions while watching a video, and also recognizes an advertisement object in the video in both directions by the file, and furthermore, the advertisement. The present invention relates to a method of enabling product information on an object to be identified.

According to the present invention, through the user interface provided by the interactive advertisement information file authoring program, the interactive advertisement information enables a user to easily check the product information on a screen by clicking a product on a specific product appearing in one video. The author can author the file, and general users can check the product information in the video in both directions and enjoy the video.

Interactive, video, advertising

Description

METHOD FOR PROVIDING INTERACTIVE ADVERTISEMENT FILE AUTHORING SERVICE, METHOD AND SYSTEM FOR PROVIDING MOVING PICTURE INCLUDING INTERACTIVE ADVERTISEMENT}

The present invention is a method of providing an interactive advertisement information file authoring service for a video object and a video including interactive advertisement information by an authored file. More specifically, the present invention provides an interactive advertisement information file authoring program for a video object. It provides a service for authoring an interactive advertisement information file that allows a video viewer to check the product information in both directions while watching the video. The present invention relates to a method for recognizing an advertisement object and further confirming product information on the advertisement object.

Conventionally, there was an effect of indirectly advertising the product through a product appearing in a broadcast such as TV. However, when the viewer really wants to obtain the information of the product, the information cannot be obtained immediately, and the effect of the advertisement is halved.

In order to solve such a problem, an object of the present invention is to provide an interactive advertisement information file for an advertisement object appearing in a video so that viewers can check the product information only by clicking a product on a screen for a specific product appearing in the video. And a method and a tool for authoring a general user and a general user to recognize an advertisement object in a video in both directions by the file, and to check product information on the advertisement object. The purpose is to provide a system.

In order to achieve the above object, the interactive advertisement information file authoring program for a video object according to the present invention is performed on a terminal of a person who intends to author a server on the network or a two-way PPL (hereinafter referred to as an interactive advertisement information file author). A method of providing a service for authoring product information in a bidirectional manner with respect to a specific object appearing in a video while operating, the method comprising: (a) authoring an interactive advertisement information file through a terminal screen of the author of the interactive advertisement information file; Providing a user interface; (b) receiving and storing product information about an object (hereinafter referred to as an advertisement object) for authoring an interactive advertisement in a video, from the author of the interactive advertisement information file; (c) extracting a still picture (hereinafter referred to as a 'frame') from the video including the advertisement object and displaying the same on the screen; (d) When the advertisement object exists in the extracted frame, a region indicating the advertisement object (hereinafter referred to as an advertisement object region) and a product corresponding to the object are selected from the author of the bidirectional advertisement information file. Advertising object region information mapping and storing the product information; (e) if the next frame exists in the video, extracting the next frame according to a preset frame extraction frequency, and then proceeding to step (f); if the next frame does not exist, proceeding to step (h); (f) If the extracted frame is a frame which has been changed by determining whether the scene has been converted compared with the previous frame, and storing the frames extracted from the scene before the conversion as one scene, mapping and storing the frames extracted from the scene before the transition ( go to d), if the frame is not transitioned to step (g); (g) Track the position where the advertisement object area is moved on the currently extracted frame compared to the previous frame, and if the position tracking is successful, move the position information to be mapped with the product information, and then proceed to step (e). If the location tracking fails, proceeding to step (d); and (h) mapping the product information and the location information of the advertisement object area in the video to generate a bidirectional interactive advertisement information file in the video for the product.

In the step (f), if the frame is not transitioned, (f01) when the position movement amount from the position of the advertisement object region in the previous frame to the position of the advertisement object region in the currently extracted frame is equal to the preset reference amount Proceed to step (e), and (f02) if the amount of position movement is smaller than the preset reference amount, reset the frame extraction frequency to a reduced value and then proceed to step (e), and (f03) the position movement amount is If the frame extraction frequency is greater than the initial set value, if the frame extraction frequency is smaller than the initial set value, the process returns to the previous frame, resets the frame extraction frequency to the increased value, and then proceeds to step (e). If it is not reduced further, it is preferable to proceed immediately to step (e).

In step (d), it is preferable to provide an edit mode interface for selecting the advertisement object area.

The edit mode interface may allow a rectangular area to be selected by a mouse drag of the author of the interactive advertisement information file.

The edit mode interface may enable selection of an elliptical area by dragging the mouse of the author of the interactive advertisement information file.

The edit mode interface may enable the author of the interactive advertisement information file to select an area of a color similar to that of a mouse click or drag.

The edit mode interface may allow the author of the interactive advertisement information file to select an area moved by a mouse drag.

The edit mode interface may enable the bi-directional advertisement information file author to select an area of a polygon whose points are mouse clicks.

Preferably, the selected area is stored in a polygonal shape that approximates the shape of the area by storing coordinate values of some points of the outline of the area.

Color information on each of the stored coordinates is stored together with the coordinate values, and the tracking of the position where the advertisement object region of step (g) is moved includes, for the advertisement object region of the previous frame, color information about the region. It is preferable to extract the included information (hereinafter referred to as 'region information') and find a position representing the most similar region information in the currently extracted frame.

The area information may be determined as a result value (heirloom vector) by applying a Gabor filter, which is an equation used to extract a feature of an image, for each coordinate representing a specific area on a frame.

In the step (f), it is determined whether the scene is a frame that has been converted, (f1) measuring the degree of change of the extracted frame and the previous frame; (f2) determining that the scene change is greater than the predetermined threshold value, and determining that the scene change has not been performed when the measured change degree is smaller than the predetermined threshold value.

In the measurement of the degree of change, after dividing the frame into a predetermined size, the brightness of each divided portion (hereinafter referred to as 'screen unit') is measured, and the brightness and the frequency of the screen unit corresponding to each brightness are displayed graphically. This can be done by comparison of one histogram.

According to another aspect of the present invention, while operating on the server on the network or the terminal of the person who wants to author the interactive advertising information file (hereinafter referred to as the "bidirectional advertising information file author"), the product information in both directions for a specific object appearing in the video A recording medium in which an interactive advertisement information file authoring program for a video object is provided, which provides a service for authoring an object as a verifiable object (hereinafter referred to as a "bidirectional advertisement information file authoring service"). A frame extraction module for extracting a still image (hereinafter referred to as a 'frame') in the video according to a preset frame extraction frequency for editing the interactive advertisement information file; An area extraction module for extracting coordinates indicating an area of the advertisement object when the author of the interactive advertisement information file selects an area of an object (hereinafter, referred to as an advertisement object) to author an interactive advertisement in a video; An advertisement product management module that manages product information on an advertisement object to be displayed in the video; An area tracking module for tracking a state in which the advertisement object area extracted on one frame by the area extraction module moves in a subsequent frame and calculating the coordinates as coordinates; The product information, the advertisement object of the product appearing on each frame, so as to provide a service that can be identified bidirectionally while watching the video (hereinafter referred to as a video service including two-way advertisement) while watching the video. A bidirectional advertisement information file generation module for generating a bidirectional advertisement information file including coordinates; A user interface providing module for providing an interface for providing the interactive advertisement information file authoring service; And a control module for controlling each module to perform a series of processes related to the provision of the interactive advertisement information file authoring service.

The frame extraction module includes: a frame extraction function for extracting a frame according to a preset frame extraction frequency; And a scene change detection function for measuring the degree of change between the extracted frame and the previous frame, determining that the measured change degree is greater than the preset threshold value, and determining that the measured change degree is not changed. can do.

The frame extracting module may reduce the frequency of extracting the frame when the amount of movement of the position from the advertisement object region position in the previous frame to the advertisement object region position in the currently extracted frame is smaller than a preset reference amount. The frame extracting frequency adjusting function may be further configured to return the previous frame after resetting the frame to a value of increasing the frequency of extracting the frame when the frame extracting frequency is larger than a preset reference amount.

The area extracting module may include: a user selection area receiving function for receiving area information selected by an author of the interactive advertisement information file as an advertisement object from a still picture displayed on a terminal screen of the user; And an area optimization function for setting the user selection area as coordinates representing vertices of polygons approximating the selection area.

The advertisement product management module includes an advertisement product information management function for inputting, modifying, and deleting advertisement product information to be displayed in a video; And an advertisement product mapping function that connects the advertisement object region and the advertisement product in the video.

The area tracking module is a coordinate that extracts information (hereinafter referred to as 'coordinate information') including a specific coordinate value among coordinates representing an advertisement object region in a specific frame and color information on the coordinate stored with the coordinate value. Information extraction function; And an area tracking function for grasping the movement of the advertisement object area by finding a coordinate representing the coordinate information most similar to the coordinate information in the next extracted frame.

The interactive advertisement information file generation module may include: an advertisement information search function for searching for a specific advertisement object in a video, the information including product information of the object and coordinate information on each frame; And generating an advertisement information file by mapping the retrieved advertisement information with each other.

When the video service including the interactive advertisement is provided through the Internet, the interactive advertisement information file is preferably generated in an XML format.

According to another aspect of the present invention, a service that enables the user to check the product information at the request of the video viewer for a particular object (hereinafter referred to as an "advertising object") that appears in the video while watching the video (hereinafter 'bidirectional' A system providing a video service including an advertisement " (hereinafter referred to as a 'bidirectional video service providing system') is a method of providing a video service including an interactive advertisement, and (a) the video service providing system including the interactive advertisement. Receiving a request for transmission of a specific video accompanied by the interactive service including a video service from a user terminal connected to the; (b) a file including frame (screen) information in which the advertisement object appears in the video and position information on the screen in which the advertisement object appears in the frame (hereinafter referred to as a "bidirectional advertisement information file") and the video; Transmitting to the user terminal; (c) when receiving a request for detailed information on the advertisement object, retrieving detailed information about a product mapped to the advertisement object and transmitting the detailed information to the user terminal.

The user terminal is an IPTV terminal, and the step (a) includes: (a1) an IPTV including a channel for providing a video accompanying the video service including the interactive advertisement (hereinafter referred to as a video on demand channel). Providing a channel selection menu in a multicasting manner over an IPTV network; (a2) When the VOD channel is selected from the IPTV terminal, a URL of a system (hereinafter, referred to as a 'two-way advertisement video main system') for providing contents of the VOD channel as a component of the interactive service including video service providing system ( Transmitting a Uniform Resource Locator address to the IPTV terminal; (a3) receiving a request for transmission of a specific video accompanied by an interactive advertisement video service from the IPTV terminal connected by the URL address, by the interactive advertisement video main system in the interactive service including video service providing system; can do.

The interactive advertisement information file is preferably configured in an XML (Extensible Markup Language) file format.

In the step (b), the transmission of the interactive advertisement information file and the video to the user terminal, it is preferable that the streaming (streaming) is made.

In step (b), the location information on the screen on which the advertisement object appears may be determined by a coordinate value on the screen.

After step (c), (d) receiving a purchase request for a product mapped to the advertisement object from a user terminal; (e) performing a payment for the product requested to purchase; may further include.

The detailed product information transmitted to the user terminal in step (c) may include a URL (Uniform Resource Locator) address that can be hyperlinked to a site for purchasing the product by a user's click.

According to another aspect of the present invention, a service that enables the user to check the product information at the request of the video viewer for a particular object (hereinafter referred to as an "advertising object") that appears in the video while watching the video (hereinafter 'bidirectional' A system that provides a video service including advertisements (hereinafter referred to as a "bidirectional video service providing system"), which is a video and a specific object appearing in the video (hereinafter referred to as an "advertising object") at the request of the video viewer. And a video main system including an interactive advertisement for providing product information, wherein the video system includes: a video content server for providing video content; A file mapped to a specific video of the video content server, the file including frame (screen) information in which a specific advertisement object appears in the video and location information on the screen in which the advertisement object appears in the frame (hereinafter referred to as "bidirectional advertisement"). An interactive advertisement information file server including an information file '; An advertisement product information server including detailed information of goods mapped to the advertisement object; And a control server configured to control the component to perform a series of processes related to providing product information for a video and an advertisement object in the video.

The video service providing system with an interactive advertisement includes an IPTV including a channel (hereinafter, referred to as a Video On Demand channel) for providing a video accompanied with the interactive advertisement including video service to provide to an IPTV terminal. A data broadcasting system for generating portal screen data for channel selection; A return path server system connected to the IPTV terminal through a IPTV network through a return channel and transmitting and receiving bidirectional data with the IPTV terminal in a unicasting manner to provide an interactive IPTV messenger service; If a channel for providing a video with a video service with an interactive advertisement (hereinafter referred to as a "Video On Demand (VOD) channel") is selected from the IPTV terminal, the VOD channel is a component of the video service providing system with the interactive advertisement. And a distribution server configured to transmit a Uniform Resource Locator (URL) address of a system for providing content (hereinafter, referred to as a “two-way advertisement video main system”) to the IPTV terminal.

The video service providing system including an interactive advertisement includes: a multiplexing system for multiplexing portal screen data and program specific information (PSI) received from the data broadcasting system, and outputting the multiplexed stream by IP packetizing; And a network switch system for transmitting the IP packetized signal received from the multiplexing system to the IPTV terminal through the IPTV network in a multicasting manner.

The interactive advertisement information file is preferably configured in an XML (Extensible Markup Language) file format.

The interactive advertisement video main system may further include a purchase processing server configured to perform a purchase process including payment for the requested product, upon receiving a purchase request for a product mapped to the advertisement object from a user terminal. Can be.

According to another aspect of the present invention, while operating in the terminal, connected to the video service providing system including the interactive advertisement through the information communication network, while watching the video for a specific object (hereinafter referred to as 'advertising object') appearing to the user to the video A recording medium in which a client program (hereinafter referred to as an interactive advertising client) that provides a service for checking the product information is recorded. The interactive advertising client sends a video request to the video service providing system including the interactive advertising. Transmitting function; A file including a requested video, frame (screen) information in which a specific advertisement object appears in the video, and position information on the screen in which the advertisement object appears in the frame (hereinafter referred to as "bidirectional"). Receiving an advertisement information file); A video player providing function of playing, rewinding, and fast forwarding the video; An advertisement object display function for interpreting the interactive advertisement information file during video playback and displaying a display on the screen indicating that there is an advertisement object on the video screen; When a user selects a specific advertisement object by using a mouse or a remote controller, sends a product information request for the selected advertisement object to the interactive service including a video service providing system; And receiving the product information from the interactive service including the video service providing system, and displaying the product information on the screen of the user terminal.

The advertisement object display function may display an indication on the screen indicating that the selection pointer is pointing to the advertisement object when the user places the selection pointer on the advertisement object of the video screen by a mouse or a remote controller.

The advertisement object display function may be to always display a display indicating the object when the advertisement object appears on the video screen.

According to the present invention, through the user interface provided by the interactive advertisement information file authoring program, the interactive advertisement information enables a user to easily check the product information on a screen by clicking a product on a specific product appearing in one video. It allows authoring a file, and general users can enjoy the video by checking the product information in the video in both directions.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. Prior to this, terms or words used in the specification and claims should not be construed as having a conventional or dictionary meaning, and the inventors should properly explain the concept of terms in order to best explain their own invention. Based on the principle that can be defined, it should be interpreted as meaning and concept corresponding to the technical idea of the present invention. Therefore, the embodiments described in the specification and the drawings shown in the drawings are only the most preferred embodiment of the present invention and do not represent all of the technical idea of the present invention, various modifications that can be replaced at the time of the present application It should be understood that there may be equivalents and variations.

1 is a diagram illustrating a software structure of a bidirectional advertisement information file authoring program (hereinafter, referred to as a "bidirectional advertisement information file authoring program") for a video object.

The control module 101 controls each module to perform a series of processes associated with providing the interactive advertisement information file authoring service.

The user interface provision module 102 is a module for providing a user interface for authoring the interactive advertisement information file.

The advertisement product management module 103 is a module for inputting, modifying, and deleting advertisement products to be displayed in a video. For the advertisement product, the name of the product and a description of the product may be defined. This makes it possible to efficiently manage such items as input, correction and deletion.

Meanwhile, when the region corresponding to the advertisement product is extracted by performing the region extraction of the region extraction module 105 to be described later, the corresponding region and the advertisement product should be connected, and the advertisement product management module 103 performs such a connection process. In this case, the user interface providing module 102 allows a user to quickly display a list of the most recently written list and a tree-view formula for the advertisement product.

The frame extraction module 104 extracts a still image (hereinafter referred to as a 'frame') in the video according to a preset frame extraction frequency for editing the interactive advertisement information file. The frame extraction frequency should be initialized to a value that is easy to edit for editing of the interactive advertisement information file, and it is preferable to dynamically change the value according to the degree of change of the image in the frame. It will be described later.

In addition, the frame extraction module 104 assists in editing the interactive advertisement information file by binding the frames for each scene by examining the association between the frames. The correlation test first calculates the image difference between the frame to be examined and the previous frame to obtain the value. Once the obtained value is stored as a frame gradient and the value is greater than or equal to a predetermined threshold value, it is determined that the association is inferior between the two frames, and the frame is set as the start of a new scene. The processing sequence for determining the scene change will be described later with reference to Figs. 2 and 3 and the actual embodiment thereof with reference to Fig. 7.

The area extracting module 105 extracts coordinates indicating an area of the advertisement object when the bidirectional advertisement information file author selects a region of an object (hereinafter, referred to as an advertisement object) to author an interactive advertisement in a video. to be.

Since a specific area in the video corresponds to one advertisement product, it is necessary to extract the corresponding area. This function simplifies the extraction of advertisement objects from users. If the area to be extracted is a simple rectangle, it can be easily extracted. However, if the polygon is a complex shape, a more sophisticated process is required. In order to easily extract these complex areas, various editing modes are provided to the user (author of the interactive advertisement information file) to enable easy area extraction.

Examples of the editing mode include 'Rectangle', 'Ellipse', 'Magic Wand', 'Free Draw', 'Polygon', and the like.

'Rectangle' extracts a rectangular area with four points, allowing the user to select a rectangular area by dragging the mouse.

'Ellipse' extracts elliptical areas, allowing the user to select elliptical areas by dragging the mouse.

'Magic Wand' detects the degree of color similarity and automatically extracts similar color areas, allowing the user to select areas of similar color to the mouse click or drag.

'Free Draw' extracts the area moved by the user's mouse drag in polygonal coordinates.

'Polygon' extracts the area of the polygon whose vertices are clicked by the user.

In this way, the coordinates of the advertisement object corresponding to the product to be advertised are extracted from the still image (frame) of the video. When the area selected by the user at the time of area extraction is not a simple polygon but a complicated shape, the area is corrected to an appropriate polygon through the area correction step. If the vertex coordinates of the generated polygon are many, the coordinates are assembled using an appropriate threshold value, and the polygon is expressed as the optimal coordinate information while preserving the existing polygon shape as much as possible. If the extracted polygon area and the pre-registered advertisement product are mapped to each other, the advertisement product is registered on the corresponding frame.

The area tracking module 106 is a module that tracks a state in which the advertisement object area extracted on one frame by the area extraction module moves in a subsequent frame and calculates it as coordinates.

Coordinate information about the advertisement object region extracted on one frame is continuously displayed in subsequent frames. The area tracking module 106 serves to track such polygon coordinate information. The area tracking module 106 measures how much the advertisement object area of the previous frame has changed on the tracked frame, digitizes and stores the changed amount, and then uses the tracking of the advertisement object area in the next frame.

The interactive advertisement information file generation module 107 provides specific product information included in a specific video so as to provide a service (hereinafter referred to as a "bidirectional advertisement containing video service") that can be identified in both directions while watching the video, the product information, A module for generating a bidirectional advertisement information file containing coordinates as an advertisement object of the product appearing on each frame.

Interactive advertisement information file The interactive advertisement information file is generated so that a video viewer can receive a video service including an interactive advertisement while viewing the video, such as the advertisement product edited by the authoring program and the coordinates of the advertisement object area for the product. When a video service including an interactive advertisement is provided through the Internet, the interactive advertisement information file may be generated in an XML format.

XML data of the interactive advertisement information file is illustrated in FIG. 22, and description of each field will be described later with reference to FIG. 22.

2 is a flowchart illustrating a method in which an interactive advertisement information file authoring program provides an interactive advertisement information file authoring service.

While the interactive advertisement information file authoring program is executed, a user interface for authoring the interactive advertisement information file is provided through the terminal screen of the user (two-way advertisement information file author) (S201). Thereafter, the user receives and stores product information on an object (hereinafter, referred to as an "advertising object") for authoring an interactive advertisement in a video (S202).

When the user plays the video and selects the editing of the interactive advertisement information file, the still image (hereinafter referred to as a 'frame') is extracted from the video including the advertisement object and displayed on the screen (S203). If there is an advertisement object corresponding to the selected product, a region indicating the advertisement object (hereinafter referred to as an advertisement object region) and a product corresponding to the object are selected by the user (S204), and the advertisement object region information Map and store product information (S205). In this case, the editing mode provided to the user for selecting the advertisement object area is as described above with reference to FIG. 1. In operation S206, the next frame is extracted according to a preset frame extraction frequency (S208), and then the scene change determination routine S209 is performed.

Performing the scene change determination routine (S209) will be described later with reference to FIG.

In operation S209, the extracted frame is determined to be a frame to which the scene has been changed compared to the previous frame. Thereafter, in step S210, an area extraction step for the advertisement object is newly performed (S203), and if the frame is not a scene change, area tracking (S211) of the advertisement object is performed in comparison with the previous frame in the frame.

The area tracking routine S211 will be described later with reference to FIG. 4.

Compared with the previous frame, the advertisement object area is tracked in the position where the advertisement object is currently extracted on the frame (S211), and if the position tracking is successful, the moved position information is mapped with the product information and stored, and then the frame extraction frequency adjustment routine ( If the location tracking fails, step S212 is performed and the area extraction step for the advertisement object is newly performed for the frame (S203).

The frame extraction frequency adjustment routine S212 will be described later with reference to FIG. 5.

Through these steps, if there is a part not shown in the drawing, but if the next frame does not exist, the editing of the interactive advertisement information file for the video is completed, and the product for the advertisement object edited in the video during that time is completed. Finally, an interactive advertisement information file including information, area information of the advertisement object in the frame, and the like is finally generated (S207).

FIG. 3 is a flowchart illustrating a process of performing a scene switching determination routine in the flowchart of FIG. 2. The degree of change between the extracted frame and the previous frame is measured (S209.1), and the value is compared with the threshold value (S209.2). The extracted frames are collected and stored as one scene (S210). If the extracted frames are smaller than the threshold value, it is determined that the scene is not changed and the area tracking routine S211 is performed.

FIG. 4 is a flowchart illustrating a process of performing a 'region tracking' routine in the flowchart of FIG. 2. First, in order to track the movement of the region, the previous frame and the current frame are loaded to track the movement of the advertisement object region coordinates (S211.2). The movement tracking of each coordinate is made by finding a coordinate representing the coordinate information most similar to the coordinate information in the previous frame with respect to the coordinate in the currently extracted frame, an embodiment of which will be described later with reference to FIG. 8. If the tracking is successful, the coordinates, area movement amount, and goods moved are mapped and stored (S211.4). If the tracking fails, a new frame is provided and a new area extraction step is performed for the advertisement object (S203). Do it.

FIG. 5 is a flowchart illustrating a process of executing a 'frame frequency adjustment' routine (S212) of the flowchart of FIG. 2.

If the position movement amount of the advertisement object area is smaller than the preset reference amount (S212.2), the next frame is extracted after resetting to a value of decreasing the frequency of extracting the frame (S212.3).

When the position movement amount is larger than the preset reference amount (S212.4), the current frame extraction frequency value is again compared with the initial setting value of the frame extraction frequency value (S212.5) and the frame extraction frequency is reduced from the initial setting value. In the case of returning to the previous frame (S212.6) and resetting the frame extraction frequency to an increased value (S212.7), the next frame is extracted (S208), and the frame extraction frequency is not reduced from the initial setting value. If it is, the next frame is extracted immediately (S208).

The next frame is extracted immediately from the position of the advertisement object region in the previous frame when the amount of movement of the position from the currently extracted frame to the position of the advertisement object region is equal to a preset reference amount (S208).

6 is a software state transition diagram when extracting an advertisement object area from a video. The progress state of the interactive advertisement information file authoring program starts from the "video selection wait state" (S601), in which the video is not selected, and when the video is opened, the state transitions to the "video open state" (S602). When the advertisement object region is selected in the frame, the state transitions to the "region selection state" (S603), and when the advertisement product to be mapped to the advertisement object region is selected, the transition to the "product selection state" (S604).

7 is a diagram illustrating an embodiment of determining whether a scene is changed in a frame. The frame extraction module 104 measures the relationship between the frames, grouping related frames into scene units from a simple sequence of frames. When the scene change is detected, the area tracking is automatically terminated, and the information about the scene is used for the shortcut for each scene. In order to detect a scene change, a frame is first extracted, and the degree of change with the previous frame is measured. When the threshold value is exceeded, the frame is determined as a frame irrelevant to the previous frame and the scene change process is performed. When the transition process is finished, the frame is saved.

Similarity to the scene is obtained by obtaining a histogram. After dividing the frame into a certain size, measure the brightness of each divided part (hereinafter referred to as 'screen unit'), and compare the brightness with the histogram that displays the frequency of the screen unit corresponding to each brightness as a graph. do. Referring to the drawings, there are shown pictures 701.1, 702.1, and 703.1 in which the three frames 701, 702, and 703 are screen-divided, and histograms 701.2, 702.2, and 703.2 for each. Of the three frames 701, 702, and 703, the first (701) and the second (702) frames, which should be treated as the same scene in the above figure, show nearly similar histograms (701.2, 702.2), while the other In the case of the histogram 703.2 of the third frame 703 that should be detected as a scene, the graph shows a completely different state, indicating that it is a new scene that is not related to the previous two scenes. By comparing the histograms, it is possible to determine whether the current frame has been converted from the scene compared to the previous frame.

8 is a diagram illustrating an embodiment of a process of tracking an advertisement object area. Area tracking is to track in which area of the frame the user-selected area appears. In order to trace the area, the area tracking is performed by loading both the previous screen that is the source of tracking and the screen that is the target of tracking. If the area tracking result exceeds a certain threshold, the area tracking will fail, and the user will have to extract the area again. If the area tracking is successful, the tracked coordinates, the advertisement product, and the amount of change for the previous area are stored.

Tracking of the area is done by tracking where the point corresponding to each extracted coordinate has moved. The second figure 802 tracks one coordinate point 804 among a plurality of points representing coordinates from which the region 803 is extracted from the first figure 801. Coordinate information such as color information on the coordinate point 804 of the previous frame 801 is stored, and coordinates where the coordinate information most similar to the corresponding coordinates are displayed in the frame 802 to be tracked. If (804.1) is found, the coordinate is the coordinate (804.1) where the existing coordinate is moved. The search range of coordinates searches only a range of constant values according to the extracted frame frequency.

The tracking of the area is performed by substituting Gabor function for each extracted coordinate and tracking the corresponding coordinate. The second figure tracks a specific coordinate 804 among the coordinates from which the region is extracted from the first figure. After storing color information and the like on the coordinates 804, if the coordinates of the place most similar to the corresponding coordinates are found in the still image to be tracked, the coordinates become the coordinates of the existing coordinates. The search range of coordinates searches only a certain range of values according to the extracted frame frequency.

Heirloom functions are two-dimensional functions that are plane waves surrounded by Gaussians. Using the following formula, a filter modeled from Gabo function (hereinafter referred to as Gabor filter), we find out where the extracted region appeared in a new frame.

Gabor filters are a type of Wavelet Transforms, and Gabo functions are defined as waves of sinusoids modulated by Gaussian functions controlled by wave vectors. Gabor filters represent frequency components and are multiplied by Gaussian functions so that Gabor filters maintain a Gaussian shape. Heirloom filter formula is shown below.

는 평면파의 모양을 제한하는 가우시안 함수를 의미하고,

는 영상에서의 전력 스펙트럼이 주파수의 제곱에 반비례하는 성질에 대한 부분을 보상하기 위하여 들어가는 수식이다. 필터의 중심 주파수는

이며 복소 평면파이다. 또한 DC 성분을 억제하기 위하여

수식이 들어간다. 가보 변환은 영상의 특징을 추출하는데 사용된다. 따라서 얼굴 인식 및 지문 감지의 특징 추출, 영상 압축, 영상 내 무늬 분할에 의한 물체 찾기 등에 활용된다. here

Means a Gaussian function that limits the shape of the plane wave,

Is a formula to compensate for the portion of the power spectrum in the image that is inversely proportional to the square of the frequency. The center frequency of the filter

And complex plane wave. Also to suppress DC components

The formula goes in. Gabor transform is used to extract the features of the image. Therefore, it is used for feature extraction of face recognition and fingerprint detection, image compression, and object search by pattern segmentation in image.

Gabo in this system is used to extract the feature of the object to be tracked as a preprocessing of the object tracking. That is, the result of passing the Gabor filter at each vertex of the polygon selected by the user in the current frame is given as a real value and an imaginary value. (Each vertex of the polygon selected by the user exists at the edge of the object to be traced.) We will refer to this as a Gabor vector. For tracking, the point that matches the polygon vertex of the current frame must be found in the next frame. Therefore, it is necessary to find the vector most similar to the heirloom vector of each vertex of the polygon of the current frame in the next frame.

If the motion is not a very fast video, the video that we feel natural to the eye does not show a big difference in the value of the object movement between frames. Therefore, it can be inferred that each vertex of the polygon in the current frame will be in a certain area range near each vertex of the current frame in the next frame. Therefore, a certain area in each polygonal vertex of the current frame is designated as a candidate region of each polygonal vertex in the next frame. First, only edges are extracted from each vertex candidate region of the polygon of the next frame to make a binary image. This is a preprocessing operation to speed up.

Each pixel of the candidate region after the preprocessing operation passes the Gabor filter to obtain a Gabor vector, and then measures the similarity with the Gabor vector of the current frame. Measuring the Heirloom Vector Distance The magnitude or direction of the heirloom vector is determined by two methods: Euclidean distance and cosine distance. That is, the method of measuring the similarity includes a method of measuring Euclidean distance with a vector size, a method of measuring cosine distance with a vector size, a method of measuring Euclidean distance in a vector direction, a method of measuring cosine distance in a vector direction, and the like. . In this way, the vector having the most similar value among the similarity values measured among the candidate regions of each vertex becomes the vertex of the next frame, and the polygon is traced.

9 is a diagram illustrating an embodiment of a user terminal screen when an interactive advertisement information file authoring program is executed. The user interface of the interactive advertisement information file authoring program is designed to conveniently extract and track the necessary area while the user watches the video. There is ToolBar for commodity editing and ToolBar for area editing, and it is possible to edit directly from the still image of the video while watching a video. In addition, it displays the frame information of the frame, advertisement product information, etc., and there are shortcuts for each scene to help editing.

The basic menu 901 is a menu having basic functions such as opening and closing a project, managing an advertisement product, and generating an interactive advertisement information file.

The basic ToolBar 902 is a ToolBar that collects tools used for editing an advertisement product.

The area editing ToolBar 903 is a ToolBar that collects tools used for object extraction in an image.

The video player 904 may play and view an image used for editing, and may press a pause button and immediately edit an area.

The advertisement product information 905 is a window showing a list of registered advertisement products and helping to select more easily.

The video information 906 shows an advertisement product registered in the corresponding video and shows information about the video being edited.

The frame information 907 provides information on the frames being edited in the video and direct access of the frames.

Scene shortcut 908 provides a shortcut for each scene to go directly to a particular scene during editing.

Status bar 909 is a status bar showing the progress of the various things currently in progress.

FIG. 10 is a diagram illustrating an embodiment of content input by a user when starting a project for authoring a new interactive advertisement information file.

'Project Name' 1001 indicates a new project name to be created.

'Movie File' 1002 indicates a location of a movie file to be used for editing.

'BeginDateTime' 1003 indicates a date and time at which a broadcast is to be started.

'EndDateTime' 1004 indicates a date and time at which the broadcast will end.

'ProgramID' 1005 indicates a broadcast ID of a program to be broadcast.

'ChannelID' 1006 indicates an ID of a channel being broadcasted.

'Author' 1007 indicates an editor name to be edited.

'Frame' 1008 indicates a default extraction frequency (Default: 4 frames) of frames per second.

Note 1009 indicates a description of the other project.

11 is a diagram illustrating an embodiment of an interface provided when a user edits a category of an advertisement product. 'ToolBar' 1101 is a toolbar with icons for adding, modifying, deleting a category. The category list 1102 shows the entire category added by the user and can be modified and deleted by using a double click.

12 is a diagram illustrating an embodiment of an interface provided when a user edits an advertisement product. 'ToolBar' 1201 is a toolbar with icons for adding, modifying and deleting advertisement products. The category list 1202 shows the entire product added by the user and can be modified and deleted by using a double click.

13 is a diagram illustrating a network configuration for providing a video service including an interactive advertisement.

The interactive service video service providing system 500 includes an interactive advertising video main system 510 which performs a main role of a video service including interactive advertising, and the interactive advertising video main system 510 provides video content that provides video content. The server 512, the interactive advertisement information file server 513 which provides the interactive advertisement information file, and the user may provide more detailed information about products corresponding to the specific objects (advertising objects) appearing in the video. The advertisement product information server 514 having detailed product information, the purchase processing server 515 which performs a purchase process including payment when a user requests a product purchase, and a series related to providing a video service including interactive advertisements by controlling them. It includes a control server 511 in charge of the processing of.

The purchase processing server 515 is a server for allowing a user to request a purchase directly from the video service providing system 500 including the interactive advertisement for the product. That is, when the user sends a purchase request for a product mapped to the advertisement object, the purchase processing server 515 processes the purchase immediately by performing a payment on the requested product, or ad objects appearing in the video. It is to provide the user with a function to put the items that he wants to buy in the 'shopping basket' one by one, so that the payment process for them later.

Meanwhile, the video service providing system 500 including the interactive advertisement may not directly process a purchase, but may directly connect to a site where a user can purchase the product, which will be described later with reference to FIG. 17.

The interactive advertisement information file is a file containing information on specific objects (advertising objects) appearing in the video, for a specific video. That is, the file records the frame (screen) information on which the advertisement object appears and the location information on the screen on which the advertisement object appears in the frame, and is preferably configured in an XML (Extensible Markup Language) file format. This file is sent to the user terminal (30.1 to 30.N, hereinafter referred to as 30.N) together with the video, and the user terminal 30.N is referred to as a client program (hereinafter referred to as a two-way advertisement client). By analyzing the interactive advertisement information file by), at the same time as the video playback, the presence of the advertisement objects appearing in the video is shown on the screen.

The user terminal 30.N transmits and receives a message with the interactive service video service providing system 500, and performs an interactive advertising client that performs the video service including the interactive advertisement in the terminal. The function of such a bidirectional client is almost the same as that of the IPTV terminal (20.1 to 20.N, hereinafter referred to as 20.N) described later in FIG.

The interactive advertisement client transmits a video request to the video service providing system 500 including the interactive advertisement, and receives the requested video and the interactive advertisement information file from the video service providing system 500 including the interactive advertisement in response thereto. As described above, the interactive advertisement information file is a file that records frame (screen) information on which the advertisement object appears in the video and location information on the screen on which the advertisement object appears in the frame, and is an XML (Extensible Markup Language) file. It is desirable to be configured in a format. In addition, transmission of the video and the interactive advertisement information file may be performed by streaming.

The interactive advertisement client may provide a user with a video player function to play, rewind, and fast forward the received video.

Meanwhile, the interactive advertisement client interprets the interactive advertisement information file during video playback, reads the frame (screen) in which the advertisement object appears in the video and the position of the advertisement object on the frame, and has the advertisement object on the video screen. A function of displaying a display indicating the message on the screen is performed. Such an indication may display on the screen an indication that the selection pointer is pointing to the advertisement object only when the user moves the selection pointer over the advertisement object on the video screen by the mouse or the remote control, or the advertisement object on the video screen. If appears, you can always display an indication that points to that object.

In addition, when a user selects a specific advertisement object by using a mouse or a remote controller, a product information request for the selected advertisement object is sent to the video service providing system 500 including the interactive advertisement, and in response thereto, the video service providing system including the interactive advertisement is provided. When receiving the product information from the 500, it can be displayed with the video on the user terminal (20.N, 30.N) screen.

14 is a diagram illustrating a configuration of an IPTV network.

The interactive advertisement video main system 510 is a part of the interactive service containing video service providing system 500 which will be described later with reference to FIG. 16, and plays a main role of performing a video service including interactive advertisements, which will be described later with reference to FIG. 16. do.

The IPTV head-end system 200 may include broadcast content supplied from each broadcast content provider 10, such as a program provider (PP), a data provider (DP), a terrestrial provider or an IPTV content provider (CP), and It is a system for transmitting electronic program guide (EPG) information on the broadcast contents to the IPTV terminal 20 of the IPTV viewer. The IPTV headend system 200 is a subscriber switch (L3 switch) 350, a subscriber concentrator (xDSL concentrator, DSLAM) via a Gigabit or higher speed router and an L3 switch using the multicast routing protocol of the premium network 300. Alternatively, the broadcast content and the EPG information are transmitted to the IPTV terminals 20 of the plurality of subscribers joined to the corresponding channel by multicast through the Fast Ethernet Switch (FES) 360. The multicast routing protocol may be a Protocol Independent Multicast-Sparse Mode (PIM-SM) protocol, but the present invention is not limited thereto, and distance vector multicast routing protocol (DVMRP), multicast extensions to OSPF (MOSPF), and core CBT Multicast routing protocols of any one of Based Tree (PIM-SM), Protocol Independent Multicast-Sparse Mode (PIM-SM), and Protocol Independent Multicast-Dense Mode (PIM-DM) may be used.

More specifically, these IP networks can be described as IP backbone networks using unicast or multicast routing protocols, subscriber networks (e.g. Ethernet, xDSL, HFC, FTTC, FTTH), IP set-top boxes. IPTV terminal 20 including a TV connected to the STB.

The IP backbone network includes a premium network 300, each router including a Rendezvous Point (RP) 310 and a premium edge (PE) router 320 therein, a metro switch (L3 switch) (330). ), An N-Topia switch (L3 switch) 340 (N-Topia: service using a high-speed Internet through LAN equipment installed in a group building where UTP is installed), and a subscriber switch (L3 switch) 350. Each of the Layer 3 network equipment uses the PIM-SM multicast routing protocol, and the IPTV terminal 20 and the subscriber concentrator 360 use the Internet Group Management Protocol (IGMP) and the IGMP Snooping protocol, respectively. The subscriber concentrator 360 may include an xDSL concentrator, a DSLAM, or a Fast Ethernet Switch (FES).

The rendezvous point 310 of the premium network 300 manages a PIM Join list and a PIM Prune list for a plurality of multicast groups. In the present invention, a broadcast channel is a multicast group. group), the Join list and the Prune list are managed for each broadcast channel.

The Internet Group Management Protocol (IGMP) is used between the IPTV terminal 20 requesting broadcast channel selection / release and the Layer 3 network equipment (eg, subscriber switch 350) accepting the request.

The IGMP Snooping protocol is a Layer 2 device (eg subscriber concentrator) located between the IPTV terminal 20 of the subscriber requesting channel selection / release and the Layer 3 network equipment (eg subscriber switch 350) accepting the request. 360)), the Layer 2 equipment (subscriber concentrator 360) in which the IGMP Snooping protocol is driven recognizes an IGMP transmission / reception message between the IPTV terminal 20 and the Layer 3 network equipment, and makes a channel request. The channel information is transmitted only to the IPTV terminal 20.

The subscriber network refers to a network between the Layer 2 equipment (eg, subscriber concentrator 360) and the IPTV terminal 20, and includes Ethernet, xDSL (ADSL, VDSL), Hybrid Fiber Coax (HFC), and FTTC ( Fiber To The Curb (FTTH), Fiber To The Home (FTTH) structure can be composed of any one topology.

The IPTV terminal 20 may use a terminal in which an IP set-top box (IP STB) is embedded or an IP set-top box, a computer, a laptop, or a personal portable terminal connected to a user's TV. Hereinafter, for convenience, a terminal of an IPTV user is referred to as a term 'IPTV terminal'. The IPTV terminal 20 includes a hardware layer composed of hardware such as a CPU, a media processor, flash RAM, and an Ethernet module, a system software layer including a device driver and an operating system, a Java virtual machine (JVM), and a JNI (Java). Network Interface), ACAP API (ACAP-J, ACAP-X API) (Java TV, Havi UI, JMF, DAVIC, CA Interface), Conditional Access System (CAS) Module or Digital Rights Management (DRM) Rights Management) interface module, APIs for IP media service (Navigator, Audio streaming API, VOD, Flash player, HDS Client, SSO Client), middleware layer with streaming protocol (RTP, RTSP), MPEG2, MPEG4, MPEG7, Supports various multi-codecs such as H.264, WMV-9, and other codecs, and includes an electronic program guide (EPG) client and a client-level client for using interactive video services. Contains the hierarchy. The subscriber's IPTV terminal 20 is assigned an IPv4 address or an IPv6 address.

FIG. 15 is a diagram illustrating a configuration of an IPTV head-end system 200.

Referring to the drawings, the IPTV headend system 200 includes a baseband system 205, a compression multiplexing system (or multiplexing system) 210, a network switch system 215, a return path server system (RPS). 220, personalization authentication server (HDS) 225, EPG providing system 230, data broadcasting system 235, media management system (MOC: Media Operation Core) 240, reception restriction system 245, billing A processing system 250, a monitoring system 255, and a subscriber management system 260.

The baseband system 205 receives an MPEG-2 broadcast signal from an external program provider (PP) or an analog broadcast signal from terrestrial waves, converts the received source broadcast signal into a SDI (Serial Digital Interface) signal, and Synchronize frames, distribute broadcast video and audio signals from multiple broadcast channels (e.g. 100 channels) via routine switcher, subtitle generator (CG) and automatic program controller (APC) The controller inserts at least one of an advertisement, a logo, or a subtitle into the broadcast video and audio signal (signal editing and processing) and transmits the same to the compression multiplexing system (or multiplexing system) 210. The baseband system 205 receives a broadcast signal such as a terrestrial wave, a tuner for receiving an analog broadcast signal through a DS-3 optical end station, a Yagi antenna, an integrated receiver decoder (IRD), and a received source signal. A frame divider for converting and correcting SDI signals and synchronizing frames, a signal divider such as an A / V router that connects / concentrates all broadcast signal channels for operational management, advertisements, logos on the SDI signals, It includes a subtitle generator for inserting subtitles to edit and process the signal.

The compression multiplexing system (or multiplexing system) 210 converts the broadcast video and audio signals received from the baseband system 205 into an A / V encoder for each broadcasting channel (eg, 100 channels). Compresses SDI (Serial Digital Interface) video signals using the H.264 protocol, compresses audio signals to MPEG-2 AAC, and compresses broadcast data and audio to a data encoder with MPEG-2 TS. After multiplexing the data broadcasting data generated by the program and the program related information (PSI) generated by the PSI generator, the packetized IP packetized by IP packetizing the multiplexed MPEG-2 Transport Stream (TS). A transport stream is transmitted to the network switch system 215. The program related information (PSI) includes a program association table (PAT) and a program map table (PMT) information.

The network switch system 215 may include one or more L3 switches (L3 SW), the return path server system, and the subscriber station 20 for transmitting the IP packetized transport stream to an IP network by multicasting. One or more L4 switches (L4 SW) for load balancing by dividing bidirectional data receiving traffic in a unicast manner between them by a proper load, and blocking harmful traffic between the L4 switch and the IP network. One or more intrusion prevention systems.

In addition, IP multicasting may use IPv4 multicasting or IPv6 multicasting techniques. In one embodiment, if the router and the L3 switch use the PIM-SM multicast routing protocol, and the subscriber's IP set-top box uses an IPv4 address, the I3 v3 / v3 uses IGMP Snooping of the L2 network device to the L3 switch. Join to the desired broadcast channel, or if using an IPv6 address, transmit to the L3 switch using MLD v1 / v2 to join the broadcast channel.

When the network switch system 215 uses IPv4 multicasting, IPv4 multicast addresses are '224.0.0.0' to '239.255.255.255', which are different for each broadcast channel (for example, 100 channels). Use For example, when using IPv4 multicasting, SBS can use 230.1.1.1 multicast address, KBS can use 230.1.1.2 multicast address, and EBS can use 230.1.1.3 multicast address. When using the PIM-SM multicast routing protocol, the network switch system 215 transmits a register message to the rendezvous point (RP) 310, and in response, the rendezvous point (RP) 310 sends a PIM JOIN message. The process of registering a rendezvous point (RP) 310 for transmitting a path to the network switch system 215 and setting a path is performed.

The return path server system 220 records log information of a subscriber, processes bidirectional data by a data provider (DP), receives bidirectional data from the IPTV terminal 20 of the subscriber, and The corresponding response data is transmitted to the IPTV terminal 20 in unicasting.

The personalization authentication server (HDS) 225 sends an authentication request message including the ID (SAID) of the IPTV terminal 20 for the IPTV service and the application service information to be used from the subscriber's IPTV terminal 20 to the return pass server. Received through the system 220, and transmits an authentication key (Unique Key, UK) in response to the authentication request message to the subscriber's IPTV terminal 20 through the return pass server system 220.

The location information of the IPTV terminal 20 includes an ID (SAID) and subscriber information of the IPTV terminal 20. The SAID of the IPTV terminal 20 is a unique ID assigned to the IPTV terminal 20. In addition, the IPTV terminal 20 includes a single sign-on (SSO) client and an HDS client for managing opening terminal information, and the SAID of the terminal is stored in the HDS client in the IPTV terminal 20. The personalization authentication server (HDS authentication server) 225 and the HDS client of the IPTV terminal 20 manage information (SAID, IP Address, MAC Address, terminal model name) of the opened IPTV terminal 20. In the case of personal authentication-based service, when authenticating a personal identification number (PIN), one master PIN number (consisting of four digits) can be assigned to one household and a plurality of PIN information can be assigned to household members.

The EPG providing system 230 provides EPG information to the IPTV terminal 20.

The data broadcasting system (DBS) 235 is a data manager for managing data encoding, a PSI generator / SI generator for generating program related information / service information (PSI / SI). ), A Data Server / Data Encoder for encoding data broadcasting data, a Multiplexer Manager (MM) for managing multiplexing functions of data broadcasting data, PSI information, and SI information, and a scheduler user. Interface (Scheduler UI) is included. The data broadcasting system (DBS) 235 multiplexes data broadcasting data and PSI information generated by a data server / data encoder and a PSI generator / SI generator by an authoring tool according to the terrestrial ACAP data broadcasting standard. The SI information is then sent to the IP multiplexer. The data manager (DM) of the data broadcasting system (DBS) 235 receives an object carousel (OC) including periodically updated information received from a data agent (DA). do.

The media operation system (MOC) 240 is a system for managing various business process information (program programming information, location information, contract information, product information, etc.) for operating a broadcasting task. The media management system 240 manages broadcast program organization information, content and media management information, contract information of a program provider (PP) and a content provider (CP), product information, and manages each system in the center of a broadcasting center. It acts as a coordinator that integrates and manages information flow through organic integration. The media management system (MOC) 240 includes contract management in terms of acquisition, media and content metadata management, EPG information acquisition / management as broadcast schedule information, and real time broadcasting in terms of operation. Marketing analysis reporting, delivery such as settlement of CP and subscriber viewing inclination in terms of VoD channel formation management, agent management for interworking with each subsystem, VoD catalog generation management, various product management, and analysis In terms of broadcast transmission monitoring, video server transmission management and VoD subscriber authentication, transmission result recording / management for settlement with CP, and data synchronization with each subsystem.

The billing processing system 250 is a provisioning system. When using the IPTV service for a fee after user authentication, the billing processing system 250 provides a billing processing function for the use of the IPTV service for each subscriber member.

The monitoring system 255 is a control system that monitors a transmission failure of an A / V broadcast signal for IPTV broadcasting and a reception failure by monitoring a downlink of the IPTV headend system 200.

The subscriber management system 260 provides a member subscription and termination for the IPTV service, and a member information management function.

16 is a diagram illustrating a network configuration for providing a video service with an interactive advertisement in IPTV.

In IPTV, an IPTV channel selection menu including a channel for providing a video accompanied by a video service with interactive advertisement (hereinafter referred to as a Video On Demand channel) is provided through a multicasting method through an IPTV network. The IPTV channel selection menu may be supplied by the electronic program guide (EPG) providing system 230 described above with reference to FIG. 15 or may be provided through a portal screen for selecting an IPTV menu generated by the data broadcasting system 235. 16 illustrates only the data broadcasting system 235. The portal screen generated by the data broadcasting system 235 is subjected to multiplexing in the multiplexing system (or compression multiplexing system) 210, through the network switch 215, and through the IPTV network described above with reference to FIG. The VOD channel is selected from the IPTV terminal 20.N. When the VOD channel is selected from the IPTV terminal 20.N, the return path server system 220 receives the received VOD channel to the distribution server 520. To pass. As shown, since a plurality of interactive advertising video main system 510 can be installed on the network for each region, the distribution server 520 is the interactive advertising video main at an optimal position on the IPTV terminal 20.N on the network. The system 510 is selected, the URL address is provided to the IPTV terminal 20.N, and the IPTV terminal 20.N connects to the selected interactive advertisement video main system 510 by the URL address. .

Since the functions of the interactive advertising client in the IPTV terminal 20.N and the functions of the respective components 511 to 515 of the interactive advertising video main system 510 are almost the same as those described above with reference to FIG. 13, the description is omitted here.

17 is a flowchart illustrating a method of providing a video service including an interactive advertisement.

When the interactive service including a video service providing system 500 receives a request for transmitting a specific video accompanied by the interactive video service from a user terminal 20.N or 30.N connected to the user (S1701), The video service providing system 500 including the interactive advertisement transmits the corresponding video and the interactive advertisement information file mapped to the video to the user terminals 20.N and 30.N (S1702). The interactive advertisement information file is a file that records frame (screen) information on which the advertisement object appears in the video and location information on the screen on which the advertisement object appears in the frame. The interactive advertisement information file is configured in an XML (Extensible Markup Language) file format. desirable. In addition, transmission of the video and the interactive advertisement information file may be performed by streaming.

The user provides a video player function to play, rewind, and fast forward the received video (S1703).

Meanwhile, the interactive advertisement client interprets the interactive advertisement information file during video playback, reads the frame (screen) in which the advertisement object appears in the video and the position of the advertisement object on the frame, and has the advertisement object on the video screen. A display indicating the message is displayed on the screen (S1704). Such an indication may display on the screen an indication that the selection pointer is pointing to the advertisement object only when the user moves the selection pointer over the advertisement object on the video screen by the mouse or the remote control, or the advertisement object on the video screen. If appears, you can always display an indication that points to that object.

In addition, when a user selects a specific advertisement object by using a mouse or a remote controller, a detailed product information request for the selected advertisement object is sent to the video service providing system 500 including the interactive advertisement (S1705), and the interactive advertisement is included in response thereto. When receiving the product information from the video service providing system 500 (S1706), and displays it with the video on the user terminal (20.N, 30.N) screen (S1707).

In addition, the user can be configured to request a direct purchase of the product. That is, when a user sends a purchase request for a product mapped to the advertisement object, the payment service for the product requested to be purchased is performed, so that the interactive service containing video service providing system 500 immediately processes the purchase. Alternatively, the user may be provided with a function of storing items, which are desired to purchase, among the advertisement objects appearing in the video in the 'shopping basket' one by one, so that the payment process may be performed on them later.

Alternatively, the video service providing system 500 including the interactive advertisement may not directly process a purchase, but may directly connect to a site where the user can purchase the product. The detailed product information to be transmitted may include a Uniform Resource Locator (URL) address that may be hyperlinked to a site for purchasing the product by a user's click. By clicking on this, the user can directly connect to the product selling site and purchase the product.

FIG. 18 is a flowchart illustrating a process of receiving a video transmission request from the IPTV terminal 20.N by the interactive video service system 500 when providing an interactive video service with IPTV.

In IPTV, an IPTV channel selection menu including a channel for providing a video accompanied by a video service including interactive advertisements (hereinafter referred to as a 'Video On Demand Channel') is provided through a multicasting method through an IPTV network. S1701.1). The IPTV channel selection menu may be supplied by the electronic program guide (EPG) providing system 230 described above with reference to FIG. 15 or may be provided through a portal screen for selecting an IPTV menu generated by the data broadcasting system 235. When the VOD channel is selected from the IPTV terminal 20.N (S1701.2), a system for providing contents of the VOD channel as a component of the video service providing system 500 including the interactive advertisement (hereinafter referred to as 'bidirectional advertisement'). URL (Uniform Resource Locator) address of the video main system 510 'is transmitted to the IPTV terminal 20.N (S1701.4). As described above with reference to FIG. 16, since a plurality of interactive advertisement video main systems 510 may be installed in a network for each region, the distribution server 520 may be located at an optimal position for the IPTV terminal 20.N. The interactive advertisement video main system 510 may be selected (S1701.3), and the URL address may be provided to the IPTV terminal 20.N (S1701.4).

When the IPTV terminal 20.N connects to the interactive advertisement video main system 510 by the URL address (S1701.5), and requests the transmission of a specific video accompanied by the interactive video service, the interactive advertisement The video main system 510 receives this (S1701.6).

19 is a diagram illustrating an embodiment of a method of displaying an advertisement object in a video. Referring to the drawing, a user places a selection pointer 1901 on a screen of a moving image by using a mouse or a remote controller. In this case, if the clothes pointed to by the mouse pointer are objects (advertising objects) accompanied by a video service including an interactive advertisement, a border line 1902 may be drawn on the area representing the advertisement objects as shown in the drawing. If the object moves, the boundary line 1902 also moves along the object.

20 illustrates another embodiment of a method of displaying an advertisement object in a video. Referring to the drawings, when the selection pointer 2001 points to an area other than the advertisement object, an arrow shape is shown, and when the selection pointer 2001 enters the advertisement object area, the shape is changed as shown in the drawing (2002) to inform the user that the advertisement object is the set area. have.

21 is a diagram illustrating an embodiment in which, when a specific advertisement object is selected in a video, detailed information of a product corresponding to the advertisement object is displayed on the terminal screen. The video may be displayed as a screen separated from the video (2101), or may be overlaid on the video (2102).

FIG. 22 is a diagram illustrating an embodiment of XML data of an interactive advertisement information file, and description of each field is as follows.

1. <head>: information about the movie and objects,

2. <body>: information about the object location and area over the actual time of the video,

3. <media>: Information about the video. Information such as video file location, description, duration, screen width, title,

4. <product>: Each piece of information about an object. The unique ID of the object, the name of the object, the type (images such as bmp, gif, documents such as html, asp, and various other types that can be represented), the file location for the object information,

5. <timeslot>: Information about how long an object appears and disappears. The amount of time that the object represents in the movie,

6. <polygon>: Screen information of a specific object. The unique ID of the object (ID declared in the product of the head), the polygon coordinates for the area on the screen of the object, the layer to determine the priority when the area of the object is duplicated, the time the current polygon starts and the length it is maintained

to be.

23 is a diagram illustrating an embodiment of a block tracking method in the area tracking method.

When the user designates a rectangular area 2302 in the Nth frame 2301, the area becomes a block of an object to be tracked. In the N + K th frame 2303, which is the next frame that is automatically tracked, finding a block including the object set above is a block tracking method. As shown in the above figure, the block 2302 of the Nth frame 2301 is fixed up, down, left, and right at the block position 2302 of the Nth frame 2301 in order to find the block 2302 of the N + Kth frame 2303. The search area 2304 of the N + K th frame is set by increasing the size.

In the search area 2304, the block size moving area 2305 moves from the upper left to the lower right of the search area 2304, comparing all the color values with the block 2302 of the Nth frame to minimize the difference in color values. The block area 2307 is determined to be a block including an object area to be searched for in the N + Kth frame. The next frame repeats this process, tracking the object.

24 is a diagram illustrating an embodiment of a block matching method among polygon tracking methods in an area tracking method.

When the user designates an object as a polygon 2402 in the Nth frame 2401, the user moves to the next frame with respect to each polygon's point. If one point 2403 of the Nth frame 2401 is at the position of the point 2406 next to the doll's eye in the N + Kth frame 2405, the area 2407 is searched based on the position. Done. In the search area 2407, a color comparison is performed between the blocks 2408 and 2409 having a predetermined size from the upper left to the lower right and the blocks 2404 surrounding the points of the polygons 2402 of the Nth frame 2401. It is determined that the block having the small value is each point of the polygon in the N + K th frame 2405. The same process is repeated in the next frame to track the object.

25 is a diagram illustrating an embodiment of a screen for selecting an area tracking method.

The screen in the case of using the block tracing 2501, the block matching 2502, and the Gabor function is shown.

1 is a diagram showing a software structure of an interactive advertisement information file authoring program.

2 is a flowchart illustrating a method in which an interactive advertisement information file authoring program provides an interactive advertisement information file authoring service.

3 is a flow chart showing a process of performing a 'scene switching determination' routine (S409) of the flow chart of FIG.

4 is a flowchart illustrating a process of performing a region tracking (S411) routine of the flowchart of FIG.

FIG. 5 is a flowchart illustrating a process of performing a 'frame frequency adjustment' routine (S412) of the flowchart of FIG. 2.

6 is a software state transition diagram when extracting an advertisement object area from a video.

7 is a diagram illustrating an embodiment of determining whether a scene is changed in a frame.

8 illustrates an embodiment of a process for tracking an advertisement object area.

9 is a view showing an embodiment of a user terminal screen when executing the interactive advertising information file authoring program.

FIG. 10 illustrates an embodiment of content to be input by a user when starting a project for authoring a new interactive advertisement information file. FIG.

11 illustrates an embodiment of an interface provided when a user edits a category of an advertisement product.

12 illustrates an embodiment of an interface provided when a user edits an advertisement product.

FIG. 13 is a diagram illustrating a network configuration for providing a video service including an interactive advertisement. FIG.

14 is a diagram illustrating a configuration of an IPTV network.

Fig. 15 shows the configuration of an IPTV head-end system.

16 is a diagram showing a network configuration for providing a video service with an interactive advertisement in IPTV.

17 is a flowchart of a method of providing a video service including an interactive advertisement.

FIG. 18 is a flowchart illustrating a process of receiving a video transmission request from an IPTV terminal by a video service system including an interactive advertisement when providing a video service including an interactive advertisement in IPTV.

19 illustrates an embodiment of a method of displaying an advertisement object in a video.

20 illustrates another embodiment of a method of displaying an advertisement object in a video.

21 is a diagram illustrating an embodiment in which, when a specific advertisement object is selected in a video, detailed information of a product corresponding to the advertisement object is displayed on a terminal screen;

Fig. 22 is a diagram showing an embodiment of XML data of a bidirectional advertisement information file.

23 illustrates an embodiment of a block tracking method in the area tracking method.

24 is a view showing an embodiment of a block matching method among polygon tracking methods in an area tracking method;

25 is a diagram illustrating an embodiment of a screen for selecting an area tracking method.

Claims (36)

The interactive advertising information file authoring program for a video object (hereinafter referred to as the "bidirectional advertising information file authoring program") of the person who wants to author the server or the interactive advertising information file (hereinafter referred to as the "bidirectional advertising information file author") on the network A method of providing a service for authoring a product that can be identified in both directions with respect to a specific object appearing in a video while operating in a terminal, (a) providing a user interface for authoring an interactive advertisement information file through a terminal screen of the author of the interactive advertisement information file; (b) receiving and storing product information about an object (hereinafter referred to as an advertisement object) for authoring an interactive advertisement in a video, from the author of the interactive advertisement information file; (c) extracting a still picture (hereinafter referred to as a 'frame') from the video including the advertisement object and displaying the same on the screen; (d) When the advertisement object exists in the extracted frame, a region indicating the advertisement object (hereinafter referred to as an advertisement object region) and a product corresponding to the object are selected from the author of the bidirectional advertisement information file. Advertising object region information mapping and storing the product information; (e) if the next frame exists in the video, extracting the next frame according to a preset frame extraction frequency, and then proceeding to step (f); if the next frame does not exist, proceeding to step (h); (f) If the extracted frame is a frame which has been changed by determining whether the scene has been converted compared with the previous frame, and storing the frames extracted from the scene before the conversion as one scene, mapping and storing the frames extracted from the scene before the transition ( go to d), if the frame is not transitioned to step (g); (g) Track the position where the advertisement object area is moved on the currently extracted frame compared to the previous frame, and if the position tracking is successful, move the position information to be mapped with the product information, and then proceed to step (e). If the location tracking fails, proceeding to step (d); (h) generating an interactive advertisement information file in the video for the product by mapping the product information and the location information of the advertisement object area in the video; Interactive advertising information file authoring service providing method comprising a. The method according to claim 1, In step (f), if the frame is not transitioned, (f01) If the position movement amount from the PLL object region position in the previous frame to the advertisement object region position in the currently extracted frame is equal to a preset reference amount, proceed to step (e); (f02) If the position movement amount is smaller than a preset reference amount, the frame shift frequency is reset to a value having a reduced frequency, and then the process proceeds to step (e). (f03) If the position movement amount is larger than the preset reference amount, and if the frame extraction frequency is less than the initial set value, return to the previous frame and reset to the value that increased the frame extraction frequency, and then proceed to step (e). If the frequency of frame extraction is not reduced below the initial setting, go to step (e) immediately. Interactive advertising information file authoring service providing method characterized in that. The method according to claim 1, In step (d), Providing an edit mode interface for selection of the advertisement object area Interactive advertising information file authoring service providing method characterized in that. The method according to claim 3, The edit mode interface, Enabling selection of a rectangular area by dragging the author of the interactive advertisement information file author Interactive advertising information file authoring service providing method characterized in that. The method according to claim 3, The edit mode interface, Enabling selection of an elliptical region by dragging the author of the interactive advertisement information file author Interactive advertising information file authoring service providing method characterized in that. The method according to claim 3, The edit mode interface, Allowing the author of the interactive advertisement information file to select an area of a color similar to a mouse click or drag portion; Interactive advertising information file authoring service providing method characterized in that. The method according to claim 3, The edit mode interface, Allowing the author of the interactive advertisement information file to select an area moved by a mouse drag Interactive advertising information file authoring service providing method characterized in that. The method according to claim 3, The edit mode interface, Allowing the author of the interactive advertisement information file to select an area of a polygon whose points are mouse clicks. Interactive advertising information file authoring service providing method characterized in that. The method according to any one of claims 4 to 8, The selected area, By storing the coordinates of some points on the outline of the area and storing them in polygonal form approximating the shape of the area Interactive advertising information file authoring service providing method characterized in that. The method according to claim 9, Color information on each stored coordinate is stored together with the coordinate value, Tracking of the position where the advertising object area of step (g) is moved, For the advertisement object area of the previous frame, information including color information about the area (hereinafter referred to as 'area information') is extracted, and the position representing the most similar area information is found by searching in the currently extracted frame. that Interactive advertising information file authoring service providing method characterized in that. The method according to claim 10, The area information, For each coordinate representing a specific area on the frame, Determined as the result (Gabor vector) by applying the Gabor filter, an equation used to extract the features of an image. Interactive advertising information file authoring service providing method characterized in that. The method according to claim 1, In step (f), Judging whether the scene is a transitioned frame, (f1) measuring a degree of change of the extracted frame and the previous frame; (f2) determining that the scene change has been performed when the measured change degree is greater than a preset threshold value, and determining that the scene change has not been performed when the change rate is smaller than a threshold value; Interactive advertising information file authoring service providing method comprising a. The method according to claim 12, The measurement of the degree of change, After dividing the frame into a certain size, measure the brightness of each divided part (hereinafter referred to as 'screen unit'), and compare the brightness with the histogram that displays the frequency of the screen unit corresponding to each brightness as a graph. Being Interactive advertising information file authoring service providing method characterized in that. While operating on a server on a network or a terminal of a person who wants to author an interactive advertisement information file (hereinafter referred to as a "bidirectional advertisement information file author"), authoring the product information as an object that can be confirmed bidirectionally about a specific object appearing in the video. A recording medium for recording a bidirectional advertisement information file authoring program for a video object that provides a service (hereinafter referred to as a "bidirectional advertisement information file authoring service"), The interactive advertisement information file authoring program, A frame extraction module for extracting a still image (hereinafter referred to as a 'frame') in the video according to a preset frame extraction frequency for editing the interactive advertisement information file; An area extraction module for extracting coordinates indicating an area of the advertisement object when the author of the interactive advertisement information file selects an area of an object (hereinafter, referred to as an advertisement object) to author an interactive advertisement in a video; An advertisement product management module that manages advertisement product information to be displayed in the video; An area tracking module for tracking a state in which the advertisement object area extracted on one frame by the area extraction module moves in a subsequent frame and calculating the coordinates as coordinates; The product information, the advertisement object of the product appearing on each frame, so as to provide a service that can be identified bidirectionally while watching the video (hereinafter referred to as a video service including two-way advertisement) while watching the video. A bidirectional advertisement information file generation module for generating a bidirectional advertisement information file including coordinates; A user interface providing module for providing an interface for providing the interactive advertisement information file authoring service; A control module for controlling each module to perform a series of processes associated with providing the interactive advertisement information file authoring service; Recording medium recording the interactive advertising information file authoring program comprising a. The method according to claim 14, The frame extraction module, A frame extraction function for extracting a frame according to a preset frame extraction frequency; A scene change detection function for measuring a degree of change between the extracted frame and the previous frame, determining that the measured change degree is greater than the preset threshold value, and determining that the measured change degree is not the scene change value when the measured change degree is smaller than the preset threshold value; Recording medium recording the interactive advertising information file authoring program comprising a. The method according to claim 15, The frame extraction module, If the moving amount from the position of the advertisement object region in the previous frame to the position of the advertisement object region in the currently extracted frame is smaller than a preset reference amount, the frame extraction frequency is reset to a value which is reduced, and is larger than the preset reference amount. If large, a frame extraction frequency adjustment function for resetting and extracting the previous frame after resetting the frame extraction frequency to an increased value; Recording medium in which the interactive advertising information file authoring program is further recorded. The method according to claim 14, The area extraction module, A user-selected area receiving function for receiving the area information selected by the author of the interactive advertisement information file as an advertisement object from a still picture displayed on a terminal screen of the user; An area optimization function for setting the user selection area as coordinates representing vertices of polygons approximating the selection area; Recording medium recording the interactive advertising information file authoring program comprising a. The method according to claim 14, The advertisement product management module, An advertisement product information management function for inputting, modifying, and deleting advertisement product information to be displayed in a video; An advertisement product mapping function that connects the advertisement object region and the advertisement product in the video; Recording medium recording the interactive advertising information file authoring program comprising a. The method according to claim 14, The area tracking module, A coordinate information extraction function for extracting a specific coordinate value among coordinates representing an advertisement object region in a specific frame and information including color information on the coordinate stored with the coordinate value (hereinafter referred to as 'coordinate information'); An area tracking function for grasping the movement of the advertisement object area by finding a coordinate representing the coordinate information most similar to the coordinate information in the next extracted frame; Recording medium recording the interactive advertising information file authoring program comprising a. The method according to claim 14, The interactive advertisement information file generation module, An interactive advertisement information file retrieval function for retrieving a specific advertisement object in the video, the information including product information of the object and coordinate information on each frame; An interactive advertisement information file generation function for generating advertisement information by mapping the retrieved advertisement information with each other; Recording medium recording the interactive advertising information file authoring program comprising a. The method of claim 20, When the video service including the interactive advertisement is provided through the Internet, The interactive advertisement information file is generated in XML format Recording medium recording the interactive advertising information file authoring program, characterized in that. A service that allows users to check the product information at the request of the video viewer for a specific object (hereinafter referred to as an "advertising object") that appears in the video while watching a video (hereinafter referred to as a "video service with two-way advertising"). The system that provides (hereinafter referred to as a "video service providing system with interactive advertising") is a method of providing a video service with interactive advertising, (a) receiving a request for transmission of a specific video accompanied by the interactive advertisement containing video service from a user terminal connected to the interactive service providing video service providing system; (b) a file including frame (screen) information in which the advertisement object appears in the video and position information on the screen in which the advertisement object appears in the frame (hereinafter referred to as a "bidirectional advertisement information file") and the video; Transmitting to the user terminal; (c) when receiving the request for detailed information on the advertisement object, retrieving detailed information on the product mapped to the advertisement object and transmitting the detailed information to the user terminal; Interactive service including a video service providing method comprising a. The method according to claim 22, The user terminal is an IPTV terminal, Step (a) is, (a1) providing an IPTV channel selection menu including a channel for providing a video with the interactive service including a video service (hereinafter referred to as a video on demand channel) through an IPTV network in a multicasting manner; ; (a2) When the VOD channel is selected from the IPTV terminal, a URL of a system (hereinafter, referred to as a 'two-way advertisement video main system') that provides content of the VOD channel as a component of the interactive service including video service providing system ( Transmitting a Uniform Resource Locator address to the IPTV terminal; (a3) receiving a request for transmission of a specific video accompanied by an interactive advertisement video service from the IPTV terminal connected by the URL address, by the interactive advertisement video main system in the interactive service including video service providing system; Interactive service including a video service providing method comprising a. The method according to claim 22 or 23, The interactive advertisement information file, Composed of an Extensible Markup Language (XML) file format Method of providing a video service including the interactive advertising, characterized in that. The method according to claim 22 or 23, In step (b), The transmission of the interactive advertisement information file and the video to the user terminal, By means of streaming Method of providing a video service including the interactive advertising, characterized in that. The method according to claim 22 or 23, In step (b), Position information on the screen on which the advertisement object appears, Determined by on-screen coordinates Method of providing a video service including the interactive advertising, characterized in that. The method according to claim 22 or 23, After step (c), (d) receiving a purchase request for a product mapped to the advertisement object from a user terminal; (e) performing a payment for the product requested to be purchased; Interactive service including a video service providing method characterized in that it further comprises. The method according to claim 22 or 23, In the step (c) product detail information to be sent to the user terminal, Includes a Uniform Resource Locator (URL) address that can be hyperlinked to a site where the product is purchased by a user's click. Method of providing a video service including the interactive advertising, characterized in that. A service that allows users to check the product information at the request of the video viewer for a specific object (hereinafter referred to as an "advertising object") that appears in the video while watching a video (hereinafter referred to as a "video service with two-way advertising"). As a system to provide (hereinafter referred to as "video service providing system with two-way advertising"), At the request of the video viewer, includes a main system of interactive advertising video that provides product information on the video and a specific object (hereinafter referred to as the "advertising object") that appears in the video, The interactive advertising video main system, A video content server providing video content; A file mapped to a specific video of the video content server, the file including frame (screen) information in which a specific advertisement object appears in the video and location information on the screen in which the advertisement object appears in the frame (hereinafter referred to as "bidirectional advertisement"). An interactive advertisement information file server including an information file '; An advertisement product information server including detailed information of goods mapped to the advertisement object; A control server that controls the component to perform a series of processes related to providing product information for a video and an advertisement object in the video; Interactive video service providing system including a. The method of claim 29, The interactive service video service providing system, In order to provide an IPTV terminal, portal screen data for selecting an IPTV channel including a channel for providing a video with the interactive video service including the interactive advertisement (hereinafter referred to as a video on demand channel) is provided. Data broadcasting systems; A return path server system connected to the IPTV terminal through a IPTV network through a return channel and transmitting and receiving bidirectional data with the IPTV terminal in a unicasting manner to provide an interactive IPTV messenger service; If a channel for providing a video with a video service with an interactive advertisement (hereinafter referred to as a "Video On Demand (VOD) channel") is selected from the IPTV terminal, the VOD channel is a component of the video service providing system with the interactive advertisement. A distribution server configured to transmit a Uniform Resource Locator (URL) address of a system for providing content (hereinafter referred to as a 'two-way advertising video main system') to the IPTV terminal; Interactive service including a video service providing system, characterized in that it further comprises. The method of claim 30, A multiplexing system for multiplexing the portal screen data and the program specific information (PSI) received from the data broadcasting system, and outputting the multiplexed stream by IP packetizing; And A network switch system for transmitting the IP packetized signal received from the multiplexing system to an IPTV terminal through an IPTV network in a multicasting manner; Interactive service including a video service providing system, characterized in that it further comprises. The method according to claim 29 or 30, The interactive advertisement information file, Composed of an Extensible Markup Language (XML) file format System for providing a video service including an interactive advertisement. The method according to claim 29 or 30, The interactive advertising video main system, A purchase processing server that receives a purchase request for a product mapped to the advertisement object from a user terminal, and performs a purchase process including payment for the requested product; Interactive service including a video service providing system, characterized in that it further comprises. It operates in the terminal and is connected with the video service providing system including the interactive advertisement through the information communication network, so that the user can check the product information while watching the video about a specific object (hereinafter referred to as an advertisement object) that appears in the video. A recording medium on which a client program providing a service (hereinafter referred to as a "bidirectional advertisement client") is recorded. The interactive advertising client, Transmitting a video request to the video service providing system including the interactive advertisement; A file including a requested video, frame (screen) information in which a specific advertisement object appears in the video, and position information on the screen in which the advertisement object appears in the frame (hereinafter referred to as "bidirectional"). Receiving an advertisement information file); A video player providing function of playing, rewinding, and fast forwarding the video; An advertisement object display function for interpreting the interactive advertisement information file during video playback and displaying a display on the screen indicating that there is an advertisement object on the video screen; When a user selects a specific advertisement object by using a mouse or a remote controller, sends a product information request for the selected advertisement object to the interactive service including a video service providing system; A function of displaying product information on the user terminal screen when receiving product information from the interactive service including a video service providing system; Recording medium recorded by the interactive advertising client comprising a. The method of claim 34, wherein The advertisement object display function, When the user moves the selection pointer over the advertisement object on the video screen by the mouse or the remote control, displaying an indication on the screen indicating that the selection pointer is pointing to the advertisement object. Recording medium recorded by the interactive advertising client, characterized in that. The method of claim 34, wherein The advertisement object display function, When an advertisement object appears on the video screen, always display a display pointing to that object. Recording medium recorded by the interactive advertising client, characterized in that.

Images