KR102200820B1 - Device and method for providing user interaction service by analysing alpha map - Google Patents

Abstract

User terminals that provide interactive services through alpha map analysis include an image acquisition unit that acquires a reference image and a real-time image, and an alpha map that generates an alpha map of each frame of the real-time image by comparing the reference image and the real-time image. The generator determines the control object by analyzing the alpha value of the alpha map, the alpha map analysis unit that generates a control signal for the device to be controlled by analyzing the alpha value of the control object, and the control that transmits the control signal to the control target device It may include a signal transmission unit.

Description

User terminals, set-top boxes, and methods that provide interactive services through Alpha Map analysis {DEVICE AND METHOD FOR PROVIDING USER INTERACTION SERVICE BY ANALYSING ALPHA MAP}

The present invention relates to a user terminal, a set-top box, and a method for providing an interactive service through alpha map analysis.

In order to meaningfully interpret a digital image, the work of classifying by object or dividing it into areas of interest is called image classification. Image classification methods include a method of separating the background by generating a Gaussian mixture model in pixel units through comparison between frames, a Bayesian decision model, a kernel density model, and an infrared ray. There is a method of obtaining the depth value of an object using a camera, and separating the object from the background through this.

Meanwhile, a general image recognition method recognizes an object by detecting an outline of an object from an image based on a change in contrast of the image, extracting features of the object from the outline, and grasping the relationship between the extracted features. However, this image recognition method has a problem in that it is difficult to extract an object according to the complexity of the background.

In this regard, Korean Patent Application Publication No. 2012-0071286 discloses that a main image of an object photographed by a main camera and sub-images photographed by a plurality of sub-cameras are obtained, and the main camera and the object are Estimate the depth value corresponding to the distance between, estimate the alpha map of the main image using the estimated depth value, extract the foreground region from the main image using the estimated alpha map, and use the extracted foreground region Thus, a configuration for performing image matting is disclosed.

The present invention generates an alpha map of each frame of a real-time image by comparing a reference image and a real-time image, generates an image corresponding to each frame of the real-time image using the alpha map, and transmits it to a control target device such as a set-top box. I want to. In addition, a control object is determined through an alpha value analysis of an alpha map, a control signal for a set-top box is generated through an alpha value analysis of the control object, and the signal is transmitted to a control target device such as a set-top box. However, the technical problem to be achieved by the present embodiment is not limited to the technical problems as described above, and other technical problems may exist.

As a technical means for achieving the above-described technical problem, a user terminal providing an interactive service through an alpha map analysis according to a first aspect of the present invention includes an image acquisition unit for acquiring a reference image and a real-time image; An alpha map generator for comparing the reference image and the real-time image to generate an alpha map of each frame of the real-time image; An alpha map analyzer configured to analyze an alpha value of the alpha map to determine a control object, and to generate a control signal for a control target device by analyzing the alpha value of the control object; And a control signal transmission unit for transmitting the control signal to the control target device. The control target device is a set-top box, and the control signal may include a channel change signal and a volume change signal.

In one example, it may further include an alpha map transmission unit for transmitting the alpha map and the original image of each frame to the image processing server. The alpha map of each frame and the image generated from the original image may be overlaid on the image being output through the control target device.

In one example, the alpha map analyzer may include an alpha map classifier for classifying the alpha map into a first object having an alpha value of each pixel as a first value and a second object having an alpha value of each pixel as a second value. The alpha map classification unit further includes a control object determination unit determining one of the first object and the second object as the control object based on at least one of a location, shape, and size of the first object and the second object. can do.

In an example, when the first object is located inside the second object, the control object determination unit may determine the first object as the at least one control object. The control object determination unit may determine an object corresponding to a size of a preset range among the first object and the second object as the control object.

In an example, when the size of the control object is changed by a preset ratio, the alpha map analyzer may generate a control signal of the control target device. The alpha map analyzer may generate a control signal of the control target device when the control object is located in a preset area.

According to a second aspect of the present invention, a set-top box providing an interactive service through an alpha map includes: a content receiver configured to receive a content image from a media server; An image receiving unit for receiving an image corresponding to an alpha map of each frame of the real-time image captured through the user terminal from the image processing server; An image output unit for displaying the received image on a web view browser and overlaying the web view browser on a player playing the content image; A control signal receiver for receiving a control signal from the user terminal; And a control unit that executes a command according to the control signal, wherein the control signal is generated by analyzing an alpha value of the alpha map by the user terminal to determine a control object, and analyzing the alpha value of the control object. I can.

In one example, the image output unit may control the transparency of the web view browser so that the image is projected onto the content image.

In one example, the image receiving unit may further receive coordinate values of the object from the image processing server.

In an example, in the image, the object and the background are separated based on an alpha map of each frame, and the coordinate value may be a coordinate value of the separated object.

In one example, an event generator that generates an event based on the coordinate value is further included, wherein a preset event is mapped to each area of the web view browser, and the event generator is an event corresponding to an area where the object is located. Can be created.

A method of providing a two-way service performed in a user terminal according to a third aspect of the present invention includes: acquiring a reference image and a real-time image; Comparing the reference image and the real-time image to generate an alpha map of each frame of the real-time image; Analyzing an alpha value of the alpha map to determine a control object, analyzing an alpha value of the control object to generate a control signal for a control target device; And transmitting the control signal to the control target device.

In one example, generating the alpha map of each frame includes classifying the alpha map into a first object having an alpha value of each pixel as a first value and a second object having an alpha value of each pixel being a second value. can do.

In one example, the classifying comprises determining one of the first object and the second object as the control object based on at least one of a location, shape, and size of the first object and the second object. Can include.

In one example, generating the control signal may include generating a control signal of the control target device when the size of the control object is changed by a preset ratio. The generating of the control signal may include generating a control signal of the control target device when the control object is located in a preset area.

The above-described problem solving means are merely exemplary and should not be construed as limiting the present invention. In addition to the above-described exemplary embodiments, there may be additional embodiments described in the drawings and detailed description of the invention.

According to any one of the above-described problem solving means of the present invention, an alpha map of each frame of a real-time image is generated by comparing a reference image and a real-time image, and an image corresponding to each frame of the real-time image is generated using the alpha map. Thus, it can be transmitted to a control target device such as a set-top box. In addition, a control object may be determined through an alpha value analysis of an alpha map, and a control signal for a set-top box may be generated through an alpha value analysis of the control object and transmitted to a control target device such as a set-top box. In addition, without using a separate controller device, the user may recognize a user's motion using an alpha map, generate a control signal for the user's motion, and transmit it to a control target device such as a set-top box.

1 is a block diagram of an interactive service providing system according to an embodiment of the present invention.
2 is a block diagram of the user terminal shown in FIG. 1 according to an embodiment of the present invention.
3 is a flowchart illustrating a method of providing a two-way service performed in a user terminal according to an embodiment of the present invention.
4 is a block diagram of the set-top box shown in FIG. 1 according to an embodiment of the present invention.
5 is a flowchart illustrating a method of providing a two-way service performed in a set-top box according to an embodiment of the present invention.
6 is a diagram illustrating an object extracted using an alpha map according to an embodiment of the present invention.
7A and 7B are diagrams for explaining a method of analyzing an alpha value of an alpha map according to an embodiment of the present invention.
8A and 8B are diagrams for explaining a method of generating a control signal for a set-top box through an alpha map analysis according to an embodiment of the present invention.
9A and 9B are diagrams for explaining a method of generating an event based on coordinate values of an object according to an embodiment of the present invention.
10 is a flowchart illustrating a method of providing a two-way service through alpha map analysis according to an embodiment of the present invention.
11 is a flowchart illustrating a method of providing an interactive service through an alpha map analysis according to another embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those of ordinary skill in the art can easily implement the present invention. However, the present invention may be implemented in various different forms and is not limited to the embodiments described herein. In the drawings, parts irrelevant to the description are omitted in order to clearly describe the present invention, and similar reference numerals are assigned to similar parts throughout the specification.

Throughout the specification, when a part is said to be "connected" to another part, this includes not only "directly connected" but also "electrically connected" with another element interposed therebetween. . In addition, when a part "includes" a certain component, it means that other components may be further included rather than excluding other components unless specifically stated to the contrary.

In the present specification, the term "unit" includes a unit realized by hardware, a unit realized by software, and a unit realized using both. Further, one unit may be realized using two or more hardware, or two or more units may be realized using one hardware.

In the present specification, some of the operations or functions described as being performed by the terminal or device may be performed instead by a server connected to the terminal or device. Likewise, some of the operations or functions described as being performed by the server may also be performed by a terminal or device connected to the server.

Hereinafter, with reference to the accompanying configuration diagram or processing flow chart, specific details for the implementation of the present invention will be described.

1 is a block diagram of an interactive service providing system according to an embodiment of the present invention.

Referring to FIG. 1, the interactive service providing system may include a user terminal 100, a control target device 110, a media server 120, and an image processing server 130. However, since the interactive service providing system of FIG. 1 is only an embodiment of the present invention, the present invention is not limitedly interpreted through FIG. 1, and may be configured differently from FIG. 1 according to various embodiments of the present invention. .

In general, components of the interactive service providing system of FIG. 1 are connected through a network 150. A network refers to a connection structure in which information exchange is possible between nodes such as terminals and servers. Examples of such networks include 3G, 4G, 5G, 3GPP (3rd Generation Partnership Project), and LTE (Long Term Evolution), World Interoperability for Microwave Access (WIMAX), Wi-Fi, and the like, but are not limited thereto.

The user terminal 100 may take an image through a camera provided in the user terminal 100. For example, the user terminal 100 may acquire a reference image and a real-time image. The user terminal 100 may generate an alpha map for the real-time image by comparing the reference image and the real-time image.

The user terminal 100 may generate a control signal for the control target device 110 by analyzing an alpha value of an alpha map for a real-time image. When the control target device 110 is a set-top box, the control signal may include, for example, a channel change signal and a volume change signal. Hereinafter, for convenience of description, it is assumed that the control target device 110 is a set-top box. However, the application of the present invention is not limited to a set-top box, and can be widely applied to game players, video display devices, media players, and other various computing devices requiring remote control.

The user terminal 100 may transmit an alpha map for a real-time image and an original image to the image processing server 130.

The image processing server 130 receives an alpha map and an original image for a real-time image from the user terminal 100, and sets-top an image in which a background image excluding an object from the original image is transparently adjusted based on the original image and the alpha map. It can be transmitted to the box 110.

The set-top box 110 may receive a content image from the media server 120. For example, the content may include all IPTV services such as real-time channels and video on demand (VOD).

The set-top box 110 may receive an image corresponding to an alpha map of each frame of a real-time image captured through the user terminal 100 from the image processing server 130. Here, the image may be an object and a background separated based on an alpha map of each frame of a real-time image. The image may be a PNG (Portable Network Graphics) format, and the background image may be a transparently adjusted image.

The set-top box 110 may overlay the received image on the content image being played on the display device 140 connected to the set-top box 110.

The set-top box 110 may receive a control signal from the user terminal 100 and perform a command according to the control signal.

The user terminal 100 may include a mobile terminal capable of wireless communication, and according to various embodiments of the present invention, the user terminal 100 may be a device of various types. For example, the user terminal 100 may be a portable terminal capable of accessing a remote server through a network. Here, as an example of a portable terminal, as a wireless communication device that guarantees portability and mobility, a smartphone, a tablet PC, a Personal Communication System (PCS), a Global System for Mobile communications (GSM), a Personal Digital Cellular (PDC) , PHS (Personal Handyphone System), PDA (Personal Digital Assistant), IMT (International Mobile Telecommunication)-2000, CDMA (Code Division Multiple Access)-2000, W-CDMA (W-Code Division Multiple Access), Wibro (Wireless Broadband) All types of handheld-based wireless communication devices such as Internet) terminals may be included. However, the user terminal 100 is not limited to the form illustrated in FIG. 1 or those illustrated above.

Hereinafter, the operation of each component of the interactive service providing system of FIG. 1 will be described in more detail.

FIG. 2 is a block diagram of the user terminal 100 shown in FIG. 1 according to an embodiment of the present invention. 2, the user terminal 100 includes an image acquisition unit 200, an alpha map generator 210, an alpha map analysis unit 220, a control signal transmission unit 230, and an alpha map transmission unit 240. It may include. Here, the alpha map analysis unit 220 may include an alpha map classification unit 222 and a control object determination unit 224. However, the user terminal 100 shown in FIG. 2 is only an example of implementation of the present invention, and various modifications are possible based on the components shown in FIG. 2.

The image acquisition unit 200 may acquire a reference image and a real-time image from an image captured by a camera provided in the user terminal 100. For example, the reference image may be a background image, and the real-time image may be an image of a motion of a specific object in the same space in real time after the reference image is captured.

The alpha map generator 210 may generate an alpha map of each frame of the real-time image by comparing the reference image and the real-time image. For example, the alpha map generator 210 may extract an alpha value of an image corresponding to each frame of a real-time image, and separate an object and a background from the real-time image based on the alpha value. For a moment, referring to FIG. 6, the alpha map generator 210 compares the real-time image and the reference image, separates the object 600 and the background 610, and separates the object 600 and the background 610. You can generate an alpha map based on it. For example, the alpha value of the separated object 600 may be '1', and the alpha value of the separated background 610 may be '0'. As described above, since an object can be extracted regardless of the complexity of the background through the alpha map, an image can be easily analyzed and an algorithm can be easily implemented.

The alpha map analyzer 220 may analyze an alpha value of the alpha map to determine a control object, and may generate a control signal for the set-top box 110 by analyzing an alpha value of the control object. For a moment, referring to FIG. 7A, the alpha map analysis unit 220 analyzes the alpha value of the object 710 of the first type and uses a hole 730 as a control object in the object 710 of the first type. I can judge. At this time, the hole 730 may be used as a mouse cursor on the screen of the display device 140 connected to the set-top box 110, and when the hole 730 disappears from the first type of object 710, a click signal of the mouse (Control signal for the set-top box 110) may be transmitted to the set-top box 110. The disappearance of the hole 730 refers only to a case where the size of the hole 730 gradually decreases and then disappears, and a case where the hole 730 moves out of the screen may be excluded.

The alpha map classifier 222 may classify the alpha map into a first object in which an alpha value of each pixel is a first value and a second object in which an alpha value of each pixel is a second value.

For a moment, referring to FIG. 7B, assuming that the alpha value of the object 710 of the first type is composed of '1' and the alpha value of the image other than the object 710 of the first type is composed of '0' , The alpha map classifier 222 may sequentially search for a pixel having an alpha value of '0' from the first pixel 750 of the image and classify a pixel having an alpha value of '0' as a first object. For example, when a pixel having an alpha value of '0' is detected, the alpha map classifier 222 may repeat detecting the alpha value of the nearest pixel based on the pixel.

The alpha map classifier 222 is a second object composed of pixels having an alpha value of '1' for a pixel having an alpha value of '1' (corresponding to a pixel included in the first type object 710) in the same manner as above. It can be classified as Since the alpha value of each pixel corresponding to the hole 730 located inside the object 710 of the first shape is '0', each pixel of the hole 730 may be classified as a first object.

The control object determination unit 224 may determine one of the first object and the second object as the control object based on at least one of the positions, shapes, and sizes of the first object and the second object. For example, the control object determination unit 224 may determine the hole 730 included in the fisted hand as the first object as a virtual mouse. For example, when the user clenched his fist (when the hole disappeared), it may be determined that the left side of the virtual mouse was clicked. For another example, when the user spreads his hand, it may be determined that the right side of the virtual mouse is clicked.

The control object determination unit 224 may determine the first object as at least one control object when the first object is located inside the second object. For example, referring to FIG. 7B, when the first object corresponding to the hole 730 is located inside the second object corresponding to the first type object 710, the control object determination unit 224 The hole 730 may be determined as a control object.

The control object determination unit 224 may determine an object corresponding to a size of a preset range among the first object and the second object as the control object. Also, the control object determination unit 224 may determine the control object based on the positions of the plurality of first objects and the plurality of second objects. For example, the control object determination unit 224 may determine an object not located at the edge of the plurality of first objects as the control object including the hole 730.

The alpha map analysis unit 220 may generate a control signal of the set-top box 110 when the size of the control object is changed by a preset ratio. For example, when the shape of the hand gesture is changed (e.g., when one hand is changed from a gripped gesture to an unfolded gesture or vice versa), the alpha map analysis unit 220 may be configured based on the changed hand gesture. It is possible to generate a control signal of the set-top box 110.

The alpha map analysis unit 220 may generate a control signal of the set-top box 110 when the control object is located in a preset area. For example, referring to FIG. 8A, the alpha map analysis unit 220 includes a character button of a virtual keyboard (eg, a character'in the first area 801 of the screen) for each of a plurality of preset areas 801 to 811 of the screen. Mapping A') can be mapped. When the control object is positioned in the second area 803 of the screen, the alpha map analysis unit 220 may generate a control signal to output the letter'B'.

As another example, referring to FIG. 8B, the alpha map analyzer 220 may map a control signal for controlling the set-top box 110 to each of a plurality of preset regions 815 to 819 of the screen. When the hand of the user 813 determined as the control object is located in the third area 815, the alpha map analysis unit 220 generates a control signal for changing the channel, and the hand of the user 813 is When located at 817, a control signal for decreasing the volume may be generated, and when a hand of the user 813 is located in the fifth area 819, a control signal for increasing the volume may be generated.

The control signal transmission unit 230 may transmit a control signal to the set-top box 110.

The alpha map transmission unit 240 may transmit the alpha map and the original image of each frame to the image processing server 130. In this case, the alpha map of each frame and the image generated from the original image may be overlaid on the image being output through the set-top box 110.

Meanwhile, for those skilled in the art, the image acquisition unit 200, the alpha map generation unit 210, the alpha map analysis unit 220, the alpha map classification unit 222, the control object determination unit 224, the control signal transmission unit 230 ) And the alphamap transmission unit 240 may be implemented separately, or one or more of them may be integrated and implemented.

3 is a flowchart illustrating a method of providing a two-way service performed in the user terminal 100 according to an embodiment of the present invention.

The method for providing a two-way service according to the embodiment shown in FIG. 3 is a user terminal 100, a set-top box 110, a media server 120, and an image processing server 130 according to the embodiment shown in FIGS. 1 to 2 It includes steps that are processed in a time series. Therefore, even though the contents are omitted below, the contents described with respect to the user terminal 100, the set-top box 110, the media server 120, and the image processing server 130 of FIGS. 1 to 2 are implemented as shown in FIG. It can also be applied to a method of providing a two-way service according to an example.

Referring to FIG. 3, in step S301, the user terminal 100 may acquire a reference image and a real-time image.

In step S303, the user terminal 100 may generate an alpha map of each frame of the real-time image by comparing the reference image and the real-time image.

In step S305, the user terminal 100 may analyze an alpha value of the alpha map to determine a control object, and generate a control signal for the set-top box 110 by analyzing the alpha value of the control object.

In step S307, the user terminal 100 may transmit a control signal to the set-top box 110.

In the above description, steps S301 to S307 may be further divided into additional steps or combined into fewer steps, according to an embodiment of the present invention. In addition, some steps may be omitted as necessary, and the order between steps may be changed.

Figure 4 is a block diagram of the set-top box 110 shown in Figure 1, according to an embodiment of the present invention. 4, the set-top box 110 includes a content receiving unit 400, an image receiving unit 410, an image output unit 420, a control signal receiving unit 430, a control unit 440 and an event generating unit 450. Can include. However, the set-top box 110 shown in FIG. 4 is only an example of implementation of the present invention, and various modifications are possible based on the components shown in FIG. 4.

The content receiver 400 may receive a content image from the media server 120.

The image receiving unit 410 may receive an image corresponding to an alpha map of each frame of a real-time image captured through the user terminal 100 from the image processing server 130. For example, the image may be transmitted from the image processing server 130 to a preset frame per sec (FPS). The image may be an object and a background separated based on an alpha map of each frame of a real-time image. The image may include reception time information of the image from the user terminal 100.

The image receiving unit 410 may further receive coordinate values of the object from the image processing server 130. Here, the coordinate value of the object is the coordinate value of the separated object and may be changed according to the moving direction of the object.

The image output unit 420 may display the received image on a web view browser, and may overlay the web view browser on a player playing the content image. Here, the image may be an image corresponding to a self-image projected on the content image.

The image output unit 420 may control the transparency of the web view browser so that the image is projected onto the content image. For example, the image output unit 420 may transparently control the web view browser. By controlling the web view browser transparently, only the image displayed in the web view browser can be projected onto the player. If the web view browser is overlaid on the player where the content video is played, and the image is refreshed at regular intervals, the two videos can be naturally mixed without composing the video directly. In addition, by using an image with a transparent background, only an object from which the background has been removed can achieve the same effect as being combined with the content image.

The control signal receiver 430 may receive a control signal from the user terminal 100. Here, the control signal may be generated by analyzing the alpha value of the alpha map by the user terminal 100 to determine the control object, and analyzing the alpha value of the control object.

The controller 440 may execute a command according to a control signal (eg, a channel change signal and a volume change signal).

The event generator 450 may generate an event based on the coordinate value of the separated object. The event generator 450 may generate an event corresponding to an area in which the object is located, and map a preset event to each area of the web view browser.

In this regard, referring to FIG. 9A for a while, the set-top box 110 vertically divides the screen of the game content image into a plurality of regions 902 to 918, and may set different events for each of the plurality of regions. For example, when the object 900 is located in the'E' area 910, the set-top box 110 may generate a first event corresponding to the'E' area 910. Alternatively, when the object 900 changes its location from the'E' area 910 to the'G' area 914, the set-top box 110 generates a second event corresponding to the'G' area 914 can do.

Referring to FIG. 9B, the set-top box 110 may determine a moving path of the object 900 based on the coordinate value of the object 900 received from the image processing server 130. Here, the coordinate value of the object 900 received from the image processing server 130 is mapped to the coordinate value of the character included in the game content image, and the object 900 is overlaid on the game content image instead of the character and output. The set-top box 110 may provide a game item based on an area in which the object 900 is located.

On the other hand, for those skilled in the art, each of the content receiving unit 400, the image receiving unit 410, the image output unit 420, the control signal receiving unit 430, the control unit 440 and the event generating unit 450 is implemented separately, or It will be fully understood that one or more of these may be integrated and implemented.

5 is an operation flowchart illustrating a method of providing a two-way service performed by the set-top box 110 according to an embodiment of the present invention.

The method of providing a two-way service according to the embodiment shown in FIG. 5 is a user terminal 100, a set-top box 110, a media server 120, and an image processing server 130 according to the embodiment shown in FIGS. 1 to 4. It includes steps that are processed in a time series. Therefore, even if the contents are omitted below, the contents described with respect to the user terminal 100, the set-top box 110, the media server 120, and the image processing server 130 of FIGS. 1 to 4 are shown in FIG. It can also be applied to a method of providing a two-way service according to an example.

Referring to FIG. 5, in step S501, the set-top box 110 may receive a content image from the media server 120.

In step S503, the set-top box 110 may receive an image corresponding to the alpha map of each frame of the real-time image captured through the user terminal 100 from the image processing server 130.

In step S505, the set-top box 110 may display the received image on the web view browser and overlay the web view browser on the player playing the content image.

In step S507, the set-top box 110 may receive a control signal from the user terminal 100. Here, the control signal may be generated by analyzing the alpha value of the alpha map by the user terminal 100 to determine the control object, and analyzing the alpha value of the control object.

In step S509, the set-top box 110 may execute a command according to a control signal.

In the above description, steps S501 to S509 may be further divided into additional steps or combined into fewer steps, according to an embodiment of the present invention. In addition, some steps may be omitted as necessary, and the order between steps may be changed.

10 is a flowchart illustrating a method of providing a two-way service through alpha map analysis according to an embodiment of the present invention.

The method of providing a two-way service according to the embodiment shown in FIG. 10 includes a user terminal 100, a set-top box 110, a media server 120, and an image processing server 130 according to the embodiment shown in FIGS. 1 to 9B. It includes steps that are processed in a time series. Therefore, even if the contents are omitted below, the contents described with respect to the user terminal 100, the set-top box 110, the media server 120, and the image processing server 130 of FIGS. 1 to 9B are illustrated in FIG. It can also be applied to a method of providing a two-way service according to an example.

Referring to FIG. 10, in step S1001, the user terminal 100 may acquire a reference image and a real-time image through a camera provided in the user terminal 100. In step S1003, the user terminal 100 may obtain a reference image and a real-time image. By comparing the images, an alpha map of each frame of the real-time image can be generated.

In step S1005, the user terminal 100 may transmit an original image and an alpha map corresponding to each frame of the real-time image to the image processing server 130.

In step S1007, the image processing server 130 may transmit an image corresponding to the alpha map of each frame of the real-time image to the set-top box 110.

In step S1009, the set-top box 110 may overlay the image received from the image processing server 130 on the content image being played in the player and output it.

In step S1011, the user terminal 100 may analyze the alpha value of the alpha map to determine a control object, and may generate a control signal for the set-top box 110 by analyzing the alpha value of the control object.

In step S1013, the user terminal 100 may transmit the generated control signal to the set-top box 110.

In step S1015, the set-top box 110 may execute a command according to a control signal received from the user terminal 100.

In the above description, steps S1001 to S1015 may be further divided into additional steps or combined into fewer steps, according to an embodiment of the present invention. In addition, some steps may be omitted as necessary, and the order between steps may be changed.

11 is a flowchart illustrating a method of providing an interactive service through an alpha map analysis according to another embodiment of the present invention.

The method of providing a two-way service according to the embodiment shown in FIG. 11 includes a user terminal 100, a set-top box 110, a media server 120, and an image processing server 130 according to the embodiments shown in FIGS. 1 to 10. It includes steps that are processed in a time series. Therefore, even if the contents are omitted below, the contents described with respect to the user terminal 100, the set-top box 110, the media server 120, and the image processing server 130 of FIGS. 1 to 10 are implemented as shown in FIG. It can also be applied to a method of providing a two-way service according to an example.

Referring to FIG. 11, in step S1101, the user terminal 100 compares the reference image captured by the camera of the user terminal 100 with the real-time image to generate an alpha map of each frame of the real-time image, and The original image corresponding to the frame, an alpha map, and coordinate values of an object included in the real-time image may be transmitted to the image processing server 130.

In step S1103, the image processing server 130 may transmit the coordinate values of the image and object corresponding to the alpha map of each frame of the real-time image to the set-top box 110.

In step S1105, the set-top box 110 may overlay the image received from the image processing server 130 on the content image being played in the player and output it.

In step S1107, the set-top box 110 may track the object based on the coordinate value of the object and generate an event corresponding to an area in which the object is located.

In the above description, steps S1101 to S1107 may be further divided into additional steps or combined into fewer steps, according to an embodiment of the present invention. In addition, some steps may be omitted as necessary, and the order between steps may be changed.

An embodiment of the present invention may also be implemented in the form of a recording medium including instructions executable by a computer, such as a program module executed by a computer. Computer-readable media can be any available media that can be accessed by a computer, and includes both volatile and nonvolatile media, removable and non-removable media. Further, the computer-readable medium may include both computer storage media and communication media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Communication media typically includes computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave, or other transmission mechanism, and includes any information delivery medium.

The above description of the present invention is for illustrative purposes only, and those of ordinary skill in the art to which the present invention pertains will be able to understand that it can be easily modified into other specific forms without changing the technical spirit or essential features of the present invention. will be. Therefore, it should be understood that the embodiments described above are illustrative in all respects and not limiting. For example, each component described as a single type may be implemented in a distributed manner, and similarly, components described as being distributed may also be implemented in a combined form.

The scope of the present invention is indicated by the claims to be described later rather than the detailed description, and all changes or modified forms derived from the meaning and scope of the claims and their equivalent concepts should be interpreted as being included in the scope of the present invention. .

100: user terminal
110: set-top box
120: media server
130: image processing server
140: display device
200: image acquisition unit
210: Alpha map generator
220: Alpha map analysis unit
222: Alpha map classification unit
224: control object determination unit
230: control signal transmission unit
240: Alpha map transmission unit
400: content receiver
410: image receiving unit
420: image output unit
430: control signal receiver
440: control unit
450: event generator

Claims (20)

In a user terminal that provides an interactive service through an Alpha Map analysis,
An image acquisition unit that acquires a reference image and a real-time image;
An alpha map generator for comparing the reference image and the real-time image to generate an alpha map of each frame of the real-time image;
An alpha map analyzer configured to analyze an alpha value of the alpha map to determine a control object, and to generate a control signal for a control target device by analyzing the alpha value of the control object; And
Control signal transmission unit for transmitting the control signal to the control target device
Including,
The alpha map analysis unit comprises an alpha map classification unit that classifies the alpha map into a first object having an alpha value of each pixel of a first value and a second object having an alpha value of each pixel of a second value;
The alpha map classification unit is a control object determination unit that determines one of the first object and the second object as the control object based on at least one of a position, shape, and size of the first object and the second object.
That further comprises a user terminal.
The method of claim 1,
An alpha map transmission unit that transmits the alpha map and original image of each frame to an image processing server
That further comprises a user terminal.
delete delete The method of claim 1,
The user terminal, wherein the control object determination unit determines the first object as the control object when the first object is located inside the second object.
The method of claim 1,
The control object determining unit determines an object corresponding to a size of a predetermined range among the first object and the second object as the control object.
The method of claim 1,
The alpha map analysis unit generates a control signal of the control target device when the size of the control object is changed by a preset ratio.
The method of claim 1,
The alpha map analysis unit generates a control signal of the control target device when the control object is located in a preset area.
The method according to claim 7 or 8,
The control target device is a set-top box,
Wherein the control signal includes a channel change signal and a volume change signal.
The method of claim 2,
Wherein the alpha map of each frame and the image generated from the original image are overlaid on the image being output through the control target device.
In a set-top box that provides a two-way service through an Alpha Map,
A content receiver for receiving a content image from a media server;
An image receiving unit for receiving an image corresponding to an alpha map of each frame of the real-time image captured through the user terminal from the image processing server;
An image output unit for displaying the received image on a web view browser and overlaying the web view browser on a player playing the content image;
A control signal receiver for receiving a control signal from the user terminal; And
A control unit that executes a command according to the control signal
Including,
The control signal is generated by analyzing an alpha value of the alpha map by the user terminal to determine a control object, and analyzing the alpha value of the control object,
The alpha map is classified into a first object in which an alpha value of each pixel is a first value and a second object in which an alpha value of each pixel is a second value,
The control object is determined as one of the first object and the second object based on at least one of a position, shape, and size of the first object and the second object.
The method of claim 11,
The image output unit controls the transparency of the web view browser so that the image is projected onto the content image.
The method of claim 11,
The image receiving unit further receives the coordinate value of the object from the image processing server, the set-top box.
The method of claim 13,
In the image, the object and the background are separated based on the alpha map of each frame,
The coordinate value is the coordinate value of the separated object, the set-top box.
The method of claim 13,
An event generator that generates an event based on the coordinate value
Including more,
Each area of the web view browser is mapped to a preset event,
The event generator generates an event corresponding to an area in which the object is located.
In the method of providing a two-way service performed in a user terminal,
Obtaining a reference image and a real-time image;
Comparing the reference image and the real-time image to generate an alpha map of each frame of the real-time image;
Analyzing an alpha value of the alpha map to determine a control object, analyzing an alpha value of the control object to generate a control signal for a control target device; And
Transmitting the control signal to the control target device
Including,
Generating the alpha map of each frame
Classifying the alpha map into a first object having an alpha value of each pixel of a first value and a second object having an alpha value of each pixel of a second value,
The classifying step
And determining one of the first object and the second object as the control object based on at least one of a location, shape, and size of the first object and the second object. .
delete delete The method of claim 16,
Generating the control signal comprises:
And generating a control signal of the control target device when the size of the control object is changed by a preset ratio.
The method of claim 16,
Generating the control signal comprises:
And generating a control signal of the control target device when the control object is located in a preset area.

Images