KR20150108571A - An information display device of a mirror display for advertisement and shopping by recognizing the reflected images on the mirror and method thereof - Google Patents

Abstract

The present invention relates to a method for displaying information of a mirror display by recognizing a projection image of a user, which displays information for advertisement or the like on the entire mirror display when a user is a little distant therefrom, and displays the advertisement information by moving the same to an empty space except for a part where the user is reflected by a mirror. The method of the present invention comprises the following steps: (a) displaying advertisement on the entire mirror display; (b) determining whether a user approaches the mirror display through a proximity sensor; (c) obtaining a projection image through a camera, and detecting a user area and location from the viewpoint of the user in the projection image, when the user approaches the mirror display; and (d) moving the advertisement to the detected user area and around the detected user location, and displaying the advertisement. According to the method for displaying information of a mirror display, advertisement, which has been displayed on the entire mirror display when a user approaches the mirror display, is moved to an empty space except for a user part, thus the advertising effect can be maximized by exposing the advertisement to the user while the user is using the mirror.

Description

[0001] The present invention relates to an information display apparatus and method for displaying information on a mirror display through projection image recognition by a user to display information such as advertisement and shopping,

The present invention relates to a display device, such as a display device, for displaying advertisement information and the like on the entire mirror display when the user is away from the mirror display, To a method of displaying information.

In addition, the present invention relates to a method and apparatus for displaying information such as advertisement and shopping on a mirror display by grasping an area and a position of a user looking at a mirror display from a user's point of view, The present invention relates to a method of displaying information on a mirror display through projected image recognition by a user who displays information on a mirror display.

Digital Information Display (DID) is attracting attention in addition to super high definition (UHD), stereoscopic (3D, non-glasses, hologram) In the concept of passive display, it is the tendency of the age that leads to the extension of the concept that the user can actively interact with the information. The ultra-high-quality screen realized with UHD enables enlargement of the display with high realism and enlargement of the screen size, which leads to improvement of the stereoscopic effect of stereoscopic images, and the experience of using interactive contents that digital information display (DID) Extensions will be imported.

The mirror display is a technology which is getting attention at a time when a paradigm of a new information society to be greeted by the development of such a next generation display and a progressive research in one dimension is required. The mirror display apparatus can be defined as a display apparatus having a display unit for displaying an image screen on a mirror and is useful in terms of cost and space because it does not require a separate display.

In particular, in the case of a small-sized personal smart device at present, it is inconvenient for the user to search for the content and re-distinguish the contents in order to use various contents. In addition, these smart devices are being used for personal purposes because of the small size for carrying and the fact that the device on which the content is loaded is a personal mobile phone. For this reason, there is a demand for a mirror display that improves the living culture by using mirrors as a next generation display, smart contents, and interactive contents design by developing a mirror which is a conventional analog display installed in every place such as a house or a business place.

The mirror display has been developed by providing a mirror on the front surface and a display device on the rear surface of the mirror [Patent Document 1]. At this time, the mirror used reflects a part of the light and uses a half mirror which transmits a part of the light. That is, the mirror display acts as a mirror by the reflected light, and the emitted light of the display arranged on the rear side functions as a display by transmitting through the mirror. Further, a mirror display combined with a mirror and a display by regulating the liquid crystal arrangement of the liquid crystal layer of the liquid crystal panel has been disclosed [Patent Document 2].

Further, a mirror display can be constituted by providing a transparent liquid crystal element on the front surface and a reflection medium having a reflection function on the rear surface. [Patent Document 3] When a transparent liquid crystal device is not displayed and transmits all the light, the transmitted light is reflected on the reflection medium, and the mirror display acts as a normal mirror. When a transparent liquid crystal device is driven to block light coming in from some cells and emit light of its own, the cells act as a display.

The above-described mirror display can be applied in various forms.

A mirror type display product installed in a toilet is a Cybertecture mirror (Hong Kong) [Non-Patent Document 1]. This product has weather display function, web search function, and scales interlocking function, but it is impossible to plan and develop various applications such as various Android operating systems because it uses a simple operating system based on an embedded board used in small household appliances. Products with this simple function are the only ones that are used only in the bathroom. In terms of usability, since there is no digital equipment for interactive functions such as a communication camera, a proximity sensor, and a touch screen, it merely adds a simple display function to a mirror, and does not provide contents utilizing the characteristic of a mirror.

There is also disclosed a technique of recognizing people facing a mirror display and displaying related information on a display screen in accordance with recognition results. For example, techniques have been disclosed in which a camera is installed to shoot a person, and a photographed person is displayed on a mirror display (Patent Documents 4 and 5).

In addition, a technique of grasping the position of a person facing a mirror by using a detection mark or the like, and displaying a virtual image of the person reflected in the mirror by wearing it has been disclosed (Patent Document 6). A technique has been disclosed in which a position of a person's eye looking at a mirror display is grasped and a position where an object projected in a mirror is projected based on the position of the eye of the person is grasped and additional information of the object is displayed [ Patent Document 7].

According to the above-described technologies, the smart mirror system utilizes a mirror as shown in FIG. 1 to provide an ultra-high resolution LED display and a proximity sensor capable of detecting a person approaching to use the mirror based on the Android operating system, A multi-touch sensor, and a front camera for content use.

Through these functions, it is usually used as a photo slide function such as a frame, an album, or a living information display such as time and weather, and a screen is changed so that the user can use it as a mirror when the user approaches. In addition, when the user touches the screen, the smart function is displayed and a natural user experience (UX) is available. Smart Mirror can utilize all applications that have been used in smartphones, smart pads and so on until now. Even if you use it for a long time, the Android main board does not cause errors or malfunctions like ordinary PC, so stable operation is possible regardless of the user's expertise.

These mirror displays are one of the devices that display information such as shopping and advertisement. Excessive advertising exposure through the mirror display, however, is inconvenient for users. In addition, if the user changes the screen so that it can be used as a mirror when coming close to the mirror, there is a problem that information such as an advertisement can not be effectively delivered to the user.

Therefore, it is necessary that the advertisement information is displayed in a blank space other than the part where the user is visible in the mirror when the user approaches while displaying information such as advertisement when the user is a little far away. However, there is still a lack of technology for accurately recognizing the physical position of a user's image formed on a mirror display and displaying information such as advertisements around the user area based on the physical location.

[Patent Document 1] Japanese Laid-Open Patent Application No. 2014-032312 (published on April 20, 2014) [Patent Document 2] Korean Laid-Open Patent Application No. 2012-0074499 (Published July 6, 2012) [Patent Document 3] Korean Published Patent Application No. 2013-0037600 (published on April 16, 2013) [Patent Document 4] U.S. Published Patent Application No. 2013-0229482 (published on May 3, 2013) [Patent Literature 5] Japanese Laid-Open Patent Application No. 2010-087569 (Published April 15, 2010) [Patent Document 6] Japanese Laid-Open Patent Application No. 2013-0128202 (published on November 26, 2013) [Patent Document 7] Korean Published Patent Application No. 2013-0128202 (published on November 26, 2013)

[Non-Patent Document 1] http://www.cybertecturemirror.com/main.php?id=features

An object of the present invention is to solve the above-mentioned problems, and it is an object of the present invention to provide a method and apparatus for displaying advertisement information on the entire mirror display when the user is slightly away from the user, The present invention also provides a method of displaying information on a mirror display by recognizing a projection image of a user moving and displaying the information.

In particular, it is an object of the present invention to provide a method and apparatus for imaging a mirror image of a user, capturing an image of a user on a mirror of a mirror display, determining a projection image and position on the user's mirror from the captured image, The present invention provides a method of displaying information on a mirror display through projected image recognition of a user displaying information such as shopping and advertisement in the vicinity.

According to an aspect of the present invention, there is provided a display device including a mirror display having a mirror panel and a display panel coupled to each other, and a camera installed around the mirror display and photographing a front surface of the mirror display, A method of displaying information on a mirror display through projection image recognition of a user displaying shopping and advertisement information on the mirror display based on an area and a location, the method comprising the steps of: (a) displaying an advertisement on the entire mirror display; (b) determining whether the user is close to the mirror display through the proximity sensor; (c) if the user is proximate, acquiring a projection image by the camera, and detecting a user area and position of the user from the projection image; And (d) moving and displaying the advertisement around the detected area and location of the user.

The method may further include the steps of: (c1) inputting, as a projection image obtained by the camera, a projection image projected on the mirror display; Receiving; (c2) correcting the input projection image; (c3) detecting a user's face in the corrected projection image; (c4) detecting a face region and a position of the user's view from the detected face image of the user.

According to another aspect of the present invention, there is provided a method of displaying information on a mirror display through projection image recognition by a user, the method comprising the steps of: (d) moving an advertisement from the entire mirror display to the periphery of the user area, And moving the screen.

According to another aspect of the present invention, there is provided an apparatus for displaying information on a mirror display through projected image recognition of a user, wherein the controller detects a face using an Adaboost algorithm.

In the method of displaying information on a mirror display through a user's projection image recognition, the control device controls the actual size (A ') of the mirror display, the size (A) of the mirror display photographed from the camera, (B ') and position (-) of the actual face using the relationship between the size of the display (A) - the detected face area (B) and the size of the photographed mirror display Is detected.

Further, the present invention is a method for displaying information of a mirror display through projection image recognition by a user, wherein the control device obtains an actual size of a face region of a user by the following [Expression 1].

[Equation 1]

However, the size of the face detection area is the size of the face detection area in the image,

The size of the actual mirror display is a predetermined value.

Further, the present invention is a method for displaying information on a mirror display through projected image recognition of a user, wherein the control device obtains an actual distance from a face region of a user by the following equation (2).

[Equation 2]

However, the reference distance and the reference size are predetermined values.

As described above, according to the method of displaying information on the mirror display through the projection image recognition of the user according to the present invention, when the user approaches the mirror display, the advertisement displayed on the entire screen is moved to the empty space outside the part where the user is viewed in the mirror It is possible to maximize the advertising effect by exposing the advertisement to the user while the user is using the mirror.

Brief Description of the Drawings Fig. 1 is a schematic view of an entire transverse pipe and a cleaning tool provided with a cleaning tool stopper according to the present invention.
BACKGROUND OF THE INVENTION Field of the Invention [0001] The present invention relates to an information display apparatus for a mirror display, and more particularly,
3 is an exemplary view showing a layout of a camera for a mirror display and a mirror photographing according to an embodiment of the present invention, wherein (a) is a front view and (b) is a side view.
FIG. 4 is a layout diagram showing various camera positions for photographing a mirror according to an embodiment of the present invention, wherein (a) is a top and bottom type, (b) is a corner type, and (c) is a left and right type.
5 is a block diagram showing a configuration of a control device of an information display apparatus of a mirror display through projected image recognition of a user according to an embodiment of the present invention.
FIG. 6 is a diagram illustrating an operation example of a mirror display according to the present invention. FIG. 6 (a) is an illustration of an image of a mouth direction object reflected by a mirror, (b) image processing and recognition, and (c)
7 is a flowchart illustrating a method of displaying information of a mirror display through projection image recognition by a user according to an embodiment of the present invention.
Figure 8 is a flow diagram illustrating the steps of detecting a user's area of user's location and location in accordance with one embodiment of the present invention.
9 is a flowchart illustrating a face detection step according to an embodiment of the present invention;
10 is an exemplary view of a mirror display according to the present invention, wherein (a) is a layout of a camera, and (b) is an example of a captured image.
FIG. 11 is an exemplary image of a viewpoint prediction through tracking of a face according to the present invention. FIG. 11 (a) shows a mirror display image (after lens and geometric distortion correction), (b) Fig.
12 is a view illustrating a size of a mirror display, a size of a detected face, and a distance to a camera according to the present invention;
13 is a view illustrating a size of a mirror display and a size of an image in a photographed image according to the present invention.
FIG. 14 is a view for explaining a time point predicted through an image photographed by a camera according to the present invention and a process of generating a composite image. FIG.
Figure 15 is an illustration of an image viewed by a user through a mirror display in accordance with the present invention;
FIG. 16 is an illustration of an image displaying information such as shopping and advertisement using the mirror display according to the present invention; FIG.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, the present invention will be described in detail with reference to the drawings.

In the description of the present invention, the same parts are denoted by the same reference numerals, and repetitive description thereof will be omitted.

First, a configuration of an information display apparatus for a mirror display through projected image recognition of a user in a practical example of the present invention will be described with reference to FIG.

As shown in FIG. 2, in an embodiment of the present invention, an information display apparatus for a mirror display through projected image recognition of a user includes a mirror display 10, a camera unit 21, and a controller 30 . In addition, it may be constituted by adding various sensors (not shown) such as a proximity sensor.

The mirror display 10 is a display panel combined with a specially coated mirror panel serving as a mirror. The mirror display 10 is preferably provided with a touch function.

In one embodiment, the mirror display 10 has a mirror 11 on its front side and a display device 12 on the rear side of the mirror 11. At this time, it is preferable to use a half mirror which reflects a part of light and transmits a part of the mirror. That is, the mirror display 10 acts as a mirror 11 by the reflected light, and the emitted light of the display device 12 arranged on the rear side passes through the mirror and functions as a display. In this case, the display device 12 may include a liquid crystal display (LCD) panel, or may include an organic EL (Organic Electro Luminescence) panel or a PDP (Plasma Display Panel) have.

In another embodiment, the mirror display 10 is provided with a transparent display device 12 on its front surface, and a light reflection paint or reflection film (or a reflective polarizing film And the like. That is, when light passes through the transparent display device 12 without operating some light emitting devices, the light is reflected by the light reflecting film to serve as a mirror, and the remaining portion of the light emitting device of the transparent display device 12, Function. At this time, preferably, the display device 12 is a transparent display, and a normal transparent organic electroluminescent display (OLED) or the like can be used.

On the other hand, the reference numeral 15 denotes a mirror fixing portion to which the mirror display device 10 and the like can be housed.

The camera unit 21 is a camera device installed around (or around) the mirror display 10, and is composed of at least one camera capable of photographing the front surface of the mirror display 10 itself. In particular, the camera 21 is mounted in close contact with the mirror display 10.

3 shows the arrangement of the camera 21 for photographing the image formed on the mirror display 10 and the mirror display 10. Various camera arrangements are possible for photographing images formed on the mirror display 10, which are illustrated in several forms in FIG.

Preferably, the camera section 21 is constituted by a camera equipped with a wide-angle lens. As shown in FIG. 3, when a camera is positioned at the top, a wide-angle lens is requested to the camera so that a wide area image can be taken as much as possible. In this case, a shaded area is generated which can acquire an image by the position of the camera. Thus, two or more cameras can be mounted to remove such shadow areas. It can be variously determined according to the type of service to be provided.

On the other hand, various sensor units (not shown) such as a proximity sensor are composed of sensors for object and environment recognition.

The control device 30 is a device having a normal computing function and includes a central processing unit (or a microprocessor), a memory, a storage device, an input / output device, a communication device, and the like. Preferably, the control device 30 is provided with an operating system such as Android (or Windows, Linux), and may be provided with a display drive, a shopping and advertisement display program, and the like.

5, the control device 30 includes an input unit 31 for receiving touch coordinates by a touch function, an image or image by the camera unit 21, a sensing value by various sensors such as a proximity sensor, A display unit 32 for displaying a screen on a display device of the mirror display 10, a communication unit 33 for communicating data with the network such as a wired / wireless Internet and a mobile communication modem, a memory 35 for storing data, And a control unit 34 implemented by a processing unit or a microprocessor.

Next, an overview of a method of displaying information of a mirror display through projection image recognition by a user according to the present invention will be described as follows.

When an object or a user is recognized through a sensor and a camera, an image formed on a mirror display is photographed through a camera and recognized through various image processing. In this case, since the physical space information of the image formed on the mirror display and the mirror display is accurately extracted, it is possible to create an accurate composite image based on the physical space information. If an object or a user is directly photographed, it is difficult to precisely synthesize the acquired object and the physical position information of the user with the photographing environment (distance, angle, illumination, etc.).

Since the mirror display shows its own shape reflected on the mirror and the image provided on the display, the composite image provided based on the physical position information on the shape of the mirror reflected on the mirror can obtain an excellent effect.

This process is illustrated in FIG. 6 (a) shows a case where a cubic object exists in front of the mirror display. The cubic object will be reflected on the mirror, and an image will be formed. After the image formed on the mirror is photographed, b). It is also important to note that if the object is a user, it can be said to be an image that is visible to the user. Based on this information, if a small cubic object is created as shown in FIG. 6 (c) and artificially projected on a display, two images can be obtained with extremely fine synthesis as shown in FIG. 6 (c). In FIG. 6 (c), the upper object is generated by a graphic and the lower object is a mirror image of the actual object that is currently positioned in front of the mirror. This feature is due to the fact that images were created based on the image information of the image formed on the mirror display.

Next, a method of displaying information of a mirror display through projection image recognition by a user according to an embodiment of the present invention will be described with reference to FIG.

As shown in FIG. 7, a method of displaying information of a mirror display through projection image recognition of a user according to an embodiment of the present invention includes the steps of: (a) displaying an advertisement on the entire mirror display; (b) determining whether the user is close to the mirror display (S20); (c) if the user is proximate, detecting (S30) a user area and position of the user's view; And (d) moving and displaying the advertisement around the detected area and location of the user (S40).

First, an advertisement is displayed on the entire mirror display 10 (S10).

Then, it is determined whether the user is close to the mirror display 10 (S20). Preferably, a proximity sensor or the like detects whether the user is close to the mirror display 10.

Next, a description will be given of a step S30 of detecting a user area and a user's point of view when the user is close to each other.

As shown in FIG. 8, the step S30 of detecting the user area and the position of the user view includes: (c1) receiving (S31) a projection image obtained by the camera; (c2) correcting the input projection image (S32); (c3) detecting a face in the projected image (S33); And (c4) detecting a face region and a position of the user's view (S34).

First, the projection image obtained by the camera of the camera unit 21 is inputted (S31). As described above, the projection image obtained by the camera 21 is an image (or image) obtained by photographing the front surface of the mirror display 10 by the camera 21. [ Preferably, the camera 21 is a camera equipped with a wide-angle lens. Therefore, the projected image photographed by the wide-angle lens is distorted compared with the normal image.

Next, the input projection image is corrected (S32).

The camera 21 for photographing an image formed on the mirror display 10 is closely mounted on the mirror display 10 and various types of distortion are generated because a wide area is photographed using the wide angle lens.

The first distortion is the lens distortion due to the use of a wide-angle lens, and the second is the distortion that occurs because the angle between the camera lens and the object to be imaged is close to vertical.

Various distortions can occur due to the physical location of the camera and the use of the lens. First, the lens distortion is removed and then the image is reconstructed. In the reconstructed images, shaded regions that are not photographed are generated at the corners, respectively, and two images are combined to obtain the final result image. Various parameters used in the process of acquiring the corrected image are set and fixed only once after the camera is installed.

Next, the face of the user is detected in the projected image (S33).

Object or face is extracted using object or face detection technique. Feature points are detected from the extracted object or face, and the position of the object or face is updated at a high speed by using the feature point based object or face tracking method.

The object or face detection process uses a modified Adaboost algorithm and reduces the calculation time by reducing the size of the target image to which the Adaboost algorithm is applied. First, a motion region is detected from an input image. This is obtained by detecting the difference between the previous frame and the current frame. If there is no motion, the difference image is repeatedly obtained until there is motion. Once the difference image is obtained, the difference image is cumulatively added in the horizontal direction and the vertical direction, respectively. The result is shown as one row and one column, and the intersection of the two extensions is obtained by extending each pixel with nonzero values as rows and columns. The results use a morphology filter (erosion filter and dilation filter) to remove small areas such as noise, and binarize the filtered image.

 Face detection uses a method of detecting the face color. In general, since the face color depends heavily on illumination, in the present invention, the image format is changed from RGB to YCbCr in order to reduce the dependency. Of these, the Y component is most sensitive to illumination, so only Cb and Cr components are used. In the present invention, the range of the color used for the skin color is the skin color reference map B (x, y), and is expressed by Equation (1).

[Equation 1]

 The region satisfying this equation is extracted and a morphology filter is applied to the result to remove small regions such as noise, and the result is also binarized. An intersection (AND) is obtained for two acquired images, and the object or face region is detected by extracting corresponding RGB image and applying Adaboost algorithm to the result region. 9 is a flowchart of the above-described face detection step.

Next, the face area and the position of the user's view are extracted (S34).

Before explaining the concrete detection method, the difference between the projection image obtained by correcting in the previous step and the image viewed from the user's view is examined.

Adjust the position and angle of the camera to shoot a subject at a certain distance from the mirror display. At this time, the image to be photographed corresponds to the image formed in the mirror display. FIG. 10 (a) is a diagram showing a relationship between a mirror display for photographing a subject using a mirror display, a camera, and a subject. Due to the characteristics of the mirror display and the position and angle of the camera, the image obtained from the camera has a shape as shown in FIG. 10 (b).

11 (a) shows the result of the correction of the image photographed by the camera, and Fig. 11 (b) shows the face position (inside the rectangle) discriminated through the face detection algorithm. The face detection algorithm can be used in various ways, and the position of the user's eye is determined from the detected face region to predict the viewpoint.

We used the Adaboost algorithm to find faces in advance, which can detect face regions and eye positions. If a face is detected, it can be predicted proportionally where the position of the eye is in the face. In addition, the method of simply finding the eyes is to detect the pupil by detecting the black part located at a certain distance from the face after detecting the face.

On the other hand, as shown in FIG. 11, the projected image photographed by the camera 21 is shot on one side in comparison with the image viewed from the user's point of view. Therefore, it is necessary to extract the region and position of the image viewed from the user view from the projection image.

12, the actual size (A ') of the mirror display - the size (A) of the mirror display photographed from the camera, the size (A) of the photographed mirror display - the detected face area (B) The size (A) of the display - the actual face size (B ') and position can be detected using the relationship between the distance from the camera and the angle (C).

That is, a mirror display is photographed using a camera, and after the correction is performed, an image as shown in FIG. 13 is obtained. When the mirror display and the camera are installed, the size of the actual space included in the photographed image, the size of the mirror display, and the distance between the cameras are stored in advance in the memory as the measured values. When the face region is detected through the Adaboost algorithm, the size of the real face can be calculated through a proportional expression between the detected face region and the size of the mirror display.

The size of the actual face is obtained by the following equation (2).

&Quot; (2) "

Also, if the size of the actual face is obtained, the distance between the mirror display and the user can be predicted. The proportional expression used at this time can be set through the calibration process when the mirror display is initially installed. That is, the reference distance and the reference size for the face object or their proportional and proportional relationships are previously measured and stored in a memory or the like.

Since the size of the actual face is already known through Equation (2), it is possible to know the distance that the actual user is located based on the reference distance information set at the initial reference face size.

The actual distance is obtained by the following equation (3).

&Quot; (3) "

Through this, the position of the user can be confirmed and, as will be seen from the following, the present reality service can be provided according to the viewpoint of the user.

Next, information such as shopping and advertisement is displayed on the basis of the detected face area / position of the detected user (S40).

After predicting the viewpoint of the user viewing the mirror display, information such as shopping and advertisement can be displayed on the mirror display according to the user's viewpoint. FIG. 14 (a) shows a form of displaying information such as shopping and advertisement in the vicinity of the location after predicting the user's viewpoint.

The user can view his or her reflection reflected on the mirror display and the shopping and advertisement images displayed around the same. Figure 15 shows this result.

FIG. 16 shows an example in which a simple service is provided after implementing a system capable of identifying a user's location and size using a mirror display, generating a composite image through the display, and providing a shopping and advertisement to a user. FIG. 16 (a) is an image in which information such as shopping and advertisement is displayed on the entire mirror display when the user is far away. FIG. 16 (b) Is displayed on the screen. In other words, it is a combination of images that show information such as advertisements and shopping displayed in the users and their surroundings.

The invention made by the present inventors has been described concretely with reference to the embodiments. However, it is needless to say that the present invention is not limited to the embodiments, and that various changes can be made without departing from the gist of the present invention.

10: mirror display 11: mirror
12: display device 21: camera
30: control device 31: input part
32: Display section 33:
34: control unit 35: memory

Claims (7)

A mirror display having a mirror panel and a display panel combined together and a camera installed around the mirror display and photographing a front surface of the mirror display to display shopping and advertisement information based on the area and position of the user- A method of displaying information on a mirror display through projected image recognition of a user displaying information on the mirror display,
(a) displaying an advertisement on the entire mirror display;
(b) determining whether the user is close to the mirror display through the proximity sensor;
(c) if the user is proximate, acquiring a projection image by the camera, and detecting a user area and position of the user from the projection image; And
(d) moving and displaying the advertisement around the detected area and position of the user, and displaying the advertisement.
The method of claim 1, wherein the step (c)
(c1) receiving as a projection image acquired by a camera, a projection image projected on the mirror display;
(c2) correcting the input projection image;
(c3) detecting a user's face in the corrected projection image;
(c4) detecting the face region and the position of the user's view from the detected face image of the user.
The method according to claim 1,
The method of claim 1, wherein, in the step (d), when the advertisement is moved from the entire mirror display to the periphery of the user area, the screen is moved using an animation effect. .
The method according to claim 1,
Wherein the face is detected by using an Adaboost algorithm in the step (c3).
3. The method of claim 2,
In step (c4), the actual size A 'of the mirror display, the size A of the mirror display photographed from the camera, the size A of the photographed mirror display, the detected face area B, (B ') and a position of a real face are detected by using a relationship between a size (A) of a display and a distance between the camera and an angle (C) Way.
3. The method of claim 2,
Wherein the actual size of the face region of the user is calculated according to Equation (1) in the step (c4).
[Equation 1]

However, the size of the face detection area is the size of the face detection area in the image,
The size of the actual mirror display is a predetermined value.
The method according to claim 6,
And the actual distance to the face region of the user is obtained by the following equation (2): " (2) "
[Equation 2]

However, the reference distance and the reference size are predetermined values.

Images