KR102209745B1 - An information display device of a mirror display for advertisement and shopping by recognizing the reflected images on the mirror and method thereof - Google Patents

Abstract

The present invention displays information such as advertisements on the entire mirror display when the user is a little far away, and when the user approaches, the user moves the advertisement information to an empty space other than the part reflected by the mirror and displays the mirror display through recognition of the user's projection image. A method for displaying information, comprising: (a) displaying an advertisement on the entire mirror display; (b) determining whether the user is close to the mirror display through the proximity sensor; (c) acquiring a projection image by the camera when a user approaches, and detecting a user region and a location of the user's perspective from the projection image; And (d) moving and displaying the advertisement around the detected user's area and location.
According to the information display method of the mirror display as described above, when the user approaches the mirror display, the advertisement displayed in the whole is moved to an empty space other than the user part on the mirror, so that the advertisement is exposed to the user while the user uses the mirror to effect the advertisement. Can be maximized.

Description

{An information display device of a mirror display for advertisement and shopping by recognizing the reflected images on the mirror and method thereof] to display information such as advertisements and shopping

The present invention displays information such as advertisements on the entire mirror display when the user is a little far away, and when the user approaches, the user moves the advertisement information to an empty space other than the part reflected by the mirror and displays the mirror display through recognition of the user's projection image. It relates to how to display information of.

In addition, in the present invention, in displaying information such as advertisements and shopping on a mirror display, by identifying the user's area and location looking at the mirror display from the user's point of view, advertising and shopping in an empty space around the user's area and location The present invention relates to a method of displaying information on a mirror display through recognition of a user's projection image that displays information on the back.

In the display 2.0 era, digital information display (DID) is in the spotlight along with major businesses such as ultra-high definition (UHD) and stereoscopic images (3D, glasses-free, hologram). It is a trend in the era that leads from the concept of passive display to the expansion of the concept that users can actively obtain information through interaction. Due to the ultra-high-definition screen implemented in UHD, the display can be enlarged with a high sense of realism and the expansion of the screen size, which leads to an improvement in the three-dimensional effect of the 3D image, thereby enhancing the experience of using interactive content that DID (digital information display) can provide to users. Will bring expansion.

Mirror display is a technology that is receiving new attention at the time when a new paradigm of information society is met due to the development of such next-generation displays, and a further advanced study is needed. The mirror display device can be defined as a display device including a display unit for displaying an image screen in a mirror, and does not require a separate display, so it is useful in terms of cost and space utilization.

In particular, in the case of a small smart device for personal use, which is currently common, there is an inconvenience in that a user needs to search for the content and divide the content again in order to use various contents. In addition, these smart devices are used for personal purposes due to their small size for portability and the nature of the device on which content is mounted is a personal mobile phone. For this reason, there is a need for a mirror display that improves living culture by developing a mirror, which is a traditional analog display installed anywhere, such as a house or business, to be used as a next-generation display and equipped with smart content and even interactive content design.

A mirror display is being developed with a mirror on the front side and a display device on the rear side of the mirror [Patent Document 1]. At this time, the mirror used is a half mirror that reflects part of the light and transmits part of the light. That is, the mirror display acts as a mirror by reflected light, and acts as a display by transmitting light emitted from the display disposed on the rear side through the mirror. In addition, by adjusting the liquid crystal arrangement of a liquid crystal layer of a liquid crystal panel, a mirror display and a display combined mirror display have been disclosed [Patent Document 2].

In addition, a mirror display can be configured by providing a transparent liquid crystal element on the front side and a reflection medium having a reflection function on the rear surface [Patent Document 3]. When the transparent liquid crystal device is not displayed and transmits all light, the transmitted light is reflected by the reflective medium, and the mirror display acts as a normal mirror. When the transparent liquid crystal device is driven to block incoming light and emit light, the cells act as a display.

The mirror display as described above can be applied in various forms.

As a mirror-type display product installed in a bathroom, there is a Cybertexture Mirror (Hong Kong) [Non-Patent Document 1]. This product has a weather display function, a web search function, and a weight scale linkage function, but it is impossible to plan and develop various applications like various Android operating systems because it uses a simple operating system based on an embedded board used for small home appliances. It is also the reason that products with these simple functions cease to be used only in the bathroom. In terms of usability, since there is no digital equipment for interactive functions such as a camera for communication, a proximity sensor, or a touch screen, a simple display function has been added to the mirror, and content utilizing the characteristics of a mirror cannot be provided.

Also, a technology for recognizing people facing the mirror display and displaying related information on a display screen according to a recognition result is also disclosed. For example, technologies for photographing a person by installing a camera and displaying the photographed person on a mirror display have been disclosed [Patent Documents 4 and 5].

In addition, a technique for identifying the position of a person facing a mirror using a detection mark or the like, and displaying an image of a person reflected in the mirror by wearing a virtual clothing has been disclosed [Patent Document 6]. A technology for displaying additional information of the object by grasping the position of a person's eye looking at a mirror display and then identifying the position at which an object projected by the mirror is projected based on the position of the human eye is being disclosed [ Patent Document 7].

By using the above technologies, the smart mirror system uses a mirror as shown in FIG. 1 to provide an ultra-high-definition LED display inside and an interactive proximity sensor capable of detecting a person approaching to use the mirror based on the Android operating system. It is equipped with a multi-touch sensor for and a front camera for content utilization.

Through this function, it is usually used as a photo slide function such as a frame or an album or as a display of life information such as time and weather, and the screen is changed to be used as a mirror when the user approaches. In addition, when the user touches the screen, smart functions are displayed, allowing a natural user experience (UX) to be used. Smart mirrors can utilize all applications that have been operated on smartphones and smart pads so far. Even if used for a long time, the Android mainboard does not cause errors or malfunctions like a general PC, so stable operation is possible regardless of the user's expertise.

Such a mirror display is one of good devices for displaying information such as shopping and advertisements. However, excessive advertisement exposure through a mirror display causes inconvenience to the user. In addition, if the screen is changed so that it can be used as a mirror when the user approaches the mirror, there is a problem that information such as effective advertisements cannot be delivered to the user.

Therefore, it is necessary to display information such as advertisements when the user is a little far away, and when the user approaches, the advertisement information is displayed in an empty space other than the part projected by the user. However, technology for accurately recognizing the physical location of a user's image on a mirror display and displaying information such as advertisements around the user's area based on this is still insufficient.

[Patent Document 1] Japanese Patent Publication No. 2014-032312 (published on February 20, 2014) [Patent Document 2] Korean Patent Publication No. 2012-0074499 (published on July 6, 2012) [Patent Document 3] Korean Patent Publication No. 2013-0037600 (published on April 16, 2013) [Patent Document 4] US Patent Publication No. 2013-0229482 (published on September 5, 2013) [Patent Document 5] Japanese Laid-Open Patent No. 2010-087569 (published on April 15, 2010) [Patent Document 6] Japanese Patent Publication No. 2013-0128202 (published on November 26, 2013) [Patent Document 7] Korean Patent Publication No. 2013-0128202 (published on November 26, 2013)

[Non-Patent Document 1] http://www.cybertecturemirror.com/main.php?id=features

An object of the present invention is to solve the above-described problems, and when the user is a little far away, information such as advertisements is displayed on the entire mirror display, and when the user approaches, the advertisement information is displayed in an empty space other than the part projected by the mirror. It is to provide a method of displaying information on a mirror display through recognition of a user's projection image that is moved and displayed.

In particular, it is an object of the present invention to capture an image of a user projected on a mirror of a mirror display, to grasp a projection image and a position on the user's mirror from the captured image, and to view a screen area of the display corresponding to the projection image and position. It is to provide a method of displaying information on a mirror display through recognition of a projection image of a user who displays information such as shopping and advertisements in the vicinity.

In order to achieve the above object, the present invention includes a mirror display in which a mirror panel and a display panel are combined, and a camera installed around the mirror display to photograph the front side of the mirror display. A method for displaying information on a mirror display through recognition of a user's projection image for displaying shopping and advertisement information on the mirror display based on an area and location, the method comprising: (a) displaying an advertisement on the entire mirror display; (b) determining whether the user is close to the mirror display through the proximity sensor; (c) when a user approaches, acquiring a projection image by the camera, and detecting a user area and location of the user's perspective from the projection image; And (d) moving and displaying the advertisement around the detected user's area and location.

In addition, the present invention provides a method for displaying information on a mirror display through recognition of a user's projection image, wherein step (c) includes inputting a projection image projected on the mirror display as a projection image acquired by a camera (c1) Receiving step; (c2) correcting the input projection image; (c3) detecting a user's face from the corrected projection image; and (c4) detecting a face region and a location of the user's perspective from the detected face image of the user.

In addition, the present invention provides a method for displaying information on a mirror display through recognition of a user's projection image, in step (d), when moving an advertisement from the entire mirror display to the periphery of the user area, using an animation effect It is characterized by moving the screen.

In addition, according to the present invention, in an information display device of a mirror display through recognition of a user's projection image, the control device is characterized in that the face is detected using an Adaboost algorithm.

In addition, the present invention provides a method for displaying information on a mirror display through recognition of a user's projection image, wherein the control device includes an actual size of the mirror display (A')-the size of the mirror display taken from a camera (A), and a photographed mirror. Using the relationship between the size of the display (A)-the detected face area (B) and the size of the photographed mirror display (A)-the distance and angle from the camera (C), the actual size (B') and the position of the face are determined. It is characterized by detecting.

In addition, according to the present invention, in a method of displaying information on a mirror display through recognition of a user's projection image, the control device is characterized in that the actual size of the user's face area is obtained by the following [Equation 1].

[Equation 1]

However, the size of the face detection area is the size of the face detection area in the image,

The actual mirror display size is a predetermined value.

Further, in the present invention, in a method of displaying information on a mirror display through recognition of a user's projection image, the control device is characterized in that the actual distance to the user's face area is obtained by the following [Equation 2].

[Equation 2]

However, the reference distance and the reference size are predetermined values.

As described above, according to the method for displaying information on the mirror display through the recognition of the user's projection image according to the present invention, when the user approaches the mirror display, the advertisement displayed in the whole is moved to an empty space other than the part projected by the mirror. By doing so, it is possible to maximize the advertising effect by exposing the advertisement to the user while the user uses the mirror.

Figure 1 is a block diagram of the entire sweeping hole and a horizontal main pipe installed with a sweeping mouth stopper according to the present invention.
2 is a (a) front view and (b) a cross-sectional view of an information display device of a mirror display through recognition of a user's projection image according to an embodiment of the present invention.
3 is an exemplary view of a layout view of a mirror display and a camera for photographing a mirror according to an embodiment of the present invention, as illustrated in (a) a front view and (b) a side view.
Figure 4 is a layout diagram showing various camera positions for photographing a mirror according to an embodiment of the present invention, (a) an up and down type, (b) a corner type, (c) an exemplary layout of a left and right type.
5 is a block diagram showing the configuration of a control apparatus of an information display device of a mirror display through recognition of a user's projection image according to an embodiment of the present invention.
6 is an exemplary view of an operation of a mirror display according to the present invention, (a) photographing an upright object reflected in the mirror, (b) image processing and recognition, and (c) an example of synthesizing an image based on the recognized information.
7 is a flowchart illustrating a method of displaying information on a mirror display through recognition of a user's projection image according to an embodiment of the present invention.
8 is a flow chart illustrating the steps of detecting a user area and location from a user's perspective according to an embodiment of the present invention.
9 is a flowchart illustrating a face detection step according to an embodiment of the present invention.
10 is an exemplary diagram of photographing of a mirror display according to the present invention, (a) an arrangement of a camera, and (b) an exemplary diagram of a photographed image.
11 is an exemplary image image of prediction of a viewpoint through face tracking according to the present invention, (a) a mirror display image (after lens and geometric distortion correction), (b) an image image of a viewpoint prediction result through face tracking Example diagram.
12 is a diagram illustrating a size of a mirror display, a size of a detected face, and a distance to a camera according to the present invention.
13 is a diagram illustrating the size of a mirror display and an image in a captured image according to the present invention.
14 is a diagram illustrating a process of generating a composite image and a viewpoint predicted through an image captured by a camera according to the present invention.
15 is an exemplary view of an image displayed by a user through a mirror display according to the present invention.
16 is an exemplary view of an image displaying information such as shopping and advertisements using a mirror display according to the present invention.

Hereinafter, specific details for the implementation of the present invention will be described with reference to the drawings.

In addition, in describing the present invention, the same parts are denoted by the same reference numerals, and repeated explanations thereof are omitted.

First, a configuration of an information display device of a mirror display through recognition of a user's projection image according to an exemplary embodiment of the present invention will be described with reference to FIG. 2.

As shown in FIG. 2, in one embodiment of the present invention, the information display device of the mirror display through the recognition of the user's projection image is composed of a mirror display 10, a camera unit 21, and a control device 30. . In addition, it may be configured by adding various sensors (not shown) such as a proximity sensor.

The mirror display 10 is a display panel in which a specially coated mirror panel serving as a mirror is combined. In addition, it is preferable that the mirror display 10 is provided with a touch function.

In one embodiment, the mirror display 10 includes a mirror 11 on the front side and a display device 12 on the rear side of the mirror 11. At this time, it is preferable to use a half mirror that reflects part of the light and transmits part of the mirror 11 used. That is, the mirror display 10 acts as a mirror 11 by reflected light, and acts as a display by transmitting light from the display device 12 disposed on the rear side through the mirror. At this time, preferably, the display device 12 may be configured with an LCD (Liquid Crystal Display) panel, and in addition, it may be configured with an organic EL (Organic Electro Luminescence) panel or a PDP (Plasma Display Panel). have.

In addition, as another embodiment, the mirror display 10 includes a transparent display device 12 on the front side, and a light reflective paint or reflective film (or reflective polarizing film) used for a mirror on the rear surface of the transparent display device 12 ), etc. may be provided. That is, when some light-emitting elements of the transparent display device 12 pass light without being operated, they are reflected by the light-reflecting film to act as a mirror, and the remaining light-emitting elements of the transparent display device 12 are converted to the display. Functions. At this time, preferably, the display device 12 is a transparent display, and a conventional transparent organic electroluminescent display (OLED) or the like may be used.

Meanwhile, reference numeral 15, which is not described, denotes a mirror fixing unit in which the mirror display device 10 or the like can be accommodated.

In addition, the camera unit 21 is a camera device installed around (or around) the mirror display 10 and includes at least one camera capable of photographing the front surface of the mirror display 10 itself. In particular, the camera 21 is mounted in close contact with the mirror display 10.

3 shows the arrangement of the mirror display 10 and the camera 21 for photographing an image formed on the mirror display 10. Various camera arrangements are possible in order to photograph an image formed on the mirror display 10, which is illustrated in several forms in FIG. 4.

Preferably, the camera unit 21 is composed of a camera equipped with a wide-angle lens. Looking at what is illustrated in FIG. 3, when the camera is placed on the top, a wide-angle lens is requested to the camera so that an image of a wide area as possible can be captured. In this case, a shaded area in which an image can be acquired occurs according to the position of the camera. Therefore, it is possible to remove these shaded areas by mounting two or more cameras. This can be determined in various ways depending on the type of service to be provided.

Meanwhile, various sensor units (not shown) such as proximity sensors are configured as sensors for object and environment recognition.

The control device 30 is a device having a general computing function, and includes a central processing unit (or microprocessor), a memory, a storage device, an input/output device, a communication device, and the like. Preferably, an operating system such as Android (or Windows, Linux) is mounted on the control device 30, and a display driving and shopping and advertisement display programs may be installed.

Specifically, as shown in FIG. 5, the control device 30 includes an input unit 31 that receives touch coordinates by a touch function, an image or an image by the camera unit 21, and a sensing value by various sensors such as a proximity sensor. ), a display unit 32 for displaying a screen on a display device of the mirror display 10, a communication unit 33 for transmitting/receiving data by being connected to a network such as a wired/wireless Internet, a modem for mobile communication, a memory 35 for storing data, and a center It is configured to include a control unit 34 implemented as a processing device or a microprocessor.

Next, prior to a detailed description of a method for displaying information on a mirror display through recognition of a user's projection image according to the present invention, a general description will be given below.

When an object or a user is recognized through a sensor and a camera, an image formed on a mirror display is captured through the camera and recognized through various image processing. At this time, since the image formed on the mirror display and physical spatial information between the mirror display are accurately extracted, it has the characteristic of creating an accurate composite image based on this. If the object or the user is directly photographed, it is difficult to accurately synthesize images with the object and user information obtained according to the photographing environment (distance, angle, lighting, etc.) because accurate physical location information cannot be known.

Since the mirror display simultaneously shows its shape reflected by the mirror and the image provided by the display, a composite image provided based on the physical location information of the shape reflected by the mirror can obtain excellent effects.

This process is illustrated in FIG. 6. Fig. 6(a) shows a case where a cubic object exists in front of the mirror display, and the cubic object is reflected by the mirror to form an image, and after photographing the image formed on the mirror, various image processing processes are performed. b) to get the same video. This is an image formed on a mirror display, but it is very important that if the object is a user, it can also be called an image visible to the user's eyes. Based on this information, if a small cubic object is created as shown in FIG. 6(c) and is artificially projected on the display, the result of combining the two images very elaborately as shown in FIG. 6(c) can be obtained. In Fig. 6(c), the upper object is created by the graphic, and the lower object is the actual object currently placed in front of the mirror. This characteristic is due to the fact that an image was created based on image information taken directly from an image formed on a mirror display.

Next, a method of displaying information on a mirror display through recognition of a user's projection image according to an embodiment of the present invention will be described with reference to FIG. 7.

As shown in FIG. 7, a method of displaying information on a mirror display through recognition of a user's projection image according to an embodiment of the present invention includes the steps of: (a) displaying an advertisement on the entire mirror display (S10); (b) determining whether the user is close to the mirror display (S20); (c) when the user is in proximity, detecting the user area and location of the user's perspective (S30); And (d) moving and displaying the advertisement around the detected user's area and location (S40).

First, an advertisement is displayed on the entire mirror display 10 (S10).

Then, it is determined whether the user is close to the mirror display 10 (S20). Preferably, it is sensed whether the user is close to the mirror display 10 through a proximity sensor or the like.

Next, when the user approaches, a step (S30) of detecting the user area and location from the user's perspective will be described.

As shown in FIG. 8, the step (S30) of detecting the user area and location of the user's perspective includes (c1) receiving a projection image obtained by the camera (S31); (c2) correcting the input projection image (S32); (c3) detecting a face from the projected image (S33); And (c4) detecting a face area and a location from the user's perspective (S34).

First, a projection image acquired by the camera of the camera unit 21 is input (S31). As described above, the projection image acquired by the camera 21 is an image (or image) in which the camera 21 photographs the front surface of the mirror display 10. Further, preferably, the camera 21 is a camera equipped with a wide-angle lens. Therefore, the projection image captured by the wide-angle lens is displayed distorted compared to a normal image.

Next, the input projection image is corrected (S32).

Since the camera 21 for photographing an image formed on the mirror display 10 is mounted in close contact with the mirror display 10 and photographs a large area using a wide-angle lens, various types of distortion occur.

The first distortion is lens distortion due to the use of a wide-angle lens, and the second distortion occurs because the angle between the camera lens and the object to be photographed is close to vertical.

Various distortions can occur due to the physical location of the camera and the use of the lens. First, lens distortion is removed, and then the image is restored. In the two reconstructed images, a shaded area that has not been photographed occurs at each corner, and the two images are synthesized to obtain a final result image. Various parameters used in the process of acquiring such a corrected image are set and fixed only once after the camera is installed.

Next, the user's face is detected from the projected image (S33).

An object or face is extracted using an object or face detection technique. A feature point is detected from the extracted object or face, and the position of the object or face is updated at high speed using a feature point-based object or face tracking technique.

The object or face detection process uses a modified Adaboost algorithm and reduces the size of the target image to which the Adaboost algorithm is applied to reduce the computation time. First, a motion region is detected from the input image. This is detected by obtaining the difference between the previous frame and the current frame, and if there is no motion, the difference image is repeatedly obtained until there is motion. Once the difference image is obtained, the difference image is cumulatively added in the horizontal and vertical directions, respectively. The result is displayed in one row and one column, and the intersection of the two extended areas is obtained by expanding pixels whose values are not 0 to each row and column. As a result, small areas such as noise are removed by using a morphology filter (erosion filter and dilation filter), and the filtered image is binarized.

Face detection was performed using a method of detecting the color of the face. In general, since the color of the face largely depends on the lighting, in the present invention, the image format was changed from RGB to YCbCr in order to reduce the dependence. Of these, the Y component is the most sensitive to lighting, so only the Cb and Cr components are used. The range of the color used as the skin color in the present invention is the skin color reference map B(x,y), as shown in Equation 1.

[Equation 1]

A region that satisfies this equation is extracted, and small regions such as noise are removed by applying a morphology filter to the result, and the result is also binarized. An intersection (AND) of the two acquired images is obtained, an RGB image corresponding thereto is extracted, and an object or face region is detected by applying the Adaboost algorithm to the resulting region. 9 shows a flowchart of the above-described face detection step.

Next, the face area and location of the user's perspective are extracted (S34).

Before explaining a specific detection method, the difference between the projected image obtained by correcting in the previous step with the image viewed from the user's point of view is examined.

By adjusting the position and angle of the camera, a subject at a certain distance from the mirror display is captured. The image captured at this time corresponds to an image formed in the mirror display. In Fig. 10(a), a relationship between a mirror display for photographing a subject using a mirror display and a camera and a subject is shown as a picture. Due to the characteristics of the mirror display and the position and angle of the camera, the image acquired from the camera has a shape as shown in FIG. 10(b).

Fig. 11(a) shows the result of the correction of the image captured from the camera, and Fig. 11(b) shows the face position (inside the square) determined through the face detection algorithm. The face detection algorithm can be used in various ways, and the viewpoint is predicted by determining the position of the user's eyes from the detected face area.

Previously, the Adaboost algorithm was used to find the face, and through this, the face area and the position of the eye can be detected. Once a face is detected, it can be predicted proportionally where the eye is positioned within that face. In addition, the simple way to find the eyes is to detect the face and then identify the pupil by searching for black areas located at regular intervals on the face.

On the other hand, as shown in Fig. 11, the projection image captured by the camera 21 is taken by being offset to one side compared to the image viewed from the user's point of view. Therefore, the area and position of the image viewed from the user's point of view must be extracted from the projected image.

As shown in FIG. 12, the actual size of the mirror display (A')-the size of the mirror display taken from the camera (A), the size of the photographed mirror display (A)-the detected face area (B) and the photographed mirror By using the relationship between the size of the display (A)-the distance and the angle from the camera (C), it is possible to detect the actual size (B') and position of the face.

That is, after photographing a mirror display using a camera and performing correction, an image as shown in FIG. 13 is obtained. When installing the mirror display and the camera, the size of the actual space included in the image captured during the calibration process, the size of the mirror display, and the distance between the cameras are measured in advance and stored in a memory in advance. When a face region is detected through the Adaboost algorithm, the actual face size can be calculated through a proportional equation between the detected face region and the size of the mirror display.

The actual size of the face is obtained by the following [Equation 2].

[Equation 2]

In addition, when the actual face size is obtained, the distance between the mirror display and the user can be predicted. The proportional formula used at this time can be set through a calibration process when the mirror display is initially installed. That is, the value of the reference distance and the reference size for the face object, or a proportional expression and proportional relationship thereof are measured in advance and stored in a memory or the like.

Since the size of the actual face is already known through Equation 2 above, the distance at which the actual user is located can be known based on information about the reference distance compared to the size of the reference face initially set.

The actual distance is obtained by the following [Equation 3].

[Equation 3]

Through this, it is possible to check the location of the user and provide an incremental reality service according to the user's viewpoint, as shown below.

Next, information such as shopping and advertisements is displayed based on the detected face area/location of the user's perspective (S40).

After predicting the user's viewpoint looking at the mirror display, information such as shopping and advertisements can be displayed through the mirror display according to the user's viewpoint. 14(a) shows a form of displaying information such as shopping and advertisements around a corresponding location after predicting a user's viewpoint.

The user can view the image of himself reflected on the mirror display and the shopping and advertisement images displayed around it. 15 shows these results.

FIG. 16 shows an example of providing a simple service after implementing a system capable of providing shopping and advertisements to the user by determining the location and size of a user using a mirror display and generating a composite image through this. Fig. 16(a) is an image in which information such as shopping and advertisements is displayed on the entire mirror display when the user is far away, and Fig. 16(b) is an advertisement in the surrounding area other than the user's projection area when the user approaches the mirror display. Is the image on the screen that is displayed. In other words, it is a combination of videos that display information such as advertisements and shopping displayed around users and their surroundings.

In the above, the invention made by the present inventors has been described in detail according to the embodiments, but the invention is not limited to the embodiments, and it goes without saying that various modifications can be made without departing from the gist of the invention.

10: mirror display 11: mirror
12: display device 21: camera
30: control device 31: input
32: display unit 33: communication unit
34: control unit 35: memory

Claims (7)

A mirror display in which a mirror panel and a display panel are combined, and a camera installed around the mirror display to photograph the front of the mirror display, and shopping and advertising based on the area and location of the user's projection image A method for displaying information on a mirror display through recognition of a user's projection image displaying information on the mirror display,
(a) displaying an advertisement on the entire mirror display;
(b) determining whether the user is close to the mirror display through the proximity sensor;
(c) acquiring a projection image by the camera when a user approaches, and detecting a user region and a location of the user's perspective from the projection image; And,
(d) moving and displaying the advertisement around the detected user's area and location,
The step (c),
(c1) receiving a projection image projected on the mirror display as a projection image acquired by a camera;
(c2) correcting the input projection image;
(c3) detecting a user's face from the corrected projection image;
(c4) detecting a face region and a location of the user's perspective from the detected face image of the user,
In the step (c4), the actual size of the user's face area is calculated by the following [Equation 1].
[Equation 1]

However, the size of the face detection area is the size of the face detection area in the image,
The actual mirror display size is a predetermined value.
delete The method of claim 1,
In the step (d), when moving the advertisement around the user area in the entire mirror display, the screen is moved by using an animation effect. .
The method of claim 1,
In step (c3), a face is detected using an Adaboost algorithm. A method of displaying information on a mirror display through recognition of a user's projection image.
The method of claim 1,
In step (c4), the actual size of the mirror display (A')-the size of the mirror display photographed from the camera (A), the size of the photographed mirror display (A)-the detected face area (B) and the photographed mirror Display information on a mirror display through the user's projection image recognition, characterized by detecting the actual face size (B') and position by using the relationship between the display size (A)-the distance and the angle from the camera (C) Way.
delete The method of claim 1,
A method of displaying information on a mirror display through recognition of a user's projection image, characterized in that the actual distance to the user's face area is obtained by the following [Equation 2].
[Equation 2]

However, the reference distance and the reference size are predetermined values.

Images