KR102178566B1 - Electronic mirror apparatus and method for controlling the same - Google Patents

Abstract

Disclosed are a mirror and an electronic mirror device capable of simultaneously providing useful information to a user, and a control method thereof. An electronic mirror device according to an aspect of the present invention includes a mirror; A display unit that includes a main display and a sub display and is installed to be superimposed on the mirror; A fixedly installed main camera for photographing a user; And outputting the real-time photographed image of the user photographed by the main camera to the main display, outputting a reference image corresponding to the analysis result of the photographed image to the sub-display, and synthesizing the reference image to the real-time photographed image. It includes a control unit.

Description

Electronic mirror device and its control method {ELECTRONIC MIRROR APPARATUS AND METHOD FOR CONTROLLING THE SAME}

The present invention relates to an electronic mirror device and a control method thereof, and more particularly, to an electronic mirror device capable of outputting an image while illuminating a user like a mirror, and a control method thereof.

In general, mirrors allow users to check their own body, and have been used mainly for women's makeup purposes since a long time ago. Mirrors such as the above were mainly used to polish the surface of silver, bronze, etc., but nowadays, according to the development of technology, mercury is applied to the back of a flat glass plate, and a brim is painted on it to prevent moisture. This fine mercury mirror is being used.

Such a conventional mirror can only check the user's current exterior and body state, but cannot compare with the past state, and thus, it is impossible to contrast with the past when wearing makeup or clothing. In addition, when a user wants to check the rear view of the user using a conventional mirror, it must be checked using a separate rear mirror, and even if a rear mirror is used, the field of view is limited. In addition, the conventional mirror only shows the outer surface of the user in pieces.

An object of the present invention is to provide an electronic mirror device capable of simultaneously providing useful information to a user while providing a mirror and a control method thereof.

An electronic mirror device according to an aspect of the present invention for achieving the above object includes: a mirror; A display unit that includes a main display and a sub display and is installed to be superimposed on the mirror; A fixed installed main camera for photographing a user; And outputting the real-time photographed image of the user photographed by the main camera to the main display, outputting a reference image corresponding to the analysis result of the photographed image to the sub-display, and synthesizing the reference image to the real-time photographed image. It includes a control unit.

The controller may analyze at least one of a fashion state, a hair state, or a makeup state of the user from the photographed image, and search for a reference image relating to at least one of a recommended fashion style, a recommended hairstyle, and a recommended makeup style.

The electronic mirror device may further include a skin diagnostic device that analyzes the skin condition of the user, and the controller may analyze a makeup state by synthesizing a skin condition analysis result of the skin diagnostic device and an analysis result of the captured image. .

The electronic mirror device further includes a motion recognition sensor that recognizes the motion of the user, and the control unit analyzes the motion of the user and the captured image to perform at least one of a fashion coordination method, a hair care method, and a makeup method. After analyzing, a reference video for at least one of a recommended fashion coordination method, a recommended hair care method, and a recommended makeup method may be searched.

The electronic mirror device further includes a movable auxiliary camera for photographing the user, and the control unit generates a 3D panoramic image of the user by using the auxiliary camera and the photographed image of the main camera, and the main display Is output to, and the reference image may be synthesized with the 3D panoramic image.

An electronic mirror device according to another aspect of the present invention for achieving the above object includes: a mirror; A display unit that includes a main display and a sub display and is installed to be superimposed on the mirror; A main camera that photographs a user; A skin diagnostic device that analyzes the user's skin condition; And a controller configured to output a real-time photographed image of the user captured by the main camera to the main display, and to output a reference image corresponding to a skin condition analysis result of the skin diagnosis device to the sub-display.

The controller may search for an introduction image of a product to be recommended to the user as the reference image according to the skin condition analysis result.

The controller may search for a reference image related to a recommended makeup style corresponding to the result of analyzing the skin condition and synthesize the reference image into the real-time photographed image.

The electronic mirror device further includes a distance measurement sensor for measuring a distance to the user, and the control unit outputs the real-time photographed image of the user to the main display at a constant rate based on the distance to the user. I can.

The electronic mirror device includes: a communication unit; And a storage unit for storing the captured image, wherein the control unit may search for a reference image from the captured image stored in the storage unit, or communicate with a remote storage unit through the communication unit to search for a reference image in the remote storage unit. .

According to an aspect of the present invention for achieving the above object, a method for controlling an electronic mirror device including a display unit including a main display and a sub display, and a mirror overlapped with the display unit, includes a user taking a picture with a camera. Outputting a real-time photographed image of the image on the main display; Outputting a reference image corresponding to the analysis result of the captured image to the sub-display; And synthesizing the reference image with the real-time photographed image output on the main display.

The outputting of the output to the sub-display may include analyzing at least one of a fashion state, a hair state, and a makeup state of the user in the captured image; And searching for a reference image about at least one of a recommended fashion style, a recommended hairstyle, and a recommended makeup style.

The control method further includes analyzing the skin condition of the user using a skin diagnosis device, and the analyzing step includes: a makeup state by synthesizing a skin condition analysis result of the skin diagnosis device and an analysis result of the captured image Can be analyzed.

The control method further includes recognizing the motion of the user, and the outputting to the sub-display comprises at least one of a fashion coordination method, a hair care method, or a makeup method by analyzing the motion of the user and the captured image. Analyzing one; And searching for a reference image for at least one of a recommended fashion coordination method, a recommended hair care method, and a recommended makeup method.

The outputting to the main display may include generating a 3D panoramic image of the user from a photographed image captured using a main camera fixed to the electronic mirror device and a movable auxiliary camera, and outputting the generated 3D panoramic image to the main display.

According to another aspect of the present invention for achieving the above object, a control method of an electronic mirror device including a display unit including a main display and a sub display, and a mirror installed overlapping with the display unit, includes a user taking a picture with a camera. Outputting a real-time photographed image of the image on the main display; Analyzing the skin condition of the user using a skin diagnostic device; And outputting a reference image corresponding to the skin condition analysis result to the sub-display.

The outputting to the sub-display includes searching for an introduction image of a product to be recommended to the user as the reference image according to the skin condition analysis result.

The outputting to the sub-display includes searching for a reference image for a recommended makeup style corresponding to the skin condition analysis result, and the control method includes synthesizing the reference image with the real-time photographed image. It may contain more.

The control method further includes measuring a distance to the user, and outputting the image to the main display includes: The real-time photographed image of the user is displayed on the main display at a constant rate based on the distance to the user. Can be printed.

The electronic mirror device of the present invention can simultaneously provide a mirror function and an information providing function by displaying a real-time image of the user on the main display and providing a reference image to be recommended for the current image of the user on the sub display.

In addition, the electronic mirror device of the present invention enhances the satisfaction of providing information by providing a reference image by synthesizing a reference image with a real-time image of a user, allowing a virtual experience to be performed in advance without actually experiencing the recommended information.

1 is a diagram schematically showing the appearance of an electronic mirror device according to an embodiment of the present invention.
FIG. 2 is a diagram illustrating an internal configuration of the electronic mirror device of FIG. 1.
3 is a schematic view showing the appearance of an electronic mirror device according to another embodiment of the present invention.
FIG. 4 is a diagram showing an internal configuration of the electronic mirror device of FIG. 3.
5 is a diagram illustrating a system interlocking with an electronic mirror device according to an embodiment of the present invention.
6 is a diagram showing an internal configuration of the electronic mirror device of FIG. 5.
7 is a flowchart illustrating a method of controlling an electronic mirror device according to an embodiment of the present invention.
8 is a flowchart illustrating a method of controlling an electronic mirror device according to another embodiment of the present invention.

While this specification includes many features, such features should not be construed as limiting the scope or claims of the invention. In addition, features described in separate embodiments herein may be combined and implemented in a single embodiment. Conversely, various features described in a single embodiment herein may be individually implemented in various embodiments, or may be properly combined and implemented.

Although the operations have been described in a specific order in the drawings, it should not be understood that such operations are performed in a specific order as shown, or as a series of consecutive sequences, or that all described operations are performed to obtain a desired result. . Multitasking and parallel processing can be advantageous in certain environments. In addition, it should be understood that classification of various system components in the above-described embodiments does not require such classification in all embodiments. The above-described program components and systems may generally be implemented as a package in a single software product or multiple software products.

The method of the present invention as described above may be implemented as a program and stored in a recording medium (CD-ROM, RAM, ROM, floppy disk, hard disk, magneto-optical disk, etc.) in a computer-readable form. This process can be easily carried out by a person of ordinary skill in the art to which the present invention pertains, and thus will not be described in detail.

The present invention described above is capable of various substitutions, modifications, and changes without departing from the technical spirit of the present invention for those of ordinary skill in the technical field to which the present invention belongs. It is not limited by the drawings.

1 is a view schematically showing the appearance of an electronic mirror device according to an embodiment of the present invention, and FIG. 2 is a view showing an internal configuration of the electronic mirror device of FIG. 1.

1 and 2, the electronic mirror device 100 according to the present embodiment includes a mirror 110, a sensing unit 210, a display unit 220, a storage unit 230, and a camera unit 240. , The lighting 250 and the control unit 260.

The mirror 110 is installed on the front side of the electronic mirror device 100. The mirror 110 may be installed on the rear side of the display unit 220 or may be installed on the front side. When the mirror 110 is installed on the rear side of the display unit 220, the display unit 220 may be implemented as a transparent display, and when the mirror 110 is installed on the front side of the display unit 220, the corresponding mirror 110 ) Is manufactured in the form of a reflective polarizing plate, and the display unit 220 has a polarizing plate corresponding thereto, and is used as a mirror when an image is not output from the display unit 220, and an image is output from the display unit 220 If yes, pass the video.

The sensing unit 210 is installed in the electronic mirror device 100 to recognize a user's motion, measure the amount of ambient light, and measure a distance between the user and the electronic mirror device 100. To this end, the sensing unit 210 includes a motion recognition sensor 161, an optical sensor 162, and a distance measurement sensor 163, and as shown in FIG. 1, each sensor of the sensing unit 210 is an electronic mirror. It may be installed on the top of the device 100, but is not limited thereto, and may be installed on the front of the electronic mirror device 100 facing the user.

The motion recognition sensor 161 recognizes a motion of a user who uses the electronic mirror device 100. Here, the user's motion includes, for example, a fashion coordination motion, a hair care motion, or a makeup motion. For example, the motion of fashion coordination can be a motion of tying a tie or a motion of tying a scarf, and the motion of hair trimming can be a motion of styling hair, and the motion of makeup is the order of makeup. Or patterns, etc. The optical sensor 162 measures the amount of light around the electronic mirror device 100. The distance measurement sensor 163 measures a distance between the electronic mirror device 100 and a user. The distance measurement sensor 163 may be, for example, an infrared sensor.

The display unit 200 may be installed to be superimposed on the front or rear surface of the mirror 110. The display unit 200 installed to be superimposed on the front of the mirror 110 may use a transparent display. The transparent display is a display that looks like transparent glass by using a panel having transmittance, and it is preferable to be a see through type, but there is no limitation on the type. The display unit 200 installed to be superimposed on the rear surface of the mirror 110 may include a backlight unit, a polarizing plate positioned above the backlight unit, and a liquid crystal positioned above the polarizing plate, and a mirror manufactured in the form of a reflective polarizing plate ( 110), and if the image is not output, the mirror 110 functions as a mirror.

The display unit 200 outputs and displays a user's image captured in real time by the camera unit 240 when power is supplied. The display unit 200 may use a liquid crystal display (LCD) technology or a light emitting polymer display (LPD) technology, and displays a visual output to a user. Visual output may include text, graphics, video, and combinations thereof. The display unit 200 may be a touch display such as a capacitive type, a resistive type, or an infrared type. The touch display provides both an output interface and an input interface between the electronic mirror device 100 and a user. Some or all of the visual output output from the touch display may correspond to a user interface object, and the touch display forms a touch sensing surface for receiving a user input.

The display unit 200 includes a main display 130 and a sub display 120 as illustrated in FIGS. 1 and 2. The main display 130 and the sub-display 120 may be physically separated and may be independent displays, or may be displays that are separated from each other by being processed by software in one physical display. The main display 130 outputs a real-time photographed image of a user photographed by the camera unit 240. The sub-display 120 outputs a reference image corresponding to the analysis result of the user's captured image output on the main display 130 under the control of the controller 260. The reference image is content that the user can refer to, and includes, for example, a recommended fashion style, a recommended hairstyle, and a recommended makeup style, and may be a still image or a video.

The storage unit 230 may include a volatile memory such as a high-speed random access memory, and may also include one or more magnetic disk storage devices, a nonvolatile memory such as a flash memory device, or another nonvolatile semiconductor memory device. . The storage unit 230 may install an operating system, a graphic module (command set), and a program for operating the electronic mirror device 100, and may also store a reference image. The operating system may be, for example, a built-in operating system such as Darwin, RTXC, LINUX, UNIX, OS X, WINDOWS or VxWorks, Android, etc., and general system tasks (e.g., memory management, storage Device control, power management, etc.) to control and manage various software components and/or devices, and facilitate communication between various hardware and software components. The graphic module includes several well-known software components for providing and displaying graphics on the display unit 220. The term "graphics" refers to any object that can be displayed to a user, including, without limitation, text, web pages, icons (eg, user interface objects including soft keys), digital images, videos, animations, etc. Include.

The camera unit 240 photographs a user who uses the electronic mirror device 100. The camera unit 240 includes a main camera 141 and a sub camera 142 as shown in FIGS. 1 and 2. The main camera 141 is fixedly installed on the front of the electronic mirror device 100 and photographs a user who uses the electronic mirror device 100. The sub-camera 142 is a camera that is connected to the electronic mirror device 100 by wire or wirelessly and is movable. For example, the sub-camera 142 may be used when a user wants to see his or her back or photograph a specific part, or 360 degrees. It can be used to implement a panoramic image.

The lighting 250 is fixedly installed on the front surface of the electronic mirror device 100 to emit light. The amount of light of the lighting 250 is controlled by the controller 260 according to the amount of ambient light measured by the light sensor 162 of the sensing unit 210. When the periphery of the electronic mirror device 100 is dark, light is emitted by the lighting 250 so that the user's image is well displayed when the user's image is captured.

The controller 260 controls the overall operation of the electronic mirror device 100. The control unit 260 is, for example, a central processing unit (CPU), and performs operations related to the electronic mirror apparatus 100 and executes commands. For example, the control unit 260 may control reception and manipulation of input and output data between components of the electronic mirror apparatus 100 using commands retrieved from the storage unit 230. The controller 260 basically outputs a real-time image of a user captured by the main camera 141 to the main display 141 and controls to provide an additional recommendation service.

Specifically, the controller 260 analyzes a real-time photographed image of a user photographed by the main camera 141, retrieves a reference image corresponding to the analysis result in the storage unit 230, and outputs it to the sub-display 120. The reference image may be an image previously captured by the user with the main camera 141 and stored, or may be an image searched and stored on the Internet. The control unit 260 retrieves a plurality of reference images from the storage unit 230 and outputs them to the sub-display 120 in the form of thumbnails or sequentially in the form of a slide, and then displays the image selected by the user on the screen of the sub-display 120. You can print it all. In addition, the controller 260 may synthesize the reference image with a real-time photographed image of a user being output on the main display 130.

The control unit 260 may analyze at least one of a fashion state, a hair state, or a makeup state of the user from the real-time photographed image of the user, and the at least one of a recommended fashion style, a recommended hair style, or a recommended makeup style as a reference image You can search for reference images. For example, the controller 260 may recognize a user's face from a real-time captured image, analyze the user's hair condition, makeup condition, etc., and search for a reference image corresponding to the analysis result. For example, the controller 260 may recommend a hair style suitable for the user's skin color and skin condition, or recommend a makeup style, or may recommend a fashion style suitable for a current hairstyle or makeup style.

The controller 260 may search for and recommend a reference image according to a user's motion recognized by the motion recognition sensor 161 of the sensing unit 210. Specifically, the controller 260 performs the user's fashion coordination motion, hair care motion, or makeup through the user's motion recognized by the motion recognition sensor 161 and the user's real-time image captured by the main camera 141. Motion, etc. may be analyzed, and a reference image for at least one of a fashion coordination method, a hair care method, and a makeup method to be recommended to a user may be searched in response to the analysis result. For example, the motion of fashion coordination can be a motion of tying a tie or a motion of tying a scarf, and the motion of hair trimming can be a motion of styling hair, and the motion of makeup is the order of makeup. Or patterns, etc.

The controller 260 may use both the main camera 141 and the sub camera 142 to analyze the user's appearance. As described above, the sub-camera 142 is a movable camera, and the user takes a picture as if scanning his or her back with the sub-camera 142, and the control unit 260 includes the sub-camera 142 and the main camera ( The user's 3D panoramic image is generated using the captured image 141 and output to the main display 130, and the user's fashion state and hair state can be more accurately analyzed as a 3D panoramic image. The controller 260 may synthesize the reference image with a real-time 3D panoramic image of a user output on the main display 130.

The control unit 260 measures the ratio of the real-time photographed image of the user captured by the main camera 141 and output to the main display 130 by the distance measurement sensor 163 of the sensing unit 210. ) And the distance between the user. That is, the user's key or the size of the user's face is controlled to be constantly output on the main display 130. Therefore, even if the user is close to or away from the electronic mirror device 100, the user's appearance is displayed at a constant rate, so that the user can see his current state more accurately. In addition, the controller 260 may provide an auto-focusing function according to the distance between the shift mirror device 100 measured by the distance measurement sensor 163 and the user.

As described with reference to FIGS. 1 and 2 above, the electronic mirror device 100 according to the present embodiment displays a real-time photographed image of the user using a camera and additionally provides a reference image according to the analysis result of the user's appearance. It serves as a means of providing information. Therefore, users can get the effect of receiving consulting from professional consultants such as fashion, hair, and makeup.

3 is a view schematically showing the appearance of an electronic mirror device according to another embodiment of the present invention, and FIG. 4 is a view showing an internal configuration of the electronic mirror device of FIG. 3. In FIGS. 3 and 4, elements of the same reference numerals as in FIGS. 1 and 2 include all operations and functions described with reference to FIGS. 1 and 2.

The electronic mirror device 100 according to the present exemplary embodiment with reference to FIGS. 3 and 4 further includes a skin diagnosis device 310 as compared to the electronic mirror device 100 described with reference to FIGS. 1 and 2. The skin diagnosis device 310 is connected to the electronic mirror device 100 by wire or wirelessly and can be moved by the user, and analyzes the user's skin condition.

The skin diagnosis device 310 is located close to the user's skin and analyzes skin conditions such as oily condition, moisture condition, skin color, skin roughness, and PH of the user's skin. The control unit 260 of the electronic mirror device 100 may analyze the makeup state by using the user's skin condition analysis result analyzed by the skin diagnosis device 310. Alternatively, in order to increase the accuracy of the result, the controller 260 may analyze the makeup state of the user by synthesizing the skin condition analysis result of the skin diagnosis device 310 and the analysis result of the photographed image by the camera unit 240.

The controller 260 may search for a reference image related to the recommended makeup style as a reference image based on the makeup state of the user analyzed through the skin diagnosis device 310 and output the searched reference image to the sub-display 120. . In addition, the controller 260 may combine the reference image output on the sub-display 120 with a real-time image of the user output on the main display 130.

In addition, the control unit 260 may output the user's skin condition analysis result analyzed through the skin diagnosis device 310 on the sub-display 120, and the makeup product to be recommended to the user according to the skin condition analysis result The introduction image may be searched as a reference image and may be output to the sub-display 120. The controller 260 may proceed with a product purchase procedure related to the searched makeup product. Product purchase may be processed by various methods, such as credit card payment and mobile phone micropayment, for example, and online payment may be performed through the communication unit 600 described below.

5 is a diagram illustrating a system interlocking with an electronic mirror device according to an embodiment of the present invention. Referring to FIG. 5, the electronic mirror device 100 may communicate with a user terminal 510 and a remote storage 520.

The user terminal 510 is a user terminal equipped with a long-distance communication or short-range communication function, and includes a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), and a PMP ( Portable Multimedia Player), and navigation. However, the present invention is not limited thereto, and a fixed terminal such as a digital TV and a desktop computer having a communication function may also be included. The user stores a photo taken by the user terminal 510 or an image searched for while surfing the Internet as a reference image and transmits it to the electronic mirror device 100 through the communication network 530 or through short-range communication to the electronic mirror device 100 Can be saved on.

The remote storage 520 includes a network attached storage device accessed through the communication network 530 or a cloud storage operated by a separate operator, and the image captured and stored by the electronic mirror device 100 is The electronic mirror device 100 may receive and store the image, or at the request of the electronic mirror device 100, an image stored therein may be transmitted to the electronic mirror device 100 as a reference image. In addition, the remote storage 520 may receive and store an image that can be used as a reference image from the user terminal 510 by communicating with the user terminal 510 through the communication network 530.

To this end, as shown in FIG. 6, the electronic mirror device 100 may further include a communication unit 600. The communication unit 600 includes a Bluetooth module 610, a Wi-Fi module 620 and a mobile communication module 630. The Bluetooth module 610 may receive a reference image from the user terminal 510 after pairing with a nearby communication device, that is, the user terminal 510. The Wi-Fi module 620 is a wireless LAN communication module and may receive a reference image from the user terminal 510 by performing wireless LAN-based short-range communication with a nearby communication device, that is, the user terminal 510. The mobile communication module 630 is a long-distance communication such as Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), WCDMA (Wideband Code Division Multiple Access), LTE (Long Term Evolution), etc. Perform. The mobile communication module 630 communicates with the remote storage 520 through the communication network 530 to transmit the image captured by the electronic mirror device 100 to the remote storage 520 or receive a reference image from the remote storage 520. Can receive.

7 is a flowchart illustrating a method of controlling an electronic mirror device according to an embodiment of the present invention.

Referring to FIG. 7, the electronic mirror device 100 stores a reference image in the storage unit 230 (S701). The electronic mirror device 100 may store a photographed image selected by a user from among the photographed images photographed by the camera unit 240 in the storage unit 230 as a reference image. Alternatively, the electronic mirror device 100 may communicate with the user terminal 510 through the communication unit 600 to receive a reference image from the user terminal 510 and store it in the storage unit 230, or through the communication unit 600 It may communicate with the remote storage 520 to receive a reference image from the remote storage 520 and store it in the storage unit 230.

The user stands in front of the electronic mirror device 100 and takes a picture. Specifically, the electronic mirror device 100 photographs a user using only the main camera 141 of the camera unit 240 or photographs the user using both the main camera 141 and the sub camera 142 to display the main display. It can be output to (130) (S702). When only the main camera 141 is used, only the image of the user facing the electronic mirror device 100 can be photographed, and when both the main camera 141 and the sub camera 142 are used, both the front and the rear of the user are photographed. You can create dimensional images.

The electronic mirror apparatus 100 analyzes the real-time photographed image of the user photographed in step S702, and retrieves a reference image corresponding to the analysis result in the storage unit 230 (S703). The electronic mirror device 100 may analyze at least one of a fashion state, a hair state, or a makeup state of the user from a real-time image of the user, and at least one of a recommended fashion style, a recommended hairstyle, or a recommended makeup style as a reference image You can search for a reference video about. The electronic mirror device 100 may recognize a user's face from a real-time photographed image, analyze a user's hair condition, makeup condition, etc., and analyze a fashion style through a full-body photographed image. In addition, the electronic mirror device 100 may search for a reference image for a hair style or makeup style suitable for a user's skin color and skin condition, or a reference image for a fashion style suitable for a current hairstyle or makeup style. can do.

The electronic mirror apparatus 100 outputs the reference image retrieved in step S703 to the sub-display 120 (S704). The electronic mirror device 100 may search for a plurality of reference images from the storage unit 230 and output them to the sub-display 120 in the form of thumbnails or sequentially in the form of slides.

The electronic mirror device 100 synthesizes the reference image output on the sub-display 120 with the real-time photographed image of the user being output on the main display 130 (S705). When a plurality of reference images are being output to the sub-display 120, the electronic mirror device 100 synthesizes a reference image selected by the user from among the plurality of reference images to the real-time photographed image of the user being output to the main display 130. I can. For example, in the case of recommending a hairstyle, the hair part from the user's real-time captured image may be synthesized as a hairstyle of the reference image. The electronic mirror device 100 outputs the synthesized image to the main display 130 so that the user can check it (S706).

In the control method described above with reference to FIG. 7, the electronic mirror device 100 may analyze a user's motion through the motion recognition sensor 161 of the sensing unit 210 before searching for a reference image in step S703. . In step S703, the electronic mirror device 100 analyzes the user's fashion coordination motion, hair care motion, or makeup motion, etc. through the user's motion and the user's real-time image, and responds to the analysis result. A reference image for at least one of a fashion coordination method, a hair care method, or a makeup method to be recommended to a person may be searched. For example, the motion of fashion coordination can be a motion of tying a tie or a motion of tying a scarf, and the motion of hair trimming can be a motion of styling hair, and the motion of makeup is the order of makeup. Or patterns, etc. In addition, the electronic mirror device 100 calculates the ratio of the real-time photographed image of the user output on the main display 130 in steps S702 and S705 by the distance measurement sensor 163 of the sensing unit 210. ) And the distance between the user. That is, the user's key or the size of the user's face is controlled to be constantly output on the main display 130.

8 is a flowchart illustrating a method of controlling an electronic mirror device according to another embodiment of the present invention.

Referring to FIG. 8, the electronic mirror device 100 stores a reference image in the storage unit 230 (S801). The electronic mirror device 100 may store a photographed image selected by a user from among the photographed images photographed by the camera unit 240 in the storage unit 230 as a reference image. Alternatively, the electronic mirror device 100 may communicate with the user terminal 510 through the communication unit 600 to receive a reference image from the user terminal 510 and store it in the storage unit 230, or through the communication unit 600 It may communicate with the remote storage 520 to receive a reference image from the remote storage 520 and store it in the storage unit 230.

The user stands in front of the electronic mirror device 100 and takes a picture. Specifically, the electronic mirror device 100 photographs a user using only the main camera 141 of the camera unit 240 or photographs the user using both the main camera 141 and the sub camera 142 to display the main display. It can be output to (130) (S802). When only the main camera 141 is used, only the image of the user facing the electronic mirror device 100 can be photographed, and when both the main camera 141 and the sub camera 142 are used, both the front and the rear of the user are photographed. You can create dimensional images.

The electronic mirror device 100 analyzes the user's skin condition by using the skin diagnosis device 310 (S803). The skin diagnosis device 310 is located close to the user's skin and analyzes skin conditions such as oily condition, moisture condition, skin color, skin roughness, and PH of the user's skin.

The electronic mirror apparatus 100 comprehensively analyzes the real-time photographed image of the user captured in step S802 and the skin condition analysis result analyzed in step S803, and searches the storage unit 230 for a reference image corresponding to the analysis result ( S804). For example, the electronic mirror device 100 may analyze a user's makeup state and search for a reference image related to a recommended makeup style according to the analysis result. Alternatively, the electronic mirror device 100 may search for a recommended fashion style or a reference image related to a recommended hairstyle according to the user's skin condition.

The electronic mirror apparatus 100 outputs the reference image retrieved in step S804 to the sub-display 120 (S805). The electronic mirror device 100 may search for a plurality of reference images from the storage unit 230 and output them to the sub-display 120 in the form of thumbnails or sequentially in the form of slides.

The electronic mirror device 100 synthesizes the reference image output on the sub-display 120 with the real-time photographed image of the user being output on the main display 130 (S806). When a plurality of reference images are being output to the sub-display 120, the electronic mirror device 100 synthesizes a reference image selected by the user from among the plurality of reference images to the real-time photographed image of the user being output to the main display 130. I can. For example, in the case of recommending a hairstyle, the hair part from the user's real-time captured image may be synthesized as a hairstyle of the reference image. The electronic mirror device 100 outputs the synthesized image to the main display 130 so that the user can check it (S807).

In the embodiment described above with reference to FIG. 8, the electronic mirror device 100 will be described as synthesizing the reference image to the real-time photographed image being output on the main display 130. In addition, the electronic mirror device 100 may search for a reference image related to a makeup product suitable for the user's skin condition in step S804 and output it to the sub-display 120, and may proceed with a product purchase procedure related to the found makeup product. . Product purchases can be processed by various methods such as credit card payment and mobile phone micropayment.

While this specification includes many features, such features should not be construed as limiting the scope or claims of the invention. In addition, features described in separate embodiments herein may be combined and implemented in a single embodiment. Conversely, various features described in a single embodiment herein may be individually implemented in various embodiments, or may be properly combined and implemented.

Although the operations have been described in a specific order in the drawings, it should not be understood that such operations are performed in a specific order as shown, or as a series of consecutive sequences, or that all described operations are performed to obtain a desired result. . Multitasking and parallel processing can be advantageous in certain environments. In addition, it should be understood that classification of various system components in the above-described embodiments does not require such classification in all embodiments. The above-described program components and systems may generally be implemented as a package in a single software product or multiple software products.

The method of the present invention as described above may be implemented as a program and stored in a recording medium (CD-ROM, RAM, ROM, floppy disk, hard disk, magneto-optical disk, etc.) in a computer-readable form. This process can be easily carried out by a person of ordinary skill in the art to which the present invention pertains, and thus will not be described in detail.

The present invention described above is capable of various substitutions, modifications, and changes without departing from the technical spirit of the present invention for those of ordinary skill in the technical field to which the present invention belongs. It is not limited by the drawings.

210: sensing unit
220: display unit
230: storage unit
240: camera unit
250: lighting
260: control unit
161: motion recognition sensor
162: light sensor
163: distance measurement sensor
310: skin diagnostic device

Claims (19)

Mirror or main display;
Main camera;
Sub display;
A controller configured to output a real-time photographed image of a user photographed by the main camera to the main display or a reference image corresponding to an analysis result of the photographed image to the sub-display; And
Including a motion recognition sensor,
The control unit
An electronic mirror device that recognizes a user's motion through the motion recognition sensor and outputs a reference image corresponding to the recognized user's motion. The method of claim 1,
The control unit,
An electronic mirror device that analyzes at least one of a fashion state, a hair state, or a makeup state of the user from the captured image, and searches a reference image for at least one of a recommended fashion style, a recommended hairstyle, and a recommended makeup style. The method of claim 2,
Further comprising a skin diagnostic device for analyzing the skin condition of the user,
The control unit,
An electronic mirror device for analyzing a makeup state by synthesizing a skin condition analysis result of the skin diagnostic device and an analysis result of the photographed image. The method of claim 1,
The user's motion includes at least one of a fashion-related motion, a hair-related motion, and a makeup-related motion,
The control unit,
When the fashion-related motion is recognized, a reference image corresponding to the fashion-related motion is searched,
When the hair-related motion is recognized, a reference image corresponding to the hair-related motion is searched,
An electronic mirror device that searches for a reference image corresponding to the makeup-related motion upon recognizing the makeup-related motion. The method of claim 1,
Further comprising a movable auxiliary camera for photographing the user,
The control unit,
An electronic mirror device for generating a 3D panoramic image of the user using the photographed image of the auxiliary camera and the main camera, outputting it to the main display, and synthesizing the reference image with the 3D panoramic image. Mirror or main display;
Sub display;
Main camera;
A skin diagnostic device that analyzes a user's skin condition;
A controller configured to output a real-time image of the user captured by the main camera to the main display, or to output a reference image corresponding to a skin condition analysis result of the skin diagnostic device to the sub-display; And
Including a motion recognition sensor,
The control unit
An electronic mirror device configured to recognize a user's motion through the motion recognition sensor and output a reference image corresponding to the recognized user's motion. The method of claim 6,
The control unit,
An electronic mirror device that searches for an introduction image of a product to be recommended to the user as the reference image according to the skin condition analysis result. The method of claim 6,
The control unit,
An electronic mirror device that searches for a reference image related to a recommended makeup style corresponding to the skin condition analysis result, and synthesizes the reference image into the real-time photographed image. The method according to any one of claims 1 to 8,
Further comprising a distance measurement sensor for measuring the distance to the user,
The control unit,
An electronic mirror device for outputting the real-time photographed image of the user to the main display at a constant rate based on a distance to the user. The method according to any one of claims 1 to 8,
Communication department; And
Further comprising a storage unit for storing the photographed image,
The control unit,
An electronic mirror device that searches for a reference image from a captured image stored in the storage unit or communicates with a remote storage unit through the communication unit to search for a reference image in the remote storage unit. In the control method of an electronic mirror device comprising a main display or a mirror,
Outputting a real-time photographed image of a user photographed with a main camera on the main display; And
And outputting a reference image corresponding to the analysis result of the captured image to a sub-display,
The step of outputting to the sub display
Recognizing the user's motion through a motion recognition sensor; And
And outputting a reference image corresponding to the user's motion. The method of claim 11,
The step of outputting to the sub-display,
Analyzing at least one of a fashion state, a hair state, and a makeup state of the user in the captured image; And
A control method comprising the step of searching for a reference image about at least one of a recommended fashion style, a recommended hairstyle, and a recommended makeup style. The method of claim 12,
Further comprising the step of analyzing the skin condition of the user using a skin diagnostic device,
The analyzing step,
A control method for analyzing a makeup condition by synthesizing a skin condition analysis result of the skin diagnosis device and an analysis result of the photographed image. The method of claim 11,
Recognizing the motion of the user
A control method comprising the step of recognizing any one of a fashion-related motion, a hair-related motion, and a makeup-related motion as the user's motion. The method of claim 11,
The step of outputting to the main display,
A control method for generating a 3D panoramic image of the user from a photographed image captured using a main camera fixed to the electronic mirror device and a movable auxiliary camera, and outputting it to the main display. In the control method of an electronic mirror device comprising a main display or a mirror,
Outputting a real-time photographed image of a user photographed with a main camera on the main display;
Analyzing the skin condition of the user using a skin diagnostic device; And
And outputting a reference image corresponding to the skin condition analysis result to the sub-display,
The step of outputting to the sub display
Recognizing the user's motion through a motion recognition sensor; And
And outputting a reference image corresponding to the user's motion. The method of claim 16,
The step of outputting to the sub-display,
And searching for an introduction image of a product to be recommended to the user as the reference image according to the skin condition analysis result. The method of claim 16,
The step of outputting to the sub-display,
Retrieving a reference image for a recommended makeup style corresponding to the skin condition analysis result,
The control method,
And synthesizing the reference image to the real-time photographed image. The method according to any one of claims 11 to 18,
Further comprising the step of measuring the distance to the user,
The step of outputting to the main display,
A control method for outputting the real-time photographed image of the user to the main display at a constant rate based on a distance to the user.

Images