JP5879562B2 - Mirror device with camera, fixture with mirror - Google Patents

Description

  The present invention relates to a mirror device with a camera, which includes a mirror surface that forms a mirror image and is provided with a camera having a field of view in front of the mirror surface.

  2. Description of the Related Art Conventionally, a technique for photographing a user's face or the like under appropriate lighting has been proposed for the purpose of photographing a face authentication system or an ID photo. For example, in Patent Document 1, when a subject wears spectacles, in order to prevent light from being reflected on the spectacles part, a display unit including a camera and a liquid crystal display, and a combination of illumination and display are disclosed. The structure which provided the part is proposed. The combined illumination / display unit is used not only for display together with the display unit but also for illumination. Patent Document 1 describes a control unit that determines which portion of the illumination / display combined unit emits light as illumination.

JP 2010-154190 A

  By the way, in the technique described in Patent Document 1, when the display unit and the illumination / display combined unit are formed by a single liquid crystal display, only a part of the screen is used for illumination. There is a possibility that the luminance is insufficient as compared with the case where a lighting device is provided. Further, since only a predetermined area of the screen of the liquid crystal display is used as the illumination / display unit, the light distribution when the subject is illuminated is also limited.

  In particular, in Patent Document 1, since the peripheral part of the liquid crystal display is used as an illumination / display unit, the illuminance at the central part, which is considered to be important in extracting the feature amount when photographing the face of the subject, is determined. There may be a shortage. In addition, depending on the display content of the display unit, unevenness in illuminance due to the display content may occur in the illuminance of the area that illuminates the subject.

  The present invention makes it possible to use the entire display device for illumination by allowing the display device to emit light as illumination and to adjust the light emission conditions at the time of shooting with a camera, thereby preventing the occurrence of insufficient light quantity and uneven illumination. An object of the present invention is to provide a mirror device with a camera.

In order to achieve the above object, a mirror device with a camera according to the present invention includes a mirror main body having a mirror surface that forms a mirror image, a display device that is disposed below the mirror main body and emits light to display, and the mirror. A camera that shoots a person facing the mirror body with the front of the body as a field of view, a processing unit that displays information extracted from an image photographed by the camera on the display device, and the display device at the time of photographing by the camera And a light emission control unit that adjusts the light emission condition of the display device, the display device is a dot matrix display, and the processing unit applies an image taken by the camera to the mirror body. The light emission control unit has a function of extracting a region of interest of a person who meets the person. To optimize the distribution of the illuminance, and having a function of adjusting the distribution of the luminance of the display device as the light emitting condition.

  In order to achieve the above object, a mirror device with a camera of another configuration according to the present invention includes a mirror main body having a mirror surface that forms a mirror image, and a display device that is disposed under the mirror main body and emits light to display. A camera that shoots a person facing the mirror body with the front of the mirror body as a field of view, a processing unit that displays information extracted from an image photographed by the camera on the display device, and photographing by the camera A light emission control unit for causing the display device to emit light as illumination and adjusting a light emission condition of the display device, and the display device is a dot matrix type color display, and the processing unit is photographed by the camera Having a function of extracting a region of interest of a person facing the mirror body from the captured image, It said to optimize the color distribution in the target region, and having a function of adjusting the distribution of the emission color of the display device as the light emitting condition.
  In this mirror device with a camera, the light emission control unit preferably has a function of adjusting the luminance distribution of the display device as the light emission condition so as to optimize the distribution of illuminance in the region of interest.

  In this mirror device with a camera, the mirror body is preferably a half mirror whose front surface is the mirror surface, and the display device is preferably disposed on the back side of the half mirror.

  In this mirror device with a camera, it is preferable that the region of interest is a face region corresponding to a human face facing the mirror body.

  A fixture with a mirror according to the present invention includes the above-described mirror device with a camera and a fixture main body.

  According to the configuration of the present invention, since the display device emits light as illumination and the light emission conditions can be adjusted at the time of photographing with the camera, the entire surface of the display device can be used for illumination, and there is insufficient light amount or uneven illuminance. It has the advantage that generation | occurrence | production can be prevented.

1 is a side view showing a first embodiment. It is a perspective view same as the above. 6 is a side view showing Embodiment 2. FIG.

(Embodiment 1)
In the present embodiment, as shown in FIG. 1, a mirror main body 1 having a mirror surface that forms a mirror image, a camera 2 having a field of view in front of the mirror main body 1, and a display device 3 disposed at the lower part of the mirror main body 1. With.

  The mirror body 1 is either an ordinary mirror that only reflects light or a half mirror that transmits part of light and reflects the remaining light. The camera 2 is a CCD image sensor or a CMOS image sensor, and is arranged above or above the mirror body 1 so that a person facing the mirror body 1 can be imaged from the front.

  When the mirror body 1 is a normal mirror, the display device 3 is arranged so as to be embedded in a part of the mirror body 1. When the mirror body 1 is a half mirror, the display device 3 is disposed on the back side of the mirror body 1. In this case, the reflectance of the half mirror is preferably greater than 70%. The display device 3 is configured to emit light and display, and is assumed to be a liquid crystal display with a backlight. However, a plasma display, an EL display, a rear projector type display, or the like can also be used. .

  An image picked up by the camera 2 is input to a processing unit 4 having a computer as a main component. The processing unit 4 extracts necessary information from the input image by executing an appropriate program. For example, the processing unit 4 has a function of extracting information on the face and information on the body or clothes from an image obtained by imaging a region including a human face facing the mirror body 1 or a region including the whole body. This type of function is well known and will not be described in detail. In the following description, it is assumed that the camera 2 captures an area including a face and extracts a face area corresponding to the face as a target area using a face recognition technique. When extracting information about the body and clothes, a region corresponding to them may be extracted as a region of interest.

  After extracting the face area, the processing unit 4 decomposes the face area into a plurality of partial areas (contours, eyes, nose, mouth, etc.) using features of shape and position, and attributes predetermined for each partial area. (Shape, color, etc.) are extracted. As described above, by dividing the face area into partial areas and extracting attributes for each partial area, it is possible to analyze attributes for each partial area, process an image by changing the attributes, and the like. In addition to extracting a partial area as information from the face area, the processing unit 4 also extracts feature quantities such as illuminance distribution, color distribution, surface roughness, gloss, and positional relation of the partial area as information. It is preferable to do.

  The processing unit 4 extracts the information as described above from the image captured by the camera 2, and further analyzes the extracted information, so that the facial color, skin state (including spots and wrinkles), facial expression, and finish of makeup Extract information that evaluates It is preferable for the user to select what information is finally extracted in the processing unit 4, but only predetermined information may be extracted. When selecting information to be extracted, a touch panel in which a touch switch is combined with the display device 3 is used as an operation unit, and an instruction is given to the processing unit 4 using the touch panel.

  Information extracted by the processing unit 4 is displayed on the display device 3. That is, the display device 3 displays information evaluated regarding the face area. The processing unit 4 has a function of displaying the processed face area image on the display device 3 when the face area image is processed. If the information extracted from the current face area by the processing unit 4 is displayed on the display device 3, the user can obtain information necessary for makeup and care, and information on the health condition can be obtained from the analysis results of facial expressions and facial colors. .

  By the way, when extracting the information as described above from an image photographed by the camera 2, if the photographing conditions are different every time the camera 2 is photographed, the extracted information varies. Therefore, if the shooting conditions are different for each shooting by the camera 2, the reliability of the extracted information is impaired. In order to solve this problem, it is conceivable to arrange an illumination device for photographing around the mirror body 1, but there is a problem that the cost increases. When importance is attached to the appearance like a cosmetic mirror, it is necessary to uniformly illuminate the entire face, and thus it is necessary to arrange an illumination device around the mirror body 1. However, since the present embodiment aims at imaging by the camera 2 and shoots from a short distance, it is preferable to shine light from the camera 2 toward the user in order to uniformly illuminate the entire face.

  Therefore, in view of displaying the above information on the display device 3 after shooting the user with the camera 2, the fact that shooting and display are not simultaneous in most cases, A configuration that functions as illumination during shooting is adopted. That is, the display device 3 emits light in conjunction with photographing by the camera 2 by utilizing the configuration in which the display device 3 emits light and performs display.

  Since shooting with the camera 2 is affected by ambient light, it is preferable to suppress variations in shooting conditions by adjusting the light emission conditions when the display device 3 emits light. Therefore, a light emission control unit 5 for adjusting the light emission conditions of the display device 3 is provided. The display device 3 occupies a relatively large area in front of the user, and the display device 3 is located at a relatively close distance to the user at the time of photographing. Therefore, by using the display device 3 as illumination at the time of photographing by the camera 2, it becomes possible to uniformly illuminate the entire required part of the user by the display device 3.

  Further, as described above, the display device 3 is disposed at the lower part of the mirror body 1, and specifically, the display device 3 is positioned slightly below the front of the eyes for users of average height. Are arranged to be. Accordingly, light is applied to the part of the user's face that tends to cause shadows due to ceiling lighting or the like from obliquely below, and the entire face is illuminated so as not to cause shadows. As a result, the image captured by the camera 2 includes a lot of information regarding the face, and the accuracy of the information extracted from the image increases accordingly. In addition, since the display device 3 is positioned slightly below the front of the eyes, when normal display is performed on the display device 3, the display contents are easy for the user to see.

  In order to adjust the light emission conditions of the display device 3 by the light emission control unit 5, it is necessary to perform pre-shooting with the camera 2 before shooting with the camera 2 after adjusting the light emission conditions in order to extract target information. preferable. The processing unit 4 extracts the illuminance and the color distribution of the face area from the image obtained by the previous photographing, and evaluates how the light including the ambient light hits the face area. Based on the evaluation result, the light emission control unit 5 determines the light emission condition of the display device 3 and causes the display device 3 to emit light. Further, the processing unit 4 acquires an image photographed by the camera 2 while the light emission control unit 5 causes the display device 3 to emit light under the light emission conditions.

  When the light emission condition of the display device 3 is adjusted by pre-photographing before taking a picture with the camera 2, the picture taking with the camera 2 may be repeated a plurality of times while changing the light emission condition. That is, while the light emission control unit 5 controls the light emission conditions of the display device 3, the light emission control unit 5 uses the information extracted by the processing unit 4 from the image captured by the camera 2. The light emission conditions are adjusted.

  The display device 3 adopts a dot matrix method because it is preferable not only to display the information obtained by the processing unit 4 as a character string but also to display an image. Therefore, the light emission conditions determined by the light emission control unit 5 can be selected so as to have different luminance for each part of the display device 3. That is, the light emission control unit 5 adjusts the luminance distribution of the display device 3 as a light emission condition so as to optimize the illuminance distribution in the face area extracted by the processing unit 4. By adjusting the luminance distribution of the display device 3, it is possible to finely control the illuminance of the user's face for each part and optimize the shooting conditions when shooting with the camera 2.

  In the above-described operation example, the light emission control unit 5 adjusts the luminance distribution of the display device 3 based on the image captured in advance by the camera 2, but the luminance distribution of the display device 3 has a base value (default). The luminance distribution may be finely adjusted while setting and photographing with the camera 2. A brightness distribution pattern suitable for the shape of the face may be prepared and fine adjustment may be performed on this pattern. Furthermore, a plurality of luminance distribution patterns may be prepared, and one of the patterns may be selected and used.

  When the display device 3 is a dot matrix type color display, the light emission control unit 5 can adjust the light emission color distribution of the display device 3 as a light emission condition. By adjusting the emission color distribution of the display device 3, the color distribution in the face region can be adjusted. When the display device 3 is a dot matrix type color display, it is possible to adjust the luminance distribution as well as the emission color. By adjusting the distribution of luminance and emission color, it is possible to optimize the color of each part of the face area.

  In particular, if you adjust the emission color corresponding to a part with a characteristic color, such as stains or acne, you can make the part inconspicuous or light that emphasizes the part if necessary Is possible. In this way, by adjusting the light color that illuminates the face, it becomes easy to extract necessary information from the image captured by the camera 2, and as a result, the accuracy of the extracted information can be increased. Become.

  When a user captures a face image with the camera 2, the user prepares for capturing by adjusting the luminance distribution or color distribution of the display device 3 while looking at the mirror image of the mirror body 1. Thereafter, the user is irradiated with light from the screen of the display device 3 under the prepared light emission conditions, and the camera 2 performs photographing. Further, information extracted from an image photographed by the camera 2 is displayed on the display device 3. In this way, the display device 3 is used exclusively for lighting when taking a picture with the camera 2, and information that hinders the taking is not displayed. That is, the display device 3 can be used under conditions suitable for both functions for illumination and display, because the period during which the display device 3 is used for illumination and the period used for display are different. Become.

  In the embodiment described above, the face region is extracted from the image captured by the processing unit 4 with the camera 2. However, the processing unit 4 may display an image captured by the camera 2 on the display device 3. That is, the image itself is used as information extracted from the image. Even if an image corresponding to the user's face is displayed just by displaying the captured image on the display device 3, the user can detect shadows, wrinkles, spots, etc. It becomes possible to see the state.

  Furthermore, if a storage unit for storing images is provided, images captured in the past are stored as a history, so that changes in the face state can be known by comparison with past images. In addition, when the image captured by the camera 2 is displayed on the display device 3 as it is, the processing unit 4 displays the image captured by the camera 2 on the display device 3 because it is opposite to the mirror image formed on the mirror body 1. In doing so, it is preferable to reverse the left and right.

  In the configuration example described above, the case where the processing unit 4 evaluates the appearance of the face is illustrated, but the face is irradiated as in the case where a feature amount for face authentication is extracted or an illumination photograph is taken. A similar technique can also be adopted when it is desired to stabilize the distribution of the emitted light. Furthermore, since the display device 3 can adjust the light emission luminance and the light emission color for each pixel and can adjust not only the position but also with the passage of time, the illumination conditions for shooting with the camera 2 are also possible. Can be finely adjusted.

  In the configuration example described above, the image taken by the camera 2 is used mainly for the purpose of extracting information related to the user's face, but it can also be used to extract the user's posture, time change of the posture, and the like. It is. In particular, when extracting the time change of the posture, when the user sees the mirror image reflected on the mirror body 1 and when shooting with the camera 2, the appropriate light irradiation direction may differ. If ceiling lighting or the like is used for shooting, the amount of light from the camera 2 is insufficient. According to the configuration of the present embodiment, the amount of light from the camera 2 is supplemented using the display device 3, so that the necessary amount of light is secured.

  Further, in the configuration in which the mirror body 1 is a half mirror and the display device 3 is disposed on the back side of the mirror body 1, the display device 3 is used as compared with the configuration in which the display device 3 is embedded in a part of the mirror body 1. Mirror surface can be used widely when not.

(Embodiment 2)
This embodiment relates to a fixture using the technique of the first embodiment. Embodiment described below assumes the vanity stand provided with the cabinet and the wash bowl as a main body of a fixture. However, the embodiment described below is an example, and a mirror-equipped fixture can be configured by combining with various fixture bodies including a mirror, such as a three-sided mirror, a figure, and a bathroom mirror.

  As shown in FIG. 3, the fixture body 10 includes a cabinet 11, and a wash bowl 13 is attached to a counter 12 that is an upper surface of the cabinet 11. Further, a back board 14 to which the mirror device with a camera described in the first embodiment is attached is provided at the rear part of the cabinet 11. The computers constituting the processing unit 4 and the light emission control unit 5 are accommodated in appropriate places on the cabinet 11 or the back board 14. In the present embodiment, it is assumed that a touch panel in which a touch switch is superimposed on the screen of the display device 3 is provided as an operation unit.

  Since the vanity is used daily for washing the face, it is suitable for managing the skin condition and the like based on the image captured by the camera 2. Further, since the vanity is used for washing the face, it is possible to accurately evaluate the skin condition by evaluating the condition of the bare skin after the face washing.

  The mirror device with a camera provided on the vanity may be activated by a user's operation, but it is desirable to pause in the standby state. In the standby state, the minimum functions of the camera 2 and the processing unit 4 are operating, and when the user stands in front of the vanity, the processing unit 4 is based on the image captured by the camera 2. Recognize the presence of users. When recognizing the presence of the user, the processing unit 4 displays an operation icon at the bottom of the display device 3.

  In this state, when a finger or a hand is brought close to the icon or the icon is touched, the processing unit 4 and the light emission control unit 5 are activated, the display device 3 emits light as illumination, and photographing by the camera 2 is performed. Thereafter, necessary information is extracted from the image photographed by the camera 2 and displayed on the display device 3.

  The icon is not displayed on the display device 3 while the display device 3 is used as illumination. When the information extracted from the image captured by the camera 2 is displayed, the icon is displayed again on the display device 3. . This icon is used when switching the display contents of the display device 3 or erasing the display of the display device 3. Further, the icon can be used to instruct the start and end of shooting with the camera 2. In order to accept an operation by the user, instead of displaying an icon on the display device 3, the mirror device with camera may be operated by adopting a voice recognition technique and using a voice or sound type. Other configurations and operations are the same as those of the first embodiment.

  In the configuration example described above, a user can operate the display device 3 using a touch panel. However, instructions to the processing unit 4 and the light emission control unit 5 are performed by communication using infrared or radio waves as a medium. It may be. For example, an appropriate program (a so-called “mobile application”) may be installed in a mobile terminal (cell phone, smart phone, etc.) managed by the user, and an instruction may be given through the communication interface of the mobile terminal. .

DESCRIPTION OF SYMBOLS 1 Mirror body 2 Camera 3 Display apparatus 4 Processing part 5 Light emission control part 10 Fixture body

Claims (6)

A mirror main body having a mirror surface for forming a mirror image; a display device disposed at a lower part of the mirror main body for emitting and displaying; a camera for photographing a person facing the mirror main body with the front of the mirror main body as a field of view; A processing unit for displaying information extracted from an image photographed by the camera on the display device, and light emission control for causing the display device to emit light as illumination during photographing by the camera and adjusting a light emission condition of the display device and a part,
The display device is a dot matrix display, and the processing unit has a function of extracting a region of interest of a person facing the mirror body from an image captured by the camera, and the light emission control unit includes the region of interest The camera-equipped mirror device has a function of adjusting the luminance distribution of the display device as the light emission condition so as to optimize the illuminance distribution in the display . A mirror main body having a mirror surface for forming a mirror image; a display device disposed at a lower part of the mirror main body for emitting and displaying; a camera for photographing a person facing the mirror main body with the front of the mirror main body as a field of view; A processing unit for displaying information extracted from an image photographed by the camera on the display device, and light emission control for causing the display device to emit light as illumination during photographing by the camera and adjusting a light emission condition of the display device With
The display device is a dot matrix type color display, and the processing unit has a function of extracting a region of interest of a person facing the mirror body from an image photographed by the camera, and the light emission control unit includes: It said to optimize the color distribution in the target region, wherein the to Luke camera with mirror device to have a function of adjusting the distribution of the emission color of the display device as the light emitting condition. The camera-equipped mirror according to claim 2 , wherein the light emission control unit has a function of adjusting a luminance distribution of the display device as the light emission condition so as to optimize an illuminance distribution in the region of interest. apparatus. The said mirror main body is a half mirror whose front is the said mirror surface, Comprising: The said display apparatus is arrange | positioned at the back side of the said half mirror, The any one of Claims 1-3 characterized by the above-mentioned. Mirror device with camera. The camera-equipped mirror device according to claim 1 , wherein the region of interest is a face region corresponding to a face of a person facing the mirror main body . A mirror-equipped fixture comprising the mirror device with a camera according to any one of claims 1 to 5 and a fixture main body.

Images