JP3505575B2 - Digital mirror device - Google Patents

Description

Description: BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention combines images taken by cameras provided on the left and right of an object such as a human face, and as if a mirror was installed in front of the object. The present invention relates to a digital mirror device configured to generate an image or the like as if viewing it. 2. Description of the Related Art In everyday life of human beings, mirrors are indispensable for grooming and the like. For example, mirrors provided on a wash basin are generally used for washing and brushing teeth every morning. When using a wash basin, always use it. Especially young women are concerned about their appearance and often apply elaborate makeup, so many people spend about an hour in the sink every day. [0003] According to statistics, a person who performs careful makeup in this wash basin has 10 minutes to wash his hair in the morning, 10 minutes to dry his hair after washing, 4 minutes and 30 seconds to wash his face and brush his teeth, 8 minutes to apply serum / emulsion, foundation,
A total of 52 minutes and 30 seconds of 20 minutes is spent on makeup such as eyebrows, eye lines, eye shadows, lipsticks, and lipsticks.
There is data that it takes 19 minutes in total for 8 minutes to apply lotion and emulsion. [0004] Therefore, the behavior of such a person in the morning is, for example, when the user wakes up in FIG. 8 at 30 minutes, showers for 30 minutes until 9 o'clock, then dries the hair in a wash basin for about 10 minutes, It takes about 10 minutes to apply lotion and milky lotion, and it takes about 9:20 to about 20 minutes to change clothes. Breakfast is from 9:40 to 20 minutes, and the last makeup is done from 10:00 to 10:20. , The behavior pattern is taken on a daily basis. [0005] Even if it is not a person who spends time putting on such particularly elaborate makeup, at least about 20 minutes for young women, etc., stand in front of the wash basin. The time spent here is also important for ordinary people, and it is desirable to spend as much time as possible here. [0006] As described above, the wash basin is an important place for a person to spend a certain amount of time on a regular basis. Being groomed doesn't necessarily mean that valuable time is being spent. In particular, as is apparent from the above-described behavior pattern, the time when the user stands in the basin in the morning is the time when he / she just got up, and there is no time to watch the news on the morning newspaper or the television until then. [0007] In addition, it is important for a young woman as described above to choose an outfit when going out. At that time, clothes are selected according to the weather and temperature in the future, shoes are selected accordingly, and other items are selected. You need to choose a decoration. In addition, it is necessary to select the color of the lipstick and the eyeshadow in accordance with these costumes, and to perform various makeup adjustments such as hairstyle adjustment. Also, in summer, it is necessary to make up for ultraviolet rays depending on the weather at that time. However, as mentioned above, there is almost no opportunity to know the weather forecast information before going to the wash basin, so simply look at the outside and perform the routine work in the morning as described above, Because they will stand in front, it is often not possible to make appropriate makeup. [0008] The above-mentioned situation is not limited to young women, but is also true for ordinary male office workers. It is necessary to brush teeth on a wash basin, wash a face, shave, etc. every day. Spending time in the wash basin and spending most of the valuable time in the morning here, but spending time only for the daily monotonous work as described above is an effective way to use time It cannot be said that there is any information provision means here. For this reason, it is also practiced to incorporate weather forecasts and news information on the radio here, but the content of the incorporation of information by radio is limited, and it is not necessarily the case that information according to the user's will be obtained Not exclusively. On the other hand, the mirror mounted on the wash basin is used only for displaying a mirror image of one's own figure while taking up a large space. For example, a function of enlarging a part, a three-sided mirror while being a plane mirror It cannot perform such a function of reflecting various shapes as described above, and it cannot be said that the mirror area of the large wash basin is always used effectively. Therefore, the present invention provides various functions such as a three-sided mirror function and a partially magnified function, in addition to a mirror of a wash basin that many people use for a long time on a daily basis, rather than merely photographing their own figure. It is intended to be a means for providing various information. [0011] In order to solve the above-mentioned problems, the present invention provides a plurality of visual sensors for obtaining image data in a plurality of directions of a user, and a method for specifying a user based on the data of the visual sensors. an image processing unit to obtain an image of the orientation, Ri Do and a monitor screen for displaying an image from the image processing unit, wherein
Input image and message voice information of user to image processing unit
The image processing unit is used by the image of the visual sensor.
Identify the user and identify the user corresponding to the identified user.
A digital mirror device for outputting information . DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Embodiments of the present invention will be described below. This will be described based on an example. FIG. 1 is an overall schematic diagram showing a basic configuration of a digital mirror device according to the present invention. A monitor screen 2 is provided on a portion of a wash basin 1 where a mirror is installed. And a second visual sensor 4 similar to the first visual sensor 3 made of
Of the user 5 standing in front of the camera. The images photographed at this time are images obtained by photographing oblique side portions of the user as shown below the visual sensors 3 and 4 in the figure, and these images are output to the image processing unit 7 of the computer 6. ing. In the image processing section 7 of the computer 6, three-dimensional shape data is obtained from the images of a plurality of cameras in each of the two visual sensors, and the entire data is integrated. In the illustrated embodiment, the monitor shown in the figure is used. The front-facing image as shown in the screen 2 is used. In such image processing, processing can be performed according to a basic procedure as shown in FIG. 2, for example. That is, an image near the human head is input from the visual sensor (step S1), then three-dimensional shape data near the head is calculated, a three-dimensional model is created, and a texture map is formed on the model (step S2).
Next, a specific viewpoint is set for the three-dimensional shape data thus obtained, and image data based on the viewpoint is obtained (step S3). The image data thus created is displayed on a monitor (step S4). In step S3, regardless of the movement of the face in the left, right, up, and down directions, the face is tracked and displayed so as to be positioned at the center of the screen. When the center of the viewpoint is determined, it is possible to perform processing such as creating an enlarged / reduced image centering on this part. Therefore, in a normal mirror, a person with a small height cannot be originally reflected on a monitor screen as a mirror at a high position, but this device can also display the image as a front view image. At present, such processing can be easily created by 3D image processing technology or computer graphics technology. Various types of visual sensors can be used. In the simplest form, two sets of visual sensors are installed on the left and right sides of the monitor screen as shown in FIG. In addition, in order to obtain a precise composite image, a total of 4
A more accurate composite image may be obtained by processing an image captured by the individual visual sensors. It should be noted that a more accurate composite image can be obtained using a larger number of visual sensors. In addition, each visual sensor can obtain a stereoscopic image by using two or more cameras, but in order to obtain more accurate image data,
More cameras, such as three or four, may be used. In the embodiment shown in FIG. 1, the Internet 6 is connected to the computer 6 and the data creation unit 9
Captures Internet information at the operation input unit 1
Data is selected in response to various requests from the user input from 0, output to the image processing unit 7, combined with the user's video, and displayed on the monitor screen 2. In the illustrated embodiment, weather forecast data is fetched from the Internet, displayed on the upper left portion of the screen so as not to cover the image of the user's face, etc., and a computer is displayed on the upper right portion of the screen. The date and time are displayed using the clock function of No. 6. The information displayed here can be arbitrarily selected by the user, for example, news, traffic information,
It can also display stock price trends and even received emails. As described above, the image viewed from the front of the user 5 is displayed on the mirror portion of the sink 1 so that the user can see his / her face and the like as if he / she is looking at the mirror. Since various information can be displayed on the screen, for example, when standing up in front of the wash basin just after getting up in the morning and performing face washing, tooth brushing, makeup, etc. Can be displayed, for example, to assist in making makeup according to the weather of the day, and by incorporating news information from the Internet or the like into the weather information portion, valuable morning time can be displayed. A lot of information such as news can be taken into. At this time, a speaker is provided on the wash basin, and information can be taken in by voice. If necessary, a television receiver or a video player is connected to the monitor screen, and the television picture currently being broadcast on the monitor screen and the video picture of the previously recorded video are operated by the user. Can also be displayed. Further, if necessary, the currently-acquired Internet information is downloaded to a memory such as a hard disk, and a user's message is input together with an image to be taken from a separate microphone and recorded in a video player. You can also. Also, when this message is for a person in this house, the presence of such a message is displayed on the screen, and then reproduced for the other party using the wash basin. You can also tell them to see. When the digital mirror device as described above is actually mounted on a sink, it can be mounted, for example, in a manner as shown in FIG. In the example shown in the figure, a thin monitor screen 2 made of plasma, liquid crystal, or the like is arranged on a portion of the washstand 1 where a mirror is conventionally attached, to form a digital mirror device. Further, a first visual sensor 3 and a second visual sensor 4 are arranged on both sides of the monitor screen 2, and their image signals are input to a computer such as a personal computer (not shown). Output to the monitor screen 2. The monitor screen 2 is movably supported in the up-down direction, and is automatically adjusted to the height of the user by the driving device by the operation of the user or by the recognition of the face position by the visual sensor. I do. The above-described apparatus can be used in various modes by the internal processing of the computer 6 in FIG. 1 in particular. For example, the image processing section mainly focuses on the front-facing image in FIG. The image is changed to an image on the diagonally left side of the user as shown in FIG. 4A, or is changed to an image on the diagonally right side of the user as shown in FIG. It can be used as if it were a three-sided mirror. In addition, the angle at that time can be arbitrarily designated and changed, and the angle can be automatically gradually changed as necessary to display the moving image. Also,
As shown in FIG. 4 (d), a face is displayed on the entire screen so that makeup can be easily performed, and further enlarged to enlarge the work such as attaching and detaching a contact lens and drawing an eye line. You can also help when doing. At this time, when the user designates an arbitrary position in the image with a finger or the like, the visual sensor can recognize this and enlarge the designated portion. Further, since the data creating section 9 of the computer 6 can fetch various information from the Internet 8 or the like as described above, various icons are displayed at the lower part of the screen as shown in FIG. By making this part an operation unit using a touch panel, each function can be performed. The icons can be displayed in a multi-layer format so that the next icon group is displayed by operating each icon. Further, it is also possible to perform various operations without touching the icons by detecting the user's line of sight with the visual sensor and identifying which of these icons the user is looking at. At that time, it is preferable to display the icons to some extent large and arrange them in a dispersed manner. FIG. 5 shows a display example including an icon, in which a front image of the user's face is displayed at the center of the screen, and the icon is arranged at a position below the screen where the user can easily operate. In this example, an icon of “health” is provided at the left end of each icon, and the user operates this icon to display the user's health information at the upper left. Note that, in this example, unless otherwise specified, an example is shown in which the date and time information is always displayed in a portion at the upper right of the screen that does not overlap with the image of the user's head at normal times. The above-mentioned health information is obtained by automatically detecting, for example, a user's breathing, pulse, turning over, and snoring conditions during sleep without restriction on the user, and evaluating the data by a computer. It is the individual data or information obtained by integrating them. In the embodiment of FIG. 5, a graph is displayed as the overall health index and the state is displayed as "good!". Other icons on the screen give instructions to image processing such as an image rotated to look at the left side of the user, an image rotated to look at the right side, an enlarged image, a wide area image showing a wide area, and the like. It has icons for
When obtaining the left and right images of the user as described above, for example, the screen may be divided into three parts, the center screen may be fixed as the front image, and the respective images may be rotated with respect to the left and right screens. In the illustrated example, an icon of “schedule” is provided, and a schedule of the day, a weekly schedule, and the like can be displayed based on data of an action schedule input by a user in advance. In addition, in the illustrated embodiment, information such as "weather", "stock price", and "traffic" can be taken in from the Internet, and mail can be received, and if necessary, mail can be transmitted from here. I can do it. As for such an e-mail transmission / reception function, when the user stands in front of the sink, the user recognizes the face of the user, and when an unread e-mail of the user is received, the message “E-mail has arrived! , Etc. can be displayed. Also, by transmitting and receiving data via the Internet, a user's image is transmitted to a specific party.
Similarly, by displaying an image of the other party on the whole or a part of the monitor part, it is possible to use as a videophone while displaying images so that their eyes are aligned with each other. In this case, in addition to using the Internet as described above, this can be performed by data communication using a normal telephone line as in the related art. In the illustrated embodiment, a “TV” icon is further provided so that a TV screen can be displayed on the whole or a part of the monitor. Necessary programs such as programs can be viewed here. In addition, a “video” icon will be provided so that previously recorded programs can be viewed here, and if necessary, for example, “Dad, take out the garbage!” You can record and record the user's message, such as "I've got it,""Mom and dog are no more." In this case, when the person who transmits the message stands on the wash basin in the same manner as described above, the face image can be recognized and the presence of the message can be transmitted. According to the present invention, in addition to the above-mentioned example, various kinds of image processing can be performed on an image of a user or the like by image processing and displayed. Can be displayed as it is, so if the user finds it difficult to use it, it can be inverted and displayed. Also, the reservation status of concert tickets from the Internet etc., bargain sale information of department stores Etc.
It can be displayed in various modes. According to the present invention, a plurality of visual sensors for obtaining image data of a plurality of directions of a user, an image processing unit for obtaining an image of a specific direction of the user based on the data of the visual sensor, Ri Do and a monitor screen for displaying an image, the image processing message sound and the user's image to unit
Voice information is input, and the image processing unit
Identify users by images and respond to the identified users
The digital mirror device is characterized in that the information of the user is output, so that the data of the visual sensor is arbitrarily image-processed so that the visual sensor does not take an image of the front of the user. Can display an image of the front, and can match his / her own image with the line of sight. Further, since various image data can be obtained by image processing, various functions such as a three-sided mirror function and a partial enlargement function can be performed instead of simply taking a picture of oneself. In particular, the image processing unit may include a user image
Automatically identifies the user by using the
Outputs user image and message voice information to the user.
The user only stands in front of the wash basin.
Automatically provide information to users
become. And the mirror part that I use regularly every morning
It can be used as a board and
It is the front part showing the appearance of the minute and in your own image
Since it is displayed in the unaffected areas, effective use of the screen and viewing
Easy information display can be performed. The following is an example of the above.

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 outlines the configuration of a digital mirror according to the present invention;
FIG. 2 is a system schematic diagram showing examples of captured images and display images. FIG. 2 is an operation flowchart showing an outline of operation of the present invention. FIG. 3 is a perspective view when the digital mirror of the present invention is used for a washstand. FIG. 4 is a diagram showing an example in which images in various modes are displayed by the image processing function of the digital mirror according to the present invention. FIG. 5 is a diagram showing an example of displaying various information on a digital mirror according to the present invention. [Description of Signs] 1 Washstand 2 Monitor screen 3 First visual sensor 4 Second visual sensor 5 User 6 Calculator 7 Image processing unit 8 Internet 9 Data creation unit 10 Operation input unit

──────────────────────────────────────────────────続 き Continuation of the front page (51) Int.Cl. ⁷ Identification symbol FI G06T 1/00 340 G06T 1/00 340A (56) References JP-A-11-112970 (JP, A) JP-A 2000-236535 ( JP, A) (58) Fields investigated (Int. Cl. ⁷ , DB name) H04N 7/18 A47B 67/02 502 A47K 1/00 A47K 1/02 G06T 1/00 315 G06T 1/00 340

Claims (1)

(57) [Claims 1] A plurality of visual sensors for obtaining image data of a plurality of directions of a user, and an image processing unit for obtaining an image of a specific direction of the user based on the data of the visual sensors. If, Ri Do from the monitor screen and for displaying an image from the image processing section, the image information of the message the voice of the image to the processing unit user input
And the image processing unit guides the user based on the image of the visual sensor.
The information of the user corresponding to the specified user
A digital mirror device, which outputs a digital mirror.