JP2013182062A - Display device and projection device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To notify information that is suitable for a state of a subject.SOLUTION: A display device 1 includes state detection means for detecting a state of a subject 3 and display means 20 for displaying information according to the state of the subject 3 detected by the state detection means to be seen superposed on the subject 3. In this case, the state detection means detects the change situation of the state of the subject according to the passage of time and the display means changes the displayed information according to the change situation of the state of the subject detected by the state detection means.

Description

  The present invention relates to a display device and a projection device.

  There has been known an information display device that displays various types of information on a user's image reflected on the mirror by projecting various types of information using the face of the user facing the mirror as a projection plane (see Patent Document 1).

JP 2011-77747 A

  The above prior art is for notifying the mirror user of uniform information such as news and weather forecast, for example, and not considering information suitable for the user's condition.

  A display device according to the present invention includes a state detection unit that detects a state of an object, and a display unit that displays information according to the state of the object detected by the state detection unit so that the information is seen superimposed on the object. , Provided.

  According to the present invention, information suitable for the state of an object can be notified.

It is a figure explaining the structure of the display apparatus by one embodiment of this invention. It is a block diagram which shows the principal part structure of a display apparatus. It is a figure explaining a makeup | decoration alerting | reporting process. It is a figure explaining unshaving notification processing. It is a figure explaining the structure of the display apparatus by the modification 6. FIG. It is a figure explaining the structure of the display apparatus by the modification 9. It is a figure which shows the spectral transmittance of the mirror used in the modification 9. It is a figure explaining the structure of the display apparatus by the modification 10. FIG. It is a figure explaining the structure of the display apparatus by the modification 11. FIG. It is a figure explaining the structure of the camera with a projector by the modification 16. It is a figure explaining the projection process by the modification 16.

  Hereinafter, embodiments for carrying out the present invention will be described with reference to the drawings. FIG. 1 is a diagram for explaining the configuration of a display device 1 according to an embodiment of the present invention. The display device 1 includes a camera unit 10 and a projector unit 20 that are installed around the upper part of the mirror 2. The display device 1 captures the user 3 facing the mirror 2 with the camera unit 10 and detects the position of the face of the user 3 from the captured image. The display device 1 projects various information by the projector unit 20 using the detected face as a projection plane. Thereby, the user 3 can visually recognize the information projected by the projector unit 20 together with the self-image reflected in the mirror 2. It should be noted that the camera unit 10 and the projector unit 20 are arranged at positions where the entire face can be photographed and projected when the user 3 stands naturally at a position where his / her face is reflected in the mirror 2.

  FIG. 2 is a block diagram illustrating a main configuration of the display device 1. The display device 1 includes a camera unit 10, a projector unit 20, a control device 30, a storage device 40, an operation member 50, and an external interface (I / F) 60.

  The control device 30 includes a microprocessor and its peripheral circuits. The control device 30 controls the photographing operation by the camera unit 10 and the projection operation by the projector unit 20 based on the control program. The storage device 40 stores a control program executed by the control device 30 and various types of information projected by the projector unit 20. The operation member 50 is configured by buttons, switches, and the like, and sends operation signals corresponding to the operated buttons and switches to the control device 30. The control device 30 acquires various information supplied from the external device via the external interface 60.

  The camera unit 10 includes an imaging optical system 101, an imaging element 102, and an imaging control circuit 103, and performs imaging in response to an instruction from the control device 30. The imaging optical system 101 forms a subject image on the imaging surface of the image sensor 102. As the image sensor 102, a CCD, a CMOS, or the like is used. The imaging control circuit 103 drives and controls the imaging device 102 according to an instruction from the control device 30 and performs predetermined signal processing on the image signal output from the imaging device 102.

  The projector unit 20 includes a projection optical system 201, a liquid crystal panel 202, an LED light source 203, and a projection control circuit 204. The LED light source 203 illuminates the liquid crystal panel 202 with brightness according to the supply current. The liquid crystal panel 202 generates a light image according to the drive signal from the projection control circuit 204. The projection optical system 201 projects a light image emitted from the liquid crystal panel 202 onto an external projection surface. The projection control circuit 204 sends a control signal for projecting information instructed from the control device 30 to the LED light source 203 and the liquid crystal panel 202.

  The display device 1 of the present embodiment is characterized by a projection process that detects the face state of the user 3 from the face image of the user 3 photographed by the camera unit 10 and projects information according to the face state. Hereinafter, this projection processing will be described. In the present embodiment, as the projection process, a makeup notification process for notifying the makeup suitable for the face color and a shave remaining notification process for notifying the shave residue of the heel are provided.

-Makeup notification processing-
The makeup notification process will be described with reference to FIG. FIG. 3A shows an image obtained by photographing the user 3 by the camera unit 10. FIG. 3B shows an image projected by the projector unit 20. In FIG. 3B, the broken line is not actually projected. FIG. 3C shows an image reflected on the mirror 2.

  When the execution of the makeup notification process is instructed by, for example, an operation signal from the operation member 50, the control device 30 controls the camera unit 10 to perform imaging at predetermined time intervals, and the captured image (FIG. 3A). ) For face detection. When the face of the user 3 is detected by the face detection process, the control device 30 detects face information such as the detected face eyes, nose, mouth position, face outline, and face skin color (face color).

  The face color varies depending on the person, for example, a skin color with a strong redness or a skin color with a strong bluishness. Further, it is known that the color of teak (blusher) that matches the face differs depending on the face color. Therefore, in the present embodiment, a database that associates various face colors with cheek colors suitable for each face color is stored in the storage device 40. The control device 30 refers to this database and specifies a cheek color suitable for the detected face color of the user 3.

  Then, as shown in FIG. 3B, the control device 30 generates a projection image for projecting the cheek image Pc of the specified color. At this time, the control device 30 positions the cheek image Pc based on the detected face information so that the cheek image Pc is projected at a position suitable for cheeking on the face of the user 3.

  The projector unit 20 projects the generated projection image using the face of the user 3 as a projection plane under the control of the control device 30. As a result, as shown in FIG. 3C, the mirror 2 shows the cheek image Pc superimposed on the face of the user 3. That is, the mirror 2 appears as if the face of the user 3 was made up. Thereby, the user 3 can confirm the face to which the makeup suitable for his face was given with the mirror 2 before applying makeup. If the user 3 likes the makeup confirmed by the mirror 2, he / she should just apply the makeup as projected.

  The control device 30 causes the camera unit 10 to capture images at predetermined time intervals even after projecting the cheek image Pc, and determines the progress of makeup based on the captured images. When the control device 30 determines that the makeup is progressing according to the projected cheek image Pc, the control device 30 gradually thins the cheek image Pc to be projected according to the progress. That is, the cheek image Pc to be projected is made thinner by the amount of cheeks on the face of the user 3 in the image taken by the camera unit 10. And the control apparatus 30 is made not to project anything on the location where makeup was completed as the projected cheek image Pc. As a result, the user 3 can confirm how much cheek he / she should add based on the change in the projected cheek image Pc.

  In addition, the camera unit 10 may be configured to be sensitive to infrared light and to capture an infrared image in addition to a visible image. In this case, the control device 30 detects the face color and identifies the cheek that matches the face color as described above, and in addition, the temperature of the face surface of the user 3 based on the infrared image captured by the camera unit 10. And a process of determining the health condition (for example, body temperature) of the user 3 based on the detection result. Then, in addition to the above-described cheek image Pc, the control device 30 projects information indicating the determination result of the health condition (for example, text information such as “there is a slight fever”) on the face of the user 3. In addition, it is known that when there is heat, the complexion looks reddish and the corners of the eyes appear lower than usual. Therefore, when the control device 30 determines that the user 3 has heat, the projector unit 20 causes the projector unit 20 to project a makeup image that makes the redness of the facial color inconspicuous, or to display a makeup image that highlights the corners of the eyes. You may make it project.

-Unshaved notification process-
The remaining shaving notification process will be described with reference to FIG. FIG. 4A shows an image obtained by photographing the user 3 by the camera unit 10. FIG. 4B shows an image projected by the projector unit 20. In FIG. 4B, the broken line is not actually projected. FIG. 4C shows an image reflected on the mirror 2.

  For example, when an operation signal from the operation member 50 instructs the control device 30 to execute the unshaved notification process, the control device 30 controls the camera unit 10 to perform image capturing at predetermined time intervals, and the captured image (FIG. )) Face detection processing is performed. When the face of the user 3 is detected by the face detection process, the control device 30 detects face information such as the detected face eyes, nose, mouth position, face outline, and face skin color (face color). In addition, the control device 30 performs a known super-resolution process on the detected face image to generate a high-resolution face image, and detects 髭 Hg from the high-resolution face image. Specifically, for example, a portion having a color different from the face color existing below the nose position and around the mouth is detected as 髭 Hg.

  Then, as shown in FIG. 4B, the control device 30 generates a projection image for projecting the arrow image Py and the text image (“Check!”) Pt for highlighting the detected position of the eyelid. In practice, the text image Pt is generated as an image that is horizontally reversed so that characters can be read when the user 3 looks through the mirror 2.

  The projector unit 20 projects the generated projection image using the face of the user 3 as a projection plane under the control of the control device 30. As a result, as shown in FIG. 4 (c), the mirror 2 shows the arrow image Py and the text image Pt superimposed on the face of the user 3. As a result, the user 3 can shave the shave after the shave with the mirror 2, and can shave the unshave shave while looking at the mirror 2.

  The control device 30 causes the camera unit 10 to capture images at predetermined time intervals even after projecting the arrow image Py and the text image Pt, continues to detect wrinkles from the captured images, and according to the progress of shaving. Change the projected image. Specifically, the projection of the arrow image Py and the text image Pt is terminated for a portion where the eyelid is no longer detected due to the shaving being shaved. Thereby, the user 3 can confirm how much he should shave further based on the change of the projected arrow image Py and the text image Pt.

  If the control device 30 determines that the detected eyelid is in the vicinity of the outline (edge) of the face, the control device 30 prompts the user 3 to change the face orientation in addition to the arrow image Py and the text image Pt. The message may be projected by the projector unit 20. For example, when the position of the heel is near the lower contour, the user is prompted to face upward, and when the position of the heel is near the right contour, the user is prompted to face left. By changing the direction of the face of the user 3 with respect to the mirror 2 in accordance with this message, the user 3 can more easily check the remaining shaving of the heel with the mirror 2. At this time, the control device 30 causes the projection positions of the arrow image Py and the text image Pt to follow as the user 3 changes the direction with respect to the mirror 2 and the position of the eyelid changes.

  Note that the method for highlighting the wrinkles is not limited to the arrow image Py and the text image Pt shown in FIG. 4. For example, an image that makes the detected wrinkles appear thick may be projected. Further, the face color of the user 3 may be detected in the same manner as the makeup notification process described above, and the opposite color of the detected face color may be used as the color of the arrow image Py and the text image Pt. Thereby, it is possible to make the arrow image Py and the text image Pt easier to see.

According to the embodiment described above, the following operational effects can be obtained.
(1) The display device 1 includes a camera unit 10 that captures the user 3 facing the mirror 2, a control device 30 that detects the face state of the user 3 based on an image captured by the camera unit 10, and A projector unit 20 that displays information according to the face state of the user 3 detected by the control device 30 so that the information is superimposed on the image of the user 3 reflected in the mirror 2; The user 3 can visually recognize information suitable for the state of the face of the user 3 together with the image of the user 3 reflected in the mirror 2.

(2) In the display device 1 of the above (1), the control device 30 is based on the image captured by the camera unit 10 and changes the state of the face of the user 3 (the progress of makeup and the progress of shaving). The projector unit 20 is configured to change the information to be displayed according to the change state, so that the optimum information is displayed according to the state of the face that changes sequentially. be able to.

(3) In the display device 1 of the above (1) or (2), the control device 30 performs a super-resolution process on the image captured by the camera unit 10, and based on the image after the super-resolution process. Since the projector unit 20 is configured to display information for emphasizing the detected eyelids, the detailed state in the face of the user 3 (the shavings remaining on the eyelids) is detected. It is possible to notify about the state of a place that is difficult to find by simply viewing 2.

(4) In the display device 1 of (1) to (3) above, the control device 30 detects the skin color of the face of the user 3 based on the image captured by the camera unit 10, and the projector unit 20 Since it is configured to display information corresponding to the detected skin color of the face (blush that matches the face color), the user 3 can make up makeup while looking at the mirror 2 and checking the information.

(5) In the display device 1 of (1) to (4) above, the camera unit 10 captures an infrared image of the user 3 facing the mirror 2, and the control device 30 is based on the infrared image. Since the surface temperature of the user 3's face is detected and the projector unit 20 is configured to display information (such as health condition and optimal makeup) according to the surface temperature of the face, Information that is difficult to notice simply by visually recognizing the mirror 2 can be notified.

(Modification 1)
In the above-described embodiment, an example of projecting a cheek that matches the face color in the makeup notification process has been described. However, the present invention is not limited to this. Further, it is possible to detect the bear of the eyes based on the skin color under the eyes and project makeup that makes the bear of the eyes inconspicuous.

(Modification 2)
In the above-described embodiment, an example in which wrinkles are detected based on a captured image converted to a high resolution by super-resolution processing has been described. However, the present invention is not limited to this, and for example, small wrinkles such as eye corners may be detected. . In this case, the control device 30 projects an image that highlights the position of the detected gavel. As a result, the user 3 can confirm the position of the gavel with the mirror 2, and thus can hide the gavel with makeup while looking at the mirror 2.

(Modification 3)
In the above-described embodiment, an example in which wrinkles are detected based on a captured image converted to high resolution by super-resolution processing has been described. However, super-resolution processing is performed using a high-resolution camera as the camera unit 10. Instead, the wrinkles may be detected based on the photographed image.

(Modification 4)
In the above-described projection processing, the projection may be performed when the user 3 is moving, and not when the user 3 is moving, but when the user 3 stops moving. For example, in the above-described remaining shaving notification process, the control device 30 detects a motion of the user 3 by performing a motion detection process using a known pattern matching or the like from an image captured by the camera unit 10. The control device 30 does not project an image that highlights wrinkles by the projector unit 20 even when a wrinkle is detected from the photographed image when a predetermined motion or more is detected, and emphasizes wrinkles when no movement is detected. An image to be displayed is projected by the projector unit 20. Thereby, for example, when the user 3 moves his hand to shave his beard, nothing is displayed, and when the user 3 stops his hand and confirms his face, he can highlight the beard.

(Modification 5)
In the projection processing described above, the projector unit 20 may be focused based on distance measurement information when the camera unit 10 focuses on the face of the user 3.

  Further, when the camera unit 10 and the projector unit 20 are arranged in the vicinity, the distance from the camera unit 10 to the face of the user 3 is substantially equal to the distance from the projector unit 20 to the face of the user 3. Therefore, in this case, the distance from the camera unit 10 to the face of the user 3 is detected based on the size of the face of the user 3 in the captured image, and the focus of the projector unit 20 is determined based on this distance. You may make it match.

  Furthermore, the focus position of the projector unit 20 may be changed according to the content of information to be projected. For example, when performing the makeup notification process, the makeup image is projected on the entire face, so that adjustment is made so that the entire face is in focus. Further, when performing the unshaved notification process, an image for emphasizing the eyelid is projected around the chin so that the chin is in focus.

(Modification 6)
You may make it perform the unpolished notification process which alert | reports the unpolished tooth. In the display device 1 of Modification 6, as shown in FIG. 5, a UV light source 70 for irradiating UV light (ultraviolet light) for detecting plaque adhering to the teeth is provided in the vicinity of the mirror 2. The UV light source 70 is arranged at a position where the UV light does not enter the eyes of the user 3. For example, when detecting the mouth and teeth of the user 3 from the image captured by the camera unit 10, the control device 30 according to the modified example 6 starts the unpolished notification process and applies UV light from the UV light source 70 to the detected teeth. The camera unit 10 takes a picture again. Since the reflection state when the UV light is irradiated is different between the teeth and the plaque, the control device 30 detects the plaque based on the reflection state of the UV light from the image taken by the camera unit 10. Then, the control device 30 causes the projector unit 20 to project an image that emphasizes the detected plaque position. As a result, the user 3 can confirm the position of the plaque with the mirror 2, so that the user 3 can brush his / her teeth so as to remove the plaque while looking at the mirror 2.

(Modification 7)
You may make it perform the process which alert | reports the clothes suitable for the user 3's complexion. In the modified example 7, a database that associates various face colors with clothes colors suitable for each face color is stored in the storage device 40. When the control device 30 detects the face color of the user 3 in the same manner as the makeup notification process described above, the control device 30 refers to this database and specifies the color of the clothes suitable for the detected face color. The projector unit 20 projects an image of the clothes of the specified color using the body of the user 3 as a projection plane. As a result, since the image of the clothes is superimposed on the body of the user 3 and displayed on the mirror 2, the user 3 can be informed of the clothes matching the complexion.

(Modification 8)
For example, you may make it perform the process which alert | reports the decoration suitable for portable terminals, such as a mobile telephone. It is assumed that the user 3 in this case has the portable terminal at a position where the portable terminal is reflected in the mirror 2 and can be photographed and projected by the camera unit 10 and the projector unit 20. When a portable terminal is detected from an image captured by the camera unit 10, the control device 30 performs a known super-resolution process on the detected image of the portable terminal to convert it to a high-resolution image. Detect scratches and discolored parts of mobile devices from the images. As a detection method, for example, an image of a portable terminal in a new state may be stored in the storage device 40 in advance, and detection may be performed based on the difference between this image and the high-resolution captured image. When a scratch or a discolored part of the mobile terminal is detected, the projector unit 20 projects a decoration image that makes the part inconspicuous using the mobile terminal as a projection plane. As a result, since the decoration image is superimposed on the mobile terminal and displayed on the mirror 2, the decoration suitable for the mobile terminal can be notified.

(Modification 9)
The projector unit 20 may be disposed on the back side of the mirror 2 as shown in FIG. In this case, as shown in FIG. 7, a mirror 2 having a high transmittance of light (RGB) having a wavelength emitted from the LED light source 203 of the projector unit 20 is used. Thereby, the projection light from the projector unit 20 passes through the mirror 2 and is projected onto the face of the user 3.

  Moreover, in the modification 9, it can project on a face more accurately by making the height which arrange | positions the projector part 20 close to the height of the user's 3 face. However, if the projector unit 20 is disposed in front of the face of the user 3, the user 3 looks directly at the projector unit 20 and becomes dazzling. Accordingly, the projector unit 20 is positioned at a position that is close to the height of the face of the user 3 but is not in front of the face of the user 3 (for example, a position projected from below the line of sight of the user 3 as shown in FIG. 6). Place. By doing so, although the projection light from the projector unit 20 is transmitted through the mirror 2, it is possible to make it difficult for the user 3 to see the projector unit 20 and to prevent dazzling.

  In FIG. 6, the projector unit 20 is arranged on the back side of the mirror 2, but the camera unit 10 may be arranged on the back side of the mirror 2, or both the camera unit 10 and the projector unit 20 are installed. It may be arranged on the back side of the mirror 2.

(Modification 10)
For example, the range covered by the user's 3 nose when viewed from the camera unit 10 cannot be photographed, but if the optical path between the camera unit 10 and the projector unit 20 is shifted, information is projected onto the uncaptured range. There is a case. In order to prevent this, the optical paths of the camera unit 10 and the projector unit 20 may be substantially matched.

  FIG. 8 is a diagram illustrating an example of the display device 1 according to the tenth modification. In FIG. 8, a mirror 80 is disposed in front of the camera unit 10, and a half mirror 90 is disposed in front of the projector unit 20. In the optical path of the projector unit 20, the projection light from the projector unit 20 passes through the half mirror 90 and is guided to the user 3. In the optical path of the camera unit 10, subject light from the user 3 is reflected by the half mirror 90 and guided to the mirror 80, and further reflected by the mirror 80 and guided to the camera unit 10. That is, in the optical path of the camera unit 10, the optical path from the user 3 to the half mirror 90 substantially matches the optical path of the projector unit 20. As a result, the projected image is also shielded for the range shielded at the time of photographing, so that information can be projected according to the situation detected by the camera unit 10, and information can be appropriately superimposed and displayed even for a three-dimensional object.

(Modification 11)
In the above-described embodiment, the example in which the information is superimposed and displayed on the image of the face of the user 3 reflected on the mirror 2 by projecting the information onto the face of the user 3 by the projector unit 20 has been described. However, information may be superimposed and displayed on the face image of the user 3 using a display instead of the projector unit 20.

  FIG. 9A shows a case where the transmissive display 120 is laminated on the front side of the mirror 2. The transmissive display 120 can display arbitrary information and transmits incident light from the outside by increasing the light transmittance of a portion (background) where information is not displayed. As the transmissive display 120, for example, a liquid crystal display, an organic EL display, an inorganic EL display, or the like can be used. In this case, the user 3 can see the image of the face of the user 3 reflected on the mirror 2 through the transmissive display 120. Therefore, by displaying information on the transmissive display 120, it is possible to display information superimposed on the face image of the user 3 as in the above-described embodiment.

  FIG. 9B shows a case where the display 220 is stacked on the back side of the half mirror 12. In this case, the display 220 may be a general display that can display arbitrary information. Part of the light incident on the half mirror 12 is reflected and part is transmitted. Therefore, the user 3 can visually recognize the face reflected on the half mirror 12 and can confirm the information displayed on the display 220 through the half mirror 12. Therefore, information can be superimposed and displayed on the face image of the user 3 as in the above-described embodiment.

(Modification 12)
In the above-described embodiment, the example in which the state of the user 3 (such as the face color and the health state) is detected based on the captured image photographed by the camera unit 10 has been described. You may make it detect the state of the user 3 using a detection means. For example, the health condition of the user 3 may be detected by measuring the body temperature of the user 3 using a temperature detection sensor or the like.

(Modification 13)
In the above-described embodiment, an example in which the temperature of the face surface of the user 3 is detected based on the infrared image captured by the camera unit 10 and the health condition of the user 3 is determined based on the detection result has been described. However, the health condition of the user 3 may be determined by this other method.

  For example, the face image of the user 3 at a normal body temperature is stored in advance in the storage device 40 as a template face image. When detecting the face of the user 3 from the image captured by the camera unit 10, the control device 30 reads the template face image from the storage device 40 and compares the face color of the image captured by the camera unit 10 with the face color of the template face image. As a result of this comparison, if the face color of the photographed image is reddish by a predetermined value or more than the face color of the template face image, it is determined that the user 3 is hot, and the text information and the redness of the face color indicating that are made inconspicuous. A makeup image is projected by the projector unit 20.

  In addition, when detecting the remaining shaving in the shaving notification process, the control device 30 compares the image taken by the camera unit 10 with the template face image read from the storage device 40, and based on this comparison result, You may make it detect the shavings left.

(Modification 14)
In the embodiment described above, an example in which the camera unit 10 and the projector unit 20 are provided separately has been described. However, the present invention may be applied to a camera with a projector in which the camera unit 10 and the projector unit 20 are integrated.

(Modification 15)
In the above-described embodiment, the example in which the camera unit 10 captures the user 3 facing the mirror 2 and detects the state of the user 3 based on the captured image has been described. However, the shooting direction of the camera unit 10 may be the direction in which the mirror 2 is shot. In this case, the camera unit 10 captures an image of the user 3 reflected on the mirror 2 and detects the state of the user 3 based on the captured image.

  Further, in the above-described embodiment, an example has been described in which the projector unit 20 projects various information on the face of the user 3 as a projection plane, thereby superimposing and displaying various information on the face of the user 3 reflected in the mirror 2. . However, the projection direction of the projector unit 20 may be the direction in which the mirror 2 is projected (that is, the projection light is emitted toward the mirror 2). In this case, the projector unit 20 may project various information on the face of the user 3 reflected in the mirror 2. Alternatively, the projector unit 20 may emit projection light toward the mirror 2 and the reflected light reflected by the mirror 2 may be projected onto the face of the user 3.

  Note that the shooting direction of the camera unit 10 may be the direction of shooting the mirror 2 and the projection direction of the projector unit 20 may be the direction of projecting the user 3. The shooting direction of the camera unit 10 may be the user 3. The direction in which the image is taken and the projection direction of the projector unit 20 may be the direction in which the mirror 2 is projected.

(Modification 16)
In the above-described embodiment, an example in which information is projected onto the face of the user 3 and the information is superimposed on the face of the user 3 reflected on the mirror 2 has been described. However, instead of the mirror 2, display means for displaying the image of the user 3 may be provided so that the information is superimposed on the image of the user 3 displayed on the display means.

  FIG. 10 is an external view of a camera with a projector 300 showing an example of the modification 16. 10A and 10B are perspective views of the projector-equipped camera 300 as viewed from the front, and FIGS. 10C and 10D are perspective views of the projector-equipped camera 300 as viewed from the rear. The internal configuration of the projector-equipped camera 300 is the same as the configuration shown in FIG. As shown in FIG. 10A, a photographing lens 310 and a projector projection window 320 are provided in front of the camera 300 with a projector. The camera unit 10 of the projector-equipped camera 300 performs shooting through the shooting lens 310. The projector unit 20 of the projector-equipped camera 300 performs projection via the projector projection window 320.

  As shown in FIG. 10B, a vari-angle monitor 330 is provided on the back surface of the projector-equipped camera 300. The vari-angle monitor 330 can be rotated about the rotation shaft 340 a by the hinge portion 340. Therefore, for example, as shown in FIGS. 10C and 10D, the vari-angle monitor 330 can be rotated so that the display surface 330 </ b> A of the vari-angle monitor 330 is directed forward. Therefore, as shown in FIG. 11, the user 3 can point the display surface 330A of the vari-angle monitor 330 toward himself / herself with the photographing lens 310 and the projector projection window 320 facing toward himself / herself. 10, the photographed image can be confirmed by the vari-angle monitor 330 while photographing itself.

  In the case of the modified example 16, the user 3 sets the camera with a projector 300 in the state shown in FIG. 11 in advance. The camera with a projector 300 images the user 3 by the camera unit 10 and detects the face state of the user 3 based on the captured image, as in the above-described embodiment. Then, the projector-equipped camera 300 projects information (such as makeup and unshaved items) according to the state of the face of the user 3 onto the face of the user 3 by the projector unit 20. Thereafter, the camera with a projector 300 again captures the face of the user 3 with the camera unit 10 and displays the captured image on the vari-angle monitor 330. At this time, since the above information is projected onto the face of the user 3 by the projector unit 20, the above information is superimposed on the image of the face of the user 3 and displayed on the vari-angle monitor 330. Thereby, the user 3 can visually recognize information suitable for the state of the face of the user 3 together with the image of the user 3.

  The above description is merely an example, and is not limited to the configuration of the above embodiment. Moreover, you may combine the structure of each modification suitably with the said embodiment.

DESCRIPTION OF SYMBOLS 1 ... Display apparatus, 2 ... Mirror, 3 ... User, 10 ... Camera part, 20 ... Projector part, 30 ... Control apparatus, 40 ... Memory | storage device, 70 ... UV light source, 120 ... Transmission type display, 300 ... Camera with a projector , 330 ... Vari-angle monitor

Claims (15)

State detection means for detecting the state of the object;
Display means for displaying information according to the state of the object detected by the state detection means so as to be seen superimposed on the object;
A display device comprising: The display device according to claim 1,
The state detection means detects a change state of the state of the object according to the passage of time,
The display device is characterized in that information to be displayed is changed in accordance with a change state of the state of the object detected by the state detection unit. The display device according to claim 1 or 2,
It further comprises imaging means for imaging the object,
The display device according to claim 1, wherein the state detection unit detects a state of the object based on an image captured by the imaging unit. The display device according to claim 3,
The state detection unit compares the image of the object stored in advance in the storage unit with the image captured by the imaging unit, and detects the state of the object based on the comparison result. Display device. The display device according to claim 3 or 4,
The state detection unit performs super-resolution processing on the image captured by the imaging unit, detects a detailed state of the object based on the image after the super-resolution processing,
The display unit displays information according to a detailed state detected by the state detection unit. The display device according to any one of claims 3 to 5,
The object is a person,
The imaging means images the person,
The state detection means detects the face state of the person based on the image picked up by the image pickup means,
The display means displays information corresponding to the state of the face of the person detected by the state detection means so that the information can be seen superimposed on the face or body of the person. . The display device according to claim 6,
The state detection unit detects a skin color of the face of the person based on an image captured by the imaging unit,
The display unit displays information according to the skin color of the face detected by the state detection unit. The display device according to claim 6 or 7,
Further comprising a light source for irradiating the predetermined portion of the person with ultraviolet light;
The imaging means images a predetermined portion of the person irradiated with the ultraviolet light,
The state detecting means detects a state of a predetermined portion of the person based on the captured image;
The display unit displays information according to a state of a predetermined portion of the person detected by the detection unit. In the display device according to any one of claims 3 to 8,
The display unit displays the information so that the information is seen superimposed on the object reflected in a mirror. The display device according to claim 9, wherein
The display device is a projector, and projects the information using the object as a projection plane. The display device according to claim 10.
The display device characterized in that the projector changes a focus position according to the content of the information to be projected. The display device according to claim 9, wherein
The display device, wherein the display means is a transmissive display disposed on the front side of the mirror. In the display device according to any one of claims 3 to 8,
The display unit displays the information so as to be superimposed on an image of the object imaged by the imaging unit. State detection means for detecting the state of the subject;
Projecting means for projecting information corresponding to the state of the subject detected by the state detecting means onto the subject;
With
The state detection means detects a change state of the state of the subject,
The projection unit changes projection information according to a change state of the state of the subject detected by the state detection unit. The projection device according to claim 14, wherein
It further comprises an imaging means,
The projection apparatus, wherein the state detection unit detects a change in the state of the subject based on an image captured by the imaging unit.

Images