WO2017183513A1

WO2017183513A1 - Mirror display device

Info

Publication number: WO2017183513A1
Application number: PCT/JP2017/014775
Authority: WO
Inventors: 橋本淳邦; 笹木隆一郎
Original assignee: アイシン精機株式会社
Priority date: 2016-04-20
Filing date: 2017-04-11
Publication date: 2017-10-26
Also published as: JP2017195491A

Abstract

The present invention provides a feature with which it is possible to obtain additional information that is convenient for a user without the need for switching between mirror image display and video display. Accordingly, a mirror display device is provided with: a mirror having a thin-film part that includes a reflection coating that reflects light on one surface of a tabular mirror body that transmits light and having a pinhole array in which minuscule through-holes through which light passes to the thin-film part are arranged in a planar row; and a display device in which the display surface thereof for displaying a display image is arranged facing the thin-film part. In the mirror display device, a pinhole image based on the display image is superposed on a mirror image that is reflected in the mirror.

Description

Mirror display device

The present invention relates to a mirror display device including a mirror and a display device.

For example, in the following Non-Patent Document 1, a rearview mirror installed in a vehicle interior is provided with a liquid crystal monitor, and a normal mirror image and a camera image drawn on the liquid crystal monitor are switched and displayed. A room mirror device is shown. On the liquid crystal monitor, a scene behind the vehicle photographed by a camera (Rear Camera) provided at the rear of the vehicle is drawn. The visibility of the rearview mirror is reduced, such as when the visibility is blocked by passengers or luggage in the passenger compartment, or when the rain drops and the water drops on the back window or glare when the sun is low May decrease. By drawing an image captured by the camera on the liquid crystal monitor provided in the room mirror, a good rear view can be obtained even when the visibility is thus lowered.

However, the viewpoint of the image taken by the camera is the installation position of the camera, not the driver's viewpoint, so the driver may feel uncomfortable. Further, in general, it is possible to superimpose additional information based on an image (including character imaging) on a captured image by a camera, but such additional information may be superimposed on a mirror image reflected in a mirror. Have difficulty. For example, when the above-described room mirror device displays a camera image, such additional information can be superimposed, but when the room mirror device displays a normal mirror image, such a case is possible. It is difficult to superimpose additional information. Considering the convenience of the user, it is preferable that additional information can be obtained as needed without switching the usage mode (mirror image display and camera video display) of the room mirror device.

In view of the above background, there is a demand for a technology that can obtain additional information that is convenient for the user without switching between mirror image display and video display.

In one aspect of the mirror display device in view of the above, a thin film portion including a reflective film that reflects light is provided on one surface of a plate-like mirror main body that transmits light, and the thin film portion has light. A mirror provided with a pinhole array in which fine through-holes that pass through are arranged in a plane, a display device in which a display surface for displaying a display image is arranged facing the thin film portion, And a pinhole image based on the display image is superimposed on a mirror image reflected on the mirror.

Since the holes forming the pinhole array are fine through holes, the influence on the mirror image is suppressed. For example, when a display image is not displayed on the display device, a person (user) viewing the mirror display device can use it as a mirror in which a normal mirror image is reflected without feeling uncomfortable. On the other hand, when another image is superimposed on the mirror image, the pinhole image based on the display image can be appropriately viewed by the user through each fine through hole. That is, according to this configuration, it is possible to superimpose a pinhole image, which is another image, on the mirror image while maintaining a normal mirror image reflected in the mirror. Moreover, since the pinhole array is formed in the thin film portion and does not have a structural influence on the mirror main body portion, a decrease in the strength of the mirror is also suppressed. Thus, according to this configuration, another image can be superimposed on the mirror image reflected in the mirror to provide a composite image.

Here, it is preferable that the display image is an image generated based on the viewpoint of the user.

画像 The image that appears along with the mirror image on the mirror surface through the fine through-hole differs depending on the viewpoint. Therefore, when a display image corresponding to the viewpoint of the user is generated, an appropriate pinhole image can be superimposed on the mirror image without causing the user to feel uncomfortable.

Here, the mirror image is an image of an imaginary light field that is a visible space based on the viewpoint of the user, and the pinhole image is formed on the retina of the user via the pinhole array. It is preferable that the display image is generated so that the pinhole light field is a visible space corresponding to a viewpoint in the imaginary light field.

In recent years, various displays have been researched and developed based on the concept of light fields. The light field refers to a visible space that includes all light (visible light) within the field of view of an observer (synonymous with a user of a mirror display device). The imaginary light field (image reflected in the mirror, mirror image) reproduced by the mirror changes according to the viewpoint, as is well known. For this reason, for example, even if an image is drawn at a fixed coordinate on the mirror surface in an attempt to superimpose another image on a specific position of the image (mirror image) reflected in the mirror, the position of the other image in the mirror image is determined by the observer (use Change depending on the person's perspective. The pinhole light field reproduced through the pinhole array by the observer (user) also changes according to the viewpoint. When the image of the imaginary light field and the image of the pinhole light field are visible from the same viewpoint, the images of both light fields are observed in an overlapping manner. Therefore, it is preferable that the display image is generated so that the pinhole light field becomes a visible space corresponding to the viewpoint in the imaginary light field.

Here, it is preferable that the display image is an image generated on the basis of an image captured by a camera that captures an image corresponding to the mirror image.

For example, an object (object) or landscape that the user wants to confirm with a mirror image may be difficult to see due to an obstacle existing between the object or landscape and the mirror. For example, if the camera is installed at a position where an object or landscape can be photographed without being affected by such an obstacle, an image of the object or landscape is superimposed on a mirror image as a display image, for example, The object and scenery can be shown to the user as if the object is transmitted. That is, the mirror image can be complemented based on the image taken by the camera. In addition, a display image can be generated by superimposing a pinhole image corresponding to the size and position of the object in the mirror image by image recognition on the captured image. In this manner, by generating a display image based on the captured image, more appropriate information can be provided to the user.

Here, it is preferable that the pinhole image is an emphasis display for emphasizing an object included in the mirror image and the captured image.

The object in the captured image can be recognized by performing image processing on the captured image. By superimposing the display image on the mirror image so that the target object is emphasized in the mirror image, information regarding the target object can be provided more clearly to the user.

Here, it is preferable that the display device displays the highlighted display in a different display form based on a distance from the object.

According to this configuration, for example, when the object is present nearer than in the case where the object exists far away, the display is emphasized with a higher visibility so that the user can quickly notice the presence of the object. Display can be made. In contrast, a display mode that displays a partially enlarged image so that a specific part of the object can be visually recognized more clearly when the object exists farther than when the object exists nearby. You can also highlight. According to this configuration, it is possible to perform highlighting by different methods based on the distance to the target object according to the type of the target object and the type of information desired to be notified to the user. That is, according to this structure, the information regarding a target object can be provided to a user more appropriately.

Here, it is preferable that the pinhole array is configured such that a plurality of pinholes are arranged in a rectangular shape or a staggered lattice shape in the thin film portion.

Here, it is preferable that the mirror display device is mounted on a vehicle, and the pinhole image is surrounding information or alert information of the vehicle.

Further features and advantages of the present invention will become clear from the following description of embodiments of the present invention described with reference to the drawings.

These are typical sectional views showing an example of composition of a mirror display device. These are figures which show the example of arrangement | positioning of the pinhole in a pinhole array. These are explanatory drawings which show the relationship between a viewpoint and the image via a pinhole. FIG. 2 is a schematic perspective view of a driver's seat of a vehicle. These are typical side views which show the visual field of a rear mirror and a rear camera. These are typical side views which show the principle of ranging by a distance sensor. FIG. 3 is a schematic block diagram of a display device and a peripheral device. These are figures which show typically an example of the visual information obtained from a mirror display apparatus. These are figures which show typically an example of the visual information obtained from a mirror display apparatus. These are figures which show the other example of arrangement | positioning of the pinhole in a pinhole array. These are figures which show typically the other example of the visual information obtained from a mirror display apparatus.

Hereinafter, an embodiment of a mirror display device will be described with reference to the drawings, taking as an example a case of applying to a rear mirror of a vehicle. The rear mirror includes a room mirror provided in the vehicle interior, a door mirror provided outside the front seat door, a fender mirror provided in the front fender portion of the vehicle, and the like. In this embodiment, a rearview mirror will be exemplified and described.

FIG. 1 is a schematic cross-sectional view illustrating a configuration example of the mirror display device 10. As shown in FIG. 1, the mirror display device 10 includes a mirror 1 and a display device 7. The mirror 1 is provided with a thin film portion 3 including a reflective film (silver film 31) that reflects light on one surface of a plate-like mirror main body 2 that transmits light. In the present embodiment, the thin film portion 3 includes a silver film 31, a copper film 32, and a protective paint film 33. The mirror main body 2 is a glass plate or an acrylic plate having a thickness of about several hundred micrometers to several millimeters. On one surface of these glass plates and acrylic plates, silver is plated to form a reflective film (silver film 31) having a thickness of several tens of nanometers. Since a coating material or the like as a protective material cannot be applied to the silver film 31, copper is generally plated on the silver film 31 to form a copper film 32. The copper film 32 is generally thinner than the silver film 31. Then, for example, a resin paint is applied on the copper film 32 to form a protective paint film 33. The protective paint film 33 is also generally thinner than the silver film 31.

As shown in FIGS. 1 and 2, the thin film portion 3 is provided with a pinhole array 5 in which pinholes 4 (fine through holes) that transmit light are arranged in a plane. The diameter of each pinhole 4 (pinhole diameter φ1) is several tens of micrometers to several hundreds of micrometers. For example, when the pinhole diameter φ1 is about 100 [μm], the presence of the pinhole 4 can hardly be visually confirmed. Further, when the pinhole diameter φ1 is small, confirmation with the naked eye becomes more difficult, but the amount of transmitted light is also reduced. Accordingly, the size that the pinhole 4 cannot be visually recognized by the naked eye is set as a limit when the diameter is large, and the size that the light quantity for visually recognizing the pinhole image (described later) cannot be maintained is small. As a limit, it is preferable that the pinhole diameter φ1 is set.

FIG. 2 shows an arrangement example of the pinholes 4 in the pinhole array 5. Here, the pinholes 4 are arranged in a rectangular shape with a first pitch G1 (horizontal pitch) in the illustrated horizontal direction and a second pitch (vertical pitch) in the illustrated vertical direction. The ideal pinhole 4 has a smooth edge and an almost perfect circle. As processing methods for forming the pinhole 4, there are various methods such as machining and laser processing. The pinhole 4 is not formed in the mirror main body 2 such as a glass plate or an acrylic plate. For this reason, the formation of the pinhole 4 in the thin film portion 3 is a femtosecond laser (Femto Second Laser), which is one of the ultrashort pulse lasers with high peak energy intensity of the irradiated light and suitable for fine processing. It is preferable to carry out using Similarly to the manufacture of semiconductors, the thin film portion 3 having the pinhole 4 may be formed on the mirror body portion 2 by performing film formation (deposition), lithography (photo-resisting-patterning), etching (etching), or the like. .

As shown in FIG. 1, the display device 7 includes a display panel 8 that displays a display image, such as liquid crystal or organic EL, and a display control unit 9 that draws the display image on the display panel 8. The display device 7 is arranged so that the display surface 8a of the display panel 8 faces the thin film portion 3 with a predetermined gap D1. Specifically, the mirror 1 and the display device 7 are fixed to the housing 11 in a state where the display surface 8a and the thin film portion 3 face each other at a separation distance D1. On the mirror image reflected on the mirror 1, a set of partial pixel areas on the display surface 8 a that reach the user's eyes through each pinhole 4 is superimposed as a pinhole image. That is, the pinhole image based on the display image is superimposed on the mirror image reflected on the mirror 1.

Incidentally, as shown in FIG. 3, the pixel area of the display surface 8 a that enters the user's eyes through the pinhole 4 varies depending on the viewpoint P of the user. For example, when the user's eyes are the first viewpoint P1, the pixel indicated by a solid circle on the display surface 8a (not the minimum unit pixel based on the resolution of the display panel 8 but the size of the pinhole 4) And a pixel region corresponding to the viewing angle). On the other hand, when the user's eyes are the second starting point P2, the user perceives the pixels (same as above) indicated by broken-line circles on the display surface 8a. Thus, the pinhole image which is an image perceived by the user through the pinhole 4 (pinhole array 5) (image formed on the retina of the user) varies depending on the viewpoint P. Therefore, it is preferable that the display image that is the source (source image) of the pinhole image is an image generated based on the viewpoint P of the user. The user's viewpoint P is detected by the viewpoint detection device, and the display control unit 9 generates a display image based on the detection result.

In the present embodiment, as shown in FIG. 4, a viewpoint detection camera 20 that captures the face of the user H, particularly the eyes, is provided on the console of the vehicle, and the viewpoint detection camera 20 and the display device 7 display. The control unit 9 functions as a viewpoint detection device. The display control unit 9 detects the viewpoint of the user H based on the captured image of the viewpoint detection camera 20. The viewpoint of the user H is calculated from the orientation of the face, the position of the pupil in the eyes, and the like using face recognition technology. Here, the display controller 9 performs the viewpoint detection calculation. However, the viewpoint may be calculated by a control device different from the display device 7 and the result may be transmitted to the display device 7. In this case, the viewpoint detection camera 20 and the other control device function as a viewpoint detection device.

By the way, in recent years, various displays have been researched and developed based on the concept of a light field. The light field refers to a visible space including all light (visible light) within the field of view of the observer (synonymous with user H). For example, a display device that reproduces a light field is called a light field display, and is ideally a display device that reproduces all light (visible light) that enters the eyes of an observer. From this point of view, the mirror can be called a light field display, and the light field (image reflected in the mirror, mirror image) reproduced by the mirror is called an imaginary light field (virtual visible space). . As is well known, the imaginary light field changes depending on the viewpoint. For this reason, for example, even if an image is drawn at a fixed coordinate on the mirror surface in an attempt to superimpose another image on a specific position of the image (mirror image) reflected in the mirror, the position of the other image in the mirror image remains at the viewpoint of the observer It will change depending on.

Further, as shown in FIG. 3, the image (pinhole image) formed on the eyeball retina of the observer using the pinhole array 5 also differs depending on the viewpoint P of the observer. The light field reproduced through the pinhole array 5 by the eyes of the observer is referred to herein as a pinhole light field. Both the imaginary light field and the pinhole light field are images that change according to the viewpoint P of the observer. When the image of the imaginary light field and the image of the pinhole light field are visible from the same viewpoint P, the images of both light fields are observed in an overlapping manner. However, if the images in both light fields are not relevant, it is just annoying. In other words, if the image of the pinhole light field is an appropriate image according to the viewpoint P of the observer of the imaginary light field, another appropriate image can be superimposed on the mirror image.

The mirror display device 10 can superimpose a pinhole image based on the display image on the mirror image. Here, the display image is preferably an image generated based on an image captured by a rear camera (camera) that captures an image corresponding to a mirror image. The dash-dot line in FIG. 5 schematically shows the field of view of the imaginary light field of the mirror 1. Further, the broken line in FIG. 5 schematically shows the field of view taken by the rear camera 30. Since the rear camera 30 is fixed to the host vehicle 100, the relationship between the camera coordinate system that is the coordinate system of the captured image and the reference coordinate system (world coordinate system) based on the host vehicle 100 is known. The relationship between the camera coordinate system and the reference coordinate system is defined by position information (translation parameters) and attitude information (rotation parameters) of the camera coordinate system with respect to the reference coordinate system.

Similarly, since the mirror 1 is also fixed to the host vehicle 100, the mirror image coordinate system (mirror coordinate system) of the mirror 1 is also defined with respect to the reference coordinate system. In the case where the mirror display device 10 is a rear mirror (a room mirror, a side mirror, a fender mirror, etc.) of the vehicle as in the present embodiment, the direction of the mirror surface can often be changed. Similarly to the camera coordinate system, the mirror coordinate system is defined by position information (translation parameter) and attitude information (rotation parameter) of the mirror coordinate system with respect to the reference coordinate system. Changing the direction of the mirror surface mainly changes the posture information (rotation parameter). Therefore, for example, it is preferable to provide an orientation sensor (not shown) to define the mirror coordinate system.

The viewpoint P of the observer (user H) is detected based on the captured image of the viewpoint detection camera 20 as described above with reference to FIG. Since the viewpoint detection camera 20 is also fixed to the host vehicle 100, this viewpoint P can also be defined with respect to the reference coordinate system.

That is, in the same coordinate system (reference coordinate system), the imaginary light field and the pinhole light field can be matched with the viewpoint P of the same observer, so that the images in both light fields are appropriately superimposed. Can do. For example, as shown in FIG. 5, the other vehicle 200 is included in both the image in the mirror coordinate system and the image in the camera coordinate system. For example, the coordinates of the other vehicle 200 in the camera coordinate system can be specified by image processing on the captured image in the camera coordinate system. Since the relationship between the camera coordinate system and the reference coordinate system is known, the coordinates of the other vehicle 200 in the reference coordinate system can also be specified. Furthermore, since the relationship between the reference coordinate system and the mirror coordinate system is known, the coordinates in the reference coordinate system can be applied to the coordinates of the mirror coordinate system. Therefore, the position of the other vehicle 200 can be specified in the mirror coordinate system. For example, by generating a display image so that a pinhole image is superimposed on the coordinates in the mirror coordinate system, information on the other vehicle 200 is displayed so that the user H can visually recognize the vicinity of the other vehicle 200 in the mirror image. Can be provided.

Thus, the mirror image is an image of an imaginary light field that is a visible space based on the viewpoint P of the user H, and the pinhole image is formed on the retina of the user H via the pinhole array 5. It is preferable that the display image is generated so that the pinhole light field is a visible space corresponding to the viewpoint P in the imaginary light field. Note that, here, an example of conversion from the camera coordinate system to the mirror coordinate system via the reference coordinate system is illustrated, but the relationship between the camera coordinate system and the mirror coordinate system is also defined based on the relationship with the reference coordinate system. I can keep it. Therefore, the coordinates may be directly converted from the camera coordinate system to the mirror coordinate system.

In the case where the mirror display device 10 is a rear mirror of the vehicle as in the present embodiment, for example, as shown in FIG. 6, the other vehicle 200 approaching the host vehicle 100 from the rear, the host vehicle 100, It is also preferable to use a detection result obtained by a distance sensor 40 such as a laser radar that detects the distance. Details will be described later.

As shown in FIG. 7 schematically showing the relationship between the display device 7 and its peripheral devices, the display control unit 9 has an image generation unit 91 and a display panel driver 92. The image generation unit 91 is configured with a graphic controller, a microcomputer, a DSP (Digital Signal Processor), or the like as a core, and functions in cooperation with hardware and software (a program or the like). The image generation unit 91 generates a display image to be displayed on the display panel 8 using a captured image by the viewpoint detection camera 20, a captured image by the rear camera 30, and distance information with a rear object by the distance sensor 40. This display image is an image corresponding to the viewpoint P of the user H detected based on the image captured by the viewpoint detection camera 20. Naturally, when the user H moves his / her body and the viewpoint P moves, the display image also changes so as to follow the position corresponding to the viewpoint P. In consideration of slight movement of the viewpoint P, for example, a display image including an image corresponding to another viewpoint position such as the vicinity of the viewpoint P may be generated. Further, the camera has a second viewpoint detection camera for photographing the passenger on the passenger seat side, and generates a display image so that the same pinhole image can be seen from both the viewpoint P from the driver seat and the viewpoint P from the passenger seat. May be.

8 and 9 illustrate images of the mirror display device 10 viewed from the user H. Here, the pinhole image is a highlight display F for emphasizing a mirror image and an object (such as the other vehicle 200) included in the captured image of the rear camera 30. FIG. 8 shows an example in which when the other vehicle 200 exists behind the host vehicle 100, the highlight display F (first highlight display F1) indicating the presence of the other vehicle 200 is superimposed on the mirror image of the mirror 1. Yes. The presence of the other vehicle 200 is determined by, for example, the image generation unit 91 based on the image recognition processing for the captured image by the rear camera 30 or the distance information by the distance sensor 40. The size and position of the first highlight F1 are determined by the image generation unit 91 by the image recognition processing for the captured image by the rear camera 30.

The first highlight F1 is an image formed on the retina of the user H so as to be superimposed on a mirror image as a pinhole image. The image generation unit 91 converts the first emphasis display F1 so as to be an image on the display surface 8a corresponding to the viewpoint P of the user H detected based on the image captured by the viewpoint detection camera 20, and displays the display image. Is generated. The display panel driver 92 displays this display image on the display panel 8. The display image displayed on the display panel 8 is different from a general image, and it is difficult to recognize the display content by itself.

In the example shown in FIG. 8, the other vehicle 200 exists at a position relatively far from the host vehicle 100. Therefore, it is not highly necessary that the occupant (for example, the user H) of the host vehicle 100 quickly performs a driving operation such as giving up the course. Therefore, it is preferable that the first highlight display F1 is a highlight display to the extent that the other vehicle 200 is present, for example, by a green frame line. As described above, this frame line follows the position corresponding to the viewpoint P when the user H moves the body and the viewpoint P moves. The same applies to the frame lines exemplified with reference to FIG.

FIG. 9 shows an example in which when the other vehicle 200 further approaches the host vehicle 100, the highlight display F (second highlight display F2) for warning the approach of the other vehicle 200 is superimposed on the mirror image of the mirror 1. Yes. The approach of the other vehicle 200 is determined by, for example, the image generation unit 91 based on distance information from the distance sensor 40, a change speed (change rate) of the distance information, and the like. The size and position of the second highlight display F2 are determined by the image generation unit 91 by the image recognition process for the captured image by the rear camera 30, as in the first highlight display F1. The second highlight display F2 is also an image formed on the retina of the user H so as to be superimposed on the mirror image as a pinhole image. Therefore, the image generation unit 91 converts the second highlight display F2 so as to be an image on the display surface 8a according to the viewpoint P of the user H detected based on the captured image by the viewpoint detection camera 20. A display image is displayed on the display panel 8 via the display panel driver 92.

In the example illustrated in FIG. 9, the other vehicle 200 is considerably closer to the host vehicle 100 as compared to FIG. 8. Therefore, it is preferable that an occupant (for example, user H) of the host vehicle 100 quickly performs a retreat operation such as giving up the course. Therefore, it is preferable to perform highlighting that alerts (or warns) the approach of the other vehicle 200, for example, blinking a red frame. In this way, the display device 7 is based on the distance between the reference position (here, any position of the host vehicle 100) based on the installation location where the mirror display device 10 is installed and the object (for example, the other vehicle 200). It is preferable to display the highlight display in a different display form. In the present embodiment, the distance sensor 40 is installed in the rear door and the rear bumper, and these positions where the distance sensor 40 is installed may be used as a reference position, or the rear end of the host vehicle 100 (for example, the bumper The last end) may be the reference position.

As described above, the mirror 1 in which the pinhole array 5 is provided in the thin film portion 3 including the reflection film (silver film 31) provided on one surface of the plate-like mirror main body 2 that transmits light. And the mirror display device 10 including the display device 7 disposed so that the display surface 8a faces the thin film portion 3 has a pinhole image based on the display image on the display surface 8a on the mirror image reflected on the mirror 1. Can be superimposed. As described above, the pinhole 4 having a pinhole diameter φ1 of about 100 [μm] is difficult to see. Therefore, for example, when the display panel 8 displays a black image or is turned off, the mirror display device 10 can be used as the simple mirror 1. On the other hand, when a display image that is a source image of a pinhole image is displayed on the display panel 8, it can be used as a mirror display device 10 in which the pinhole image is superimposed on the mirror image. Note that light passing through the pinhole 4 causes a diffraction phenomenon. Occurrence of the diffraction phenomenon is also affected by the pinhole diameter φ1, the angle of light entering the pinhole 4, and the like. Therefore, in the above description, the pinhole diameter φ1 of about 100 [μm] is exemplified, but it is preferable to set the pinhole diameter φ1 in consideration of diffraction within the range of about 30 to 100 [μm].

[Other Embodiments]
Hereinafter, other embodiments will be described. Note that the configuration of each embodiment described below is not limited to being applied independently, and can be applied in combination with the configuration of other embodiments as long as no contradiction arises. It should be noted that the embodiments disclosed herein, including the following description, are merely examples in all respects. Accordingly, various modifications can be made as appropriate without departing from the spirit of the present disclosure.

(1) In the above, with reference to FIG. 2, the pinhole 4 was arrange | positioned at rectangular shape and the form by which the pinhole array 5 was formed was illustrated. However, the pinhole array 5 may be arranged in a staggered pattern as shown in FIG.

(2) In the above, as shown in FIG. 1, the display surface 8a of the display panel 8 of the display device 7 and the thin film portion 3 of the mirror 1 are arranged to face each other with a gap of a separation distance D1. The form which has been illustrated was illustrated. However, although not shown, one micro convex lens (Micro Lens) corresponds to each pinhole 4 of the pinhole array 5 between the thin film portion 3 of the mirror 1 and the display surface 8 a of the display device 7. In this way, a microlens array in which the micro-convex lens is arranged may be provided. Each micro-convex lens condenses light from the display panel 8 in each corresponding pinhole 4. For this reason, the amount of light passing through each pinhole 4 is larger than when the microlens array is not provided, and the superimposed pinhole image becomes brighter and clearer.

Of course, it is also preferable to increase the luminance of the display device 7 without using such a micro-convex lens. In addition, since the optical system differs depending on the presence or absence of the microlens array, the viewing angle may differ. Therefore, based on the use of the mirror display device 10, the output (brightness, etc.) of the display device 7, and the structure of the mirror 1 (the transmittance of the mirror body 2 and the pinhole diameter φ1), the light quantity and the viewing angle are taken into consideration. It is preferable to determine the presence or absence of the microlens array and the separation distance D1.

(3) In the above, the viewpoint which detected the user's H viewpoint P and displayed the display image corresponding to the said viewpoint P on the display apparatus 7 was illustrated. However, as illustrated in FIGS. 8 and 9, in the case where it is not necessary to identify and emphasize the object (for example, the following vehicle) in the mirror image or the captured image of the rear camera 30, the viewpoint P is set. The display image may be displayed as a pinhole image superimposed on the mirror image without being specified. Needless to say, in this case, the position of the pinhole image superimposed on the mirror surface differs depending on the position of the viewpoint P. However, if the alert information is as shown in FIG. 11, for example, the alert icon W (W1, W2, W3), the object need not be specified. With the alert icon W, the user H can know that an event that requires attention has occurred, and can perform a retreat operation while looking at the mirror image. However, even in these cases (even if the position of the pinhole image is not specified with respect to the mirror image), both images are the same when the pinhole image is superimposed on the mirror image as viewed from the user H. It is an image of a viewpoint.

In addition, the display image in such a case is not limited to the alert icon W, but for example, a fueling icon (not shown) indicating that the amount of fuel has decreased, a clock icon (not shown) indicating the time, and the speed limit change. It may be a road information icon (not shown) indicating this. The road information icon is an example of vehicle periphery information.

(4) In the above, the form which displayed the display image based on the picked-up image by the back camera 30 on the display apparatus 7 was illustrated. However, for example, the display device 7 includes a front camera (not shown) in which the vehicle captures a scene in front of the vehicle, and a display image generated based on a captured image captured by the front camera is used as a pinhole image. It may be displayed superimposed on a mirror image. In the display image, for example, road signs and road markings included in an image captured by the front camera, or information on the surroundings of a vehicle such as a building or facility that is a destination or landmark (landmark) of a navigation system is displayed. It is preferable.

(5) In the above, the case where the mirror display device 10 is applied to the rear mirror of the vehicle has been described as an example. However, the mirror display device 10 can be applied not only to the rear mirror of the vehicle but also to other mirrors such as a mirror on a dressing table and a curved mirror on a road or a passage. For example, when the mirror display device 10 is applied to a mirror of a dressing table, a makeup simulation can be performed by superimposing lipstick or eye shadow color as a pinhole image. In addition, when the mirror display device 10 is applied to a curved mirror, when a person or the like approaches the curved mirror, an arrow indicating the traveling direction is displayed or the curved mirror is viewed from outside the mirror field of view. The presence / absence of a person or the like can be displayed.

(6) Moreover, the mirror display apparatus 10 provides a user (observer) with a different pinhole image according to the viewpoint P as mentioned above. As described above, it is possible to provide an image overlapping the mirror image in the same way at different viewpoints P, but it is also possible to provide different images at different viewpoints P as a matter of course. For example, different pinhole images may be shown to the user as the user moves in front of the mirror. In other words, a parallax (motion parallax) accompanying the user's motion may be used to show a pinhole image that changes according to the user's motion. For example, the mirror display device 10 can perform the following display when a pedestrian passes in front of a mirror that is long in the lateral direction. The mirror display device 10 displays, for example, “East Exit” with an arrow in the direction opposite to the traveling direction from the vicinity where the pedestrian approaches the mirror to the vicinity of the center, and after passing the vicinity of the center, Display “West Exit” with an arrow. That is, a closer “exit” can be guided according to the position of the pedestrian. As described above, the mirror display device 10 can perform more appropriate display using the parallax associated with the movement of the pedestrian.

Note that motion parallax is also used in an example in which the mirror display device 10 is applied to the above-described curve mirror. Specifically, when a person or the like approaches the curve mirror within a predetermined distance, an arrow indicating the direction of travel is displayed, but when the person is far from the predetermined distance, the curve mirror is displayed. Even if the mirror image can be visually recognized, such an arrow is not displayed. For example, it is also preferable to change the direction of the arrow according to the positional relationship between the curve mirror and the user.

(7) In the above, as illustrated in FIGS. 1 and 11, the case where the mirror 1 is a back surface reflecting mirror having a reflecting film (silver film 31) on the back surface side of the mirror body 2 is illustrated. However, the mirror 1 may be a surface reflecting mirror having a reflecting film on the surface side (mirror surface side) of the mirror body 2.

The present invention can be used for a mirror display device including a mirror and a display device.

1: Mirror 2: Mirror body part 3: Thin film part 4: Pinhole (fine through hole)
5: Pinhole array 7: Display device 8: Display panel 8a: Display surface 10: Mirror display device 31: Silver film (reflection film)
100: Own vehicle 200: Other vehicle (object)
F: Highlight display F1: First highlight display F2: Second highlight display H: User P: View point P1: First view point P2: Second start point W: Attention alert icon (attention alert information)

Claims

A thin film part including a reflective film that reflects light is provided on one surface of a plate-like mirror body part that transmits light, and fine through holes that transmit light are arranged in a plane in the thin film part. A mirror provided with a pinhole array,
A display surface on which a display image is displayed is disposed to face the thin film portion, and
A mirror display device in which a pinhole image based on the display image is superimposed on a mirror image reflected on the mirror.
The mirror display device according to claim 1, wherein the display image is an image generated based on a user's viewpoint.
The mirror image is an image of an imaginary light field that is a visible space based on the viewpoint of the user, and the pinhole image is a visible space that is imaged on the retina of the user via the pinhole array. The mirror display according to claim 2, wherein the display image is an image of a pinhole light field, and the display image is generated so that the pinhole light field is a visible space corresponding to a viewpoint in the imaginary light field. apparatus.
The mirror display device according to any one of claims 1 to 3, wherein the display image is an image generated based on an image captured by a camera that captures an image corresponding to the mirror image.
The mirror display device according to claim 4, wherein the pinhole image is a highlight display for emphasizing an object included in the mirror image and the captured image.
The mirror display device according to claim 5, wherein the display device performs the highlighting in a different display form based on a distance from the object.
The mirror display device according to any one of claims 1 to 6, wherein the pinhole array includes a plurality of pinholes arranged in a rectangular shape or a staggered lattice pattern in the thin film portion.
The mirror display device according to any one of claims 1 to 7, wherein the mirror display device is mounted on a vehicle and the pinhole image is surrounding information or alert information of the vehicle.