JP6697747B2 - Display system, electronic mirror system and moving body - Google Patents

Description

  The present disclosure relates generally to a display system, an electronic mirror system, and a moving body, and more particularly, to a display system, an electronic mirror system, and a moving body that display an image based on a captured image.

  BACKGROUND ART Conventionally, there is known an electronic mirror system including an image pickup device that picks up an image of the rear or side of a vehicle, and a display device that displays a video signal output from the image pickup device as an image (Patent Document 1). Here, the display device is installed inside the vehicle at a position where the driver can easily see the image on the display device. The display device is composed of a liquid crystal display or the like.

JP, 2009-83618, A

  In the electronic mirror system described in Patent Document 1, it is difficult for a person who sees the image displayed on the liquid crystal display to grasp the sense of distance to another vehicle or the like captured by the image capturing device.

  An object of the present disclosure is to provide a display system, an electronic mirror system, and a moving body in which a person who views an image to be displayed can easily grasp a sense of distance.

A display system according to one aspect of the present disclosure includes a display surface, a display mirror, and a display element. An image based on the captured image output from the camera is displayed on the display surface. The display mirror reflects the image displayed on the display surface. The display element is arranged on an optical path between the display surface and the display mirror. The display element displays, as a pattern image, at least a part of the structure of the moving body existing on the reflected light path of the display mirror, and displays the pattern image so as to overlap the image .
A display system according to one aspect of the present disclosure includes a display surface, a display mirror, and a display element. An image based on the captured image output from the camera is displayed on the display surface. The display mirror reflects the image displayed on the display surface. The display element is arranged on an optical path between the display surface and the display mirror. The display element displays at least a part of an object existing on the reflected light path of the display mirror as a pattern image. The display element includes a transparent plate having a first surface and a second surface opposite to each other in a thickness direction, and a pattern image formed on the first surface of the transparent plate and having the same shape as the pattern image. A first pattern image element which is a source of the pattern image, and a second pattern image element which is formed on the second surface of the transparent plate and has the same shape as the pattern image and is a source of the pattern image, The brightness distribution of the first pattern image element is different from the brightness distribution of the second pattern image element.
A display system according to one aspect of the present disclosure includes a display surface, a display mirror, and a display element. An image based on the captured image output from the camera is displayed on the display surface. The display mirror reflects the image displayed on the display surface. The display element is arranged on an optical path between the display surface and the display mirror. The display element displays at least a part of an object existing on the reflected light path of the display mirror as a pattern image. The display element has a transparent block and the pattern image formed in the transparent block.
A display system according to one aspect of the present disclosure includes a display surface, a display mirror, and a display element. An image based on the captured image output from the camera is displayed on the display surface. The display mirror reflects the image displayed on the display surface. The display element is arranged on an optical path between the display surface and the display mirror. The display element displays at least a part of an object existing on the reflected light path of the display mirror as a pattern image. The display system includes a DFD display including two image display panels, and a screen of an image display panel far from the display mirror of the two image display panels is the display surface, and an image close to the display mirror. A display panel is the display element.

  An electronic mirror system according to an aspect of the present disclosure includes the display system described above and a camera that outputs the captured image to the display system.

  A mobile body according to an aspect of the present disclosure includes the electronic mirror system described above and a mobile body main body on which the electronic mirror system is mounted.

  The present disclosure has an advantage that a person who views an image to be displayed can easily grasp a sense of distance.

FIG. 1 is a conceptual diagram of an automobile including the display system according to the first embodiment. FIG. 2 is a conceptual diagram showing the configuration of the above display system. FIG. 3A is a front view of a display element of the above display system. FIG. 3B is a side view of a display element of the above display system. FIG. 4 is a conceptual diagram illustrating the focus of the eyes of the user when the display system described above is used. FIG. 5: is a conceptual diagram explaining the position of the display mirror in the motor vehicle to which the display system same as the above is applied. FIG. 6 is a conceptual diagram showing the relationship between the visual field of the user of the display system and the virtual image of the image displayed on the display surface. FIG. 7A is a conceptual diagram showing the relationship between the visual field of the user of the display system and the virtual image of the image displayed on the display surface. FIG. 7B is a conceptual diagram of a relative positional relationship between the image in the display system and the image reflected by the display mirror. FIG. 8A is a conceptual diagram showing the relationship between the visual field of the user of the display system and the virtual image of the image displayed on the display surface. FIG. 8B is a conceptual diagram of a relative positional relationship between the image in the display system and the image reflected by the display mirror. FIG. 9A is a front view of the display element of the display system according to the first modified example of the first embodiment. FIG. 9B is a side view of a display element of the above display system. FIG. 9C is a rear view of a display element of the above display system. FIG. 10 is a conceptual diagram showing a display element of the display system according to the second modified example of the first embodiment. FIG. 11A is a conceptual diagram showing a state in which a pattern image is displayed on the display element of the display system according to the third modified example of the first embodiment. FIG. 11B is a conceptual diagram showing a state in which a pattern image is not displayed in the display system of the above. FIG. 12 is a conceptual diagram showing a display element of the display system according to the fourth modified example of the first embodiment. FIG. 13 is a conceptual diagram showing the configuration of the display system according to the fifth modified example of the first embodiment. FIG. 14 is a conceptual diagram showing an image reflected by the display mirror in the display system according to the sixth modified example of the first embodiment. FIG. 15 is a conceptual diagram showing the configuration of the display system according to the second embodiment.

  1 to 15 described in the following embodiments and the like are conceptual diagrams, and the size ratio and the thickness ratio of each component in the drawings do not always reflect the actual dimensional ratio. .

(Embodiment 1)
(1) Overview As shown in FIG. 1, the display system 10 according to the present embodiment is, for example, a system used for a vehicle 100 as a moving body.

  The display system 10 is mounted on a main body (moving body main body) 110 of an automobile 100. In the display system 10, when the image P1 based on the captured image is displayed on the display surface 21, the image reflected by the display mirror 3 (hereinafter, also referred to as a reflected image) P2 (see FIGS. 2 and 5) is displayed. It is visually recognized by the user 200 (driver of the automobile 100) who is the target person who looks at the mirror 3. The display mirror 3 is a front portion near the windshield 102 (windshield) in the ceiling portion 101 of the main body 110, and the user 200 seated on the front seat 103 comes into the view of the user 200 in a state of facing forward. It is located in the position (see FIG. 1). The captured image is output from a camera (imaging device) 90 that captures the rear of the automobile 100. The camera 90 is mounted on the main body 110 of the automobile 100. Since the user 200 views the reflection image P2 on the display mirror 3, the user 200 displays the image P1 on the display surface 21 in a space farther than the display mirror 3 with respect to his/her own eye (eyeball) 201. It looks as if they are (see Figure 3). In other words, it seems to the user 200 that the virtual image 300 (see FIG. 4) of the image P1 on the display surface 21 is displayed at a position in front of the automobile 100 in the direction in which the display mirror 3 is viewed from the user 200.

  By the way, in the electronic mirror system described in Patent Document 1, a driver of an automobile views a real image of an image displayed on a display device including a liquid crystal display. Therefore, for the driver, for example, the distance difference between the distance to the position where the eyes are focused when viewing the road conditions in front of the car and the distance to the position where the eyes are focused when viewing the image on the display device. Is large, the amount of focus adjustment is large and the time for focusing (focusing) is long.

  On the other hand, in the display system 10, as shown in FIG. 4, for the user 200, when viewing the road condition in front of the automobile 100, when viewing the distance L1 to the position where the eye 201 is focused and the virtual image 300. The distance difference ΔL from the distance L2 to the position where the eye 201 is focused becomes small. Therefore, in the display system 10, the focus adjustment amount of the user 200 can be reduced, and the focusing time of the user 200 can be shortened. Further, in the display system 10, even when the user 200 has difficulty in focusing on a relatively short distance due to old age, hyperopia, etc., the focus adjustment becomes easy.

  The display system 10 according to the present embodiment includes the display element 4 arranged on the optical path OP between the display surface 21 and the display mirror 3. Here, the display element 4 displays, as a pattern image PA1, a part of an object existing within the field of view of the display mirror 3 and outside the field of view FV9 (see FIG. 1) of the camera 90. Here, the display element 4 has a first surface 41 and a second surface 42, and light incident on the display element 4 through the first surface 41 is emitted from the display element 4 through the second surface 42. Is configured. Therefore, in the display system 10, the image P1 displayed on the display surface 21 and the pattern image PA1 displayed on the display element 4 appear to overlap with each other for the user 200 who looks at the display mirror 3. As a result, in the display system 10, the user 200 has a sense of distance from another vehicle or the like behind the vehicle 100 as compared with the case where the driver directly views the display device that displays the video signal output from the imaging device as an image. It has the advantage of being easy to grab.

(2) Configuration (2.1) Overall Configuration of Display System The display system 10 according to the present embodiment has a display unit (image) having a display surface 21 as shown in FIGS. 1, 2, 4, 6, 7A and 8A. The forming unit) 2, the display mirror 3, and the display element 4. In FIGS. 4, 6, 7A and 8A, the display element 4 is not shown. The display system 10 further includes a control unit that controls the display unit 2.

  The image P1 based on the captured image output from the camera 90 is displayed on the display surface 21. The camera 90 is not a component of the display system 10. The image sensor in the camera 90 is a CMOS (Complementary MOS) image sensor. The image pickup device is not limited to the CMOS image sensor, and may be, for example, a CCD (Charge Coupled Device) image sensor.

  The display unit 2 outputs light that forms an image. As shown in FIG. 2, the display unit 2 includes a liquid crystal panel 22 (LCD: Liquid Crystal Display) and a light source device 23. The liquid crystal panel 22 is arranged in front of the light source device 23. The light source device 23 is used as a backlight of the liquid crystal panel 22. The light source device 23 is a so-called surface light source. The light source device 23 is a side light type light source device using a solid-state light emitting element such as a light emitting diode or a laser diode. The light from the light source device 23 passes through the liquid crystal panel 22 and is output from the display surface 21 of the display unit 2. The light output from the display surface 21 (output light) is light that reflects the image displayed on the liquid crystal panel 22. In FIG. 2, a traveling path (optical path OP) of light output from one point (a certain pixel point) of the image P1 displayed on the display surface 21 of the display unit 2 is schematically illustrated.

  In the display system 10, the vertical direction of the liquid crystal panel 22 is the vertical direction of the reflection image P2, and the horizontal direction of the liquid crystal panel 22 is the horizontal direction of the reflection image P2. The vertical direction of the reflection image P2 is the vertical direction of the virtual image 300 (see FIG. 4), that is, the direction along the vertical direction in the visual field of the user 200. The horizontal direction of the reflection image P2 is the horizontal direction of the virtual image 300, that is, the direction along the horizontal direction in the visual field of the user 200.

  The control unit controls the display unit 2 (the liquid crystal panel 22 and the light source device 23). Here, the control unit acquires the captured image output from the camera 90 and causes the display unit 2 to display the image P1 based on the captured image. The captured image is an image generated by the camera 90 mounted on the rear portion of the automobile 100 capturing the rear of the automobile 100. As an example, the control unit causes the display unit 2 to display the acquired captured image as it is as the image P1. Here, the camera 90 is arranged at the center of the rear part of the automobile 100 in the left-right direction. As a result, the camera 90 can image a range behind the camera 90 (within the field of view FV9 of the camera 90). The display system 10 can be applied to the electronic mirror system 80. The electronic mirror system 80 includes the display system 10 and a camera 90 that outputs a captured image to the display system 10. The electronic mirror system 80 can be used as an inside mirror of the automobile 100.

  The control unit is composed of, for example, a microcomputer having CPU (Central Processing Unit) and memory as main components. In other words, the control unit is realized by a computer having a CPU and a memory, and the computer functions as the control unit when the CPU executes the program stored in the memory. Although the program is recorded in advance in the memory of the control unit here, it may be provided through an electric communication line such as the Internet or in a recording medium such as a memory card.

  The display mirror 3 is a concave mirror. The display mirror 3 includes, for example, a glass base material and a reflective film formed on the concave surface of the base material. The reflective film is, for example, a metal film.

  The display mirror 3 reflects the image P1 displayed on the display surface 21. The display mirror 3 in the display system 10 reflects only a partial area of the image P1 displayed on the display surface 21 as a reflection image P2.

  In the display system 10, as shown in FIG. 6, the size of the virtual image 300 with respect to the entire image P1 on the virtual plane in the space away from the user 200 is determined by the display mirror 3 and the visual field VF2 of the eye 201 of the user 200. The size of the display mirror 3 is determined so as to be larger than that. Here, in the display system 10, the size of the display mirror 3 is determined so that the outer peripheral line of the visual field VF2 is located inside the outer peripheral line of the virtual image 300 on the virtual plane. As a result, the display system 10 is configured such that the position of the reflection image P2 displayed as the virtual image 301 in the distance changes as the eye 201 of the user 200 (target person) who views the display mirror 3 moves. See Figures 7A, 7B, 8A and 8B). Here, the reflection image P2 has a smaller number of pixels than the image P1 in both the vertical direction and the horizontal direction of the image P1.

  Hereinafter, for convenience of description, the two eyes 201 of the user 200 may be referred to as a right eye 201R and a left eye 201L in order to distinguish them from each other. Further, in the following description of FIGS. 7A and 8A, “right side” means the right side as viewed from the user 200, and “left side” means the left side as viewed from the user 200. In the display system 10, when the size of the display surface 21 is predetermined, the radius of curvature of the display mirror 3 may be determined so that the size of the virtual image 301 is larger than the visual field VF2.

  FIG. 7A is a conceptual diagram when the midpoint of the straight line connecting the right eye 201R and the left eye 201L of the user 200 and the center of the display surface 21 are located within the plane of one vertical plane VP. FIG. 8A is a conceptual diagram when the midpoint of the straight line connecting the right eye 201R and the left eye 201L of the user 200 moves to the right from the position in FIG. 7A and the right eye 201R moves to the right end of the eye box 203. .. The “eye box 203” here is a range in which the user 200 can visually recognize the image without missing. More specifically, the “eye box 203” is a viewpoint range in which a part of the virtual image 300 is reflected in the entire visual field of the eye 201. In the display system 10, if the eye 201 of the user 200 is within the range of the eye box 203, the reflection image P2 falls within the image P1 as shown in FIGS. 7B and 8B.

  Further, as shown in FIGS. 7A and 8A, the virtual image 301 formed by reflecting a part of the image P1 by the display mirror 3 is a concave mirror of the comparative example, which is the entire image P1 displayed on the display surface 21. It becomes a part of the virtual image 300 formed when reflected by. Here, in FIG. 7A, the central portion of the entire virtual image 300 in each of the vertical direction and the horizontal direction becomes the virtual image 301 seen by the user 200.

  In FIG. 7A, the range of the virtual image 301 seen by the right eye 201R of the user 200 in the virtual image 300 is shown. The range of the virtual image 301 seen by the left eye 201L of the user 200 is plane-symmetric with the range of the virtual image 301 seen by the right eye 201R with reference to the vertical plane VP.

  As shown in FIG. 8A, when the midpoint of the straight line connecting the right eye 201R and the left eye 201L of the user 200 moves to the right as compared to the position shown in FIG. 7A, the range of the virtual image 301 seen by the right eye 201R of the user 200. Moves to the left. In FIG. 8A, the right eye 201R of the user 200 is located at the right end 203R of the eye box 203, and the left end 301L of the virtual image 301 seen by the right eye 201R of the user 200 matches the left end 300L of the virtual image 300.

  Contrary to FIG. 8A, when the midpoint of the straight line connecting the right eye 201R and the left eye 201L of the user 200 moves to the left as compared to the position shown in FIG. 7A, the range of the virtual image 301 seen by the left eye 201L of the user 200. Moves to the right. When the left eye 201L of the user 200 moves to the left end 203L of the eye box 203, the right end 301R of the virtual image 301 seen by the left eye 201L of the user 200 matches the right end 300R of the virtual image 300.

  Therefore, in the display system 10, when the user 200 moves his/her face in the left/right direction, the right eye 201R and the left eye 201R are moved along with the movement of the face of the user 200, as in the case where the user 200 looks at the conventional inside mirror of the automobile. The range of the virtual image 301 that can be seen at 201L changes. Here, if the right eye 201R and the left eye 201L of the user 200 are inside the eye box 203, the image is not seen as missing.

  Further, in the display system 10, even when the user 200 moves his/her face up and down, as with the case where the user 200 looks at the inside mirror, the right eye 201R and the left eye 201L respectively move with the movement of the face of the user 200. The range of the visible virtual image 301 changes. That is, if the face of the user 200 moves upward, the range of the virtual image 301 that can be seen by the right eye 201R and the left eye 201L moves downward, and if the face of the user 200 moves downward, the right eye 201R and The range of the virtual image 301 that can be seen by the left eye 201L moves to the upper side. Here, if the right eye 201R and the left eye 201L of the user 200 are inside the eye box 203, the image is not seen as missing.

  The display element 4 is arranged on the optical path OP between the display surface 21 and the display mirror 3. The display element 4 is an element that displays at least a part of an object existing within the field of view of the display mirror 3 and outside the field of view FV9 of the camera 90 as a pattern image PA1 (see FIGS. 2 and 3A). Here, at least a part of the object is the pillar 105 (see FIG. 1) of the automobile 100. The pillar 105 here is a window pillar diagonally behind the rear seat in the automobile 100. As an example, the pattern image PA1 includes two image portions PA11, an image portion PA12, and an image portion PA13. The two image portions PA11 correspond one-to-one to the two pillars 105 that are separated from each other on the left and right of the automobile 100. The image portion PA12 corresponds to the rear portion of the ceiling portion 101 (see FIG. 1) connected to the upper ends of the two pillars 105 of the automobile 100. The image portion PA13 corresponds to a portion connected to the lower ends of the two pillars 105 of the automobile 100. The pattern image PA1 is not limited to the example of FIG. 1, but may include, for example, two image portions PA11 that correspond to each of the at least two pillars 105 in a one-to-one relationship. The thickness of the image portion PA11 of the pillar 105 may be changed according to the vehicle type of the automobile 100, or may be thinner than the pillar 105 of the automobile 100.

The display element 4 has a transparent plate 40 and a pattern image PA1 as shown in FIGS. 3A and 3B. The transparent plate 40 has a rectangular plate shape and has a first surface 41 and a second surface 42 that are opposite to each other in the thickness direction. Each of the first surface 41 and the second surface 42 is flat. The first surface 41 and the second surface 42 are parallel to each other. In other words, the thickness of the transparent plate 40 is constant. The pattern image PA1 is formed on the first surface 41 of the transparent plate 40, but is not limited to this, and may be formed on the second surface 42 of the transparent plate 40. The pattern image PA1 is formed by a printing technique. In short, the pattern image PA1 is a printed film having a predetermined pattern.
The display element 4 is arranged near the display surface 21 on the optical path OP. The display element 4 is arranged so that the second surface 42 of the first surface 41 and the second surface 42 is on the display surface 21 side. On the optical path OP, the distance between the display element 4 and the display surface 21 is shorter than the distance between the display element 4 and the display mirror 3.

  The transparent plate 40 is made of, for example, glass and has transparency. Here, “having transparency” means that the transmittance for visible light is 50% or more, preferably 70% or more, 90% or more. The transparent plate is not limited to glass and may be made of a resin such as an acrylic resin.

  The display system 10 according to the present embodiment includes the display element 4 between the display surface 21 and the display mirror 3, so that the image P1 and the pattern image PA1 are displayed on the user 200 who views the display mirror 3. They appear to overlap (see the reflection image P2 in FIG. 2). As a result, in the display system 10, the image displayed by the display system 10 is different from the case where the driver directly looks at the display device that displays the video signal output from the imaging device as an image like the conventional electronic mirror system. There is an advantage that the user 200 who sees the (reflection image P2) can easily grasp the sense of distance to another vehicle behind by using the pattern image PA1 as a reference (mark).

  In the display system 10 including the display surface 21 on which the image P1 based on the captured image is displayed and the display mirror 3 that reflects the image P1 displayed on the display surface 21, the image P1 displayed on the display surface 21 The resolution is preferably higher than the limit resolution of the virtual image 300 at the display position of the virtual image 300. Here, the “limit resolution of the virtual image 300 at the display position of the virtual image 300” (hereinafter, simply referred to as “limit resolution”) is a value determined by the visual distance from the eye 201 of the user 200 to the virtual image 300 and the visual acuity of the user 200. The limit resolution is a limit value of the resolution with which the human eye can identify, and can be obtained based on, for example, the gap of the Landolt ring used for a visual acuity test. The longer the viewing distance, the lower the limit resolution. Further, the better the visual acuity of the user 200, the higher the limit resolution becomes. The limit resolution can be obtained from a predetermined calculation formula using the value of the visual distance from the eye 201 of the user 200 to the virtual image 300 and the value of the visual acuity of the user 200. In the display system 10 of the present embodiment, since the display mirror 3 magnifies and displays a part of the image on the display surface 21, if the limit resolution is determined, the resolution of the image P1 on the display surface 21 is determined according to the limit resolution. Is determined, and the resolution of the image P1 is set to a value higher than the limit resolution. If the resolution of the image P1 on the display surface 21 is determined in this way, the virtual image 300 having a resolution higher than the limit resolution is displayed at the display position of the virtual image 300, and the user 200 looking at the virtual image 300 looks at the mirror. You can feel the depth and stereoscopic effect of the virtual image 300 as you see. In particular, since the high-definition image moves as the vehicle 100 moves while the vehicle 100 is traveling, the user 200 can feel a more stereoscopic effect.

  In the display system 10, the housing 28 that houses the display unit 2, the display element 4, and the control unit is separate from the housing 38 that houses the display mirror 3, but the invention is not limited to this. For example, the display unit 2, the display element 4, the control unit, and the display mirror 3 may be housed in one housing.

(2.2) Operation of Electronic Mirror System The operation of the electronic mirror system 80 will be described.

  For example, when electric power is supplied from the battery of the automobile 100 to the electronic mirror system 80 and a control signal for starting operation of the electronic mirror system 80 is input from an ECU (Electronic Control Unit), the electronic mirror system 80 starts operating. ..

  For example, when a control signal is input to the control unit from the ECU of the automobile 100, the control unit causes the camera 90 to image the rear of the automobile 100 at a predetermined frame rate and acquires image data of a captured image from the camera 90.

  When the image data of the captured image is input from the camera 90, the control unit displays the image P1 based on the captured image on the display surface 21 of the display unit 2.

  A part of the image P1 displayed on the display surface 21 of the display unit 2 is reflected by the display mirror 3. As a result, the user 200 can visually recognize the reflection image P2 in which the image P1 and the pattern image PA1 overlap each other.

(3) Modifications Embodiment 1 is only one of various embodiments of the present disclosure. The first embodiment can be variously modified according to the design and the like as long as the object of the present disclosure can be achieved.

(3.1) First Modification A display system 10 according to a first modification includes a display element 4a (see FIGS. 9A, 9B, and 9C) having a configuration different from that of the display element 4 of the display system 10 of the first embodiment. This is different from the display system 10 of the first embodiment. The same components as those in the first embodiment are designated by the same reference numerals and the description thereof will be omitted as appropriate.

  The display element 4a includes a transparent plate 40, a first pattern image element 43, and a second pattern image element 44. The transparent plate 40 has a first surface 41 and a second surface 42 that are opposite to each other in the thickness direction. In the display element 4a, the first surface 41 is located on the display mirror 3 side and the second surface 42 is located on the display surface 21 side on the optical path OP.

  The first pattern image element 43 is formed on the first surface 41 of the transparent plate 40. The first pattern image element 43 has the same shape as the pattern image PA1 and is a source of the pattern image PA1. The second pattern image element 44 is formed on the second surface 42 of the transparent plate 40. The second pattern image element 44 has the same shape as the pattern image PA1 and is a source of the pattern image PA1. The first pattern image element 43 and the second pattern image element 44 are arranged so as to overlap each other in the thickness direction of the transparent plate 40.

  In the display element 4a, the brightness distribution of the first pattern image element 43 and the brightness distribution of the second pattern image element 44 are different.

  Of the first pattern image element 43 and the second pattern image element 44, the first pattern image element 43, which is closer to the display mirror 3 on the optical path OP, is used for display in an actual object corresponding to the pattern image PA1. The closer to the mirror 3, the brighter. On the other hand, of the first pattern image element 43 and the second pattern image element 44, the second pattern image element 44 farther from the display mirror 3 on the optical path OP is relative to the actual object corresponding to the pattern image PA1. The part farther from the display mirror 3 is brighter. In the display system 10, since the light from the display unit 2 enters the display element 4a and exits from the display element 4a, the luminance distribution of the first pattern image element 43 and the luminance distribution of the second pattern image element 44 are different from each other. .. In short, the display element 4a is a DFD (Depth-Fused 3-D) type display element. Therefore, the user 200 who looks at the display mirror 3 of the display system 10 can see the image more stereoscopically due to the illusion, and can more easily grasp the sense of distance to another vehicle or the like in the rear, for example.

(3.2) Second Modified Example A display system 10 according to a second modified example includes a display element 4b (see FIG. 10) having a configuration different from that of the display element 4 of the display system 10 of the first embodiment. This is different from the display system 10 of the first embodiment.

  The display element 4b has a transparent block 45 and a pattern image PA1 formed in the transparent block 45. The display element 4b is 3D crystal glass, the transparent block 45 is composed of crystal glass, and the pattern image PA1 is composed of a modified portion of crystal glass. The modified portion is formed by subjecting crystal glass to laser processing.

(3.3) Third Modified Example A display system 10 according to a third modified example includes a display element 4c (see FIGS. 11A and 11B) having a configuration different from that of the display element 4 of the display system 10 of the first embodiment. The point is different from the display system 10 of the first embodiment.

  The display element 4c is a transparent display. The transparent display is a display that can display the pattern image PA1 on a transparent screen. The transparent display is a transparent liquid crystal display, but is not limited to this, and may be, for example, an OLED display. The display element 4c is controlled by, for example, the control unit, and can be switched between a state in which the pattern image PA1 is displayed as shown in FIG. 11A and a state in which the pattern image PA1 is not displayed as shown in FIG. 11B.

(3.4) Fourth Modified Example A display system 10 according to a fourth modified example is different from the display system 10 of the first embodiment in that the display system 10 of the first embodiment includes a DFD display 6.

  The DFD display 6 is a display that utilizes the stereoscopic illusion phenomenon, and the DFD display 6 includes two image display panels 61 and 62. The DFD display 6 further includes a light source device 63. In the DFD display 6, the screen of the image display panel 61 (hereinafter, also referred to as the first image display panel 61) that is far from the display mirror 3 among the two image display panels 61 and 62 is the display surface 21. In the DFD display 6, the image display panel 62 (hereinafter, also referred to as the second image display panel 62) near the display mirror 3 is the display element 4d that displays the pattern image PA1. In short, the image P1 based on the captured image is displayed on the first image display panel 61. Further, the pattern image PA1 is displayed on the second image display panel 62.

  Each of the two image display panels 61 and 62 is a liquid crystal panel. The light source device 63 is used as a backlight for the two image display panels 61 and 62. The light source device 63 is a so-called surface light source. The two image display panels 61 and 62 and the light source device 63 of the DFD display 6 are controlled by the control unit.

(3.5) Fifth Modification A display system 10 according to a fifth modification is substantially the same as the display system 10 of the first embodiment, and the display element 4 displays the display surface 21 as shown in FIG. It differs from the display system 10 of the first embodiment in that it is rotatable between a first position on the optical path OP between the mirror 3 and the second position outside the optical path OP.

(3.6) Sixth Modification Example A display system 10 according to a sixth modification example is a camera 90 (first camera 90) that images the rear of the vehicle 100, a second camera that images the right rear of the vehicle 100, and the vehicle 100. An object such as a pillar of the automobile 100 is displayed so as to be superimposed on an image obtained by combining the captured images output from the respective third cameras that capture the left rear of the vehicle. FIG. 14 is an example of a conceptual diagram showing an image reflected by the display mirror in the display system 10 according to the sixth modification.

(3.7) Other Modifications Hereinafter, modifications other than the first modification to the sixth modification of the first embodiment will be listed.

  The display unit 2 is not limited to the configuration including the liquid crystal panel 22 and the light source device 23. The display unit 2 may be configured to draw an image on the screen by scanning the diffuse transmission screen with laser light from behind the screen, for example. Further, the display unit 2 may be configured to project an image on a diffuse transmission screen from behind the screen by a projector. Further, the display unit 2 may be a self-luminous display panel including an OLED (Organic Light Emitting Diode) or the like.

  The image based on the captured image is not limited to the captured image itself, and may be, for example, an image obtained by performing image processing on the captured image or a CG (Computer Graphics) image created based on the captured image. For example, since the image captured by the camera 90 becomes dark at night, the image based on the captured image may be an image obtained by performing brightness correction on the image captured by the camera 90. The image based on the captured image may be an image in which an obstacle is extracted from the image captured by the camera 90 and a CG (Computer Graphics) image indicating the obstacle is superimposed on the captured image.

  In the display system 10, the number of pixels in the vertical direction of the reflected image P2 is smaller than the number of pixels in the vertical direction of the image P1, and the number of pixels in the horizontal direction of the reflected image P2 is smaller than the number of pixels in the horizontal direction of the image P1. However, it is not limited to this. For example, in the display system 10, the number of pixels in one of the vertical direction and the horizontal direction of the reflected image P2 may be smaller than the number of pixels in the corresponding direction (vertical direction or horizontal direction) in the image P1.

  Further, in the display system 10, the pattern image PA1 of the display element 4 may be a translucent printed film. This reduces the blind spot for the user 200 who views the display mirror 3.

  The display system 10 may include a DFD display instead of the display element 4. The DFD display is a display that utilizes a stereoscopic illusion phenomenon. In this case, the DFD display has a first liquid crystal panel arranged on the display mirror 3 side on the optical path OP and a second liquid crystal panel arranged on the display surface 21 side. Here, an image including the first pattern image element having the same brightness distribution as the first pattern image element described in the first modification is displayed on the first liquid crystal panel. An image including the second pattern image element having the same brightness distribution as the second pattern image element described in the first modification is displayed on the second liquid crystal panel.

  Further, in the display system 10, the display element 4 is arranged parallel to the display surface 21, but the upper side of the display element 4 may be arranged farther from the display surface 21 than the lower side. As a result, the user 200 who views the display system 10 can see a stereoscopic image as compared with the case where the display element 4 is arranged parallel to the display surface 21.

  Further, although the display element 4 has a configuration in which the pattern image is formed on the flat plate, it may be a three-dimensional structure. As a result, the user 200 viewing the display system 10 can see a stereoscopic image as compared with the case where the display element 4 is a pattern image on a flat plate.

  Further, in the automobile 100, the camera 90 may be arranged on the rear side of the automobile 100 so as to capture an image in a range visible by a conventional door mirror or fender mirror. In this case, the electronic mirror system 80 may be used as a rear confirmation mirror instead of the conventional door mirror or fender mirror.

  Further, the moving body to which the electronic mirror system 80 is applied is not limited to the automobile 100. For example, the electronic mirror system 80 can be applied to a moving body other than the automobile 100 such as a motorcycle, a train, an aircraft, a construction machine, and a ship. In short, the main body of the moving body is not limited to an automobile vehicle, but may be a main body of a moving body other than the automobile 100 such as a motorcycle, a train, an aircraft, a construction machine, and a ship. Furthermore, the electronic mirror system 80 is not limited to a mobile body, and may be used in, for example, an amusement facility, a medical facility, or the like.

(Embodiment 2)
As shown in FIG. 15, the display system 10g according to the present embodiment is different from the first embodiment in that the display system 10g includes a mirror 7 arranged on the optical path P1 between the display surface 21 and the display mirror 3. The display system 10 is different. Hereinafter, the same components as those in the first embodiment will be denoted by the same reference numerals and the description thereof will be appropriately omitted.

  The mirror 7 is configured to reflect the image P1 from the display surface 21 side to the display mirror 3 side. The display element 4, the mirror 7, and the display mirror 3 are disposed on the optical path OP (the optical path of the light output from the display surface 21) between the display surface 21 and the display mirror 3 by the display element 4, the mirror 7, and the display. The mirrors 3 are arranged in this order.

  That is, the mirror 7 is on the side opposite to the light source device 23 as viewed from the liquid crystal panel 22, that is, in front of the liquid crystal panel 22, so that light from the display surface 21 (hereinafter, also referred to as output light) enters through the display element 4. It is located in. The mirror 7 reflects the output light from the display surface 21 side toward the display mirror 3. The display mirror 3 is arranged at a position where the output light of the display surface 21 reflected by the mirror 7 enters. The display mirror 3 reflects the output light of the display surface 21 reflected by the mirror 7 toward the eye 201 of the user 200.

  The mirror 7 is a plane mirror. The mirror 7 includes, for example, a glass base material and a reflective film formed on the surface of the base material and made of a metal film or the like. Therefore, in the mirror 7, the output light from the display surface 21 is reflected by the surface of the reflective film.

  In the display system 10g of the present embodiment, the display unit 2, the mirror 7, and the display mirror 3 are arranged at the vertex positions of the triangle formed in the vertical plane. The “vertical plane” here is a plane including the vertical direction (vertical direction) of the image displayed by the display unit 2 and the traveling direction (optical axis) of the output light. In the display system 10g, the output light from the display surface 21 is first reflected by the mirror 7 and then by the display mirror 3.

  Therefore, in the display system 10g of the present embodiment, the output light from the display surface 21 is reflected twice. In a modified example of the display system 10g, the number of mirrors 7 may be increased so that the output light from the display surface 21 is reflected three times or more. In short, the display system 10g may be configured to reflect the output light from the display surface 21 multiple times. Here, the optical path length between the display surface 21 and the eye 201 of the user 200 is related to the distance between the projection position of the virtual image 300 seen by the eye 201 of the user 200 and the eye 201 of the user 200. Therefore, in the display system 10g, the distance from the eye 201 of the user 200 to the projection position of the virtual image 300 can be increased by reflecting the output light from the display surface 21 multiple times.

  Further, in the display system 10g, the display unit 2, the control unit, the display mirror 3 and the mirror 7 are housed in one housing 35. In the display system 10g, for example, if the distance from the eye 201 of the user 200 to the virtual image 300 is the same as that of the display system 10 of the first embodiment, it is possible to reduce the size of the display system 10g.

  The display system 10g may have an optical component (for example, a lens) other than the mirror 7 on the optical path OP between the display surface 21 and the display mirror 3.

  The configuration (including the modification) of the display system 10g according to the second embodiment can be appropriately combined with the configurations of the first modification to the sixth modification of the first embodiment.

(Summary)
As described above, the display system (10; 10g) according to the first aspect includes the display surface (21), the display mirror (3), the display element (4; 4a; 4b; 4c; 4d). , Is provided. The image (P1) based on the captured image output from the camera (90) is displayed on the display surface (21). The display mirror (3) reflects the image (P1) displayed on the display surface (21). The display elements (4; 4a; 4b; 4c; 4d) are arranged on the optical path (P1) between the display surface (21) and the display mirror (3). The display element (4) displays, as a pattern image (PA1), at least part of an object existing within the field of view of the display mirror (3) and outside the field of view (FV9) of the camera (90).

  According to this configuration, the image (P1) and the pattern image (PA1) appear to be stereoscopically overlapped with each other by the subject who views the display mirror (3). As a result, in the display system (10; 10g), the display system (10; 10g) is different from the case where a person directly views the display device that displays the video signal output from the imaging device as an image, as in the conventional electronic mirror system. There is an advantage that a person who views the image displayed by 10 g) can easily perceive a sense of distance with the pattern image (PA1) as a reference (mark).

  In the display system (10; 10g) which concerns on a 2nd aspect, a display element (4) has a transparent plate (40) and a pattern image (PA1) in a 1st aspect. The transparent plate (40) has a first surface (41) and a second surface (42) that are opposite to each other in the thickness direction. The pattern image (PA1) is formed on one of the first surface (41) and the second surface (42).

  According to this structure, the display element (4) can be realized with a relatively simple structure.

  In a display system (10; 10g) according to a third aspect, in the first aspect, the display element (4a) includes a transparent plate (40), a first pattern image element (43), and a second pattern image element. (44) and The transparent plate (40) has a first surface (41) and a second surface (42) that are opposite to each other in the thickness direction. The first pattern image element (43) is formed on the first surface (41) of the transparent plate (40). The first pattern image element (43) has the same shape as the pattern image (PA1) and is a source of the pattern image (PA1). The second pattern image element (44) is formed on the second surface (42) of the transparent plate (40). The second pattern image element (44) has the same shape as the pattern image (PA1) and is a source of the pattern image (PA1). The brightness distribution of the first pattern image element (43) and the brightness distribution of the second pattern image element (44) are different.

  According to this configuration, a person who looks at the display mirror (3) of the display system (10, 10g) can see the image more stereoscopically and more easily grasp the sense of distance due to the illusion.

  In the display system (10; 10g) which concerns on a 4th aspect, a display element (4b) is a transparent block (45) and the pattern image (PA1) formed in the transparent block (45) in a 1st aspect. And have.

  According to this configuration, there is an advantage that deterioration of the image quality due to stains, scratches, etc. of the pattern image (PA1) can be reduced.

  In the display system (10; 10g) according to the fifth aspect, in the first aspect, the display element (4c) is a transparent display.

  According to this configuration, it is possible to reduce the deterioration of the image quality due to stains and scratches on the pattern image (PA1), and the advantage that the display of the pattern image (PA1) can be eliminated if necessary. There is an advantage that the pattern image (PA1) can be easily changed.

  The display system (10; 10g) which concerns on a 6th aspect is equipped with the DFD display (6) containing two image display panels (61, 62) in a 1st aspect. Of the two image display panels (61, 62), the screen of the image display panel (61) far from the display mirror (3) is the display surface (21), and the image display panel (62) close to the display mirror (3). ) Is a display element (4d).

  According to this configuration, there is an advantage that the display of the pattern image (PA1) can be eliminated as necessary, and that the pattern image (PA1) can be easily changed.

  In the display system (10; 10g) according to the seventh aspect, in any one of the first to sixth aspects, the display mirror (3) is a concave mirror.

  According to this configuration, a person who looks at the display mirror (3) of the display system (10; 10 g) can see the image more stereoscopically and can see the distance more than when the display mirror (3) is a flat mirror. It is easier to get a feel.

  An electronic mirror system (80) according to an eighth aspect is a display system (10; 10g) according to any one of the first to seventh aspects, and a camera (90) that outputs a captured image to the display system (10; 10g). ), and.

  According to this configuration, the display system (10; 10g) displays the image as compared with the case where the person directly views the display device that displays the image signal output from the image pickup device as an image like the conventional electronic mirror system. There is an advantage that a person who views the image can easily grasp the sense of distance.

  A mobile body according to the ninth aspect (for example, the automobile 100) includes an electronic mirror system (80) according to the eighth aspect and a mobile body (for example, a main body 110 of the automobile 100) on which the electronic mirror system (80) is mounted. ), and.

  According to this configuration, there is an advantage that a person viewing an image displayed by the display system (10; 10g) of the electronic mirror system (80) can easily grasp the sense of distance.

  A display system (10; 10g) according to a tenth aspect reflects a display surface (21) on which an image (P1) based on a captured image is displayed and an image (P1) displayed on the display surface (21). And a display mirror (3). The resolution of the display surface (21) is higher than the limit resolution of the image displayed at a predetermined display position by the display mirror (3). Note that the thirteenth aspect is an aspect that can be implemented by itself, and it is not essential to assume any one of the first to seventh aspects.

21 display surface 3 display mirror 4, 4a, 4b, 4c, 4d display element 40 transparent plate 41 first surface 42 second surface 43 first pattern image element 44 second pattern image element 45 transparent block 6 DFD display 61 image display Panel 62 Image display panel 10, 10g Display system 80 Electronic mirror system 90 Camera 100 Car (moving body)
110 main body (moving body main body)
P1 image PA1 pattern image OP optical path

Claims (9)

A display surface on which an image based on the captured image output from the camera is displayed,
A display mirror that reflects an image displayed on the display surface,
At least a part of the structure of the moving body, which is arranged on the optical path between the display surface and the display mirror and exists on the reflected optical path of the display mirror, is used as a pattern image , and the pattern image is the image. And a display element that displays so as to overlap with the display system. The display element, a transparent plate having a first surface and a second surface on the opposite side in the thickness direction, the pattern image formed on any one of the first surface and the second surface, The display system according to claim 1, further comprising: A display surface on which an image based on the captured image output from the camera is displayed,
A display mirror that reflects an image displayed on the display surface,
A display element, which is arranged on an optical path between the display surface and the display mirror, displays at least a part of an object existing on a reflection optical path of the display mirror as a pattern image,
The display element includes a transparent plate having a first surface and a second surface opposite to each other in a thickness direction, and a pattern image formed on the first surface of the transparent plate and having the same shape as the pattern image. A first pattern image element which is a source of the pattern image, and a second pattern image element which is formed on the second surface of the transparent plate and has the same shape as the pattern image and is a source of the pattern image, The brightness distribution of the first pattern image element is different from the brightness distribution of the second pattern image element.
Viewing system. A display surface on which an image based on the captured image output from the camera is displayed,
A display mirror that reflects an image displayed on the display surface,
A display element, which is arranged on the optical path between the display surface and the display mirror, displays at least a part of an object existing on the reflection optical path of the display mirror as a pattern image,
The display element has a transparent block and the pattern image formed in the transparent block.
Viewing system. The display system according to claim 1, wherein the display element is a transparent display. A display surface on which an image based on the captured image output from the camera is displayed,
A display mirror that reflects an image displayed on the display surface,
A display element, which is arranged on the optical path between the display surface and the display mirror, displays at least a part of an object existing on the reflection optical path of the display mirror as a pattern image,
Equipped with a DFD display including two image display panels,
Of the two image display panels, the screen of the image display panel that is far from the display mirror is the display surface, and the image display panel near the display mirror is the display element.
Viewing system. The display system according to claim 1, wherein the display mirror is a concave mirror. A display system according to any one of claims 1 to 7,
An electronic mirror system comprising: a camera that outputs the captured image to the display system. An electronic mirror system according to claim 8,
A mobile body, comprising a mobile body on which the electronic mirror system is mounted.