JP2020161919A - Image display device - Google Patents

Abstract

To provide an image display device of a simple configuration, which can suppress the occurrence of incongruity at a changeover.SOLUTION: An image display device 100 includes: a room mirror 200 which reflects the back of a vehicle and transmits a display screen image arranged on the back side; a camera 52 which images the back of the vehicle; a back image generation unit which, using the image imaged by the camera 52, generates a back image for display; a display processing unit 20 and a display device 22 which display the back image on the display screen; a display changeover SW 10 which changes over from a first state, which reflects a mirror image of the back of the vehicle by the room mirror 200, to a second state which displays the display screen image through the room mirror 200; and a display range change unit which, when the display changeover SW 10 changes over from the first state to the second state, makes the display content coincident between before and after the changeover, and as the lapse of time, gradually changes the display aspect of the back image to be displayed on the display screen.SELECTED DRAWING: Figure 1

Description

The present invention relates to an image display device that switches between displaying a mirror image of the rear of a vehicle optically reflected by a mirror and displaying an image of the rear of the vehicle taken by a camera.

Conventionally, there has been known an image display device in which a display of an image display device and an optical inner mirror are integrally formed, and the mirror image display state by the optical inner mirror is switched to the display display state (image display state) by the image display device. (See, for example, Patent Document 1). In this image display device, when the distance between the own vehicle and the following vehicle is Ls or less, the image for display display is cut out so as to be the same as the size of the following vehicle included in the mirror image by the optical inner mirror. When the distance between the own vehicle and the following vehicle is larger than Ls, the image is cut out so that the size of the following vehicle included in the image for display is gradually reduced.

JP-A-2018-127083

By the way, the image display device disclosed in Patent Document 1 described above has a problem that the configuration becomes complicated because it is necessary to measure the distance to the following vehicle. In addition, since the display method of the image including the rear vehicle differs depending on the distance to the following vehicle, the appearance of the rear vehicle in the image differs depending on the presence or absence of the rear vehicle having a distance of Ls or less, which causes a sense of discomfort. There was a problem. Further, when the distance to the rear vehicle is larger than Ls, the size of the rear vehicle gradually decreases, and the surrounding situation can be widely confirmed. However, when the distance to the rear vehicle is Ls or less, Since such processing is not performed, it is not possible to widely check the surrounding conditions when the following vehicle is approaching.

The present invention was created in view of these points, and an object of the present invention is that it is not necessary to measure the distance to the following vehicle, the configuration can be simplified, and when switching from the mirror image display state to the image display state. It is an object of the present invention to provide an image display device capable of suppressing the occurrence of a sense of discomfort depending on the presence or absence of a following vehicle. Another object of the present invention is to provide an image display device capable of widely confirming the surrounding situation regardless of the presence or absence of a following vehicle and the distance to the following vehicle.

In order to solve the above-mentioned problems, the image display device of the present invention includes a mirror that reflects the rear of the vehicle and transmits an image of the display screen arranged on the back side, and a first camera that images the rear of the vehicle. A rear image creating means for creating a rear image for display using an image captured by the first camera, a display means for displaying the rear image on a display screen, and a first mirror image of the rear of the vehicle. From the state of to the second state of displaying the image of the display screen through the mirror, or from the second state to the first state, and the display switching means from the first state to the second state. When switching, the display contents are matched before and after that, and then the display mode of the rear image displayed on the display screen is gradually changed with the passage of time, and when switching from the second state to the first state by the display switching means. In addition, a display mode changing means for gradually changing the display mode of the rear image displayed on the display screen with the passage of time before switching is provided so that the display contents match before and after that.

Immediately after switching from the mirror image display by the mirror to the display of the image captured by the camera, these two types of display contents are matched, and then the display mode of the image is gradually changed. Therefore, the display mode is displayed regardless of the presence or absence of the following vehicle. The way of changing the image is constant, and it is possible to reduce the discomfort felt by the user who sees this display. Alternatively, when switching from the display of the image captured by the camera to the mirror image display by the mirror, the display mode of the image before switching is gradually changed so that these two types of display contents match before and after that. The way the display mode is changed is constant regardless of the presence or absence of a vehicle, and it is possible to reduce the discomfort felt by the user who sees this display. Further, the configuration for measuring the distance to the following vehicle is unnecessary, and the configuration can be simplified.

Further, it is desirable that the display mode changing means described above changes the display mode of the rear image over a predetermined time. By setting the time for gradually changing the display mode to a predetermined time, the state of change in the display mode can be stabilized, and the occurrence of discomfort due to the change can be reduced.

Further, it is desirable that the display mode changing means described above continuously changes the display mode of the rear image. This makes it possible to make the change in the display mode look more natural to the user.

Further, it is desirable that the above-mentioned display mode changing means gradually changes the display mode of the rear image. As a result, it is possible to clearly inform the user that the display mode is being changed.

In addition, the above-mentioned display mode changing means makes the background range included in the mirror image of the mirror the same as the background range included in the image displayed on the display screen immediately after the switching, and the display screen is displayed with the passage of time. It is desirable to gradually increase the range of the background included in the image displayed in. This makes it possible to check the surrounding conditions widely regardless of the presence or absence of the following vehicle and the distance to the following vehicle.

Further, the display mode changing means described above displays with the passage of time so that the background range included in the mirror image of the mirror and the background range included in the image displayed on the display screen become the same immediately before switching. It is desirable to gradually reduce the range of the background included in the image displayed on the screen. This makes it possible to check the surrounding conditions widely regardless of the presence or absence of the following vehicle and the distance to the following vehicle.

Further, the display mode changing means described above makes the background range included in the mirror image of the mirror the same as the background range included in the image displayed on the display screen immediately after the switching, and the display screen is displayed with the passage of time. It is desirable to gradually shift the range of the background included in the image displayed in the left and right direction. This makes it possible to confirm the situation in the range that the user wants to see regardless of the presence or absence of the following vehicle and the distance to the following vehicle.

Further, the above-mentioned display mode changing means displays with the passage of time so that the background range included in the mirror image of the mirror and the background range included in the image displayed on the display screen become the same immediately before the switching. It is desirable to gradually shift the range of the background included in the image displayed on the screen to the left and right. This makes it possible to confirm the situation in the range that the user wants to see regardless of the presence or absence of the following vehicle and the distance to the following vehicle.

In addition, the above-mentioned display mode changing means makes the brightness of the background included in the mirror image of the mirror the same as the brightness of the background included in the image displayed on the display screen immediately after the switching, and the display screen is displayed with the passage of time. It is desirable to gradually increase the brightness of the background contained in the image displayed in. Alternatively, the display mode changing means described above displays with the passage of time so that the brightness of the background included in the mirror image of the mirror and the brightness of the background included in the image displayed on the display screen are the same immediately before the switching. It is desirable to gradually darken the brightness of the background contained in the image displayed on the screen. Further, it is desirable that the brightness is changed by the above-mentioned display mode changing means at night. Further, it is desirable that the brightness is changed by the above-mentioned display mode changing means when the headlight of the vehicle is turned on. As a result, even when the content of the mirror image display by the mirror is dark, the brightness can be increased and the visibility can be improved by switching to the image display on the display screen.

Further, the rear image creating means described above creates a first rear image in which a part of the vehicle interior is reflected and a second rear image in which a part of the vehicle interior is not reflected, and the display mode changing means changes the display mode. During that time, it is desirable to change the content displayed on the display screen to the first rear image and then to the second rear image. As a result, when the display mode is changed, the state before the change is clarified, so that the occurrence of discomfort due to the change can be further reduced.

Further, it is desirable that the display mode changing means described above makes a part of the vehicle interior included in the first rear image transparent with the passage of time when changing from the first rear image to the second rear image. .. This makes it possible to clarify the range of the background added or changed as the display mode changes.

Further, a second camera is further provided at a position close to the above-mentioned mirror and images the rear of the vehicle so as to include a part of the vehicle interior, and the rear image creating means is imaged by the second camera. It is desirable to create a first rear image using the resulting image. This makes it possible to accurately and easily create an image in which a part of the vehicle interior is reflected.

It is a figure which shows the structure of the image display device of one Embodiment. It is a functional block diagram of the display mode changing part which operates by executing a display control program by a CPU. It is a flow chart which shows the operation procedure which changes the display mode by expanding the display range of an image after switching from a mirror image display to an image display. It is a figure which shows the specific example of the rear image cutout displayed according to the operation procedure shown in FIG. It is a figure which shows the specific example of the display range of the rear image corresponding to the image cutout shown in FIG. It is a figure which shows the modification of the created rear image. It is a flow chart which shows the operation procedure which changes the display mode by shifting the display range of an image to the left-right direction after switching from a mirror image display to an image display. It is a figure which shows the specific example of the rear image cutout displayed according to the operation procedure shown in FIG. 7. It is a figure which shows the specific example of the display range of the rear image corresponding to the image cutout shown in FIG. It is a figure which shows the modification of the created rear image. It is a flow chart which shows the operation procedure which changes the display mode by increasing the brightness (sensitivity) of an image after switching from a mirror image display to an image display. It is a figure which shows the modification of the image display device. It is a flow chart which shows the operation procedure which gradually reduces the range of the background included in the image displayed on the display screen with the lapse of time just before switching. It is a flow chart which shows the operation procedure which gradually shifts the range of the background included in the image displayed on the display screen with the lapse of time just before switching. It is a flow chart which shows the operation procedure which gradually reduces the brightness of an image displayed on a display screen with the lapse of time just before switching.

Hereinafter, an image display device according to an embodiment to which the present invention is applied will be described with reference to the drawings.

FIG. 1 is a diagram showing a configuration of an image display device according to an embodiment. As shown in FIG. 1, the image display device 100 of the present embodiment has a display switching SW (switch) 10, a display processing unit 20, a display device 22, a CPU 30, a memory 40, and an input / output interface unit (I / O IF) 50. , The camera 52 is provided. The image display device 100 is for creating an image of the rear of the vehicle and replacing it with a mirror image of the rearview mirror 200 for display.

The room mirror 200 is attached to the upper part of the windshield at the center of the driver's seat and the passenger's seat of the vehicle. The room mirror 200 is provided with a display screen on the back side, and when an image is displayed on the display screen, the displayed image can be seen by the driver through the mirror surface.

The display switching SW10 is for switching between the first state in which the rearview mirror image of the vehicle is projected by the rearview mirror 200 and the second state in which the image of the display screen is displayed through the rearview mirror 200. For example, a switch provided on a support portion that supports the room mirror 200 is turned off in the first state of reflecting a mirror image of the rear of the vehicle by the surface (mirror surface) of the room mirror 200, and is turned off on the back side of the mirror surface of the room mirror 200. It is turned on when the mirror surface of the room mirror 200 is tilted toward the ceiling in the vehicle interior in order to display the image of the position display screen through the mirror surface of the room mirror 200 in the second state. By tilting the mirror surface toward the ceiling, it is possible to prevent the background behind the vehicle from being reflected on the mirror surface of the room mirror 200 and the visibility of the display screen from being deteriorated.

The display processing unit 20 creates a rear image to be displayed on the display screen of the display device 22 by using all or a part of the image of the camera 52 that captures the rear of the vehicle. The display device 22 has a display screen using, for example, a liquid crystal display (LCD). This display screen is arranged on the back side of the room mirror 200, and when the display screen is dark, the mirror image by the room mirror 200 can be seen by the driver, and the display screen is bright (the image is displayed). ), The image displayed on the display screen through the mirror surface of the rearview mirror 200 becomes visible to the driver.

The CPU 30 controls the entire image display device 100 by executing a predetermined program stored in the memory 40. Further, the CPU 30 creates a rear image for display using the image captured by the camera 52, and turns the display switching SW10 from off to on to display the display device from the mirror image display (first state) using the room mirror 200. When the image display (second state) using the 22 is switched, the display contents are matched before and after the display, and the display mode of the rear image using the display device 22 is gradually changed with the lapse of time. The operation of gradually changing the display mode is performed for a predetermined time immediately after switching from the first state to the second state. Further, the display mode may be changed continuously and gradually, but the display mode may be gradually changed step by step.

The memory 40 is used as a work area for storing the operation program of the CPU 30 and storing various data necessary for the operation of the CPU 30. The operation program executed by the CPU 30 includes a program (display control program) for creating a rear image and gradually switching the display mode of the rear image when switching from the mirror surface display to the image display. ..

The input / output interface unit 50 performs input / output processing of signals (data) with various input / output devices including the camera 52.

The camera 52 is attached to a predetermined position behind the vehicle (for example, the upper part of the rear glass or the upper part of the license plate), and captures a wider range than the mirror image reflected on the rearview mirror 200.

FIG. 2 is a functional block diagram of a display mode changing unit 30A that operates by executing a display control program by the CPU 30. The display mode changing unit 30A includes a rear image creating unit 32, a display range changing unit 34, a cutting position changing unit 36, and a sensitivity changing unit 38.

The rear image creating unit 32 creates a rear image to be displayed on the display screen of the display device 22 by using the image captured by the camera 52.

Immediately after switching from the mirror image display (first state) to the image display (second state), the display range changing unit 34 sets the background range included in the mirror image of the room mirror 200 and thereafter. An instruction is given to the rear image creation unit 32 to make the range of the background included in the image displayed on the display screen the same and gradually increase the range of the background included in the image displayed on the display screen over time. To do.

Immediately after switching from the mirror image display (first state) to the image display (second state), the cutout position changing unit 36 displays the background range included in the mirror image of the room mirror 200 and the display screen. The rear image creation unit 32 is instructed to make the range of the background included in the displayed image the same and gradually shift the range of the background included in the image displayed on the display screen to the left and right with the passage of time. To do.

Immediately after switching from the mirror image display (first state) to the image display (second state), the sensitivity changing unit 38 displays the brightness of the background included in the mirror image of the room mirror 200 and the display screen. The rear image creation unit 32 is instructed to make the brightness of the background included in the image to be the same and to gradually increase the brightness of the background included in the image displayed on the display screen with the passage of time.

The rear image creating unit 32 described above is used as the rear image creating means, the display processing unit 20 and the display device 22 are used as the display means, the display switching SW10 is used as the display switching means, the display range changing unit 34, the cutting position changing unit 36, and the sensitivity change. The unit 38 corresponds to each of the display mode changing means.

The image display device 100 of the present embodiment has such a configuration, and the operation thereof will be described next.

FIG. 3 is a flow chart showing an operation procedure for changing the display mode by expanding the display range of the image after switching from the mirror image display to the image display.

The rear image creation unit 32 determines whether or not the display switching SW10 is turned on (step 100). If it is not turned on, a negative judgment is made and this judgment is repeated. In this state, a mirror image containing the background behind the vehicle is projected on the rearview mirror 200, and the driver of the vehicle can confirm the state behind the vehicle by looking at this mirror image.

Further, when the display switching SW10 is turned on, a positive determination is made in the determination in step 100. Next, the display range changing unit 34 gives an instruction to the rear image creating unit 32 to create a rear image so as to be the same as the background range included in the mirror image of the room mirror 200, and the rear image The creation unit 32 cuts out an image corresponding to the instructed range from the image captured by the camera 52 and creates a rear image (step 102). This rear image is displayed on the screen of the display device 22 by the display processing unit 20 (step 104).

Next, the display range changing unit 34 gives an instruction to the rear image creating unit 32 to create a rear image so that the range of the background to be displayed is larger than before, and the rear image creating unit 32 receives the instruction to create the rear image. From the image captured by the camera 52, an image corresponding to the instructed range is cut out to create a rear image (step 106). This rear image is displayed on the screen of the display device 22 by the display processing unit 20 (step 108).

Next, the display range changing unit 34 determines whether or not a predetermined time has elapsed after switching to the image display (step 110). If it has not passed, a negative determination is made, and the process returns to step 106 to further expand the display range and repeat the creation and display of the rear image.

Further, when the predetermined time has elapsed, a positive judgment is made in the determination in step 110. Next, the display range changing unit 34 stops expanding the range of the background to be displayed, gives an instruction to the rear image creating unit 32 to create a rear image so as to be the same range as before, and rearward. The image creation unit 32 cuts out an image corresponding to the instructed range from the image captured by the camera 52 and creates a rear image (step 112). This rear image is displayed on the screen of the display device 22 by the display processing unit 20 (step 114). After that, the process returns to step 112, and the creation and display of the rear image corresponding to the same range is repeated.

FIG. 4 is a diagram showing a specific example of rear image cutting displayed according to the operation procedure shown in FIG. Immediately after switching from the mirror image display by the room mirror 200 to the rear image display of the display screen, the rear image is cut out so as to be the same as the background range included in the mirror image (FIG. 4 (A)). After that, the rear image is cut out by gradually expanding the range of the background to be displayed with the passage of time (FIG. 4 (B)). Then, when the predetermined time elapses, the rear image is cut out so that the range of the background to be displayed is maximized (FIG. 4 (C)).

FIG. 5 is a diagram showing a specific example of the display range of the rear image corresponding to the image cutout shown in FIG. Immediately after switching from the mirror image display by the room mirror 200 to the rear image display of the display screen, a rear image is created and displayed so as to be the same as the background range included in the mirror image (FIG. 5 (A)). ). After that, a rear image is created and displayed by gradually expanding the range of the background to be displayed with the passage of time (FIG. 5 (B)). Then, when the predetermined time elapses, the range of the background to be displayed becomes maximum, and the rear image is created and displayed (FIG. 5 (C)).

FIG. 6 is a diagram showing a modified example of the created rear image. Immediately after switching from the mirror image display by the room mirror 200 to the rear image display of the display screen, a rear image is created and displayed so as to be the same as the background range included in the mirror image (FIG. 6 (A)). ). The mirror image immediately before switching includes a part of the passenger compartment (a part of the rear seats, ceiling, etc.) reflected in the room mirror 200, and the rear image created also shows a part of the passenger compartment. Images are included. Since the rear of the vehicle is imaged by the camera 52 attached to the rear of the vehicle, a part of the vehicle interior does not actually enter the imaging range, and a partial image reminiscent of a part of the vehicle interior is created separately. Is synthesized.

After that, a rear image is created and displayed by gradually expanding the range of the background to be displayed with the passage of time (FIG. 6 (B)). In this state, a part of the vehicle interior area included in the rear image is enlarged, but it is not always necessary to use an accurate part of the vehicle interior image over a wide area, and the interior of the vehicle interior shown in FIG. It may be replaced with the same color as a part. In FIG. 6B, the hatched region on the outer peripheral portion of the rear image shows a region in which a part of the vehicle interior is combined.

Then, when the predetermined time elapses, the range of the background to be displayed becomes maximum, and the rear image is created and displayed (FIG. 6 (C)). After that, a part of the passenger compartment (including the area with the same color system around it) included in this rear image becomes transparent over time, and the hidden background image is displayed (). FIG. 6 (D).

By the way, in the above-described embodiment, the case where the display mode is changed by gradually widening the range of the rear image after switching to the image display has been described, but the display mode is changed by gradually shifting the range for cutting out the rear image. May be changed.

FIG. 7 is a flow chart showing an operation procedure for changing the display mode by shifting the display range of the image in the left-right direction after switching from the mirror image display to the image display.

The rear image creation unit 32 determines whether or not the display switching SW10 is turned on (step 200). If it is not turned on, a negative judgment is made and this judgment is repeated. Further, when the display switching SW10 is turned on, a positive determination is made in the determination in step 200. Next, the cutout position changing unit 36 gives an instruction to the rear image creating unit 32 to create a rear image so as to be the same as the background range included in the mirror image of the room mirror 200, and the rear image The creation unit 32 cuts out an image corresponding to the instructed range from the image captured by the camera 52 and creates a rear image (step 202). This rear image is displayed on the screen of the display device 22 by the display processing unit 20 (step 204).

Next, the cutout position changing unit 36 gives an instruction to the rear image creating unit 32 to create a rear image so that the range of the background to be displayed shifts in the left-right direction with respect to the past, and creates the rear image. The unit 32 cuts out an image corresponding to a designated range from the image captured by the camera 52 to create a rear image (step 206). This rear image is displayed on the screen of the display device 22 by the display processing unit 20 (step 208).

Next, the cutout position changing unit 36 determines whether or not a predetermined time has elapsed after switching to the image display (step 210). If it has not passed, a negative determination is made, and the process returns to step 206 to further shift the display range to the left and right, and the creation and display of the rear image are repeated.

Further, when the predetermined time has elapsed, a positive judgment is made in the determination in step 210. Next, the cutout position changing unit 36 stops the shift of the background range to be displayed in the left-right direction, and gives an instruction to the rear image creating unit 32 to create a rear image so that the range is the same as before. Then, the rear image creating unit 32 cuts out an image corresponding to the instructed range from the image captured by the camera 52 and creates a rear image (step 212). This rear image is displayed on the screen of the display device 22 by the display processing unit 20 (step 214). After that, the process returns to step 212, and the creation and display of the rear image corresponding to the same range is repeated.

FIG. 8 is a diagram showing a specific example of rear image cutout displayed according to the operation procedure shown in FIG. 7. Immediately after switching from the mirror image display by the room mirror 200 to the rear image display of the display screen, the rear image is cut out so as to be the same as the background range included in the mirror image (FIG. 8 (A)). After that, as time passes, the range of the background to be displayed is gradually shifted to the left, for example, and the rear image is cut out (FIG. 8 (B)). Then, when the predetermined time elapses, the rear image is cut out so that the shift of the background range to be displayed is maximized (FIG. 8 (C)).

FIG. 9 is a diagram showing a specific example of the display range of the rear image corresponding to the image cutout shown in FIG. Immediately after switching from the mirror image display by the room mirror 200 to the rear image display of the display screen, a rear image is created and displayed so as to be the same as the background range included in the mirror image (FIG. 9 (A)). ). After that, as time passes, the range of the background to be displayed is gradually shifted to the left to create a rear image, which is displayed (FIG. 9B). Then, when the predetermined time elapses, the shift of the background range to be displayed becomes maximum, and the rear image is created and displayed (FIG. 9 (C)).

FIG. 10 is a diagram showing a modified example of the created rear image. Immediately after switching from the mirror image display by the room mirror 200 to the rear image display of the display screen, a rear image is created and displayed so as to be the same as the background range included in the mirror image (FIG. 10 (A)). ). The mirror image immediately before switching includes a part of the passenger compartment (a part of the rear seats, ceiling, etc.) reflected in the room mirror 200, and the rear image created also shows a part of the passenger compartment. Images are included. Since the rear of the vehicle is imaged by the camera 52 attached to the rear of the vehicle, a part of the vehicle interior does not actually enter the imaging range, and a partial image reminiscent of a part of the vehicle interior is created separately. Is synthesized.

After that, the rear image is created and displayed by gradually shifting the range of the background to be displayed to the left with the passage of time (FIG. 10 (B)). In this state, a part of the vehicle interior area included in the rear image is enlarged, but it is not always necessary to use an accurate part of the vehicle interior image over a wide area, and the interior of the vehicle interior shown in FIG. It may be replaced with the same color as a part. In FIG. 10B, the hatched region on the outer peripheral portion of the rear image shows a region in which a part of the vehicle interior is combined.

Then, when the predetermined time elapses, the shift of the background range to be displayed becomes maximum, and the rear image is created and displayed (FIG. 10 (C)). After that, a part of the passenger compartment (including the area with the same color system around it) included in this rear image becomes transparent over time, and the hidden background image is displayed (). FIG. 10 (D).

FIG. 11 is a flow chart showing an operation procedure for changing the display mode by increasing the brightness (sensitivity) of the image after switching from the mirror image display to the image display.

The rear image creation unit 32 determines whether or not the display switching SW10 is turned on (step 300). If it is not turned on, a negative judgment is made and this judgment is repeated. Further, when the display switching SW10 is turned on, an affirmative determination is made in the determination in step 300. Next, the sensitivity changing unit 38 gives an instruction to the rear image creating unit 32 to create a rear image so as to have the same brightness (sensitivity) as the mirror image of the room mirror 200, and the rear image creating unit 38. 32 cuts out an image from the image captured by the camera 52 so as to have the same range as the mirror image, and adjusts the image quality so as to have the same brightness as the mirror image to create a rear image (step 302). This rear image is displayed on the screen of the display device 22 by the display processing unit 20 (step 304).

Next, the sensitivity changing unit 38 gives an instruction to the rear image creating unit 32 to increase the brightness (sensitivity) of the image more than before to create a rear image, and the rear image creating unit 32 is instructed. The rear image is created by adjusting the image quality so as to have a high brightness (sensitivity) (step 306). This rear image is displayed on the screen of the display device 22 by the display processing unit 20 (step 308).

Next, the sensitivity changing unit 38 determines whether or not a predetermined time has elapsed after switching to the image display (step 310). If it has not passed, a negative determination is made, and the process returns to step 306 to further increase the brightness (sensitivity) of the image, and the creation and display of the rear image are repeated.

Further, when the predetermined time has elapsed, a positive judgment is made in the determination in step 310. Next, the sensitivity changing unit 38 stops changing the brightness (sensitivity), gives an instruction to the rear image creating unit 32 to create a rear image while maintaining the brightness (sensitivity) up to that point, and rearward. The image creation unit 32 creates a rear image with the instructed brightness (sensitivity) (step 312). This rear image is displayed on the screen of the display device 22 by the display processing unit 20 (step 314). After that, the process returns to step 312, and the creation and display of the rear image having the same brightness (sensitivity) is repeated.

As described above, in the image display device 100 of the present embodiment, immediately after switching from the mirror image display by the room mirror 200 to the display of the image captured by the camera 52, these two types of display contents are matched, and then the image display mode is changed. Since the change is gradually made, the way of changing the display mode is constant regardless of the presence or absence of the following vehicle, and it is possible to reduce the discomfort felt by the user who sees this display. Further, the configuration for measuring the distance to the following vehicle is unnecessary, and the configuration can be simplified.

Further, by setting the time for gradually changing the display mode to a predetermined time, the state of change in the display mode can be stabilized, and the occurrence of discomfort due to the change can be reduced.

In addition, by continuously changing the display mode, it is possible to make the change in the display mode look more natural to the user. Alternatively, by changing the display mode step by step, it is possible to clearly inform the user that the display mode is being changed.

Immediately after switching from the mirror image display to the image display on the display screen, the background range included in the mirror image of the room mirror 200 and the background range included in the image displayed on the display screen are made the same, and the time is set. By gradually increasing the range of the background included in the image displayed on the display screen with the passage of time, it is possible to check the surrounding situation widely regardless of the presence or absence of the following vehicle and the distance to the following vehicle.

Similarly, immediately after switching from the mirror image display to the image display on the display screen, the background range included in the mirror image of the room mirror 200 and the background range included in the image displayed on the display screen are made the same, and the background range is made the same. By gradually shifting the background range included in the image displayed on the display screen to the left and right over time, the user can check the status of the range that the user wants to see regardless of the presence or absence of the following vehicle and the distance to the following vehicle. It becomes possible to do.

Immediately after switching from the mirror image display to the image display on the display screen, the brightness of the background included in the mirror image of the room mirror 200 and the brightness (sensitivity) of the background included in the image displayed on the display screen are the same. At the same time, by gradually brightening the background brightness included in the image displayed on the display screen with the passage of time, the brightness is gradually brightened even when the content of the mirror image display by the room mirror 200 is dark. The visibility can be improved.

In addition, while the display mode is changed after switching from the mirror image display to the image display on the display screen, the first rear image (FIG. 6 (A)) in which a part of the vehicle interior is reflected in the content to be displayed on the display screen. , (B), (C) and FIGS. 10 (A), (B), (C)), and then the second rear image (FIG. 6 (D) and FIG. 10) in which a part of the vehicle interior is not reflected. By changing to (D)) and clarifying the state before the change when the display mode is changed, it is possible to further reduce the occurrence of discomfort due to the change.

In particular, when changing from the first rear image to the second rear image, by making a part of the vehicle interior included in the first rear image transparent with the passage of time, it is added as the display mode changes. Alternatively, it becomes possible to clarify the range of the changed background.

The present invention is not limited to the above embodiment, and various modifications can be made within the scope of the gist of the present invention. For example, in the above-described embodiment, the sensitivity changing unit 38 may gradually increase the brightness (sensitivity) of the rear image to change the display mode at night. For example, it is conceivable that the vehicle can receive a headlight ON / OFF signal indicating that the headlight of the vehicle is on / off, and the above display mode can be changed when the headlight is on. .. As a result, even when the content of the mirror image display by the room mirror 200 is dark, by switching to the image display on the display screen, the brightness can be gradually increased and the visibility can be improved.

Further, in the above-described embodiment, the first rear image (FIGS. 6 (A), (B), (C) and 10 (A)) in which a part of the vehicle interior is reflected in the content to be displayed on the display screen. When creating (B) and (C)), a partial image that was not actually captured was created and combined separately from the rear image, but a part of the vehicle interior was included using an actual camera. A rear image may be captured and used.

FIG. 12 is a diagram showing a modified example of the image display device. The image display device 100A shown in FIG. 12 is different from the image display device 100 shown in FIG. 1 in that a camera 54 is added. The camera 54 is provided at a position close to the room mirror 200 (for example, the upper part of the room mirror 200), and images the rear of the vehicle so as to include a part of the vehicle interior. In this case, the rear image creating unit 32 uses the image captured by the camera 54 to accurately obtain the first rear image in which a part of the vehicle interior is reflected without synthesizing the separately created partial image. And it can be easily created.

Further, in the above-described embodiment, the display range changing unit 34, the cutting position changing unit 36, and the sensitivity changing unit 38 are used to change three types of display modes, but any of these three types of display mode changes. You may do one, or you may combine two or three and do it at the same time.

Further, in the above-described embodiment, the display mode is changed (enlargement of the display range) by the display range changing unit 34 by increasing the cropping range of the image captured by the camera 52. It may be done by instructing an optical zoom-out.

Further, in the above-described embodiment, the change of the display mode (shift of the display range in the left-right direction) by the cutout position changing unit 36 is performed by changing the cutout position of the image captured by the camera 52 in the left-right direction. However, it may be performed by sending an instruction to the camera 52 to change the viewing direction.

Further, in the above-described embodiment, the display mode is changed (increased in brightness and sensitivity) by the sensitivity changing unit 38 by adjusting the image quality with respect to the image captured by the camera 52. It may be performed by instructing the change of the sensitivity (gain).

Further, in the above-described embodiment, the mirror image display by the room mirror 200 is switched to the image display by the display device 22, but conversely, when the image display by the display device 22 is switched to the mirror image display by the room mirror 200, the display is displayed. The display mode of the image display by the device 22 may be gradually changed so that the two types of display contents match before and after the switching.

Immediately before switching, FIG. 13 is displayed on the display screen over time so that the background range included in the mirror image of the room mirror 200 and the background range included in the image displayed on the display screen are the same. It is a flow chart which shows the operation procedure which gradually reduces the range of the background included in the image. This operation procedure shows an operation when the image display is switched back to the mirror image display again after being switched to the image display according to the operation procedure shown in FIG.

The rear image creation unit 32 determines whether or not the display switching SW10 has been turned off (step 120). If it is not turned off, a negative judgment is made and this judgment is repeated. In this state, an image of the screen of the display device 22 (an image in which the display range is enlarged with respect to the mirror image display) is visible through the room mirror 200, and the driver of the vehicle sees this image to see the rear of the vehicle. Can be confirmed in a wider range than in the case of mirror image display.

Further, when the display switching SW10 is turned off, an affirmative determination is made in the determination in step 120. Next, the display range changing unit 34 gives an instruction to the rear image creating unit 32 to create a rear image so that the range of the background to be displayed becomes smaller than before, and the rear image creating unit 32 receives the instruction to create the rear image. From the image captured by the camera 52, an image corresponding to the instructed range is cut out to create a rear image (step 122). This rear image is displayed on the screen of the display device 22 by the display processing unit 20 (step 124).

Next, the display range changing unit 34 determines whether or not a predetermined time has elapsed since the reduction of the rear image was started (step 126). If it has not passed, a negative determination is made, the process returns to step 122, the display range is further reduced, and the creation and display of the rear image are repeated.

Further, when the predetermined time has elapsed, a positive judgment is made in the determination in step 126. Next, the display range changing unit 34 stops reducing the range of the background to be displayed, gives an instruction to the rear image creating unit 32 to create a rear image so as to be the same range as before, and rearward. The image creation unit 32 cuts out an image corresponding to the instructed range from the image captured by the camera 52 and creates a rear image (step 128). This rear image is displayed on the screen of the display device 22 by the display processing unit 20 (step 130). After that, the display of the rear image by the display device 22 is terminated (step 132). By ending the display of the rear image, the display of the mirror image by the rearview mirror 200 is switched. To end the display of the rear image, in addition to the case where the power of the display device 22 is turned off, an image in which each pixel is black may be displayed instead of the rear image. Further, the reduction rate (speed) of the rear image in step 122 is set so that the size of the rear image after a lapse of a predetermined time becomes the same size as the mirror image of the room mirror 200, and the rear image is set in step 132. When switching from the image display to the mirror image display, the size of the background to be displayed is the same.

Immediately before switching, FIG. 14 is displayed on the display screen over time so that the background range included in the mirror image of the room mirror 200 and the background range included in the image displayed on the display screen are the same. It is a flow chart which shows the operation procedure which gradually shifts the range of the background included in the image. This operation procedure shows an operation when the image display is switched back to the mirror image display again according to the operation procedure shown in FIG. 7.

The rear image creation unit 32 determines whether or not the display switching SW10 has been turned off (step 220). If it is not turned off, a negative judgment is made and this judgment is repeated. In this state, an image of the screen of the display device 22 (an image in which the display range is shifted with respect to the mirror image display) is visible through the rearview mirror 200, and the driver of the vehicle sees this image to see the rear of the vehicle. Can be confirmed in a range shifted in a desired direction as compared with the case of mirror image display.

Further, when the display switching SW10 is turned off, an affirmative determination is made in the determination in step 220. Next, the cutout position changing unit 36 gives an instruction to create a rear image so that the range of the background to be displayed shifts in the left-right direction (the direction opposite to the shift direction in step 206 in FIG. 7). This is performed on the rear image creating unit 32, and the rear image creating unit 32 cuts out an image corresponding to the instructed range from the image captured by the camera 52 and creates a rear image (step 222). This rear image is displayed on the screen of the display device 22 by the display processing unit 20 (step 224).

Next, the cutout position changing unit 36 determines whether or not a predetermined time has elapsed since the shift of the display range of the rear image was started (step 226). If it has not passed, a negative determination is made, the process returns to step 222, the display range is further shifted, and the creation and display of the rear image are repeated.

Further, when the predetermined time has elapsed, an affirmative judgment is made in the determination in step 226. Next, the cutout position changing unit 36 stops shifting the range of the background to be displayed, gives an instruction to the rear image creating unit 32 to create a rear image so that the range is the same as before, and rearward. The image creation unit 32 cuts out an image corresponding to a designated range from the image captured by the camera 52 and creates a rear image (step 228). This rear image is displayed on the screen of the display device 22 by the display processing unit 20 (step 230). After that, the display of the rear image by the display device 22 is terminated (step 232). By ending the display of the rear image, the display of the mirror image by the rearview mirror 200 is switched. The shift ratio (speed) of the rear image in step 222 is set so that the display range of the rear image when a predetermined time elapses is the same as the display range of the mirror image of the room mirror 200, and in step 232. When switching from the rear image display to the mirror image display, the range of the background to be displayed is the same.

FIG. 15 is displayed on the display screen with the passage of time so that the brightness (sensitivity) of the mirror image of the room mirror 200 and the brightness (sensitivity) of the image displayed on the display screen are the same immediately before switching. It is a flow chart which shows the operation procedure which gradually reduces the brightness of an image. This operation procedure shows an operation when the image display is switched back to the mirror image display again after being switched to the image display according to the operation procedure shown in FIG.

The rear image creation unit 32 determines whether or not the display switching SW10 has been turned off (step 320). If it is not turned off, a negative judgment is made and this judgment is repeated. In this state, an image of the screen of the display device 22 (an image in which the brightness (sensitivity) is increased with respect to the mirror image display) is visible through the rearview mirror 200, and the driver of the vehicle can see the image of the vehicle. The rear view can be confirmed more clearly than in the case of mirror image display.

Further, when the display switching SW10 is turned off, an affirmative determination is made in the determination in step 320. Next, the sensitivity changing unit 38 gives an instruction to the rear image creating unit 32 to lower (lower) the brightness of the image than before to create a rear image, and the rear image creating unit 32 gives a camera. From the image captured by 52, an image corresponding to the specified range and brightness is cut out to create a rear image (step 322). This rear image is displayed on the screen of the display device 22 by the display processing unit 20 (step 324).

Next, the sensitivity changing unit 38 determines whether or not a predetermined time has elapsed since the brightness of the displayed image was reduced (step 326). If it has not passed, a negative determination is made, and the process returns to step 322 to further reduce the brightness of the displayed image, and the creation and display of the rear image are repeated.

Further, when the predetermined time has elapsed, an affirmative judgment is made in the determination in step 326. Next, the sensitivity changing unit 38 stops lowering the brightness of the displayed image, gives an instruction to the rear image creating unit 32 to create a rear image so that the brightness becomes the same as before, and gives a rear image creating unit 38. 32 cuts out an image corresponding to the specified range and brightness from the image captured by the camera 52 to create a rear image (step 328). This rear image is displayed on the screen of the display device 22 by the display processing unit 20 (step 330). After that, the display of the rear image by the display device 22 is terminated (step 332). By ending the display of the rear image, the display of the mirror image by the rearview mirror 200 is switched. The speed at which the brightness of the rear image is reduced in step 322 is set so that the brightness of the rear image after a lapse of a predetermined time becomes the same as the brightness of the mirror image of the room mirror 200, and the rear is set in step 332. The brightness of the displayed contents does not change when switching from the image display to the mirror image display.

Further, the three types of operations for changing the display mode of the displayed image when switching from the image display shown in FIGS. 13 to 15 to the mirror image display may be performed simultaneously by two or a combination of the three types. Further, when changing the display mode of the display image, the rear image may include an image showing a part of the vehicle interior as shown in FIGS. 6 and 10. Further, as the image showing a part of the vehicle interior, the image obtained by the image taken by the camera 54 shown in FIG. 12 may be used.

Further, in the above-described embodiment, the mirror image and the display image are switched between the rearview mirror 200 of the vehicle, but the present invention can also be applied to the switching between the mirror image and the display image corresponding to other mirrors.

Further, in the above-described embodiment, when the rear image is displayed on the screen of the display device 22, the rear image can be seen through the room mirror 200, and when the display of the rear image is stopped (finished), the mirror image by the room mirror 200 can be seen. However, the image display and the mirror image display may be switched by combining the room mirror 200 with a liquid crystal shutter and turning the liquid crystal shutter on / off (or switching the transmission rate and the reflectance).

As described above, according to the present invention, immediately after switching from the mirror image display by the mirror to the display of the image captured by the camera, these two types of display contents are matched, and then the display mode of the image is gradually changed. Therefore, the way the display mode is changed is constant regardless of the presence or absence of the following vehicle, and the discomfort felt by the user who sees this display can be reduced. Further, the configuration for measuring the distance to the following vehicle is unnecessary, and the configuration can be simplified.

10 Display switching SW
20 Display processing unit 22 Display device 30 CPU
30A Display mode change unit 32 Rear image creation unit 34 Display range change unit 36 Cutout position change unit 38 Sensitivity change unit 40 Memory 52, 54 Camera 100 Image display device

Claims (15)

A mirror that reflects the rear of the vehicle and allows the image of the display screen placed on the back side to pass through.
The first camera that captures the rear of the vehicle,
A rear image creating means for creating a rear image for display using the image captured by the first camera, and
A display means for displaying the rear image on the display screen, and
Display switching means for switching from a first state in which a mirror image of the rear of the vehicle is projected by the mirror to a second state in which an image of the display screen is displayed through the mirror, or from the second state to the first state. When,
When switching from the first state to the second state by the display switching means, the display contents are matched before and after that, and then the display mode of the rear image to be displayed on the display screen gradually changes with the passage of time. When the display switching means switches from the second state to the first state, the rear image is displayed on the display screen with the passage of time before the switching so that the display contents match before and after the change. Display mode changing means for gradually changing the display mode of
An image display device comprising. The image display device according to claim 1, wherein the display mode changing means changes the display mode of the rear image over a predetermined time. The image display device according to claim 1 or 2, wherein the display mode changing means continuously changes the display mode of the rear image. The image display device according to claim 1 or 2, wherein the display mode changing means changes the display mode of the rear image stepwise. Immediately after the switching, the display mode changing means makes the background range included in the mirror image of the mirror the same as the background range included in the image displayed on the display screen, and the display screen changes over time. The image display device according to any one of claims 1 to 4, wherein the range of the background included in the image displayed in is gradually increased. Immediately before switching, the display mode changing means displays the display over time so that the background range included in the mirror image of the mirror and the background range included in the image displayed on the display screen become the same. The image display device according to any one of claims 1 to 5, wherein the range of the background included in the image displayed on the screen is gradually reduced. Immediately after switching, the display mode changing means makes the background range included in the mirror image of the mirror the same as the background range included in the image displayed on the display screen, and the display screen changes over time. The image display device according to any one of claims 1 to 4, wherein the range of the background included in the image displayed in is gradually shifted in the left-right direction. Immediately before switching, the display mode changing means displays the display over time so that the background range included in the mirror image of the mirror and the background range included in the image displayed on the display screen become the same. The image display device according to any one of claims 1 to 4, 7, wherein the range of the background included in the image displayed on the screen is gradually shifted in the left-right direction. Immediately after switching, the display mode changing means makes the brightness of the background included in the mirror image of the mirror the same as the brightness of the background included in the image displayed on the display screen, and changes the display screen over time. The image display device according to any one of claims 1 to 8, wherein the brightness of the background included in the image displayed in is gradually increased. Immediately before switching, the display mode changing means displays the display over time so that the brightness of the background included in the mirror image of the mirror and the brightness of the background included in the image displayed on the display screen become the same. The image display device according to any one of claims 1 to 9, wherein the brightness of the background included in the image displayed on the screen is gradually darkened. The image display device according to claim 10, wherein the change of brightness by the display mode changing means is performed at night time. The image display device according to claim 9, wherein the change of brightness by the display mode changing means is performed when the headlight of the vehicle is turned on. The rear image creating means creates a first rear image in which a part of the vehicle interior is reflected and a second rear image in which a part of the vehicle interior is not reflected.
The claim is characterized in that the display mode changing means changes the content to be displayed on the display screen to the first rear image and then to the second rear image while the display mode is changed. The image display device according to any one of 1 to 8. When changing from the first rear image to the second rear image, the display mode changing means makes a part of the vehicle interior included in the first rear image transparent with the passage of time. The image display device according to claim 13. A second camera, which is provided close to the mirror and images the rear of the vehicle so as to include a part of the vehicle interior, is further provided.
The image display device according to claim 13, wherein the rear image creating means creates the first rear image using an image captured by the second camera.

Images