WO2020084827A1

WO2020084827A1 - Superimposed-image display device, and computer program

Info

Publication number: WO2020084827A1
Application number: PCT/JP2019/023606
Authority: WO
Inventors: 賢二渡邊; 広之三宅
Original assignee: アイシン・エィ・ダブリュ株式会社
Priority date: 2018-10-25
Filing date: 2019-06-14
Publication date: 2020-04-30
Also published as: JP2020067576A

Abstract

Provided are a superimposed-image display device and a computer program that make it possible to prevent the occurrence of double-vision of a guide image due to both-eyes parallax, and to cause the guide image to be visible superimposed at an appropriate position regardless of the current eye position of a user. The superimposed-image display device is provided with a front display 4 capable of displaying, respectively, a right-eye image visible to only the right eye of the user and a left-eye image visible to only the left eye of the user, and is configured such that: the positions of each eye of a vehicle occupant are detected; a guide image display position on the front display 4 is determined on the basis of the detected positions of the eyes of the occupant; and a first guide image in particular is displayed as either a right-eye image or a left-eye image, thereby causing the first guide image displayed on the front display 4 to be visible superimposed on the surrounding environment around the vehicle.

Description

Superimposed image display device and computer program

The present invention relates to a superimposed image display device and a computer program that support driving of a vehicle.

Conventionally, various means have been used as information providing means for providing various information to vehicle occupants such as route guidance and warning of obstacles to assist vehicle traveling. For example, it is a display on a liquid crystal display installed in the vehicle, a voice output from a speaker, or the like. In recent years, as one of such information providing means, an image to be superimposed on the surrounding environment (landscape, real scene) of a vehicle such as a head-up display (hereinafter referred to as HUD) or a window shield display (hereinafter referred to as WSD). There is a device that provides information by displaying.

Here, with the HUD and WSD as described above, it is possible to provide various information to the occupant without deviating the direction of the line of sight of the occupant from the front. Further, when the occupant visually recognizes the image to be superimposed on the surrounding environment, in addition to visually recognizing the image with both eyes, the image is visually recognized with only one eye. For example, in Japanese Patent Laid-Open No. 2015-194709, in the case of generating a virtual image to be visually recognized by the user, when the stereoscopic viewing distance of the user is less than 50 m, the virtual image is generated by visually recognizing the image with both eyes, When the stereoscopic viewing distance is 50 m or more, it is disclosed that the virtual image is generated by visually recognizing the image with only one eye. This makes it possible to reduce the burden on the user and generate a virtual image with good visibility.

JP-A-2015-194709 (page 5)

However, in Patent Document 1 described above, since the device for detecting the position of the eyes of the occupant is not provided, it is not possible to specify the exact positions of the eyes of the left and right of the occupant on the device side, and the position may be correct depending on the position of the eyes of the occupant. There is a problem that the virtual image cannot be visually recognized at the position or the virtual image itself cannot be visually recognized. In particular, when the image is viewed with only one eye (when only the image for the right eye or the image for the left eye is displayed), the range of the eye position where the virtual image can be viewed becomes narrow, which is a larger problem. It was

The present invention has been made in order to solve the above-mentioned problems in the related art. When the guide image is visually recognized only by one eye of the user, a phenomenon in which the guide image is double viewed due to a difference between the two eyes occurs. It is an object of the present invention to provide a superimposed image display device and a computer program capable of preventing the above and visually recognizing a guide image superimposed at an appropriate position regardless of the current eye position of the user.

In order to achieve the above-mentioned object, the superimposed image display device according to the present invention is mounted on a vehicle, and an image display surface capable of displaying a right-eye image visually recognized only by the user's right eye and a left-eye image visually recognized only by the user's left eye. Is a superimposed image display device for visually recognizing the image displayed on the image display surface by superimposing the image displayed on the image display surface on the surrounding environment around the vehicle by visually recognizing with both eyes of the user. And a display position determination unit that determines the display position of the image on the image display surface based on the positions of both eyes of the user detected by the position detection unit, and is a guidance target for the user. When the guide image is displayed on the image display surface, it is displayed as either the right-eye image or the left-eye image.
Here, "to superimpose an image on the surrounding environment to be visually recognized" means that the image is at least overlapped with somewhere in the surrounding environment (including everything visible to the user such as the sky and buildings in addition to the road surface and obstacles). It means that the image is visually recognized in a closed state, and it does not matter whether or not a state in which the image is visually recognized by superimposing an image on a specific object (for example, road surface, obstacle, etc.) in the surrounding environment is maintained.

Further, the computer program according to the present invention is a program for supporting driving of a vehicle. Specifically, by mounting on a vehicle and visually recognizing, with both eyes of the user, an image display surface capable of displaying a right-eye image to be visually recognized only by the user's right eye and a left-eye image to be visually recognized only by the user's left eye, The superimposed image display device that superimposes the image displayed on the image display surface on the surrounding environment around the vehicle for visual recognition, and position detection means for detecting the positions of both eyes of the user, and the user's position detected by the position detection means. A computer program for functioning as display position determining means for determining the display position of an image on the image display surface based on the positions of both eyes, wherein the guide image to be guided to the user is the image. When displayed on the display surface, it is displayed as either the image for the right eye or the image for the left eye.

According to the superimposed image display device and the computer program according to the present invention having the above configuration, when the guide image is visually recognized by being superimposed on the surrounding environment of the vehicle, the guide image is visually recognized by only one eye of the user, It is possible to prevent a phenomenon in which the guide image is visually recognized twice due to the difference between the two eyes. Further, by making it possible to detect the positions of both eyes of the user, it is possible to visually recognize the guide image superimposed at an appropriate position regardless of the current position of the user's eyes and the type of eyes to be visually recognized.

It is a schematic block diagram of the superimposed image display apparatus which concerns on this embodiment. It is the figure which showed the structure of the front display which concerns on this embodiment. It is a figure showing the display mode of the image for the right eye and the image for the left eye of the front display concerning this embodiment. It is a block diagram showing a navigation device concerning this embodiment. It is a flow chart of a driving support processing program concerning this embodiment. It is the figure which showed the example of the virtual image of the 1st guidance image and 2nd guidance image visually recognized by the passenger | crew of a vehicle. It is the figure which showed the example of the virtual image of the 1st guidance image visually recognized by the passenger of a vehicle. 7 is a flowchart of a sub-processing program of display range determination processing. It is a figure explaining the method of determining the display range of the 1st guidance image on the front display.

Hereinafter, a detailed description will be given with reference to the drawings based on an embodiment in which a superimposed image display device according to the present invention is embodied. First, the schematic configuration of the superimposed image display device 1 according to the present embodiment will be described with reference to FIG. FIG. 1 is a schematic configuration diagram of a superimposed image display device 1 according to the present embodiment.

As shown in FIG. 1, the superimposed image display device 1 basically has a navigation device 3 mounted on a vehicle 2 and a front display 4 also mounted on the vehicle 2 and connected to the navigation device 3. The front display 4 functions as a head-up display together with the windshield 5 of the vehicle 2 as described later, and serves as an information providing means for providing various information to the occupant 6 of the vehicle 2.

Here, the navigation device 3 searches for a recommended route to the destination, displays a map image around the current position of the vehicle 2 based on the map data acquired from the server or stored in the memory, and is set. The front display 4 has a function of providing driving guidance along the guide route, warning of obstacles, and the like. The navigation device 3 does not have to have all of the functions described above, and the present invention can be configured as long as the navigation device 3 has at least a function of performing traveling guidance along the guide route, warning of obstacles, and the like. is there. The details of the structure of the navigation device 3 will be described later.

On the other hand, the front display 4 is a liquid crystal display installed inside the dashboard 7 of the vehicle 2 and having a function of displaying an image on an image display surface provided on the front surface. As the backlight, for example, CCFL (cold cathode tube) or white LED is used. As the front display 4, a combination of an organic EL display or a liquid crystal projector and a screen may be used instead of the liquid crystal display.

The front display 4 functions as a head-up display together with the windshield 5 of the vehicle 2, and the image output from the front display 4 is reflected on the windshield 5 in front of the driver's seat so that the occupant 6 of the vehicle 2 can visually recognize the image. Is configured. The images displayed on the front display 4 include information about the vehicle 2 and various information used to support the driving of the occupant 6. For example, a warning for an object (other vehicle, pedestrian, guide sign) that is a warning target for the occupant 6, a guide route set by the navigation device 3 or guide information based on the guide route (arrows indicating right / left turn directions, etc.) , Warnings displayed on the road surface (crash collision, speed limits, etc.), lane markings on which the vehicle is traveling, current vehicle speed, shift position, energy level, advertisement image, facility information, map image, traffic information, news, weather forecast , Time, connected smartphone screen, TV program, etc.

Further, the front display 4 of the present embodiment is a liquid crystal display provided with a parallax barrier or a lenticular lens, and an image to be viewed only by the right eye of the occupant 6 (hereinafter referred to as an image for the right eye) and an image viewed by only the left eye of the occupant 6 The images to be displayed (hereinafter, referred to as left-eye images) can be displayed. Therefore, if the above-mentioned warning, guidance information, and the like are displayed only as an image for the right eye, the information can be visually recognized only by the right eye. Further, if it is displayed only as the image for the left eye, it becomes possible to make the information visible only to the left eye. Further, if the information is displayed on both the right-eye image and the left-eye image, it becomes possible for both eyes to visually recognize the information.

For example, in the front display 4 using a parallax barrier, as shown in FIG. 2, a parallax barrier (parallax barrier) 9 having lattice-shaped gaps is arranged in front of the image display area 8 of the front display 4. In the image display area 8, the image displayed using the area (pixel) 8A that is visible from the right eye of the occupant 6 through the gap of the parallax barrier 9 is an image that is visible only to the right eye (that is, the image for the right eye). Becomes On the other hand, in the image display area 8, the image displayed using the area (pixel) 8B that is visible from the left eye of the occupant 6 through the gap of the parallax barrier 9 is an image that is visible only to the left eye (that is, the image for the left eye). Becomes

In addition, in the present embodiment, since a camera is arranged in the vehicle and the positions of the left and right eyes of the occupant 6 can be respectively detected, the area 8A for displaying the image for the right eye and the area 8B for displaying the image for the left eye. Can also be corrected according to the position of the eyes of the occupant 6. For example, if it is detected that the position of the left eye of the occupant 6 has moved from L1 to R1, or if the position of the right eye of the occupant 6 has been moved from R1 to L1, the image for the right eye is displayed. The area 8A to be displayed and the area 8B to display the image for the left eye are switched. Alternatively, as shown in FIG. 3, when the area 8A for displaying the image for the right eye and the area 8B for displaying the image for the left eye are composed of a plurality of pixels in the horizontal direction, the area 8A for displaying the image for the right eye and the image for the left eye are Instead of switching the display area 8B at once, it is possible to move the display area 8B pixel by pixel according to the change in the position of the eyes of the user. As a result, the right-eye image can be accurately viewed by the user's right eye, and the left-eye image can be accurately viewed by the user's left eye, regardless of the position of the user's eyes.

As a means for displaying an image, an organic EL display, a combination of a liquid crystal projector and a screen may be used instead of a liquid crystal display, but it is a means capable of displaying an image for the right eye and an image for the left eye respectively. Is desirable.

Also, polarizing glasses or liquid crystal shutter glasses may be used as a means for displaying the image for the right eye and the image for the left eye. Specifically, the occupant 6 wears polarized glasses or liquid crystal shutter glasses to visually recognize the front display 4 through the polarized glasses or liquid crystal shutter glasses. The front display 4 displays an image for a right eye image and a left eye image by displaying an image of a method corresponding to the glasses worn (for example, liquid crystal shutter glasses alternately display a right eye image and a left eye image). Is possible. Further, in addition to the above examples, any display means such as a head-mounted display (HMD) type capable of displaying a right-eye image and a left-eye image can be applied to the present application.

Further, when the occupant 6 sees the image displayed on the front display 4 by reflecting the windshield 5, the occupant 6 does not see the position of the windshield 5 but the front display at a position far away from the windshield 5. The image displayed in 4 is configured to be visually recognized as the virtual image 10. Further, the virtual image 10 is displayed by being superimposed on the surrounding environment (landscape, real scene) in front of the vehicle, and is superimposed on, for example, an arbitrary object (road surface, building, object to be warned, etc.) located in front of the vehicle. It is also possible to display them.

Here, the position at which the virtual image 10 is generated, more specifically, the distance L from the occupant 6 to the virtual image 10 (hereinafter referred to as the imaging distance) is determined by the position of the front display 4. For example, the imaging distance L is determined by the distance (optical path length) along the optical path from the position where the image is displayed on the front display 4 to the windshield 5. For example, the optical path length is set so that the imaging distance L is 1.5 m.

Further, in the present embodiment, the front display 4 is used as the means for displaying the image to be superimposed on the surrounding environment in front of the vehicle, but other means may be used. For example, a window shield display (WSD) that displays an image on the windshield 5 may be used. In WSD, an image may be displayed from a projector using the windshield 5 as a screen, or the windshield 5 may be used as a transmissive liquid crystal display. The image displayed on the windshield 5 by the WSD is an image to be superimposed on the surrounding environment in front of the vehicle, like the front display 4.

Also, a front camera 11 is installed above the front bumper of the vehicle, behind the room mirror, and the like. The front camera 11 is an imaging device having a camera that uses a solid-state imaging device such as a CCD, and is installed with the optical axis direction facing forward in the traveling direction of the vehicle. Then, by performing image processing on the captured image captured by the front camera 11, the situation of the front environment (that is, the environment in which the virtual image 10 is superimposed) visually recognized by the occupant 6 through the windshield is detected. It A sensor such as a millimeter wave radar may be used instead of the front camera 11.

Also, an in-vehicle camera 12 is installed on the upper surface of the instrument panel of the vehicle. The in-vehicle camera 12 is an imaging device having a camera using a solid-state imaging device such as a CCD, and is installed with the optical axis direction facing the driver's seat. The range in which the occupant's face is generally expected to be located inside the vehicle is set as the detection range (imaging range of the in-vehicle camera 12), and the face of the occupant 6 sitting in the driver's seat is imaged. Then, image processing is performed on the captured image captured by the in-vehicle camera 12 to detect the position of the left and right eyes of the occupant 6 (line-of-sight start point) and the line-of-sight direction.

Next, a schematic configuration of the navigation device 3 which constitutes the superimposed image display device 1 will be described with reference to FIG. FIG. 4 is a block diagram showing the navigation device 3 according to the present embodiment.

As shown in FIG. 4, the navigation device 3 according to the present embodiment includes a current position detection unit 13 that detects the current position of the vehicle 2 in which the navigation device 3 is mounted, and a data recording unit 14 that records various data. A navigation ECU 15 that performs various kinds of arithmetic processing based on the input information, an operation unit 16 that receives an operation from a user, and a liquid crystal display 17 that displays a map around the vehicle and facility information related to the facility to the user. Communication for communication between a speaker 18 that outputs voice guidance regarding route guidance, a DVD drive 19 that reads a DVD that is a storage medium, and an information center such as a VICS (registered trademark: Vehicle Information and Communication System) center. And a module 20. Further, the navigation device 3 is connected to the front display 4, the front camera 11, the in-vehicle camera 12 and the like described above via an in-vehicle network such as CAN.

Below, each component which the navigation apparatus 3 has is demonstrated in order.
The current position detection unit 13 includes a GPS 21, a vehicle speed sensor 22, a steering sensor 23, a gyro sensor 24, and the like, and is capable of detecting the current vehicle position, azimuth, vehicle traveling speed, current time, and the like. . Here, in particular, the vehicle speed sensor 22 is a sensor for detecting the moving distance and the vehicle speed of the vehicle, generates a pulse in accordance with the rotation of the drive wheels of the vehicle, and outputs a pulse signal to the navigation ECU 15. Then, the navigation ECU 15 calculates the rotational speed and the moving distance of the drive wheels by counting the generated pulses. It is not necessary for the navigation device 3 to include all of the four types of sensors, and the navigation device 3 may include only one or a plurality of types of these sensors.

The data recording unit 14 also reads a hard disk (not shown) as an external storage device and a recording medium, a map information DB 31 and a predetermined program recorded in the hard disk, and a driver for writing predetermined data in the hard disk. And a recording head (not shown). The data recording unit 14 may have a flash memory, a memory card, or an optical disk such as a CD or a DVD instead of the hard disk. Further, the map information DB 31 may be stored in an external server and the navigation device 3 may obtain it by communication.

Here, the map information DB 31 is, for example, link data 32 regarding roads (links), node data 33 regarding node points, point data 34 regarding points such as facilities, intersection data regarding each intersection, and map display data for displaying a map. The storage means stores search data for searching a route, search data for searching a spot, and the like.

Here, as the link data 32, for example, a link ID for identifying the link, end node information for identifying a node located at the end of the link, a road type of a road formed by the link, and the like are stored. . In addition, as the node data 33, a node ID for identifying the node, a position coordinate of the node, connection destination node information for identifying a connection destination node to which the node is connected via a link, and the like are stored. Further, as the point data 34, various kinds of information regarding facilities to be set as a destination are stored. For example, the ID for identifying the facility, the facility name, the position coordinates, the genre, the address, etc. are stored.

On the other hand, the navigation ECU (electronic control unit) 15 is an electronic control unit that controls the entire navigation device 3, and a CPU 41 as an arithmetic unit and a control unit, and a working memory for the CPU 41 to perform various arithmetic processes. In addition to the RAM 42 that stores the route data when the route is searched, the control program, and the ROM 43 and the ROM 43 that store a driving support processing program (FIG. 5) described below and the like. An internal storage device such as a flash memory 44 for storing a program is provided. The navigation ECU 15 has various means as a processing algorithm. For example, the position detecting means detects the positions of both eyes of the user. The display position determining means determines the display position of the image on the front display 4 based on the positions of the eyes of the user detected by the position detecting means.

The operation unit 16 is operated when inputting a departure point as a travel start point and a destination as a travel end point, and has a plurality of operation switches (not shown) such as various keys and buttons. Then, the navigation ECU 15 performs control so as to execute various corresponding operations based on the switch signal output by pressing each switch. The operation unit 16 may have a touch panel provided on the front surface of the liquid crystal display 17. Further, it may have a microphone and a voice recognition device.

Further, on the liquid crystal display 17, a map image including roads, traffic information, operation guidance, operation menu, key guidance, guidance route from the departure point to the destination, guidance information along the guidance route, news, weather forecast, Time, mail, TV programs, etc. are displayed. In addition, since the front display 4 is provided as the information display means in the present embodiment, the liquid crystal display 17 may be omitted if the front display 4 is used to display the map image and the like.

Further, the speaker 18 outputs voice guidance for guiding the driver to travel along the guide route and guidance for traffic information based on an instruction from the navigation ECU 15.

The DVD drive 19 is a drive that can read data recorded on a recording medium such as a DVD or a CD. Then, based on the read data, reproduction of music or video, updating of the map information DB 31, etc. are performed. A card slot for reading and writing a memory card may be provided instead of the DVD drive 19.

The communication module 20 is a communication device for receiving traffic information including traffic congestion information, regulation information, traffic accident information and the like transmitted from a traffic information center, for example, a VICS center or a probe center. For example, a mobile phone or DCM is applicable.

Next, a driving support processing program executed by the navigation device 3 among the superimposed image display device 1 having the above-described configuration will be described with reference to FIG. FIG. 5 is a flowchart of the driving support processing program according to the present embodiment. Here, the driving support processing program is executed after the ACC power supply (accessory power supply) of the vehicle is turned on, and by superimposing the image displayed on the front display 4 on the surrounding environment of the vehicle for visual recognition, It is a program that provides various information to passengers. The programs shown in the flowcharts of FIGS. 5 and 8 below are stored in the RAM 42 or the ROM 43 included in the navigation device 3, and are executed by the CPU 41.

In the following description, particularly using the front display 4, a guide arrow indicating the traveling direction of the vehicle along the guide route set by the navigation device 3 and information about the vehicle (for example, current vehicle speed, shift position, remaining energy amount) An example of providing the above will be described. However, it is possible to provide guidance and information other than the above. For example, a warning for an object (for example, another vehicle, a pedestrian, a guide sign) that is a warning target for the occupant 6 of the vehicle 2, a warning displayed on the road surface (a rear-end collision warning, a speed limit, etc.), and a lane section in which the vehicle travels It is possible to display lines, advertisement images, facility information, map images, traffic information, news, weather forecast, time, screens of connected smartphones, TV programs, and the like.

First, in the driving support processing program, in step (hereinafter abbreviated as S) 1, the CPU 41 acquires the current position information of the own vehicle, the map information around the own vehicle, and the guide route set by the navigation device 3, respectively. . The current position of the host vehicle is detected using, for example, the GPS 21 or the vehicle speed sensor 22. When the vehicle travels on a road having a plurality of lanes, it is desirable to specify the lane in which the vehicle travels. Further, the map information around the own vehicle is acquired from the map information DB 31 or an external server. The map information includes information that identifies the shape of the road and the lane segment.

Next, in S2, the CPU 41 performs image processing such as binarization processing on the captured image captured by the front camera 11 to display the road surface of the road on which the vehicle is running, which is the target of superimposition of the virtual image of the guide arrow. To detect.

Subsequently, in S3, the CPU 41 specifies a specific position of the road surface of the road on which the vehicle on which the virtual image of the guide arrow is to be superimposed (hereinafter referred to as a superimposition target road surface) is three-dimensional position coordinates. For example, the road surface of the road (including the guidance intersection if there is a guidance intersection) 100 m ahead from the current position of the vehicle along the guidance route is set as the superimposition target road surface. The position of the road surface to be superimposed may be specified based on the imaged image taken by the front camera 11, or may be specified using a sensor such as a millimeter wave radar. Further, when the navigation device 3 can acquire map information including three-dimensional information, it is also possible to specify the position of the road surface to be superimposed on the basis of the map information and the current position of the vehicle.

Also, the position of the road surface to be superimposed will be continuously specified until the driving support processing program ends. For example, if the position of the road surface to be superimposed is specified for each frame of the image captured by the front camera 11, the current position of the road surface to be superimposed can be continuously specified.

Next, in S4, the CPU 41 determines whether or not to provide information about the vehicle via the front display 4. The information regarding the own vehicle includes, for example, the current vehicle speed, the shift position, the remaining energy level, and the like. It should be noted that the ON / OFF switching of the provision of information regarding the own vehicle can be performed by the operation of the vehicle occupant. Further, ON or OFF may be automatically switched based on the surrounding situation or the state of the vehicle.

Then, if it is determined that the information regarding the own vehicle is provided via the front display 4 (S4: YES), the process proceeds to S5. On the other hand, when it is determined that the information regarding the own vehicle is not provided via the front display 4 (S4: NO), the process proceeds to S9.

After that, in S5, the CPU 41 performs display range determination processing (FIG. 8) described later. In the display range determination processing, the range in which the guide image is projected on the windshield 5 (that is, the range in which the guide image is displayed on the front display 4) is determined. After S5, an image of a guide arrow (hereinafter referred to as the first guide image) indicating the traveling direction of the vehicle along the guide route set by the navigation device 3 and an image (hereinafter referred to as the first guide image) that guides information about the vehicle. Two types of images (referred to as 2 guide images) are displayed. Therefore, in S5, the display range of each of the first guide image and the second guide image is determined.

Here, the first guide image is an image that needs to be maintained in a state of being superposed on a specific object (specifically, a superposition target road surface) included in the surrounding environment visually recognized from the vehicle. Further, the first guide image is one of the images selected for the right-eye image or the left-eye image on the front display 4 in order to prevent the image from being visually recognized twice due to the difference between the two eyes. It is displayed (that is, the first guidance image is visually recognized only by one of the right eye and the left eye). Therefore, in S5, the display range of the first guide image in the selected one of the right-eye image and the left-eye image is determined as described later.

On the other hand, the second guide image is an image that does not need to be maintained in a state in which it is superposed on a specific object included in the surrounding environment visually recognized by the vehicle. Further, since the accuracy of the overlapping position of the second guide image does not matter as compared with the first guide image, both the right-eye image and the left-eye image are displayed on the front display 4 so that they can be visually recognized more comfortably. The image is displayed (that is, the second guidance image is visually recognized by both the right eye and the left eye). Therefore, in S5, the display range of the second guide image in both the right-eye image and the left-eye image is determined as described later.

Subsequently, in S6, the CPU 41 transmits a control signal to the front display 4 and displays the first guide image on the front display 4 in the display range of the image for the right eye or the image for the left eye determined in S5. . Further, the second guide image is displayed in each display range of the image for the right eye and the image for the left eye determined in S5. As a result, the virtual images of the first guide image and the second guide image are visually recognized by the occupant of the vehicle in an overlapping manner with the surrounding environment in front of the vehicle. In particular, the virtual image of the first guide image is visually recognized as being overlapped with the road surface to be superimposed when visually recognized by an occupant of the vehicle.

Here, FIG. 6 shows the contents of the left-eye image and the right-eye image displayed on the front display 4 in S6, and the first guide image visually recognized by the occupant of the vehicle as a result of visually recognizing the left-eye image and the right-eye image. FIG. 6 is a diagram showing an example of a virtual image of a second guide image.

In the example shown in FIG. 6, the first guidance image 55 is displayed as the left-eye image 56, and the second guidance image 57 is displayed as the left-eye image 56 and the right-eye image 58. Further, among the left-eye image 56 and the right-eye image 58, the display area in which the first guide image 55 and the second guide image 57 are not displayed is a black image or an image with zero brightness. Therefore, the region of the right-eye image 58 corresponding to the first guide image 55 displayed on the left-eye image 56 becomes a black image or an image of 0 brightness, and even when the front display 4 is visually recognized by both eyes, It is possible for only one eye to visually recognize the first guide image. As a result of the occupant 6 of the vehicle visually recognizing the left-eye image 56 with the left eye and the right-eye image 58 with the right eye, the virtual image of the first guide image 55 superimposed on the surrounding environment is displayed with the left eye over the windshield 5 of the vehicle. The virtual image of the second guide image 57 is visually recognized by both eyes.

Here, the virtual image of the first guide image 55 is visually recognized in the surrounding environment, in particular, on the road surface 59 to be superimposed in front of the vehicle. FIG. 6 is an example of the first guidance image 55 displayed when the guidance route is a route that turns right at the front guidance intersection, and the first guidance image 55 is an image of an arrow indicating that the first guidance image 55 turns right at the guidance intersection. And As a result, the occupant can grasp the position of the guided intersection and the traveling direction of the vehicle at the guided intersection without moving the line of sight from the front of the traveling direction. Further, since the virtual image of the first guide image 55 is visually recognized only by the left eye of the occupant of the vehicle, it is possible to prevent a phenomenon in which the image is double visually recognized due to the difference between both eyes. The display of the first guide image 55 is basically performed while the guide route is set (a straight arrow is displayed when going straight), but is only displayed when approaching the guidance intersection. You may do it.

On the other hand, the virtual image of the second guide image 57 is visually recognized in the vicinity of the center of the lower edge of the windshield 5 of the vehicle, being superimposed on the surrounding environment. Unlike the first guide image, the second guide image 57 is not superposed on a specific object, but is fixed at the same position on the windshield 5 and is visually recognized. In the example shown in FIG. 6, the second guidance image 57 is an image showing the current vehicle speed of the vehicle. As a result, the occupant can grasp the current vehicle speed of the vehicle without moving the line of sight from the front in the traveling direction. Further, since the virtual image of the second guide image 57 is visually recognized by both eyes of the occupant of the vehicle, there is no sense of discomfort as compared with the case of viewing with one eye. The display of the second guidance image 57 is basically always performed when the information provision of the own vehicle using the front display 4 is turned on.

In addition, since the first guide image 55 needs to be maintained on the superimposition target road surface 59 viewed by the occupant of the own vehicle, the own vehicle moves (that is, the position and size of the surrounding environment viewed by the vehicle are Change), the display range of the first guide image 55 is newly determined in S5, and the display range is updated. That is, when the surrounding environment visually recognized from the vehicle changes, the display position and the display size of the first guide image 55 also change in association with it. In other words, the first guidance image 55 is an image associated with the position where it is superimposed in the surrounding environment.

On the other hand, since the second guide image 57 does not need to be superimposed on a specific object, it is basically displayed at a fixed position of the windshield 5 (for example, near the center of the lower edge). That is, the display position of the second guide image 57 is not linked to the change of the surrounding environment visually recognized from the own vehicle, and the display range initially determined in S5 is basically unchanged. In other words, the second guide image 57 is an image in which the positions to be superimposed in the surrounding environment are not associated.

Next, in S7, the CPU 41 determines whether to switch the eyes of the occupant who visually recognizes the first guidance image to the other eye. For example, when the occupant's left eye visually recognizes, when the occupant changes his / her posture and the left eye deviates from the detection area where the eye position of the occupant 6 can be detected by the in-vehicle camera 12, or the edge of the detection area. On the other hand, when it approaches within a predetermined distance (for example, within 5 cm) or when the fatigue level of the left eye exceeds the threshold value, it is determined that the occupant's eye visually recognizing the first guidance image is switched to the right eye. Similarly, when the occupant's right eye visually recognizes, when the occupant changes his / her posture and the right eye deviates from the detection area where the position of the eyes of the occupant 6 can be detected by the in-vehicle camera 12, or the edge of the detection area. It is determined that the eyes of the occupant who visually recognizes the first guidance image are switched to the left eye when the distance to the part is within a predetermined distance (for example, within 5 cm) or when the fatigue level of the right eye exceeds a threshold value. The degree of eye fatigue is estimated from the viewing time of the first guide image. For example, it is determined that the fatigue level of the left eye exceeds the threshold value when the state in which the left eye visually recognizes the first guidance image becomes a predetermined time (for example, 10 minutes) or more.

Also, the timing of switching the eyes of the passenger who visually recognizes the first guidance image to the other eye is the timing when the first guidance image is hidden. The first guide image is basically displayed while the guide route is set, but is displayed in a display mode in which display and non-display are repeated at regular intervals (for example, in units of 1 sec). By switching the eyes of the occupant who visually recognizes the first guidance image at the timing when the first guidance image is not displayed, it is possible to switch the eyes to be visually recognized without causing the occupant to feel discomfort. .

Also, the timing of switching the eyes of the passenger who visually recognizes the first guidance image to the other eye may be the timing of changing the display mode of the first guidance image. For example, as shown in FIG. 6, when the first guide image is a guide arrow indicating the traveling direction of the vehicle along the guide route, there are a case of guiding to turn right and left and a case of guiding to go straight. It is possible to change the spacing of the guide arrows. Specifically, in the case of guiding to go straight ahead, it is desirable to make the interval between the guide arrows wider than in the case of guiding to turn right or left. Therefore, by switching the eyes of the occupant who visually recognizes the first guidance image at the timing when the interval of the guide arrows is changed, that is, at the timing when the display mode of the first guidance image is changed, the occupant feels uncomfortable. It is possible to switch the eyes to be visually recognized without giving them. The timing of changing the display mode of the first guide image may be, in addition to the timing of changing the interval of the guide arrows, the timing of changing the shape of the guide arrows, the timing of changing the display color of the guide arrows, or the like.

Then, when it is determined that the eyes of the occupant who visually recognizes the first guidance image are switched to the other eye (S7: YES), the eyes of the occupant who visually recognizes the first guidance image is switched to the other eye (S8). . For example, when the left eye is selected, the right eye is subsequently selected as the eyes of the passenger who visually recognizes the first guidance image. Then, the display range of the first guidance image 55 is determined based on the position of the eyes of the occupant newly switched in S5, and the display range is updated. When the first guide image 55 is displayed on the left-eye image 56, the first guide image 55 is displayed on the right-eye image 58 thereafter, while the first guide image 55 is displayed on the right-eye image 58. If it is displayed, the first guide image 55 is displayed as the left-eye image 56 thereafter. The first guidance image 55 is visually recognized by the occupant at the same position before and after the eyes of the occupant visually recognizing the first guidance image 55 are switched.

On the other hand, when it is determined that the eyes of the passenger who visually recognizes the first guidance image are not switched to the other eyes (S7: NO), the current display mode is continued.

On the other hand, in the determination process of S4, if it is determined that the information regarding the own vehicle is not provided via the front display 4 (S4: NO), in S9, similarly to S5, the display range determination described below is performed. Processing (FIG. 8) is performed. However, in S9, only the first guide image is displayed and only the display range of the first guide image is determined.

After that, in S10, the CPU 41 transmits a control signal to the front display 4, and displays the first guide image on the front display 4 in the display range of the image for the right eye or the image for the left eye determined in S9. As a result, the virtual image of the first guidance image is visually recognized by the occupant of the vehicle in a superimposed manner on the surrounding environment in front of the vehicle. In particular, the virtual image of the first guide image is visually recognized as being overlapped with the road surface to be superimposed when visually recognized by an occupant of the vehicle.

Here, FIG. 7 shows the contents of the left-eye image and the right-eye image displayed on the front display 4 in S10, and the first guide image visually recognized by the occupant of the vehicle as a result of visually recognizing the left-eye image and the right-eye image. FIG. 6 is a diagram showing an example of a virtual image of a second guide image.

In the example shown in FIG. 7, the first guidance image 55 is displayed as the left-eye image 56. Further, in the left-eye image 56, the display area in which the first guide image 55 is not displayed and the entire right-eye image 58 are black images or images with zero brightness. Therefore, the region of the right-eye image 58 corresponding to the first guide image 55 displayed on the left-eye image 56 becomes a black image or an image of 0 brightness, and even when the front display 4 is visually recognized by both eyes, It is possible for only one eye to visually recognize the first guide image. As a result of the occupant 6 of the vehicle visually recognizing the left-eye image 56 with the left eye and the right-eye image 58 with the right eye, the virtual image of the first guide image 55 superimposed on the surrounding environment is displayed with the left eye over the windshield 5 of the vehicle. To be seen.

Here, the virtual image of the first guide image 55 is visually recognized in the surrounding environment, in particular, on the road surface 59 to be superimposed in front of the vehicle. FIG. 7 is an example of the first guidance image 55 displayed when the guidance route is a route that makes a right turn at the guidance intersection ahead, and the first guidance image 55 is an image of an arrow indicating that the guidance route turns right at the guidance intersection. And As a result, the occupant can grasp the position of the guided intersection and the traveling direction of the vehicle at the guided intersection without moving the line of sight from the front of the traveling direction. Further, since the virtual image of the first guide image 55 is visually recognized only by the left eye of the occupant of the vehicle, it is possible to prevent a phenomenon in which the image is double visually recognized due to the difference between both eyes. The display of the first guide image 55 is basically performed while the guide route is set (a straight arrow is displayed when going straight), but is only displayed when approaching the guidance intersection. You may do it. Then, the process proceeds to S7.

Next, the sub-process of the display range determination process executed in S5 and S9 will be described with reference to FIG. FIG. 8 is a flowchart of a sub-process program of the display range determination process.

First, in S11, the CPU 41 detects the positions of the left and right eyes of the occupant of the vehicle (starting point of sight line) based on the captured image captured by the in-vehicle camera 12. The detected eye position is specified by three-dimensional position coordinates.

Next, in S12, the CPU 41 selects either the right eye or the left eye as the eyes of the occupant who visually recognizes the first guidance image. For example, the selection is made according to the following criteria (1) to (4). The condition (1) is given the highest priority, and any of the conditions (2) to (4) may be adopted.
(1) If only one eye is included in the detection area in which the position of the eyes of the occupant 6 can be detected by the in-vehicle camera 12, the included eyes are selected.
(2) If both eyes are included in the detection area and the dominant eye of the occupant can be determined, the dominant eye of the occupant is selected.
(3) When both eyes are included in the detection area, the fatigue level of the left and right eyes is detected from the image captured by the in-vehicle camera 12, and the eye with the lesser fatigue level is selected.
(4) When the detection area includes both eyes, the eye closer to the center of the detection area is selected.

The eyes of the occupant who visually recognizes the first guidance image selected in S12 may not be continuously fixed thereafter, but may be switched to the other eye in the subsequent processing of S8. However, the eyes of the occupant who visually recognizes the first guidance image may be fixed.

Next, in S13, the CPU 41 determines whether or not the display on the front display 4 is ON. The display of the front display 4 can be switched between ON and OFF by an operation of a vehicle occupant. Further, ON or OFF may be automatically switched based on the surrounding situation or the state of the vehicle.

If it is determined that the display on the front display 4 is ON (S13: YES), the process proceeds to S14. On the other hand, when it is determined that the display on the front display 4 is OFF (S13: NO), the process ends without displaying the virtual images of the first guide image and the second guide image on the front display 4.

In S14, the CPU 41 acquires the position coordinates of the windshield 5 on which the image is projected by the front display 4. The position coordinates of the windshield 5 are specified by three-dimensional position coordinates.

Next, in S15, the CPU 41 causes the position coordinates of the road surface to be superimposed detected in S3, the position coordinates of the position of the eyes of the occupant of the vehicle (gaze starting point) detected in S11, and the front acquired in S14. Based on the position coordinates of the glass 5, position coordinates for displaying the first guide image and the second guide image on the windshield 5 are calculated. Specifically, the display position of the first guide image is set to a position where the virtual image of the first guide image overlaps with the road surface to be superimposed and is visually recognized by the vehicle occupant as shown in FIGS. 8 and 9. On the other hand, the display position of the second guide image is the fixed position of the windshield 5 (for example, near the center of the lower edge) as shown in FIG.

Subsequently, in S16, the CPU 41 determines the projection range of the first guidance image and the second guidance image on the windshield 5 based on the position coordinates calculated in S15. Further, the display range of the first guide image and the second guide image on the front display 4 is also determined from the determined projection range. Further, the front display 4 of the present embodiment can respectively display a right-eye image that is viewed by only the right eye of the occupant 6 and a left-eye image that is viewed by only the left eye of the occupant 6. Then, for the first guide image, the display range in the image corresponding to the eye selected in S12 (the image for the right eye if viewed by the right eye) is specified from among the image for the left eye and the image for the right eye. On the other hand, for the second guidance image, the display range in both the left-eye image and the right-eye image is specified.

For example, FIG. 9 is a diagram illustrating the details of the determination process of the display range of the first guide image on the front display 4. As shown in FIG. 9, when the line of sight starting point S is the position of the eye selected in S12 among the left and right eyes of the occupant, the windshield 5 is connected by a straight line to connect the line of sight starting point S and the road surface 59 to be superimposed. The projection range of the first guidance image at is determined. Further, the display range of the first guide image on the front display 4 is also determined based on the visual angle from the line-of-sight start point S to the projection range and the inclination angle of the windshield 5.

When the first guidance image is viewed with one eye, the line-of-sight start point S is one point, and therefore the processing relating to the determination of the display range of the first guidance image on the front display 4 is viewed with both eyes. It can be simplified as compared with the case.

After that, the process proceeds to S6 and S10, and virtual images of the first guidance image and the second guidance image are displayed based on the determined projection range and display range. The processes of S1 to S8 are repeated until the display on the front display 4 is turned off.

As described in detail above, according to the superimposed image display device and the computer program executed in the superimposed image display device according to the present embodiment, the image for the right eye to be viewed only by the right eye of the user and the left eye that is viewed only by the left eye of the user. The front display 4 capable of displaying the use images respectively is provided to detect the positions of both eyes of the vehicle occupant (S11), and the display position of the guide image on the front display 4 is determined based on the detected positions of both eyes of the occupant. (S16), in particular, by displaying the first guidance image as either the right-eye image or the left-eye image, the first guidance image displayed on the front display 4 is superimposed on the surrounding environment around the vehicle. Since it is made to be visually recognized (S6, S10), both eyes can be viewed by making only one eye of the occupant visually recognize the first guidance image. First guide image it is possible to prevent that the event is visible to the doubly caused by. Further, by making it possible to detect the positions of both eyes of the occupant, it is possible to visually recognize the first guide image superimposed at an appropriate position regardless of the current position of the occupant's eyes and the type of eyes to be visually recognized. To do.

It should be noted that the present invention is not limited to the above embodiment, and it is needless to say that various improvements and modifications can be made without departing from the gist of the present invention.
For example, in the above-described embodiment, the virtual image is generated in front of the windshield 5 of the vehicle 2 by the front display 4, but the virtual image may be generated in front of the window other than the windshield 5. Further, the object on which the image is reflected by the front display 4 may be the visor (combiner) installed around the windshield 5 instead of the windshield 5 itself.

Further, in the present embodiment, the front display 4 is used as a means for displaying an image superimposed on the surrounding environment, but a window shield display (WSD) for displaying an image on the windshield 5 may be used.

In the present embodiment, the first guide image is displayed as either the right-eye image or the left-eye image, and the second guide image is displayed as both the right-eye image and the left-eye image. The two-guidance image may be displayed as either the right-eye image or the left-eye image. In that case, the first guidance image and the second guidance image may be viewed with the same eye or different eyes (for example, the first guidance image is the left eye, and the second guidance image is the right eye. ).

Further, in the present embodiment, the first guide image is an image of a guide arrow indicating the traveling direction of the vehicle along the guide route set by the navigation device 3, but other images may be used. For example, a warning image of an object (for example, another vehicle, a pedestrian, a guide sign) that is a warning target for a vehicle occupant, an image of a lane marking in which the vehicle travels, or the like may be used.

Further, in the present embodiment, the first guidance image is an image that needs to be maintained in a state of being superimposed on a specific object (for example, a road surface) included in the surrounding environment visually recognized from the vehicle. It may be an image (for example, an image of a smartphone, a map image, etc.) that does not need to be maintained in the state of being superposed on.

Further, in the present embodiment, the processing of the driving support processing program (FIG. 5) is configured to be executed by the navigation ECU 15 of the navigation device 3, but the execution subject can be appropriately changed. For example, it may be configured to be executed by the control unit of the front display 4, the vehicle control ECU, and other vehicle-mounted devices. When the control unit of the front display 4 executes the superimposing image display device according to the present invention, the superimposition image display device may be configured by only the front display 4.

Further, although the embodiment in which the superimposed image display device according to the present invention is embodied has been described above, the superimposed image display device can also have the following configuration, and in that case, the following effects are exhibited.

For example, the first configuration is as follows.
An image display surface (4) mounted on the vehicle (2) and capable of displaying a right-eye image (58) that is visible only to the right eye of the user (6) and a left-eye image (56) that is visible only to the user's left eye. A superimposed image display device (1) for visually recognizing an image displayed on the image display surface by observing the image with both eyes of a user, by detecting the positions of both eyes of the user. And a display position determining means (41) for determining the display position of the image on the image display surface based on the positions of both eyes of the user detected by the position detecting means, When the guide image (55) to be guided to the user is displayed on the image display surface, it is displayed as either the right-eye image or the left-eye image.
According to the superimposed image display device having the above-described configuration, when the guide image is visually recognized by superimposing it on the surrounding environment of the vehicle, the guide image is visually recognized only by one of the eyes of the user. It is possible to prevent the occurrence of a heavily visually recognized event. Further, by making it possible to detect the positions of both eyes of the user, it is possible to visually recognize the guide image superimposed at an appropriate position regardless of the current position of the user's eyes and the type of eyes to be visually recognized.

The second configuration is as follows.
The guidance image is displayed as both a first guidance image (55) displayed as either the right-eye image (58) or the left-eye image (56), and both the right-eye image and the left-eye image. A second guide image (57) to be executed.
According to the superimposed image display device having the above configuration, by visually recognizing the first guide image with only one eye, it is possible to prevent the phenomenon in which the guide image is double recognized due to the difference between the two eyes. On the other hand, the second guide image can be visually recognized by both eyes without any discomfort.

The third configuration is as follows.
The first guide image (55) is an image that needs to be maintained in a state of being superposed on a specific object (59) included in the surrounding environment visually recognized by the vehicle (2), and the second guide image (55) The guide image (57) is an image that does not need to be maintained in a state of being superimposed on a specific target object included in the surrounding environment visually recognized by the vehicle.
According to the superimposed image display device having the above-described configuration, when the first guide image, which requires the accuracy of the superimposed position, is visually recognized by only one eye, there is a phenomenon that the guide image is double visually recognized due to the difference between both eyes. While it is possible to prevent the second guide image from being generated, it is possible to visually recognize the second guide image that does not require the accuracy of the overlapping position with both eyes.

The fourth configuration is as follows.
When the guide image (55) is displayed as either the right-eye image (58) or the left-eye image (56), the area of the other image corresponding to the guide image displayed as one image Is a black image.
According to the superimposed image display device having the above configuration, even when the image display surface is viewed by both eyes of the user, it is possible to allow only one eye to view the guide image.

The fifth configuration is as follows.
When the guide image (55) is displayed as either the right-eye image (58) or the left-eye image (56), the area of the other image corresponding to the guide image displayed as one image Is an image with 0 brightness.
According to the superimposed image display device having the above configuration, even when the image display surface is viewed by both eyes of the user, it is possible to allow only one eye to view the guide image.

The sixth configuration is as follows.
When the guide image (55) is displayed on the image display surface (4), the guide image has an eye selecting unit (41) for selecting the eyes of the user (6) who visually recognizes the guide image. The image for the right eye (58) or the image for the left eye (56) is displayed in the image corresponding to the eye selected by the eye selecting means.
According to the superimposed image display device having the above-described configuration, when the guide image is viewed by being superimposed on the surrounding environment of the vehicle, the guide image can be viewed only by one eye of the selected user.

The seventh configuration is as follows.
The eye selecting means (41) preferentially selects eyes included in the detection range of the position detecting means (41).
According to the superimposed image display device having the above configuration, the guide image can be visually recognized by the eye capable of detecting the current position on the device side. As a result, it is possible to visually recognize the guide image superimposed on an appropriate position.

The eighth configuration is as follows.
The eye selecting means (41) switches the user's eyes to be selected as a target for visually recognizing the guidance image based on the positional relationship of the user's eyes with respect to the detection range of the position detecting means (41).
According to the superimposed image display device having the above-mentioned configuration, even if the eyes visually recognizing the guide image may be out of the range where the current position can be detected on the device side due to the change in the posture of the user, the guide image is displayed. By switching the eye to be visually recognized to the other eye, it is possible to continuously make only one eye visually recognize the guide image.

The ninth configuration is as follows.
A target for visualizing the guide image (55) based on the degree of fatigue of the eyes of the user, which has a degree of fatigue detecting means (41) for detecting the degree of fatigue of the eyes of the user. Switch the user's eyes to select as.
According to the superimposed image display device having the above-described configuration, even if the fatigue of the eye visually recognizing the guide image is accumulated, the burden on the user is increased by switching the eye to visually recognize the guide image to the other eye. Instead, it is possible to continuously make the guide image visible only to one eye.

The tenth configuration is as follows.
The eye selecting means (41) switches the eyes of the user to be selected as a target for visually recognizing the guide image at the timing when the guide image (55) is hidden.
According to the superimposed image display device having the above configuration, even if the eye for visually recognizing the guide image is switched to the other eye, the guide image visually recognized by the user does not feel uncomfortable.

The eleventh configuration is as follows.
The eye selecting means (41) switches the eyes of the user to be selected as the target for visually confirming the guide image at the timing of changing the display mode of the guide image (55).
According to the superimposed image display device having the above configuration, even if the eye for visually recognizing the guide image is switched to the other eye, the guide image visually recognized by the user does not feel uncomfortable.

The twelfth configuration is as follows.
The display position determining means (41) is arranged on the image display surface (4) based on the position where the guide image (55) is superimposed in the surrounding environment and the eye position selected by the eye selecting means (41). The display position of the guide image is determined.
According to the superimposed image display device having the above configuration, it is possible to simplify the processing relating to the determination of the display position of the guide image, as compared with the case where the guide image is visually recognized by both eyes. Further, regardless of the position of the eyes of the user, it is possible to surely make the guide image visible only to one eye of the selected user.

The thirteenth configuration is as follows.
By reflecting the image displayed on the image display surface (4) on the windshield (5) of the vehicle (2) and making it visible to the user (6), a virtual image of the image displayed on the image display surface is displayed. Make it visible in the surrounding environment around the vehicle.
According to the superimposed image display device having the above configuration, it is possible to visually recognize the guide image by superimposing it on the surrounding environment of the vehicle by the virtual image of the image.

The fourteenth configuration is as follows.
By viewing the image display surface (4) through polarizing glasses or liquid crystal shutter glasses worn by the user (6), only the right-eye image (58) to be viewed by only the right eye of the user and the left eye of the user are displayed. The left-eye image (56) to be visually recognized can be displayed on the image display surface.
According to the superimposed image display device having the above configuration, it is possible to allow the user to visually recognize the guide image only by wearing the polarizing glasses or the liquid crystal shutter glasses.

1 superimposed image display device 2 vehicle 3 navigation device 4 front display 5 windshield 6 occupant 7 dashboard 41 CPU
42 RAM
43 ROM
55 First guidance image 56 Left eye image 57 Second guidance image 58 Right eye image 59 Superimposed road surface

Claims

Displayed on the image display surface by allowing the user's eyes to visually recognize an image display surface that is mounted on a vehicle and that can display a right-eye image that can be viewed only by the user's right eye and a left-eye image that can be viewed only by the user's left eye A superimposed image display device for visually recognizing a superimposed image in the surrounding environment around the vehicle,
Position detecting means for detecting the positions of both eyes of the user,
A display position determining unit that determines the display position of the image on the image display surface based on the positions of both eyes of the user detected by the position detecting unit;
A superimposed image display device for displaying a guidance image to be guided to a user as either the right-eye image or the left-eye image when the guidance image is displayed on the image display surface.
The guide image is
A first guide image displayed as one of the right-eye image or the left-eye image,
The superimposed image display device according to claim 1, further comprising a second guide image displayed as both the image for the right eye and the image for the left eye.
The first guidance image is an image that needs to be maintained in a state of being superimposed on a specific object included in the surrounding environment visually recognized from the vehicle,
The superimposed image display device according to claim 2, wherein the second guide image is an image that does not need to be maintained in a state of being superimposed on a specific object included in the surrounding environment visually recognized by the vehicle.
When the guide image is displayed as either the right-eye image or the left-eye image, the area of the other image corresponding to the guide image displayed as one image is a black image. The superimposed image display device according to claim 1.
When the guide image is displayed as either the right-eye image or the left-eye image, the area of the other image corresponding to the guide image displayed as one image is an image with zero brightness. Item 10. The superimposed image display device according to any one of items 1 to 3.
When the guide image is displayed on the image display surface, it has an eye selecting unit that selects the eyes of the user who visually recognizes the guide image,
The superimposing image display device according to claim 1, wherein the guide image is displayed in an image corresponding to an eye selected by the eye selecting unit out of the right eye image or the left eye image. .
The superposed image display device according to claim 6, wherein the eye selecting means preferentially selects eyes included in the detection range of the position detecting means.
The superimposition according to claim 6 or 7, wherein the eye selecting unit switches the user's eyes to be selected as the target for visually recognizing the guidance image based on the positional relationship of the user's eyes with respect to the detection range of the position detecting unit. Image display device.
It has a fatigue degree detection means for detecting the degree of fatigue of each user's eyes,
The superposed image display device according to claim 6 or 7, wherein the eye selection unit switches the eyes of the user to be selected as the target for visually recognizing the guidance image based on the degree of fatigue of the eyes of the user.
10. The superimposed image display device according to claim 8 or 9, wherein the eye selection unit switches the eyes of the user to be selected as a target for viewing the guide image at a timing when the guide image is hidden.
The superimposed image display device according to claim 8 or 9, wherein the eye selecting unit switches the eyes of the user to be selected as the target for visually recognizing the guide image at the timing of changing the display mode of the guide image.
7. The display position determining means determines the display position of the guide image on the image display surface based on the position where the guide image is superimposed in the surrounding environment and the position of the eye selected by the eye selecting means. The superimposed image display device according to claim 11.
A virtual image of the image displayed on the image display surface is superimposed on the surrounding environment of the vehicle to be visually recognized by reflecting the image displayed on the image display surface on the windshield of the vehicle and allowing the user to visually recognize the image. Item 13. The superimposed image display device according to any one of items 1 to 12.
By visually recognizing the image display surface through polarizing glasses or liquid crystal shutter glasses worn by the user, the image display for the right eye image to be visually recognized only by the user's right eye and the left eye image to be visually recognized only for the user's left eye The superimposed image display device according to any one of claims 1 to 13, wherein the superimposed image display device is capable of displaying each on a surface.
Displayed on the image display surface by allowing the user's eyes to visually recognize an image display surface that is mounted on a vehicle and that can display a right-eye image that can be viewed only by the user's right eye and a left-eye image that can be viewed only by the user's left eye A superimposed image display device for superimposing the displayed image on the surrounding environment around the vehicle for visual recognition,
Position detecting means for detecting the positions of both eyes of the user,
A computer program for functioning as a display position determining unit that determines a display position of an image on the image display surface based on the positions of both eyes of the user detected by the position detecting unit,
A computer program for displaying a guidance image as a guidance target for a user on the image display surface as either the right-eye image or the left-eye image.