JP6971087B2 - Visual assistance device - Google Patents

Description

The present invention relates to a visual recognition assisting device provided in a vehicle such as an automobile and displaying an image of the situation around the own vehicle, and can visually recognize a wide range with a particularly small movement of the line of sight. Regarding things that can be easily grasped.

In a vehicle such as an automobile, an image captured by an image pickup device such as a camera is used to enable an occupant such as a driver during manual driving to easily recognize the situation around the vehicle and reduce the monitoring burden. Various visual aids presented in the above have been proposed.

For example, in Patent Document 1, in a vehicle display device that displays an image of the front of a vehicle captured by an infrared camera on a head-up display, when it is determined from a steering operation that the vehicle turns a curve, a band-shaped image is obtained. Of the data, video data offset by a predetermined image shift amount from the central portion is extracted and displayed.
In Patent Document 2, in a driving support device that magnifies and displays an image of a gaze target to which the driver directs his / her gaze while driving, a magnified image in which the gaze target is enlarged and an annular shape adjacent to the entire outer periphery of the magnified image are described. It is an image, and an image consisting of a peripheral reduced image that has been reduced in size so that the image can be visually recognized by the driver in a state where the images are continuously connected from the enlarged image to the original landscape is generated and displayed in an superimposed manner. It is stated that.
According to Patent Document 3, in a vehicle display device, a mirror image of a road mirror in front of the own vehicle is photographed by a camera, and when the road reflector to be photographed adopts a curved mirror, it is projected and converted into a plane mirror image. It is described that the image processing is performed and the image after the image processing is displayed in the display area of the windshield.
In Patent Document 4, in a vehicle display device that displays an image captured by an infrared camera in front of the own vehicle on a head-up display, the enlargement ratio of the image is gradually changed according to the vehicle speed, and the display unit is enlarged. By emitting the display light indicating the image to the front windshield through the opening of the instrument panel, the driver can visually recognize the image in front of the vehicle by the display light and realize whether the enlarged display is performed. It is stated that it should be done.

Japanese Unexamined Patent Publication No. 2004-155307 Japanese Unexamined Patent Publication No. 2009-43003 Japanese Unexamined Patent Publication No. 2005-178623 Japanese Unexamined Patent Publication No. 2004-168105

By widening the imaging angle of view of the lens of the image pickup device when displaying an image of the situation in front of the own vehicle, an image that displays a wide range with a low display magnification is generated, and more information is presented to the occupants. It becomes possible.
However, when displaying such a wide-angle image, the relationship between the direct field of view and the displayed image is easily understood because the view is significantly different from the field of view (direct field of view) that the occupant can see directly with the naked eye through the window glass. There is concern that it cannot be done.
In view of the above-mentioned problems, an object of the present invention is to provide a visual recognition assisting device that can visually recognize a wide range with a small movement of the line of sight and can easily grasp the relationship between the displayed image and the directly visible visual field. ..

The present invention solves the above-mentioned problems by the following solution means.
The invention according to claim 1 is an imaging device that images the front of the own vehicle, and a display area that is superimposed on or adjacent to the visual field that the occupant visually observes the front of the own vehicle when viewed from the viewpoint of the occupant. It is a visual recognition assisting device including an image display device that displays an image captured by the image pickup device, and the image display device has at least a left-right display magnification when viewed from the viewpoint of the occupant with the naked eye. The reference position set on the image displayed on the image display device, which is reduced with respect to the visual field, is viewed with the naked eye in the line-of-sight direction from the viewpoint of the occupant. The display area of the image display device is arranged so as to substantially coincide with the line-of-sight direction when visually observing, and the display area of the image display device is arranged so as to be offset in the left-right direction with respect to the viewpoint of the occupant, and the reference position is the display area. It is a visual recognition assisting device characterized in that it is set at the end portion on the occupant side in the upper left-right direction.
According to this, by reducing the display magnification of the image display device with respect to the visual field visually viewed by the occupant (widening the angle of view), a wide range of forward view information is provided to the occupant, and the movement of the line of sight is small. A wide range of situations can be visually recognized.
Further, by setting the display position so that the reference position set on the image coincides with the portion corresponding to the reference position visually observed by the naked eye, even a wide-angle image can be visually observed with the naked eye. The relationship with the visual field can be easily grasped.
Further, when the image display device is arranged diagonally forward to the left and right of the occupant, the positional relationship between the visual field directly visible to the naked eye and the image can be easily grasped.
Further, the side of the own vehicle can be visually recognized with a small amount of movement of the line of sight, and the monitoring burden on the occupant can be reduced.

The invention according to claim 2 is characterized by comprising a viewpoint position detecting means for detecting the viewpoint position of the occupant and a reference position setting means for setting the reference position based on the detection result of the viewpoint position. Item 1 is the visual recognition assisting device.
According to this, by detecting the viewpoint position of the occupant, the reference position can be appropriately set on the image, and the above-mentioned effect can be surely obtained.

The invention according to claim 3 is characterized in that the risk object detecting means for detecting the risk object around the own vehicle is provided, and the image display device displays the risk object in a different display mode from the normal one. The visual recognition assisting device according to claim 1 or 2.
According to this, it is possible to alert the occupants when there is a risk object and improve the safety.

The invention according to claim 4, wherein the image display apparatus, visual recognition assistance of claim 3 wherein when the risk object is present and displaying an enlarged display magnification of the risk object It is a device.
According to this, it is possible to draw the attention of the occupants by changing the display magnification, and to improve the visibility of the risk target to promote appropriate countermeasures.

As described above, according to the present invention, it is possible to provide a visual recognition assisting device that can visually recognize a wide range with a small movement of the line of sight and can easily grasp the relationship between the displayed image and the directly visible visual field. ..

It is a block diagram which shows the structure of embodiment of the visual recognition assist device to which this invention is applied. It is a figure which shows an example of the driver's field of view in the vehicle which has the visual recognition assist device of embodiment. It is a flowchart which shows the operation of the visual recognition assist device of embodiment. It is a figure which shows the other example of the driver's field of view in the vehicle which has the visual recognition assist device of embodiment, and is the figure which shows the state which another vehicle is approaching from the side. It is a figure which shows the other example of the driver's field of view in the vehicle which has the visual recognition assist device of embodiment, and is the figure which shows the state when the risk of collision with another vehicle approaching from the side occurs.

Hereinafter, embodiments of the visual recognition assisting device to which the present invention is applied will be described.
The visual recognition assisting device of the embodiment is provided, for example, in an automobile such as a passenger car, and presents an image of the front of the own vehicle to an occupant such as a driver by an image display device to support visual recognition of the situation around the own vehicle.
FIG. 1 is a block diagram showing a configuration of a visual recognition assisting device according to an embodiment.
The visual recognition assisting device 1 of the embodiment includes a stereo camera device 10, an environment recognition unit 20, an occupant monitoring unit 30, a display image generation unit 40, a display device 50, and the like.

The stereo camera device 10, the environment recognition unit 20, the occupant monitoring unit 30, the display image generation unit 40, and the display device 50 are connected to each other via an in-vehicle LAN system such as a CAN communication system or directly to each other. It is possible to send and receive.
Further, each unit is configured to include, for example, information processing means such as a CPU, storage means such as RAM and ROM, an input / output interface, and a bus connecting these.

The stereo camera device 10 includes a camera LH11, a camera RH12, a stereo image processing unit 13, and the like.
The camera LH11 and the camera RH12 are an image pickup device having an optical system such as a lens group for taking a wide-angle image of the front of the own vehicle, a solid-state image pickup element such as CMOS, a drive device thereof, an image processing engine, an input / output interface, and the like. ..
The camera LH11 and the camera RH12 are attached with the optical axis of the optical system facing the front of the vehicle in a state of being separated from each other in the left-right direction.
The camera LH11 and the camera RH12 are fixed, for example, in a state of protruding downward from the front end portion of the roof 130 into the vehicle interior, and are adapted to capture an image of the front of the own vehicle through the windshield 140.

The data related to the images captured by the cameras LH11 and the camera RH12 are sequentially provided to the stereo image processing unit 13.
Further, these image data are also provided to the display image generation unit 40 via the stereo image processing unit 13 in order to generate the display image of the display device 50.
For example, when displaying the situation diagonally to the left and front of the own vehicle as in the present embodiment (see FIG. 2), a display image can be generated using the image captured by the camera LH11.

The stereo image processing unit 13 performs known stereo image processing on the image data sequentially transmitted from the camera LH11 and the camera RH12, recognizes a subject existing in front of the own vehicle, and recognizes the recognized subject relative to the own vehicle. The position is detected by using the pixel position on the image, the parallax between the camera LH11 and the camera RH12, and the like.
Further, the stereo image processing unit 13 determines the type and attribute (for example, other vehicle, bicycle, pedestrian, building, lane end white line, etc.) of the recognized subject by the known image processing and image recognition technology. Is possible.

The environment recognition unit 20 recognizes the environment in front of the own vehicle by using the object detection result in front of the own vehicle by the stereo image processing unit 13.
Among other vehicles, buildings, etc. recognized by the stereo image processing unit 13, the environment recognition unit 20 recognizes a risk object having a high possibility of colliding with the own vehicle from the relative position, the relative speed, and the like with respect to the own vehicle.
The environment recognition unit 20 functions as a risk object detecting means according to the present invention.

When the environment recognition unit 20 determines that a collision between the risk object and the own vehicle is unavoidable based on the relative position of the risk object with respect to the own vehicle, the relative speed (approach speed), etc. (when the pre-crash determination is established). ), Information about the risk object is transmitted to the display image generation unit 40.
Here, as information on the risk object, for example, the type of the risk object, the relative position with respect to the own vehicle, the relative speed, and the like can be mentioned.

The occupant monitoring unit 30 processes an image obtained by an occupant photographing camera 31 of an occupant who is a driver during manual operation, and detects the state of the occupant.
The occupant photography camera 31 is provided on, for example, the instrument panel 140 of the vehicle and captures the face and the like of the occupant to be monitored.
The occupant photography camera 31 can be provided, for example, in the combination meter 141 (see FIG. 2).
The occupant monitoring unit 30 performs predetermined image processing on the image data captured by the occupant photographing camera 31 to detect the position of the viewpoint (eye portion), the line-of-sight direction, the awakening state, and the like.
Information about the viewpoint position of the occupant is transmitted to the display image generation unit 40.
The occupant monitoring unit 30 functions as the viewpoint position detecting means according to the present invention in cooperation with the occupant photographing camera 31.

The display image generation unit 40 uses the image data provided by the stereo camera device 10, information on the risk object by the environment recognition unit 20, and the detection result of the occupant's viewpoint position by the occupant monitoring unit 30 by the display device 50. It generates data for the displayed image to be displayed.
The display image generation unit 40 has a function of setting a display range and a display position to be displayed on the display device 50 among the image data provided by the stereo camera device 10.
In the display image generation unit 40, in a normal state (in a state where no risk object exists), the display image displayed on the display device 50 has a visual field in which the display magnification when viewed from the viewpoint of the occupant can be directly seen with the naked eye. It is displayed so that the reference position P (see FIG. 2), which is small and wide-angle and is set on a part of the screen, coincides with the reference position P in the visual field directly visible to the naked eye. Set the image display range and display position.
The display image generation unit 40 functions as the reference position setting means according to the present invention.
The function of the display image generation unit 40 will be described in more detail later.

The display device 50 is an image display device that presents, for example, an image of an image of the outside of the vehicle diagonally to the left of the own vehicle to the user (occupant).
The display device 50 includes a display for displaying the display image generated by the display image generation unit 40, a drive device thereof, and the like.
As the display device 50, for example, a transparent LCD that is substantially transparent when not displayed and can be seen by the occupant can be used.
The arrangement of the display device 50 will be described in detail later.

As shown in FIG. 3, the vehicle has a windshield 110, a front door glass 120, a side mirror 130, an instrument panel 140, a steering wheel 150, an A pillar 160, a roof 170, a rearview mirror 180 and the like.

The windshield 110 is arranged on the front side of the driver.
The windshield 110 is a quadric curved glass that is formed in a substantially horizontally long rectangular shape and is curved in a direction in which the front is convex.
The windshield 110 is arranged so as to be tilted backward so that the upper end portion is on the rear side of the vehicle with respect to the lower end portion.
When viewed from the occupant's point of view, the transparent portion of the windshield 110 (the portion excluding the black ceramic portion (not shown) provided around the windshield 110) serves as a visual field for the occupant to directly see the front of the vehicle with the naked eye.

The front door glass 120 is an upper portion of the left and right front doors used for passengers to get on and off, and is provided on the side of the driver.
The front door glass 120 has an elevating main body portion 121 and a fixed triangular window portion 122 provided at the front portion of the main body portion 121.

The side mirror 130 allows the driver to confirm the left-right rear view.
The side mirrors 130 project outward in the vehicle width direction from the outer panels of the left and right front doors.
In the user's field of view, the side mirror 130 is visible, for example, in the vicinity of the front end portion of the main body portion 121 of the front door glass 120.

The instrument panel 140 is an interior member provided below the windshield 110 in the vehicle interior.
The instrument panel 140 also functions as a housing for accommodating various instruments, display devices, switches, air conditioners, passenger seat airbag devices, knee protection airbag devices, and the like.
The instrument panel 140 is provided with a combination meter 141, a multifunction display 142, a navigation device display 143, and the like.

The combination meter 141 is provided in front of the driver's seat, and is a unitization of various instruments such as a speedometer, an engine tachometer, and a range finder.
The multifunction display 142 is an image display means such as an LCD provided at the upper portion of the instrument panel 140 in the central portion in the vehicle width direction.
The navigation device display 143 is an image display means such as an LCD on which a navigation device (not shown) displays a map or the like.
The navigation device display 143 is provided at the lower portion of the instrument panel 140 in the central portion in the vehicle width direction.

The steering wheel 150 is an annular operating member for inputting a steering operation during manual operation by the driver.
The steering wheel 150 is provided substantially directly in front of the driver.
The combination meter 141 is visible from the inner diameter side in the upper half of the steering wheel 150 in the user's field of view.

The A-pillar 160 is a columnar vehicle body structural member arranged along the side end portion of the windshield 110 and the front end portion of the windshield 120.
The surface of the A-pillar 160 on the vehicle interior side is covered with a resin pillar trim.

The roof 170 is formed so as to extend rearward from the upper end portion of the windshield 110.
The surface of the roof 170 on the vehicle interior side is covered with a resin roof trim.
A stereo camera accommodating portion 171 in which the camera LH11 and the camera RH12 are accommodated is provided at the front end portion of the roof 170 in the central portion in the vehicle width direction.

The rearview mirror 180 is a rear-view mirror provided in the vehicle interior.
The rearview mirror 180 is provided near the upper end portion of the windshield 110 in the center portion in the vehicle width direction via a stay (not shown).

For example, the screen portion of the display device 50 is provided so as to project from the vicinity of the A pillar 160 on the anti-driver side (left side in the case of FIG. 2) in the left-right direction to the center side (windshield 110 side) in the vehicle width direction. ..
A part of the display device 50 is arranged so as to overlap the front side of the windshield 110 when viewed from the viewpoint of the occupant.

Next, the operation of the visual recognition assisting device of the embodiment will be described.
FIG. 3 is a flowchart showing the operation of the visual recognition assisting device of the embodiment.
Hereinafter, each step will be described step by step.

<Step S01: Acquisition of forward image data>
The display image generation unit 40 acquires image data in front of the own vehicle captured by the camera 11 and the camera RH 12 from the stereo image processing unit 13 of the stereo camera device 10.
Then, the process proceeds to step S02.

<Step S02: Crew viewpoint position detection>
The occupant monitoring unit 30 performs predetermined image processing on the image data captured by the occupant photographing camera 31 to detect the viewpoint position of the occupant (driver during manual operation).
Information about the detected viewpoint position is provided to the display image generation unit 40.
After that, the process proceeds to step S03.

<Step S03: Reference position setting>
The display image generation unit 40 sets a reference position P (see FIG. 2) on the image displayed on the display device 50.
The reference position P is set, for example, in the right end portion and the vicinity of the lower end portion in the display area of the display device 50.
When the display image generation unit 40 sees a position corresponding to the reference position P in the display device 50 from the viewpoint position of the occupant detected in step S02, if the display device 50 is transparent, the reference position P The part outside the vehicle that overlaps with and is seen through is recognized as a "point corresponding to the reference position" (subject to be displayed at the reference position P) in the visual field directly visible to the naked eye.
After that, the process proceeds to step S04.

<Step S04: Judgment of presence / absence of risk target>
The environment recognition unit 20 determines whether or not there is a risk object that is likely to collide with the own vehicle in the vicinity of the own vehicle and within the range in which the image can be displayed by the display device 50.
Information regarding the discrimination result (presence / absence of risk target) by the environment recognition unit 20 is transmitted to the display image generation unit 40.
When a risk object exists, information such as the relative position, relative speed, and type of the risk object is also transmitted to the display image generation unit 40.
If the risk object exists, the process proceeds to step S06, and if the risk object does not exist, the process proceeds to step S05.

<Step S05: Normal wide-angle display image generation>
The display image generation unit 40 generates a normal wide-angle display image as an image displayed on the display device 50, in which the front of the own vehicle is displayed in a wide angle by reducing the display magnification with respect to the field of view visually recognizable by the naked eye.
At this time, the display image generation unit 40 displays the line-of-sight direction when the reference position P set on the image is viewed from the viewpoint of the occupant at a position corresponding to the reference position P (displayed at the reference position P on the image). The display range and display position of the display image are set so as to substantially match the line-of-sight direction when the occupant directly sees the subject) with the naked eye.
Then, the process proceeds to step S07.

<Step S06: Risk object close-up image generation>
The display image generation unit 40 generates a close-up image of a risk object that enlarges and displays the risk object by trimming an area including the risk object from the image data provided by the stereo camera device 10.
At this time, for example, the display color may be changed or the display may be blinked so that the close-up image of the risk object more strongly draws the attention of the occupant.
In addition, a text message or pictogram indicating the existence of a risk object may be displayed. Further, such a display may be used in combination with a voice message, a warning sound, or the like.
Then, the process proceeds to step S07.

<Step S07: Display device diagnosis>
The display image generation unit 40 uses the self-diagnosis function included in the display device 50 to determine whether the display device 50 is in a state where it can normally display an image.
If the display device 50 can display the image normally, the process proceeds to step S08, and if the display device 50 cannot display the image normally due to some trouble or the like, the process proceeds to step S09.

<Step S08: Image display execution>
The display image generation unit 40 displays the image generated in step S05 or step S06 by the display device 50, and then ends (returns) a series of processes.

<Step S09: Image display off>
The display image generation unit 40 stops the image display by the display device 50, and makes the display device 50 substantially transparent so that the occupant can see through it.
After that, a series of processes is terminated.

Hereinafter, a display example of the display device 50 in the visual recognition assist device 1 of the embodiment will be described.
FIG. 2 shows a state in which there is no risk object.
Since there is no risk object, a wide-angle display image is usually displayed on the display device 50.
In the state shown in FIG. 2, trees A, B, and C stand side by side from the front side along the traveling direction of the own vehicle on the left side of the lane in which the own vehicle is traveling.
In the field of view seen by the occupant through the windshield 110 with the naked eye, the entire tree A is visible, but the lower part of the tree B is blocked by the A pillar 160 and cannot be visually recognized, and the tree C is substantially entirely A. It is not blocked by the pillar 160, and only a part of the upper end portion and the lower end portion can be visually recognized from the triangular window portion 122 of the windshield 110 and the front door glass 120.

On the other hand, on the image displayed on the display device 50, the tree image a, which is an image of the trees A, B, and C, is displayed by reducing the display magnification with respect to the field of view visually observed by the naked eye. All of b and c are displayed as a whole, and it is possible to visually recognize information in a wider range than the visual field visually observed by the naked eye by a relatively small movement of the line of sight.
At this time, the line-of-sight direction when the occupant sees the reference position P is substantially the same as the line-of-sight direction when the occupant directly visually recognizes the portion corresponding to the reference position P when the display device 50 is transparent. It is designed to match.
Since the reference position P is an index for the occupant to grasp the positional relationship between the displayed image and the visual field with the naked eye, it is preferable that the reference position P is displayed by a mark or the like on the image.

FIG. 4 is a diagram showing another example of the driver's field of view in the vehicle having the visual recognition assist device of the embodiment, and is a diagram showing a state in which another vehicle is approaching from the side.
In the state shown in FIG. 4, there is another vehicle V traveling diagonally to the left and forward of the own vehicle toward the right when viewed from the own vehicle.
At the time shown in FIG. 4, the other vehicle V has not yet been recognized as a risk object, and a wide-angle display image is normally displayed on the display device 50.
In the state shown in FIG. 4, the other vehicle V is obstructed by the A pillar 160 or the like and can only be partially visually recognized in the visual field visually observed with the naked eye, but on the display device 50 displayed at a wide angle, the other vehicle image v. Is visible almost entirely.

FIG. 5 is a diagram showing another example of the driver's field of view in the vehicle having the visual recognition assist device of the embodiment, and is a diagram showing a state when there is a risk of collision with another vehicle approaching from the side.
FIG. 5 shows a state that can occur following the state shown in FIG.
At the time shown in FIG. 5, the other vehicle V is recognized as a risk object because the possibility of a collision is high, and the display device 50 displays a close-up image of the risk object. ..
In the state shown in FIG. 5, the other vehicle V is visible in the vicinity of the left end portion of the windshield 110 in the visual field visually observed with the naked eye, but the other vehicle image v is visually observed with the naked eye in the display device 50. In addition to enlarging the display to other vehicles V, the display color of the screen is changed and a text message indicating that it is dangerous is also displayed to draw the attention of the occupants and encourage appropriate avoidance actions. It has become.

According to the embodiment described above, the following effects can be obtained.
(1) In a normal wide-angle display image, by using a wide-angle display in which the display magnification is reduced with respect to the field of view directly viewed with the naked eye, a wide range of situations including a blind spot due to pillars or the like due to a small movement of the line of sight can be visually recognized. be able to.
Further, by arranging the reference position P set on the image so as to coincide with the portion corresponding to the reference position visually observed by the naked eye, the field of view visually observed by the naked eye even if the image is wide-angled. The relationship with can be easily grasped.
(2) By detecting the viewpoint position of the occupant by the occupant monitoring unit, the reference position P can be appropriately set on the image and the above-mentioned effect can be surely obtained.
(3) By setting the reference position P near the right end portion and the lower end portion of the image displayed on the display device 50, the display device 50 is directly visually recognized by the naked eye in the embodiment in which the display device 50 is arranged diagonally to the left and front of the occupant. The positional relationship between the field of view and the displayed image can be easily grasped.
Further, the left side of the own vehicle including the range of the blind spot can be visually recognized by the A-pillar 160 with a small amount of movement of the line of sight, and the monitoring burden on the occupant can be reduced.
(4) When a risk object exists, the risk object is enlarged and displayed, the display color is different, and a text message indicating that the danger exists is displayed to draw the attention of the occupants and at the same time. It is possible to improve the visibility of risk objects and encourage appropriate measures.
(5) When the display device 50 cannot display normally due to a failure or the like, by turning off the display and making the display device 50 transparent, the visibility is not obstructed by the naked eye through which the display device 50 is seen through, and the visibility is improved. Can be secured.

(Modification example)
The present invention is not limited to the embodiments described above, and various modifications and changes can be made, and these are also within the technical scope of the present invention.
(1) The configuration of the vehicle and the visual recognition assisting device is not limited to the above-described embodiment, and can be appropriately changed .
( 2) In the embodiment, a transparent LCD is used as the display device, but the specific configuration of the display device is not limited to this and can be appropriately changed. For example, a general non-transparent LCD or an organic EL display may be used.
Further, the head-up display device may be used to project an image on the windshield or a transparent plate provided separately from the windshield.
(3) In the embodiment, in a normal wide-angle display image, the display magnification is uniformly reduced in both the vertical direction and the horizontal direction, but the present invention is not limited to this, and the display magnifications in the vertical direction and the horizontal direction may be different. .. Further, the display magnification may not be reduced in the vertical direction, but may be reduced only in the horizontal direction.
(4) In the embodiment, the vertical position of the reference position P in the screen of the display device 50 is arranged in the vicinity of the lower end portion, but it may be arranged in the vicinity of the upper end portion or in the intermediate portion in the vertical direction.
In particular, when it is arranged near the upper end portion, the field of view on the display device is expanded downward, and the visibility of a relatively low-positioned object such as a curb or a child is improved.
(5) In the embodiment, the image captured by the stereo camera device used for environment recognition in front of the own vehicle is used for generating the display image, but a dedicated camera unit may be provided for generating the display image. ..

1 Visual assistance device 10 Stereo camera device 11 Camera LH 12 Camera RH
13 Stereo image processing unit 20 Environment recognition unit 30 Crew monitoring unit 31 Crew shooting camera 40 Display image generation unit 50 Display device 110 Windshield 120 Front door glass 121 Main body 122 Triangular window 130 Side mirror 140 Instrument panel 141 Combination meter 142 Multi-function display 143 Navigation device display 150 Steering wheel 160 A pillar 170 Roof 171 Stereo camera housing 180 Room mirror A, B, C Tree a, b, c Tree image V Other vehicle v Other vehicle image P Reference position

Claims (4)

An image pickup device that captures the front of the vehicle and
An image display device having a display area superimposed on or adjacent to a field of view in which the occupant visually observes the front of the vehicle when viewed from the occupant's point of view and displaying an image captured by the image pickup device. It is a visual field assist device that is equipped.
The image display device is set so that at least the display magnification in the left-right direction when viewed from the viewpoint of the occupant is reduced with respect to the visual field visually observed by the naked eye.
The line-of-sight direction when the reference position set on the image displayed on the image display device is viewed from the viewpoint of the occupant substantially coincides with the line-of-sight direction when the portion corresponding to the reference position is visually observed with the naked eye. is arranged,
The display area of the image display device is arranged so as to be offset in the left-right direction with respect to the viewpoint of the occupant.
The visual recognition assisting device, characterized in that the reference position is set at the end portion on the occupant side in the left-right direction on the display area. The viewpoint position detecting means for detecting the viewpoint position of the occupant,
The visual recognition assisting device according to claim 1, further comprising a reference position setting means for setting the reference position based on the detection result of the viewpoint position. Equipped with a risk object detection means to detect risk objects around the own vehicle,
The visual recognition assisting device according to claim 1 or 2 , wherein the image display device displays the risk object in a different display mode from the normal one. The visual recognition assisting device according to claim 3 , wherein the image display device enlarges and displays the display magnification of the risk object when the risk object exists.

Images