JP2010049349A - Vision support device of vehicle - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a vision support device of vehicle for selecting images surrounding a vehicle desired to be visually recognized by a driver by accumulating the images as the information in which a traveling state of the vehicle is associated with road information to display the selected images. <P>SOLUTION: The device includes a plurality of imaging means (10) for imaging the surroundings of the vehicle; a traveling state detection means (30) for detecting a traveling state (31) including at least a current location and time of the vehicle traveling on a road; a road information confirmation means (20) with the information including at least the vicinity of the current location and concerning the traveling of the vehicle acquired or stored thereby or therein; an image selection means (40) for selecting the photographed images; and a display means (50) for displaying the selected images. The selection means (40) automatically selects images in response to a change in the traveling state (31) forecasted when the vehicle intends to move from the current location to a change forecast location where the change in the traveling state (31) is forecasted by the confirmation means (20). <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a vision support device around a vehicle, and more particularly to a device that displays an image around a vehicle that requires an occupant to view while driving the vehicle.

  When approaching the intersection where the vehicle turns left, the occupant driving the vehicle visually recognizes the left side of the traveling direction of the vehicle using the door mirror on the passenger seat side and the rear left side using the rearview mirror.

  However, the field of view behind or behind the vehicle is limited only by the door mirror or the rearview mirror. Furthermore, in order for the occupant to see the rearview mirrors arranged in front and above the center of the vehicle interior and the door mirrors arranged on the left and right front doors, the direction of the line of sight must be greatly changed, and careful actions are taken. It was necessary.

Therefore, the rear or rear side of the vehicle is photographed with a photographing means such as a camera so as to widen the field of view and not to move the line of sight largely, for example, triggering operation of a direction indicator, brake operation, etc. As a technique, a technique for displaying a photographed image on a display in a vehicle interior has been developed (see, for example, Patent Document 1).
Japanese Patent No. 4059078

  There are various ways of visually recognizing driving occupants, and the positions and timing for visual recognition are different. It is natural that valuing the driving feeling of the occupant leads to safe driving, and it is necessary to respect the way of viewing according to the personality and experience of the occupant.

  However, the prior art has generalized the way of observing the occupant, and has not been configured to make use of individuality and experience (for example, Patent Document 1).

  The present invention provides a visual assistance device for surroundings of a vehicle that accumulates as information in which the traveling state of the vehicle and road information are associated, selects an image around the vehicle that the occupant wants to view based on the information, and displays the selected image. With the goal.

  One embodiment according to the present invention is a visual support device for a vehicle mounted on a vehicle, and includes a plurality of imaging means for imaging the periphery of the vehicle and a vehicle including at least a current position and time of a vehicle traveling on a road. A driving state detecting unit for detecting a state, a road information confirming unit that includes at least the vicinity of the current position and for which road information relating to driving of the vehicle is acquired or stored, and an image selecting unit that selects a captured image And display means for displaying the selected image.

  The image selecting means automatically selects an image according to the expected change in the driving state when the vehicle is about to move from the current position to the expected change point in the driving state by the road information confirmation means. Configured to select.

  Such configuration includes changes in driving conditions such as changes in vehicle speed, direction indicator operation, shift change, hazard lamp lighting, accelerator operation, and brake operation, and positional information when this driving state changes, etc. By associating the road information with this and setting this as a predicted change point, it is possible to automatically select and display an image around the vehicle required by the occupant in advance.

  ADVANTAGE OF THE INVENTION According to this invention, the visual assistance apparatus of the vehicle reflecting the passenger | crew's preference, experience, etc. which drive a vehicle can be provided.

[First Embodiment]
Hereinafter, a first embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a block diagram of an overall configuration of a vehicle vision support apparatus according to the present embodiment.

  As shown in FIG. 1, the visual assistance device according to the present embodiment has a plurality of cameras (photographing means) 10 (11, 12, 13) for photographing the periphery of the own vehicle, and information on the road on which the vehicle travels. A road information confirmation device (road information confirmation means) 20, a traveling state detection device (traveling state detection means) 30 for detecting a traveling state 31 of the vehicle such as a vehicle position 32 and a vehicle signal 33, and a photographed image are selected. An image selection device (image selection means) 40, a display device 50 that displays the selected image, and an image selection SW (image selection switch) 60 that allows the occupant to manually switch the image. Yes.

  As the camera 10, a normal visible light camera can be used. For example, a CMOS camera and a CCD camera can be applied. In order to widen the field of view of one camera and reduce the number of cameras, a wide-angle lens, a fish-eye lens, or the like may be used. The camera 10 (11, 12, 13) can be disposed, for example, at the bottom of the left and right door mirrors and at the center of the rear. In such a configuration, if the cameras under the left and right door mirrors are rotatably mounted, or the fisheye lens is applied as described above, most of the periphery of the vehicle is photographed including the left side of the passenger seat side that is difficult for the passenger to see. It can be a range.

  The road information confirmation device 20 acquires at least road information associated with position information, or stores and accumulates the road information in the memory 21. Here, the road information may be a record of past driving conditions such as a record that the vehicle has traveled, a record of turning left, a record of stopping, or the vehicle is a car navigation system (hereinafter referred to as “car navigation”). ) And road information may be acquired by car navigation. Further, the position information associated with the road information is the same as the vehicle position 32 that is one of the detection amounts of the traveling state detection device 30 described later, is acquired by GPS, and the past traveling state 31 is acquired as necessary. It is stored and stored in the memory 21 together with the recording.

  The traveling state detection device 30 detects the traveling state 31. The driving state 31 includes at least a vehicle position 32 represented by longitude and latitude, and constitutes a vehicle signal 33 as necessary, which includes an accelerator operation, a brake operation, a steering angle, a shift position, and a direction indication. It includes the operation of the indicator (blinker), hazard operation, vehicle speed, etc. Furthermore, you may make it include the manual selection image selected by image selection SW60 mentioned later. The detected traveling state 31 is stored in the memory 21 of the road information confirmation device 20 and is used for automatic image selection by the image selection device 40 described later.

  The image selection device 40 assists the occupant to view the vehicle according to the expected change in the driving state when the driving state change is predicted at the waypoint or destination planned to be driven from the driving state detection result and the road information. Automatically select the images to be used.

  For example, when the vehicle makes a left turn at a predetermined position and road information indicating that the occupant frequently selects the left image at this time is stored in the memory 21, the vehicle is traveling toward the predetermined position. If the traveling state approaching the predetermined position is detected by the traveling state detecting device 30, the image selecting device 40 automatically selects an image taken by the left camera 10 before reaching the predetermined position. There are various aspects of image selection, which will be described in detail later as an example.

  The display device 50 is not particularly limited as long as it can display an image, and a display for a car navigation system, a monitor display for equipment installed in a vehicle such as an audio or an air conditioner, or the like can be applied. As shown in FIG. 1, the display device 50 normally displays a map of A or a device monitor (not shown), and when the image selection device 40 automatically selects an image or by an image selection SW 60. When the occupant selects an image, an image around the vehicle B is displayed. As a display form, an application that makes the entire screen A map or the like and a peripheral image of B may be selected, or an application that simultaneously displays two screens may be selected. The applications 1a, 1b,... Of the cameras 11, 12, 13 indicate the types of display modes selected as described above.

  1 and some subsequent drawings, the applications 1a, 1b,... Are illustrated as corresponding to the respective cameras 11, 12, 13, but a central processing unit (CPU) provided in the ECU 70 is illustrated. ) And the like, and specifications that are selected by a changeover switch or the like according to a passenger's request, or specifications that include the applications 1a, 1b,.

  The image selection SW 60 is a means for the occupant to manually select an image. The result of manual selection may be detected by the traveling state detection device 30. The image selection SW 60 may also be used as a switch for cancellation described later. Further, an image selection switch or the like for a car navigation system may also be used without newly providing the image selection SW 60.

  The road information confirmation device 20, the traveling state detection device 30, and the image selection device 40 described above may be integrated to form an ECU (electronic control device) 70, as shown in FIG. For example, in a vehicle equipped with a car navigation system, if the car navigation system can have a part of the functions of each device, a device that supplements the deficient function may be added.

  Several examples according to the first embodiment will be described below. The first embodiment is an example in which map information is included and a map is displayed on the display device 50, but no guidance means to the destination is used.

  For example, the case where the occupant uses a vehicle for commuting and drives the vehicle from his home to a company where he / she works, when he / she goes to the nearest station, or when the occupant's child is sent to school is applicable. In such a case, even if the vehicle is equipped with a car navigation system, the occupant travels the vehicle without using the guiding means. A car navigation display (display device 50) often displays a map of the current position of the vehicle and its vicinity.

[Example 1-1]
Example 1-1 will be described with reference to the drawings. FIG. 2 is a flowchart showing a procedure for storing the running state 31 in the memory 21. FIG. 3 is a general flowchart of a procedure for automatically selecting an image by the image selection device 40 in this embodiment. FIG. 5 is a flowchart of an embodiment of automatic image selection when an intersection that turns left is a target, and FIG. 5 is a schematic diagram illustrating an embodiment of an application to be displayed. In the following description, FIG. 1 is also referred to.

  When the occupant gets on the vehicle and turns on the ignition switch (IGN), power is supplied to the device mounted on the vehicle. As shown in FIG. 2, the display device 50 displays a map of the current position of the vehicle and the vicinity thereof (step S1101). When the vehicle starts, the traveling state detection device 30 detects the departure place, time, day of the week, etc., and the detection result is recorded in the memory 21 (step S1102).

  The occupant operates the image selection SW 60 (step S1103: YES), and the images of any of the cameras 11, 12, 13 and their applications 1a, 1b,... Are selected (step S1104).

  The image selection device 40 displays the manually selected image on the display device 50 in accordance with the manually selected application (step 1105). The traveling state detection device 30 records the location where the image is selected and its application in the memory 21 and counts and records the number of times the same selection has been made (step S1106).

  After the manually selected image is displayed on the display device 50, when the occupant switches the display to map information by operating the current location switch of the car navigation system (step S1107: YES), the map information is displayed on the display device 50. It is displayed (step S1108).

  When the IGN is turned OFF and the supply of power to the equipment mounted on the vehicle is stopped (step S1109: YES), the traveling state detection device 30 detects the arrival location, time, day of the week, etc., and the detection result is stored in the memory. 21 (step S1110).

  As described above, the visual assistance device according to this embodiment first records the running state and accumulates the record. If the records of the driving conditions such as the place of departure, the place of arrival, the time zone and the day of the week are the same and recorded frequently, the visual assistance device detects the driving state of the departure, time and day of the week. The arrival location and the route are estimated by detecting by the device 30 (route estimation means). This route estimation can be configured as a function of the ECU 70, and can also be a guiding means that does not manually select an arrival location if it cooperates with the function of the car navigation system.

  After the above-described route estimation is established, as shown in FIG. 3, the image selection device 40 of the visual assistance device according to the present embodiment is expected to change the running state of the vehicle from the current position by the road information confirmation device 20. When moving to a predicted change point, an image can be automatically selected according to the expected change in the running state.

  The expected change point here corresponds to the place recorded in step 1106 of FIG.

  The flow of automatic image selection will be described below with reference to FIG.

  When the occupant gets on the vehicle and turns on the ignition switch (IGN), power is supplied to the device mounted on the vehicle. As shown in FIG. 3, the display device 50 displays a map of the current position of the vehicle and its vicinity (step S1201). The traveling state detection device 30 detects the position of the vehicle (for example, home), time, day of the week, etc. (step S1202). The detected result is sent to the image selection device 40.

  The image selection device 40 refers to the time, day of the week, and travel route that have left the past home, which are information stored in the memory 21 of the road information confirmation device 20 (step S1203). If there is a record of information with high frequency, a destination (for example, a company) is estimated and its route is estimated (step S1204).

  In the estimated route, the image selection device 40 records the location where the image selection SW 60 stored in the memory 21 is operated (step S1106 described in FIG. 2) and whether the selected frequency exceeds a predetermined threshold. Reference is made (step S1205). When the number of operations of the image selection SW 60 exceeds the threshold (step S1206: YES), the image selection device 40 automatically selects an image selected in the past and an application selected in the past, and the display device 50 (Step S1207).

  After the automatically selected image is displayed on the display device 50, when the occupant operates the current position switch of the car navigation system and the number of operations exceeds the threshold (step S1208: YES), the map is displayed again on the display device 50. (Step S1209).

  When the IGN is turned OFF and the supply of power to the device mounted on the vehicle is stopped (step S1210: YES), the traveling state detection device 30 detects the arrival location, time, day of the week, etc., and the detection result is stored in the memory. 21 (step S1211).

  As described above, the visual assistance device according to the present embodiment estimates the route as described above, and the vehicle is frequently selected by the occupant from the current position while referring to the past record. An image can be automatically selected when moving to a predicted change point.

  The location and timing of visual recognition during driving vary greatly depending on the skill and experience of the occupant or the vehicle body shape of the vehicle being driven. In this embodiment, suitable visual support is realized by automatically selecting an image based on the past driving situation of the occupant. Further, as shown in step S1211, by accumulating the traveling state detection results, highly accurate route estimation and automatic image selection are realized.

  Next, a specific example of the expected change point will be described with reference to FIG.

  “Map display” (step S1301), “Vehicle position confirmation (example: home)” (step S1302), “Refer to past time, day of week, travel route” (step S1303) and “Destination "Estimate (example: company)" (step S1304) is the same as steps S1201 to 1204 described in FIG.

  In the present embodiment, there is an intersection that makes a left turn on the estimated route. The image selection device 40 estimates the distance to the intersection while referring to the result detected by the traveling state detection device 30 and the position information of the intersection stored in the memory 21 of the road information confirmation device 20. If the distance to the intersection is greater than or equal to a predetermined distance (500 m in the figure) (step S1305: NO), the driving state is detected and the route is estimated (steps 1302 to 1304). If the distance to the intersection is less than the predetermined distance (step S1305: YES), L that is the distance to the intersection and T that is scheduled to reach the intersection are calculated (step S1306). Here, T can be calculated by dividing the distance L by the vehicle speed that is one of the vehicle signals 33 detected by the traveling state detection device 30.

  In this embodiment, in consideration of the driving sensation of the occupant, when either the distance to the intersection or the time to reach the intersection is less than a predetermined value (step S1307: YES), the image selection device 40 Is configured to automatically select an image and display it on the display device 50 (step S1308).

  In FIG. 4, the condition is that the distance L is less than 100 m or the time T is less than 10 seconds (step S1307). When this condition is not satisfied (step S1307: NO), L and T are calculated again (step S1306).

  The selected image is based on the past driving state of the vehicle. For example, when the occupant is always viewing the inner wheel difference when turning left, the image on the left side (passenger seat side) of the vehicle is Automatically selected.

  The selected image is configured to be switched to a map display after a predetermined time (2 seconds in the figure) has elapsed after the left turn is finished (step S1309: YES) (step S1310).

  With this configuration, a necessary image can be displayed when the occupant needs visual recognition.

  FIG. 5 is an example of a displayed image. A vehicle 80 travels in the direction of an arrow on a road having a plurality of lanes (three lanes in FIG. 5) on one side. Cameras 10L and 10R are disposed below the left and right door mirrors (not shown) of the vehicle 80. The camera 10L can capture the field of view LV, and the camera 10R can capture the field of view RV. When the other vehicle 81 is traveling in the left lane and the other vehicle 82 is traveling in the right lane behind the vehicle 80, the rear image BV captured by the camera 10L is displayed as LV1. Then, the rear image BV captured by the camera 10R is displayed as RV1. The display form is changed by selecting the application 1a,... Of each camera 10 shown in FIG. 1. For example, a boundary is provided at the center of the screen, such as LV2 and RV2, and the map information MAP and the rear image BV are displayed. A two-screen display can also be used.

  For example, when the vehicle 80 traveling on the highway exits from the highway, the map information MAP in the vicinity of the current location and the rear image BV that is the information of the other vehicle 81 traveling behind are displayed in parallel. The occupant can check the status of other lanes for changing lanes and information after leaving the highway.

[Example 1-2]
Next, one modification of the present embodiment will be described with reference to the drawings. In addition, about the structure which is common in the above-mentioned Example, it abbreviate | omits and demonstrates centering on a different part. FIG. 6 is a flowchart of an example of automatic image selection when an intersection that turns to the left is the same as the situation described in FIG.

  Steps S1401 to S1407 and steps S1410 to S1411 are the same as steps S1301 to S1307 and steps S1309 to S1310 in FIG.

  When the vehicle approaches the intersection and the answer to step S1407 is YES, the occupant operates the direction indicator (winker), shifts change (down), removes the foot from the accelerator (accelerator OFF), and operates the brakes before preparing to turn left. It is expected to operate equipment (such as brake ON).

  For example, when any one of these device operations (accelerator OFF, brake ON, shift down) is performed (step S1408: YES), the image selection device 40 corresponds to the corresponding image based on the information stored in the memory 21. And its application automatically. Then, an image is displayed on the display device 50 (step S1409).

  Such a configuration can reliably predict a change in the running state of the vehicle, and can prevent an image from being automatically selected and displayed when going straight through an intersection that normally makes a left turn.

[Example 1-3]
Next, another modification of the present embodiment will be described with reference to the drawings. In addition, about the structure which is common in the above-mentioned Example, it abbreviate | omits and demonstrates centering on a different part. FIG. 7 is a flow diagram of an example of automatic image selection in the case similar to the situation described with reference to FIG. 4, with the destination set as the nearest station and targeted for stopping at this nearest station.

  Steps S1501 to S1507 are the same as steps S1301 to S1307 in FIG. 4 except that the destination is the nearest station and that the timing of image selection is the nearest station, and thus description thereof is omitted.

  When the vehicle approaches the nearest station and step S1507 is YES, the occupant is expected to operate the hazard lamp (hazard ON) as preparation before stopping at the station premises.

  For example, when the hazard lamp is operated (hazard ON) (step S1508: YES), the image selection device 40 automatically selects the corresponding image and its application based on the information stored in the memory 21. For example, when stopping at the premises of the nearest station, it is estimated that there are many cases where the vehicle is usually brought to the left side and the occupant selects an image of the left front side (referred to as application 1b). Images are automatically selected. Then, an image is displayed on the display device 50 (step S1509).

  While the vehicle is stopped, the display of the image on the left front side that requires visual recognition at the time of subsequent start is maintained (step S1510). If the vehicle starts and a predetermined time (2 seconds in the figure) elapses (step S1511: YES), the vehicle shifts to normal travel, and thus map information is displayed on the display device 50 (step S1512).

  Such a configuration can automatically select and display an image corresponding to a special driving situation such as stopping or starting in a station based on a record of the traveling state of the occupant.

[Example 1-4]
Next, another modification of the present embodiment will be described with reference to the drawings. In addition, about the structure which is common in the above-mentioned Example, it abbreviate | omits and demonstrates centering on a different part. FIG. 8 is similar to the situation described in FIG. 4, but is a flow diagram of an example of automatic image selection in a case where a transit point is a school and a road on the vicinity of this school is targeted.

  Steps S1601 to S1604 are the same as steps S1301 to S1304 in FIG.

  As described above, even when the car navigation guidance means is not used, the visual assistance device according to the present embodiment estimates the arrival point and the route based on the accumulated information when the vehicle departs. The estimated route may go through the vicinity of the school. Schools have start and end times, and so-called school hours are often set on the roads near the school, where children and students walk on the road near the school during a specific time. When traveling on a road near the school during school hours, the occupant needs to drive slowly and check the surroundings of the vehicle, particularly for safety confirmation. On the other hand, school hours are generally limited to weekdays.

  The image selection device 40 refers to the time when it reaches the vicinity of the school that is the transit point (step S1605: YES). If the time is a school time zone (for example, 7:30 am to 9:00 am) and the day of the week is a school day (for example, a weekday) (step S1606: YES), the information stored in the memory 21 is stored. Based on this, the corresponding image and its application are automatically selected. For example, when driving on a road with no sidewalk near the school, it is estimated that there are many cases where an image of the left rear side of the road on which the student walks is selected (referred to as application 1a). The side image is automatically selected. Then, an image is displayed on the display device 50 (step S1607).

  When the vehicle passes the vicinity of the school and leaves a predetermined distance (for example, a radius of 500 m from the school) (step S1608: YES), the vehicle shifts to normal driving, and thus the map information is displayed on the display device 50 (step S1608). S1609).

  When the IGN is turned OFF and the power supply to the equipment mounted on the vehicle is stopped (step S1610: YES), the traveling state detection device 30 detects the arrival location, time, day of the week, etc. The detection result of the traveling state 31 when traveling is recorded in the memory 21 (step S1611).

  Such a configuration can automatically select and display an image according to a special driving situation on the basis of a record of the occupant's running state in consideration of the characteristics of the waypoint called a school (time, day of the week, place, etc.). .

[Example 1-5]
Next, another modification of the present embodiment will be described with reference to the drawings. In addition, about the structure which is common in the above-mentioned Example, it abbreviate | omits and demonstrates centering on a different part. FIG. 9 is similar to the situation described in FIG. 4, but a flow diagram of an example of automatic image selection when there is a section where traffic is restricted or a lane is reduced at a transit point and the section is driven. FIG. 10 shows an example of a plan view overlooking a vehicle traveling on a traffic-restricted road and an example of a selected image.

  Steps S1701 to S1704 are the same as steps S1301 to S1304 in FIG.

  As described above, even when the car navigation guidance means is not used, the visual assistance device according to the present embodiment estimates the arrival point and the route based on the accumulated information when the vehicle departs. The estimated route may pass through a traffic regulation or a lane decrease section.

  Sections where traffic restrictions or lane reduction sections change from moment to moment depending on road construction, traffic accidents, etc., when regular changes are set according to time zones, or when the original road form is used There are various reasons.

  Therefore, the information related to the section corresponds to information from the road traffic information communication system (VICS), information from other vehicles by telematics described later, and information stored in the memory 21, and any information is referred to. May be. In the following, the traffic restriction will be described as an example.

  An example of the traffic restriction section CS shown in FIG. 10 is that a normal section NS of a road that is one lane on one side and a line 85 that divides the lane in the center is installed on a wall W for construction, etc. The entire width of the road is narrowed, and the dividing line 85 is also lost.

  The vehicle 80 needs to cross the oncoming vehicle 83 and pass through the traffic regulation section CS, and the occupant must travel while bringing the vehicle 80 to the left end of the road. When traveling, the occupant needs to pay sufficient attention to the presence of an obstacle in the area VA between the vehicle 80 and the wall W as well as the distance between the wall W and the vehicle 80.

  As described above, information passing through the restricted traffic section on the estimated route includes information from the road traffic information communication system (VICS), information from other vehicles by telematics described later, and information stored in the memory 21. When it is acquired by the above (step S1705), the distance to the traffic regulation section is sequentially detected. Then, when the distance to the traffic restriction section is less than a predetermined distance (100 m in the figure) (step S1706: YES), the image selection device 40 determines the corresponding image and its application based on the information stored in the memory 21. Is automatically selected. For example, the image of the area VA (referred to as application 1b) on the left front side of the vehicle 80 shown in FIG. 10 is automatically selected. Then, an image is displayed on the display device 50 (step S1707).

  When the travel in the restricted traffic section ends and a predetermined distance (100 m in the figure) is passed (step S1708: YES), the vehicle shifts to a normal travel, so that the map information is displayed on the display device 50 (step S1709).

  When the IGN is turned OFF and the supply of power to the equipment mounted on the vehicle is stopped (step S1710: YES), the traveling state detection device 30 detects the arrival location, time, day of the week, etc., and this traffic regulation section The detection result of the traveling state 31 when traveling in the vicinity is recorded in the memory 21 (step S1711).

  In addition, traffic regulation may be performed according to a time zone with a section. Therefore, it goes without saying that if the information related to the traffic restriction time zone is acquired, the same condition judgment as in step S1706 can be performed regarding the time zone during which the vehicle 80 is traveling.

  Such a configuration automatically selects and displays an image according to a special driving situation based on the record of the occupant's running state in consideration of the characteristics of the transit point (time, day of the week, place, etc.) as a restricted traffic zone. Can do.

[Second Embodiment]
Next, a second embodiment of the present invention will be described with reference to the drawings. Note that portions that are the same as those in the first embodiment are omitted, and the differences will be mainly described.

  This embodiment is guided to a destination using a car navigation system, and is different from the first embodiment in which a route from a past traveling state record to an arrival point is estimated. That is, a map information storage unit (not shown) in which the map information that the car navigation system has as a standard in the configuration shown in FIG. 1 is stored, and the map information is used to guide the vehicle from the starting point to the designated arrival point. A guidance unit (not shown) for guidance is added.

  Hereinafter, several examples according to the second embodiment will be introduced.

[Example 2-1]
Example 2-1 will be described with reference to FIGS. 1 and 11. FIG. 11 is a flowchart of a procedure in which the image selection device 40 automatically selects an image in the present embodiment, and targets an intersection that turns left. Note that “NAVI” in FIG. 11 is used to include information related to route guidance by car navigation and guidance routes in addition to a device called car navigation.

  As can be seen from FIG. 11 compared with FIG. 4 which is a representative example of the first embodiment, the procedure of steps S1301 to S1304 of FIG. 4 is not necessary because the car navigation has already set the guidance route.

  In the present embodiment, there is an intersection that turns left on the guidance route. The image selection device 40 estimates the distance to the intersection while referring to the position information of the intersection of the car navigation system. If the distance to the intersection is not less than a predetermined distance (500 m in the figure) (step S2102: NO), route guidance (step S2101) is continued. If the distance to the intersection is less than a predetermined distance (500 m in the figure) (step S2102: YES), a left rear side camera that covers a visual field that needs to be visually recognized when turning left is selected in advance (step S2103). .

  L that is the distance to the intersection and T that is scheduled to reach the intersection are calculated (step S2104). Here, T can be calculated by dividing the distance L by the vehicle speed that is one of the vehicle signals 33 detected by the traveling state detection device 30.

  In the present embodiment, in the same manner as the embodiment 1-1 (FIG. 4), either the distance to the intersection or the time to reach the intersection is less than a predetermined value in consideration of the driving feeling of the occupant. In this case (step S2105: YES), the image selection device 40 automatically selects an image and displays it on the display device 50 (step S2106 or S2107).

  In FIG. 11, the condition is that the distance L is less than 100 m or the time T is less than 10 seconds (step S2105). When this condition is not satisfied (step S2105: NO), L and T are calculated again (step S2104).

  The image to be selected often visually recognizes the bicycle running on the shoulder or the inner wheel difference of the left turn when turning left, and the image on the left rear side (passenger seat side) of the vehicle is automatically selected. The automatically selected image is displayed on the display device 50, but the car navigation route guidance screen and the left rear side image may be displayed side by side as in the screen example of FIG. 5 (step S2106). ) Only the left rear side image may be displayed (step S2107). Such a selection can be arbitrarily operated by a passenger using a screen selection switch of a car navigation system.

  The selected image is configured to be switched to a route guidance screen for a car navigation system after a predetermined time (2 seconds in the figure) has elapsed after the left turn is completed (step S2108: YES) (step S2109).

  With this configuration, a necessary image can be displayed when the occupant needs visual recognition.

[Example 2-2]
Next, one modification of the present embodiment will be described with reference to the drawings. In addition, about the structure which is common in the above-mentioned Example, it abbreviate | omits and demonstrates centering on a different part. FIG. 12 is a flow diagram of an embodiment of automatic image selection when leaving a priority road or branching a road.

  Exiting from the priority road or branching of the road can be in either the left or right direction. When the traveling road is a road having a plurality of lanes on one side, in some cases, after changing the lane, it is necessary to drive the vehicle to exit or branch. Moreover, since a lane change or the like immediately before exiting or branching is dangerous, a visual behavior with a certain margin in time and distance is required.

  In view of such a situation, the present embodiment starts route guidance by car navigation (step S2201), and exits from the priority road to the waypoint, or a predicted change point where a change in driving state such as a road branch is expected When there is, the distance to the expected change point is always monitored, and when the distance is less than a predetermined distance (1 km in the figure) (step S2202: YES), is the exit or branch on the right side of the road (step S2203: No) It is determined whether it is the left side (step S2203: YES). In the case of the left side, the camera 11 is selected (step S2204), and in the case of the right side, the camera 12 is selected (step S2205). Here, although it is not specified whether the cameras 11 and 12 are the left side, the right side, or the center, both have a rear visual field. This is because, depending on road conditions, the visual field behind the center may contribute to visual recognition for passengers.

  The procedure (steps S2206 and 2207) for calculating the distance and time to the expected change point and determining whether or not it is less than the predetermined distance or less than the predetermined time until arrival is the same as in the above-described embodiment 2-1. However, since exit and branching are often required when traveling on an automobile road, both the predetermined distance and the predetermined time are large (in the figure, the distance is less than 500 m and the time is less than 20 seconds).

  Since the flow after Step S2207 becomes YES (Steps S2208 to S2211) is the same as Steps S2107 to S2110 of Example 2-1, description is omitted.

  As described above, according to the present embodiment, an image can be automatically selected and displayed accurately according to the traveling state of leaving the priority road or branching the road.

[Example 2-3]
Next, one modification of the present embodiment will be described with reference to the drawings. In addition, about the structure which is common in the above-mentioned Example, it abbreviate | omits and demonstrates centering on a different part. FIG. 13 is a flowchart of an example of automatic image selection when exiting a priority road similar to the situation described in FIG. 12 or targeting a branch of a road, but a road having two or more lanes on one side Is targeted.

  Steps S2301 to S2303 are the same as steps 2201 to S2203 in FIG.

  When the traveling road is a road having a plurality of lanes on one side, in some cases, after changing the lane, it is necessary to drive the vehicle so that it exits or branches.

  In this embodiment, when the vehicle exits or branches to the left side (step S2303: YES), it is determined whether or not there are two or more lanes on one side. If the road is more than one lane on one side (step S2304: YES), it is next determined whether or not the vehicle is traveling in the leftmost lane (step S2305). This is because when the vehicle is traveling in a lane other than the left end, it is necessary to exit or branch after changing the lane.

  If the vehicle is traveling in a lane other than the left end (step S2305: YES), the left rear side camera is selected. This is for visually confirming whether or not another vehicle is traveling from behind in the lane to be changed.

  The display of the selected image (steps S2307, S2308, S2314, S2315) and the subsequent flow are the same as steps SS2208 to S2211 of FIG.

  The flow for exiting or branching to the right side (steps 2309 to S2315) is the same as that for exiting or branching to the left side, and will not be described.

  As described above, according to the present embodiment, an image can be automatically selected and displayed accurately according to the traveling state of exiting from a road having a plurality of traveling lanes on one side or branching of the road.

[Example 2-4]
Next, one modification of the present embodiment will be described with reference to the drawings. In addition, about the structure which is common in the above-mentioned Example, it abbreviate | omits and demonstrates centering on a different part. FIG. 14 is a flowchart of an embodiment of automatic image selection for a case where a junction of roads is included in a waypoint.

  Road merging can be from either the left or right direction. And when joining a priority road, such as when entering an automobile-only road, the vehicle traveling on the priority road has a fast vehicle speed, and the vehicle that is about to merge visually recognizes the traveling status of other vehicles in the lane where the vehicle meets. There is a need to. Similarly, in a so-called junction on an automobile-only road, the lane may decrease from the junction point, and it is necessary to travel while visually checking the distance between the other vehicle and the own vehicle.

  In view of such a situation, in this embodiment, route guidance is started by car navigation (step S2401), and when there is a road junction at the waypoint, the distance to the junction is always monitored, and a predetermined distance (in the figure, 500 m) or less (step S2402: YES), it is determined whether the merge is on the right side of the road (step S2403: YES) or on the left side (step S2403: NO). In the case of the right side, for example, the camera 11 is selected (step S2404), and in the case of the left side, for example, the camera 12 is selected (step S2405). Here, although it is not specified whether the cameras 11 and 12 are the left side, the right side, or the center, both have a rear visual field. This is because, depending on road conditions, the visual field behind the center may contribute to visual recognition for passengers.

  The subsequent flow (steps S2406 to S2411) is the same as steps S2206 to S2211 of FIG.

  As described above, according to the present embodiment, when passing through the junction of roads, an image can be automatically selected and displayed accurately according to the traveling state at the time of junction.

[Example 2-5]
Next, one modification of the present embodiment will be described with reference to the drawings. In addition, about the structure which is common in the above-mentioned Example, it abbreviate | omits and demonstrates centering on a different part. FIG. 15 is a flowchart for a case where an intersection that makes a left turn similar to the situation described in FIG. 11 is a target, and a device operation similar to the configuration described in FIG. 6 is used as a trigger for automatic image selection. .

  Steps S2501 to S2505 are the same as steps S2101 to S2105 in FIG.

  When the vehicle approaches the intersection and the answer to step S2505 becomes YES, the occupant operates the direction indicator (winker), shifts change (down), removes the foot from the accelerator (accelerator OFF), and operates the brakes (preparation before turning left). It is expected to operate equipment such as brake ON).

  For example, when any of these device operations (accelerator OFF, brake ON, shift down) is performed (step S2506: YES), the image selection device 40 automatically selects a corresponding image and its application. Then, an image is displayed on the display device 50 (steps S2507 and S2508).

  Such a configuration can automatically select an image corresponding to an intersection that is turning left.

[Example 2-6]
Next, one modification of the present embodiment will be described with reference to the drawings. In addition, about the structure which is common in the above-mentioned Example, it abbreviate | omits and demonstrates centering on a different part. FIG. 16 is a flowchart for a case where an intersection that makes a left turn similar to the situation described in FIG. 15 is targeted.

  In this embodiment, as shown in the determination in step S2606, any one of the combinations of “accelerator OFF and shift down”, “accelerator OFF and brake ON”, and “shift down and brake ON” is applicable. The image is automatically selected when the operation is performed.

  Such a configuration is in accordance with an actual driving situation, and can provide an accurate timing for automatically selecting and displaying an image.

[Example 2-7]
Next, one modification of the present embodiment will be described with reference to the drawings. In addition, about the structure which is common in the above-mentioned Example, it abbreviate | omits and demonstrates centering on a different part. FIG. 17 shows a case where there is a school at the same waypoint as the situation described in FIG. 8 of the embodiment 1-4, and FIG. 18 shows a passage restriction section at the same waypoint as the situation explained in FIG. 9 of the embodiment 1-5. FIG. 10 is a flow diagram for a case.

  In Examples 1-4 and 1-5, in principle, a camera and its application are selected based on past information. However, the present embodiment is a case where there is a school or a traffic restriction section at the route point of the guidance route set by the car navigation system, and the shooting direction of the preselected image is set (S2704, S2705: left rear side) , Step S2804: left front side).

  Other configurations are the same as those in FIG. 8 and FIG. 18 are the same as those in FIG.

  Such a configuration can automatically select an image that supports visual recognition even when the vehicle travels on a road that does not normally pass.

[Third Embodiment]
Next, a third embodiment of the present invention will be described with reference to the drawings. Note that portions overlapping with those of the first and second embodiments are omitted, and description will be made focusing on portions having differences.

  The first embodiment described above is an example in which the map information is included and the map is displayed on the display device 50, but the guidance means to the destination is not used, and the second embodiment is In this example, the car navigation system is used to guide the vehicle to the destination. In the present embodiment, it is only necessary to mount a device such as a GPS that positions the position of the vehicle, and both the first embodiment and the second embodiment are included in the present embodiment. In this embodiment, the destination estimation and route estimation of the first embodiment and the route guidance to the destination of the second embodiment are not performed.

  In the following description, only a device such as a GPS that positions the position of the vehicle is mounted on the vehicle, and the display screen A of the display device 50 in FIG. 1 is neither map information nor a NAVI screen. The monitor of the equipped apparatus is shown, and it is set as the Example which applied what is called a monitor display.

  The basic configuration is as shown in FIG. 1, and the difference is that the display screen A of the display device 50 is an in-vehicle device monitor display as described above. The display is not particularly limited as long as it can display an image taken by the camera 10.

  Hereinafter, several examples according to the third embodiment will be introduced.

[Example 3-1]
Example 3-1 will be described with reference to the drawings. FIG. 19 is a general flowchart of a procedure in which the image selection device 40 automatically selects an image in this embodiment. In the following description, FIG. 1 is also referred to.

  While the vehicle is traveling, the display device 50 displays an in-vehicle device monitor (“audio” in the figure) (step S3101). The traveling state detection device 30 always confirms the position of the vehicle by GPS or the like (step S3102). When the image selection SW 60 is operated, the selected camera 10 and its application, which are the contents of this operation, and the operated position (for example, longitude / latitude) are recorded in the memory 21 of the road information confirmation device 20. The The past record stored in the memory 21 is referred to, and if this new record is the same as the past record, the selected number is added and recorded as the “number of selections” (step S3103).

  When the “number of selections” exceeds a predetermined number (step S3104: YES, the threshold is 3 in the figure), the image selection device 40 automatically selects an image with reference to past records stored in the memory 21, The image is displayed on the display device 50 (step S3105). In FIG. 19, it is assumed that there are a plurality of applications exceeding the threshold of 3 times (step 3104), and the application having the largest number of selections is selected. If there is one application that exceeds the threshold, it goes without saying that such a determination is not made and the target application is selected.

  In such a configuration, the occupant automatically selects an image in advance because a place where the occupant frequently performs visual recognition by manually selecting an image in daily driving is regarded as a predicted change point where a change in the running state is expected. However, it is possible to assist in visually recognizing the vicinity of the vehicle without performing complicated work.

[Example 3-2]
Next, one modification of the present embodiment will be described with reference to the drawings. In addition, about the structure which is common in the above-mentioned Example, it abbreviate | omits and demonstrates centering on a different part. FIG. 20 is a flowchart of an example of automatic image selection based on accumulated information similar to FIG.

  The present embodiment is configured from information related to manual selection of an image and information on a selected position, and does not estimate a change in travel of the vehicle at the corresponding position. Therefore, for example, even if the vehicle reaches a corresponding position, which is an intersection that usually makes a left turn, it may be assumed that the vehicle goes straight or turns right depending on the day. In such a situation, even if an image obtained by photographing the left side of a vehicle that is useful for making a left turn is automatically selected and displayed, it does not provide visual support for the occupant, but is rather troublesome.

  The present embodiment avoids such a situation, and adds the operation state (vehicle signal 33) of the equipment related to the traveling of the vehicle to the embodiment 3-1, so that the determination of the automatic image selection is made accurate. .

  Steps S3201 to S3204 are the same as steps S3101 to S3104 in FIG. Recorded along with vehicle position and manual image selection.

  When the left turn signal ON is detected by the traveling state detection device 30 (step S3206: YES), the image selection device 40 automatically selects an image based on the past record and displays the image on the display device 50. (Step S3206). Similarly, when a hazard ON is detected (step S3205: YES), the image selection device 40 automatically selects an image based on past records and displays the image on the display device 50 (step S3207).

  The vehicle signal 33 is not accumulated, and if the left turn signal is on, the left turn image is regarded as a left turn, and if the hazard is on, the vehicle is regarded as parked and stopped, and the front left or front image is automatically selected. You may do it.

  With this configuration, this embodiment can make the determination of automatic image selection more accurate.

[Example 3-3]
Next, one modification of the present embodiment will be described with reference to the drawings. In addition, about the structure which is common in the above-mentioned Example, it abbreviate | omits and demonstrates centering on a different part. FIG. 21 is a flowchart of an embodiment for automatically selecting a selection image registered by an occupant.

  If the occupant is using the vehicle for commuting and traveling from home to a company that works from home, going to the nearest station, or sending an occupant's child to school, the vehicle will follow the same route. Run.

  It is assumed that there are many intersections along the route, and passengers often view the periphery of the vehicle with a fixed camera image, such as when turning left at the intersection or when a vehicle is parked at the destination.

  In this embodiment, the image to be selected in advance is registered, and the image is automatically selected at the target location, thereby avoiding the troublesome operation of the image selection SW 60 during traveling.

  Similar to Example 3-1, etc., also in this example, the position of the vehicle traveling by GPS or the like is lateral.

  At a point requiring visual assistance, the occupant continues to press the image selection SW 60 for a certain period of time (long press, step S3303: YES). By long pressing, the selected image, its application, and the position of the vehicle are registered (step S3302).

  In FIG. 21, when the image selected by simply pressing and holding and the application (step S3304) are displayed on the display device 50 (step S3305), when the vehicle reaches the corresponding point in the next and subsequent travels, The image selection device 40 automatically selects a registered image and causes the display device 50 to display it.

  Such a configuration does not require a troublesome operation because an image is automatically selected and displayed when passing through a place that requires visual recognition on a daily road.

[Example 3-4]
Next, one modification of the present embodiment will be described with reference to the drawings. In addition, about the structure which is common in the above-mentioned Example, it abbreviate | omits and demonstrates centering on a different part. FIG. 22 is a flowchart of this embodiment.

  In the present embodiment, for example, in a storage medium such as the memory 21, the vehicle signal 33 related to the driving operation such as the left turn signal ON, the place to be operated, the image assumed to be visually recognized and the application ( (Hereinafter referred to as “recommended applications”).

  While the vehicle is traveling, the display device 50 displays an in-vehicle device monitor (“audio” in the figure) (step S3401). The traveling state detection device 30 always confirms the position of the vehicle sideways by GPS or the like (step S3402). When the image selection SW 60 is operated (step S3403: YES), the image of the selected application (step S3407) is selected and displayed on the display device 50 (step S3408).

  When the image selection SW 60 is not operated (step S3403: NO) and the vehicle signal 33 related to the driving operation is detected (in the figure, the left turn signal ON, step S3404: YES), the recommended application described above is used. The database is referred to (step S3405), and if the corresponding application exists in the database, the image is automatically selected and displayed on the display device 50 (step S3406).

  With this configuration, the present embodiment allows the occupant to manually select an image when particularly necessary, and in other cases, the image selection device 40 automatically selects an image suitable for visual assistance. , Troublesome operations can be avoided.

[Example 3-5]
Next, one modification of the present embodiment will be described with reference to the drawings. In addition, about the structure which is common in the above-mentioned Example, it abbreviate | omits and demonstrates centering on a different part. FIG. 23 is a flowchart of this embodiment.

  The present embodiment has a configuration similar to that of the embodiment 3-4 and FIG. However, the recommended application in Example 3-4 is a generalized database, and the automatically selected image may not be in accordance with the passenger's preference and experience.

  Therefore, this embodiment provides a configuration that avoids automatic selection that does not conform to the occupant's intention.

  Steps S3501 to S3506, S3511, and S3512 are the same as those in FIG.

  In this embodiment, when an image of a recommended application is automatically selected and displayed on the display device 50 (step S3506), the occupant operates the image selection SW 60 or returns to the audio monitor that is the original image. The display image canceling action is monitored (step S3507).

  If there is a display image canceling action (step S3507: YES), the cancellation point (latitude, longitude) and the canceled application are recorded in the memory 21 of the road information confirmation apparatus 20 (step S3508). If the past record stored in the memory 21 is referred to and this new record is the same as the past record, the number of cancel actions is added and recorded as “cancellation count”.

  When the “number of cancellations” exceeds the predetermined number (step S3509: YES, the threshold is 3 in the figure), the image selection device 40 refers to the past record stored in the memory 21 and displays it on the display device 50. The image of the recommended application is not displayed (step S3510).

  Such a configuration can avoid automatic selection that does not conform to the will of the occupant.

[Example 3-6]
Next, one modification of the present embodiment will be described with reference to the drawings. In addition, about the structure which is common in the above-mentioned Example, it abbreviate | omits and demonstrates centering on a different part. FIG. 24 is a flowchart of this embodiment.

  The present embodiment has a configuration similar to that of the embodiment 3-5 and FIG. In the embodiment 3-5, the recommended application image is not automatically selected depending on the number of cancellations of the recommended application. In this embodiment, the recommended application is deleted from the database.

  Steps S3601 to S3606, S3609, and S3610 are the same as those in FIG.

  In this embodiment, when an image of a recommended application is automatically selected and displayed on the display device 50 (step S3606), the occupant operates the image selection SW 60 or returns to the audio monitor that is the original image. When the display image is canceled and the switch or button is operated for a predetermined time or longer ("long press" in the figure) (step S3607: YES), the passenger does not visually recognize the image. The image is deleted from the recommended application (step S3608).

  Such a configuration can avoid automatic selection that does not conform to the will of the occupant.

[Fourth Embodiment]
Next, a fourth embodiment of the present invention will be described with reference to the drawings. Note that portions overlapping with the above-described embodiment will be omitted, and description will be made focusing on portions having differences. FIG. 25 is a schematic explanatory diagram of an example according to the present embodiment.

  As shown in FIG. 25, the visual assistance device according to the present embodiment includes a plurality of vehicles V1, V2, V3, and V4 having the same visual assistance device, and each of the vehicles V1, V2, V3, and V4 is a communication line. Therefore, an environment connected to the center server CS is assumed.

  For example, when an occupant of one vehicle V1 manually selects an image by the image selection SW, the selected image and the traffic situation when operated (location, weather, time, day of the week, congestion status, speed, etc.) Is transmitted to the center server CS via a communication line (telematics or the like) (arrow OUT).

  The center server CS, in addition to the above-described one vehicle V1, which image or image has been selected based on data (arrow OUT) transmitted from a plurality of other vehicles V2, V3, V4 Are counted.

  The center server CS calculates the selection frequency of the image and its application for each traffic situation based on the counting result, and transmits this information to each vehicle V1, V2, V3, V4 (arrow IN) and shares the information. To do.

  When a certain vehicle (for example, the vehicle V2) encounters a traffic situation exceeding a predetermined selection frequency, the image selection device 40 of the visual assistance device of the vehicle V2 automatically selects an image based on the shared information. Is displayed on the display device 50.

  With such a configuration, road information that cannot be grasped only by information from the road traffic information communication system (VICS) can be shared, and an accurate image can be selected and displayed at a place where visual recognition is necessary.

  The preferred embodiments and examples of the present invention have been described above. The present invention is not limited to the one described in the drawings, and design changes can be made without departing from the spirit of the present invention.

It is a block diagram of the whole structure of the visual assistance apparatus of the vehicle concerning 1st Embodiment. It is a flowchart showing the procedure which memorize | stores the driving state concerning Example 1-1 in memory. It is a general flowchart of the procedure in which the image selection apparatus concerning Example 1-1 selects an image automatically. It is a flowchart of the example of the image automatic selection at the time of making into the intersection which turns left concerning Example 1-1. It is a schematic diagram which shows the example of the application displayed concerning Example 1-1. It is a flowchart of the example of the image automatic selection at the time of making into the intersection which turns left concerning Example 1-2. It is a flowchart of the example of the image automatic selection at the time of making the destination concerning Example 1-3 into the nearest station and making it stop at this nearest station. It is a flowchart of the example of the image automatic selection at the time of making the transit place concerning Example 1-4 into the school and drive | working the road of this school vicinity. FIG. 10 is a flowchart of an example of automatic image selection in a case where there is a section where traffic is restricted or a lane is reduced at a transit point according to Example 1-5 and the section is driven. It is the figure which showed an example of the top view and the selected image which looked down at the vehicle which drive | works the road by which traffic is restricted concerning Example 1-5. It is a flowchart of the procedure in which the image selection apparatus concerning Example 2-1 of 2nd Embodiment selects an image automatically. It is a flowchart of the example of the image automatic selection at the time of leaving the priority road concerning Example 2-2, or making the branch of a road into object. FIG. 12 is a flowchart of an example of automatic image selection when a priority road targeting a road having two or more lanes on one side is applied or a branch of a road is targeted according to Example 2-3. It is a flowchart of the example of the image automatic selection for the case where the junction of a road is included in the waypoint concerning Example 2-4. It is a case where it is a case where the intersection which turns left concerning Example 2-5 is made into object, and apparatus operation is made into the image automatic selection trigger. It is a flowchart at the time of targeting the intersection which turns left concerning Example 2-6. It is a flowchart for the case where there is a school in the waypoint concerning Example 2-7. It is a flow figure for the case where there is a traffic regulation section in the waypoint concerning Example 2-7. It is a general flowchart of the procedure in which the image selection apparatus concerning Example 3-1 selects an image automatically. It is a flowchart of the example of the image automatic selection based on the accumulate | stored information concerning Example 3-2. It is a flowchart of the example which selects automatically the selection image which the passenger | crew concerning Example 3-3 registered. It is a flowchart of the example of image selection concerning Example 3-4. FIG. 10 is a flowchart of an example of image selection and image cancellation according to Example 3-5. FIG. 10 is a flowchart of an example of image selection and application deletion according to Example 3-6. It is typical explanatory drawing of one Example concerning 4th Embodiment.

Explanation of symbols

10, 11, 12, 13 Camera 20 Road information confirmation device 21 Memory 30 Running state detection device 31 Running state 32 Vehicle position 33 Vehicle signal 34 Image selection 40 Image selection device 50 Display device 60 Image selection SW
70 ECU
80 Vehicle 81, 82 Other vehicle 83 Oncoming vehicle 85 Partition line

Claims (36)

A visual support device for a vehicle mounted on a vehicle,
A plurality of imaging means for imaging the periphery of the vehicle;
Traveling state detecting means for detecting a traveling state including at least the current position and time of the vehicle traveling on the road;
Road information confirmation means including at least the vicinity of the current position, information of the road related to the traveling of the vehicle is acquired or stored;
Image selection means for selecting the captured image;
Display means for displaying the selected image,
The image selecting means responds to the expected change in the running state when the vehicle is about to move from the current position to the expected change point where the change in the running state is expected by the road information confirmation means. A visual support device for a vehicle that automatically selects an image. A route estimation unit;
The route estimation means stores the traveling state detected by the traveling state detection means,
The stored driving state includes at least a position and a time zone divided by a predetermined time, and is a driving state record in which the predetermined position and the time zone are associated with each other.
When the traveling state record in which the predetermined position and the time zone substantially coincide with each other exceeds a predetermined number of times, it is stored as a route traveling state record,
2. The vehicle vision according to claim 1, wherein when the travel of the vehicle is included in the route travel state record, the arrival point of the vehicle and the route to the arrival point are estimated from the stored travel state. Support device. The image selection means includes an image selection switch, and an image is manually selected also by operating the image selection switch.
The road information confirmation means includes a storage means for storing the manually selected image, the time of the image selection operation, and the frequency of the image selection operation within a predetermined time when the image selection operation is performed,
The visual support device for a vehicle according to claim 2, wherein the storage means also stores a position when the image selection operation detected by the running state detection means is performed. The image selection means includes a plurality of display forms of the selected image,
This display form is manually selected by operating the image selection switch,
The visual support device for a vehicle according to claim 3, wherein the storage unit stores the manually selected display form. The storage means stores as a selection record in which a predetermined position and a predetermined image manually selected there are associated with each other, and when the selection recording is stored more than a predetermined number of times, the predetermined position is changed to the change position. Remember it as an expected point,
5. The visual assistance device for a vehicle according to claim 3, wherein the image selection unit automatically selects an image captured in the same field of view as the image of the selection record when the vehicle travels at the predicted change point. .   When the predicted change point is on the route estimated by the route estimation unit, the image selection unit is configured to predict the traveling state before a predetermined distance or a predetermined time before the vehicle travels the predicted change point. The visual support device for a vehicle according to any one of claims 2 to 5, wherein an image corresponding to a change in the number is automatically selected. A map information storage means for storing map information;
In the stored map information, the expected change point is at least an intersection that turns right or left, a point where the frequency of lane change is high on a road having a plurality of lanes on one side, a merge point of a plurality of roads, a branch point, and The visual assistance device according to claim 6, wherein an exit point of an automobile-only road is included.   The said image selection means sets the predetermined distance or predetermined time to the said change estimated point which selects an image automatically based on the road information in the predetermined time slot | zone in the point acquired by the said map information. The visual support device according to 1.   The expected change in the running state includes at least operation of a direction indicator, shift change, lighting of a hazard lamp, accelerator operation, and device operation such as a brake operation. The visual assistance device according to one item.   The visual support apparatus according to claim 9, wherein the image selection unit automatically selects an image when the device is operated.   When there is an intersection that makes a left turn on the route estimated by the route estimation unit, the image selection unit sets the intersection as the expected change point, and automatically selects an image on the left rear side of the vehicle. The visual assistance device for a vehicle according to any one of claims 6 to 10.   When the arrival point estimated by the route estimation unit is within a railway station, the image selection unit sets the station as the expected change point, and automatically selects an image on the left front side of the vehicle. The visual assistance device for a vehicle according to any one of claims 6 to 11.   When there is a school on the route estimated by the route estimation unit, the image selection unit sets the school and the vicinity of the school as the predicted change point, and automatically selects an image on the left rear side of the vehicle The visual assistance device for a vehicle according to any one of claims 6 to 11. A road traffic information communication system;
When the road traffic information communication system detects that there is a road restricted in the route estimated by the route estimation means, the image selection means sets the road restricted in traffic as the expected change point. The vehicle visual assistance device according to any one of claims 6 to 11, wherein an image of a left front side of the vehicle is automatically selected. Map information storage means for storing map information;
Guidance means for guiding the vehicle to a designated route from the starting point to the arrival point specified by the map information;
The vehicle visual support device according to claim 1, wherein the road information confirmation unit acquires the stored map information and the guidance route.   The vehicle visual support device according to claim 15, wherein the display unit displays the map information and the selected image in parallel.   When there is the expected change point on the guidance route, the image selection means displays an image corresponding to the expected change in the driving state before a predetermined distance or a predetermined time before the vehicle travels the expected change point. The vehicle visual assistance device according to claim 15 or 16, wherein automatic selection is performed.   The expected change points include at least intersections that make a right or left turn, points that have a high frequency of lane changes on roads that have multiple lanes on one side, merge points of multiple roads, branch points, and exit points of priority roads The visual assistance device according to claim 17.   The visual assistance device according to claim 17 or 18, wherein the image selection unit automatically selects an image on the left rear side of the vehicle when the predicted change point is an intersection that turns left.   When the predicted change point is an exit point from a priority road or a branch point of the road, when the vehicle exits or branches leftward, the image selection means automatically selects an image on the left rear side of the vehicle 19. On the other hand, when the vehicle leaves or branches in the right direction, the vehicle visual assistance device according to claim 17 or 18, wherein an image on the right rear side of the vehicle is automatically selected. Based on the current position and the map information, a road on which the vehicle is traveling has a plurality of traveling lanes on one side, and a traveling lane that detects whether the vehicle is traveling in any of the traveling lanes. A detection means;
The road on which the vehicle is traveling is a priority road, and the expected change point is an exit point from the priority road or a branch point of the road, and the vehicle exits or branches at the exit point. If
When the exit point or the branch point is on the left side of the priority road, and the vehicle is traveling on a road other than the leftmost lane, the image selection means automatically selects an image on the left rear side of the vehicle,
On the other hand, when the exit point or the branch point is on the right side of the priority road, and the vehicle is traveling on a road other than the rightmost lane, the image selection unit automatically selects an image on the right rear side of the vehicle. The visual assistance device for a vehicle according to claim 17 or 18. Based on the current position and the map information, a road on which the vehicle is traveling has a plurality of traveling lanes on one side, and a traveling lane that detects whether the vehicle is traveling in any of the traveling lanes. A detection means;
When the road on which the vehicle is traveling is a priority road, the expected change point is an exit point from the priority road or a branch point of the road, and the vehicle passes through this exit point or this branch point,
When the exit point or the branch point is on the left side of the priority road, and the vehicle is traveling on a road other than the rightmost lane, the image selection means automatically selects an image on the right rear side of the vehicle,
On the other hand, when the exit point or the branch point is on the right side of the priority road, and the vehicle is traveling on a road other than the leftmost lane, the image selection unit automatically selects an image on the left rear side of the vehicle. The visual assistance device for a vehicle according to claim 17 or 18.   When the expected change point is a merge point where one road on which the vehicle is traveling and another road merge, the image selection means, when the merge point is the left side of the one road, 19. An image of a left rear side of a vehicle is automatically selected, while an image of a right rear side of the vehicle is automatically selected when the junction is on the right side of one road. Visual assistance device for vehicles.   24. The image selection unit according to claim 15, wherein the image selection unit automatically selects an image corresponding to a predicted change in the running state before a predetermined distance or a predetermined time before the vehicle travels the predicted change point. The vehicle vision support apparatus according to any one of the preceding claims.   The visual assistance device according to claim 24, wherein the expected change in the running state includes at least an operation of a direction indicator, a shift change, lighting of a hazard lamp, an accelerator operation, and a device operation of a brake operation.   The visual assistance device according to claim 25, wherein the image selection unit automatically selects an image when the device is operated.   The said image selection means sets the predetermined distance or predetermined time to the said change estimated point which selects an image automatically based on the road information in the predetermined time slot | zone in the point acquired by the said map information. The visual assistance device according to any one of claims 17 to 24 or claims 24 to 26.   When there is a school or a shopping street on the guidance route, the image selection means sets the vicinity of the school and the school or the vicinity of the shopping street and the shopping street as the expected change point, and the left rear side of the vehicle The visual support apparatus according to any one of claims 15 to 17, or 24 to 27, wherein the image of the other is automatically selected. A road traffic information communication system;
When the road traffic information communication system detects that there is a traffic-restricted road on the guidance route, the image selection means sets the traffic-restricted road as the expected change point, and the left front side of the vehicle The vehicle visual assistance device according to any one of claims 15 to 28, which automatically selects the image. The image selection means stores an image selection switch that can manually select an image, the manually selected image of the image selection switch, and a running state detected by the running state detection means when the manual selection is performed. Storage means for
This stored driving state includes at least a position,
When the vehicle is traveling in a predetermined location, the predetermined location is included in the stored traveling state, the vehicle has traveled a predetermined number of times, and the same imaging at the predetermined location The visual assistance device for a vehicle according to claim 1, wherein when the manual selection of the direction image exceeds a predetermined number of times, the image selection unit automatically selects the image in the same imaging direction. The image selection means includes a plurality of display forms of the selected image, and this display form is also manually selected by operating the image selection switch,
The storage means stores the manually selected display form,
The visual assistance device for a vehicle according to claim 30, wherein when the images in the same imaging direction are automatically selected, the display form is automatically selected at the same time.   The predicted change in the running state includes at least operation of a direction indicator, shift change, lighting of a hazard lamp, accelerator operation, and device operation such as a brake operation. The visual assistance device according to one item. The image selection means further includes an image cancel switch for manually canceling the automatically selected image,
The automatic selection is canceled when the automatically selected image at a predetermined location is canceled by the image cancel switch and the cancel operation exceeds a predetermined number of times. The visual support device for a vehicle according to item.   32. The visual assistance apparatus for a vehicle according to claim 31, wherein the display form is manually registered.   The visual support device for a vehicle according to any one of claims 30 to 33, wherein the image selection unit further includes an image selection / erasure switch for manually canceling the automatic selection information stored in the storage unit. Further comprising communication line means for acquiring the road information or / and the running state of another vehicle via a communication line;
The image selecting means automatically selects an image based on the road information or / and the running state of the other vehicle and the road information or / and the running state of the own vehicle. 35. The vehicle visual assistance device according to any one of 35.

Images