JP2020185982A - Display control device and display control program - Google Patents

Abstract

To provide a display control device or the like which can present a guide relating to in-lane travelling and lane change so as to be easily understood.SOLUTION: An HCU is used in a vehicle A, and has a function of a display control device which controls display by a head-up display. The HCU superimposes and displays LTA execution content CTt indicating a predicted track of in-lane travelling on the basis of LTA information acquired from a lane keep control unit for controlling the in-lane travelling of the vehicle A on a road surface as a superimposition object. In addition, the HCU displays LCA advance notice content CTpc, which indicates a predicted track of the lane change on the basis of LCA information, when the LCA information is acquired from the lane change control unit for controlling the lane change of the vehicle A during in-lane travelling, together with the LTA execution content CTt.SELECTED DRAWING: Figure 10

Description

The disclosure according to this specification relates to a display control device and a display control program for controlling display by a head-up display.

For example, Patent Document 1 describes a traveling control device that automatically generates a lane change track and automatically guides the own vehicle to a lane change destination according to the generated track. The travel control device of Patent Document 1 captures the foreground of the own vehicle by capturing a display for guiding the start position and end position of the lane change based on automatic guidance and a display for guiding the travel in the lane to the start position of the lane change. It is superimposed on the real image and displayed on a display such as a meter or a navigation device.

Japanese Patent No. 6387369

Patent Document 1 describes that a head-up display can be adopted as a display for displaying guidance for changing lanes and maintaining lanes. However, even if the screen display of a normal display is displayed as a virtual image using a head-up display, there is a risk that the guidance for changing lanes and traveling in the lane will not be easy to understand.

An object of the present disclosure is to provide a display control device and a display control program capable of providing easy-to-understand guidance regarding driving in a lane and changing lanes.

In order to achieve the above object, one disclosed aspect is a display control device used in the vehicle (A) to control the display by the head-up display (20), which is a lane for controlling the driving of the vehicle in the lane. Acquire lane change information related to lane change from the control information acquisition unit (73) that acquires driving control information related to driving control from the maintenance control unit (51) and the lane change control unit (52) that controls the lane change of the vehicle. The change information acquisition unit (74) and the display control unit (75) that superimpose and display the predicted locus content (CTt) indicating the predicted locus of driving in the lane on the road surface as the superimposition target based on the driving control information. When the lane change information is acquired while driving in the lane, the display control unit displays the lane change content (CTpc) indicating the expected lane change locus together with the expected locus content based on the lane change information. It is considered as a control device.

Further, one disclosed aspect is a display control program used in the vehicle (A) to control the display by the head-up display (20), and the vehicle travels in the lane to at least one processing unit (11). (S103), the driving control information related to the driving control is acquired from the lane keeping control unit (51) that controls (S104), the lane change information related to the lane change is acquired from the lane change control unit (52) that controls the lane change of the vehicle (S107, S108), and the lane change information is obtained while driving in the lane. When acquired, the display control program executes a process including displaying the lane change content (CTpc) indicating the predicted lane change locus together with the predicted locus content (S113) based on the lane change information.

In these aspects, when shifting from driving in the lane by the lane keeping control unit to changing lanes by the lane change control unit, the lane change content indicating the predicted locus in the lane change is added to the predicted locus content superimposed and displayed on the road surface. Is displayed. As described above, if the lane change content and the predicted trajectory content include the superimposed content in which the superimposed target is specified, the driver will change the control transition from the change in the display recognized through the normal visual behavior. Can be grasped. Therefore, it is possible to provide easy-to-understand guidance regarding driving in the lane and changing lanes.

Further, one disclosed aspect is a display control device used in the vehicle (A) that controls the display by the head-up display (20), and is a lane keeping control unit (51) that controls the traveling in the lane of the vehicle. ), A control information acquisition unit (73) that acquires driving control information related to driving control, and a change information acquisition unit that acquires lane change information related to lane change from a lane change control unit (52) that controls a lane change of a vehicle. (74) and a display control unit (75) that superimposes and displays the predicted locus content (CTt) indicating the predicted locus of traveling in the lane on the road surface as a superimposition target based on the driving control information. Is the lane change content (CTwc, CTpc, CTc) indicating the predicted lane change based on the lane change information after ending the display of the predicted trajectory content when the lane change information is acquired while driving in the lane. ) Is displayed as a display control device.

Further, one disclosed aspect is a display control program used in the vehicle (A) to control the display by the head-up display (20), and the vehicle travels in the lane to at least one processing unit (11). (S103), the driving control information related to the driving control is acquired from the lane keeping control unit (51) that controls (S104), lane change information related to lane change was acquired from the lane change control unit (52) that controls the lane change of the vehicle (S105), and lane change information was acquired while driving in the lane. In this case, after the display of the predicted locus content is finished, the lane change content (CTwc, CTpc, CTc) indicating the predicted lane change is displayed (S110, S113, S116) based on the lane change information. It is a display control program that executes the including processing.

In these aspects, when shifting from driving in the lane by the lane keeping control unit to changing lanes by the lane change control unit, the lane change content indicating the predicted locus in the lane change is replaced with the predicted locus content superimposed and displayed on the road surface. Is displayed. As described above, if the lane change content and the expected trajectory content are sequentially displayed, the driver can grasp the control transition schedule from the change in the display recognized through the normal visual behavior. Therefore, it is possible to provide easy-to-understand guidance regarding driving in the lane and changing lanes.

The reference numbers in parentheses are merely examples of the correspondence with the specific configuration in the embodiment described later, and do not limit the technical scope at all.

It is a figure which shows the whole image of the vehicle-mounted network including the HCU according to the first embodiment of the present disclosure. It is a figure which shows an example of the head-up display mounted on a vehicle. It is a figure which shows an example of the schematic structure of HCU. It is a figure which visualizes and shows an example of the simulation of the display layout carried out in the display generation part. It is a figure which visualizes and shows an example of the simulation of the display layout carried out in the display generation part. It is a figure which shows typically the whole image of the scene which changes a lane in order to overtake the vehicle in front. It is a figure which shows the LTA execution display. It is a figure which shows the LCA reception display. It is a figure which shows the LCA standby display when the LC execution section is not within the angle of view. It is a figure which shows the LCA standby display when the LC execution section is within the angle of view. It is a figure which shows the LCA execution display. It is a figure which shows the LC cancellation display when the lane change is canceled. It is a figure which shows the LCA standby display and LCA execution display when the moving destination lane is not within the angle of view. It is a figure which shows the LTA transition display. It is a figure which shows the LTA standby display. It is a figure which shows the LTA execution display after the completion of the lane change by the LCA function. It is a figure which shows the LCA standby display when the LC execution section is within the angle of view. It is a figure which shows the LCA execution display. It is a flowchart which shows the detail of the process which realizes the display control method of 1st Embodiment together with FIG. 20 and FIG. It is a flowchart which shows the detail of the process which realizes the display control method of 1st Embodiment together with FIG. 19 and FIG. It is a flowchart which shows the detail of the process which realizes the display control method of 1st Embodiment together with FIG. 19 and FIG. It is a figure which shows the LTA execution display of the 2nd Embodiment. It is a figure which shows the LCA reception display of the 2nd Embodiment. It is a figure which shows the LCA standby display of the 2nd Embodiment, and shows the LCA standby display when the LC execution section is not within the angle of view. It is the LCA standby display of the 2nd Embodiment, and is the figure which shows the LCA standby display when the LC execution section is within the angle of view. It is a figure which shows the LCA execution display of the 2nd Embodiment. In the second embodiment, it is a figure which shows the LCA standby display and the LCA execution display when the moving destination lane is not within the angle of view. It is a figure which shows the LTA transition display of the 2nd Embodiment. It is a figure which shows the LTA standby display of the 2nd Embodiment. It is a figure which shows the LTA execution display after the completion of the lane change by the LCA function. It is a figure which shows the LCA reception display of the 3rd Embodiment. It is a figure which shows the LCA standby display of the 3rd Embodiment. It is a figure which shows the LTA transition display of the 3rd Embodiment. It is a figure which shows the LCA reception display of 4th Embodiment. It is a figure which shows the LCA standby display of 4th Embodiment. It is a figure which shows the LCA cancellation display of 4th Embodiment. It is a figure which shows the LTA standby display of 4th Embodiment. It is a figure which shows the LTA transition display of 4th Embodiment. It is a figure which shows the LCA standby display and LCA execution display of 4th Embodiment. It is a figure which shows the LCA standby display of 5th Embodiment. It is a figure which shows the LCA execution display of 5th Embodiment and the LTA execution display after that. This is the LCA standby display of the fifth embodiment. It is a figure which shows the LCA standby display of 6th Embodiment. It is a figure which shows the LCA cancellation display of 6th Embodiment. It is a figure which shows the LTA transition display of 6th Embodiment. It is a figure which shows the LCA standby display of 6th Embodiment. It is a figure which shows the transition of the LCA reception display, the LCA standby display, and the LCA execution display in the modification 1. It is a figure which shows the LCA standby display of the modification 2. It is a figure which shows the LTA transition display of the modification 2. It is a figure which shows the LCA standby display of the modification 3. It is a figure which shows the LCA standby display of the modification 4. It is a figure which shows the LCA reception display of the modification 5. It is a figure which shows the LTA transition display of the modification 6. It is a figure which shows the LCA standby display of the modification 7 when the moving destination lane is out of the angle of view. It is a figure which shows the LTA standby display of the modification 8. It is a figure which shows the LCA standby display and LTA transition display of the modification 9.

Hereinafter, a plurality of embodiments of the present disclosure will be described with reference to the drawings. In addition, duplicate description may be omitted by assigning the same reference numerals to the corresponding components in each embodiment. When only a part of the configuration is described in each embodiment, the configuration of the other embodiment described above can be applied to the other parts of the configuration. Further, not only the combination of the configurations specified in the description of each embodiment, but also the configurations of a plurality of embodiments can be partially combined even if the combination is not specified. Further, it is assumed that the unspecified combination of the configurations described in the plurality of embodiments and modifications is also disclosed by the following description.

(First Embodiment)
The function of the display control device according to the first embodiment of the present disclosure is realized by the HCU (Human Machine Interface Control Unit) 100 shown in FIGS. 1 to 3. The HCU 100 comprises an HMI (Human Machine Interface) system 10 used in the vehicle A together with a head-up display (hereinafter, HUD) 20 and the like. In addition, the HMI system 10 further includes an operating device 26, a driver status monitor (hereinafter, DSM) 27, and the like. The HMI system 10 has an input interface function for accepting user operations by an occupant (for example, a driver) of the vehicle A, and an output interface function for presenting information to the driver.

The HMI system 10 is communicably connected to the communication bus 99 of the vehicle-mounted network 1 mounted on the vehicle A. The HMI system 10 is one of a plurality of nodes provided in the vehicle-mounted network 1. A peripheral monitoring sensor 30, a locator 40, a DCM (Data Communication Module) 49, and the like are connected to the communication bus 99 of the vehicle-mounted network 1 as nodes. Further, a driving support ECU (Electronic Control Unit) 50, a body ECU 55, and the like are connected to the communication bus 99 as nodes. These nodes connected to the communication bus 99 can communicate with each other. The specific nodes of these devices and each ECU may be directly electrically connected to each other and can communicate with each other without going through the communication bus 99.

In the following description, the front-rear (see FIG. 2 front Ze and rear Go) and left-right (see FIG. 2 side Yo) directions are defined with reference to the vehicle A stationary on a horizontal plane. Specifically, the front-rear direction is defined along the longitudinal direction (traveling direction) of the vehicle A. The left-right direction is defined along the width direction of the vehicle A. Further, the vertical direction (see FIG. 2 upper Ue and lower Si) is defined along the vertical direction of the horizontal plane that defines the front-back direction and the left-right direction. Further, for the sake of simplification of the description, the description of the code indicating each direction may be omitted as appropriate.

The peripheral monitoring sensor 30 is an autonomous sensor that monitors the surrounding environment of the vehicle A. The peripheral monitoring sensor 30 can be used to detect moving objects such as pedestrians, cyclists, non-human animals, and other vehicles, as well as falling objects on the road, guardrails, curbs, road markings, traveling lane markings, etc., from the detection range around the vehicle. It is possible to detect road markings and stationary objects such as structures on the side of the road. The peripheral monitoring sensor 30 provides the detection information of detecting an object around the vehicle A to the driving support ECU 50 and the like through the communication bus 99.

The peripheral monitoring sensor 30 has a front camera 31 and a millimeter wave radar 32 as a detection configuration for object detection. The front camera 31 outputs at least one of the imaging data obtained by photographing the front range of the vehicle A and the analysis result of the imaging data as detection information. A plurality of millimeter wave radars 32 are arranged, for example, on the front and rear bumpers of the vehicle A at intervals from each other. The millimeter wave radar 32 irradiates the millimeter wave or the quasi-millimeter wave toward the front range, the front side range, the rear range, the rear side range, and the like of the vehicle A. The millimeter wave radar 32 generates detection information by a process of receiving reflected waves reflected by a moving object, a stationary object, or the like. The peripheral monitoring sensor 30 may include detection configurations such as a rider and sonar.

The locator 40 generates highly accurate position information and the like of the vehicle A by compound positioning that combines a plurality of acquired information. The locator 40 can specify, for example, the lane in which the vehicle A travels among a plurality of lanes. The locator 40 includes a GNSS (Global Navigation Satellite System) receiver 41, an inertial sensor 42, a high-precision map database (hereinafter, high-precision map DB) 43, and a locator ECU 44. The locator 40 may include other sensor configurations such as an electronic compass.

The GNSS receiver 41 receives positioning signals transmitted from a plurality of artificial satellites (positioning satellites). The GNSS receiver 41 can receive a positioning signal from each positioning satellite of at least one satellite positioning system among satellite positioning systems such as GPS, GLONASS, Galileo, IRNSS, QZSS, and Beidou.

The inertial sensor 42 has, for example, a gyro sensor and an acceleration sensor. The high-precision map DB 43 is mainly composed of a non-volatile memory, and stores map data (hereinafter, high-precision map data) having higher accuracy than ordinary map data used for navigation. The high-precision map data holds detailed information at least for information in the height (z) direction. The high-precision map data includes information that can be used for advanced driving support and automatic driving, such as three-dimensional shape information of roads, information on the number of lanes, and information indicating the direction of travel allowed for each lane.

The locator ECU 44 mainly includes a microcomputer including a processor, RAM, a storage unit, an input / output interface, and a bus connecting them. The locator ECU 44 combines the positioning signal received by the GNSS receiver 41, the measurement result of the inertial sensor 42, the vehicle speed information output to the communication bus 99, and the like, and sequentially positions the own vehicle position, the traveling direction, and the like of the vehicle A. The locator ECU 44 provides the position information and direction information of the vehicle A based on the positioning result to the driving support ECU 50, the HCU 100, and the like through the communication bus 99. In addition, the locator ECU 44 reads the corresponding high-precision map data from the high-precision map DB 43 in response to a request from the driving support ECU 50, the HCU 100, and the like, and provides the locator ECU 44 to the request source ECU.

The DCM49 is a communication module mounted on the vehicle A. The DCM49 transmits and receives radio waves to and from base stations around the vehicle A by wireless communication in accordance with communication standards such as LTE (Long Term Evolution) and 5G. By installing the DCM49, the vehicle A becomes a connected car that can connect to the Internet. The DCM49 can acquire the latest high-precision map data from a probe server provided on the cloud. The DCM49 cooperates with the locator ECU 44 to update the high-precision map data stored in the high-precision map DB 43 to the latest information.

The operation support ECU 50 has a configuration mainly including a computer including a processor, a RAM, a storage unit, an input / output interface, a bus connecting these, and the like. The driving support ECU 50 has a driving support function that supports the driving operation of the driver. The driving support ECU 50 enables partial automatic driving control (advanced driving support) of level 2 or lower at the automatic driving level specified by the American Society of Automotive Engineers of Japan.

Based on the detection information acquired from the peripheral monitoring sensor 30, the driving support ECU 50 recognizes the driving environment around the vehicle A for the driving control described later. The driving support ECU 50 provides the HCU 100 with the result of the analysis of the detection information performed by the driving environment recognition as the analyzed detection information. The driving support ECU 50 provides information (hereinafter, boundary information) indicating the relative positions and shapes of the left and right lane markings (or road edges) of the lane in which the vehicle A is currently traveling (hereinafter, own lane Lns, see FIG. 7). It can be provided to the HCU 100. As described above, the left and right directions referred to here are directions that coincide with the width direction of the vehicle A stationary on the horizontal plane, and are set with reference to the traveling direction of the vehicle A.

The driving support ECU 50 has a plurality of functional units that realize advanced driving support by executing a program by a processor. Specifically, the driving support ECU 50 includes an ACC (Adaptive Cruise Control) control unit, a lane keeping control unit 51, and a lane change control unit 52. The ACC control unit is a functional unit that realizes the function of ACC for driving the vehicle A at a constant speed at a target vehicle speed or for following the vehicle A while maintaining the distance between the vehicle and the vehicle in front. The ACC control unit sequentially provides the HCU 100 with ACC status information indicating the operating state of the ACC function.

The lane keeping control unit 51 is a functional unit that realizes the function of the LTA (Lane Tracing Assist) that controls the traveling of the vehicle in the lane. LTA is also called LTC (Lane Trace Control). The lane keeping control unit 51 controls the steering angle of the steering wheel of the vehicle A based on the boundary information extracted from the image data of the front camera 31 and the like. The lane keeping control unit 51 generates a planned traveling line PRL (see FIGS. 4 and 5) having a shape along the own lane Lns so that the vehicle A travels in the center of the own lane Lns (see FIG. 7). To do. The lane keeping control unit 51 cooperates with the ACC control unit to drive the vehicle A in the own lane Lns (hereinafter referred to as “lane keeping control”) according to the planned running line PRL (so-called lane keeping control or lane following control). I do.

When the lane keeping control unit 51 activates the LTA function based on, for example, a user operation on the operation device 26, the lane keeping control unit 51 sequentially provides the HCU 100 with driving control information (hereinafter, LTA information) relating to driving control of driving in the lane. The LTA information includes at least status information and line shape information.

The status information is information indicating whether the operating state of the LTA function is a standby state, an executing state, or an executable state. In the standby state, the search for lane markings or roadsides is continuously carried out. On the other hand, the driving control for traveling in the lane is not executed (started) in the standby state. The execution state is a state in which the lane marking or the road edge is recognized and the operation control is being executed. The executable state is a state in which the driving control for traveling in the lane is temporarily interrupted because the lane change control unit 52 executes the lane change described later. In the viable state, lane markings or roadsides are recognized. Therefore, if it is in the executable state, the driving control for traveling in the lane can be restarted after the lane change is completed. The status information indicating the executable state is the LTA information related to the driving control after the lane change is completed.

The line shape information is information indicating the shape of the planned traveling line PRL. Based on the line shape information, the HCU 100 can restore the shape of the planned running line PRL. As an example, the line shape information is a data format including at least the three-dimensional coordinates of a plurality of specific points that define the shape of the planned running line PRL, the length of the virtual line connecting the specific points, the radius of curvature, and the like. Good. As another example, the line shape information may be in a data format including a large number of coordinate information that defines points lined up on the planned running line PRL at predetermined intervals.

The lane change control unit 52 is a functional unit that realizes the function of LCA (Lane Change Assist) that controls the lane change of the vehicle. The lane change control unit 52 activates the LCA function when the driver inputs an on operation (described later) instructing the execution of the lane change by the driving support function. The LCA function can be used only when the LTA function is in the operating state. The lane change control unit 52 automatically controls the steering angle of the steering wheel of the vehicle A to move the vehicle A from the own lane Lns to the adjacent lane. At this time, the lane change control unit 52 temporarily shifts the LTA function in the lane keeping control unit 51 to the standby state (or the executable state), and temporarily interrupts the driving control for traveling in the lane. It enables movement to the adjacent lane with departure from the own lane Lns. When the lane change control unit 52 completes the lane change, the lane change control unit 52 transitions to the off state. As a result, the lane keeping control unit 51 transitions from the executable state to the executed state, and restarts the driving control for traveling in the lane.

The lane change control unit 52 sets a planned traveling line PRL (see FIGS. 4 and 5) from the own lane Lns to the adjacent lane (hereinafter referred to as the destination lane Lnd, see FIG. 8) to be moved in the lane change. Generate. The lane change control unit 52 executes a lane change from the own lane Lns to the destination lane Lnd according to the planned traveling line PRL. The scheduled traveling line PRL for changing lanes is generated in a shape continuous with the scheduled traveling line PRL for traveling in the lane generated by the lane keeping control unit 51.

In the lane change by the lane change control unit 52, an upper limit is set for the lateral acceleration or the moving speed. Therefore, the shape of the planned traveling line PRL indicated by the locus shape information becomes longer along the extending direction of the road as the traveling speed indicated by the vehicle speed information increases. Therefore, the distance required for changing lanes (see LC execution section SLc, FIGS. 4 and 5 described later) also becomes long.

When the lane change control unit 52 activates the LCA function based on the ON operation, the lane change control unit 52 sequentially provides the HCU 100 with lane change information (hereinafter, LCA information) relating to the lane change. Like the LTA information, the LCA information also includes at least status information in addition to the line shape information. Further, the LCA information may further include input information of the on operation and input information of the cancel operation for canceling the on operation.

The status information is information indicating whether the operating state of the LCA function is a start-up state, a standby state, or an execution state. The startup start state is the state immediately after the on operation is accepted. In the start-up state, based on the detection information, it is confirmed whether or not another vehicle exists in the destination lane Lnd (see FIG. 8), which is the destination for changing lanes (hereinafter, peripheral check). Other vehicles to be detected by the peripheral check are not limited to vehicles traveling in the destination lane Lnd, and the destination lane Lnd from the lane located on the opposite side of the own lane Lns across the destination lane Lnd. May include vehicles that can change lanes. When the peripheral check is completed, the operating state of the LCA function is set to either the standby state or the executing state. As a result of the peripheral check, if there is another vehicle that prevents the vehicle from changing lanes, the LCA function is in the standby state. On the other hand, when there is no other vehicle that hinders the lane change of the own vehicle, the LCA function shifts the operating state from the start start state or the standby state to the execution state in which the lane change is started.

The body ECU 55 has a configuration mainly including a microcontroller including a processor, a RAM, a storage unit, an input / output interface, and a bus connecting them. The body ECU 55 has at least a function of controlling the operation of a lighting device mounted on the vehicle A, such as a headlight and a turn signal. The body ECU 55 is electrically connected to the direction indicator switch 56.

The direction indicator switch 56 is a lever-shaped operation unit provided on the steering column unit 8. The body ECU 55 starts blinking either the left or right direction indicator corresponding to the operation direction based on the detection of the user operation input to the direction indicator switch 56. In the direction indicator switch 56, in addition to the normal user operation of starting the blinking operation of the turn signal in the state of manual operation, the lane change control unit 52 executes the lane change control in the state where the LTA function is activated. The on operation to instruct is input. As an example, a user operation in which the direction indicator switch 56 is half-pressed for a predetermined time (for example, about 1 to 3 seconds) is an on operation of the LCA function. When the body ECU 55 detects the input of the on operation of the LCA function, the body ECU 55 outputs the on operation information to the driving support ECU 50. In the on operation information, the fact that the on operation has been input and the left and right input directions of the on operation are notified as information related to the on operation. The operation of the direction indicator switch 56 in the direction opposite to the on operation is the cancel operation of the LCA function. Further, steering operation, accelerator operation, brake operation, etc. exceeding a specific operation amount by the driver are also regarded as cancellation operations of the LCA function.

Next, details of the operating device 26, DSM27, HUD20, and HCU100 included in the HMI system 10 will be described in order.

The operation device 26 is an input unit that accepts user operations by a driver or the like. A user operation for switching between starting and stopping is input to the operation device 26, for example, for a driving support function or the like. Specifically, the operation device 26 includes a steering switch provided on the spoke portion of the steering wheel, an operation lever provided on the steering column portion 8, a voice input device for detecting the driver's utterance, and the like.

The DSM 27 is configured to include a near-infrared light source, a near-infrared camera, and a control unit for controlling them. The DSM 27 is installed in a posture in which the near-infrared camera is directed toward the headrest portion of the driver's seat, for example, on the upper surface of the steering column portion 8 or the upper surface of the instrument panel 9. The DSM27 uses a near-infrared camera to photograph the head of the driver irradiated with near-infrared light by a near-infrared light source. The image captured by the near-infrared camera is image-analyzed by the control unit. The control unit extracts information such as the position of the eye point EP and the line-of-sight direction from the captured image, and sequentially outputs the extracted state information to the HCU 100.

The HUD 20 is mounted on the vehicle A as one of a plurality of in-vehicle display devices together with a meter display, a center information display, and the like. The HUD 20 is electrically connected to the HCU 100 and sequentially acquires video data generated by the HCU 100. Based on the video data, the HUD 20 presents various information related to the vehicle A, such as route information, sign information, and control information of each in-vehicle function, to the driver using the virtual image Vi.

The HUD 20 is housed in a storage space in the instrument panel 9 below the windshield WS. The HUD 20 projects the light formed as a virtual image Vi toward the projection range PA of the windshield WS. The light projected on the windshield WS is reflected toward the driver's seat side in the projection range PA and is perceived by the driver. The driver visually recognizes the display in which the virtual image Vi is superimposed on the foreground seen through the projection range PA.

The HUD 20 includes a projector 21 and a magnifying optical system 22. The projector 21 has an LCD (Liquid Crystal Display) panel and a backlight. The projector 21 is fixed to the housing of the HUD 20 with the display surface of the LCD panel facing the magnifying optical system 22. The projector 21 displays each frame image of video data on the display surface of the LCD panel, and transmits and illuminates the display surface with a backlight to emit light formed as a virtual image Vi toward the magnifying optical system 22. To do. The magnifying optical system 22 includes at least one concave mirror in which a metal such as aluminum is vapor-deposited on the surface of a base material made of synthetic resin or glass. The magnifying optical system 22 projects the light emitted from the projector 21 onto the upper projection range PA while spreading it by reflection.

The angle of view VA is set in the above HUD 20. Assuming that the virtual range in the space where the virtual image Vi can be imaged by the HUD 20 is the image plane IS, the angle of view VA is defined based on the virtual line connecting the driver's eye point EP and the outer edge of the image plane IS. The viewing angle. The angle of view VA is an angle range in which the driver can visually recognize the virtual image Vi when viewed from the eye point EP. In the HUD 20, the horizontal angle of view (for example, about 10 to 12 °) in the horizontal direction is larger than the vertical angle of view (for example, about 4 to 5 °) in the vertical direction. When viewed from the eye point EP, the front range (for example, a range of about a dozen m to 100 m) that overlaps with the image plane IS is the range within the angle of view VA.

The HUD 20 displays the superimposed content CTs (see FIG. 7 and the like) and the non-superimposed content CTn (see FIGS. 8 and 14 and the like) as virtual images Vi. Superimposed content CTs are AR display objects used for augmented reality (AR) display. The display position of the superimposed content CTs is associated with a specific superimposed object existing in the foreground, such as a specific position on the road surface, a vehicle in front, a pedestrian, and a road sign. The superimposed content CTs are superimposed and displayed on a specific superimposed object in the foreground, and can be moved in the appearance of the driver following the superimposed object so as to be relatively fixed to the superimposed object. That is, the relative positional relationship between the driver's eye point EP, the superposed object in the foreground, and the superposed content CTs is continuously maintained. Therefore, the shape of the superimposed content CTs may be continuously updated at a predetermined cycle according to the relative position and shape of the superimposed object. The superimposed content CTs are displayed in a posture closer to horizontal than the non-superimposed content CTn, and have a display shape extending in the depth direction (traveling direction, forward Ze) as seen from the driver, for example.

The non-superimposed content CTn is a non-AR display object excluding the superposed content CTs among the display objects superimposed and displayed in the foreground. Unlike the superimposed content CTs, the non-superimposed content CTn is displayed superimposed on the foreground without specifying the superimposed target. The display position of the non-superimposed content CTn is not associated with a specific superimposition target. The display position of the non-superimposed content CTn is a fixed position within the projection range PA (the above-mentioned angle of view VA). Therefore, the non-superimposed content CTn is displayed as if it is relatively fixed to the vehicle configuration such as the windshield WS. Further, the shape of the non-superimposed content CTn may be substantially constant. The non-superimposed content CTn may be accidentally superposed on the superimposition target of the superimposition content CTs due to the positional relationship between the eye point EP and the superimposition target.

The HCU 100 is an electronic control device that integrally controls the display by a plurality of in-vehicle display devices including the HUD 20 in the HMI system 10. The HCU100, HUD20, and the like constitute a virtual image display system.

The HCU 100 mainly includes a computer including a processing unit 11, a RAM 12, a storage unit 13, an input / output interface 14, and a bus connecting them. The processing unit 11 is hardware for arithmetic processing combined with the RAM 12. The processing unit 11 has a configuration including at least one arithmetic core such as a CPU (Central Processing Unit) and a GPU (Graphics Processing Unit). The processing unit 11 may further include an FPGA (Field-Programmable Gate Array), an NPU (Neural network Processing Unit), an IP core having other dedicated functions, and the like. The RAM 12 may be configured to include a video RAM for video generation. By accessing the RAM 12, the processing unit 11 executes various processes for realizing the functions of the functional units described later. The storage unit 13 is configured to include a non-volatile storage medium. Various programs (display control programs, etc.) executed by the processing unit 11 are stored in the storage unit 13.

The HCU 100 shown in FIGS. 1 to 3 has a plurality of functional units for controlling the superimposed display of contents by the HUD 20 by executing the display control program stored in the storage unit 13 by the processing unit 11. Specifically, the HCU 100 is constructed with functional units such as a viewpoint position specifying unit 71, a locator information acquisition unit 72, an LTA information acquisition unit 73, an LCA information acquisition unit 74, and a display generation unit 75.

The viewpoint position specifying unit 71 identifies the position of the eye point EP of the driver seated in the driver's seat based on the state information acquired from the DSM 27. The viewpoint position specifying unit 71 generates three-dimensional coordinates (hereinafter, eye point coordinates) indicating the position of the eye point EP, and sequentially provides the generated eye point coordinates to the display generation unit 75.

The locator information acquisition unit 72 acquires the information necessary for the superimposed display of the superimposed content CTs. Specifically, the locator information acquisition unit 72 acquires the latest position information and direction information about the vehicle A from the locator ECU 44 as own vehicle position information. In addition, the locator information acquisition unit 72 acquires high-precision map data of the peripheral range of the vehicle A from the locator ECU 44. The locator information acquisition unit 72 sequentially provides the acquired vehicle position information and high-precision map data to the display generation unit 75. Although the locator ECU 44 can provide information in a range wider than the peripheral range of the vehicle A, the locator information can be used to provide information in a range (for example, 50 m to 200 m around the vehicle A) necessary for superimposing the superimposed content CTs. Provided to the acquisition unit 72.

The LTA information acquisition unit 73 acquires the ACC status information and the LTA information output to the communication bus 99. As described above, the LTA information is driving control information related to driving control of driving in the lane output to the communication bus 99 by the lane keeping control unit 51. The status information of the LTA information includes information indicating whether or not the lane keeping control unit 51 can execute the lane change after the lane change is completed. In addition, the LTA information acquisition unit 73 acquires boundary information of the own lane Lns (see FIG. 7) from the driving support ECU 50. The LTA information acquisition unit 73 sequentially provides the display generation unit 75 with the status information and the line shape information included in the LTA information and the boundary information.

The LTA information acquisition unit 73 may acquire the imaging data of the front camera 31 instead of the boundary information as the analysis result acquired from the driving support ECU 50. In this case, the LTA information acquisition unit 73 acquires boundary information by a process of extracting the left and right lane markings or road edges of the own lane Lns from the imaging data. Here, the lane keeping control unit 51 can provide lane keeping control information in a wider range than the peripheral range of the vehicle A. The lane maintenance control unit 51 to the LTA information acquisition unit 73 are provided with at least lane maintenance control information in a range (for example, 50 m to 200 m around the vehicle A) necessary for superimposing the superimposed content CTs. The lane keeping control unit 51 may provide the LTA information to the LTA information acquisition unit 73 substantially all the time, for example, during the period when the lane keeping control is on, or when a specific event is determined to occur, the LTA information is sequentially provided. You may be broken.

The LCA information acquisition unit 74 acquires the LCA information output to the communication bus 99. As described above, the LCA information is driving control information related to the lane change output to the communication bus 99 by the lane change control unit 52. The line shape information of the LCA information includes information indicating the start point and end point of the lane change and the movement direction in the lane change as information on the destination lane Lnd (see FIG. 8) in which the vehicle A moves due to the lane change. I'm out. The LCA information acquisition unit 74 sequentially provides the display generation unit 75 with the status information and the line shape information included in the LCA information.

The display generation unit 75 controls the presentation of information to the driver by the HUD 20 by generating video data that is sequentially output to the HUD 20. The display generation unit 75 draws the original image of each content displayed as a virtual image Vi on the individual frame images constituting the video data. When drawing the original image of the superimposed content CTs (see FIG. 7 and the like) on the frame image, the display generation unit 75 draws the original image in the frame image and the drawing shape according to the eye point EP and each position of the overlay target. To correct. As described above, the superimposed content CTs are displayed at the position and shape correctly superimposed on the superimposed object when viewed from the eye point EP.

The display generation unit 75 further has a virtual layout function and a content selection function in order to realize the above-mentioned video data generation function. The virtual layout function is a function of simulating the display layout of the superimposed content CTs based on various information provided to the display generation unit 75. The display generation unit 75 reproduces the current traveling environment of the vehicle A in the virtual space based on the vehicle position information, the high-precision map data, the detection information, and the like. The display generation unit 75 may start the simulation of the display layout by its own judgment based on the LTA information and the LCA information.

More specifically, as shown in FIGS. 2 to 5, the display generation unit 75 sets the own vehicle object AO at a reference position in the virtual three-dimensional space. The display generation unit 75 maps the road model of the shape indicated by the high-precision map data to the three-dimensional space in association with the own vehicle object AO based on the own vehicle position information. The display generation unit 75 sets a planned traveling line PRL having a shape based on the line shape information on the road model while referring to the boundary information.

The display generation unit 75 sets the virtual camera position CP and the superimposition range SA in association with the own vehicle object AO. The virtual camera position CP is a virtual position corresponding to the driver's eye point EP. The display generation unit 75 sequentially corrects the virtual camera position CP with respect to the own vehicle object AO based on the latest eye point coordinates acquired by the viewpoint position specifying unit 71. The superimposition range SA is a range in which the virtual image Vi can be superposed and displayed. The display generation unit 75 looks forward from the virtual camera position CP based on the virtual camera position CP and the outer edge position (coordinates) information of the image plane IS stored in advance in the storage unit 13 (see FIG. 1) or the like. The front range, which is sometimes inside the image plane IS, is set as the superimposition range SA. The superimposition range SA corresponds to the angle of view VA of HUD20.

The display generation unit 75 can arrange the first virtual object VO1 and the second virtual object VO2 on the road surface of the road model in the three-dimensional space. The first virtual object VO1 is a virtual object that defines the positions and shapes of the LTA execution content CTt (see FIG. 7) and the LTA notice content CTpt (see FIG. 14), which will be described later. The first virtual object VO1 is set in the virtual space when the contents CTt and CTpt are displayed as virtual images. The first virtual object VO1 is arranged on the virtual road surface corresponding to the LTA execution sections SLt1 and SLt2 in the virtual space. The LTA execution sections SLt1 and SLt2 are planned control sections in which the LTA function is activated and the vehicle A travels in the lane. The first virtual object VO1 has a shape extending in a strip shape on the planned traveling line PRL arranged in the center of the virtual road surface of the own lane.

The second virtual object VO2 is a virtual object that defines the positions and shapes of the LCA standby content CTwc (see FIG. 9), the LCA notice content CTpc (see FIG. 10), and the LCA execution content CTc (see FIG. 11), which will be described later. .. The second virtual object VO2 is set in the virtual space when displaying each content CTwc, CTpc, CTc as a virtual image. The second virtual object VO2 is arranged on the virtual road surface corresponding to the LC execution section SLc in the virtual space. The LC execution section SLc is a planned control section in which the LCA function is activated and the vehicle A changes lanes. The second virtual object VO2 has a shape that covers the virtual road surface of the destination lane in a plane.

The shape of each of the above virtual objects VO1 and VO2 as viewed from the virtual camera position CP is the virtual image shape of each superimposed content CTs visually recognized from the eye point EP. In other words, the shape of each virtual object VO1 and VO2 projected onto the virtual image plane IS toward the virtual camera position is regarded as the virtual image shape of each superimposed content CTs. The display generation unit 75 calculates the virtual image shape and the drawing shape of the original image from the shapes of the virtual objects VO1 and VO2 based on the specification information of the optical system of the HUD20.

The content selection function is a function for selecting content to be used for presenting information. The display generation unit 75 selects the content to be drawn in the video data based on the LTA information, the LCA information, and the like acquired by the information acquisition units 73 and 74 and the simulation result of the display layout. The display generation unit 75 properly uses the superimposed content CTs and the non-superimposed content CTn, and presents information related to the lane keeping control and the lane change control to the driver.

The display generation unit 75 described so far has an LTA execution display (see FIGS. 7 and 16), an LCA reception display (see FIG. 8), and an LCA standby display in a scene overtaking the preceding vehicle AF as shown in FIG. (See FIGS. 9, 10, 13 and 17) and the like are presented. Further, the display generation unit 75 includes an LCA execution display (see FIGS. 11, 13 and 18), an LCA cancellation display (see FIG. 12), an LTA transition display (see FIG. 14), and an LTA standby display (see FIG. 15). Etc. are presented.

These displays include LTA execution content CTt, LTA notice content CTpt, and LTA standby content CTwt as contents for giving LTA-related notifications. Further, each display includes response notification content CTa, LCA standby content CTwc, LCA notice content CTpc, and LCA execution content CTc as contents for giving LCA-related notification. Hereinafter, the details of each display will be described in order based on FIGS. 7 to 18 with reference to FIGS. 3 to 6.

The LTA execution display shown in FIG. 7 is a display indicating to the driver that the LTA function is being executed by the lane keeping control unit 51. The LTA execution display includes the LTA execution content CTt. The LTA execution content CTt are superimposed content CTs that are superimposed and displayed in the center of the road surface of the own lane Lns in the foreground. The LTA execution content CTt shows the predicted locus of traveling in the lane by the LTA function. In addition, the LTA execution content CTt indicates that the lane keeping control unit 51 controls the traveling position of the vehicle A to the center of the own lane Lns.

The drawing shape of the LTA execution content CTt is determined based on the above-mentioned first virtual object VO1. The LTA execution content CTt is displayed so as to stick to the road surface in a posture along the road surface. The LTA execution content CTt has a linear shape when the own lane Lns is straight, and has a curved shape along the curved shape when the own lane Lns is curved. The LTA execution content CTt updates the drawing shape at a predetermined update cycle so as to match the road surface shape seen from the eye point EP (see FIG. 2) according to the traveling of the vehicle A.

The LCA reception display shown in FIG. 8 is a display for notifying the driver that the input of the on operation to the direction indicator switch 56 is received and the LCA function is activated. The LCA reception display includes the response notification content CTa in addition to the LTA execution content CTt.

The response notification content CTa is content that notifies the acceptance of the on operation by the lane change control unit 52. The display of the response notification content CTa is started based on the fact that the status information indicating the activation start state is acquired by the LCA information acquisition unit 74. The display of the response notification content CTa is continued until the lane change control unit 52 completes the peripheral check and the LCA information acquisition unit 74 acquires the status information indicating the standby state or the execution state of the LCA function.

The response notification content CTa is a non-superimposed content CTn, and continues to maintain a predetermined shape from the start of display to the end of display. The response notification content CTa is placed on the side of the LTA execution content CTt in the direction of movement when changing lanes, based on on-operation information or LCA information, so as to be superimposed on the road surface of the destination lane Lnd when changing lanes. Is displayed. The response notification content CTa is drawn in a display color or display shape associated with the LCA notice content CTpc (see FIG. 10) described later. Since the response notification content CTa is the non-superimposed content CTn, it does not have to be accurately superimposed on the destination lane Lnd due to the curve shape and slope of the road.

The LCA standby display shown in FIG. 9 is a display for notifying the driver that the LCA function is in the standby state and that the lane change is not started within a predetermined time (for example, 3 seconds). The predetermined time is set based on the angle of view VA of the HUD 20, and specifically, it is set to a time immediately before the LC execution section SLc enters the angle of view VA. The LCA standby display includes the LCA standby content CTwc in addition to the LTA execution content CTt.

The LCA standby content CTwc is content indicating that the LCA function is about to change lanes when the LC execution section SLc is not within the angle of view VA. In other words, the LCA standby content CTwc is also content indicating that it is not possible to move to the destination lane Lnd. The LCA standby content CTwc is displayed in place of the response notification content CTa (see FIG. 8) based on the acquisition of status information indicating the standby state of the LCA function. The LCA standby content CTwc is superimposed content CTs and is superimposed and displayed at a position that does not overlap with the LTA execution content CTt. For example, the LCA standby content CTwc is superimposed and displayed on the entire road surface of the destination lane Lnd included in the angle of view VA. Further, the LCA standby content CTwc is displayed in a manner different from the LCA notice content CTpc (see FIG. 10) when the LC execution section SLc is not within the angle of view VA. For example, the LCA standby content CTwc is displayed with a lower brightness than the LCA notice content CTpc.

The drawing shape of the LCA standby content CTwc is determined based on the above-mentioned second virtual object VO2. The LCA standby content CTwc is displayed so as to stick to the road surface in a posture along the road surface. The LCA standby content CTwc updates the drawing shape at a predetermined update cycle so as to match the road surface shape seen from the eye point EP (see FIG. 2) as the vehicle A travels.

The LCA standby display shown in FIG. 10 is a display for notifying the driver that the LCA function is in the standby state and that the lane change is scheduled to start within a predetermined time. The LCA standby display in this case includes the LCA notice content CTpc in addition to the LTA execution content CTt.

The LTA execution content CTt is superimposed on the road surface of the own lane Lns, which is the range that is the LTA execution section SLt1, in other words, the range that is on the front side (own vehicle side) of the LC execution section SLc. Therefore, as the vehicle A travels, the LTA execution content CTt gradually increases as the point where the LTA execution section SLt1 shifts to the LC execution section SLc (hereinafter, LC transition point Pcs, see FIG. 4) approaches the vehicle A. It's getting shorter.

When the LC execution section SLc is within the angle of view VA, the LCA notice content CTpc is superimposed on the road surface of the destination lane Lnd, and is displayed so as to fill the range of the road surface that becomes the LC execution section SLc. .. The LCA notice content CTpc is displayed at a position that does not overlap with the LTA execution content CTt. Specifically, the LCA notice content CTpc is displayed at a position visible on the back side (upper side) of the LTA execution content CTt and on the Lnd side of the destination lane. The LCA notice content CTpc is gradually expanded in accordance with the contraction of the LTA execution content CTt as the LC transition point Pcs approaches the vehicle A.

The drawing shape of the LCA notice content CTpc is determined based on the above-mentioned second virtual object VO2, similarly to the LCA standby content CTwc (see FIG. 9). The LCA notice content CTpc is displayed so as to stick to the road surface in a posture along the road surface. The drawing shape of the LCA notice content CTpc is updated at a predetermined update cycle so as to match the road surface shape seen from the eye point EP (see FIG. 2).

The LCA execution display shown in FIG. 11 is a display for notifying the driver that the LCA function is in the execution state. When the operating state of the LCA function directly transitions from the activation start state to the execution state, the display generation unit 75 shifts from the LCA reception display (see FIG. 8) to the LCA execution display. The LCA execution display includes the LCA execution content CTc. At the timing when the LCA function transitions from the standby state to the execution state, the LTA execution section SLt1 is already outside the angle of view VA. Therefore, the LTA execution content CTt (see FIG. 10) is hidden in the LCA execution display.

The LCA execution content CTc is displayed in substantially the same manner as the LCA notice content CTpc (see FIG. 10) when the LC execution section SLc is within the angle of view VA. The LCA execution content CTc is the superimposed content CTs, and is configured to fill the entire range of the road surface of the destination lane Lnd that overlaps with the angle of view VA. The drawing shape of the LCA execution content CTc is determined based on the above-mentioned second virtual object VO2, similarly to the LCA notice content CTpc. Therefore, the display transition from the LCA notice content CTpc to the LCA execution content CTc is continuously performed.

The LCA cancellation display shown in FIG. 12 is a display for notifying the driver that the LCA function has transitioned to the off state. In addition, the LCA cancellation display also functions as a display indicating the continuation of driving in the lane by the LTA function. The lane change control unit 52 changes the lane when a cancel operation of the LCA function is input to the direction indicator switch 56, or when a predetermined time elapses without the LCA operating state being able to transition to the execution state (timeout). finish. When the display generation unit 75 grasps the end of the lane change based on the LCA information, the display generation unit 75 shifts from the LCA standby display to the LCA cancel display.

In the LCA cancellation display, the display of the LCA notice content CTpc (or the LCA standby content CTwc) is terminated (see the broken line range in the lower part of FIG. 12). In addition, in the LCA cancellation display, the LTA execution content CTt is highlighted in order to impress the driver on the continuation of driving in the lane. Specifically, the display generation unit 75 extends the LCA execution content CTc whose overlapping range is limited to the vehicle side of the LC transition point Pcs in the traveling direction from the position where the LC transition point Pcs was. .. The stretching animation of the LCA execution content CTc may be repeated a plurality of times.

The LCA standby display and the LCA execution display shown in FIG. 13 are displays selected in a driving scene in which the road surface of the destination lane Lnd does not enter the angle of view VA. Based on the simulation result of the display layout, the display generation unit 75 determines that the destination lane Lnd is outside the angle of view VA when the area of the road surface of the destination lane Lnd included in the superposition range SA is less than a predetermined value. To do. As an example, when the road in the traveling direction has a curved shape, the road surface of the destination lane Lnd deviates from the angle of view VA. In the LCA standby display and the LCA execution display in such a driving scene, the LCA icon CTci is used as the LCA notice content CTpc and the LCA execution content CTc.

The LCA icon CTci is a display object including an arrow-shaped image portion and an outer peripheral image portion. The arrow-shaped image portion has an arrow shape that points in the traveling direction (upward) while bending toward the Lnd side of the destination lane. The outer peripheral image portion surrounds the arrow-shaped image portion in an annular shape. The LCA icon CTci are superimposed content CTs that are superimposed and displayed on the road surface of the own lane Lns. The LCA icon CTci superimposes the road surface of the LC transition point Pcs. The LCA icon CTci is superimposed on the vicinity of the lane marking of the own lane Lns desired on the destination lane Lnd. The LCA icon CTci moves within the angle of view VA as the LC transition point Pcs approaches. The drawing shape of the LCA icon CTci may be kept constant, or may be increased as the LC transition point Pcs approaches.

The LTA transition display shown in FIG. 14 is a display for notifying the driver that the driver is scheduled to start traveling in the lane in the destination lane Lnd after the lane change by the LCA function is completed. The LTA transition display is displayed when the LTA information acquisition unit 73 acquires the status information indicating the executable state of the LTA function after the transition to the LTA execution display. The LCA transition display includes the LTA notice content CTpt in addition to the LCA execution content CTc.

The LTA notice content CTpt is a content indicating an execution schedule of traveling in the lane after changing lanes. The LTA notice content CTpt is drawn based on the line shape information when the status information indicating the executable state is acquired. The mode of the LTA notice content CTpt is changed based on whether or not the point at which the LC execution section SLc shifts to the LTA execution section SLt2 (hereinafter, the LTA transition point Pce, see FIG. 5) is within the angle of view VA. When the LTA transition point Pce is outside the angle of view VA, the LTA icon CTti is displayed as the LTA notice content CTpt.

The LTA icon CTti is a non-superimposed content CTn displayed at a position within the angle of view VA that does not overlap with the LCA execution content CTc. The LTA icon CTti is displayed in a manner different from the normal LTA notice content CTpt when the LTA transition point Pce is within the angle of view VA. Specifically, the LTA icon CTti is a display object including a central image portion and an outer peripheral image portion. The central image section has each drawing that imitates the lane marking and the steering wheel. The outer peripheral image portion surrounds the central image portion in an annular shape. The LTA icon CTti continues to be displayed in the vicinity of the LCA execution content CTc in a predetermined drawing shape until the LTA transition point Pce enters the angle of view VA.

On the other hand, when the LTA transition point Pce is within the angle of view VA, the normal LTA notice content CTpt is displayed. The LTA notice content CTpt is superimposed content CTs for superimposing the road surface of the destination lane Lnd which is the own lane. The LTA notice content CTpt is displayed in substantially the same manner as the LTA execution content CTt (see FIG. 10). The LTA notice content CTpt is superimposed on the center of the road surface of the destination lane Lnd, and indicates a planned locus in the lane driving that is started after the completion of the lane change.

The LTA notice content CTpt is displayed at a position that does not overlap with the LCA execution content CTc. Specifically, the LTA notice content CTpt is arranged at a position visible on the back side (upper side) of the LCA execution content CTc, and is superimposed and displayed on the road surface ahead of the LTA transition point Pce.

The LTA notice content CTpt is displayed in a manner continuous with the LCA execution content CTc, and the continuous scheduled trajectory of the vehicle A generated on the system side can be shown together with the LCA execution content CTc. The LTA notice content CTpt is gradually expanded downward (on the own vehicle side) in accordance with the contraction of the LCA execution content CTc as the LTA transition point Pce approaches the vehicle A.

The LTA standby display shown in FIG. 15 is a display for notifying the driver that it may not be possible to resume driving in the lane in the destination lane Lnd after the lane change is completed. The LTA standby display is displayed, for example, when the LTA function is not in the executable state at the timing when the vehicle A crosses the lane marking after the transition to the LCA execution display. The LTA standby display includes the LTA standby content CTwt in addition to the LCA execution content CTc.

The LTA standby content CTwt is displayed when it is not possible to drive in the lane after changing lanes. The LTA standby content CTwt indicates that the LTA function is in the standby state in the lane keeping control unit 51 in which the driving control is interrupted. The LTA standby content CTwt is displayed, for example, for a period until the detection of the lane marking (or road edge) of the destination lane Lnd is completed. When the lane marking of the destination lane Lnd or the like can be detected, the LTA standby content CTwt is replaced with the LTA notice content CTpt (see FIG. 14). On the other hand, when the lane marking of the destination lane Lnd or the like cannot be detected, the display of the LTA standby content CTwt is continued until the display of the LCA execution content CTc is completed.

The LTA standby content CTwt is a non-superimposed content CTn having a drawing shape associated with the LTA icon CTti (see FIG. 14). The drawing shape of the LTA standby content CTwt is such that an “x” indicating negation is superimposed on the LTA icon CTti. The LTA standby content CTwt has a display color different from that of the LTA icon CTti, and specifically, it is displayed in a display color such as amber that calls attention. Further, immediately before the LCA function shifts to the off state, the LTA standby content CTwt may be displayed blinking.

The LTA execution display shown in FIG. 16 is a display for notifying the driver of the transition to the off state of the LCA function and the transition to the execution state of the LTA function at the timing when the lane change is completed. The LTA execution display is a display including the LTA execution content CTt. The LTA execution content CTt is superimposed content CTs that are superimposed on the center of the road surface that has become the own lane Lns and show the predicted locus of traveling in the lane by the LTA function. The LTA execution content CTt has substantially the same drawing shape as the LTA notice content CTpt (see FIG. 14) of the LTA transition display and the LTA execution content CTt (see FIG. 7) before the lane change is performed.

The LCA standby display in the second lane change shown in FIG. 17 is the same as the LCA standby display in the first lane change (see FIG. 10), that the LCA function is in the standby state, and the lane change is made within a predetermined time. Notifies the driver that is scheduled to start. In the second lane change, the own lane Lns and the destination lane Lnd are replaced with the first lane change. The LTA standby display in this case is also superimposed on the LTA execution content CTt superimposed on the own lane Lns on the own vehicle side of the LC transition point Pcs and on the destination lane Lnd behind the LC transition point Pcs. LCA notice content CTpc is included.

The LCA execution display at the second lane change shown in FIG. 18 notifies the driver that the LCA function is in the execution state, similarly to the LCA execution display at the first lane change (see FIG. 11). The LCA execution display includes the LCA execution content CTc having substantially the same mode as the LCA notice content CTpc (see FIG. 17) displayed in the immediately preceding LCA standby display. The LCA execution content CTc is displayed in a manner that fills the entire road surface range of the destination lane Lnd that overlaps with the angle of view VA.

Next, the details of the display control method for controlling each display related to the lane keeping control and the lane change control based on the display control program are shown in FIGS. 3 and 7 to 18 based on the flowcharts shown in FIGS. 19 to 21. Will be described below with reference to. The display control process shown in FIGS. 19 to 21 is started by the HCU 100 that has completed the start-up process or the like, for example, by switching the vehicle power supply to the on state.

In S101, based on the ACC status information acquired by the LTA information acquisition unit 73, the driving support ECU 50 determines whether or not the ACC function is in the execution state. When it is determined in S101 that the ACC function is not in the execution state, the determination in S101 is repeated and the ACC function waits for the transition to the execution state. Then, when the ACC function transitions to the execution state, the process proceeds to S102. In S102, the ACC execution display indicating the execution state of the ACC function is displayed by the HUD 20, and the process proceeds to S103.

In S103, the LTA information output from the lane keeping control unit 51 to the communication bus 99 and acquired by the LTA information acquisition unit 73 is referred to. Then, in S103, based on the status information of the LTA function, the lane keeping control unit 51 determines whether or not the LTA function is in the execution state. If it is determined in S103 that the LTA function is not in the execution state, the process returns to S101 and the ACC execution display is continued. On the other hand, when the LTA function transitions to the execution state, the process proceeds to S104. In S104, the LTA execution display (see FIG. 7) is started, and the process proceeds to S105. According to S104, based on the latest LTA information, the LTA execution content CTt showing the expected locus of traveling in the lane is superimposed and displayed on the road surface of the own lane Lns as the superimposition target.

In S105, it is determined whether or not the on operation for activating the lane change control unit 52 is input to the direction indicator switch 56 based on the status information of the LCA function acquired by the LCA information acquisition unit 74. When the LCA information includes the driver operation information, the determination in S105 may be performed based on the driver operation information. If it is determined in S105 that there is no input for the on operation, the process returns to S101 and the LTA execution display is continued. On the other hand, if it is determined that the on operation has been input, the process proceeds to S106. In S106, the LCA reception display (see FIG. 8) is started, and the process proceeds to S107.

In S107, the LCA information output from the lane change control unit 52 to the communication bus 99 and acquired by the LCA information acquisition unit 74 is referred to. Then, in S107, based on the status information about the LCA function, it is determined whether or not the peripheral check for the surroundings of the own vehicle is completed, and the completion of the peripheral check is waited for. In S107, when the status information indicating the standby state or the execution state is acquired by the LCA information acquisition unit 74, it is determined that the peripheral check is completed, and the process proceeds to S108. The LCA reception display started in S106 is continued until the completion determination of the peripheral check is performed in S107.

In S108, the LCA information acquired by the LCA information acquisition unit 74, specifically, the latest status information of the LCA function is referred to. Then, in S108, it is determined whether or not the lane change can be immediately executed based on the status information. If the status information indicating the standby state has been acquired in S108, the process proceeds to S109 (see FIG. 20). At this time, the LCA function of the lane change control unit 52 is in the standby state, while the LTA function of the lane maintenance control unit 51 maintains the execution state.

In S109, it is determined whether or not the lane change can be started within a predetermined time (for example, 3 seconds) based on the LCA information acquired in S108. If it is determined in S109 that it is impossible to start the lane change within the predetermined time, the process proceeds to S110. In S110, the LCA standby display (see FIG. 9) including the LCA standby content CTwc is started, and the process proceeds to S111.

In S111, it is determined whether or not the lane change based on the on operation has timed out. If it is determined in S111 that the lane change has not timed out, the process returns to S109. On the other hand, if it is determined in S111 that the lane change has timed out, the process proceeds to S112. At this time, the LCA function of the lane change control unit 52 transitions to the off state, while the LTA function of the lane maintenance control unit 51 maintains the execution state. Therefore, in S112, the display transitions to the LCA cancellation display (see FIG. 12) and the LCA execution display (see FIG. 7) are sequentially performed so as to match the status transitions of the lane keeping control unit 51 and the lane change control unit 52, and a series of display transitions are performed. The display control process is temporarily terminated.

If it is determined in S109 that the lane change can be started within a predetermined time, the process proceeds to S113. In S113, the LCA standby display (see FIGS. 10 and 17) when the LC transition point Pcs is within the angle of view VA is started, and the process returns to S108. According to S113, the LCA notice content CTpc showing the expected trajectory of the lane change is displayed together with the LTA execution content CTt based on the latest line shape information included in the LCA information. When the destination lane Lnd is outside the angle of view VA, the LCA standby display may be a display using the LCA icon CTci (see FIG. 13).

If the status information indicating the execution status has been acquired in S108, the process proceeds to S114 (see FIG. 21). At this time, the LCA function of the lane change control unit 52 is in the execution state, while the LTA function of the lane maintenance control unit 51 is in the standby state. In S114, it is determined whether or not the destination lane Lnd is within the angle of view VA. If it is determined in S114 that the destination lane Lnd is outside the angle of view VA, the process proceeds to S115. In S115, the LCA execution display (see FIG. 13) using the LCA icon CTci is started, and the process returns to S114. This LCA execution display is continued until the destination lane Lnd moves within the angle of view VA.

On the other hand, if it is determined in S114 that the destination lane Lnd is within the angle of view VA, the process proceeds to S116. In S116, a normal LCA execution display (see FIGS. 11 and 18) is started, and the process proceeds to S117. According to S116, based on the latest line shape information included in the LCA information, the LCA execution content CTc showing the expected trajectory of the lane change by filling the destination of the own vehicle is the moving destination lane Lnd as the superimposition target. It is superimposed on the road surface.

In S117, among the LTA information acquired by the LTA information acquisition unit 73, the information regarding the driving control after the completion of the lane change is referred to. Then, in S117, based on the status information about the LTA function, it is determined whether or not the lane change can be resumed after the lane change is completed. If it is determined in S117 that it is not possible to resume driving in the lane, the process proceeds to S118.

In S118, the LTA standby display (see FIG. 15) including the LTA standby content CTwt is started, and the process proceeds to S119. In S119, it is determined that the vehicle has not been driven in the lane after the lane change. If it is determined in S119 that there is no resumption of driving in the lane, a series of display control processes are temporarily terminated. On the other hand, if it is determined in S119 that the driving in the lane may be resumed, the process returns to S117. As described above, the LTA standby display is continued until, for example, the lane marking of the destination lane Lnd is detected.

On the other hand, if it is determined in S117 that the lane change can be resumed by the LTA function after the lane change is completed, the process proceeds to S120. In S120, it is determined whether or not the LTA transition point Pce is within the angle of view VA. If it is determined in S120 that the LTA transition point Pce is outside the angle of view VA, the process proceeds to S121. In S121, the LTA transition display including the LTA icon CTti (see the upper part of FIG. 14) is started, and the process proceeds to S123. On the other hand, if it is determined in S120 that the LTA transition point Pce is within the angle of view VA, the process proceeds to S122. In S122, the LTA transition display (see the lower part of FIG. 14) including the LTA notice content CTpt is started, and the process proceeds to S123. According to the above S121 and S122, based on the latest line shape information included in the LTA information, the LTA notice content CTpt indicating the execution schedule of the lane travel after the lane change is displayed together with the LCA execution content CTc.

In S123, it is determined whether or not the LC execution section SLc is outside the angle of view VA. When it is determined in S123 that a part of the LC execution section SLc remains in the angle of view VA, the process returns to S120. As a result, the LTA transition display is continued. On the other hand, if it is determined in S123 that the entire LC execution section SLc is outside the angle of view VA, the process proceeds to S124. At this time, the LCA function of the lane change control unit 52 transitions to the off state, while the LTA function of the lane maintenance control unit 51 transitions from the executable state to the execution state. In S124, the display is changed from the LTA transition display to the LTA execution display (see FIG. 16) so as to match the above state transitions, and a series of display control processes are temporarily terminated.

In the first embodiment described so far, when shifting from traveling in the lane by the lane keeping control unit 51 to changing lanes by the lane change control unit 52, the LCA notice content CTpc showing the expected trajectory in the lane change is the LTA execution content. It is displayed in addition to CTt. The LTA execution content CTt are superimposed content CTs superimposed and displayed on the road surface. As described above, if the LTA execution content CTt and the LCA notice content CTpc include the superposed content CTs for which the superimposition target is specified, the driver controls from the change in the display recognized through the normal visual behavior. You can grasp the transition schedule of. Therefore, it is possible to provide easy-to-understand guidance regarding driving in the lane and changing lanes.

In addition, the LCA notice content CTpc of the first embodiment is displayed at a position that does not overlap with the LTA execution content CTt. Based on the above, the LCA notice content CTpc and the LTA execution content CTt can inform the driver of the timing and position of the control switching in addition to the schedule of the control transition from the in-lane driving to the lane change. As a result, the content display can provide guidance regarding driving in the lane and changing lanes in an easier-to-understand manner.

Further, the LCA notice content CTpc of the first embodiment is displayed at a position visually recognized on the back side of the LTA execution content CTt. According to such a positional relationship, the LTA execution content CTt and the LCA notice content CTpc can clearly indicate the position where the control is switched from traveling in the lane to changing lanes. As a result, guidance on driving in the lane and changing lanes is presented in a more understandable manner.

Further, in the first embodiment, when the LCA information acquisition unit 74 grasps the interruption (cancellation) of the lane change once attempted based on the LCA information, the display generation unit 75 highlights the LTA execution content CTt. Let me. Specifically, the display generation unit 75 implements a display that extends the LTA execution content CTt in the traveling direction. According to such a display, the driver can easily grasp that the lane keeping control is not canceled even if the lane change is canceled. Therefore, a more understandable presentation of guidance regarding driving in the lane and changing lanes is realized.

In addition, the LCA notice content CTpc of the first embodiment is displayed at a position visually recognizable on the Lnd side of the destination lane with respect to the LTA execution content CTt. According to such a positional relationship, each content can suggest not only the starting position of the lane change but also the moving direction in the lane change. As a result, the content display can present the control content of the scheduled lane change in an easy-to-understand manner.

Further, in the first embodiment, when the LC execution section SLc is within the angle of view VA of the HUD 20, the LTA notice content CTpt is superimposed and displayed on the road surface of the LC execution section SLc. As described above, if the LCA notice content CTpc is also displayed as the superimposed content CTs in addition to the LTA execution content CTt, these content displays can present the scheduled control transition schedule more easily.

Further, in the first embodiment, the LCA standby content CTwc is displayed when the LC transition point Pcs is not within the angle of view VA. This LCA standby content CTwc is displayed in a manner different from the LTA notice content CTpt when the LC transition point Pcs is within the angle of view VA. The above content display can notify the driver that the latest lane change cannot be started, while informing the driver that the LCA function is functioning normally and an attempt is being made to change lanes. it can. Therefore, even if the angle of view VA of the HUD 20 is limited, appropriate information is presented in a driving scene in which the lane change is not started promptly. As a result, the driver's anxiety about the LCA function can be reduced.

In addition, the LCA standby content CTwc of the first embodiment is displayed at a position that does not overlap with the LTA execution content CTt, similarly to the LTA notice content CTpt. Therefore, the display transition from the LCA standby content CTwc to the LTA notice content CTpt can be smoothly carried out in accordance with the approach of the LC transition point Pcs. According to the above, it is possible to display the content with less annoyance while presenting the necessary information about the lane change.

Further, in the first embodiment, the response notification content CTa for notifying the acceptance of the on operation is displayed. Therefore, the driver can confirm that the on operation instructing the execution of the lane change has been normally accepted by the system side. As a result, the driver's sense of security for automatic lane change control can be fostered.

Further, the response notification content CTa is a non-superimposed content CTn for which a superimposition target is not specified. Therefore, since the process of specifying the superposition target becomes unnecessary, the display of the response notification content CTa can be started quickly in response to the on operation. According to the above, since the operability felt by the driver is improved, it becomes easy to foster a sense of security for the system.

In the first embodiment, the LTA information acquisition unit 73 corresponds to the "control information acquisition unit", the LCA information acquisition unit 74 corresponds to the "change information acquisition unit", and the display generation unit 75 corresponds to the "display control unit". The HCU 100 corresponds to the "display control device". Further, the LTA execution content CTt corresponds to the "expected locus content", the LCA notice content CTpc corresponds to the "lane change content", and the LCA standby content CTwc corresponds to the "change standby content". Then, the LC execution section SLc corresponds to the “execution section (of changing lanes)”.

(Second Embodiment)
The second embodiment of the present disclosure shown in FIGS. 22 to 30 is a modification of the first embodiment. In the second embodiment, the contents of each display related to the lane keeping control and the lane change control are different from those in the first embodiment. Hereinafter, the details of the display of each pattern in the second embodiment will be described in order based on FIGS. 22 to 30 with reference to FIGS. 3 to 5.

The LTA execution content CTt of the second embodiment used in the LTA execution display shown in FIG. 22 includes a left boundary line CTtl and a right boundary line CTtr. The left boundary line CTtl and the right boundary line CTtr are arranged inside the left and right lane markings of the own lane Lns, and have a shape extending in a strip shape along each lane marking. The LTA execution content CTt can indicate the expected locus of traveling in the lane by the LTA function and also indicate the range recognized by the lane keeping control unit 51 as being able to travel (hereinafter, the travelable range).

The LCA reception display shown in FIG. 23 includes the response notification content CTa in addition to the above-mentioned LTA execution content CTt. The response notification content CTa of the second embodiment is an icon-shaped non-superimposed content CTn. The response notification content CTa is a display object including an arrow-shaped image portion and an outer peripheral image portion, similarly to the LCA icon CTci (see FIG. 13) of the first embodiment. The display position of the response notification content CTa is defined in advance so that it does not overlap with the boundary lines CTtl and CTtr and is displayed between these boundary lines CTtl and CTtr. The response notification content CTa continues to be displayed in the substantially center of the angle of view VA so as to be superimposed on the road surface of the own lane Lns until the completion of the peripheral check by the lane change control unit 52.

The LCA standby display shown in FIG. 24 is an LCA standby display when the LC execution section SLc is outside the angle of view VA. The LCA standby display includes the LCA standby content CTwc and the LTA execution content CTt. The LCA standby content CTwc is superimposed content CTs that notify the driver of the operation of the LCA function that is about to change lanes. The LCA standby content CTwc has a shape related to the LCA execution content CTc (see FIG. 26) described later, and is drawn in a form that is less attractive than the LCA execution content CTc. For example, the display brightness of the LCA standby content CTwc is lower than the display brightness of the LCA execution content CTc.

The LCA standby content CTwc has an arrow shape extending from the own lane Lns to the destination lane Lnd. When a lane change to the right lane is instructed, the arrow-shaped LCA standby content CTwc extending from the own lane Lns in the right front direction is displayed. On the other hand, when the lane change to the left lane is instructed, the arrow-shaped LCA standby content CTwc extending from the own lane Lns in the left front direction is displayed.

The shape of the LTA execution content CTt is changed so as not to overlap with the LCA standby content CTwc. When the LCA standby content CTwc extends to the right, the middle portion of the right boundary line CTtr is hidden. Similarly, when the LCA standby content CTwc extends to the left, the middle portion of the left boundary line CTtl is hidden.

The LCA standby display shown in FIG. 25 is an LCA standby display when the LC execution section SLc is within the angle of view VA. The LCA standby display includes the LTA execution content CTt and the LCA notice content CTpc. Also in the second embodiment, the LTA execution content CTt gradually shortens the boundary lines CTtl and CTtr as the LC transition point Pcs approaches the vehicle A.

The LCA notice content CTpc has an arrow shape extending from the own lane Lns to the destination lane Lnd. The LCA notice content CTpc is located behind the LTA execution content CTt and is displayed in an arrangement that does not overlap with the LTA execution content CTt. The base end portion of the LCA notice content CTpc is continuous with the tip end portions of the boundary lines CTtl and CTtr, respectively. When the LC transition point Pcs is near the upper edge of the angle of view VA, the LCA notice content CTpc has a drawing shape in which the tip portion (see the two-point difference line) indicating the traveling direction is cut off from the angle of view VA. Then, when the LC transition point Pcs is located near the center of the angle of view VA, almost the entire LCA notice content CTpc is displayed.

The LCA execution display shown in FIG. 26 includes the LCA execution content CTc. The LTA execution content CTt (see FIG. 25) is also hidden in the LCA execution display of the second embodiment. The LCA execution content CTc is displayed in substantially the same manner as the LCA notice content CTpc (see FIG. 25) when the LC execution section SLc is within the angle of view VA, and from the own lane Lns to the destination lane Lnd. It has an arrow shape that extends. As a result, a smooth display transition is carried out from the LCA notice content CTpc to the LCA execution content CTc.

The LCA standby display and the LCA execution display shown in FIG. 27 are displays selected in a driving scene in which the road surface of the destination lane Lnd does not enter the angle of view VA. In each display in such a driving scene, the LCA notice content CTpc and the LCA execution content CTc are mainly superimposed on the road surface of the own lane Lns within the angle of view VA, and indicate the direction of the destination lane Lnd at the tip portion. It has an arrow shape. Therefore, each content CTpc and CTc exerts a function of showing an execution schedule and an expected trajectory of a lane change even if the superposed road surface range is limited.

The LTA transition display shown in FIG. 28 includes the LTA notice content CTpt in addition to the above-mentioned LCA execution content CTc. When the LTA transition point Pce is outside the angle of view VA, the LTA icon CTti is displayed as the LTA notice content CTpt as in the first embodiment. The LTA icon CTti is displayed on the side of the LCA execution content CTc in an arrangement that does not overlap with the LCA execution content CTc.

On the other hand, when the LTA transition point Pce is within the angle of view VA, the LTA notice content CTpt is displayed as the superimposed content CTs. The LTA notice content CTpt is displayed in substantially the same manner as the LTA execution content CTt (see FIG. 22), and includes the boundary lines CTtl and CTtr. The boundary lines CTtl and CTtr are located behind the LCA execution content CTc and are displayed in an arrangement that does not overlap with the LCA execution content CTc. Each boundary line CTtl, CTtr indicates a planned locus in the lane running after the lane change is completed. The boundary lines CTtl and CTtr gradually extend downward (on the vehicle side) as the LTA transition point Pce approaches the vehicle A and the LCA execution content CTc contracts.

The LTA standby display shown in FIG. 29 includes, in addition to the above-mentioned LCA execution content CTc, the LTA standby content CTwt having a drawing shape substantially the same as that of the first embodiment. The LTA standby content CTwt is displayed at a position in the angle of view VA that does not overlap with the LCA execution content CTc so as to be aligned with the LCA execution content CTc.

The LTA execution display after the lane change shown in FIG. 30 includes the LTA execution content CTt as in the LTA execution display before the lane change (see FIG. 22). The LTA execution content CTt has each boundary line CTtl and CTtr in common with the LTA notice content CTpt (see FIG. 28). That is, by extending the boundary lines CTtl and CTtr to the vicinity of the lower edge of the angle of view VA, the display transition from the LTA notice content CTpt to the LTA execution content CTt is executed.

The second embodiment described so far also has the same effect as that of the first embodiment. As a result, the driver can grasp the control transition schedule from the change in the display recognized through the normal visual behavior. Therefore, it is possible to provide easy-to-understand guidance regarding driving in the lane and changing lanes.

In addition, in the second embodiment, the LTA execution content CTt and the LTA notice content CTpt are superimposed and displayed on the road surface in an arrangement that is continuous with each other and does not overlap with each other. According to such a content display, the change point from the in-lane driving control to the lane change control is presented to the driver more easily.

(Third Embodiment)
The third embodiment of the present disclosure shown in FIGS. 31 to 33 is another modification of the first embodiment. Also in the third embodiment, the drawing shape of each content is different from the first and second embodiments described above. Hereinafter, the details of the display of each pattern in the third embodiment will be described in order based on FIGS. 31 to 33 with reference to FIGS. 3 to 5. The LTA execution display of the third embodiment is substantially the same as that of the first embodiment.

The LCA reception display shown in FIG. 31 includes the LTA execution content CTt and the response notification content CTa. The LTA execution content CTt are superimposed content CTs substantially the same as those in the first embodiment, and are superimposed and displayed in the center of the own lane Lns.

The response notification content CTa is the non-superimposed content CTn, and the drawing shape and drawing size in the angle of view VA are defined in advance so that the response notification content CTa is superimposed over both the own lane Lns and the destination lane Lnd. There is. Similar to the LCA notice content CTpc (see FIG. 32) and the LCA execution content CTc (see FIG. 33) described later, the response notification content CTa is directed from the own lane Lns toward the adjacent lane corresponding to the input direction of the on-operation. It has an arrow shape that extends. The response notification content CTa is displayed in a manner less attractive than the LTA execution content CTt. As an example, the response notification content CTa is displayed with a display brightness lower than that of the LTA execution content CTt. Further, the response notification content CTa may be drawn in a broken line shape in outline or in whole.

The LCA standby display shown in FIG. 32 is an LCA standby display when the LC execution section SLc is within the angle of view VA. The LCA standby display includes the LTA execution content CTt and the LCA notice content CTpc. The LTA execution content CTt extends in a strip shape to the front side (own vehicle side) of the LC transition point Pcs.

The LCA notice content CTpc is superimposed content CTs having an arrow shape, and extends from the own lane Lns to the destination lane Lnd while being curved. The base end portion of the LCA notice content CTpc is located at the LC transition point Pcs, and is continuous with the tip end portion of the LTA execution content CTt at this LC transition point Pcs. The tip portion of the LCA notice content CTpc is superimposed on the road surface of the destination lane Lnd and points in the traveling direction of the vehicle A.

The LCA notice content CTpc, together with the LTA execution content CTt, shows the expected trajectory of the vehicle A. The connected portion of the LCA notice content CTpc and the LTA execution content CTt moves downward (front side) in the angle of view VA in accordance with the movement of the LC transition point Pcs in the foreground. As a result, the display change in which the LTA execution content CTt shrinks and the display change in which the LCA notice content CTpc expands are both implemented as the vehicle A travels.

The LTA transition display shown in FIG. 33 includes the LCA execution content CTc and the LTA notice content CTpt. The LCA execution content CTc are superimposed content CTs having an arrow shape, similar to the above-mentioned LCA notice content CTpc (see FIG. 32). The LCA execution content CTc extends in a band shape along the planned traveling line PRL to the front side (own vehicle side) of the LTA transition point Pce.

Like the above-mentioned LTA execution content CTt (see FIG. 31), the LTA notice content CTpt are superimposed content CTs exhibiting a strip shape, and extend from the LTA transition point Pce toward the back along the planned running line PRL. doing. The base end portion of the LTA notice content CTpt is continuous with the tip end portion of the LCA execution content CTc at the LTA transition point Pce.

The connected portion of the LTA notice content CTpt and the LCA execution content CTc moves downward (front side) in the angle of view VA in accordance with the movement of the LTA transition point Pce in the foreground. As a result, the display change in which the LTA notice content CTpt shrinks and the display change in which the LCA execution content CTc expands are both implemented as the vehicle A travels.

In the LCA execution display of the third embodiment, the above-mentioned LCA execution content CTc is superimposed and displayed across the own lane Lns and the destination lane Lnd. Further, in the LTA standby display of the third embodiment, the icon-shaped LTA standby content CTwt (see FIG. 29) substantially the same as that of the second embodiment is displayed in the vicinity of the above-mentioned LCA execution content CTc.

The third embodiment described so far also has the same effect as that of the first embodiment, and the driver can grasp the control transition schedule from the change in the display recognized through the normal visual behavior. Therefore, it is possible to provide easy-to-understand guidance regarding driving in the lane and changing lanes.

(Fourth Embodiment)
The fourth embodiment of the present disclosure shown in FIGS. 34 to 39 is still another modification of the first embodiment. In the fourth embodiment, the display of the superimposed content CTs is suppressed in order to reduce the troublesomeness of the driver. Specifically, the display generation unit 75 does not always display the LTA execution content CTt in the LTA execution display (see FIG. 7) during traveling in the lane by the lane keeping control unit 51. The display generation unit 75 alternately repeats the period for displaying the LTA execution content CTt and the period for hiding the LTA execution content CTt at a predetermined cycle.

In addition, the display generation unit 75 exclusively displays only one of the superimposed content CTs related to LTA and the superimposed content CTs related to LCA. Hereinafter, the LCA reception display (see FIG. 34), the LCA standby display (see FIG. 35), the LCA cancellation display (see FIG. 36), the LTA transition display (see FIG. 37), and the LTA standby display (see FIG. 38) of the fourth embodiment. ) And the LCA execution display (see FIG. 39) will be described in order.

In the LCA reception display shown in FIG. 34, the LTA execution content CTt is hidden. More specifically, when the display generation unit 75 acquires LCA information, specifically, operation information indicating an on operation of the direction indicator switch 56 (winker) while traveling in the lane (see FIG. 19S105), The display of the LTA execution content CTt is terminated. Then, the display generation unit 75 ends the display of the LTA execution content CTt and then starts the display of the response notification content CTa (see FIG. 19S106). The display of the response notification content CTa is started promptly without delay after the display of the LTA execution content CTt is completed. The display end of the LTA execution content CTt and the display start of the response notification content CTa may be performed substantially at the same time.

In the LCA standby display shown in FIG. 35, the LTA notice content CTpt is displayed instead of the response notification content CTa. That is, the display generation unit 75 temporarily displays the response notification content CTa after finishing the display of the LTA execution content CTt, and displays the LCA notice content CTpc indicating the predicted trajectory of the lane change based on the LCA information. .. As described above, in the LCA standby display, only the LCA notice content CTpc is displayed as the superimposed content CTs related to LTA and LCA. Similar to the first embodiment, the LCA notice content CTpc is superimposed on the road surface of the destination lane Lnd on the back side (LC execution section SLc) of the LC transition point Pcs.

When the LCA information is acquired during the non-display period of the LTA execution content CTt, the display generation unit 75 sequentially displays the response notification content CTa and the LCA notice content CTpc without displaying the LTA execution content CTt.

In the LCA cancellation display shown in FIG. 36, the display of the LCA notice content CTpc or the LCA standby content CTwc (see FIG. 9) is terminated based on the transition to the off state of the LCA function (see the broken line range in the lower part of FIG. 36). After ending the display of the superimposed content CTs related to the LCA, the display generation unit 75 displays the LTA execution content CTt indicating the expected locus of traveling in the lane based on the LTA information. The LTA execution content CTt is highlighted as an animation extending from the lower edge (own vehicle side) of the angle of view VA toward the upper edge (back side). As described above, even in the LCA cancellation display, only one superimposed content CTs related to LTA and LCA is displayed.

In the LTA transition display shown in FIG. 37, the LCA execution content CTc and the LTA execution content CTt are displayed in order. When the LTA transition point Pce moves out of the angle of view VA, the display generation unit 75 ends the display of the LCA execution content CTc and starts the display of the LTA execution content CTt. In the LTA transition display, an animation is displayed in which the LTA execution content CTt is extended along the own lane Lns from the front side to the back side. The display generation unit 75 displays the LTA execution content CTt for a predetermined time (for example, about 5 seconds), and then starts repeating the non-display period and the display period. The repetition of displaying and hiding the LTA execution content CTt may be omitted.

The LTA standby display shown in FIG. 38 is an example of being displayed at a stage where traveling in the lane after changing lanes is not possible. The LTA standby display at this stage functions as an LTA non-disabled display that notifies the driver that driving in the lane will not be resumed. Similar to the first embodiment, the LTA standby display includes the LCA execution content CTc and the LTA standby content CTwt.

The LCA execution content CTc is superimposed and displayed on the road surface of the destination lane Lnd on the front side (own vehicle side) of the LTA transition point Pce. The LTA standby content CTwt has substantially the same drawing shape as that of the first embodiment, and is displayed above (backward) the LCA execution content CTc (LTA transition point Pce). The LTA standby content CTwt is the non-superimposed content CTn and is displayed at the center of the angle of view VA in the horizontal direction. As a result, the LTA standby content CTwt is visually recognized overlapping the road surface ahead of the destination lane Lnd.

Also in the LTA standby display of the second lane change shown in FIG. 39, the LTA notice content CTpc is displayed after the display of the LTA execution content CTt is completed. The display generation unit 75 hides the LTA execution content CTt during the display period of the LTA execution content CTt, and starts displaying the LCA notice content CTpc as it is during the non-display period of the LTA execution content CTt.

Then, when the vehicle A reaches the LC transition point Pcs, the transition from the LCA standby display to the LCA execution display is made, and the LTA notice content CTpt becomes the LCA execution content CTc. If the lane change is started immediately after the driver turns on the direction indicator switch 56, the display generation unit 75 omits the display of the LCA standby content CTwc and shifts the LTA execution content CTt to the LCA execution content CTc. Make a switch.

In the fourth embodiment described so far, when shifting from traveling in the lane by the lane keeping control unit 51 to changing lanes by the lane change control unit 52, the LCA notice content CTpc showing the expected trajectory in the lane change is the LTA execution content. It is displayed instead of CTt. The LTA execution content CTt are superimposed content CTs superimposed and displayed on the road surface. As described above, if the LTA execution content CTt and the LCA notice content CTpc (or the LCA execution content CTc) are sequentially displayed, the driver can grasp the control transition schedule from the change in the display recognized through the normal visual behavior. .. Therefore, it is possible to provide easy-to-understand guidance regarding driving in the lane and changing lanes.

The process of ending the display of the LTA execution content CTt can be performed at a timing different from the LCA reception display (S106) when the direction indicator switch 56 is turned on (FIG. 19 S105: YES). Specifically, the display of the LTA-related superimposed content CTs may be terminated at the timing when the peripheral check is completed (S107: YES) or the timing when the lane change becomes feasible (S108: YES). Further, in the fourth embodiment, the LCA execution content CTc, the LCA notice content CTpc, and the LCA standby content CTwc correspond to the “lane change content”.

(Fifth Embodiment)
The fifth embodiment of the present disclosure shown in FIGS. 40 to 42 is a modification of the second embodiment. In the fifth embodiment, the drawing shapes of the LCA notice content CTpc and the LCA execution content CTc are different from those in the second embodiment. Each content CTpc, CTc of the fifth embodiment includes a left boundary line CTcl and a right boundary line CTcr. The boundary lines CTcl and CTcr are integrally drawn so as to be continuous with the boundary lines CTtl and CTtr of the LTA notice content CTpt or the LTA execution content CTt. That is, each boundary line CTcl, CTcr is displayed with substantially the same display color and display brightness as each boundary line CTtl, CTtr.

In the LCA standby display shown in FIG. 40, the left boundary line CTl and the right boundary line CTr transition from the LTA execution content CTt to the LCA notice content CTpc while maintaining the display state based on the on operation of the direction indicator switch 56 by the driver. To do. The left boundary line CTl and the right boundary line CTr are superimposed on the road surface in the foreground so as to show the shape of the planned traveling line PRL (see FIG. 4) based on the line shape information.

Specifically, the display generation unit 75 directs the rear ends of the left boundary line CTl and the right boundary line CTr from the own lane Lns to the destination lane Lnd in accordance with the approach of the LC transition point Pcs. Move. As described above, the left boundary line CTl and the right boundary line CTr extending while curving from the road surface of the own lane Lns to the road surface of the destination lane Lnd are displayed. Each boundary line CTl and CTr becomes the LTA execution content CTt after the LTA transition point Pce moves out of the angle of view VA.

Also in the LCA execution display and the LTA execution display shown in FIG. 41, the left boundary line CTl and the right boundary line CTr present the shape of the planned traveling line PRL to the driver. In the LCA execution display (see the upper part of FIG. 41), the boundary lines CTl and CTr are superimposed content CTs that also serve as LCA execution content CTc and LTA notice content CTpt. Further, in the LTA execution display (see the lower part of FIG. 41), each boundary line CTl and CTr are displayed as LTA execution content CTt.

Further, in the LCA standby display in the second lane change shown in FIG. 42, the rear ends of the boundary lines CTl and CTr move from the own lane Lns based on the on operation of the direction indicator switch 56 by the driver. It transforms toward the front lane Lnd. Through such animation, each boundary line CTl, CTr transitions from the LTA execution content CTt to the LTA notice content CTpt or the LTA execution content CTt.

In the fifth embodiment described so far, after the completion of the first lane change, the in-lane driving is in the execution state and the second lane change is started, that is, each boundary line CTl, CTr. Is displayed continuously by. Based on the above, the driver can grasp the control transition schedule from the change in the display recognized through the normal visual behavior, as in the fourth embodiment in which only one superimposed content CTs related to LTA and LCA is displayed. .. Therefore, it is possible to provide easy-to-understand guidance regarding driving in the lane and changing lanes.

(Sixth Embodiment)
The sixth embodiment of the present disclosure shown in FIGS. 43 to 46 is still another modification of the first embodiment. The LCA standby content CTwc and the LCA execution content CTc of the sixth embodiment are displayed in a manner that fills the road surface of the destination lane Lnd, as in the first embodiment. Further, the LTA execution content CTt and the LTA notice content CTpt include two boundary lines CTtl and CTtr as in the second embodiment.

The intervals between the boundary lines CTtl and CTtr are defined with reference to the vehicle width of the vehicle A (own vehicle), and are set narrower than those in the second embodiment. As an example, assuming that the boundary lines CTtl and CTtr are projected onto the road surface in the foreground, the distance between the boundary lines CTtl and CTtr on the road surface is slightly wider than the vehicle width of the own vehicle. As described above, a gap is apparently secured between each boundary line CTtl, CTtr and the lane marking line in the vicinity thereof. As a result, misidentification between the actual lane marking line and each boundary line CTtl, CTtr is less likely to occur.

Specifically, the LCA standby display shown in FIG. 43 includes the LTA execution content CTt and the LCA notice content CTpc. The boundary lines CTtl and CTtr of the LTA execution content CTt are superimposed and displayed on the road surface range on the front side (own vehicle side) of the own lane Lns from the LC transition point Pcs. The LCA notice content CTpc is superimposed and displayed on the road surface range on the back side (traveling direction) of the LC transition point Pcs in the destination lane Lnd. As the LC transition point Pcs approaches, the boundary lines CTtl and CTtr are reduced downward, while the LCA notice content CTpc is expanded downward.

In the LCA cancellation display shown in FIG. 44, the display of the LCA notice content CTpc (or the LCA standby content CTwc) is terminated (see the broken line range in the lower part of FIG. 44). In addition, in the LCA cancellation display, an animation is displayed in which the boundary lines CTtl and CTtr are extended from the LC transition point Pcs in the traveling direction after the display of the LCA notice content CTpc is completed.

The LTA transition display shown in FIG. 45 includes the LCA execution content CTc and the LTA notice content CTpt. The LCA execution content CTc is superimposed and displayed on the road surface range on the front side (own vehicle side) of the LTA transition point Pce in the destination lane Lnd. The boundary lines CTtl and CTtr of the LTA notice content CTpt are superimposed and displayed on the road surface range on the back side (traveling direction) of the destination lane Lnd from the LTA transition point Pce. The boundary lines CTtl and CTtr are superimposed on the lane markings of the destination lane Lnd at positions with a predetermined gap. Each boundary line CTtl and CTtr becomes the LTA execution content CTt (see FIG. 46), and is hidden after being displayed for a predetermined time.

The LTA transition display shown in FIG. 46 is a display when the driver inputs the on operation of the second lane change while the display of the LTA execution content CTt started after the first lane change is continued. In this case, both the LTA execution content CTt and the superimposed content CTs related to LCA are displayed. The superimposed content CTs related to LCA are not limited to the LCA notice content CTpc, but may be the LCA standby content CTwc (see FIG. 9) or the LCA execution content CTc (see FIG. 45). After displaying the two superimposed content CTs together, the display generation unit 75 limits the display of the LTA execution content CTt to the road surface range on the front side of the LC transition point Pcs, or hides the LTA execution content CTt. To.

The sixth embodiment described so far also has the same effect as that of the first embodiment, and the driver can grasp the control transition schedule from the change in the display recognized through the normal visual behavior. Therefore, it is possible to provide easy-to-understand guidance regarding driving in the lane and changing lanes.

(Other embodiments)
Although the plurality of embodiments of the present disclosure have been described above, the present disclosure is not construed as being limited to the above embodiments, and is applied to various embodiments and combinations without departing from the gist of the present disclosure. can do.

In the first modification of the second embodiment shown in FIG. 47, in the process of shifting from the in-lane driving control to the lane change control, the display control for fading out the LTA-related content and fading in the LCA-related content is performed. Will be implemented.

More specifically, in the LCA reception display of the first modification, the LTA execution content CTt composed of the boundary lines CTtl and CTtr is displayed in a normal display state, that is, in a state where the display brightness is secured. On the other hand, in the LCA reception display, the response notification content CTa is displayed in a display state having a lower attractiveness than the boundary lines CTtl and CTtr, that is, a state in which the display brightness is low. The drawing shape of the response notification content CTa of the first modification is substantially the same arrow shape as that of the third embodiment.

Then, by the transition from the LCA reception display to the LCA standby display, the arrow-shaped superimposed content CTs that follow the display features of the response notification content CTa are displayed as the LCA notice content CTpc. The display brightness of the LCA notice content CTpc is about the same as that of the response notification content CTa, or slightly higher than that of the response notification content CTa. On the other hand, in the LCA standby display, the display brightness of each boundary line CTtl and CTtr is lower than that of the LCA reception display. For example, the display brightness of each boundary line CTtl and CTtr is set to be about the same as the display brightness of the LCA notice content CTpc.

Further, due to the transition from the LCA standby display to the LCA execution display, the display brightness of each of the boundary lines CTtl and CTtr is gradually lowered, and the display is hidden. On the other hand, the LCA notice content CTpc becomes the LCA execution content CTc that gradually increases the display brightness and shows the expected locus when changing lanes. The display brightness of the LCA execution content CTc is set to be about the same as the boundary lines CTtl and CTtr in the LCA reception display.

In the second modification of the sixth embodiment shown in FIGS. 48 and 49, the LTA execution content CTt and the LTA notice content CTpt include two boundary lines CTtl and CTtr, as in the sixth embodiment. Unlike the sixth embodiment, the boundary lines CTtl and CTtr are arranged according to the lane width of the own lane Lns. As an example, the gap between each boundary line CTtl, CTtr and each of the left and right dividing lines is narrower than the band width of each boundary line CTtl, CTtr.

In the LCA standby display shown in FIG. 48, the boundary lines CTtl and CTtr are set in the range of the LTA execution section SLt1 which is on the front side (own vehicle side) of the LC transition point Pcs on the road surface of the own lane Lns. It is superimposed and displayed as the LTA execution content CTt. In addition, in the LCA standby display, the LCA notice content CTpc that fills the road surface is superimposed on the range of the LC execution section SLc that is behind the LC transition point Pcs on the road surface of the destination lane Lnd. Will be done.

Further, in the LTA transition display shown in FIG. 49, the road surface is filled in the range of the LC execution section SLc on the front side of the LTA transition point Pce in the road surface of the old destination lane Lnd which is the own lane. The LCA execution content CTc in such a mode is superimposed and displayed. In addition, in the LTA transition display, the boundary lines CTtl and CTtr are superimposed as the LTA notice content CTpt in the range of the LTA execution section SLt2, which is on the back side of the LTA transition point Pce on the road surface of the old destination lane Lnd. Is displayed.

In the third modification of the first embodiment shown in FIG. 50, the drawing shape of the LCA notice content CTpc is different from that of the first embodiment. Similar to the LCA standby content CTwc (see FIG. 8), the LCA notice content CTpc of the third modification is superimposed and displayed on the entire range of the road surface of the destination lane Lnd that overlaps with the angle of view VA. That is, the superimposition range of the LCA notice content CTpc is not limited to the LC execution section SLc. Therefore, in the LCA standby display of the third modification, the approach of the LC transition point Pcs is notified to the driver by shortening the LTA execution content CTt.

As described above, the LCA notice content CTpc does not have to be located on the back side of the LTA execution content CTt as long as it does not overlap with the LTA execution content CTt. The LCA notice content CTpc may be displayed side by side with the LTA execution content CTt. With such a drawing shape, even if the LC transition point Pcs is far from the vehicle A, the display area of the LCA notice content CTpc can be sufficiently secured. Therefore, it becomes possible for the driver to recognize the lane change schedule at an earlier timing.

In the modified example 4 of the first embodiment shown in FIG. 51, the drawing shape of the LTA execution content CTt is different from that of the first embodiment. Like the LCA notice content CTpc and the like, the LTA execution content CTt is a superposed content CTs that fills the track. The LTA execution content CTt is superimposed and displayed on the range of the LTA execution section SLt1 on the road surface of the own lane Lns, which is on the front side of the LC transition point Pcs. In the fourth modification, the LTA notice content may also be superimposed and displayed on the back side of the LCA execution content so as to fill the road surface of the LTA execution section.

In the LCA reception display of the modified example 5 of the third embodiment shown in FIG. 52, the LTA execution content CTt (see FIG. 47 and the like) is temporarily hidden. As a result, the arrow-shaped non-superimposed content CTn is displayed as the response notification content CTa in the angle of view VA. The display brightness of the response notification content CTa may be about the same as that of the LTA execution content CTt. The LTA execution content CTt may be displayed again after the display transition to the LCA standby display.

In the LTA transition display of the modification 6 of the second embodiment shown in FIG. 53, the drawing shape of the LTA notice content CTpt is different from that of the second embodiment. The superimposition range of the LTA notice content CTpt is not limited to the road surface of the LTA execution section SLt2. The LTA notice content CTpt may be superimposed on the road surface of the own lane (former destination lane Lnd) included in the angle of view VA.

More specifically, when the LTA transition point Pce is outside the angle of view VA, the range overlapping the angle of view VA is the LC execution section SLc. In this case, the boundary lines CTtl and CTtr of the LTA notice content CTpt are superimposed on the road surface of the destination lane Lnd in a display state with low attractiveness. For example, the boundary lines CTtl and CTtr are displayed on both sides of the LCA execution content CTc with a display brightness lower than that of the LCA execution content CTc.

When the LTA transition point Pce is within the angle of view VA, each boundary line CTtl, CTtr has a portion superimposed on the LTA execution section SLt2 (hereinafter, execution section portion) and a portion superimposed on the LC execution section SLc (hereinafter, below). , Waiting section part) and the display state is different. The execution section portion located at the back side of the LCA execution content CTc is displayed with the same display brightness as the LCA execution content CTc. On the other hand, the standby section portion located behind the LCA execution content CTc is displayed with a lower display brightness than the execution section portion and the LCA execution content CTc.

In the LCA standby display of the modified example 7 of the second embodiment shown in FIG. 54, the LCA icon CTci is displayed as the LCA notice content CTpc as in the first embodiment. The LCA icon CTci of the modification 7 is the non-superimposed content CTn, and is displayed in the substantially center of the angle of view VA. The LCA icon CTci of the modification 7 may be continuously displayed as the LCA execution content until the road surface of the destination lane Lnd enters the angle of view VA.

In the LTA standby display of the modified example 8 of the second embodiment shown in FIG. 55, the LTA standby content CTwt is displayed at a position that does not overlap with the LCA execution content CTc and is displayed behind the LCA execution content CTc. With such a display layout, the driver can clearly show that the expected locus of the LTA standby content CTwt has disappeared on the system side and the operation control may be released. The drawing shape of the LTA standby content CTwt is such that an "x" indicating negation is superimposed on a drawing object imitating a steering wheel.

In the modified example 9 of the fifth embodiment shown in FIG. 56, the boundary lines CTcl and CTcr included in the LCA-related contents CTpc and CTc are replaced with the boundary lines CTtl and CTtr included in the LTA-related contents CTpt and CTt. Displayed distinguishably. As an example, each boundary line CTcl, CTcr is displayed with a display color or display brightness different from that of each boundary line CTtl, CTtr.

Specifically, in the LCA standby display of the modified example 9, each boundary line CTtl and CTtr of the LTA execution content CTt have each tip portion and each base end portion of each boundary line CTcl and CTcr of the LCA notice content CTpc, respectively. It is continuous. Similarly, in the LCA standby display, each of the boundary lines CTcl and CTcr of the LCA execution content CTc has their respective tip portions continuous with the respective base end portions of the boundary lines CTtl and CTtr of the LTA notice content CTpt.

In the modified example 10 of the above embodiment, the LCA notice content CTpc and the LTA execution content CTt are partially overlapped and displayed. In addition, in the modification 10, the LCA standby content CTwc and the LTA execution content CTt are partially overlapped and displayed.

In the modified example 11 of the above embodiment, even when the LC execution section SLc is within the angle of view VA, the driver is notified of the predicted trajectory of the lane change by the LCA function by the LCA icon CTci which is the non-superimposed content CTn.

In the modified example 12 of the above embodiment, the LCA reception display including the response notification content CTa is omitted. In the modified example 12, a direct display transition from the LTA execution display to the LCA standby display or the LCA execution display is performed after the peripheral check based on the input of the on operation is completed. The on operation for activating the LCA function may be input to an input unit different from the direction indicator switch 56.

In the modified example 13 of the above embodiment, the LCA standby display when the LC execution section SLc is outside the angle of view VA is omitted. That is, the display of the LCA standby content CTwc is not performed. In the modification 13, the display transition from the LCA reception display to the LCA standby display is performed at the timing when the LC execution section SLc is within the angle of view VA.

In the above-described embodiment and modification, when each content is displayed in a different manner, at least one of static elements such as display color, display brightness, and reference display shape must be different to the extent that it can be distinguished by the driver. Just do it. Further, even if at least one of the dynamic elements such as the presence / absence of blinking, the cycle of blinking, the presence / absence of animation, and the operation of animation are different to the extent that they can be distinguished by the driver, they can be regarded as displayed in different modes. ..

The driving scene in which the information presentation is illustrated in the description of the above embodiment and the modified example is an example. The HCU can present information in combination with non-superimposed content and superposed content in a driving scene different from the above. Further, the shape, display position, display color, display brightness, presence / absence of animation, etc. of each content may be changed as appropriate, and may be changed according to, for example, the preference of the driver.

The HCU of the above embodiment uses the position information of the eye point detected by the DSM so that the superimposed content is superimposed on the superimposed object without deviation when viewed from the driver, and the virtual image light imaged as the superimposed content CTs. The projection shape and projection position of the above were controlled sequentially. However, the HCU of the modified example 14 of the above embodiment uses the setting information of the center of the reference eye point set in advance without using the detection information of the DSM, and the projected shape of the virtual image light imaged as the superimposed content and Control the projection position.

The projector 21 of the HUD 20 of the modification 15 is provided with an EL (Electro Luminescence) panel instead of the LCD panel and the backlight. Further, instead of the EL panel, a projector using a display such as a plasma display panel, a cathode ray tube and an LED can be adopted for the HUD 20.

The HUD 20 of the modified example 16 is provided with a laser module (hereinafter, “LSM”) and a screen instead of the LCD and the backlight. The LSM includes, for example, a laser light source, a MEMS (Micro Electro Mechanical Systems) scanner, and the like. The screen is, for example, a micromirror array or a microlens array. In such a HUD 20, a display image is drawn on the screen by scanning the laser beam emitted from the LSM. The HUD 20 projects the display image drawn on the screen onto the windshield by the magnifying optical element, and displays the virtual image Vi in the air.

Further, the HUD 20 of the modified example 17 is provided with a DLP (Digital Light Processing, registered trademark) projector. A DLP projector has a digital mirror device (hereinafter, DMD) provided with a large number of micromirrors, and a projection light source that projects light toward the DMD. The DLP projector draws a display image on the screen under the control of linking the DMD and the projection light source.

Further, in the HUD 20 of the modification 18, a projector using LCOS (Liquid Crystal On Silicon) is adopted. Further, in the HUD 20 of the modified example 19, a holographic optical element is adopted as one of the optical systems for displaying the virtual image Vi in the air.

In the modified example 20 of the above embodiment, the HCU and the HUD are integrally configured. That is, the processing function of the HCU is mounted on the HUD control circuit of the modified example 20. In such a modification 20, the HUD corresponds to the "display control device". Further, the processing function of the HCU may be mounted on the meter ECU, the navigation ECU, the display audio ECU, and the like. In such a modification, the meter device, the navigation device, and the display audio device correspond to the "display control device".

In the modified example 21 of the above embodiment, the HCU 100 is provided with a camera image acquisition unit that acquires the imaged data obtained by capturing the foreground of the own vehicle, which is the imaged data of the front camera 31. The display generation unit 75 generates video data obtained by superimposing original images such as LTA-related contents CTt, CTpt and LCA-related contents CTwc, CTpc, CTc on a real image of the foreground based on the captured data. Based on such video data, the HUD 20 projects a display in which each content is superimposed on a real image as a virtual image in the foreground. When the angle of view of the HUD 20 is not sufficient as in the above modification 21, in a scene where the AR content deviates from the angle of view VA, a virtual image display in which the original image such as the content used for the AR display is superimposed on the real image is displayed. It may be carried out.

In the above embodiment, each function provided by the HCU can also be provided by software and the hardware that executes it, software only, hardware only, or a combination thereof. Further, when such a function is provided by an electronic circuit as hardware, each function can also be provided by a digital circuit including a large number of logic circuits or an analog circuit.

Further, the form of the storage medium for storing the program or the like capable of realizing the above display control method may be changed as appropriate. For example, the storage medium is not limited to the configuration provided on the circuit board, and may be provided in the form of a memory card or the like, inserted into the slot portion, and electrically connected to the control circuit of the HCU. .. Further, the storage medium may be an optical disk and a hard disk drive as a copy base of the program to the HCU.

The vehicle equipped with the HMI system is not limited to a general private passenger car, and may be a vehicle for rent-a-car, a vehicle for a manned taxi, a vehicle for ride sharing, a freight vehicle, a bus, or the like. Further, the driverless vehicle used for the mobility service may be equipped with an HMI system including an HCU.

The vehicle equipped with the HMI system may be a right-hand drive vehicle or a left-hand drive vehicle. Further, the traffic environment in which the vehicle travels may be a traffic environment premised on left-hand traffic, or may be a traffic environment premised on right-hand traffic. The lane keeping control and its related display according to the present disclosure are appropriately optimized according to the Road Traffic Act of each country and region, the steering wheel position of the vehicle, and the like.

The control unit and its method described in the present disclosure may be realized by a dedicated computer constituting a processor programmed to execute one or more functions embodied by a computer program. Alternatively, the apparatus and method thereof described in the present disclosure may be realized by a dedicated hardware logic circuit. Alternatively, the apparatus and method thereof described in the present disclosure may be realized by one or more dedicated computers configured by a combination of a processor that executes a computer program and one or more hardware logic circuits. Further, the computer program may be stored in a computer-readable non-transitional tangible recording medium as an instruction executed by the computer.

A vehicle, CTa response notification content, CTc LCA execution content (lane change content), CTpc LCA notice content (lane change content), CTwc LCA standby content (change standby content, lane change content), CTt LTA execution content (expected trajectory content) ), Lnd destination lane, SLc LC execution section (lane change execution section), VA angle, 11 processing unit, 20 HUD (head-up display), 51 lane maintenance control unit, 52 lane change control unit, 73 LTA information Acquisition unit (control information acquisition unit), 74 LCA information acquisition unit (change information acquisition unit), 75 display generation unit (display control unit), 100 HCU (display control device)

Claims (12)

A display control device used in a vehicle (A) to control a display on a head-up display (20).
A control information acquisition unit (73) that acquires driving control information related to driving control from a lane keeping control unit (51) that controls driving in the lane of the vehicle.
A change information acquisition unit (74) that acquires lane change information related to a lane change from a lane change control unit (52) that controls a lane change of the vehicle.
Based on the driving control information, a display control unit (75) that superimposes and displays the predicted locus content (CTt) showing the predicted locus of traveling in the lane on the road surface as a superimposition target is provided.
When the lane change information is acquired while traveling in the lane, the display control unit displays lane change content (CTpc) indicating a predicted lane change trajectory together with the predicted track content based on the lane change information. Display control device to make. The display control device according to claim 1, wherein the display control unit displays the lane change content at a position that does not overlap with the expected locus content. A display control device used in a vehicle (A) to control a display on a head-up display (20).
A control information acquisition unit (73) that acquires driving control information related to driving control from a lane keeping control unit (51) that controls driving in the lane of the vehicle.
A change information acquisition unit (74) that acquires lane change information related to a lane change from a lane change control unit (52) that controls a lane change of the vehicle.
Based on the driving control information, a display control unit (75) that superimposes and displays the predicted locus content (CTt) showing the predicted locus of traveling in the lane on the road surface as a superimposition target is provided.
When the lane change information is acquired while traveling in the lane, the display control unit ends the display of the predicted trajectory content, and then changes the lane indicating the predicted lane change based on the lane change information. A display control device that displays contents (CTwc, CTpc, CTc). The display control device according to any one of claims 1 to 3, wherein the display control unit displays the lane change content at a position visually recognized on the back side of the predicted locus content. The display control device according to any one of claims 1 to 4, wherein the display control unit highlights the expected locus content when the interruption of the lane change is grasped based on the lane change information. The lane change information includes information on the destination lane (Lnd) to which the vehicle moves due to the lane change.
The display control device according to any one of claims 1 to 5, wherein the display control unit displays the lane change content at a position visually recognized on the destination lane side with respect to the predicted trajectory content. When the execution section (SLc) of the lane change by the lane change control unit is within the angle of view (VA) of the head-up display, the display control unit has the lane on the road surface including at least a part of the execution section. The display control device according to any one of claims 1 to 6, wherein the changed content is superimposed and displayed. The display control unit displays change standby content (CTwc) indicating that the lane is to be changed when the execution section is not within the angle of view, and the lane when the execution section is within the angle of view. The display control device according to claim 7, wherein the content is displayed in a manner different from that of the changed content. The display control device according to claim 8, wherein the display control unit displays the change standby content at a position that does not overlap with the expected locus content. The lane change information includes information indicating an input of an on operation instructing the lane change control unit to perform a lane change.
The display control device according to any one of claims 1 to 9, wherein the display control unit displays the response notification content (CTa) for notifying the acceptance of the on operation together with the expected locus content. A display control program used in the vehicle (A) to control the display on the head-up display (20).
In at least one processing unit (11)
The driving control information related to the driving control is acquired from the lane keeping control unit (51) that controls the traveling in the lane of the vehicle (S103).
Based on the driving control information, the predicted locus content (CTt) showing the predicted locus of driving in the lane is superimposed and displayed on the road surface as the superimposition target (S104).
The lane change information related to the lane change is acquired from the lane change control unit (52) that controls the lane change of the vehicle (S107, S108).
When the lane change information is acquired while traveling in the lane, the lane change content (CTpc) indicating the expected locus of the lane change is displayed together with the predicted locus content based on the lane change information (S113).
A display control program that executes processing including that. A display control program used in the vehicle (A) to control the display on the head-up display (20).
In at least one processing unit (11)
The driving control information related to the driving control is acquired from the lane keeping control unit (51) that controls the traveling in the lane of the vehicle (S103).
Based on the driving control information, the predicted locus content (CTt) showing the predicted locus of driving in the lane is superimposed and displayed on the road surface as the superimposition target (S104).
The lane change information related to the lane change is acquired from the lane change control unit (52) that controls the lane change of the vehicle (S105).
When the lane change information is acquired while driving in the lane, after the display of the predicted trajectory content is finished, the lane change content (CTwc, CTpc, CTc) indicating the predicted lane change based on the lane change information. ) Is displayed (S110, S113, S116),
A display control program that executes processing including that.

Images