JP2017030727A - Drive assist device, drive assist system, drive assist method, drive assist program and automatic operation vehicle - Google Patents

Abstract

PROBLEM TO BE SOLVED: To enable a driver to intuitively and simply instruct a vehicle to switch lanes.SOLUTION: In a drive assist device (10), an image output section (14a) outputs an image including an own vehicle object representing an own vehicle and a plurality of lanes to a display section (31). An operation signal input section (14b) receives user's operation to move the own vehicle object from a first lane to a second lane in the image displayed on the display section (31). A command output section (14c), when receiving the user's operation, outputs a command to instruct the own vehicle to shift from the first lane to the second lane to a vehicle operation control section (20) which controls automatic operation.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a technique for assisting a driver with a driving operation instruction to a vehicle during automatic driving.

  In recent years, development related to automatic driving of automobiles has been promoted. As for automatic operation, the automation levels defined in 2013 by NHTSA (National Highway Traffic Safety Administration) are no automation (level 0), automation of specific functions (level 1), automation of complex functions (level 2), semi-automatic operation ( Level 3) and fully automatic operation (level 4). Level 1 is a driving support system that automatically performs one of acceleration, deceleration, and steering. Level 2 is a driving support system that automatically performs two or more of acceleration, deceleration, and steering in harmony. is there. In either case, the driver remains involved in the driving operation. The automation level 4 is a fully automatic traveling system that automatically performs all of acceleration, deceleration, and steering, and the driver is not involved in the driving operation. The automation level 3 is a quasi-fully automatic traveling system in which acceleration, deceleration, and steering are all automatically performed, and a driver performs a driving operation as necessary.

  As a form of automatic driving, the driver does not operate the existing driving operation unit such as steering and accelerator pedal, but by issuing commands to the vehicle side, specific driving operation such as lane change, overtaking, following driving, etc. Can be considered to the vehicle side. In this form, a user interface with few erroneous operations is required.

JP2013-129328A

  In a design where a switch is provided for each specific driving operation such as lane change, overtaking, and follow-up driving, the correspondence between the switch operation and automatic driving control is not intuitive. Selecting a function that has been changed according to the situation by reducing the number of people is a complicated task, and includes a wide range of people, including those who have not been driving until now, and those who want to continue driving even if their driving ability has declined There is a problem that a user cannot use an autonomous driving vehicle without training.

  The present invention has been made in view of such circumstances, and an object of the present invention is to provide a technique by which a driver can instruct a vehicle to perform a specific driving operation intuitively and simply.

  In order to solve the above problems, a driving support apparatus according to an aspect of the present invention includes an image output unit that outputs image information including a host vehicle object representing a host vehicle and a plurality of lanes, and a display unit An operation signal input unit that receives an operation signal of a user that moves the vehicle object in the displayed image from the first lane to the second lane, and when the operation signal is received, the traveling lane of the vehicle is changed to the first lane. A command output unit that outputs an automatic driving control command for instructing to change to the second lane to an automatic driving control unit that controls automatic driving.

  An arbitrary combination of the above components, the expression of the present invention converted between an apparatus, a system, a method, a program, a recording medium recording the program, a vehicle equipped with the apparatus, and the like are also included in the present invention. It is effective as an embodiment.

  According to the present invention, the driver can instruct the vehicle to perform a specific driving operation intuitively and simply.

It is a block diagram which shows the structure of the vehicle which concerns on embodiment of this invention. It is a figure which shows an example of the basic sequence of the detection part of FIG. 1, an automatic driving controller, an HMI controller, a display part, and an input part. It is a figure which shows an example of the basic flowchart for demonstrating the process of the HMI controller of FIG. It is a flowchart for demonstrating the update process of reception mode. It is a flowchart which shows an example of the determination process in case the gesture operation which instruct | indicates a lane change is input in step S9 of FIG. It is a flowchart which shows the 1st process example which issues a lane change instruction command by gesture operation. FIGS. 7A to 7B are diagrams illustrating an example of a gesture operation according to the flowchart of FIG. It is a flowchart which shows the 2nd process example which issues a lane change instruction command by gesture operation. 9A to 9D are diagrams illustrating an example of the gesture operation according to the flowchart of FIG. It is a flowchart which shows the 3rd process example which issues a lane change instruction command by gesture operation. FIGS. 11A and 11B are diagrams illustrating an example of a gesture operation according to the flowchart of FIG. It is a flowchart which shows the 4th process example which issues a lane change instruction command by gesture operation. FIGS. 13A to 13D are diagrams illustrating an example of the gesture operation according to the flowchart of FIG. It is a flowchart which shows the 5th process example which issues a lane change instruction command by gesture operation. 15A to 15D are diagrams illustrating an example of the gesture operation according to the flowchart of FIG. It is a flowchart which shows the 6th process example which issues a lane change instruction command by gesture operation. 17A to 17D are diagrams illustrating an example of a gesture operation according to the flowchart of FIG. It is a flowchart which shows the 7th process example which issues a lane change instruction command by gesture operation. FIGS. 19A to 19C are diagrams illustrating an example of a gesture operation according to the flowchart of FIG. It is a flowchart which shows the 8th process example which issues a lane change instruction command by gesture operation. FIGS. 21A to 21F are diagrams illustrating an example of a gesture operation according to the flowchart of FIG. It is a flowchart which shows the process example which issues a cancel command, after issuing a lane change instruction command by gesture operation. FIGS. 23A to 23D are diagrams illustrating an example of a gesture operation according to the flowchart of FIG. FIGS. 24A and 24B are diagrams illustrating another example of the gesture operation according to the flowchart of FIG. FIG. 6 is a flowchart illustrating an example of a process of drawing a predicted trajectory / route candidate in step S9f of FIG. FIG. 6 is a flowchart illustrating another example of a process of drawing a predicted trajectory / route candidate in step S9f of FIG. FIGS. 27A to 27C are diagrams illustrating an example of the gesture operation according to the flowchart of FIG. 28A to 28C are diagrams showing an example of the error display screen in step S15 of FIG.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. FIG. 1 is a block diagram showing a configuration of a vehicle 1 according to an embodiment of the present invention, which is a configuration related to automatic driving. A vehicle 1 (own vehicle) equipped with an automatic driving mode includes a driving support device 10, an automatic driving control device 20, a display device 30, a detection unit 40, and a driving operation unit 50.

  The display device 30 includes a display unit 31 and an input unit 32. The display device 30 may be a head unit such as a car navigation system or display audio, may be a mobile terminal device such as a smartphone or a tablet, or may be a dedicated console terminal device.

  The display unit 31 is a liquid crystal display, an organic EL display, or a head-up display (HUD). The input unit 32 is a user interface that receives user input. The display unit 31 and the input unit 32 may be an integrated touch panel display. Note that the input unit 32 may include an input device that assists gesture input, such as a mouse, a stylus pen, or a trackball. A pen that emits visible light or infrared light may be used.

  Note that the display unit 31 and the input unit 32 may be physically separated instead of an integrated touch panel display. For example, the input unit 32 may be a non-contact type input device that includes a sensor such as a camera and is capable of inputting an air gesture operation. For example, an operation method such as pointing with a pointing object, starting dragging with the gesture of closing the thumb and index finger close, and ending dragging with the gesture of releasing the thumb and index finger can be considered.

  The driving support device 10 and the display device 30 may be connected by a wired communication such as a dedicated line or a CAN (Controller Area Network), or may be USB, Ethernet (registered trademark), Wi-Fi (registered trademark). , Bluetooth (registered trademark) or the like may be connected by wired communication or wireless communication.

  The detection unit 40 includes a position information acquisition unit 41, a sensor 42, a speed information acquisition unit 43, and a map information acquisition unit 44. The position information acquisition unit 41 acquires the current position of the vehicle 1 from the GPS receiver. The sensor 42 is a general term for various sensors for detecting the situation outside the vehicle and the state of the vehicle 1. For example, a camera, millimeter wave radar, LIDAR (Light Detection and Ranging, Laser Imaging Detection and Ranging), a temperature sensor, an atmospheric pressure sensor, a humidity sensor, an illuminance sensor, and the like are mounted as sensors for detecting a situation outside the vehicle. The situation outside the vehicle may be a road situation where the host vehicle travels including lane information, an environment including the weather, and a situation around the host vehicle. Any information outside the vehicle that can be detected by the sensor may be used. For example, an acceleration sensor, a gyro sensor, a geomagnetic sensor, a tilt sensor, and the like are mounted as sensors for detecting the state of the vehicle 1. The speed information acquisition unit 43 acquires the current speed of the vehicle 1 from the vehicle speed sensor. The map information acquisition unit 44 acquires map information around the current position of the vehicle 1 from the map database. The map database may be recorded on a recording medium in the vehicle 1, or may be downloaded from a map server via a network when used.

  The detection unit 40 and the automatic operation control device 20 are connected by wired communication such as a dedicated line, USB, Ethernet (registered trademark), CAN (Controller Area Network) or the like. The data acquired and detected by the detection unit 40 may be directly output from the detection unit 40 to the driving support device 10.

  The driving operation unit 50 includes a steering 51, a brake pedal 52, an accelerator pedal 53, and a winker switch 54. In the automatic driving mode according to the present embodiment, acceleration, deceleration, steering, and blinker blinking are objects of automatic control by the automatic driving control device 20, and FIG. 1 shows an operation unit for performing these controls manually. I'm drawing. In addition, you may output the information which the driver | operator moved the driving operation part 50 a little manually to the driving assistance apparatus 10. FIG.

  The steering 51 is an operation unit for steering the vehicle. When the steering wheel 51 is rotated by the driver, the traveling direction of the vehicle is controlled via the steering actuator. The steering actuator can be electronically controlled by a steering ECU (Electronic Control Unit).

  The brake pedal 52 is an operation unit for decelerating the vehicle 1. When the brake pedal 52 is depressed by the driver, the vehicle is decelerated through the brake actuator. The brake actuator can be electronically controlled by the brake ECU.

  The accelerator pedal 53 is an operation unit for accelerating the vehicle 1. When the accelerator pedal 53 is depressed by the driver, the engine speed and / or the motor speed are controlled via the accelerator actuator. The engine speed is controlled in a pure engine car, the motor speed is controlled in a pure electric car, and both are controlled in a hybrid car. The accelerator actuator can be electronically controlled by the engine ECU and / or the motor ECU.

  The turn signal switch 54 is an operation unit for blinking a turn signal for notifying the outside of the vehicle path. When the turn signal switch 54 is turned on / off by the driver, the turn signal is turned on / off via the turn signal controller. The winker controller includes a drive circuit such as a relay for controlling power feeding to the winker lamp.

  The steering ECU, the brake ECU, the engine ECU, the motor ECU, and the winker controller are connected to the automatic driving control device 20 by wired communication such as a CAN or a dedicated line. The steering ECU, the brake ECU, the engine ECU, the motor ECU, and the winker controller respectively transmit state signals indicating the states of the steering, the brake, the engine, the motor, and the winker lamp to the automatic driving control device 20.

  In the automatic operation mode, the steering ECU, the brake ECU, the engine ECU, and the motor ECU drive each actuator in accordance with a control signal supplied from the automatic operation control device 20. In the manual operation mode, the steering 51, the brake pedal 52, and the accelerator pedal 53 may be mechanically transmitted directly to each actuator, or may be configured to be electronically controlled via each ECU. It may be. The winker controller turns on / off the winker lamp in response to a control signal supplied from the automatic operation control device 20 or an instruction signal from the winker switch 54.

  The automatic operation control device 20 is an automatic operation controller that implements an automatic operation control function, and includes a control unit 21, a storage unit 22, and an input / output unit 23. The configuration of the control unit 21 can be realized by cooperation of hardware resources and software resources, or only by hardware resources. Processors, ROM, RAM, and other LSIs can be used as hardware resources, and programs such as an operating system, application, and firmware can be used as software resources. The storage unit 22 includes a nonvolatile recording medium such as a flash memory. The input / output unit 23 executes various communication controls corresponding to various communication formats.

  The control unit 21 applies various parameter values collected from the detection unit 40 and various ECUs to the automatic driving algorithm, and calculates a control value for controlling an automatic control target such as the traveling direction of the vehicle 1. The control unit 21 transmits the calculated control value to each control target ECU or controller. In this embodiment, it is transmitted to a steering ECU, a brake ECU, an engine ECU, and a winker controller. In the case of an electric vehicle or a hybrid car, the control value is transmitted to the motor ECU instead of or in addition to the engine ECU.

  The driving support apparatus 10 is an HMI (Human Machine Interface) controller for executing an interface function between the vehicle 1 and the driver, and includes a determination unit 11, a generation unit 12, an instruction unit 13, and an input / output unit 14. . The determination unit 11, the generation unit 12, and the instruction unit 13 can be realized by cooperation of hardware resources and software resources, or only by hardware resources. Processors, ROM, RAM, and other LSIs can be used as hardware resources, and programs such as an operating system, application, and firmware can be used as software resources. The input / output unit 14 executes various communication controls according to various communication formats. The input / output unit 14 includes an image output unit 14a, an operation signal input unit 14b, a command output unit 14c, and a vehicle information input unit 14d. The image output unit 14 a outputs the image generated by the generation unit 12 to the display unit 31. The operation signal input unit 14 b receives an operation signal generated by the driver, an occupant, or a user outside the vehicle made to the input unit 32 and outputs the operation signal to the determination unit 11. The command output unit 14 c outputs the command instructed by the instruction unit 13 to the automatic operation controller 20. The vehicle information input unit 14 d receives detection data acquired by the detection unit 40 and vehicle-side information generated by the automatic driving controller 20 and outputs the information to the generation unit 12.

  The automatic operation controller 20 and the HMI controller 10 are directly connected by a signal line. In addition, the structure connected via CAN may be sufficient. Further, a configuration is possible in which the automatic operation controller 20 and the HMI controller 10 are integrated into one controller.

  FIG. 2 is a diagram illustrating an example of a basic sequence of the detection unit 40, the automatic operation controller 20, the HMI controller 10, the display unit 31, and the input unit 32 of FIG. The detection unit 40 detects the own vehicle position information, the own vehicle traveling road information including the lane information, and the own vehicle surrounding information and outputs the detected information to the automatic driving controller 20 (P1). The automatic driving controller 20 outputs the vehicle position information, the vehicle traveling road information, and the vehicle surrounding information acquired from the detection unit 40 to the HMI controller 10 (P2). The HMI controller 10 generates a schematic diagram including the host vehicle and the surrounding situation of the host vehicle based on the information acquired from the automatic driving controller 20 (P3). The HMI controller 10 outputs the generated schematic diagram to the display device 30 and displays it on the display unit 31 (P4).

  The user who sees the schematic diagram displayed on the display unit 31 contacts the input unit 32 (P5). The display unit 31 outputs the coordinate data in which contact is detected to the HMI controller 10 (P6). The HMI controller 10 determines the type of command based on the coordinate data acquired from the display device 30 (P7). The HMI controller 10 accepts additional inputs until a predetermined time has elapsed (P8 to P12). After determining the command, the HMI controller 10 regenerates a schematic diagram indicating that the command is being instructed (P8). The HMI controller 10 outputs the regenerated schematic diagram to the display device 30 and displays it on the display unit 31 (P9). When there is no command corresponding to the gesture operation by the user's contact, a schematic diagram including an error message is generated and output to the display device 30 and displayed on the display unit 31.

  When the user who sees the schematic diagram showing that the command is being instructed touches the input unit 32 (P10), the display unit 31 outputs the coordinate data in which the contact is detected to the HMI controller 10 (P11). The HMI controller 10 executes additional command processing based on the coordinate data acquired from the display device 30 (P12). If there is no new command input in the additional command processing (P12), the HMI controller 10 issues the command determined in P7 to the automatic operation controller 20 (P13, P14). When a new command is input in the additional command process (P12), the new command is issued to the automatic operation controller 20. If the newly input command is a cancel command, cancel the command issue. The overwriting / cancellation processing of the original command by a new command may be performed by the automatic operation controller 20, and in that case, the HMI controller 10 transmits the command to the automatic operation controller 20 after the command determination processing in P7 and P12. The overwriting / cancellation process is performed according to the state of the automatic operation controller 20.

  The detection unit 40 periodically detects the vehicle position information, the vehicle traveling road information, and the vehicle periphery information and outputs the detected information to the automatic driving controller 20 (P15). Based on the information, the automatic operation controller 20 determines whether or not the control instructed by the command issued from the HMI controller 10 can be executed (P16). If it can be executed, the automatic operation controller 20 outputs a control start notification to the HMI controller 10 (P17). Upon receiving the control start notification, the HMI controller 10 regenerates a schematic diagram including a message indicating that control is being performed (P18). The HMI controller 10 outputs the regenerated schematic diagram to the display device 30 and displays it on the display unit 31 (P19). Although not shown, the automatic operation controller 20 applies various parameter values collected from the detection unit 40 and various ECUs to the automatic operation algorithm, and performs automatic control such as the traveling direction of the vehicle 1 for executing the issued command. A specific control value for controlling the driving operation unit 50 is calculated and transmitted to each ECU or controller to be controlled. The driving operation unit 50 operates based on specific control values. The driving operation unit 50 determines that the command execution is complete when the predetermined control value or the detection data of the detection unit 40 reaches a predetermined value (range) and the automatic operation controller 20 determines that the condition of the issued command is satisfied. .

  When receiving the control completion notification from the automatic operation controller 20, the HMI controller 10 generates a schematic diagram including a message indicating that the control is completed and outputs the schematic diagram to the display device 30. During a period in which no operation is accepted from the user, a schematic diagram including a message indicating that no operation is accepted is generated and output to the display device 30.

  FIG. 3 is a diagram showing an example of a basic flowchart for explaining the processing of the HMI controller 10 of FIG. The determination unit 11 of the HMI controller 10 checks whether the operation mode is the automatic operation mode or the manual operation mode (S1). In the case of the manual operation mode (N in S2), the process is terminated. In the case of the automatic operation mode (Y in S2), the following process is performed.

  The sensor information input from the detection unit 40 to the automatic operation controller 20 is updated as needed (S3). The generation unit 12 of the HMI controller 10 includes the own vehicle position information, the own vehicle traveling road information including the lane information, and the surrounding conditions of the own vehicle and the own vehicle based on the own vehicle periphery information. A schematic diagram is generated, and the generated schematic diagram is drawn on the display unit 31 (S4). The determination unit 11 checks whether the reception mode is an acceptable mode in which an operation from the user can be accepted or an unacceptable mode in which an operation from the user cannot be accepted (S5). If it is in the unacceptable mode (N in S6), the process ends. When it is in the acceptable mode (Y in S6), the determination unit 11 determines whether or not there is a user's contact with the input unit 32 (S7). When there is no contact (N of S8), the fixed time passage determination process (S12) described later is executed. When there is contact (Y in S8), the determination unit 11 determines a control command in accordance with a gesture operation input by the user (S9). Details of this determination process will be described later.

  When the control command determined in step S9 is not a cancel command (N in S10), the generation unit 12 displays a command instruction on the display unit 31 (S11). When a certain time has elapsed after the control command is determined (Y in S12), if there is a control command determined in step S9 (Y in S13), the display unit 31 displays that the operation cannot be accepted (S14), and the determination unit 11 updates the acceptance mode from the acceptable mode to the unacceptable mode (S15), and the instruction unit 13 outputs the determined control command to the automatic operation controller 20 (S16). Until a predetermined time elapses (N in S12), the process proceeds to step S3.

  In step S10, when the determined control command is a cancel command (Y in S10), cancel is displayed (S110), and the process ends. In step S13, if there is no control command determined in step S9, an input error is displayed (S111), and the process ends. The automatic operation controller 20 periodically detects the vehicle position information, the vehicle traveling road information, and the vehicle surrounding information from the detection unit 40. Since the surrounding situation changes from moment to moment, it may be determined that the control command cannot be executed after the control command is output to the automatic operation controller 20. For example, there is a case where another vehicle has interrupted between the own vehicle and another vehicle after the follow-up instruction. When the automatic operation controller 20 determines that the control command can be executed (Y in S17), the generation unit 12 displays on the display unit 31 that the control is being performed (S18), activates a timer, and starts counting. (S19). When the automatic operation controller 20 determines that control is impossible (N in S17), the generation unit 12 displays an uncontrollable error on the display unit 31 (S112).

  FIG. 4 is a flowchart for explaining the reception mode update process. When the timer count value reaches a set value (for example, 10 seconds) (Y in S113), the determination unit 11 of the HMI controller 10 updates the reception mode from the unacceptable mode to the acceptable mode (S114). The count value of the timer may be changed according to the surrounding situation of the own vehicle. When the determination unit 11 receives a notification indicating the completion of control from the automatic driving controller 20 or determines from the behavior of the vehicle 1 that the control according to the control command is completed, the reception mode can be received from the unacceptable mode. You may update to mode.

  Hereinafter, in the present embodiment, an example in which a control command for instructing lane change is issued as a control command will be described. The user inputs a gesture operation that instructs the input unit 32 to change lanes. A specific example of the gesture operation will be described later.

  FIG. 5 is a flowchart illustrating an example of determination processing when a gesture operation instructing lane change is input in step S9 of FIG. The determination unit 11 of the HMI controller 10 determines whether or not the vehicle mark is present at the contact start position (S9a). When the own vehicle mark does not exist (N in S9a), the determination unit 11 determines that the control command is other than the lane change instruction (S9b). When the vehicle mark is present (Y in S9a), the generation unit 12 draws a droppable area in the schematic diagram and displays it on the display unit 31 (S9c). A specific example of the droppable area will be described later.

  The determination unit 11 receives the touch event generated at the input unit 32 (S9d), and determines the type of the touch event (S9e). When the touch event type is movement (movement of S9e), the generation unit 12 draws the predicted trajectory / route candidate of the vehicle 1 in the schematic diagram and causes the display unit 31 to display the candidate (S9f). Details of the process of drawing the predicted trajectory / route candidate will be described later.

  When the touch event type is contact end (contact end in S9e), the determination unit 11 determines whether or not the contact end position is on the lane (S9g). When it is on the lane (Y in S9g), the determination unit 11 determines whether the lane at the contact end position is different from the lane at the contact start position (S9h). When the lanes are not different (in the case of the same lane) (N in S9h), the determination unit 11 determines that the control command is other than the lane change instruction (S9i). In this case, the lane in which the vehicle is traveling is maintained.

  If the lane at the contact end position is different from the lane at the contact start position (Y in S9h), the determination unit 11 determines whether the lane at the contact end position is a lane that can change lanes (S9j). When the lane can be changed (Y in S9j), the determination unit 11 determines whether there is another vehicle in the lane at the contact end position (S9k). When there is no other vehicle (N in S9k), the determination unit 11 determines that the command is a lane change instruction command to the lane (S91).

  When there is another vehicle in the contact end position lane (Y in S9k), the determination unit 11 determines whether the contact end position is in front of or behind the other vehicle (S9m). When the vehicle is ahead (before S9m), the determination unit 11 determines that the command is a lane change instruction command to the lane ahead of the other vehicle (S9n). When it is behind (after S9m), the determination part 11 determines with the lane change instruction command to the said other vehicle back to the said other lane (S9o).

  In step S9g, when the contact end position is outside the lane (N in S9g), the determination unit 11 determines whether or not the contact end position is outside the left and right of all the lanes (S9p). If it is not the left or right outside of all lanes (N in S9p), the determination unit 11 determines that the control command is other than the lane change instruction (S9q). When it is outside the left and right of all the lanes (Y in S9p), the determination unit 11 determines whether there is an intersection ahead (S9r). When there is no intersection ahead (N in S9r), the generation unit 12 displays an error message on the display unit 31 (S9s). When there is an intersection ahead (Y in S9r), it is determined as a right turn instruction command or a left turn instruction command (S9t). If it is the right outside of all lanes, it becomes a right turn instruction command, and if it is outside the left, it becomes a left turn instruction command. In the process of step S9j, when the lane at the contact end position is not a lane where the lane can be changed (N of S9j), the process proceeds to step S9r, and the determination unit 11 determines whether an intersection exists ahead (S9r). .

  Hereinafter, a specific example of the gesture operation used when changing the lane will be described. In the following example, it is assumed that a touch panel display in which the display unit 31 and the input unit 32 are integrated is used.

  FIG. 6 is a flowchart illustrating a first processing example in which a lane change instruction command is issued by a gesture operation. The determination unit 11 of the HMI controller 10 receives a touch event (DOWN) from the touch panel (S20). The touch event (DOWN) is an event indicating a change from a non-contact state to a contact state with a finger or a pen on the touch panel. The determination unit 11 determines whether or not the coordinate at which the touch event (DOWN) is detected is within the display area of the vehicle icon (S21). If it is outside the display area (N in S21), it is determined that it is not a lane change instruction, and the process ends.

  When it is inside the display area (Y in S21), the determination unit 11 receives a touch event (MOVE) from the touch panel (S22). A touch event (MOVE) is an event that represents a change from a contact state of a point on the touch panel with a finger or a pen to a contact state of another point. Thereafter, the determination unit 11 receives a touch event (UP) from the touch panel (S23). The touch event (UP) is an event representing a change from a contact state with a finger or a pen to the touch panel to a non-contact state.

  The determination unit 11 determines whether or not the coordinate where the touch event (UP) is detected is another lane in the same traveling direction (S24). If it is another lane (Y in S24), the instruction unit 13 issues a lane change instruction command to the automatic driving controller 20 (S25). If it is not another lane (N in S24), it is determined that it is not a lane change instruction, and the process ends.

  FIGS. 7A to 7B are diagrams illustrating an example of a gesture operation according to the flowchart of FIG. In the schematic diagram shown in FIG. 7A, the first lane L1 and the second lane L2 are displayed, and the vehicle icon V1 is displayed on the first lane L1. Various display forms are conceivable as display forms of the surrounding situation including the own vehicle and the road. A live-action image may be used, or a precise CG image or animation image may be used. The display of the own vehicle is not limited to icons, and may be displayed with simpler marks and characters, or may be displayed with a live-action image. That is, the object may be displayed on the screen in some display form.

  When the driver wants to change the lane from the first lane L1 to the second lane L2, as shown in FIG. 7A, the driver drags the vehicle icon V1 on the first lane L1, and as shown in FIG. 7B. The own vehicle icon V1 is dropped on the second lane L2. Thereby, a lane change instruction command is issued.

  FIG. 8 is a flowchart illustrating a second processing example in which a lane change instruction command is issued by a gesture operation. The second processing example is an example when another vehicle exists in the lane change destination lane. The processing from step S20 to step S24 is the same as the flowchart of FIG.

  When the coordinate where the touch event (UP) is detected is another lane in the same traveling direction (Y in S24), the determination unit 11 determines whether or not the coordinate is a front area of the other vehicle icon (S26). When it is a front area (Y of S26), the instruction unit 13 issues an overtaking instruction command and a lane change instruction command of another vehicle to the automatic operation controller 20 (S27). If it is the rear region (N in S26), the instruction unit 13 issues an overtaking instruction command and a lane change instruction command for other vehicles to the automatic operation controller 20 (S28). That is, the lane change is performed so that the vehicle enters behind the other vehicle after the other vehicle has come out ahead of the own vehicle.

  9A to 9D are diagrams illustrating an example of the gesture operation according to the flowchart of FIG. When the driver wants to change the lane from the first lane L1 to the front of the other vehicle in the second lane L2, as shown in FIG. 9A, the driver drags the vehicle icon V1 on the first lane L1 and ), The host vehicle icon V1 is dropped in front of the other vehicle icon V2 of the second lane L2. Thereby, an overtaking instruction command and a lane change instruction command are issued. When the driver wants to change the lane from the first lane L1 to the rear of the other vehicle in the second lane L2, as shown in FIG. 9C, the driver drags the vehicle icon V1 on the first lane L1 to ), The host vehicle icon V1 is dropped behind the other vehicle icon V2 of the second lane L2. Thereby, an overtaking instruction command and a lane change instruction command are issued.

  FIG. 10 is a flowchart illustrating a third processing example in which a lane change instruction command is issued by a gesture operation. The third processing example is an example when a right turn or left turn dedicated lane exists. The processing from step S20 to step S23 is the same as the flowchart of FIG.

  The determination unit 11 determines whether or not the coordinates at which the touch event (UP) is detected are inside a right turn or left turn dedicated lane (S29). When it is inside the right turn or left turn exclusive lane (Y in S29), the instruction unit 13 issues a lane change instruction command and a right turn or left turn instruction command to the automatic operation controller 20 (S210). If it is not inside the right turn or left turn dedicated lane (N in S29), the process of step S210 is not activated.

  FIGS. 11A and 11B are diagrams illustrating an example of a gesture operation according to the flowchart of FIG. When the driver wants to change the lane from the straight lane Ls to the right turn lane Lr, as shown in FIG. 11A, the driver drags the vehicle icon V1 on the straight lane Ls as shown in FIG. 11B. The own vehicle icon V1 is dropped on the right turn exclusive lane Lr. Thereby, a lane change instruction command and a right turn command are issued.

  FIG. 12 is a flowchart illustrating a fourth processing example in which a lane change instruction command is issued by a gesture operation. The fourth processing example is an example in which the content of the command is changed according to the context. The processing from step S20 to step S24 is the same as the flowchart of FIG.

  When the coordinates at which the touch event (UP) is detected are other lanes in the same traveling direction (Y in S24), the instruction unit 13 issues a lane change instruction command to the automatic driving controller 20 (S27). When it is not another lane in the same traveling direction (N in S24), the instruction unit 13 issues a traveling direction instruction command (for example, a right turn instruction command, a left turn instruction command, a U turn instruction command) to the automatic operation controller 20 (S211). In this way, a plurality of control commands can be issued by combining the same touch operation with a plurality of lane information. The driver can issue an appropriate driving instruction with a simpler operation by issuing a control command suitable for the surrounding situation of the vehicle just by performing the same gesture.

  FIGS. 13A to 13D are diagrams illustrating an example of the gesture operation according to the flowchart of FIG. When the driver wants to change the lane from the first lane L1 to the second lane L2, as shown in FIG. 13 (a), the driver drags the vehicle icon V1 on the first lane L1, and as shown in FIG. 13 (b). The own vehicle icon V1 is dropped on the second lane L2. Thereby, a lane change instruction command is issued. On the other hand, when the driver wants to turn right, the vehicle icon V1 on the first lane L1 is dragged as shown in FIG. 13 (c), and the vehicle icon V1 is placed on the right outside of the lane as shown in FIG. 13 (d). To drop. As a result, a right turn instruction command is issued.

  FIG. 14 is a flowchart illustrating a fifth process example of issuing a lane change instruction command by a gesture operation. The fifth processing example is an example using flick input. The determination unit 11 of the HMI controller 10 receives a touch event (DOWN) from the touch panel (S20). The determination unit 11 determines whether or not the coordinate at which the touch event (DOWN) is detected is within the display area of the vehicle icon (S21). If it is outside the display area (N in S21), it is determined that it is not a lane change instruction, and the process ends.

  When it is inside the display area (Y in S21), the determination unit 11 determines whether there are a plurality of lanes that can travel in the traveling direction of the host vehicle (S212). When there are a plurality of lanes (Y in S212), the generation unit 12 generates a drop area for instructing lane change to a lane where the vehicle can run on the left and / or right of the vehicle icon and displays the drop area on the touch panel (S213). ). If there are no multiple lanes (N in S212), the process in step S213 is skipped.

  The determination unit 11 determines whether there is an intersection within a certain distance in the traveling direction (S214). When there is an intersection (Y in S214), the generation unit 12 displays a drop area for a route change instruction in a direction in which the route can be changed at the intersection on the left and / or right of the own vehicle icon or the drop area for the lane change instruction. Generate and display on the touch panel (S215). When there is no intersection (N of S214), the process of step S215 is skipped.

  The determination unit 11 receives a touch event (UP) from the touch panel (S216). The determination unit 11 determines whether or not the coordinates where the touch event (UP) is detected are within the drop area (S217). If it is not in the drop area (N in S217), it is determined that it is not a lane change instruction, and the process ends. When the coordinates at which the touch event (UP) is detected are within the lane change instruction drop area (lane change instruction drop area in S217), the instruction unit 13 issues a lane change instruction command to the automatic driving controller 20 ( S218). When the coordinates at which the touch event (UP) is detected are within the route change instruction drop area (the route change instruction drop area in S217), the instruction unit 13 issues a route change instruction command to the automatic operation controller 20 ( S219).

  15A to 15D are diagrams illustrating an example of the gesture operation according to the flowchart of FIG. When the driver wants to change the lane from the first lane L1 to the second lane L2, as shown in FIG. 15A, the driver touches the own vehicle icon V1 on the first lane L1. When the host vehicle icon V1 is touched, a lane change instruction drop area A1 for the second lane L2 is displayed as shown in FIG. 15 (b). When the user flicks to the drop area A1, a lane change instruction command to the second lane L2 is issued.

  When the user touches the own vehicle icon V1 when there is an intersection ahead as shown in FIG. 15C, the lane change instruction drop area A1 to the right lane, the left lane as shown in FIG. 15D A lane change instruction drop area A2, a right turn instruction drop area A3, and a left turn instruction drop area A4 are displayed. When the user flicks to one of the drop areas, a corresponding command is issued. As a result, a desired control command can be issued with only a small movement distance of the user's finger.

  FIG. 16 is a flowchart illustrating a sixth process example of issuing a lane change instruction command by a gesture operation. The sixth processing example is an example in which the track of the own vehicle icon is displayed in the schematic diagram. The determination unit 11 of the HMI controller 10 receives a touch event (DOWN) from the touch panel (S20). The determination unit 11 determines whether or not the coordinate at which the touch event (DOWN) is detected is within the display area of the vehicle icon (S21). If it is outside the display area (N in S21), it is determined that it is not a lane change instruction, and the process ends.

  If it is inside the display area (Y in S21), the determination unit 11 receives a touch event (MOVE / UP) from the touch panel (S220). The determination unit 11 determines the type of touch event (S221). When the type of the touch event is “MOVE” (MOVE in S221), the determination unit 11 determines whether or not the coordinate where the touch event (MOVE) is detected is another lane in the same traveling direction (S222). When it is another lane (Y of S222), the generation unit 12 generates a predicted route when the lane change is performed and displays the predicted route on the touch panel (S223). If it is not another lane (N in S222), the process of step S223 is skipped. Thereafter, the process proceeds to operation S220. In this flowchart, attention is paid to the display of the predicted route, and therefore, the processing after step S221 when the touch event type is “UP” (UP in S221) is omitted.

  17A to 17D are diagrams illustrating an example of a gesture operation according to the flowchart of FIG. When the driver wants to change the lane from the first lane L1 to the second lane L2, as shown in FIG. 17A, the driver drags the own vehicle icon V1 on the first lane L1. As shown in FIG. 17B, the track T1 through which the vehicle passes when the moving vehicle icon V1 is dropped at the current position is displayed. When the driver wants to make a right turn at the intersection, the vehicle icon V1 is dragged as shown in FIG. As shown in FIG. 17D, a track T1 through which the vehicle passes when the moving vehicle icon V1 is dropped at the current position is displayed. A detailed description regarding the display of the trajectory will be described later.

  FIG. 18 is a flowchart illustrating a seventh processing example in which a lane change instruction command is issued by a gesture operation. The seventh processing example is an example for obtaining a confirmation operation. The processing from step S20 to step S24 is the same as the flowchart of FIG.

  When the coordinates at which the touch event (UP) is detected are other lanes in the same traveling direction (Y in S24), when the determination unit 11 receives an input of a confirmed gesture (Y in S224), the instruction unit 13 instructs the lane change. A command is issued to the automatic operation controller 20 (S25). While there is no input of the confirmation gesture (N in S224), the issue of the command is suspended.

  FIGS. 19A to 19C are diagrams illustrating an example of a gesture operation according to the flowchart of FIG. When the driver wants to change the lane from the first lane L1 to the front of the other vehicle in the second lane L2, as shown in FIG. 19A, the driver drags the vehicle icon V1 on the first lane L1 to ), The vehicle icon V1 is moved onto the second lane L2. When the host vehicle icon V1 is moved, a confirmation button C1 is displayed. As shown in FIG. 19C, after the vehicle icon V1 is dropped on the second lane L2, when the confirmation button C1 is pressed, a lane change instruction command to the second lane L2 is issued. Thereby, it is possible to further prevent erroneous operation.

  FIG. 20 is a flowchart illustrating an eighth processing example in which a lane change instruction command is issued by a gesture operation. The eighth processing example is an example in which a display during control is added. “In control” means a period until the vehicle completes the lane change after the lane change instruction command is issued. The process from step S20 to step S25 is the same as the flowchart of FIG.

  After the instructing unit 13 issues a lane change instruction command to the automatic driving controller 20 (S25), the generating unit 12 generates the own vehicle icon in the coordinates before moving and the coordinates after moving, and A predicted trajectory is generated and displayed on the touch panel (S225).

  FIGS. 21A to 21F are diagrams illustrating an example of a gesture operation according to the flowchart of FIG. When the driver wants to change the lane from the first lane L1 to the second lane L2, as shown in FIGS. 21A and 21D, the driver drags the vehicle icon V1 on the first lane L1, and FIG. (E), the own vehicle icon V1 is dropped on the second lane L2. Thereby, a lane change instruction command is issued. During execution of the lane change instruction command, as shown in FIGS. 21C and 21F, the host vehicle icon V1a is displayed at the original position before the start of the lane change, and the host vehicle icon V1b is displayed at the target position after the lane change is completed. Is displayed. Further, as shown in FIG. 21 (f), the predicted trajectory T1 of the own vehicle may be displayed.

  FIG. 22 is a flowchart illustrating a processing example in which a cancel command is issued after a lane change instruction command is issued by a gesture operation. After the lane change instruction command is issued to the automatic driving controller 20, the determination unit 11 of the HMI controller 10 receives a touch event (DOWN) from the touch panel (S226). Thereafter, the determination unit 11 of the HMI controller 10 receives a touch event (MOVE) from the touch panel (S227). Thereafter, the determination unit 11 of the HMI controller 10 receives a touch event (UP) from the touch panel (S228). The determination unit 11 determines whether or not there is an intersection between the movement track and the lane change track of the touch event (S229). When the intersection exists (Y in S229), the instruction unit 13 issues a command for canceling the previously issued lane change instruction command to the automatic operation controller 20 (S230). If there is no intersection (N in S229), no cancel command is issued.

  FIGS. 23A to 23D are diagrams illustrating an example of a gesture operation according to the flowchart of FIG. FIG. 23A shows an example in which a cancel command for a lane change instruction command is issued when swiping S1 across the predicted trajectory T1. FIG. 23B shows an example in which a cancel command for a lane change instruction command is issued when swiping S2 across the vehicle icon V1b after movement. FIG. 23C shows an example in which a cancel command for a lane change instruction command is issued when flicking F1 starts with the own vehicle icon V1b after movement. FIG. 23D shows an example in which a cancel command for a lane change instruction command is issued when a flick F1 is started from the predicted trajectory T1.

  FIGS. 24A and 24B are diagrams illustrating another example of the gesture operation according to the flowchart of FIG. When the vehicle icon V1b after movement is dragged as shown in FIG. 24 (a) and the vehicle icon V1c is dropped at the position before movement as shown in FIG. 24 (b), a cancel command for the lane change instruction command is issued. publish.

  Hereinafter, returning to FIG. 5, the details of the process of drawing the predicted trajectory / route candidate in step S9f will be described. The processing described in FIGS. 16 and 17A to 17D will be described more specifically.

  FIG. 25 is a flowchart illustrating an example of processing for drawing a predicted trajectory / route candidate in step S9f of FIG. The determination unit 11 of the HMI controller 10 determines whether a notification of movement of the own vehicle icon is received from the touch panel (S9fa). When receiving (Y of S9fa), the determination part 11 determines whether the moving position of the own vehicle icon is on a lane (S9fb). When it is on the lane (Y of S9fb), the determination unit 11 determines whether or not the movement position of the own vehicle icon is on a lane different from the lane of the movement start position of the own vehicle icon (S9fc). When not on different lanes (when on the same lane) (N in S9fc), the generation unit 12 deletes the movement trajectory in the schematic diagram displayed on the touch panel (S9fd). In step S9fb, even when the moving position of the vehicle icon is not on the lane (N in S9fb), the generation unit 12 deletes the moving track in the schematic diagram displayed on the touch panel (S9fd).

  In step S9fc, when the movement position of the vehicle icon is on a lane different from the lane of the movement start position of the vehicle icon (Y in S9fc), the determination unit 11 can change the lane of the movement position of the vehicle icon. It is determined whether or not the current lane is over (S9fe). When the lane change is not possible on the lane (N in S9fe), the generation unit 12 draws an error notification on the touch panel (S9ff). When the vehicle is on a lane where lane change is possible (Y in S9fe), the instruction unit 13 notifies the automatic operation controller 20 of the touch event coordinates of the vehicle icon and requests a predicted trajectory (S9fg). The generation unit 12 draws the predicted lane change trajectory acquired from the automatic driving controller 20 on the touch panel (S9fh). The above processing is continued until no movement notification of the vehicle icon is received from the touch panel (N in S9fa).

  FIG. 26 is a flowchart illustrating another example of the process of drawing the predicted trajectory / route candidate in step S9f of FIG. The processing from step S9fa to step S9ff is the same as the flowchart of FIG. When the vehicle is on a lane where lane change is possible (Y of S9fe), the determination unit 11 determines whether there is another vehicle in the lane of the lane change destination (S9fi). When there is no other vehicle (N in S9fi), the generation unit 12 draws a predicted lane change trajectory without acceleration / deceleration on the touch panel (S9fj).

  If there is another vehicle in the lane change destination lane (Y in S9fi), the determination unit 11 determines whether the movement position of the own vehicle icon is in front of or behind the other vehicle icon (S9fk). When it is ahead of the other vehicle icon (before S9fk), the production | generation part 12 draws the prediction track | orbit of lane change with acceleration on a touch panel (S9fl). When the vehicle is behind the other vehicle icon (after S9fk), the generation unit 12 draws the predicted trajectory of the lane change with deceleration on the touch panel (S9fm). When the movement position of the own vehicle icon is inside the other vehicle icon (other vehicle of S9fk), the generation unit 12 draws an error notification mode on the touch panel (S9fn). The above processing is continued until no movement notification of the vehicle icon is received from the touch panel (N in S9fa).

  FIGS. 27A to 27C are diagrams illustrating an example of the gesture operation according to the flowchart of FIG. FIG. 27A shows an example of a predicted track for lane change without acceleration / deceleration in step S9fj. FIG. 27B is an example of a predicted trajectory for lane change with acceleration in step S9fl. FIG. 27C is an example of a predicted trajectory for changing lanes with deceleration in step S9fm.

  FIGS. 28A to 28C are diagrams illustrating an example of an error display screen. When the driver wants to change the lane from the first lane L1 to the second lane L2, as shown in FIG. 28A, the driver drags the vehicle icon V1 on the first lane L1, and as shown in FIG. The own vehicle icon V1 is dropped on the second lane L2. When an approach of another vehicle is detected at the drop position, as shown in FIG. 28 (c), an error message “Cancelled because of following vehicle” is displayed in the pop-up window P1, and the vehicle icon V1 is Returned to 1 lane L1.

  The generation unit 12 may leave the original image (the vehicle icon before movement) in the schematic diagram until the original image is dropped after being dragged until the original image is dropped. In addition, the drag unit 12 may draw a drag trajectory in the schematic diagram with a dotted line from when the vehicle icon is dragged to when it is dropped. Moreover, the generation unit 12 may invert the color of the road until the vehicle icon is dropped after being dragged, and return it to the original color when the icon is dropped. It should be noted that the state of the moving icon such as color and shape may be different from or the same as the state of the icon before the movement.

  In addition, when the vehicle icon is dragged and dropped, the generation unit 12 changes the color of the vehicle icon when there is a non-dropable area (such as an opposite lane) or when an operation (lane change, etc.) is not possible ( Inversion, thinning, etc.). At the time of dropping, the vehicle icon may be returned to the original vehicle position, and an error message such as “operation not possible” may be displayed. Examples of cases where operation is not possible include approach of a following vehicle, lane change prohibition area, overspeed limit, and the like.

  Also, during the period from dragging the vehicle icon to dropping it, the generation unit 12 may change the color of the background such as a road (inverted, lightened, etc.) when the operation is impossible. When the operation becomes possible, the original color is restored. Further, the generation unit 12 changes the color of the non-dropable area from when the own vehicle icon is dragged to when it is dropped. In addition, when the vehicle icon is dragged and dropped, the generation unit 12 notifies an error sound or vibration when there is a drop-impossible area or when an operation is not possible.

  If the operation cannot be started when dragging the own vehicle icon is started, the generation unit 12 may change the color of the own vehicle icon. Alternatively, the drag operation (movement of the own vehicle icon) may be disabled. Also, an error message such as “operation not possible” may be displayed. If the operation cannot be started when dragging of the vehicle icon is started, the generation unit 12 may change the background color such as a road. When the operation becomes possible, the original color is restored. If the operation cannot be started when the drag of the own vehicle icon is started, the generation unit 12 notifies an error sound or vibration in a state where the drag operation (moving of the own vehicle icon) is not possible.

  From the time when the host vehicle icon is dropped until the host vehicle reaches the target position, the generation unit 12 may display a ghost of the state of the host vehicle that is changing lanes, and may display a lane change track. In addition, the generation unit 12 may change the display state (flashing, color change, size, position, etc.) of the own vehicle icon from when the own vehicle icon is dropped until the own vehicle reaches the target position. In addition, from when the own vehicle icon is dropped until the own vehicle reaches the target position, the determination unit 11 queues the next instruction by an additional operation (reservation of control performed after the current control is completed). Also good. The predicted trajectory may be received from the automatic operation controller 20 and drawn on the display unit 31 while the own vehicle icon is being dragged, dropped, or until the own vehicle reaches the target position. Good. If there is a vehicle in the destination lane, the vehicle is under construction, or it is a lane change-impossible zone, and the lane change is temporarily impossible, the generation unit 12 “trying” until the lane change control is established. ”Or the like may be displayed, and the predicted trajectory may be drawn at the timing at which execution becomes possible. While the vehicle icon is being dragged, or between when the vehicle icon is dropped and when the vehicle reaches the target position, the generation unit 12 displays the estimated required time and the remaining time required until the vehicle reaches the target position after the drop. You may make it do. If the lane change control is temporarily impossible, it may be possible to set in advance whether the control is continued until it becomes possible, or the control is given up and stopped. A drop area for canceling may be provided in case the user starts dragging by mistake or wants to cancel after dragging. You can cancel issuing commands by dragging your vehicle and dropping it in the drop area for cancellation.

  As described above, according to the present embodiment, various operation details can be transmitted to the automatic operation controller 20 by moving the icon displayed on the touch panel with a gesture. The gesture operation for moving the icon is a simple operation, and is released from conventional driving operations such as the driver turning the steering wheel 51 and depressing the accelerator pedal 53. For example, by displaying a schematic diagram including a plurality of lanes and a vehicle icon and moving the vehicle icon to another lane, it is possible to easily instruct the vehicle change. The driver can check the surrounding situation and perform operation instructions on the touch panel at the same time, so that the line of sight does not move. Therefore, the possibility of erroneous operation is reduced, and safer driving can be realized. In addition, in order to issue the lane change instruction command, an operation for linking the own vehicle icon and another lane other than the above operation may be performed. In addition, although the gesture operation corresponding to the control command has been described by drag and drop, touch and touch may be used. A predetermined gesture or operation may be used, but the driver may be able to customize it. In addition, an explanation, an icon, or an arrow may be displayed on the display unit 31, a guide may be displayed, or voice guidance may be given so that the correspondence between the gesture operation and the control command can be understood.

  The present invention has been described based on the embodiments. It is understood by those skilled in the art that these embodiments are exemplifications, and that various modifications can be made to combinations of the respective constituent elements and processing processes, and such modifications are also within the scope of the present invention. By the way.

  For example, the HMI controller 10 is assumed to be mounted by a dedicated LSI, but the function of the HMI controller 10 may be realized using a CPU in a mobile device such as a smartphone or a tablet used as the display device 30. In this case, the portable device used as the display device 30 and the automatic operation controller 20 are directly connected. Further, the function of the HMI controller 10 may be realized by a CPU in a head unit such as a car navigation device or display audio. In addition, a configuration in which a dedicated LSI on which the HMI controller 10 is mounted may be included in the head unit.

  The embodiment may be specified by the following items.

[Item 1]
An image output unit (14a) for outputting an image including a vehicle object representing the vehicle and a plurality of lanes to the display unit (31);
An operation signal input unit (14b) for receiving a user operation to move the vehicle object in the image displayed on the display unit (31) from the first lane to the second lane;
When the operation is accepted, a command output unit that outputs a command instructing to change the traveling lane of the host vehicle from the first lane to the second lane to the automatic driving control unit (20) that controls the automatic driving. (14c),
A driving support device (10) comprising:
Thereby, the operation which a user instruct | indicates a lane change can be performed intuitively and simply.
[Item 2]
When the other vehicle is traveling in the second lane, the image output unit (14a) outputs, to the display unit (31), an image including the other vehicle object representing the other vehicle in the second lane. ,
The command output unit (14c) changes the lane from the first lane to the front of the other vehicle in the second lane when the own vehicle object is moved before the other vehicle object in the second lane. When the own vehicle object is moved behind the object in the second lane, the other vehicle in the second lane from the first lane is output to the automatic operation control unit (20). The driving support device (10) according to item 1, wherein a command for instructing a lane change to the rear of the vehicle is output to the automatic driving control unit (20).
Thereby, when changing lanes, it can be intuitively and easily instructed whether to move in front of or behind the other vehicle.
[Item 3]
The command output unit (14c), when the host vehicle object is moved to the first lane within a predetermined time after the host vehicle object is moved to the second lane, from the first lane to the second lane. 3. The driving assistance device (10) according to item 1 or 2, wherein a command for canceling a command for changing the lane to a two-lane is output to the automatic driving control unit (20).
Thereby, the operation which cancels a lane change can be performed intuitively and simply.
[Item 4]
The command output unit (14c) sends a command for instructing the vehicle to turn right when the vehicle object is out of the plurality of lanes and moved to the right side of the plurality of lanes. And when the vehicle object is outside the plurality of lanes and on the left side of the plurality of lanes, a command for instructing the vehicle to turn left is output to the automatic driving control unit (20). The driving support apparatus (10) according to any one of items 1 to 3, characterized in that:
Thereby, the operation of turning right or turning left can be performed intuitively and easily.
[Item 5]
When the operation signal input unit (14b) receives a user operation indicating the own vehicle object in the image displayed on the display unit (31), the image output unit (14c) Any one of Items 1 to 4, wherein an image including at least one driving operation candidate object representing at least one driving operation candidate that can be executed by the host vehicle is output to the display unit (31). The driving assistance device (10) described in 1.
As a result, the user only needs to select the driving operation candidate object, and the user can perform the operation intuitively and easily, and can suppress erroneous operations.
[Item 6]
The image output unit (14a) outputs, to the display unit (31), an image including a trajectory from a position before the start of lane change of the own vehicle object to a position after the end of lane change. To 5. The driving support device (10) according to any one of claims 1 to 5.
Thereby, a user can be made to recognize the track of lane change.
[Item 7]
A display device (30) for displaying an image;
A driving support device (10) for outputting an image to the display device (30),
The driving assistance device (10)
An image output unit (14a) for outputting an image including a vehicle object representing the vehicle and a plurality of lanes to the display device (30);
An operation signal input unit (14b) for receiving a user operation to move the vehicle object in the image displayed on the display device (30) from the first lane to the second lane;
When the operation is accepted, a command output unit that outputs a command instructing to change the traveling lane of the host vehicle from the first lane to the second lane to the automatic driving control unit (20) that controls the automatic driving. (14c),
A driving support apparatus system (10, 30) characterized by comprising:
Thereby, the operation which a user instruct | indicates a lane change can be performed intuitively and simply.
[Item 8]
Outputting to the display unit (31) an image including a vehicle object representing the vehicle and a plurality of lanes;
Receiving a user operation to move the vehicle object in the image displayed on the display unit (31) from the first lane to the second lane;
When receiving the operation, outputting a command instructing to change the traveling lane of the host vehicle from the first lane to the second lane to an automatic driving control unit (20) that controls automatic driving;
A driving support method comprising:
Thereby, the operation which a user instruct | indicates a lane change can be performed intuitively and simply.
[Item 9]
A process of outputting an image including a vehicle object representing the vehicle and a plurality of lanes to the display unit (31);
A process of accepting a user operation to move the vehicle object in the image displayed on the display unit (31) from the first lane to the second lane;
When receiving the operation, a process of outputting a command for instructing to change the traveling lane of the host vehicle from the first lane to the second lane to an automatic driving control unit (20) that controls automatic driving;
A driving support program for causing a computer to execute.
Thereby, the operation which a user instruct | indicates a lane change can be performed intuitively and simply.
[Item 10]
An image output unit (14a) for outputting an image including a vehicle object representing the vehicle and a plurality of lanes to the display unit (31);
An operation signal input unit (14b) for receiving a user operation to move the vehicle object in the image displayed on the display unit (31) from the first lane to the second lane;
When receiving the operation, a command output unit (14c) that outputs a command instructing to change the traveling lane of the host vehicle from the first lane to the second lane;
An automatic operation control unit (20) for executing the output command;
An autonomous driving vehicle (1) comprising:
Thereby, the operation which a user instruct | indicates a lane change can be performed intuitively and simply.

  DESCRIPTION OF SYMBOLS 1 vehicle, 10 HMI controller, 11 determination part, 12 production | generation part, 13 instruction | indication part, 14 input / output part, 20 automatic operation controller, 21 control part, 22 memory | storage part, 23 input / output part, 30 display apparatus, 31 display part, 32 input unit, 40 detection unit, 41 position information acquisition unit, 42 sensor, 43 speed information acquisition unit, 44 map information acquisition unit, 50 driving operation unit, 51 steering, 52 brake pedal, 53 accelerator pedal, 54 winker switch.

  The present invention is applicable to a vehicle equipped with an automatic driving mode.

Claims (10)

An image output unit that outputs image information including a vehicle object representing the vehicle and a plurality of lanes to the display unit;
An operation signal input unit for receiving an operation signal of a user for moving the vehicle object in the image displayed on the display unit from the first lane to the second lane;
When the operation signal is received, a command output that outputs an automatic driving control command that instructs to change the traveling lane of the host vehicle from the first lane to the second lane to an automatic driving control unit that controls automatic driving. And
A driving support apparatus comprising: When the other vehicle is traveling in the second lane, the image output unit outputs image information including another vehicle object representing the other vehicle to the second lane on the display unit,
The command output unit instructs the lane change from the first lane to the front of the other vehicle in the second lane when the own vehicle object is moved before the other vehicle object in the second lane. When an automatic driving control command is output to the automatic driving control unit and the own vehicle object is moved behind the object in the second lane, the vehicle moves from the first lane to the rear of the other vehicle in the second lane. The driving support device according to claim 1, wherein an automatic driving control command for instructing a lane change is output to the automatic driving control unit.   The command output unit may change from the first lane to the second lane when the own vehicle object is moved to the first lane within a predetermined time after the own vehicle object is moved to the second lane. The driving support device according to claim 1 or 2, wherein a command for canceling an automatic driving control command instructing to change a lane is output to the automatic driving control unit.   The command output unit outputs a command instructing a right turn of the host vehicle to the automatic driving control unit when the host vehicle object is outside the plurality of lanes and moved to the right side of the plurality of lanes, The automatic driving control command for instructing a left turn of the own vehicle is output to the automatic driving control unit when the own vehicle object is outside the plurality of lanes and on the left side of the plurality of lanes. The driving support device according to any one of the above.   When the operation signal input unit accepts a user operation signal indicating the vehicle object in the image displayed on the display unit, the image output unit executes the vehicle based on the surrounding situation of the vehicle. The driving support device according to any one of claims 1 to 4, wherein image information including at least one driving operation candidate object representing at least one possible driving operation candidate is output to the display unit.   The driving according to any one of claims 1 to 5, wherein the image output unit outputs image information including a track from a position before the start of lane change to a position after the end of lane change of the own vehicle object to the display unit. Support device. A display device for displaying an image;
A driving support device that outputs image information to the display device,
The driving support device includes:
An image output unit that outputs image information including a vehicle object representing the vehicle and a plurality of lanes to the display device;
An operation signal input unit for receiving an operation signal of a user for moving the vehicle object in the image displayed on the display device from the first lane to the second lane;
When the operation signal is received, a command output that outputs an automatic driving control command that instructs to change the traveling lane of the host vehicle from the first lane to the second lane to an automatic driving control unit that controls automatic driving. And
Driving support system including. Outputting to the display unit image information including a vehicle object representing the vehicle and a plurality of lanes;
Receiving a user operation signal for moving the vehicle object in the image displayed on the display unit from the first lane to the second lane;
When receiving the operation signal, outputting an automatic driving control command instructing to change the traveling lane of the own vehicle from the first lane to the second lane to an automatic driving control unit that controls automatic driving; ,
A driving support method comprising: A process of outputting image information including a vehicle object representing the vehicle and a plurality of lanes to the display unit;
A process of receiving a user operation signal for moving the vehicle object in the image displayed on the display unit from the first lane to the second lane;
When receiving the operation signal, a process of outputting an automatic driving control command instructing to change the traveling lane of the own vehicle from the first lane to the second lane to an automatic driving control unit that controls automatic driving; ,
A driving support program that causes a computer to execute. An image output unit that outputs image information including a vehicle object representing the vehicle and a plurality of lanes to the display unit;
An operation signal input unit for receiving an operation signal of a user for moving the vehicle object in the image displayed on the display unit from the first lane to the second lane;
When receiving the operation signal, a command output unit that outputs an automatic driving control command instructing to change the traveling lane of the own vehicle from the first lane to the second lane;
An automatic operation control unit for executing the output command;
A self-driving vehicle comprising:

Images