JP2023144123A - display device - Google Patents

Abstract

To provide a display device that enables an operator to start a smooth manual operation when a traveling control mode of a mobile body transitions from an automatic operation mode to a manual operation mode.SOLUTION: A display device 10 comprises: a mode transition information acquisition unit that acquires mode transition information related to transition between traveling control modes which are control modes related to automatic traveling of a mobile body; and a display control unit that, when the mode transition information acquisition unit acquires mode transition information indicating that the traveling control mode of the mobile body is to transition, makes a display unit display a traveling landscape as viewed from the mobile body at a point that is expected to be passed after the traveling control mode has transitioned.SELECTED DRAWING: Figure 1

Description

The present invention relates to a display device, and for example, to a display device capable of displaying information to support a driver of a mobile object such as an automobile capable of self-driving.

2. Description of the Related Art Conventionally, there has been known a technology related to driving support that automatically performs driving operations related to traveling of a vehicle in place of a driver. For example, Patent Document 1 proposes a device that notifies a driver in advance of switching from automatic driving to manual driving (Patent Document 1).

Japanese Patent Application Publication No. 2017-30158

For example, in a mobile object such as a car that has the above-mentioned automatic driving function, there is a range from an automatic driving mode in which driving control is performed automatically to a driving control mode in which driving control is performed by the driver's operation. A switch to manual operation mode occurs. During this switch, the driver, who did not need to perform any maneuvering operations during automatic driving mode, suddenly finds himself in a situation where he is required to perform piloting operations when switching to manual driving mode. It will be destroyed. For this reason, one example of the problem is that it takes time for the driver to get used to manual steering operations, making it difficult to smoothly transition from automatic driving mode to manual driving mode.

The present invention has been made in view of the above-mentioned points. For example, when the travel control mode of a mobile object shifts from automatic driving mode to manual driving mode, the present invention allows the driver to smoothly start manual driving. The purpose is to provide a display device that enables

The invention according to claim 1 includes: a mode transition information acquisition section that acquires mode transition information regarding transition between travel control modes that are control modes related to automatic travel of the mobile body; a display control unit that, upon acquiring mode transition information indicating that the driving control mode will shift, causes a display unit to display a driving scene as seen from the mobile object at a point that is expected to be passed after the driving control mode is changed; A display device characterized by including:

1 is a perspective view of a front seat portion of an automobile equipped with a display device according to a first embodiment of the present invention. 1 is a block diagram showing an example of the configuration of a display device that is Example 1 of the present invention. FIG. This is an example of a simulation data group. FIG. 3 is a perspective view of the front seat portion of the automobile at the time of execution of the simulation. 1 is a flowchart of an operation routine of a display device according to a first embodiment of the present invention. FIG. 7 is a flowchart of an operation routine of a display device that is a modified example of the present invention.

In the following, preferred embodiments of the invention will be described. However, these may be modified and combined as appropriate. Further, in the following description and the accompanying drawings, substantially the same or equivalent parts are designated by the same reference numerals. In addition, in the following description, video will be explained as including moving images and still images. Furthermore, in the following description, an operation for controlling the travel of a vehicle, that is, an operation for steering, is also simply referred to as a steering operation.

EMBODIMENT OF THE INVENTION Below, the display apparatus 10 which is Example 1 of this invention is demonstrated with reference to an attached drawing. In the first embodiment, a case where the display device 10 is mounted on a car M as an example of a moving body will be described as an example.

FIG. 1 is a perspective view of a front seat portion of an automobile M as a moving object to which a display device 10 is attached, as viewed from inside the automobile M. FIG. 1 shows, as an installation example, a case where the display device 10 is installed near the center console of a dashboard DB in the front seat of an automobile M.

The camera 11 is a camera capable of photographing a passenger of the automobile M. The camera 11 is provided, for example, on the dashboard DB, and is oriented so as to be able to photograph the driver in the driver's seat. Note that the camera 11 only needs to be placed at a position where it can photograph the situation, such as the movement of the upper body of the passenger. For example, the camera 11 may be provided on the room mirror RM, or may be provided on the upper end of the windshield FG or the ceiling near the upper end.

The camera 11 is communicably connected to the display device 10 and can transmit signals of captured images to the display device 10.

The steering wheel 13 is a member that receives a steering operation for steering the automobile M. The steering wheel 13 is provided on the dashboard DB so as to be rotatable with respect to the dashboard DB. When the steering wheel 13 is rotated, the steered wheels of the automobile M operate accordingly.

In the automobile M of this embodiment, the amount of rotation, rotational force, etc. of the steering wheel 13 are detected by sensors (not shown), and control signals calculated based on the detection information of these sensors are sent to the wire harness. An example will be explained in which a so-called steer-by-wire system is used in which the steering angle of the steered wheels is transmitted to a steering control device such as a motor that controls the turning angle of the steered wheels. Detection information on the amount of rotation and rotational force of the steering wheel 13 detected by the sensor is transmitted to the display device 10.

The accelerator pedal 15 is provided under the foot of the driver's seat, and is a member that receives an operation related to control of a prime mover such as a driving engine or a motor of the automobile M by a depressing operation by the driver. That is, the accelerator pedal 15 is a member that receives control operations related to acceleration and deceleration of the automobile M.

In the automobile M of this embodiment, a sensor (not shown) detects the amount of movement and movement speed of the accelerator pedal 15, and a control signal calculated based on the detection information of these sensors is transmitted through the wire harness. An example will be explained in which a so-called throttle-by-wire system is used, in which the signal is transmitted to a prime mover control device, which is a control device that controls an engine or a motor, which is a prime mover. Detection information on the amount of movement and speed of movement of the accelerator pedal 15 detected by the sensor is transmitted to the display device 10.

The brake pedal 17 is provided under the foot of the driver's seat, and is a member that receives an operation related to controlling the brakes of the automobile M by a depressing operation by the driver. That is, the brake pedal 17 is a member that receives a control operation related to deceleration of the automobile M.

Note that in the automobile M of this embodiment, a sensor (not shown) detects the movement amount, movement speed, etc. of the brake pedal 17, and a control signal calculated based on the detection information of these sensors is transmitted through the wire harness. An example will be explained in which a so-called brake-by-wire system is used in which the information is transmitted to a brake control device that controls the brakes via the brake control device. Detection information on the amount of movement and speed of movement of the brake pedal detected by the sensor is transmitted to the display device 10.

As described above, the vehicle M of this embodiment has a so-called drive-by-wire system, which is a system consisting of a steering-by-wire system, a throttle-by-wire system, and a brake-by-wire system. .

In addition, hereinafter, the steering wheel 13, the accelerator pedal 15, and the brake pedal 17
Collectively, they are also referred to as a maneuver reception device that accepts maneuver operations including steering operations and acceleration/deceleration operations.

The GPS receiver 19 is a device that receives signals from GPS (Global Positioning System) satellites (GPS signals). The GPS receiver 19 is arranged, for example, on the dashboard DB. Note that the GPS receiver 19 may be placed anywhere as long as it can receive GPS signals. The GPS receiver 19 is communicably connected to the display device 10 and can transmit the received GPS signal to the display device 10.

The touch panel 21 is, for example, a touch panel monitor in which a display 21A such as a liquid crystal display capable of displaying images and a touch pad 21B are combined. The touch panel 21 is arranged, for example, on the center console of the dashboard DB. The touch panel 21 only needs to be placed in a place that is visible to the driver and within reach of the driver. For example, the touch panel 21 may be installed on the dashboard DB.

The display 21A is communicably connected to the display device 10 and can perform screen display under the control of the display device 10. Furthermore, the touch panel 21B can transmit a signal representing an input operation to the touch panel 21B received from the user to the display device 10.

The speaker 23 is provided, for example, on the indoor side of the A-pillar AP. The speaker 23 is communicably connected to the display device 10 and can emit sounds such as voices based on the control of the display device 10.

The projection device 25 is a device that constitutes a windshield projection type head-up display. The head-up display 25 is provided on the dashboard DB, and can project an image or video onto the windshield FG by irradiating the windshield FG with projection light.

The projection device 25 is communicably connected to the display device 10, and irradiates the display area AR, which is the area near the driver's seat of the windshield FG, with projection light based on the control of the display device 10. Screen display can be performed in the display area AR. Note that the projection device 25 may be able to perform screen display in an area other than the display area AR of the windshield FG. For example, the projection device 25 may be capable of displaying an image on the entire surface of the windshield FG.

[System configuration]
FIG. 2 shows the configuration of the display device 10. For example, the display device 10 is a device in which a mass storage device 33, a control section 35, an input section 37, an output section 39, and a data communication section 41 cooperate with each other via a system bus 31.

The mass storage device 33 is configured with, for example, a hard disk device, an SSD (solid state drive), a flash memory, etc., and stores various programs such as an operating system and software for a terminal.

Note that the various programs may be obtained, for example, from another server device or the like via a network, or may be recorded on a recording medium and read via various drive devices. That is, various programs stored in the mass storage device 33 (including programs for executing processing in the display device 10, which will be described later) can be transmitted via a network, and can also be stored as computer-readable records. It is possible to record it on a medium and transfer it.

A map information database (map information DB) 33A is constructed in the mass storage device 33. The map information database 33A holds map information including road maps. The map information database 33A may also include information on automatic driving areas, which are areas where the automobile M can travel automatically, and manual driving areas, which are areas where the automobile M cannot travel automatically. The automatic operation area and manual operation area may be defined by, for example, laws or regulations.

Furthermore, a simulation database (simulation DB) 33B is constructed in the mass storage device 33. The simulation database 33B includes information that enables driving simulation at a specific point or area on the road. The simulation database 33B includes, for example, a driving simulation at a point or area on the road that is closest to the boundary between the automatic driving area and the manual driving area and requires maneuvering operations including steering operations, acceleration/deceleration operations, or complex maneuvering operations. Contains information that allows For example, areas or points on a road that require maneuvering operations or complex maneuvering operations include curves, intersections, branches, merging, and the like.

FIG. 3 shows a simulation data group SD, which is an example of data included in the simulation database 33B. As shown in FIG. 3, in the simulation data group SD, for example, a road name and area to be simulated, and simulation data that is data for the simulation are linked to each data ID.

The simulation data includes, for example, scenery data for the simulation and appropriate operation amounts of the steering wheel 13, accelerator pedal 15, and brake pedal 17 in the simulation.

Referring to FIG. 2 again, the control unit 35 is comprised of a CPU (Central Processing Unit) 35A, a ROM (Read Only Memory) 35B, a RAM (Random Access Memory) 35C, and functions as a computer. The CPU 35A reads and executes various programs stored in the ROM 35B and the mass storage device 33, thereby realizing various functions.

The input unit 37 is an interface unit that communicably connects the display device 10 and the touch pad 21B. The display device 10 can receive, via the input unit 37, a signal indicating an input operation to the touch pad 21B.

The output unit 39 is communicably connected to the display 21A, the speaker 23, and the projection device 25, and transmits a video or image signal to the display 21A for display, and transmits an audio signal to the speaker 23 to output sound. It is possible to output. Further, the output unit 39 can transmit a video or image signal to the projection device 25 to display it on the windshield FG.

The data communication unit 41 is an interface unit that connects the display device 10, camera 11, and GPS receiver 19 in a communicable manner. Further, the data communication unit 41 is an interface unit that communicably connects the display device 10 and the steering sensor 13A, which is a sensor that detects physical quantities related to operations such as the amount of rotation and rotational force of the steering wheel 13.

Further, the data communication unit 41 is an interface unit that communicably connects the display device 10 and the accelerator sensor 15A, which is a sensor that detects physical quantities related to operations such as the amount of movement and the speed of movement of the accelerator pedal 15. Further, the data communication unit 41 is an interface unit that communicably connects the display device 10 and the brake sensor 17A, which is a sensor that detects physical quantities related to operations such as the amount of movement and the speed of movement of the brake pedal 15.

The display device 10 receives a video signal from the camera 11 via the data communication unit 41. The display device 10 can determine the line of sight of the driver of the automobile M from the video signal received via the data communication unit 41. The display device 10 receives a GPS signal from the GPS receiver 19 via the data communication unit 41. The display device 10 can acquire position information, which is information for specifying the position of the automobile M, from the GPS signal received via the data communication unit 41.

Furthermore, the display device 10 receives signals regarding physical quantities related to the operations of the steering handle 13, the accelerator pedal 15, and the brake pedal 17 from each of the steering sensor 13A, the accelerator sensor 15A, and the brake sensor 17A. The display device 10 can recognize operations on the steering wheel 13, the accelerator pedal 15, and the brake pedal 17 from signals regarding physical quantities received via the data communication unit 41. For example, the display device 10 can calculate the amount of operation of the steering wheel 13, the accelerator pedal 15, and the brake pedal 17.

Further, the data communication unit 41 also serves as an interface for communicably connecting the display device 10 and the travel control device VC of the automobile M in which the display device 10 is mounted. The driving control device VC is a device that controls driving of the automobile M.

In this embodiment, the travel control device VC performs manual driving control in which acceleration, deceleration, and steering are manually controlled, or partially automatic driving control in which only acceleration, deceleration, and steering are automatically controlled when the vehicle M is traveling. or fully automatic driving control, which automatically performs all driving controls including acceleration, deceleration, and steering.

In addition, the driving control mode when driving under manual driving control is manual driving mode, the driving control mode when driving under partially automatic driving control is partially automatic driving mode, and when driving under fully automatic driving control. The driving control mode when the vehicle is running is called the fully automatic driving mode. Hereinafter, among the partially automatic driving modes, a case where steering is automatically controlled will be referred to as a steering automatic driving mode, and a case where acceleration/deceleration is automatically controlled will be referred to as an acceleration/deceleration automatic driving mode.

For example, if we apply the above three driving controls to the level of automated driving defined by the Japanese government or the US National Highway Traffic Safety Administration (NHTSA), manual driving control is level 0, and partially automated driving control is level 0. 1 or 2, fully automatic driving control is level 3 or higher.

In this embodiment, the travel control device VC also determines whether the current travel control mode of the vehicle M is a manual driving mode, a partially automatic driving mode, that is, a steering automatic driving mode, an acceleration/deceleration automatic driving mode, or a fully automatic driving mode. The driving control mode information can be transmitted to the display device 10 via the data communication section 41.

Furthermore, when there is a plan to change the driving control mode, the driving control device VC can transmit mode transition information indicating the transition to the display device 10. The mode transition information may include information about the travel control mode after the transition. Note that the state of manual driving control in which all driving-related controls such as steering and acceleration/deceleration operations are performed manually by the driver is defined as automatic driving level 0.

Further, when there is a plan to change the driving control mode of the automobile M, the driving control device VC can transmit the plan to the display device 10 via the data communication unit 41. The travel control device VC may set the travel control mode of the automobile M to an automatic driving mode when the area in which the automobile M is traveling is an automatic driving area, and may set the driving control mode to a manual driving mode when the area where the automobile M is traveling is a manual driving area.

In this switching of the driving control mode, the driving control device VC may use a position specifying device such as a GPS device, map information, etc. that the driving control device VC has to determine the switching of the driving mode.

Further, the travel control device VC may receive position information from the display device 10 and refer to the map information database 33A of the display device 10 to determine switching of the driving control mode. Further, for example, the driving control device VC may determine whether to switch the driving control mode of the vehicle M depending on the situation around the vehicle M. Note that the display device 10 may determine by itself that there is a shift to the driving control mode based on the information in the map information database 33A and the GPS signal from the GPS receiver 19.

[Operation of display device]
The operation of the display device 10 will be described below. Display device 10 receives mode transition information from travel control device VC when there is a change in travel control mode. If this mode transition information is information indicating that at least either the steering or the acceleration/deceleration is switched from automatic control to manual control, the display device 10 causes the driver of the automobile M to perform a driving simulation. That is, the display device 10 allows the driver to perform a driving simulation when the travel control mode of the automobile M shifts to a mode in which the degree of dependence on the driver is higher for at least either steering or acceleration/deceleration.

Specifically, for example, the display device 10 uses the projection device 25 to display a driving scene for simulation. The driving scenery for this simulation may be a driving scenery in an actually existing place, or a driving scenery in a non-existent virtual place.

FIG. 4 is a diagram showing the front seat portion of the automobile M when a driving simulation is executed. As shown in FIG. 4, during the driving simulation, the driving scenery for the simulation is displayed in the display area AR of the windshield FG by the projection device 25. In the example of FIG. 4, the car M is actually running on a straight road, but the simulation shows a case where it is running on a left curve. Further, as an example, a case is shown in which the driver turns the steering wheel 13 to the left in accordance with the driving scenery for simulation.

The display device 10 changes the driving scenery based on the signals from the steering sensor 13A, the accelerator sensor 15A, and the brake sensor 17A while displaying the driving scenery for the simulation. That is, the display device 10 functions as a drive simulator that uses the display area AR as a screen and uses the steering wheel 13, accelerator pedal 15, and brake pedal 17 as controls.

Further, the display device 10 may determine whether or not the driver's operations on the steering wheel 13, accelerator pedal 15, and brake pedal 17 are appropriate while displaying the driving scenery for the simulation. This determination result can be displayed on the display 21 or the display area AR to notify the driver. Further, the driver may be notified of this determination result by audio from the speaker 23.

Further, the display device 10 may determine whether the direction of the driver's line of sight is appropriate while displaying the driving scenery for the simulation. The driver may be notified of this determination result by displaying it on the display 21 or the display area AR, for example. Further, the driver may be notified of this determination result by audio from the speaker 23. Note that the display device 10 can also suggest an appropriate line of sight direction to the driver by displaying it on the display area AR using the projection device 25.

Note that when the display device 10 receives the mode transition information, even if the mode transition information is information indicating that at least one of steering or acceleration/deceleration is switched from manual control to automatic control, The driver may be allowed to perform a driving simulation. That is, when the driving control mode changes, the display device 10 may cause the driver to perform a driving simulation regardless of the manner of the change. For example, the display device 10 may allow the driver to perform a driving simulation even when the driving control mode shifts to a mode in which the driving control is less dependent on the driver.

As mentioned above, the car M employs a drive-by-wire system as an example, and the operations on the steering wheel 13, accelerator pedal 15, and brake pedal 17 during the driving simulation are not the same as the actual driving control of the car. It is possible to separate it. Specifically, by preventing signals from each maneuver receiving device from reaching the steering control device, prime mover control device, and brake control device, operations on the maneuver receiving device are separated from actual driving control. .

In the above description, the display device 10 receives the mode transition information from the cruise control device VC, but the display device 10 may determine whether there is a transition of the cruise control mode. Specifically, for example, the display device 10 may determine whether there is a shift in travel control mode based on the GPS information and the map information database 33A, and may generate and acquire mode shift information itself.

[Example operation routine of display device 10]
An example of the operation routine of the display device 10 will be described below.

FIG. 5 is a diagram showing a simulation operation routine R1 as an example of an operation routine. The simulation operation routine R1 is repeatedly executed, for example, when the display device 10 is powered on. For example, the simulation operation routine R1 is repeatedly executed when the accessory power source (hereinafter referred to as ACC power source) of the automobile M is turned on.

When the simulation operation routine R1 is started, the control unit 35 first waits for reception from the travel control device VC (step S1). Next, the control unit 35 determines whether mode transition information has been received from the travel control device VC (step S2). In step S1 and step S2, the control unit 35 functions as a mode transition information acquisition unit.

In step S2, when it is determined that the mode transition information has been received from the travel control device VC (step S2: YES), the control unit 35 changes the control of at least one of steering or acceleration/deceleration from automatic to automatic due to the mode transition. It is determined whether to shift to manual mode (step S3). In step S2, if it is determined that mode transition information has not been received from the cruise control device VC (step S2: NO), the routine ends.

In step S3, when it is determined that control of at least one of steering or acceleration/deceleration will shift from automatic to manual (step S3: YES), the control unit 35 waits for a first predetermined period of time (for example, 10 minutes) until the mode transition. It is determined whether or not the value is within the range (step S4). In step S3, if it is determined that control of at least one of steering or acceleration/deceleration does not shift from automatic to manual (step S3: NO), the routine ends.

In step S4, if it is determined that it is within the first predetermined time until the mode transition (step S4: YES), the control unit 35 reads arbitrary simulation data from the simulation database 33A and starts the driving simulation ( Step S5). In this driving simulation, the control unit 35 causes the projection device 25 to display a driving scene based on the driving operation by the driver in the display area AR.

In step S4, if it is determined that the mode transition is not within the first predetermined time (step S4: NO), the control unit 35 determines that it is still too early to start the driving simulation and waits for a certain period of time. After that, step S4 is executed again.

After starting the driving simulation in step S5, the control unit 35 determines whether or not the driver's operation is appropriate in step S6. This determination is to determine whether the amount of operation of the steering wheel 13, accelerator pedal 15, and brake pedal 17 by the driver during a certain period of time (for example, several seconds) is within the range specified by the simulation data. It may be done in

Note that the determination made in step S6 may be made only regarding operations that become manual after the mode transition. For example, if only the steering becomes manual control after the mode transition, only the operation of the steering wheel 13 may be determined. Furthermore, for example, if only acceleration and deceleration are under manual control after the mode transition, only the operations of the accelerator pedal 15 and the brake pedal 17 may be determined. In step S6, the control section 35 functions as a determination section.

In step S6, if it is determined that the operation by the driver is appropriate (step S6: YES), the control unit 35 determines whether or not it is within a second predetermined time (for example, 30 seconds) until the driving mode transition. (Step S7).

If it is determined in step S6 that the operation by the driver is not appropriate (step S6: NO), the control unit 35 notifies the driver that the operation is not appropriate (step S8). Specifically, for example, the control unit 35 displays a warning on the display 21A, displays a warning on the display area AR using the projection device 25, or issues an audio warning using the speaker 23 to alert the driver. may be notified. After executing step S8, the control unit 35 executes step S7.

If it is determined in step S7 that it is within the second predetermined time until switching (step S7: YES), the control unit 35 ends the simulation (step S9), and then the routine R1 ends. In step S7, if it is determined that it is not within the second predetermined time until switching (step S7: NO), the control unit 35 continues the simulation, and step S6 is executed again. In step S6-9, the control section 35 functions as a display control section. Note that the driving simulation may be interrupted by the driver's operation on the touch pad 21B.

Note that, for safety reasons, during execution of the driving simulation, the steering operation to the maneuver reception device or the operation of the maneuver reception device is separated from the actual driving control of the automobile, and is not used for driving control of the automobile M. Specifically, for example, during execution of a driving simulation, an electric signal corresponding to the operation of the maneuver receiving device may not be transmitted.

According to the display device 10 of the first embodiment, the driver can simulate the driving operation in advance when transitioning to the driving control mode in which at least one of the driving operations is changed from automatic to manual. Therefore, at the time of transition to the travel control mode, the driver can smoothly enter the driving operation.

Furthermore, according to the display device of the first embodiment, in the simulation, if the driver's steering operation is inappropriate, the driver is notified of this fact. That is, feedback is given to the driver regarding the appropriateness of the steering operation. Therefore, it becomes possible for the driver himself to be aware that he has a feeling regarding inappropriate driving. This allows the driver to perform more appropriate steering operations during manual driving.

[Modified example]
Modifications of the display device 10 will be described below. In the first embodiment, an example has been described in which the display device 10 reads out arbitrary simulation data and performs a driving simulation when the driving control mode of the automobile M shifts. However, before the travel control mode of the vehicle M shifts, the display device 10 may perform a driving simulation in a region or point where the vehicle M is expected to pass after the shift.

Specifically, for example, before the driving control mode of the vehicle M shifts, the display device 10 indicates that the vehicle M requires a steering operation including a steering operation and an acceleration/deceleration operation, or a complicated maneuvering operation for the first time after the transition. A driving simulation may be performed by displaying a driving scene in an expected area or point. As described above, the area or point where the maneuvering operation or the complicated maneuvering operation is required (hereinafter also simply referred to as a maneuvering required area) is, for example, a curve, an intersection, a confluence, a branch, or the like.

In this case, the display device 10 specifies, based on the map information database 33A, the first maneuver-required region to be passed through after the transition to the travel control mode. Then, the simulation database 33B is searched to see if there is simulation data for the region requiring the maneuver. If there is simulation data for the region that requires maneuvering through first, a driving simulation is performed based on this data.

If the simulation data for the first maneuver-required region is not found in the simulation database 33B, after the travel control mode transition, the simulation data for the second and subsequent maneuver-required regions are sequentially searched for. Driving simulation may be performed based on simulation data. Alternatively, simulation data of the first maneuver required area may be generated based on the map information in the map information database 33A, and a driving simulation may be performed based on the generated simulation data.

Referring to FIG. 6, an operation routine R2, which is an example of an operation routine of a modified example of the display device 10, will be described. The operation routine R2 is the same as the operation routine R1 except that a process is added between steps S3 and S4 of the operation routine R1. Therefore, description of parts other than the additional processing will be omitted.

In the operation routine R2, when it is determined in step S3 that control of at least one of steering or acceleration/deceleration will shift from automatic to manual (step S3: YES), the control unit 35 first controls the control after the shift of the travel control mode. It is determined whether simulation data of a region requiring maneuver that passes through is present in the simulation database 33B (step S3-1).

In step S3-1, if it is determined that the simulation data of the first maneuver required area is in the simulation database 33B (step S3-1: YES), the control unit 35 imports the simulation data from the simulation database 33B. Obtain (step S3-2).

In step S3-1, if it is determined that there is no simulation data of the first maneuver required area in the simulation database 33B (step S3-1: NO), the control unit 35 controls the first maneuver required area. Simulation data is generated (step S3-3). This simulation data may be generated, for example, based on map information in the map information database 33A.

For example, if the first area requiring maneuvering is an intersection, new simulation data may be generated by generating scenery data based on the shape of the intersection. Note that instead of generating new simulation data, simulation data of an intersection having a shape similar to the shape of the intersection may be obtained from the simulation database 33B and used instead.

In the process of operation routine R2, in step S4, the simulation data acquired in step S3-2 or the simulation data generated in step S3-3 is used to determine the first maneuvering required area after transition to the travel control mode. Driving simulation starts.

According to the display device 10 of the modified example, when transitioning to a cruise control mode in which at least one of the steering operations is changed from automatic to manual, the driver predicts in advance that it will actually be required after the transition of the cruise control mode. It is possible to perform simulations of driving operations. Therefore, at the time of transition to the driving control mode, the driver can smoothly and safely enter into driving-related maneuvering operations. Such a simulation is particularly effective for drivers who are driving in the above-mentioned maneuver-required region for the first time or for drivers with little driving experience, in order to enable smooth maneuvering operations related to safe driving.

In the above embodiment, the display device 10 displays a driving scene that changes based on the operation of the steering wheel 13, accelerator pedal 15, and brake pedal 17 by the driver during a driving simulation. However, the display device 10 may simply display the driving scenery during the driving simulation.

For example, specifically, the display device 10 may simply display a driving scene when the vehicle appropriately travels along a road at a constant speed through the simulation target area. Further, the display device 10 may display a driving scene when the vehicle appropriately travels along a road in a manner in which the speed changes based on the operation of the accelerator pedal 15 and the brake pedal 17. When performing such a simulation, it may be determined whether or not the steering wheel 13 is being operated appropriately according to the driving scenery.

In the above embodiment, an example in which the display device 10 is mounted on the automobile M has been described. However, the display device 10 can be applied to various other moving objects that can be operated automatically and that require a driver to operate, such as ships, aircraft, motorcycles, monorails, linear motor cars, etc. It is applicable.

The configuration, routine, data format, etc. of the display device 10 in the embodiments described above are merely illustrative, and can be appropriately selected or changed depending on the purpose and the like.

10 Display device 13 Steering wheel 15 Accelerator pedal 17 Brake pedal 21 Touch panel 25 Projection device 31 System bus 33 Mass storage device 35 Control unit

Claims (1)

a mode transition information acquisition unit that acquires mode transition information regarding transition between driving control modes that are control modes related to automatic driving of a mobile body;
When the mode transition information acquisition unit acquires mode transition information indicating that the travel control mode of the mobile object will change, the mode transition information acquisition unit acquires the driving scenery as seen from the mobile object at a point that is expected to be passed after the travel control mode is changed. a display control unit for displaying information on a display unit;
A display device comprising:

Images