WO2019239709A1

WO2019239709A1 - Moving body display control device, moving body display control method, and control program

Info

Publication number: WO2019239709A1
Application number: PCT/JP2019/016112
Authority: WO
Inventors: 靖作間
Original assignee: 株式会社デンソー
Priority date: 2018-06-12
Filing date: 2019-04-15
Publication date: 2019-12-19
Also published as: JP2019214273A; JP7024619B2

Abstract

Provided is a moving body display control device that controls a heads-up display device, the moving body display control device comprising: a determination information acquisition unit (201) that acquires content determination information that is information for determining content of an image drawn on a display unit; and drawing control units (211, 213) that draw an image on the display unit according to the content determination information that is acquired by the determination information acquisition unit. The drawing control units draw a moving attribute image that changes position according to a foreground object to be displayed overlaid and a fixed attribute image of which position is fixed regardless of the foreground which are divided into different layers on one display unit.

Description

MOBILE BODY DISPLAY CONTROL DEVICE, MOBILE BODY DISPLAY CONTROL METHOD, AND CONTROL PROGRAM

Cross-reference of related applications

This application is based on Japanese Patent Application No. 2018-112068 filed on June 12, 2018, the contents of which are incorporated herein by reference.

The present disclosure relates to a moving body display control device, a moving body display control method, and a control program.

2. Description of the Related Art A head-up display (hereinafter referred to as “HUD”) that displays a virtual image superimposed on a foreground of a vehicle by projecting an image onto a projection member such as a windshield is known. For example, Patent Document 1 discloses display of movement attributes such as a right turn mark displayed at an intersection position and a pedestrian warning mark displayed at a detected pedestrian position for display items to be projected on a predetermined area of a windshield. It is disclosed that an item image and an image of a fixed attribute display item such as speedometer information representing vehicle speed and tachometer information representing engine rotation speed can be displayed simultaneously.

JP 2018-22105 A

When displaying both the moving attribute display item image and the fixed attribute display item image at the same time, both images are mixed, reducing the visibility of both the moving attribute display item and the fixed attribute display item. There is a risk that.

The present disclosure projects a moving attribute display item image and a fixed attribute display item image onto a common projection member when a virtual image is superimposed on the foreground of the moving object by projecting the image onto the projection member. Even if both virtual images are displayed on the foreground of the moving object in combination, the display control device for moving object, the display control method for moving object, and the control program that suppress the deterioration of the visibility of both virtual images The purpose is to provide.

According to one aspect of the present disclosure, a display control apparatus for a moving body is used in a moving body, and a head-up display that superimposes and displays a virtual image on the foreground of the moving body by projecting an image drawn on the display onto a projection member. Control the device. The moving body display control device includes a determination information acquisition unit that acquires information for determining content, which is information for determining the content of an image to be drawn on a display, and content determination information acquired by the determination information acquisition unit. And a drawing control unit for drawing an image on the display. The drawing control unit divides the moving attribute image whose position is changed according to the object in the foreground to be superimposed and the fixed attribute image whose position is fixed regardless of the foreground into different layers on one display device. draw.

According to another aspect of the present disclosure, a moving body display control method is used in a moving body, and a head-up that superimposes and displays a virtual image on the foreground of a moving body by projecting an image to be drawn on a display onto a projection member. Control the display device. When the mobile object display control method acquires content determination information that is information for determining the content of an image to be drawn on the display, and draws an image on the display according to the content determination information to be acquired, The moving attribute image whose position is changed according to the object in the foreground to be superimposed and the fixed attribute image whose position is fixed regardless of the foreground are divided into different layers and drawn on one display.

According to another aspect of the present disclosure, a control program is used in a moving body, and a head-up display that superimposes a virtual image on the foreground of the moving body by projecting an image to be drawn on the display onto a projection member. An information acquisition unit for determining content determination information that is information for determining the content of an image to be drawn on the display of the device, and an image on the display according to the information for content determination acquired by the information acquisition unit for determination When drawing an image, a moving attribute image whose position is changed according to the object in the foreground to be superimposed and a fixed attribute image whose position is fixed regardless of the foreground are divided into different layers, and one display Function as a drawing control unit for drawing.

According to the present disclosure, when an image is drawn on a display of a head-up display device that superimposes a virtual image on a foreground of a moving object by projecting the image to be drawn on the display onto a projection member, A moving attribute image whose position is changed according to the target and a fixed attribute image whose position is fixed regardless of the foreground are divided into different layers and drawn on one display. Therefore, even when a virtual image of a moving attribute image and a fixed attribute image is displayed in combination on the foreground of the moving object, both can be displayed separately. Therefore, it is possible to suppress a reduction in both visibility due to a mixture of both virtual images. As a result, when the virtual image is superimposed on the foreground of the moving object by projecting the image onto the projection member, the image of the display item with the movement attribute and the image of the display item with the fixed attribute are projected onto the common projection member. Even when both virtual images are displayed in combination on the foreground of the moving object, it is possible to suppress a reduction in the visibility of both virtual images.

The above and other objects, features, and advantages of the present disclosure will become more apparent from the following detailed description with reference to the accompanying drawings. In the accompanying drawings,
It is a figure which shows an example of a schematic structure of a mobile body system. It is a figure which shows the example of mounting to a vehicle of a HUD apparatus. It is a figure which shows an example of a schematic structure of HCU. It is a figure for demonstrating an example of the display by the display control in a display control block when emergency information is not included in a movement attribute display. It is a figure for demonstrating an example of the display by the display control in a display control block when emergency information is not included in a movement attribute display. It is a figure for demonstrating an example of the display by the display control in a display control block when emergency information is not included in a movement attribute display. It is a figure for demonstrating an example of the display by the display control in a display control block in case emergency information is included in a movement attribute display. It is a figure for demonstrating an example of the display by the display control in a display control block in case emergency information is included in a movement attribute display. It is a figure for demonstrating an example of the display by the display control in a display control block in case emergency information is included in a movement attribute display. It is a flowchart which shows an example of the flow of the virtual image display control related processing in HCU.

A plurality of embodiments for disclosure will be described with reference to the drawings. For convenience of explanation, among the embodiments, parts having the same functions as those shown in the drawings used in the explanation so far may be given the same reference numerals and explanation thereof may be omitted. is there. For the parts denoted by the same reference numerals, the description in other embodiments can be referred to.

(Embodiment 1)
(Schematic configuration of mobile system 1)
Hereinafter, the present embodiment will be described with reference to the drawings. The mobile body system 1 is used in mobile bodies such as vehicles, ships, and aircraft. In the present embodiment, the following description will be given by giving an example of application to a vehicle such as an automobile.

A mobile system 1 shown in FIG. 1 is used in a vehicle, and includes an HMI (Human Machine Interface) system 2, an ADAS (Advanced Driver Assistant Systems) locator 3, a peripheral monitoring sensor 4, a vehicle state sensor 5, and a vehicle control ECU 6. , Navigation device 7 and automatic operation ECU 8 are included. It is assumed that the HMI system 2, the ADAS locator 3, the periphery monitoring sensor 4, the vehicle state sensor 5, the vehicle control ECU 6, the navigation device 7, and the automatic driving ECU 8 are connected to the in-vehicle LAN, for example.

The ADAS locator 3 includes a GNSS (Global Navigation Satellite System) receiver and an inertial sensor. The GNSS receiver receives positioning signals from a plurality of artificial satellites. The inertial sensor includes, for example, a gyro sensor and an acceleration sensor. The ADAS locator 3 sequentially measures the position of the vehicle by combining the positioning signal received by the GNSS receiver and the measurement result of the inertial sensor. The vehicle position may be measured using a travel distance obtained from detection results sequentially output from a vehicle speed sensor mounted on the host vehicle. And the measured vehicle position is output to in-vehicle LAN.

The ADAS locator 3 may include a map database (hereinafter referred to as a map DB) that stores a three-dimensional map made up of point shapes of road shapes and structure feature points as map data. When this 3D map is used, the ADAS locator 3 does not use a GNSS receiver, but detects this 3D map and the road shape and the point cloud of the feature points of the structure LIDAR (Light Detection and Ranging / Laser Imaging It is good also as a structure which pinpoints the vehicle position of the own vehicle using the detection results in the periphery monitoring sensors 4 such as Detection (Randing). The map data of the three-dimensional map may be obtained from the outside of the own vehicle via the communication module.

The surrounding monitoring sensor 4 is an autonomous sensor that monitors the surrounding environment of the vehicle. As an example, the periphery monitoring sensor 4 is a stationary static object such as a pedestrian, a non-human animal, a moving dynamic target such as a vehicle other than the own vehicle, and a fallen object on the road, a guardrail, a curb, and a tree. Detect obstacles around the vehicle such as target. In addition, road markings such as travel lane markings around the vehicle are detected. The surrounding monitoring sensor 4 is, for example, a surrounding monitoring camera that captures a predetermined range around the host vehicle, a millimeter wave radar, a sonar, a LIDAR, or the like that transmits an exploration wave to the predetermined range around the host vehicle. The peripheral monitoring camera sequentially outputs captured images that are sequentially captured to the in-vehicle LAN as sensing information. A sensor that transmits an exploration wave such as sonar, millimeter wave radar, or LIDAR sequentially outputs a scanning result based on a reception signal obtained when a reflected wave reflected by a detection target is received to the in-vehicle LAN as sensing information.

It is preferable that the periphery monitoring sensor 4 includes an illuminance sensor (hereinafter referred to as a front illuminance sensor) 41 that detects the illuminance in front of the vehicle. Here, an example in which illuminance is used as an index of brightness is shown, but the present invention is not necessarily limited thereto, and a configuration using an index other than illuminance may be employed. Note that the brightness in front of the host vehicle may be detected from a front image of a front camera that captures a predetermined range in front of the host vehicle of the peripheral monitoring cameras.

The vehicle state sensor 5 is a sensor group for detecting various states of the host vehicle. The vehicle state sensor 5 includes a vehicle speed sensor that detects the vehicle speed of the host vehicle, a steering sensor that detects the steering angle of the host vehicle, an accelerator position sensor that detects the opening degree of the accelerator pedal of the host vehicle, and a depression of the brake pedal of the host vehicle. There are brake pedal force sensors that detect the amount. The vehicle state sensor 5 outputs sensing information to be detected to the in-vehicle LAN. The sensing information detected by the vehicle state sensor 5 may be configured to be output to the in-vehicle LAN via an ECU mounted on the own vehicle.

It is preferable that the vehicle state sensor 5 includes an illuminance sensor (hereinafter referred to as an indoor illuminance sensor) 51 that detects the illuminance in the room of the host vehicle or a height sensor 52. Here, an example in which illuminance is used as an index of brightness has been shown, but the present invention is not necessarily limited thereto, and a configuration using an index other than illuminance may be employed.

The height sensor 52 is a sensor that detects the height of the host vehicle. The height sensor 52 is provided, for example, in the vicinity of each wheel of the host vehicle, and measures the amount of sinking with respect to the vehicle body for each wheel that is displaced up and down by the operation of the suspension device. The height sensor 52 sequentially outputs measurement data obtained by measuring the amount of depression of each wheel. That is, the height sensor 52 sequentially outputs information indicating the pitching state of the own vehicle (hereinafter, pitching information). Pitching is a rotational motion like the behavior of a seesaw with the left-right direction of the host vehicle as an axis, and can be rephrased as a longitudinal motion. The height sensor 52 may be configured to directly measure the distance from the vehicle body to the road surface as posture change information using ultrasonic waves or laser light irradiated from the vehicle body toward the road surface.

The vehicle control ECU 6 is an electronic control device that performs acceleration / deceleration control and / or steering control of the host vehicle. The vehicle control ECU 6 includes a steering ECU that performs steering control, a power unit control ECU that performs acceleration / deceleration control, a brake ECU, and the like. The vehicle control ECU 6 obtains detection signals output from sensors such as an accelerator position sensor, a brake pedal force sensor, a rudder angle sensor, and a wheel speed sensor mounted on the host vehicle, and performs electronic control throttle, brake actuator, EPS (Electric Power Steering) Outputs control signals to each travel control device such as a motor. The vehicle control ECU 6 can output the detection signals of the above-described sensors to the in-vehicle LAN.

The navigation device 7 includes a map DB storing map data, searches for a route that satisfies conditions such as time priority and distance priority to a set destination, and performs route guidance according to the searched route. The map DB may be a non-volatile memory that stores map data such as link data, segment data, node data, and road shapes. Note that the map data may include a three-dimensional map including a road shape and a point group of feature points of the structure.

The automatic driving ECU 8 controls the vehicle control ECU 6 to execute an automatic driving function for performing a driving operation by the driver. The autonomous driving ECU 8 travels based on the vehicle position and three-dimensional map data acquired from the ADAS locator 3, sensing information from the surrounding monitoring sensor 4, and map data acquired from the navigation device 7. Recognize the environment. As an example, the shape and movement state of an object around the own vehicle are recognized from the sensing information of the surrounding monitoring sensor 4, or the shape of a road marking around the own vehicle is recognized. Then, by combining with the vehicle position of the own vehicle and the map data, a virtual space in which the actual traveling environment is reproduced in three dimensions is generated.

The automatic driving ECU 8 generates a driving plan for automatically driving the vehicle by the automatic driving function based on the recognized driving environment. As the travel plan, a long-term travel plan and a short-term travel plan are generated. In the long-term driving plan, a route for directing the vehicle to a set destination is defined. About the long-term driving plan, it is good also as a structure using the route searched with the navigation apparatus 7. FIG. In the short-term travel plan, a planned travel locus for realizing travel according to the long-term travel plan is defined using the generated virtual space around the vehicle. Specifically, execution of steering for lane tracking and lane change, acceleration / deceleration for speed adjustment, and sudden braking for collision avoidance is determined based on a short-term travel plan.

The HMI system 2 includes an HCU (Human Machine Interface Control Unit) 20, an operation device 21, and a display device 22. The HMI system 2 accepts an input operation from a driver who is a user of the own vehicle or is directed toward the driver of the own vehicle. To present information. The operation device 21 is a switch group operated by the driver of the own vehicle. The operation device 21 is used for performing various settings. For example, the operation device 21 includes a steering switch provided in a spoke spoke portion of the own vehicle. A head-up display (HUD) device 220 is used as the display device 22. Here, the HUD device 220 will be described with reference to FIG.

As shown in FIG. 2, the HUD device 220 is provided on the instrument panel 12 of the own vehicle, and includes a display 221, a plane mirror 222, and a concave mirror 223. The HUD device 220 projects an image on the front windshield 10 under the control of the HCU 20. The HUD device 220 projects a display image formed by the display unit 221 onto a projection area defined on the front windshield 10 as a projection member through an optical system such as a plane mirror 222 and a concave mirror 223. More specifically, an image displayed on the display 221 (that is, a display image) is reflected by the plane mirror 222, then enlarged by the concave mirror 223, and projected onto a projection area defined on the front windshield 10. . The projection area is assumed to be located in front of the driver's seat, for example. The display 221 is, for example, a TFT liquid crystal panel, and outputs light of a display image drawn on the liquid crystal panel by transmitting light from the backlight.

The luminous flux of the display image reflected on the vehicle interior side by the front windshield 10 is perceived by the driver sitting in the driver's seat. Further, the light flux from the foreground as the scenery existing in front of the own vehicle that is transmitted through the front windshield 10 formed of translucent glass is also perceived by the driver sitting in the driver's seat. As a result, the driver can visually recognize the virtual image 100 of the display image formed in front of the front windshield 10 with a part of the foreground. That is, the HUD device 220 superimposes and displays the virtual image 100 on the foreground of the host vehicle to realize a so-called AR (Augmented Reality) display. As the display image, there are a moving attribute image whose position is changed in accordance with a target in the foreground to be superimposed and a fixed attribute image whose position is fixed regardless of the foreground.

In the present embodiment, by tilting the display 221 with respect to the optical system such as the flat mirror 222 and the concave mirror 223, the virtual image 100 is displayed so that the upper side of the virtual image 100 can be seen more distally than the lower side when viewed from the driver. A description will be given by taking as an example a case where the vehicle is tilted in the front-rear direction of the vehicle. This eliminates the use of two indicators: a display for displaying the virtual image 100 so as to be visible on the proximal side of the driver and a display for displaying the virtual image 100 so as to be visible on the distal side of the driver. However, the virtual image 100 can be easily viewed as being displayed from the proximal side to the distal side. Note that the present invention is not necessarily limited to this configuration, and the virtual image 100 may be displayed without being tilted in the front-rear direction of the host vehicle.

In the present embodiment, the following description is given by taking the case where the display 221 is a TFT liquid crystal panel as an example, but the present invention is not necessarily limited thereto. For example, as long as a display image can be drawn, another type of display device may be used, and the optical system is not limited to the above-described one, such as using a reflective screen instead of the flat mirror 222. The projection member on which the HUD device 220 projects the display image is not limited to the front windshield 10 and may be a light-transmitting combiner. In addition to the HUD device 220, a device that displays an image may be used as the display device 22. Examples include a combination meter display, CID (Center Information Display), and the like.

The HCU 20 is configured mainly by a microcomputer including a processor, a volatile memory, a nonvolatile memory, an I / O, and a bus for connecting them, and is connected to the HUD device 220. The HCU 20 controls display on the HUD device 220 by executing a control program stored in the nonvolatile memory. The HCU 20 corresponds to a moving body display control device. Executing this control program by the processor corresponds to executing a display control method for a moving body corresponding to the control program. The memory is a non-transitory storage medium that stores computer-readable programs and data in a non-transitory manner. The non-transitional tangible storage medium is realized by a semiconductor memory or a magnetic disk. The configuration of the HCU 20 relating to display control by the HUD device 220 will be described in detail below.

(Schematic configuration of HCU20)
Here, a schematic configuration of the HCU 20 will be described with reference to FIG. As shown in FIG. 3, the HCU 20 includes an information processing block 200 and a display control block 210 as functional blocks regarding display control in the HUD device 220. Note that some or all of the functions executed by the HCU 20 may be configured by hardware using one or a plurality of ICs. Also, some or all of the functional blocks provided in the HCU 20 may be realized by a combination of execution of software by a processor and hardware members.

The information processing block 200 selectively acquires information necessary for display control in the display control block 210 among various information output to the in-vehicle LAN. In addition, the information processing block 200 performs processing for converting the acquired information into a state suitable for display control. As illustrated in FIG. 3, the information processing block 200 includes a determination information acquisition unit 201, a room brightness acquisition unit 202, a front brightness acquisition unit 203, and a pitching information acquisition unit 204 as sub function blocks.

The determination information acquisition unit 201 acquires information necessary for determining the contents to be displayed on the HUD device 220. In other words, information for determining the content of the image drawn on the display 221 of the HUD device 220 (hereinafter, content determination information) is acquired. As an example of the content determination information, the vehicle position output from the ADAS locator 3, the route searched by the navigation device 7, the map data stored in the map DB, the traveling environment recognized by the automatic driving ECU 8, the automatic driving ECU 8 There are a travel plan to be generated, sensing information in the vehicle state sensor 5, operation input information in the operation device 21, setting of an automatic driving function in the automatic driving ECU 8, operation information, and the like.

If the vehicle is equipped with devices that monitor the driver, such as a device that detects the direction of the driver's line of sight, a sensor that detects whether the driver of the vehicle is holding the steering wheel, It is good also as a structure which the information acquisition part 201 for determination acquires the monitoring result of the driver in an apparatus as information for content determination.

The indoor brightness acquisition unit 202 acquires the illuminance of the vehicle interior detected by the indoor illuminance sensor 51. The front brightness acquisition unit 203 acquires the front illuminance detected by the front illuminance sensor 41. The pitching information acquisition unit 204 acquires pitching information that is sequentially acquired from the height sensor 52 and indicates the pitching state of the vehicle.

The display control block 210 controls the display on the HUD device 220 based on the information acquired by the information processing block 200. As illustrated in FIG. 3, the display control block 210 includes a first drawing control unit 211, a second drawing control unit 213, and an arbitration synthesis processing unit 216 as sub function blocks.

The first drawing control unit 211 and the second drawing control unit 213 generate image data of a display image to be drawn on the display 221 of the HUD device 220 based on information acquired by the information processing block 200. The first drawing control unit 211 and the second drawing control unit 213 correspond to a drawing control unit. The first drawing control unit 211 and the second drawing control unit 213 draw the display image on the display unit 221 by outputting the generated image data to the display unit 221. The first drawing control unit 211 and the second drawing control unit 213 change the content and arrangement mode of the display image according to the content determination information acquired by the determination information acquisition unit 201. Hereinafter, a display image belonging to the fixed attribute image is referred to as a fixed attribute display, and a display image belonging to the movement attribute image is referred to as a movement attribute display.

The first drawing control unit 211 generates fixed attribute display image data based on information for fixed attribute display in the information acquired by the information processing block 200. The second drawing control unit 213 generates image data for movement attribute display based on the information for movement attribute display in the information acquired by the information processing block 200. That is, the first drawing control unit 211 draws the fixed attribute display on the display 221, and the second drawing control unit 213 draws the movement attribute display on the display 221.

As an example of the fixed attribute display drawn by the first drawing control unit 211, an image showing information on the instrument of the own vehicle, an image showing a setting state of the function of the own vehicle such as an automatic driving function, and an operating state of the automatic driving function An image showing the content of the traffic sign on the running road, an image showing the monitoring state of the driver, and the like.

Examples of the image showing the information of the own vehicle meter include an image showing the vehicle speed. As an image showing the setting state of the function of the vehicle such as the automatic driving function, there is an icon image showing whether the automatic driving function such as the ACC (Adaptive Cruise Control) function is on or off, or whether the route guidance function is on or off. Can be mentioned. As an image which shows the operation state of an automatic driving function, the icon image etc. which show the presence or absence of operation | movement of an automatic driving function are mentioned. Examples of the image indicating the restriction information on the road being traveled include an icon image indicating the contents of a road sign such as a speed restriction sign for the road being traveled. Examples of the image indicating the monitoring state of the driver include an icon image indicating whether or not the steering wheel is gripped by the driver. The fixed attribute display is not limited to the example given here.

As an example of the arrangement of the fixed attribute display, the fixed attribute display may be arranged in a corresponding area below the projection area when projected onto the projection area. Thereby, the fixed attribute display is displayed mainly on the proximal side of the driver. In addition, you may arrange | position to the area | region applicable to the side of a projection area | region, when projecting on a projection area | region.

Examples of the movement attribute display drawn by the second drawing control unit 213 include a turn-by-turn (TBT) image, a lane guidance image indicating a planned lane, a marking image indicating the presence of surrounding facilities, and the following of the own vehicle. There are an image of marking indicating the target vehicle, an image of a warning marker for alerting the presence of a notification target approaching the host vehicle, and the like.

Examples of the TBT image include a linear or sheet-like image along the road surface of the planned travel route for indicating the planned travel route of the host vehicle. Examples of the lane guidance image include an image in which a lane marking of the planned lane is emitted in a pseudo manner, and a linear or sheet-like image showing a range in the lane along the shape of the planned lane. The lane guidance image may include an image of an arrow indicating the planned traveling direction. Examples of the marking image indicating the tracking target vehicle of the host vehicle include an image surrounding or pointing to the tracking target vehicle. Examples of the warning marker image include an image that surrounds or points to the notification target object. Examples of the notification target include pedestrians, bicycles, motorcycles, automobiles other than the own vehicle, and the like. The movement attribute image is not limited to the example given here.

Since the movement attribute display is arranged at a position corresponding to the object of the movement attribute display in the foreground, it may be arranged over the entire projection area. Thereby, the movement attribute display is displayed from the proximal side to the distal side of the driver.

The first drawing control unit 211 and the second drawing control unit 213 have different layers for drawing a display image on the display 221, and the mediation synthesis processing unit 216 determines which display image is the upper layer. Arbitration as to whether the lower layer is used or not is performed by superposing the upper layer on the lower layer.

When the movement attribute display includes emergency information that the driver of the vehicle should respond urgently, the arbitration composition processing unit 216 sets the movement attribute display layer as a higher layer than the fixed attribute display layer. . On the other hand, when the emergency information is not included in the movement attribute display, the arbitration synthesis processing unit 216 sets the fixed attribute display layer as a higher layer than the movement attribute display layer. As an example, when the emergency attribute is included in the information for movement attribute display in the information acquired by the determination information acquisition unit 201, the arbitration synthesis processing unit 216 sets the movement attribute display layer as the upper layer. On the other hand, if the emergency information is not included, the fixed attribute display layer is set as the upper layer.

As an example, the movement attribute display including emergency information may be an image of the warning marker described above. Further, as an example, the emergency information may be information on a situation in which it is necessary to alert the presence of a notification target approaching the host vehicle so that an image of a warning marker is displayed.

Here, an example of display by display control in the display control block 210 will be described with reference to FIGS. 4A to 4C and FIGS. 5A to 5C. FIGS. 4A to 4C are diagrams for explaining an example of a display when emergency information is not included in the movement attribute display. FIGS. 5A to 5C are diagrams when emergency information is included in the movement attribute display. It is a figure for demonstrating an example of a display.

4A to 4C will be described. FIG. 4A is a fixed attribute display, which is an image showing the speed of the host vehicle. FIG. 4B is a movement attribute display, which is an image of lane guidance that also includes an image of an arrow indicating the planned traveling direction. FIG. 4C is a diagram illustrating a display example in which the images of FIGS. 4A and 4B are superimposed on the foreground. Vi in FIG. 4C indicates a projection area. In the examples of FIGS. 4A to 4C, since the emergency information is not included in the movement attribute display, the fixed attribute display layer is set as the upper layer, while the movement attribute display layer is set as the lower layer. An image in which a layer with a fixed attribute display is superimposed on the foreground is displayed. Therefore, an image showing that the vehicle speed of the host vehicle is overwritten on the image of the lane guidance is displayed, and each image is displayed in a more distinguishable manner, and an image showing the vehicle speed of the host vehicle is displayed more easily. Is done.

Subsequently, the example of FIGS. 5A to 5C will be described. FIG. 5A is a fixed attribute display, which is an image showing the speed of the host vehicle. FIG. 5B is a movement attribute display, which is an image of a warning marker for alerting the presence of a pedestrian approaching the vehicle. FIG. 5C is a diagram showing a display example in which the images of FIGS. 5A and 5B are superimposed and displayed on the foreground. Vi in FIG. 5C indicates a projection area. In the example of FIG. 5A to FIG. 5C, since the emergency information is included in the movement attribute display, the layer for the movement attribute display is set as the upper layer, while the layer for the fixed attribute display is set as the lower layer, An image on which layers of movement attribute display are superimposed is superimposed on the foreground. Therefore, a display is made in which the image of the warning marker appears to be overwritten on the image indicating the vehicle speed of the host vehicle, and the images of the warning marker are displayed in a more easily viewable manner while displaying each image in a more distinguishable manner.

In addition, here, for the sake of convenience, description will be made assuming that there is one moving attribute display layer and one fixed attribute display layer, but this is not necessarily the case. For example, the layers may be divided according to the type of display item even if they are the same movement attribute display, or the layers may be divided according to the type of display item even if they are the same fixed attribute display.

The first drawing control unit 211 includes a first luminance correction unit 212 as shown in FIG. The first brightness correction unit 212 changes the apparent brightness of the fixed attribute display by changing the transmittance of the fixed attribute display according to the illuminance in the vehicle interior acquired by the room brightness acquisition unit 202. As an example, referring to the correspondence relationship between the illuminance in the vehicle interior and the transmittance of the fixed attribute display in which the visibility from the driver of the vehicle exceeds a certain level, What is necessary is just to set it as the structure changed to the transmittance | permeability of the fixed attribute display from which the visibility from a driver becomes more than fixed. Note that this correspondence relationship may be made available to the first drawing control unit 211 by storing in advance in the nonvolatile memory of the HCU 20 what is obtained by simulation, experiment, or the like. In the fixed attribute display mainly displayed on the proximal side of the driver, it is necessary to change the luminance of the appearance in accordance with the illuminance in the room of the own vehicle in order to improve the visibility. According to the above configuration, it is possible to improve the visibility by changing the apparent luminance of the fixed attribute display in accordance with the illuminance in the vehicle interior.

The second drawing control unit 213 includes a second luminance correction unit 214 as shown in FIG. The second luminance correction unit 214 changes the apparent luminance of the movement attribute display by changing the transmittance of the movement attribute display according to the illuminance in front of the host vehicle acquired by the front brightness acquisition unit 203. As an example, referring to the correspondence between the illuminance in front of the vehicle and the transmissivity of the movement attribute display in which the visibility from the driver of the vehicle is more than a certain level, What is necessary is just to set it as the structure changed to the transmittance | permeability of the movement attribute display from which the visibility from a driver becomes more than fixed. Note that this correspondence relationship may be used by the second drawing control unit 213 by storing the correspondence obtained by simulation, experiment, or the like in advance in the nonvolatile memory of the HCU 20. In the movement attribute display that can be displayed to the far side of the driver, it is necessary to change the luminance of the appearance according to the illuminance in front of the host vehicle in order to improve the visibility. According to the above configuration, it is possible to improve visibility by changing the apparent luminance of the movement attribute display in accordance with the illuminance in front of the host vehicle.

The first luminance correction unit 212 and the second luminance correction unit 214 change the transmittance of the display image by a display 221 for performing fixed attribute display and a display 221 for performing movement attribute display. This is because it is common and the backlight is common, and it is difficult to switch the brightness of the backlight separately between the fixed attribute display and the movement attribute display.

The first luminance correction unit 212 and the second luminance correction unit 214 lower the transmittance of the display image of the lower layer relative to the upper layer image. Thereby, it becomes possible to further improve the visibility of the display image of the upper layer. The first luminance correction unit 212 and the second luminance correction unit 214 may be configured to relatively reduce the transmittance of the display image of the lower layer by increasing the transmittance of the display image of the upper layer. Alternatively, the transmittance of the display image of the lower layer may be relatively lowered by lowering the transmittance of the display image of the lower layer. It is more preferable that the transmittance of the display image of the lower layer is relatively lowered by lowering the transmittance of the display image of the lower layer.

If the first luminance correction unit 212 and the second luminance correction unit 214 cannot increase the transmittance of the upper layer image in order to satisfy the above-described transmittance range of the display image according to the illuminance, The transmittance of the display image of the lower layer may be relatively lowered by lowering the transmittance of the layer image. On the other hand, if the transmittance of the lower layer image cannot be reduced in order to satisfy the above-mentioned range of transmittance of the display image according to the illuminance, the transmittance of the upper layer image can be increased. The transmittance of the display image of the lower layer may be relatively lowered.

The first luminance correction unit 212 and the second luminance correction unit 214 satisfy the above-described transmittance range of the display image according to the illuminance, and are layers that are lower layers than images of layers that are upper layers. If it is not possible to achieve a relatively low transmittance of the display image, the following may be performed. For example, when the movement attribute display layer is an upper layer, the lower layer layer image is lower than the upper layer image, rather than satisfying the display image transmittance range according to the illuminance described above. What is necessary is just to give priority to making the transmittance | permeability of a display image relatively low. On the other hand, when the layer of fixed attribute display is the upper layer, the display of the layer that is the lower layer with respect to the image of the layer that is the upper layer is to meet the above-described transmittance range of the display image according to the illuminance What is necessary is just to give priority over lowering the transmittance of the image. According to this, it becomes possible to improve the visibility of the display image as necessary, such as giving priority to enhancing the visibility of the movement attribute display including the emergency information.

The second drawing control unit 213 further includes a position correction unit 215 as shown in FIG. Based on the pitching information acquired by the pitching information acquisition unit 204, the position correction unit 215 draws an image to be drawn on the display unit 221 so as to reduce the shift in the display position of the virtual image 100 of the movement attribute display with respect to the foreground due to pitching. Perform position correction to move the position. As an example, a correction function for correcting a shift in display position is set in advance by the HCU 20, and correction of position correction is performed by calculating this correction function based on the pitching information acquired by the pitching information acquisition unit 204. What is necessary is just to set it as the structure which calculates a value. The correction function is a function indicating a correspondence relationship between the pitching information and a correction value for reducing the shift of the display position of the virtual image 100 of the movement attribute display with respect to the foreground. The position correction unit 215 may be configured to perform position correction by moving the drawing position of the movement attribute display according to the calculated correction value.

According to the above configuration, since the position correction unit 215 performs position correction so as to reduce the shift of the display position due to the pitching of the own vehicle, the shift of the movement attribute display with respect to the target of the movement attribute display in the foreground is reduced, It is possible to prevent the intention of the movement attribute display from becoming difficult to be transmitted to the driver.

In the display control block 210, this position correction based on the pitching information is not performed for the fixed attribute display. That is, the first drawing control unit 211 moves the drawing position of the image drawn on the display 221 so as to reduce the shift of the display position of the virtual image 100 of the fixed attribute display with respect to the foreground due to the pitching based on the pitching information. Does not perform position correction. This is because the fixed attribute display is not a display image that changes its position according to the object in the foreground, and therefore, a part of the display image deviates from the projection area by position correction rather than reducing the display position shift due to pitching. This is because it is preferable to prioritize the prevention of chipping.

(Virtual image display control related processing in HCU20)
Next, an example of the flow of processing related to display control in the HUD device 220 in the HCU 20 (hereinafter referred to as virtual image display control related processing) will be described using the flowchart of FIG. The flowchart in FIG. 6 may be configured to start when the power of the HUD device 220 is turned on and the function of the HUD device 220 is turned on. The function of the HUD device 220 may be switched on / off according to an input operation received by the operation device 21. The power supply of the HUD device 220 may be switched according to on / off of a switch (hereinafter referred to as a power switch) for starting the internal combustion engine or motor generator of the host vehicle.

In S1, the determination information acquisition unit 201, the indoor brightness acquisition unit 202, the front brightness acquisition unit 203, and the pitching information acquisition unit 204 of the information processing block 200 are among the various information output to the in-vehicle LAN. Information necessary for display control in the display control block 210 is selectively acquired.

In S2, when the emergency information is included in the information for movement attribute display among the information acquired by the determination information acquisition unit 201 (YES in S2), the process proceeds to S3. On the other hand, when the emergency information is not included in the information for movement attribute display in the information acquired by the determination information acquisition unit 201 (NO in S2), the process proceeds to S4.

In S3, the arbitration composition processing unit 216 sets the movement attribute display layer as a higher layer than the fixed attribute display layer, and proceeds to S5. On the other hand, in S4, the arbitration composition processing unit 216 sets the fixed attribute display layer as a layer higher than the movement attribute display layer, and proceeds to S5.

In S5, when the movement attribute display layer is set as the upper layer in S3, the first luminance correction unit 212 lowers the transmittance of the display image of the fixed attribute display layer or the second luminance correction unit 214 moves. Increase the transmittance of the display image of the attribute display layer. Thereby, the transmittance of the display image of the layer with the fixed attribute display is made relatively lower than the transmittance of the display image of the layer with the movement attribute display. On the other hand, when the fixed attribute display layer is set as the upper layer in S4, the first luminance correction unit 212 increases the transmittance of the display image of the fixed attribute display layer, or the second luminance correction unit 214 sets the movement attribute. Decrease the transmittance of the display image of the display layer. Thereby, the transmittance of the display image of the layer with the movement attribute display is made relatively lower than the transmittance of the display image of the layer with the fixed attribute display. In addition, the first luminance correction unit 212 changes the transmittance of the fixed attribute display according to the illuminance in the vehicle interior acquired by the indoor brightness acquisition unit 202, and the second luminance correction unit 214 acquires the front brightness. The transmissivity of the movement attribute display is changed according to the illuminance ahead of the host vehicle acquired by the unit 203.

In S6, the position correction unit 215 corrects the position of the movement attribute display based on the pitching information acquired by the pitching information acquisition unit 204. The process of S6 may be performed before the process of S5, or may be performed before the process of S2.

In S7, the arbitration composition processing unit 216 causes the first drawing control unit 211 and the second drawing control unit 213 to draw the upper layer by overlapping the lower layer. For example, when the movement attribute display layer is an upper layer, the movement attribute display layer is drawn on top of the fixed attribute display layer. On the other hand, when the fixed attribute display layer is an upper layer, the fixed attribute display layer is drawn by being superimposed on the movement attribute display layer.

In S8, when it is the end timing of the virtual image display control related processing (YES in S8), the virtual image display control related processing is ended. On the other hand, if it is not the end timing of the virtual image display control related process (NO in S8), the process returns to S1 and the process is repeated. As an example of the end timing of the virtual image display control related processing, there is a case where the power switch of the own vehicle is turned off, a case where the function of the HUD device 220 is turned off, or the like.

According to the configuration of the first embodiment, when an image is drawn on the display 221 of the HUD device 220, the movement attribute display and the fixed attribute display are divided into different layers and drawn on one display 221. Even when the virtual image of the display and the fixed attribute display is displayed in combination on the foreground of the vehicle, both can be displayed separately. Therefore, it is possible to suppress a reduction in both visibility due to a mixture of both virtual images. As a result, when the virtual image 100 is superimposed on the foreground of a moving body such as a vehicle by projecting an image onto a projection member such as the front windshield 10, an image of a moving attribute display item and an image of a fixed attribute display item are displayed. Even in a case where both virtual images are displayed on the foreground of the moving object by being projected onto a common projection member, the visibility of both virtual images can be prevented from being lowered.

According to the configuration of the first embodiment, the transmittance between the movement attribute display and the fixed attribute display is changed. Therefore, even when the movement attribute display and the fixed attribute display are drawn by one display 221, It is possible to easily switch the apparent luminance individually. Furthermore, according to the configuration of the first embodiment, since it is possible to perform switching for changing the transmittance between the movement attribute display and the fixed attribute display separately, it is possible to make the apparent luminance of both different, It is possible to display both of them easily.

(Embodiment 2)
In the first embodiment, when the movement attribute display includes emergency information, the movement attribute display layer is set as the upper layer. When the movement attribute display does not include emergency information, the fixed attribute display layer is set as the upper layer. However, the present invention is not limited to this. Which layer of the movement attribute display and the fixed attribute display is set as the upper layer may be switched according to conditions other than the emergency information, or may be fixed regardless of the conditions. Even in this case, as long as the movement attribute display and the fixed attribute display are divided into different layers, it is possible to display both of them separately, so the visibility of both can be improved by mixing both virtual images. It becomes possible to suppress the decrease.

(Embodiment 3)
In the first embodiment, the first luminance correction unit 212 changes the transmittance of the fixed attribute display according to the illuminance of the vehicle interior acquired by the indoor brightness acquisition unit 202, and the second luminance correction unit 214 Although the configuration in which the transmittance of the movement attribute display is changed according to the illuminance in front of the host vehicle acquired by the brightness acquisition unit 203 is shown, the configuration is not necessarily limited thereto. For example, the configuration may be such that the HCU 20 does not include the room brightness acquisition unit 202 and does not change the transmittance of the fixed attribute display according to the illuminance in the room of the host vehicle. Alternatively, the HCU 20 may not include the front brightness acquisition unit 203 and may not change the transmittance of the movement attribute display according to the illuminance ahead of the host vehicle.

(Embodiment 4)
In the first embodiment, a configuration in which the first luminance correction unit 212 and the second luminance correction unit 214 relatively reduce the transmittance of the display image of the lower layer with respect to the image of the upper layer is shown. However, this is not necessarily the case. For example, regardless of whether the first luminance correction unit 212 and the second luminance correction unit 214 are the upper layer or the lower layer, the illuminance and forward brightness of the vehicle interior acquired by the indoor brightness acquisition unit 202, respectively. It is good also as a structure which changes the transmittance | permeability of a display image according to the illumination intensity ahead of the own vehicle acquired by the length acquisition part 203. FIG.

(Embodiment 5)
In the first embodiment, the position correction unit 215 performs the position correction of the movement attribute display based on the pitching information acquired by the pitching information acquisition unit 204. However, the configuration is not necessarily limited thereto. For example, the HCU 20 may not include the pitching information acquisition unit 204 and the position correction unit 215 and may not perform position correction of the movement attribute display.

(Embodiment 6)
In Embodiment 1, although the example applied when the own vehicle has an automatic driving function was given and demonstrated, it does not necessarily restrict to this. For example, the structure in which the own vehicle does not have an automatic driving function may be sufficient. In this case, the mobile system 1 does not include the automatic operation ECU 8, and the travel environment may be recognized by another ECU.

(Embodiment 7)
In the first embodiment, the configuration in which the HCU 20 separate from the HUD device 220 performs the function related to the display control in the HUD device 220 is shown, but the configuration is not necessarily limited thereto. For example, the control circuit provided in the HUD device 220 may be responsible for functions related to display control in the HUD device 220, or may be configured as the control circuit provided in the combination meter.

The control and the method described in the present disclosure may be realized by a dedicated computer constituting a processor programmed to execute one or a plurality of functions embodied by a computer program. Alternatively, the control and the method thereof described in the present disclosure may be realized by a dedicated computer that configures a processor with a dedicated hardware logic circuit. Alternatively, the control and the method described in the present disclosure may be realized by one or more dedicated computers configured by a combination of a processor that executes a computer program and one or more hardware logic circuits. The computer program may be stored in a computer-readable non-transition tangible recording medium as instructions executed by the computer.

Here, the flowchart described in the present application or the process of the flowchart is composed of a plurality of steps (or referred to as sections), and each step is expressed as, for example, S1. Further, each step can be divided into a plurality of sub-steps, while a plurality of steps can be combined into one step.

Heretofore, the embodiment, configuration, and aspect of the display control device for mobile body, the display control method for mobile body, and the control program according to one aspect of the present disclosure have been exemplified, but the embodiment, configuration, and aspect according to the present disclosure are described above. However, the present invention is not limited to each embodiment, each configuration, and each aspect. For example, embodiments, configurations, and aspects obtained by appropriately combining technical parts disclosed in different embodiments, configurations, and aspects are also included in the scope of the embodiments, configurations, and aspects according to the present disclosure.

Claims

A display control device for a moving body that controls a head-up display device that is used in a moving body and displays a virtual image superimposed on the foreground of the moving body by projecting an image to be drawn on a display device onto a projection member,
A determination information acquisition unit (201) that acquires content determination information that is information for determining the content of an image to be drawn on the display;
A drawing control unit (211, 213) for drawing an image on the display unit according to the content determination information acquired by the determination information acquisition unit;
The drawing control unit divides a moving attribute image whose position is changed according to a target in the foreground to be superimposed and a fixed attribute image whose position is fixed regardless of the foreground into different layers, and A display control device for a moving body that draws on a display.
When the moving attribute image includes emergency information that the user of the moving body should respond urgently, the layer of the moving attribute image is displayed on a layer higher than the fixed attribute image; The display control apparatus for moving bodies according to claim 1.
The mobile object according to claim 2, wherein, when the emergency information is not included in the movement attribute image, the layer of the fixed attribute image is a layer displayed in a higher layer than the movement attribute image. Display controller.
4. The drawing control unit according to any one of claims 1 to 3, wherein the drawing control unit can perform drawing by switching a transmittance of an image to be drawn between the image layer having the movement attribute and the image layer having the fixed attribute. The display control apparatus for moving bodies described in 1.
An indoor brightness acquisition unit (202) for acquiring the indoor brightness of the mobile body;
A front brightness acquisition unit (203) that acquires the brightness of the front of the moving body,
The drawing control unit changes the transmittance of the image to be drawn on the image layer of the fixed attribute according to the indoor brightness of the moving body acquired by the indoor brightness acquisition unit, while the front brightness The display control apparatus for a moving body according to claim 4, wherein the transmittance of the image drawn on the layer of the image of the movement attribute is changed according to the brightness in front of the moving body acquired by the acquisition unit.
The drawing control unit relatively sets the transmittance of the lower layer image relative to the upper layer image of the movement attribute image layer and the fixed attribute image layer relative to each other. The display control apparatus for a moving body according to claim 4 or 5, wherein the display control apparatus for drawing is lowered.
A pitching information acquisition unit (204) for acquiring pitching information indicating a pitching state of the mobile body;
The drawing control unit, based on the pitching information acquired by the pitching information acquisition unit, draws an image to be drawn on the display so as to reduce a shift in the display position of the virtual image with respect to the foreground due to the pitching A position correction unit (215) for performing position correction for moving
The position correction unit does not perform the position correction on the image drawn on the fixed attribute image layer, while the position correction unit does not perform the position correction on the movement attribute image layer. The display control apparatus for a moving body according to any one of claims 1 to 6, wherein correction is performed.
A moving body display control method for controlling a head-up display device that is used in a moving body and projects a virtual image superimposed on the foreground of the moving body by projecting an image to be drawn on a display device onto a projection member,
Obtaining information for determining content that is information for determining the content of an image to be drawn on the display,
When drawing an image on the display according to the content determination information to be acquired, the position of the moving attribute is changed regardless of the foreground, and the image has a movement attribute that changes the position according to the object in the foreground to be superimposed. A display control method for a moving object, in which an image having a fixed attribute is divided into different layers and drawn on a single display.
Computer
Information used to determine the content of an image to be drawn on the display of a head-up display device that is used by the moving body and projects a virtual image superimposed on the foreground of the moving body by projecting the image to be drawn on the display onto a projection member A determination information acquisition unit (201) for acquiring content determination information,
When rendering an image on the display unit according to the content determination information acquired by the determination information acquisition unit, an image of a movement attribute that changes a position according to an object in the foreground to be superimposed and displayed, A control program for functioning as a drawing control unit (211, 213) that divides a fixed attribute image whose position is fixed regardless of the foreground into different layers and draws it on one display device.
A computer-readable non-transitional tangible storage medium storing the control program according to claim 9.