WO2018163266A1 - Display control device and display control method - Google Patents

Abstract

The present invention has the purpose of providing a display on an HUD without giving a sense of discord. A display control device related to the present invention is provided with: a region specifying unit (12) which selects, as a selection region, a pixel region in which a temporal change of a pixel value is smaller than a predetermined value in a captured image of an actual view outside a subject vehicle, which is viewed from a driver of the subject vehicle; a blind spot event determination unit (13A) which determines whether a blind spot event, which should be notified to the driver, occurs in a blind spot of the driver; and a display control unit (15) which controls a display of a display device installed in the subject vehicle, wherein the display device includes an HUD (35) which displays information so that the driver can view the information superimposed on the actual view outside the subject vehicle, and the display control unit (15) controls the HUD (35) such that notification information on the blind spot event for the driver is displayed in a display region of the HUD (35), which is superimposed on the selection area and viewed by the driver.

Description

Display control apparatus and display control method

The present invention relates to display control of HUD (Head-Up Display).

∙ Human attention is more likely to be directed to areas that are larger than areas with small changes over time. Therefore, the line of sight of the driver of the vehicle tends to concentrate in a region where the temporal change is large in the actual scene. In recent years, HUD has attracted attention as a display device using this tendency. The HUD generates augmented reality (AR) in which information is added to the actual scene by displaying the superimposed image superimposed on the actual scene in front of the vehicle. According to the HUD, it is possible to transmit information quickly and accurately while suppressing the movement of the driver's line of sight.

Patent Document 1 discloses a vehicle peripheral information display system using HUD. The vehicle peripheral information display system of Patent Document 1 predicts the future behavior of another vehicle approaching from outside the HUD display area, predicts the position where the other vehicle enters the display area, and predicts the position. The driver is alerted by superimposing a warning virtual image that emphasizes other vehicles.

Japanese Unexamined Patent Publication No. 2016-62368

In order to alert the driver of an object located in the driver's field of view using the HUD, it is desirable that the alert image is displayed so as to overlap the object or its surroundings when viewed from the driver.

However, when alerting the driver that the other vehicle is approaching from the driver's blind spot, the other vehicle is outside the display area of the HUD, so the alert image is viewed from the driver as the other vehicle or It is not displayed so as to overlap the periphery, but is displayed superimposed on other areas.

Therefore, the position of the other vehicle recalled from the alert image is different from the actual position of the other vehicle, which gives the driver a sense of incongruity due to this difference.

The present invention has been made in view of the above-mentioned problems, and an object thereof is to display notification information of an event that has occurred in a driver's blind spot on the HUD without a sense of incongruity.

The display control device according to the present invention includes an area specifying unit, a blind spot event determining unit, and a display control unit. The region specifying unit selects, as a selection region, a pixel region in which a temporal change in pixel value is smaller than a predetermined value in a photographed image of a real scene outside the target vehicle viewed from the driver of the target vehicle. The blind spot event determination unit determines whether or not a blind spot event that should be notified to the driver is occurring at the driver's blind spot. The display control unit performs display control of a display device provided in the target vehicle. The display device includes a HUD that displays information so that the driver can visually recognize the actual scene outside the target vehicle. The display control unit controls the HUD so as to display the notification information of the blind spot event for the driver in the display area of the HUD that is visually recognized by the driver so as to overlap the selected area.

The display control apparatus according to the present invention allows the blind spot event notification information to be visually recognized by the driver as overlapping with an area where the temporal change is small in the actual scene outside the target vehicle. Since it is difficult for the driver to pay attention to an area where the change with time is small, he / she does not pay too much attention to the notification information of the blind spot event. Therefore, the driver feels uncomfortable due to the difference between the display position of the blind spot event notification information and the position of the blind spot event.

The objects, features, aspects and advantages of the present invention will become more apparent from the following detailed description and the accompanying drawings.

It is a block diagram which shows the structure of the display control apparatus which concerns on Embodiment 1 of this invention. It is a flowchart which shows operation | movement of the display control apparatus which concerns on Embodiment 1 of this invention. It is a figure explaining the display of the notification information of the blind spot event by the display control apparatus which concerns on the comparative example of this invention. It is a figure explaining the display of the notification information of the blind spot event by the display control apparatus which concerns on Embodiment 1 of this invention. It is a block diagram which shows the structure of the display control apparatus which concerns on Embodiment 2 of this invention. It is a flowchart which shows operation | movement of the display control apparatus which concerns on Embodiment 2 of this invention. It is a block diagram which shows the structure of the display control apparatus which concerns on Embodiment 3 of this invention. It is a flowchart which shows operation | movement of the display control apparatus which concerns on Embodiment 3 of this invention. It is a figure explaining the display of the notification information of the blind spot event by the display control apparatus which concerns on Embodiment 3 of this invention. It is a block diagram which shows the structure of the display control apparatus which concerns on Embodiment 4 of this invention. It is a flowchart which shows operation | movement of the display control apparatus which concerns on Embodiment 4 of this invention. It is a figure explaining the display of the notification information of the visual field event by the display control apparatus which concerns on Embodiment 4 of this invention. It is a figure explaining the display of the notification information of the visual field event and blind spot event by the display control apparatus which concerns on Embodiment 4 of this invention. It is a block diagram which shows the structure of the display control apparatus which concerns on Embodiment 5 of this invention. It is a flowchart which shows operation | movement of the display control apparatus which concerns on Embodiment 5 of this invention. It is a figure which shows the notification information displayed on HUD by the display control of the display control apparatus which concerns on Embodiment 5 of this invention. It is a block diagram which shows the structure of the display control apparatus which concerns on Embodiment 6 of this invention. It is a flowchart which shows operation | movement of the display control apparatus which concerns on Embodiment 6 of this invention. It is a figure explaining the display control of the display control apparatus which concerns on Embodiment 6 of this invention. It is a figure explaining the display control of the display control apparatus which concerns on Embodiment 6 of this invention. It is a figure explaining the display control of the display control apparatus which concerns on Embodiment 6 of this invention. It is a block diagram which shows the structure of the display control apparatus which concerns on Embodiment 7 of this invention. It is a figure which shows the icon showing the relationship between a driver | operator's visual field and a HUD display area. It is a flowchart which shows operation | movement of the display control apparatus which concerns on Embodiment 7 of this invention. It is a figure explaining the display control of the display control apparatus which concerns on Embodiment 7 of this invention. It is a figure which shows the hardware constitutions of the display control apparatus of this invention. It is a figure which shows the hardware constitutions of the display control apparatus of this invention. It is a figure which shows the structural example by the vehicle-mounted apparatus and server of the display control apparatus which concern on Embodiment 2 of this invention.

In this specification, the HUD that performs display control by the display control apparatus according to the present invention is referred to as a target vehicle, a vehicle other than the target vehicle is referred to as another vehicle, and the two are distinguished. In addition, the same or corresponding components among the components of the invention described below are described with the same reference numerals in the drawings. The HUD is an example of a display device that can be displayed in a superimposed manner in the driver's visual field area, and the present invention can be applied to other display devices as long as the display device can be displayed in a superimposed manner in the driver's visual field area.

<A. Embodiment 1>
<A-1. Configuration>
FIG. 1 is a block diagram showing a configuration of display control apparatus 101 according to Embodiment 1 of the present invention. The display control apparatus 101 includes an area specifying unit 12, a peripheral event determination unit 13, and a display control unit 15. The peripheral event determination unit 13 includes a blind spot event determination unit 13A. The display control device 101 is connected to the in-vehicle camera 32, the visual field detection device 33, the display content database 34, and the HUD 35, and is configured to be able to use them.

The in-vehicle camera 32 is mounted on the target vehicle and images the front, side, and rear of the target vehicle. The front image of the target vehicle photographed by the in-vehicle camera 32 is used for processing to be described later by the region specifying unit 12. The side image and the rear image of the target vehicle captured by the in-vehicle camera 32 are used for the later-described process by the blind spot event determination unit 13A.

The visual field detection device 33 detects the driver's visual field from the driver's face direction or line of sight, and outputs the detection result to the display control device 101 as visual field information. In the field of view information, the field of view is defined by the range of angles in the vertical and horizontal directions around the face direction or line of sight. The visual field information is used for processing described later by the blind spot event determination unit 13A.

The display content database 34 is a storage unit that stores display content such as images to be displayed on the HUD 35. The display content database 34 is configured by an HDD (Hard Disk Drive) mounted on the target vehicle as an example, but may be configured by a cloud or a server. The format of the image data stored in the display content database 34 is assumed to be a 32-bit bitmap format having an α value in order to support transmission control. However, PNG (Portable) capable of transmission control and lossless compression is used for capacity reduction. An image format such as (Network Graphics) may be used.

The HUD 35 is installed in front of the target vehicle, and displays the display content stored in the display content database 34 under the control of the display control unit 15. In the present embodiment, the HUD 35 is assumed to be a combiner type installed on the dashboard of the target vehicle and covering a part of the windshield. However, a windshield type covering the entire surface of the windshield may be used.

The area specifying unit 12 divides the front image of the target vehicle captured by the in-vehicle camera 32 into an area where the change with time is small and an area where it is not. As a quantitative evaluation index for area division, there is a time-series standard deviation of a pixel value of a specific pixel of interest. The region specifying unit 12 may use a predetermined minimum pixel block as a target pixel block and use a time-series standard deviation of the average pixel value of the target pixel block. In this case, the region specifying unit 12 can perform region division while avoiding the influence of camera noise or disturbance.

The region specifying unit 12 regards a target pixel or a target pixel block whose standard deviation is equal to or less than a predetermined threshold as a change with time. When the standard deviation of the pixel of interest or the pixel block adjacent to the pixel of interest or the pixel block of interest considered that the change with time is small is equal to or less than the threshold value, the region specifying unit 12 selects the pixel or pixel block of interest To integrate. The area specifying unit 12 divides the front image of the target vehicle into an area where the temporal change is small and an area where it is not so by performing this integration process on all pixels or all pixel blocks. Hereinafter, an area divided by the area specifying unit 12 as an area having a small change with time is referred to as a selection area. That is, the region specifying unit 12 selects a pixel region in which an index indicating a temporal change of the pixel value is smaller than a predetermined value in a captured image of a real scene outside the target vehicle viewed from the driver of the target vehicle. Select as region.

The blind spot event determination unit 13 </ b> A is a blind spot event to be notified to the driver at the driver's blind spot based on the side or rear video of the target vehicle captured by the in-vehicle camera 32 and the visual field information acquired from the visual field detection device 33. It is determined whether or not this has occurred. In this specification, an event that occurs in the vicinity of the target vehicle and should be notified to the driver is defined as a peripheral event, an event that occurs in the driver's blind spot among the peripheral events is a blind spot event, and an event that occurs in the driver's field of view. Let it be an event.

The event that should be notified to the driver is an event that may affect the target vehicle. An example of the blind spot event is that another vehicle is approaching from the right lane while the target vehicle is traveling in the left lane, for example. In this embodiment, the blind spot event determination unit 13A determines the presence or absence of a blind spot event based on the video of the in-vehicle camera 32. May be.

When the blind spot event determination unit 13A determines that a blind spot event has occurred, the display control unit 15 provides information for notifying the driver of the blind spot event (hereinafter simply referred to as “dead spot event notification information”). Display) on the HUD 35. The display control unit 15 acquires display content corresponding to the blind spot event from the display content database 34 as blind spot event notification information. The display control unit 15 controls the HUD 35 so that the blind spot event notification information is displayed in a region that is overlapped with the region selected by the region specifying unit 12 in the display region of the HUD 35 and visually recognized by the driver.

When there are a plurality of selection areas, the display control unit 15 controls the HUD 35 to display the blind spot event notification information in the display area of the HUD 35 that is visually recognized by overlapping the selection area with the smallest relative position change with the target vehicle. To do. For example, the display control unit 15 specifies a selection region having the smallest sum of optical flows of feature points included in the selection region. The blind spot event notification information is displayed stably in an area other than the actual scene in front of the target vehicle (including a part of the target vehicle) in the HUD 35 as much as possible, so that the display position of the blind spot event notification information and the actual blind spot are displayed. The discomfort felt by the driver due to the deviation from the event occurrence position is reduced.

<A-2. Operation>
The operation of the display control apparatus 101 will be described with reference to the flowchart of FIG. The display control apparatus 101 repeatedly executes the flow of FIG. 2 at a specific timing such as a fixed period.

First, the area specifying unit 12 selects, from the front image of the in-vehicle camera 32, an area where the change with time during traveling is small (step S11).

Next, the blind spot event determination unit 13A determines whether a blind spot event has occurred (step S12). If no blind spot event has occurred in step S12, the display control process ends.

If a blind spot event has occurred in step S12, the display control unit 15 performs the following processing. First, the display controller 15 acquires blind spot event notification information from the display content database 34 (step S13).

Next, the display control unit 15 specifies the display area of the HUD 35 that displays the blind spot event notification information (step S14). Here, the display control unit 15 specifies a region that is visually recognized by the driver so as to overlap the selected region of the front image of the in-vehicle camera 32.

Finally, the display control unit 15 displays blind spot event notification information in the display area of the HUD 35 identified in step S14 (step S15).

<A-3. Effect>
A description will be given of how the blind spot event notification information is displayed on the HUD 35 by the display control processing of the display control apparatus 101. First, FIG. 3 shows a display by a display control device of a comparative example of the present invention. Here, “the other vehicle is approaching the target vehicle from the driver's blind spot” is defined as a blind spot event.

In FIG. 3, the field of view 43 of the driver 41 shows a real scene outside the target vehicle such as the bonnet, road, and guardrail of the target vehicle. In addition, the driver 41 visually recognizes a display area (hereinafter referred to as “HUD display area”) 44 of the HUD 35 so as to overlap a part of the visual field 43. Therefore, the driver 41 can visually recognize the display of the HUD 35 without greatly moving the line of sight.

In the upper area 44A of the HUD display area 44, blind spot event notification information 45A and 45B are displayed. Since the region 44A is visually recognized by the driver 41 so as to overlap with a road or the like, a change with the passage of time of the target vehicle is large. Therefore, the driver 41 is greatly attracted to the blind spot event notification information 45. The driver 41 feels uncomfortable because there is a difference between the display position of the blind spot event notification information 45 and the position of the other vehicle 42.

On the other hand, according to the display control of the display control apparatus 101 according to the first embodiment, the blind spot event notification information 45 is displayed in the lower area 44B of the HUD display area 44 as shown in FIG. . The region 44B is a region that is visually recognized by being overlapped with the hood of the target vehicle when viewed from the driver 41, and since the change with time associated with the traveling of the target vehicle is small, it is difficult for the driver 41 to pay attention. In this way, the display control apparatus 101 dares to display the blind spot event notification information 45 in an area where it is difficult for the driver 41 to pay attention, so that the driver 41 does not pay too much attention to the blind spot event notification information 45. Like that. Therefore, the uncomfortable feeling due to the difference between the display position of the blind spot event notification information 45 and the position of the other vehicle 42 that is the blind spot event is reduced.

That is, the display control apparatus 101 according to the first embodiment includes an area specifying unit 12, a blind spot event determining unit 13A, and a display control unit 15. Then, the area specifying unit 12 selects, as a selection area, a pixel area in which an index indicating a temporal change of the pixel value is smaller than a predetermined value in a photographed image of a real scene outside the target vehicle viewed from the driver 41. To do. The blind spot event determination unit 13A determines whether or not a blind spot event that should be notified to the driver is occurring at the driver's blind spot. The display control unit 15 performs display control of a display device provided in the target vehicle. The display device includes a HUD 35 that displays information so that the driver 41 can visually recognize the actual scene outside the target vehicle. The display control unit 15 controls the HUD 35 so that the blind spot event notification information 45 for the driver 41 is displayed in the HUD display area 44 that is visually recognized by the driver 41 so as to overlap the selected area. In this way, the display control device 101 dares to display the blind spot event notification information 45 in an area where it is difficult for the driver 41 to pay attention. Therefore, the driver 41 may excessively pay attention to the blind spot event notification information 45. Absent. Therefore, the uncomfortable feeling due to the difference between the display position of the blind spot event notification information 45 and the position of the other vehicle 42 that is the blind spot event is reduced.

<B. Second Embodiment>
<B-1. Configuration>
FIG. 5 is a block diagram showing a configuration of display control apparatus 102 according to Embodiment 2 of the present invention. The display control apparatus 102 includes a vehicle movement determination unit 11 in addition to the configuration of the display control apparatus 101 according to the first embodiment.

The vehicle speed sensor 31 detects the vehicle speed of the target vehicle and outputs the detection result to the vehicle movement determination unit 11. For example, the vehicle speed sensor 31 outputs a value other than 0 when the target vehicle is in a running state, and outputs 0 when the target vehicle is in a stopped state.

The vehicle movement determination unit 11 acquires the vehicle speed of the target vehicle from the vehicle speed sensor 31, and determines whether the target vehicle is running based on this. In the second embodiment, the operations of the area specifying unit 12, the surrounding event determining unit 13, and the display control unit 15 described in the first embodiment are performed only when the vehicle movement determining unit 11 determines that the target vehicle is running. Is called.

<B-2. Operation>
Next, the operation of the display control apparatus 102 will be described with reference to the flowchart of FIG. The display control apparatus 102 repeatedly performs the flow of FIG. 6 at a specific timing such as a fixed period.

First, the vehicle movement determination unit 11 determines whether or not the target vehicle is traveling based on information from the vehicle speed sensor 31 (step S21). If the target vehicle is not traveling in step S21, the display control process ends.

If the target vehicle is traveling in step S21, the display control process proceeds to step S22. Steps S22 to S26 are the same as steps S11 to S15 in FIG.

<B-3. Effect>
The display control device 102 includes a vehicle movement determination unit 11 in addition to the configuration of the display control device 101. The display control device 102 performs display control of the blind spot event notification information for the HUD 35 only when the vehicle movement determination unit 11 determines that the target vehicle is traveling. Therefore, since the blind spot event notification information is not displayed on the HUD 35 while the target vehicle is stopped, it is possible to prevent the driver from viewing the blind spot event notification information unnecessarily.

<C. Embodiment 3>
<C-1. Configuration>
FIG. 7 is a block diagram showing a configuration of display control apparatus 103 according to Embodiment 3 of the present invention. In the configuration of the display control apparatus 102 according to the second embodiment, the display control apparatus 103 includes the display content classification unit 15A. Further, the display control unit 15 performs display control of a CID (Center Information Display) 36 in addition to the HUD 35.

The display content classification unit 15A classifies the blind spot event notification information into first notification information and second notification information according to the amount of information. The second notification information has a larger amount of information than the first notification information. The display content classification unit 15A can classify, for example, character information as first notification information and non-character information such as an illustration showing a positional relationship between the target vehicle and the cause of the alert target as second notification information. The display destination of the first notification information is HUD 35, and the display destination of the second notification information is CID 36.

CID 36 is a display that is displayed in front of the driver's seat of the target vehicle. The main application of the CID 36 is to display a map of a car navigation device. Recently, the CID 36 is becoming increasingly sophisticated as a multi-function display used for a parking assist function using an on-vehicle camera image, air conditioning operation, fuel efficiency information display, and the like. . In the present embodiment, the CID 36 is an example of a non-HUD display device that displays information so that the driver can visually recognize the actual scene outside the target vehicle without overlapping. Therefore, instead of the CID 36, a display panel mounted on another non-HUD display device, for example, an instrument panel (hereinafter referred to as “instrument panel”) may be used. The instrument panel refers to instruments such as a speedometer, tachometer, fuel gauge, water temperature gauge, and distance meter installed in front of the driver's seat of the vehicle, and generally has an analog display. However, in recent years, the number of instrument panels for digital display equipped with a display panel has increased.

<C-2. Operation>
Next, the operation of the display control apparatus 103 will be described along the flowchart of FIG. The display control apparatus 103 repeatedly executes the flow of FIG. 8 at a specific timing such as a fixed period.

Steps S31 to S34 are the same as steps S21 to S24 in FIG.

The display content classification unit 15A classifies the blind spot event notification information acquired by the display control unit 15 in step S34 into first notification information and second notification information (step S35). For example, character information is classified as first notification information, and other information is classified as second notification information.

Next, the display control unit 15 specifies the display area of the HUD 35 that displays the first notification information (step S36). Here, an area that is visually recognized by the driver is identified by overlapping the area selected in step S32.

Next, the display control unit 15 controls the HUD 35 so that the first notification information is displayed in the display area specified in step S36 (step S37).

Further, the display control unit 15 displays the second notification information on the CID 36 (step S38).

<C-3. Effect>
How the blind spot event notification information is displayed on the HUD 35 and the CID 36 by the display control process of the display control apparatus 103 will be described. Here, “the other vehicle is approaching the target vehicle from the driver's blind spot” is defined as a blind spot event. As illustrated in FIG. 9, the blind spot event notification information includes character information 45 </ b> A “approach to other vehicle” and an icon 45 </ b> B indicating a positional relationship between the target vehicle and the other vehicle. Character information 45A is displayed in the area 44B below the HUD display area 44, and an icon 45B is displayed in the CID 36. Thus, only the notification information with a small amount of information such as the character information 45 </ b> A is displayed in the HUD display area 44 displayed so as to overlap the actual scene of the driver's visual field 43.

That is, according to the display control apparatus 103 of the third embodiment, the display device includes a non-HUD display device that displays information so that the driver can visually recognize the actual scene outside the target vehicle without overlapping, and display control is performed. The unit 15 classifies the blind spot event notification information 45 into first notification information and second notification information having a larger amount of information than the first notification information, causes the first notification information to be displayed on the HUD 35, and Display on HUD display device. Therefore, information is not excessively displayed in the driver's visual field 43. Thereby, according to the display control apparatus 103, in addition to the effect of Embodiment 2, it has the effect of preventing the driver's confusion in the short term, and the driver ignores the information in the long term. This has the effect of preventing this.

<D. Embodiment 4>
<D-1. Configuration>
FIG. 10 is a block diagram showing a configuration of display control apparatus 104 according to Embodiment 4 of the present invention. In the configuration of the display control apparatus 102 according to the second embodiment, the display control apparatus 104 includes the peripheral event determination unit 13 and the visual field event determination unit 13B.

The visual field event determination unit 13B is based on the front image or the side image of the target vehicle captured by the in-vehicle camera 32 and the visual field information acquired from the visual field detection device 33. It is determined whether or not this has occurred. The event to be notified to the driver is an event that may affect the target vehicle. For example, the preceding vehicle has suddenly stopped. In the present embodiment, the visual field event determination unit 13B determines whether or not a visual field event has occurred based on the image of the in-vehicle camera 32. The visual field event determination unit 13B determines using the information received by inter-vehicle communication or road-to-vehicle communication. May be.

The display control unit 15 performs the following operation in addition to the operations described in the first embodiment and the second embodiment. That is, the display control unit 15 causes the HUD 35 to display visual field event notification information for the driver when the visual field event determination unit 13B detects the occurrence of a visual field event. The HUD 35 includes blind spot event notification information when a blind spot event occurs, visual field event notification information when a visual field event occurs, and both event notification information when both events occur. ,Is displayed.

In FIG. 10, the peripheral event determination unit 13 includes a blind spot event determination unit 13A and a visual field event determination unit 13B. As shown in FIG. 10, the blind spot event determination unit 13A and the visual field event determination unit 13B may be realized as different processes performed in parallel by one module called the peripheral event determination unit 13, or as different module processes. It may be realized. When the blind spot event determination unit 13A and the visual field event determination unit 13B are realized as different processes of the same module, the peripheral event determination unit 13 corresponding to the main thread includes two blind spot event determination units 13A and a visual field event determination unit 13B. A worker thread is generated, and processing is executed while communicating between each worker thread and the main thread.

<D-2. Operation>
Next, the operation of the display control apparatus 104 will be described along the flowchart of FIG. The display control device 104 repeatedly executes the flow of FIG. 11 at a specific timing such as a fixed period. Step S41 and step S42 are the same as step S21 and step S22 of FIG.

The peripheral event determination unit 13 determines whether a peripheral event has occurred (step S43). Peripheral events include both blind spot events and visual field events. Here, the peripheral event determination unit 13 determines that a peripheral event has occurred if at least one of a blind spot event and a visual field event has occurred. The blind spot event determination unit 13A determines whether or not a blind spot event has occurred, and the visual field event determination unit 13B determines whether or not a blind spot event has occurred. If neither a blind spot event nor a visual field event occurs, the peripheral event determination unit 13 determines that no peripheral event has occurred, and the display control device 104 ends the process.

When the peripheral event occurs, the display control unit 15 performs the following processing. First, the display control unit 15 acquires notification information of peripheral events from the display content database 34 (step S44). The display control unit 15 acquires blind spot event notification information when a blind spot event occurs, acquires visual field event notification information when a visual field event occurs, and both events occur. If so, get notification information for both events.

Next, the display control unit 15 specifies the display area of the HUD 35 that displays the notification information of the peripheral event determined to have occurred in step S43 (step S45). Here, the HUD display area that is visually recognized by the driver over the area selected in step S42 is specified as the display area for the blind spot event notification information. Further, as the display area for the visual event notification information, for example, a HUD display area that is visually recognized by the driver over the cause of the visual event is specified.

Next, the display control unit 15 displays the notification information of the peripheral event in the display area of the HUD 35 identified in Step S45 (Step S46).

<D-3. Effect>
With reference to FIG. 12, how the visual field event notification information is displayed on the HUD 35 by the display control processing of the display control device 104 will be described. Here, “the preceding vehicle suddenly stops” is defined as a visual field event. The driver visually recognizes the HUD display area 44 by overlapping a part of the visual field 43. In the HUD display area 44, a rectangular frame 46 </ b> A is displayed as visual field event notification information in an area that is visually recognized by overlapping with a preceding vehicle that has suddenly stopped. Since the driver sees the preceding vehicle as if surrounded by the rectangular frame 46A, the driver's attention is drawn to the preceding vehicle. In addition, a text message 46B “preceding vehicle, sudden stop” is displayed in the lower area 44B of the HUD display area 44 as the visual event information. Thus, the visual field event notification information does not necessarily have to be displayed in the HUD display area that is visually recognized by the driver over the cause of the visual field event.

Referring to FIG. 13, a description will be given of what display is performed on the HUD 35 by the display control processing of the display control device 104 when a visual field event and a blind spot event occur simultaneously. Here, “the preceding vehicle suddenly stops” is defined as a visual field event, and “another vehicle is approaching the target vehicle from the driver's blind spot” is defined as a blind spot event. The HUD display area 44 displays blind spot event notification information 45 in addition to the rectangular frame 46A and the text message 46B as the visual field event notification information shown in FIG. The blind spot event notification information 45 includes an icon 45A indicating the positional relationship between the target vehicle and the other vehicle and character information 45B “approach to other vehicle”, and the driver in the HUD display area 44 moves from the driver to the target vehicle. The change with time is displayed in an area that overlaps with an area where the change with time is small.

As described above, the display control device 104 according to the fourth embodiment includes the visual field event determination unit 13B that determines whether or not a visual field event that should be notified to the driver is generated in the driver's visual field. The control unit 15 controls the HUD 35 so as to display the notification information of the visual field event for the driver in the HUD display area 44 that is visually recognized by the driver over the place where the visual field event occurs. Accordingly, the driver can recognize the visual field event.

<E. Embodiment 5>
<E-1. Configuration>
FIG. 14 is a block diagram showing a configuration of display control apparatus 105 according to Embodiment 5 of the present invention. The display control device 105 includes an event priority setting unit 14 in addition to the configuration of the display control device 104 according to the fourth embodiment. Further, the display control unit 15 performs display control of the CID 36 in addition to the HUD 35. The CID 36 is an example of a non-HUD display device that displays information so that the driver can visually recognize the actual scene outside the vehicle, and a display panel mounted on the instrument panel may be used instead of the CID 36. good.

The event priority setting unit 14 determines that the blind spot event has occurred in the blind spot event determination unit 13A and the visual field event determination unit 13B determines that the visual field event has occurred, that is, the blind spot event and the visual field. When events occur simultaneously, priorities are set for these events. As a quantitative evaluation index of priority, the arrival time of the event to the target vehicle can be mentioned. Here, the arrival time of the event to the target vehicle is the time until the cause of the event reaches the target vehicle. For example, regarding the visual field event that “the preceding vehicle suddenly stopped”, the time until the target vehicle collides with the preceding vehicle has been reached, assuming that the target vehicle has continued to run at the current speed. It will be time. In addition, regarding the blind spot event that “the other vehicle is approaching the target vehicle from the driver's blind spot”, the time until the other vehicle appears in the field of view of the target vehicle is the arrival time. The event priority setting unit 14 sets a higher priority for an event having a shorter arrival time.

The display control unit 15 performs the same operation as that of the fourth embodiment when one of the blind spot event and the visual field event occurs, but sets the event priority when the blind spot event and the visual field event occur simultaneously. The event notification information for which the priority is set high in the unit 14 is displayed on the HUD 35, and the event notification information for which the priority is set low is displayed on the CID 36.

<E-2. Operation>
Next, the operation of the display control apparatus 105 will be described along the flowchart of FIG. The display control apparatus 105 repeatedly performs the flow of FIG. 15 at a specific timing such as a fixed period.

Since step S51 and step S52 are the same as step S21 and step S22 of FIG. 6 described in the second embodiment, description thereof is omitted. Further, step S53 is the same as step S43 of FIG. 11 described in the fourth embodiment, and a description thereof will be omitted.

When the peripheral event determination unit 13 determines in step S53 that a peripheral event has occurred, it determines whether both a blind spot event and a visual field event have occurred (step S54). If both the blind spot event and the visual field event have not occurred in step S54, that is, if only one of the blind spot event and the visual field event has occurred, the process proceeds to step S57.

When both the blind spot event and the visual field event occur in step S54, the event priority setting unit 14 calculates the arrival time of the event to the target vehicle for both events (step S55), and the arrival time is short. An event is set as a high priority event, and an event with a long arrival time is set as a low priority event (step S56).

Next, the display control unit 15 acquires notification information from the display content database 34 (step S57). The notification information to be acquired here is the notification information of both events for which priority is set in step S56 when both the blind spot event and the visual field event occur in step S54. When any of the visual field events occurs, it is notification information of the event that has occurred.

After that, the display control unit 15 determines whether the notification information is both a blind spot event and a visual field event (step S58). If both are displayed, the notification information with low priority is displayed on the CID (step S59). ), The process proceeds to step S59A. If the notification information is one of a blind spot event and a visual field event, the process proceeds to step S59A. In step S59A, the display control unit 15 specifies the display area 44 of the HUD 35 (step S59A). In the display area 44 of the HUD 35, notification information of the event that has occurred is displayed. However, when both the blind spot event and the visual field event have occurred, the notification information of the event whose priority is set high in step S56 is displayed in the display area 44 of the HUD 35. Here, when the notification information displayed in the HUD display area is the blind spot event notification information, the display control unit 15 specifies the HUD display area 44 that is visually recognized by the driver over the area selected in step S32. When the notification information to be displayed on the HUD display area 44 is visual field event notification information, the display control unit 15 specifies the HUD display area 44 that is visually recognized by the driver over the cause of the visual field event, for example.

Finally, the display control unit 15 displays the notification information in the display area 44 of the HUD 35 identified in step S59A (step S59B).

<E-3. Effect>
With reference to FIG. 16, what kind of display is performed on the HUD 35 by the display control process of the display control device 105 when the visual field event and the blind spot event occur simultaneously will be described. Here, “the preceding vehicle suddenly stops” is defined as a visual field event, and “another vehicle is approaching the target vehicle from the driver's blind spot” is defined as a blind spot event. The display control device 105 calculates the arrival time to the target vehicle for each of the blind spot event and the visual field event, and displays a rectangular frame 46A and character information 46B as notification information for the visual field event having a shorter arrival time than the blind spot event in HUD It is displayed in the area 44. The blind spot event notification information is not displayed in the HUD display area 44, but instead is displayed in the CID 36 as character information 46C and an icon 46D indicating the positional relationship between the target vehicle and the other vehicle.

If the notification information of both the visual field event and the blind spot event is displayed in the HUD display area 44 as in the fourth embodiment described with reference to FIG. 13, the driver visually recognizes a lot of information superimposed on the actual scene of the visual field 43. It becomes. However, in the fifth embodiment, the notification information of the event with the higher priority of notification among the visual field event and the blind spot event is displayed in the HUD display area 44, and the notification information of the event with lower priority is displayed on the CID 36. The driver 41 glances at notification information with a low priority on the CID 36 while visually checking the notification information with a moderate amount of information on the visual field 43 in a superimposed manner. Therefore, the display control device 105 has an effect of suppressing the driver from being confused in the short term and an effect of suppressing the driver from ignoring the information in the long term. Furthermore, according to the display control apparatus 105, there is an effect of ensuring the sense of security and the reliability of the system by suppressing the insufficient provision of the notification information to the driver.

That is, the display control apparatus 105 according to the fifth embodiment includes an event priority setting unit 14 that sets priorities for the blind spot event and the visual field event when the blind spot event and the visual field event occur simultaneously. Then, the display control unit 15 controls the HUD 35 so as to display the notification information of the high priority event set by the event priority setting unit 14 among the blind spot event and the visual field event, and the notification information of the low priority event. CID 36 is controlled so as to be displayed. Therefore, the display control device 105 has an effect of suppressing the driver from being confused in the short term and an effect of suppressing the driver from ignoring the information in the long term. Furthermore, according to the display control apparatus 105, there is an effect of ensuring the sense of security and the reliability of the system by suppressing the insufficient provision of the notification information to the driver.

<F. Embodiment 6>
<F-1. Configuration>
FIG. 17 is a block diagram showing a configuration of display control apparatus 106 according to Embodiment 6 of the present invention. In the display control device 106, the display control unit 15 includes a display mode control unit 15B in the configuration of the display control device 102 according to the second embodiment.

When the blind spot event exists across both the driver's field of vision and the blind spot, the display mode control unit 15B changes the display mode of the blind spot event notification information according to the ratio of the blind spot event existing in the driver's field of view. change. Here, transparency is assumed as the display mode to be changed, but a shape such as length or size may be used.

<F-2. Operation>
Next, the operation of the display control apparatus 106 will be described along the flowchart of FIG. The display control apparatus 106 repeatedly executes the flow of FIG. 18 at a specific timing such as a fixed period.

Since steps S61 to S65 are the same as steps S21 to S25 of FIG. 6 described in the second embodiment, the description thereof is omitted.

The display mode control unit 15 </ b> B calculates the ratio of the cause of the blind spot event in the blind spot based on the side video or the rear video of the target vehicle captured by the in-vehicle camera 32 and the visual field information acquired from the visual field detection device 33. (Step S66). Then, the display mode control unit 15B determines whether or not the ratio that the cause of the blind spot event exists in the blind spot is 0% (step S67). If the ratio that the cause of the blind spot event exists in the blind spot is 0% in step S67, the process of the display control device 106 ends.

If the ratio of the cause of the blind spot event in the blind spot is not 0% in step S67, the display mode control unit 15B sets the transparency of the blind spot event notification information according to the ratio (step S68). Specifically, if the ratio of the cause of the blind spot event in the blind spot is 100%, the transmittance is 0%, and if the ratio of the cause of the blind spot event in the blind spot is 30%, the permeability is 70%. As described above, the display mode control unit 15B sets the transparency higher as the proportion of the cause of the blind spot event in the blind spot becomes smaller.

Then, the display control unit 15 causes the HUD 35 to display the blind spot event notification information with the transparency determined in Step S68 in the HUD display area determined in Step S65 (Step S69).

Next, returning to step S66, the display mode control unit 15B calculates again the ratio of the cause of the blind spot event in the blind spot. When the cause of the blind spot event is completely moved to the driver's field of view, the ratio of the cause of the blind spot event in the blind spot is 0% (No in step S67), and the processing of the display control device 106 ends. That is, the display mode control unit 15B calculates the ratio of the cause of the blind spot event repeatedly in the blind spot until the ratio of the cause of the blind spot event in the blind spot becomes 0% (step S66), and according to the ratio The transparency of the blind spot event notification information is changed (step S68).

Through the above operation, when the cause of the blind spot event moves from the driver's blind spot to the field of view, the transparency of the blind spot event notification information gradually increases until the cause of the blind spot event completely moves to the driver's field of view. Become.

<F-3. Effect>
When another vehicle approaches the target vehicle from the driver's blind spot and appears in the driver's field of view, how the transmission of the blind spot event notification information in the HUD 35 changes under the display control of the display control device 106. explain. Here, “the other vehicle is approaching the target vehicle from the blind spot of the driver” is defined as a blind spot event, and the other vehicle approaching is the cause of the blind spot event.

FIG. 19 shows that the HUD 35 is obtained when the other vehicle 42 travels on the right rear side of the target vehicle 40 and the ratio of the vehicle 42 existing in the driver's blind spot 53 is 100%. Is shown. In the lower area 44B of the HUD display area 44, character information 45A and icons 45B, which are notification information for prompting attention to the other vehicle 42, are displayed. At this time, the transparency of the character information 45A and the icon 45B is 0%, and is clearly visible to the driver.

FIG. 20 shows a display of the HUD 35 when the other vehicle 42 travels in front of the right side of the target vehicle 40 and a part thereof appears in the driver's field of view 43. The rate at which the other vehicle 42 is present in the driver's blind spot 53 is 30%. At this time, the transparency of the character information 45A and the icon 45B, which are notification information of the blind spot event, is 70%, and the visibility by the driver is lowered.

FIG. 21 shows a display of the HUD 35 when the other vehicle 42 travels in front of the right side of the target vehicle 40 and the other vehicle 42 completely appears in the driver's field of view 43. The ratio that the other vehicle 42 exists in the driver's blind spot 53 is 0%. At this time, since the display control unit 15 does not display the blind spot event notification information, the driver does not visually recognize the blind spot event notification information. In other words, the transparency of the blind spot event notification information is 100%.

When the other vehicle 42 overtakes the target vehicle 40, the display on the HUD 35 of the blind spot event notification information that informs the approach of the other vehicle 42 transitions in the order of FIG. 19, FIG. 20, and FIG. The blind spot event notification information does not suddenly disappear when the other vehicle 42 appears in the driver's field of view 43, but gradually disappears. Therefore, when the other vehicle 42 appears in the driver's visual field 43 and the notification information of the other vehicle 42 is superimposed on the position of the other vehicle 42 and displayed on the HUD 35, the other vehicle 42 is in the driver's blind spot 53. Continuity of the display mode is ensured by the notification information and the notification information after the other vehicle 42 appears in the driver's visual field 43. Therefore, the uncomfortable feeling caused by a sudden change in the display mode of the notification information at the timing when the cause of the blind spot event moves from the blind spot 53 of the driver to the visual field 43 is reduced.

As described above, in the display control device 106 according to the sixth embodiment, when the blind spot event exists across the driver's visual field and the blind spot, the display control unit 15 responds to the ratio of the blind spot event existing in the driver's visual field. Thus, the display mode of the blind spot event notification information is changed. Therefore, the uncomfortable feeling due to a sudden change in the display mode of the notification information at the timing when the cause of the blind spot event moves from the blind spot of the driver to the field of view is reduced.

<G. Embodiment 7>
<G-1. Configuration>
FIG. 22 is a block diagram showing a configuration of display control apparatus 107 according to Embodiment 7 of the present invention. The configuration of the display control apparatus 107 is the same as the configuration of the display control apparatus 102 according to the second embodiment. However, the display control unit 15 performs display control of the CID 36 in addition to the HUD 35.

The CID 36 is an example of a non-HUD display device that displays information so that the driver can visually recognize the actual scene outside the vehicle, and a display panel mounted on the instrument panel may be used instead of the CID 36. good.

In addition to the operations described in the first and second embodiments, the display control unit 15 displays the driver's visual field 43, the HUD display area 44, and an icon representing the positional relationship of the blind spot event on the CID 36. Hereinafter, this icon is referred to as a positional relationship icon 50.

FIG. 23 shows an example of the positional relationship icon 50. In the overhead view of the target vehicle 40, the positional relationship icon 50 is the position of the driver's visual field 43, blind spot 53, HUD display area 44, and other vehicle 42 that is a blind spot event in a circle centered on the target vehicle 40. Represents a relationship. 44A in FIG. 23 represents the viewing angle of the driver corresponding to the HUD display area 44. In the positional relationship icon 50, the HUD display area 44 is included in a part of the visual field 43. The display control unit 15 reflects the position of the other vehicle 42 on the positional relationship icon 50 based on the side or rear image of the target vehicle by the in-vehicle camera 32. In addition, the display control unit 15 acquires visual field information from the visual field detection device 33 and reflects the change in the visual field of the driver on the positional relationship icon 50. That is, if the driver's visual field changes, the display control unit 15 changes the boundary 51 between the visual field 43 and the blind spot 53 in the positional relationship icon 50 accordingly.

Note that an arrow 54 in FIG. 23 indicates a change in the driver's visual field in the left-right direction, and an arrow 55 indicates a change in the driver's visual field in the vertical direction.

<G-2. Operation>
Next, the operation of the display control apparatus 107 will be described along the flowchart of FIG. The display control apparatus 107 repeatedly executes the flow of FIG. 24 at a specific timing such as a fixed period.

Since Steps S71 to S76 are the same as Steps S21 to S26 of FIG. 6 described in the second embodiment, description thereof is omitted.

In step S77, the display control unit 15 displays the positional relationship icon on the CID 36.

<G-3. Effect>
FIG. 25 shows display control of the display control device 107 when a blind spot event “an other vehicle is approaching the target vehicle from the driver's blind spot” occurs. In the HUD display area 44, blind spot event notification information 45 is displayed in an area 44B that is visually recognized by the driver so as to overlap with a real scene with little temporal change. Further, the driver's visual field 43, the HUD display area 44, and a positional relationship icon 50 representing the positional relationship of the blind spot event are displayed on the CID 36.

The driver can grasp the position relationship between his / her field of view, blind spot, and blind spot event from a bird's-eye view using the position relationship icon 50.

In the display control apparatus 107 according to the seventh embodiment, the display device includes a non-HUD display device that displays information so that the driver can visually recognize the actual scene outside the target vehicle. And the display control part 15 displays the icon showing the positional relationship of a visual field area | region, a blind spot area | region, and a blind spot event on a non-HUD display apparatus. Therefore, the driver can grasp the position relationship of his / her visual field, blind spot, and blind spot event from a bird's-eye view using the positional relationship icon 50.

<H. Hardware configuration>
In the display control devices 101 to 107 of the present invention, the vehicle movement determination unit 11, the region specifying unit 12, the peripheral event determination unit 13, the event priority setting unit 14, and the display control unit 15 are processed by a processing circuit 81 shown in FIG. Realized. That is, the processing circuit 81 includes the vehicle movement determination unit 11, the region specifying unit 12, the surrounding event determination unit 13, the event priority setting unit 14, and the display control unit 15 (hereinafter referred to as “vehicle movement determination unit 11 etc.”). Is provided. Dedicated hardware may be applied to the processing circuit 81, or a processor that executes a program stored in the memory may be applied. The processor is, for example, a central processing unit, a processing unit, an arithmetic unit, a microprocessor, a microcomputer, a DSP (Digital Signal Processor) or the like.

When the processing circuit 81 is dedicated hardware, the processing circuit 81 includes, for example, a single circuit, a composite circuit, a programmed processor, a processor programmed in parallel, an ASIC (Application Specific Integrated Circuit), an FPGA (Field-). Programmable (Gate Array) or a combination of these. Each function of each unit such as the vehicle movement determination unit 11 may be realized by a plurality of processing circuits 81, or the function of each unit may be realized by a single processing circuit.

When the processing circuit 81 is a processor, the functions of the vehicle movement determination unit 11 and the like are realized by a combination with software or the like (software, firmware or software and firmware). Software or the like is described as a program and stored in a memory. As shown in FIG. 27, the processor 82 applied to the processing circuit 81 reads out and executes the program stored in the memory 83, thereby realizing the function of each unit. That is, when the display control devices 101 to 107 are executed by the processing circuit 81, the temporal change of the pixel value is predetermined in the photographed image of the actual scene outside the target vehicle viewed from the driver of the target vehicle. A pixel area smaller than the selected value as a selection area, a step of determining whether or not a blind spot event to be notified to the driver at the driver's blind spot occurs, and a driver visually confirming the selection area. And a memory 83 for storing a program to be executed as a result of controlling the HUD 35 so as to display the notification information of the blind spot event for the driver in the display area of the HUD 35 to be displayed. In other words, it can be said that this program causes the computer to execute procedures and methods such as the vehicle movement determination unit 11. Here, the memory 83 is a nonvolatile memory such as RAM (Random Access Memory), ROM (Read Only Memory), flash memory, EPROM (Electrically Programmable Read Only Memory), EEPROM (Electrically Erasable Programmable Read Only Memory), or the like. Or volatile semiconductor memory, HDD (Hard Disk Drive), magnetic disk, flexible disk, optical disk, compact disk, mini disk, DVD (Digital Versatile Disk) and its drive device, or any storage media used in the future There may be.

As described above, the configuration in which each function of the vehicle movement determination unit 11 or the like is realized by either hardware or software has been described. However, the present invention is not limited to this, and a configuration in which a part of the vehicle movement determination unit 11 or the like is realized by dedicated hardware and another part is realized by software or the like. For example, the function of the display control unit 15 is realized by a processing circuit as dedicated hardware, and otherwise the processing circuit 81 as the processor 82 reads and executes the program stored in the memory 83. A function can be realized.

As described above, the processing circuit can realize the functions described above by hardware, software, or the like, or a combination thereof.

Further, the display control devices 101 to 107 of the present invention may be devices mounted on a target vehicle, or may be an in-vehicle device, a PND (Portable Navigation Device), a communication terminal (for example, a mobile phone, a smartphone, a tablet, etc.). The present invention can also be applied to a system constructed as a system by appropriately combining a mobile terminal), functions of applications installed therein, a server, and the like. In this case, each function or each component of the display control apparatuses 101 to 107 described above may be distributed and arranged in each device constituting the system, or may be concentrated on any one of the devices. Also good. For example, as shown in FIG. 28, the display control unit 15 of the display control device 102 may be arranged in the in-vehicle device, and the region specifying unit 12 and the peripheral event determination unit 13 may be arranged in the server.

The present invention can be freely combined with each embodiment and each modification within the scope of the invention, or can be appropriately modified or omitted with each embodiment and each modification.

Although the present invention has been described in detail, the above description is illustrative in all aspects, and the present invention is not limited thereto. Innumerable variations not illustrated can be envisaged without departing from the scope of the present invention.

11 vehicle movement determination unit, 12 area identification unit, 13 surrounding event determination unit, 13A blind spot event determination unit, 13B visual field event determination unit, 14 event priority setting unit, 15 display control unit, 15A display content classification unit, 15B display mode Control unit, 31 vehicle speed sensor, 32 in-vehicle camera, 33 visual field detection device, 34 display content database, 35 HUD, 36 CID, 40 target vehicle, 41 driver, 42 other vehicle, 43 visual field, 44 HUD display area, 81 processing circuit , 82 processor, 83 memory, 101-107 display control device.

Claims (12)

1. An area specifying unit that selects, as a selection area, a pixel area whose temporal change in pixel value is smaller than a predetermined value in a photographed image of a real scene outside the target vehicle viewed from the driver of the target vehicle;
   A blind spot event determination unit that determines whether or not a blind spot event that should be notified to the driver at the driver's blind spot occurs,
   A display control unit that performs display control of a display device provided in the target vehicle,
   The display device includes a HUD that displays information from the driver so that the driver can visually recognize the actual scene outside the target vehicle,
   The display control unit controls the HUD to display the blind spot event notification information for the driver in a display area of the HUD that is visually recognized by the driver so as to overlap the selection area.
   Display control device.
2. The captured image is an image captured by a camera mounted on the target vehicle.
   The display control apparatus according to claim 1.
3. When there are a plurality of the selection areas, the display control unit displays the blind spot event notification information in the display area of the HUD that is visually recognized by overlapping the selection area with the smallest relative position change with the target vehicle. Control the HUD,
   The display control apparatus according to claim 1.
4. The display device includes a non-HUD display device that displays information from the driver so as to be viewed without overlapping with a real scene outside the target vehicle,
   The display control unit classifies the blind spot event notification information into first notification information and second notification information having a larger amount of information than the first notification information, and displays the first notification information on the HUD, Displaying second notification information on the non-HUD display device;
   The display control apparatus according to claim 1.
5. The first notification information is character information, and the second notification information is non-character information.
   The display control apparatus according to claim 4.
6. A visual event determining unit that determines whether or not a visual event to be notified to the driver is occurring in the driver's visual field;
   The display control unit controls the HUD to display the visual event notification information for the driver in a display area of the HUD that is visually recognized from the driver by overlapping with the visual event occurrence location.
   The display control apparatus according to claim 1.
7. An event priority setting unit that sets a priority for the blind spot event and the visual field event when the blind spot event and the visual field event occur simultaneously;
   The display control unit controls the HUD so as to display notification information of a high priority event set by the event priority setting unit among the blind spot event and the visual field event.
   The display control apparatus according to claim 6.
8. The display device includes a non-HUD display device that displays information from the driver so as to be viewed without overlapping with a real scene outside the target vehicle,
   The event priority setting unit sets a priority for the visual field event and the blind spot event based on the arrival time of the blind spot event and the visual field event to the target vehicle,
   The display control unit controls the non-HUD display device so as to display notification information of a low priority event set by the event priority setting unit among the visual field event and the blind spot event.
   The display control apparatus according to claim 7.
9. When the blind spot event exists across the driver's visual field and blind spot, the display control unit displays the blind spot event notification information according to a ratio of the blind spot event existing in the driver's visual field. Change the aspect,
   The display control apparatus according to claim 1.
10. The display mode is transparency or shape.
    The display control apparatus according to claim 9.
11. The display device includes a non-HUD display device that displays information from the driver so as to be viewed without overlapping with a real scene outside the target vehicle,
    The display control unit causes the non-HUD display device to display an icon representing a positional relationship between a visual field region, a blind spot region, and the blind spot event.
    The display control apparatus according to claim 1.
12. In the photographed image of the actual scene outside the target vehicle as viewed from the driver of the target vehicle, a pixel area whose pixel value change with time is smaller than a predetermined value is selected as a selection area,
    Determining whether there is a blind spot event that should be notified to the driver at the driver's blind spot,
    Display control of a display device including a HUD that is provided in the target vehicle and displays information so that the driver can visually recognize the actual scene outside the target vehicle,
    The display control includes controlling the HUD so as to display notification information of the blind spot event for the driver in a display area of the HUD that is visually recognized by the driver so as to overlap the selection area.
    Display control method.

Images