WO2018163266A1 - Dispositif et procédé de commande d'affichage - Google Patents

Dispositif et procédé de commande d'affichage Download PDF

Info

Publication number
WO2018163266A1
WO2018163266A1 PCT/JP2017/008915 JP2017008915W WO2018163266A1 WO 2018163266 A1 WO2018163266 A1 WO 2018163266A1 JP 2017008915 W JP2017008915 W JP 2017008915W WO 2018163266 A1 WO2018163266 A1 WO 2018163266A1
Authority
WO
WIPO (PCT)
Prior art keywords
event
blind spot
display control
driver
display
Prior art date
Application number
PCT/JP2017/008915
Other languages
English (en)
Japanese (ja)
Inventor
裕史 狩田
下谷　光生
怜奈 佐々木
Original Assignee
三菱電機株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 三菱電機株式会社 filed Critical 三菱電機株式会社
Priority to PCT/JP2017/008915 priority Critical patent/WO2018163266A1/fr
Priority to JP2019504157A priority patent/JP6703183B2/ja
Publication of WO2018163266A1 publication Critical patent/WO2018163266A1/fr

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Arrangement of adaptations of instruments
    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • G08G1/16—Anti-collision systems

Definitions

  • the present invention relates to display control of HUD (Head-Up Display).
  • HUD augmented reality
  • Patent Document 1 discloses a vehicle peripheral information display system using HUD.
  • the vehicle peripheral information display system of Patent Document 1 predicts the future behavior of another vehicle approaching from outside the HUD display area, predicts the position where the other vehicle enters the display area, and predicts the position.
  • the driver is alerted by superimposing a warning virtual image that emphasizes other vehicles.
  • the alert image is displayed so as to overlap the object or its surroundings when viewed from the driver.
  • the other vehicle when alerting the driver that the other vehicle is approaching from the driver's blind spot, the other vehicle is outside the display area of the HUD, so the alert image is viewed from the driver as the other vehicle or It is not displayed so as to overlap the periphery, but is displayed superimposed on other areas.
  • the position of the other vehicle recalled from the alert image is different from the actual position of the other vehicle, which gives the driver a sense of incongruity due to this difference.
  • the present invention has been made in view of the above-mentioned problems, and an object thereof is to display notification information of an event that has occurred in a driver's blind spot on the HUD without a sense of incongruity.
  • the display control device includes an area specifying unit, a blind spot event determining unit, and a display control unit.
  • the region specifying unit selects, as a selection region, a pixel region in which a temporal change in pixel value is smaller than a predetermined value in a photographed image of a real scene outside the target vehicle viewed from the driver of the target vehicle.
  • the blind spot event determination unit determines whether or not a blind spot event that should be notified to the driver is occurring at the driver's blind spot.
  • the display control unit performs display control of a display device provided in the target vehicle.
  • the display device includes a HUD that displays information so that the driver can visually recognize the actual scene outside the target vehicle.
  • the display control unit controls the HUD so as to display the notification information of the blind spot event for the driver in the display area of the HUD that is visually recognized by the driver so as to overlap the selected area.
  • the display control apparatus allows the blind spot event notification information to be visually recognized by the driver as overlapping with an area where the temporal change is small in the actual scene outside the target vehicle. Since it is difficult for the driver to pay attention to an area where the change with time is small, he / she does not pay too much attention to the notification information of the blind spot event. Therefore, the driver feels uncomfortable due to the difference between the display position of the blind spot event notification information and the position of the blind spot event.
  • the HUD that performs display control by the display control apparatus according to the present invention is referred to as a target vehicle, a vehicle other than the target vehicle is referred to as another vehicle, and the two are distinguished.
  • the same or corresponding components among the components of the invention described below are described with the same reference numerals in the drawings.
  • the HUD is an example of a display device that can be displayed in a superimposed manner in the driver's visual field area, and the present invention can be applied to other display devices as long as the display device can be displayed in a superimposed manner in the driver's visual field area.
  • FIG. 1 is a block diagram showing a configuration of display control apparatus 101 according to Embodiment 1 of the present invention.
  • the display control apparatus 101 includes an area specifying unit 12, a peripheral event determination unit 13, and a display control unit 15.
  • the peripheral event determination unit 13 includes a blind spot event determination unit 13A.
  • the display control device 101 is connected to the in-vehicle camera 32, the visual field detection device 33, the display content database 34, and the HUD 35, and is configured to be able to use them.
  • the in-vehicle camera 32 is mounted on the target vehicle and images the front, side, and rear of the target vehicle.
  • the front image of the target vehicle photographed by the in-vehicle camera 32 is used for processing to be described later by the region specifying unit 12.
  • the side image and the rear image of the target vehicle captured by the in-vehicle camera 32 are used for the later-described process by the blind spot event determination unit 13A.
  • the visual field detection device 33 detects the driver's visual field from the driver's face direction or line of sight, and outputs the detection result to the display control device 101 as visual field information.
  • the field of view information is defined by the range of angles in the vertical and horizontal directions around the face direction or line of sight.
  • the visual field information is used for processing described later by the blind spot event determination unit 13A.
  • the display content database 34 is a storage unit that stores display content such as images to be displayed on the HUD 35.
  • the display content database 34 is configured by an HDD (Hard Disk Drive) mounted on the target vehicle as an example, but may be configured by a cloud or a server.
  • the format of the image data stored in the display content database 34 is assumed to be a 32-bit bitmap format having an ⁇ value in order to support transmission control. However, PNG (Portable) capable of transmission control and lossless compression is used for capacity reduction. An image format such as (Network Graphics) may be used.
  • the HUD 35 is installed in front of the target vehicle, and displays the display content stored in the display content database 34 under the control of the display control unit 15.
  • the HUD 35 is assumed to be a combiner type installed on the dashboard of the target vehicle and covering a part of the windshield.
  • a windshield type covering the entire surface of the windshield may be used.
  • the area specifying unit 12 divides the front image of the target vehicle captured by the in-vehicle camera 32 into an area where the change with time is small and an area where it is not.
  • As a quantitative evaluation index for area division there is a time-series standard deviation of a pixel value of a specific pixel of interest.
  • the region specifying unit 12 may use a predetermined minimum pixel block as a target pixel block and use a time-series standard deviation of the average pixel value of the target pixel block. In this case, the region specifying unit 12 can perform region division while avoiding the influence of camera noise or disturbance.
  • the region specifying unit 12 regards a target pixel or a target pixel block whose standard deviation is equal to or less than a predetermined threshold as a change with time.
  • the region specifying unit 12 selects the pixel or pixel block of interest To integrate.
  • the area specifying unit 12 divides the front image of the target vehicle into an area where the temporal change is small and an area where it is not so by performing this integration process on all pixels or all pixel blocks.
  • an area divided by the area specifying unit 12 as an area having a small change with time is referred to as a selection area.
  • the region specifying unit 12 selects a pixel region in which an index indicating a temporal change of the pixel value is smaller than a predetermined value in a captured image of a real scene outside the target vehicle viewed from the driver of the target vehicle. Select as region.
  • the blind spot event determination unit 13 ⁇ / b> A is a blind spot event to be notified to the driver at the driver's blind spot based on the side or rear video of the target vehicle captured by the in-vehicle camera 32 and the visual field information acquired from the visual field detection device 33. It is determined whether or not this has occurred.
  • an event that occurs in the vicinity of the target vehicle and should be notified to the driver is defined as a peripheral event
  • an event that occurs in the driver's blind spot among the peripheral events is a blind spot event
  • an event that occurs in the driver's field of view Let it be an event.
  • the event that should be notified to the driver is an event that may affect the target vehicle.
  • An example of the blind spot event is that another vehicle is approaching from the right lane while the target vehicle is traveling in the left lane, for example.
  • the blind spot event determination unit 13A determines the presence or absence of a blind spot event based on the video of the in-vehicle camera 32. May be.
  • the display control unit 15 When the blind spot event determination unit 13A determines that a blind spot event has occurred, the display control unit 15 provides information for notifying the driver of the blind spot event (hereinafter simply referred to as “dead spot event notification information”). Display) on the HUD 35.
  • the display control unit 15 acquires display content corresponding to the blind spot event from the display content database 34 as blind spot event notification information.
  • the display control unit 15 controls the HUD 35 so that the blind spot event notification information is displayed in a region that is overlapped with the region selected by the region specifying unit 12 in the display region of the HUD 35 and visually recognized by the driver.
  • the display control unit 15 controls the HUD 35 to display the blind spot event notification information in the display area of the HUD 35 that is visually recognized by overlapping the selection area with the smallest relative position change with the target vehicle.
  • the display control unit 15 specifies a selection region having the smallest sum of optical flows of feature points included in the selection region.
  • the blind spot event notification information is displayed stably in an area other than the actual scene in front of the target vehicle (including a part of the target vehicle) in the HUD 35 as much as possible, so that the display position of the blind spot event notification information and the actual blind spot are displayed. The discomfort felt by the driver due to the deviation from the event occurrence position is reduced.
  • the area specifying unit 12 selects, from the front image of the in-vehicle camera 32, an area where the change with time during traveling is small (step S11).
  • the blind spot event determination unit 13A determines whether a blind spot event has occurred (step S12). If no blind spot event has occurred in step S12, the display control process ends.
  • step S12 the display control unit 15 performs the following processing. First, the display controller 15 acquires blind spot event notification information from the display content database 34 (step S13).
  • the display control unit 15 specifies the display area of the HUD 35 that displays the blind spot event notification information (step S14).
  • the display control unit 15 specifies a region that is visually recognized by the driver so as to overlap the selected region of the front image of the in-vehicle camera 32.
  • the display control unit 15 displays blind spot event notification information in the display area of the HUD 35 identified in step S14 (step S15).
  • FIG. 3 shows a display by a display control device of a comparative example of the present invention.
  • the other vehicle is approaching the target vehicle from the driver's blind spot” is defined as a blind spot event.
  • the field of view 43 of the driver 41 shows a real scene outside the target vehicle such as the bonnet, road, and guardrail of the target vehicle.
  • the driver 41 visually recognizes a display area (hereinafter referred to as “HUD display area”) 44 of the HUD 35 so as to overlap a part of the visual field 43. Therefore, the driver 41 can visually recognize the display of the HUD 35 without greatly moving the line of sight.
  • HUD display area a display area
  • blind spot event notification information 45A and 45B are displayed. Since the region 44A is visually recognized by the driver 41 so as to overlap with a road or the like, a change with the passage of time of the target vehicle is large. Therefore, the driver 41 is greatly attracted to the blind spot event notification information 45. The driver 41 feels uncomfortable because there is a difference between the display position of the blind spot event notification information 45 and the position of the other vehicle 42.
  • the blind spot event notification information 45 is displayed in the lower area 44B of the HUD display area 44 as shown in FIG. .
  • the region 44B is a region that is visually recognized by being overlapped with the hood of the target vehicle when viewed from the driver 41, and since the change with time associated with the traveling of the target vehicle is small, it is difficult for the driver 41 to pay attention.
  • the display control apparatus 101 dares to display the blind spot event notification information 45 in an area where it is difficult for the driver 41 to pay attention, so that the driver 41 does not pay too much attention to the blind spot event notification information 45. Like that. Therefore, the uncomfortable feeling due to the difference between the display position of the blind spot event notification information 45 and the position of the other vehicle 42 that is the blind spot event is reduced.
  • the display control apparatus 101 includes an area specifying unit 12, a blind spot event determining unit 13A, and a display control unit 15. Then, the area specifying unit 12 selects, as a selection area, a pixel area in which an index indicating a temporal change of the pixel value is smaller than a predetermined value in a photographed image of a real scene outside the target vehicle viewed from the driver 41. To do.
  • the blind spot event determination unit 13A determines whether or not a blind spot event that should be notified to the driver is occurring at the driver's blind spot.
  • the display control unit 15 performs display control of a display device provided in the target vehicle.
  • the display device includes a HUD 35 that displays information so that the driver 41 can visually recognize the actual scene outside the target vehicle.
  • the display control unit 15 controls the HUD 35 so that the blind spot event notification information 45 for the driver 41 is displayed in the HUD display area 44 that is visually recognized by the driver 41 so as to overlap the selected area.
  • the display control device 101 dares to display the blind spot event notification information 45 in an area where it is difficult for the driver 41 to pay attention. Therefore, the driver 41 may excessively pay attention to the blind spot event notification information 45. Absent. Therefore, the uncomfortable feeling due to the difference between the display position of the blind spot event notification information 45 and the position of the other vehicle 42 that is the blind spot event is reduced.
  • FIG. 5 is a block diagram showing a configuration of display control apparatus 102 according to Embodiment 2 of the present invention.
  • the display control apparatus 102 includes a vehicle movement determination unit 11 in addition to the configuration of the display control apparatus 101 according to the first embodiment.
  • the vehicle speed sensor 31 detects the vehicle speed of the target vehicle and outputs the detection result to the vehicle movement determination unit 11. For example, the vehicle speed sensor 31 outputs a value other than 0 when the target vehicle is in a running state, and outputs 0 when the target vehicle is in a stopped state.
  • the vehicle movement determination unit 11 acquires the vehicle speed of the target vehicle from the vehicle speed sensor 31, and determines whether the target vehicle is running based on this.
  • the operations of the area specifying unit 12, the surrounding event determining unit 13, and the display control unit 15 described in the first embodiment are performed only when the vehicle movement determining unit 11 determines that the target vehicle is running. Is called.
  • the vehicle movement determination unit 11 determines whether or not the target vehicle is traveling based on information from the vehicle speed sensor 31 (step S21). If the target vehicle is not traveling in step S21, the display control process ends.
  • Step S21 If the target vehicle is traveling in step S21, the display control process proceeds to step S22. Steps S22 to S26 are the same as steps S11 to S15 in FIG.
  • the display control device 102 includes a vehicle movement determination unit 11 in addition to the configuration of the display control device 101.
  • the display control device 102 performs display control of the blind spot event notification information for the HUD 35 only when the vehicle movement determination unit 11 determines that the target vehicle is traveling. Therefore, since the blind spot event notification information is not displayed on the HUD 35 while the target vehicle is stopped, it is possible to prevent the driver from viewing the blind spot event notification information unnecessarily.
  • FIG. 7 is a block diagram showing a configuration of display control apparatus 103 according to Embodiment 3 of the present invention.
  • the display control apparatus 103 includes the display content classification unit 15A. Further, the display control unit 15 performs display control of a CID (Center Information Display) 36 in addition to the HUD 35.
  • CID Center Information Display
  • the display content classification unit 15A classifies the blind spot event notification information into first notification information and second notification information according to the amount of information.
  • the second notification information has a larger amount of information than the first notification information.
  • the display content classification unit 15A can classify, for example, character information as first notification information and non-character information such as an illustration showing a positional relationship between the target vehicle and the cause of the alert target as second notification information.
  • the display destination of the first notification information is HUD 35, and the display destination of the second notification information is CID 36.
  • CID 36 is a display that is displayed in front of the driver's seat of the target vehicle.
  • the main application of the CID 36 is to display a map of a car navigation device.
  • the CID 36 is becoming increasingly sophisticated as a multi-function display used for a parking assist function using an on-vehicle camera image, air conditioning operation, fuel efficiency information display, and the like.
  • the CID 36 is an example of a non-HUD display device that displays information so that the driver can visually recognize the actual scene outside the target vehicle without overlapping. Therefore, instead of the CID 36, a display panel mounted on another non-HUD display device, for example, an instrument panel (hereinafter referred to as “instrument panel”) may be used.
  • the instrument panel refers to instruments such as a speedometer, tachometer, fuel gauge, water temperature gauge, and distance meter installed in front of the driver's seat of the vehicle, and generally has an analog display.
  • instruments such as a speedometer, tachometer, fuel gauge, water temperature gauge, and distance meter installed in front of the driver's seat of the vehicle, and generally has an analog display.
  • the number of instrument panels for digital display equipped with a display panel has increased.
  • Steps S31 to S34 are the same as steps S21 to S24 in FIG.
  • the display content classification unit 15A classifies the blind spot event notification information acquired by the display control unit 15 in step S34 into first notification information and second notification information (step S35). For example, character information is classified as first notification information, and other information is classified as second notification information.
  • the display control unit 15 specifies the display area of the HUD 35 that displays the first notification information (step S36).
  • an area that is visually recognized by the driver is identified by overlapping the area selected in step S32.
  • the display control unit 15 controls the HUD 35 so that the first notification information is displayed in the display area specified in step S36 (step S37).
  • the display control unit 15 displays the second notification information on the CID 36 (step S38).
  • the blind spot event notification information includes character information 45 ⁇ / b> A “approach to other vehicle” and an icon 45 ⁇ / b> B indicating a positional relationship between the target vehicle and the other vehicle.
  • Character information 45A is displayed in the area 44B below the HUD display area 44, and an icon 45B is displayed in the CID 36.
  • the display device includes a non-HUD display device that displays information so that the driver can visually recognize the actual scene outside the target vehicle without overlapping, and display control is performed.
  • the unit 15 classifies the blind spot event notification information 45 into first notification information and second notification information having a larger amount of information than the first notification information, causes the first notification information to be displayed on the HUD 35, and Display on HUD display device. Therefore, information is not excessively displayed in the driver's visual field 43.
  • the display control apparatus 103 in addition to the effect of Embodiment 2, it has the effect of preventing the driver's confusion in the short term, and the driver ignores the information in the long term. This has the effect of preventing this.
  • FIG. 10 is a block diagram showing a configuration of display control apparatus 104 according to Embodiment 4 of the present invention.
  • the display control apparatus 104 includes the peripheral event determination unit 13 and the visual field event determination unit 13B.
  • the visual field event determination unit 13B is based on the front image or the side image of the target vehicle captured by the in-vehicle camera 32 and the visual field information acquired from the visual field detection device 33. It is determined whether or not this has occurred.
  • the event to be notified to the driver is an event that may affect the target vehicle. For example, the preceding vehicle has suddenly stopped.
  • the visual field event determination unit 13B determines whether or not a visual field event has occurred based on the image of the in-vehicle camera 32.
  • the visual field event determination unit 13B determines using the information received by inter-vehicle communication or road-to-vehicle communication. May be.
  • the display control unit 15 performs the following operation in addition to the operations described in the first embodiment and the second embodiment. That is, the display control unit 15 causes the HUD 35 to display visual field event notification information for the driver when the visual field event determination unit 13B detects the occurrence of a visual field event.
  • the HUD 35 includes blind spot event notification information when a blind spot event occurs, visual field event notification information when a visual field event occurs, and both event notification information when both events occur. ,Is displayed.
  • the peripheral event determination unit 13 includes a blind spot event determination unit 13A and a visual field event determination unit 13B.
  • the blind spot event determination unit 13A and the visual field event determination unit 13B may be realized as different processes performed in parallel by one module called the peripheral event determination unit 13, or as different module processes. It may be realized.
  • the peripheral event determination unit 13 corresponding to the main thread includes two blind spot event determination units 13A and a visual field event determination unit 13B. A worker thread is generated, and processing is executed while communicating between each worker thread and the main thread.
  • Step S41 and step S42 are the same as step S21 and step S22 of FIG.
  • the peripheral event determination unit 13 determines whether a peripheral event has occurred (step S43). Peripheral events include both blind spot events and visual field events. Here, the peripheral event determination unit 13 determines that a peripheral event has occurred if at least one of a blind spot event and a visual field event has occurred. The blind spot event determination unit 13A determines whether or not a blind spot event has occurred, and the visual field event determination unit 13B determines whether or not a blind spot event has occurred. If neither a blind spot event nor a visual field event occurs, the peripheral event determination unit 13 determines that no peripheral event has occurred, and the display control device 104 ends the process.
  • the display control unit 15 When the peripheral event occurs, the display control unit 15 performs the following processing. First, the display control unit 15 acquires notification information of peripheral events from the display content database 34 (step S44). The display control unit 15 acquires blind spot event notification information when a blind spot event occurs, acquires visual field event notification information when a visual field event occurs, and both events occur. If so, get notification information for both events.
  • the display control unit 15 specifies the display area of the HUD 35 that displays the notification information of the peripheral event determined to have occurred in step S43 (step S45).
  • the HUD display area that is visually recognized by the driver over the area selected in step S42 is specified as the display area for the blind spot event notification information.
  • the display area for the visual event notification information for example, a HUD display area that is visually recognized by the driver over the cause of the visual event is specified.
  • the display control unit 15 displays the notification information of the peripheral event in the display area of the HUD 35 identified in Step S45 (Step S46).
  • the preceding vehicle suddenly stops is defined as a visual field event.
  • the driver visually recognizes the HUD display area 44 by overlapping a part of the visual field 43.
  • a rectangular frame 46 ⁇ / b> A is displayed as visual field event notification information in an area that is visually recognized by overlapping with a preceding vehicle that has suddenly stopped. Since the driver sees the preceding vehicle as if surrounded by the rectangular frame 46A, the driver's attention is drawn to the preceding vehicle.
  • a text message 46B “preceding vehicle, sudden stop” is displayed in the lower area 44B of the HUD display area 44 as the visual event information.
  • the visual field event notification information does not necessarily have to be displayed in the HUD display area that is visually recognized by the driver over the cause of the visual field event.
  • the HUD display area 44 displays blind spot event notification information 45 in addition to the rectangular frame 46A and the text message 46B as the visual field event notification information shown in FIG.
  • the blind spot event notification information 45 includes an icon 45A indicating the positional relationship between the target vehicle and the other vehicle and character information 45B “approach to other vehicle”, and the driver in the HUD display area 44 moves from the driver to the target vehicle.
  • the change with time is displayed in an area that overlaps with an area where the change with time is small.
  • the display control device 104 includes the visual field event determination unit 13B that determines whether or not a visual field event that should be notified to the driver is generated in the driver's visual field.
  • the control unit 15 controls the HUD 35 so as to display the notification information of the visual field event for the driver in the HUD display area 44 that is visually recognized by the driver over the place where the visual field event occurs. Accordingly, the driver can recognize the visual field event.
  • FIG. 14 is a block diagram showing a configuration of display control apparatus 105 according to Embodiment 5 of the present invention.
  • the display control device 105 includes an event priority setting unit 14 in addition to the configuration of the display control device 104 according to the fourth embodiment. Further, the display control unit 15 performs display control of the CID 36 in addition to the HUD 35.
  • the CID 36 is an example of a non-HUD display device that displays information so that the driver can visually recognize the actual scene outside the vehicle, and a display panel mounted on the instrument panel may be used instead of the CID 36. good.
  • the event priority setting unit 14 determines that the blind spot event has occurred in the blind spot event determination unit 13A and the visual field event determination unit 13B determines that the visual field event has occurred, that is, the blind spot event and the visual field.
  • priorities are set for these events.
  • the arrival time of the event to the target vehicle can be mentioned.
  • the arrival time of the event to the target vehicle is the time until the cause of the event reaches the target vehicle. For example, regarding the visual field event that “the preceding vehicle suddenly stopped”, the time until the target vehicle collides with the preceding vehicle has been reached, assuming that the target vehicle has continued to run at the current speed. It will be time.
  • the event priority setting unit 14 sets a higher priority for an event having a shorter arrival time.
  • the display control unit 15 performs the same operation as that of the fourth embodiment when one of the blind spot event and the visual field event occurs, but sets the event priority when the blind spot event and the visual field event occur simultaneously.
  • the event notification information for which the priority is set high in the unit 14 is displayed on the HUD 35, and the event notification information for which the priority is set low is displayed on the CID 36.
  • step S51 and step S52 are the same as step S21 and step S22 of FIG. 6 described in the second embodiment, description thereof is omitted.
  • step S53 is the same as step S43 of FIG. 11 described in the fourth embodiment, and a description thereof will be omitted.
  • step S53 determines whether both a blind spot event and a visual field event have occurred. If both the blind spot event and the visual field event have not occurred in step S54, that is, if only one of the blind spot event and the visual field event has occurred, the process proceeds to step S57.
  • the event priority setting unit 14 calculates the arrival time of the event to the target vehicle for both events (step S55), and the arrival time is short.
  • An event is set as a high priority event, and an event with a long arrival time is set as a low priority event (step S56).
  • the display control unit 15 acquires notification information from the display content database 34 (step S57).
  • the notification information to be acquired here is the notification information of both events for which priority is set in step S56 when both the blind spot event and the visual field event occur in step S54.
  • the visual field events it is notification information of the event that has occurred.
  • the display control unit 15 determines whether the notification information is both a blind spot event and a visual field event (step S58). If both are displayed, the notification information with low priority is displayed on the CID (step S59). ), The process proceeds to step S59A. If the notification information is one of a blind spot event and a visual field event, the process proceeds to step S59A. In step S59A, the display control unit 15 specifies the display area 44 of the HUD 35 (step S59A). In the display area 44 of the HUD 35, notification information of the event that has occurred is displayed. However, when both the blind spot event and the visual field event have occurred, the notification information of the event whose priority is set high in step S56 is displayed in the display area 44 of the HUD 35.
  • the display control unit 15 specifies the HUD display area 44 that is visually recognized by the driver over the area selected in step S32.
  • the display control unit 15 specifies the HUD display area 44 that is visually recognized by the driver over the cause of the visual field event, for example.
  • the display control unit 15 displays the notification information in the display area 44 of the HUD 35 identified in step S59A (step S59B).
  • the display control device 105 calculates the arrival time to the target vehicle for each of the blind spot event and the visual field event, and displays a rectangular frame 46A and character information 46B as notification information for the visual field event having a shorter arrival time than the blind spot event in HUD It is displayed in the area 44.
  • the blind spot event notification information is not displayed in the HUD display area 44, but instead is displayed in the CID 36 as character information 46C and an icon 46D indicating the positional relationship between the target vehicle and the other vehicle.
  • the driver visually recognizes a lot of information superimposed on the actual scene of the visual field 43. It becomes.
  • the notification information of the event with the higher priority of notification among the visual field event and the blind spot event is displayed in the HUD display area 44, and the notification information of the event with lower priority is displayed on the CID 36.
  • the driver 41 glances at notification information with a low priority on the CID 36 while visually checking the notification information with a moderate amount of information on the visual field 43 in a superimposed manner.
  • the display control device 105 has an effect of suppressing the driver from being confused in the short term and an effect of suppressing the driver from ignoring the information in the long term. Furthermore, according to the display control apparatus 105, there is an effect of ensuring the sense of security and the reliability of the system by suppressing the insufficient provision of the notification information to the driver.
  • the display control apparatus 105 includes an event priority setting unit 14 that sets priorities for the blind spot event and the visual field event when the blind spot event and the visual field event occur simultaneously. Then, the display control unit 15 controls the HUD 35 so as to display the notification information of the high priority event set by the event priority setting unit 14 among the blind spot event and the visual field event, and the notification information of the low priority event. CID 36 is controlled so as to be displayed. Therefore, the display control device 105 has an effect of suppressing the driver from being confused in the short term and an effect of suppressing the driver from ignoring the information in the long term. Furthermore, according to the display control apparatus 105, there is an effect of ensuring the sense of security and the reliability of the system by suppressing the insufficient provision of the notification information to the driver.
  • FIG. 17 is a block diagram showing a configuration of display control apparatus 106 according to Embodiment 6 of the present invention.
  • the display control unit 15 includes a display mode control unit 15B in the configuration of the display control device 102 according to the second embodiment.
  • the display mode control unit 15B changes the display mode of the blind spot event notification information according to the ratio of the blind spot event existing in the driver's field of view. change.
  • transparency is assumed as the display mode to be changed, but a shape such as length or size may be used.
  • steps S61 to S65 are the same as steps S21 to S25 of FIG. 6 described in the second embodiment, the description thereof is omitted.
  • the display mode control unit 15 ⁇ / b> B calculates the ratio of the cause of the blind spot event in the blind spot based on the side video or the rear video of the target vehicle captured by the in-vehicle camera 32 and the visual field information acquired from the visual field detection device 33. (Step S66). Then, the display mode control unit 15B determines whether or not the ratio that the cause of the blind spot event exists in the blind spot is 0% (step S67). If the ratio that the cause of the blind spot event exists in the blind spot is 0% in step S67, the process of the display control device 106 ends.
  • the display mode control unit 15B sets the transparency of the blind spot event notification information according to the ratio (step S68). Specifically, if the ratio of the cause of the blind spot event in the blind spot is 100%, the transmittance is 0%, and if the ratio of the cause of the blind spot event in the blind spot is 30%, the permeability is 70%. As described above, the display mode control unit 15B sets the transparency higher as the proportion of the cause of the blind spot event in the blind spot becomes smaller.
  • the display control unit 15 causes the HUD 35 to display the blind spot event notification information with the transparency determined in Step S68 in the HUD display area determined in Step S65 (Step S69).
  • the display mode control unit 15B calculates again the ratio of the cause of the blind spot event in the blind spot.
  • the ratio of the cause of the blind spot event in the blind spot is 0% (No in step S67), and the processing of the display control device 106 ends. That is, the display mode control unit 15B calculates the ratio of the cause of the blind spot event repeatedly in the blind spot until the ratio of the cause of the blind spot event in the blind spot becomes 0% (step S66), and according to the ratio The transparency of the blind spot event notification information is changed (step S68).
  • FIG. 19 shows that the HUD 35 is obtained when the other vehicle 42 travels on the right rear side of the target vehicle 40 and the ratio of the vehicle 42 existing in the driver's blind spot 53 is 100%. Is shown.
  • character information 45A and icons 45B which are notification information for prompting attention to the other vehicle 42, are displayed.
  • the transparency of the character information 45A and the icon 45B is 0%, and is clearly visible to the driver.
  • FIG. 20 shows a display of the HUD 35 when the other vehicle 42 travels in front of the right side of the target vehicle 40 and a part thereof appears in the driver's field of view 43.
  • the rate at which the other vehicle 42 is present in the driver's blind spot 53 is 30%.
  • the transparency of the character information 45A and the icon 45B, which are notification information of the blind spot event, is 70%, and the visibility by the driver is lowered.
  • FIG. 21 shows a display of the HUD 35 when the other vehicle 42 travels in front of the right side of the target vehicle 40 and the other vehicle 42 completely appears in the driver's field of view 43.
  • the ratio that the other vehicle 42 exists in the driver's blind spot 53 is 0%.
  • the display control unit 15 since the display control unit 15 does not display the blind spot event notification information, the driver does not visually recognize the blind spot event notification information. In other words, the transparency of the blind spot event notification information is 100%.
  • the display on the HUD 35 of the blind spot event notification information that informs the approach of the other vehicle 42 transitions in the order of FIG. 19, FIG. 20, and FIG.
  • the blind spot event notification information does not suddenly disappear when the other vehicle 42 appears in the driver's field of view 43, but gradually disappears. Therefore, when the other vehicle 42 appears in the driver's visual field 43 and the notification information of the other vehicle 42 is superimposed on the position of the other vehicle 42 and displayed on the HUD 35, the other vehicle 42 is in the driver's blind spot 53. Continuity of the display mode is ensured by the notification information and the notification information after the other vehicle 42 appears in the driver's visual field 43. Therefore, the uncomfortable feeling caused by a sudden change in the display mode of the notification information at the timing when the cause of the blind spot event moves from the blind spot 53 of the driver to the visual field 43 is reduced.
  • the display control unit 15 when the blind spot event exists across the driver's visual field and the blind spot, the display control unit 15 responds to the ratio of the blind spot event existing in the driver's visual field.
  • the display mode of the blind spot event notification information is changed. Therefore, the uncomfortable feeling due to a sudden change in the display mode of the notification information at the timing when the cause of the blind spot event moves from the blind spot of the driver to the field of view is reduced.
  • FIG. 22 is a block diagram showing a configuration of display control apparatus 107 according to Embodiment 7 of the present invention.
  • the configuration of the display control apparatus 107 is the same as the configuration of the display control apparatus 102 according to the second embodiment.
  • the display control unit 15 performs display control of the CID 36 in addition to the HUD 35.
  • the CID 36 is an example of a non-HUD display device that displays information so that the driver can visually recognize the actual scene outside the vehicle, and a display panel mounted on the instrument panel may be used instead of the CID 36. good.
  • the display control unit 15 displays the driver's visual field 43, the HUD display area 44, and an icon representing the positional relationship of the blind spot event on the CID 36.
  • this icon is referred to as a positional relationship icon 50.
  • FIG. 23 shows an example of the positional relationship icon 50.
  • the positional relationship icon 50 is the position of the driver's visual field 43, blind spot 53, HUD display area 44, and other vehicle 42 that is a blind spot event in a circle centered on the target vehicle 40.
  • 44A in FIG. 23 represents the viewing angle of the driver corresponding to the HUD display area 44.
  • the HUD display area 44 is included in a part of the visual field 43.
  • the display control unit 15 reflects the position of the other vehicle 42 on the positional relationship icon 50 based on the side or rear image of the target vehicle by the in-vehicle camera 32.
  • the display control unit 15 acquires visual field information from the visual field detection device 33 and reflects the change in the visual field of the driver on the positional relationship icon 50. That is, if the driver's visual field changes, the display control unit 15 changes the boundary 51 between the visual field 43 and the blind spot 53 in the positional relationship icon 50 accordingly.
  • an arrow 54 in FIG. 23 indicates a change in the driver's visual field in the left-right direction
  • an arrow 55 indicates a change in the driver's visual field in the vertical direction.
  • Steps S71 to S76 are the same as Steps S21 to S26 of FIG. 6 described in the second embodiment, description thereof is omitted.
  • step S77 the display control unit 15 displays the positional relationship icon on the CID 36.
  • FIG. 25 shows display control of the display control device 107 when a blind spot event “an other vehicle is approaching the target vehicle from the driver's blind spot” occurs.
  • blind spot event notification information 45 is displayed in an area 44B that is visually recognized by the driver so as to overlap with a real scene with little temporal change.
  • the driver's visual field 43, the HUD display area 44, and a positional relationship icon 50 representing the positional relationship of the blind spot event are displayed on the CID 36.
  • the driver can grasp the position relationship between his / her field of view, blind spot, and blind spot event from a bird's-eye view using the position relationship icon 50.
  • the display device includes a non-HUD display device that displays information so that the driver can visually recognize the actual scene outside the target vehicle.
  • the display control part 15 displays the icon showing the positional relationship of a visual field area
  • the vehicle movement determination unit 11, the region specifying unit 12, the peripheral event determination unit 13, the event priority setting unit 14, and the display control unit 15 are processed by a processing circuit 81 shown in FIG. Realized. That is, the processing circuit 81 includes the vehicle movement determination unit 11, the region specifying unit 12, the surrounding event determination unit 13, the event priority setting unit 14, and the display control unit 15 (hereinafter referred to as “vehicle movement determination unit 11 etc.”). Is provided. Dedicated hardware may be applied to the processing circuit 81, or a processor that executes a program stored in the memory may be applied.
  • the processor is, for example, a central processing unit, a processing unit, an arithmetic unit, a microprocessor, a microcomputer, a DSP (Digital Signal Processor) or the like.
  • the processing circuit 81 When the processing circuit 81 is dedicated hardware, the processing circuit 81 includes, for example, a single circuit, a composite circuit, a programmed processor, a processor programmed in parallel, an ASIC (Application Specific Integrated Circuit), an FPGA (Field-). Programmable (Gate Array) or a combination of these.
  • Each function of each unit such as the vehicle movement determination unit 11 may be realized by a plurality of processing circuits 81, or the function of each unit may be realized by a single processing circuit.
  • the processing circuit 81 When the processing circuit 81 is a processor, the functions of the vehicle movement determination unit 11 and the like are realized by a combination with software or the like (software, firmware or software and firmware). Software or the like is described as a program and stored in a memory. As shown in FIG. 27, the processor 82 applied to the processing circuit 81 reads out and executes the program stored in the memory 83, thereby realizing the function of each unit. That is, when the display control devices 101 to 107 are executed by the processing circuit 81, the temporal change of the pixel value is predetermined in the photographed image of the actual scene outside the target vehicle viewed from the driver of the target vehicle.
  • a pixel area smaller than the selected value as a selection area a step of determining whether or not a blind spot event to be notified to the driver at the driver's blind spot occurs, and a driver visually confirming the selection area.
  • a memory 83 for storing a program to be executed as a result of controlling the HUD 35 so as to display the notification information of the blind spot event for the driver in the display area of the HUD 35 to be displayed.
  • this program causes the computer to execute procedures and methods such as the vehicle movement determination unit 11.
  • the memory 83 is a nonvolatile memory such as RAM (Random Access Memory), ROM (Read Only Memory), flash memory, EPROM (Electrically Programmable Read Only Memory), EEPROM (Electrically Erasable Programmable Read Only Memory), or the like. Or volatile semiconductor memory, HDD (Hard Disk Drive), magnetic disk, flexible disk, optical disk, compact disk, mini disk, DVD (Digital Versatile Disk) and its drive device, or any storage media used in the future There may be.
  • RAM Random Access Memory
  • ROM Read Only Memory
  • flash memory EPROM (Electrically Programmable Read Only Memory), EEPROM (Electrically Erasable Programmable Read Only Memory), or the like.
  • volatile semiconductor memory HDD (Hard Disk Drive), magnetic disk, flexible disk, optical disk, compact disk, mini disk, DVD (Digital Versatile Disk) and its drive device, or any storage media used in the future There may be.
  • each function of the vehicle movement determination unit 11 or the like is realized by either hardware or software.
  • the present invention is not limited to this, and a configuration in which a part of the vehicle movement determination unit 11 or the like is realized by dedicated hardware and another part is realized by software or the like.
  • the function of the display control unit 15 is realized by a processing circuit as dedicated hardware, and otherwise the processing circuit 81 as the processor 82 reads and executes the program stored in the memory 83. A function can be realized.
  • the processing circuit can realize the functions described above by hardware, software, or the like, or a combination thereof.
  • the display control devices 101 to 107 of the present invention may be devices mounted on a target vehicle, or may be an in-vehicle device, a PND (Portable Navigation Device), a communication terminal (for example, a mobile phone, a smartphone, a tablet, etc.).
  • the present invention can also be applied to a system constructed as a system by appropriately combining a mobile terminal), functions of applications installed therein, a server, and the like.
  • each function or each component of the display control apparatuses 101 to 107 described above may be distributed and arranged in each device constituting the system, or may be concentrated on any one of the devices. Also good.
  • the display control unit 15 of the display control device 102 may be arranged in the in-vehicle device, and the region specifying unit 12 and the peripheral event determination unit 13 may be arranged in the server.
  • the present invention can be freely combined with each embodiment and each modification within the scope of the invention, or can be appropriately modified or omitted with each embodiment and each modification.

Abstract

La présente invention a pour but de fournir un affichage sur un HUD sans donner de sensation de dissonance. Selon la présente invention, un dispositif de commande d'affichage comprend : une unité de spécification de région (12) qui sélectionne, en tant que région de sélection, une région de pixel dans laquelle un changement temporel d'une valeur de pixel est inférieur à une valeur prédéterminée dans une image capturée d'une vue réelle à l'extérieur d'un véhicule sujet, qui est vue depuis un conducteur du véhicule sujet ; une unité de détermination d'événement d'angle mort (13A) qui détermine si un événement d'angle mort, qui doit être notifié au conducteur, se produit dans un angle mort du conducteur ; et une unité de commande d'affichage (15) qui commande un affichage d'un dispositif d'affichage installé dans le véhicule sujet, le dispositif d'affichage comprenant un HUD (35) qui affiche des informations de sorte que le conducteur puisse visualiser les informations superposées sur la vue actuelle à l'extérieur du véhicule sujet, et l'unité de commande d'affichage (15) commande le HUD (35) de telle sorte que des informations de notification sur l'événement d'angle mort pour le conducteur soient affichées dans une région d'affichage du HUD (35), qui est superposée sur la zone de sélection et vue par le conducteur.
PCT/JP2017/008915 2017-03-07 2017-03-07 Dispositif et procédé de commande d'affichage WO2018163266A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/JP2017/008915 WO2018163266A1 (fr) 2017-03-07 2017-03-07 Dispositif et procédé de commande d'affichage
JP2019504157A JP6703183B2 (ja) 2017-03-07 2017-03-07 表示制御装置および表示制御方法

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2017/008915 WO2018163266A1 (fr) 2017-03-07 2017-03-07 Dispositif et procédé de commande d'affichage

Publications (1)

Publication Number Publication Date
WO2018163266A1 true WO2018163266A1 (fr) 2018-09-13

Family

ID=63449022

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2017/008915 WO2018163266A1 (fr) 2017-03-07 2017-03-07 Dispositif et procédé de commande d'affichage

Country Status (2)

Country Link
JP (1) JP6703183B2 (fr)
WO (1) WO2018163266A1 (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2020235303A1 (fr) * 2019-05-17 2020-11-26 株式会社東海理化電機製作所 Dispositif de commande et système de présentation
WO2022123922A1 (fr) * 2020-12-11 2022-06-16 株式会社Ｎｔｔドコモ Système de traitement de l'information

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007233770A (ja) * 2006-03-01 2007-09-13 Alpine Electronics Inc 車載周辺状況提示装置
JP2007249364A (ja) * 2006-03-14 2007-09-27 Denso Corp 安全運転支援システム及び安全運転支援装置
JP2008001182A (ja) * 2006-06-21 2008-01-10 Nissan Motor Co Ltd 車両用視覚情報呈示装置及び車両用視覚情報呈示方法
JP2008070955A (ja) * 2006-09-12 2008-03-27 Sumitomo Electric Ind Ltd 移動体を表示するための表示システム、車載装置、画像送信装置及び表示方法
JP2014106147A (ja) * 2012-11-28 2014-06-09 Fujitsu Ltd 交差点検出方法および交差点検出システム
JP2014206888A (ja) * 2013-04-15 2014-10-30 本田技研工業株式会社 車両の運転支援装置
WO2015025350A1 (fr) * 2013-08-19 2015-02-26 三菱電機株式会社 Dispositif de commande d'affichage monté sur véhicule
JP2016091084A (ja) * 2014-10-30 2016-05-23 マツダ株式会社 車両の警報装置

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007233770A (ja) * 2006-03-01 2007-09-13 Alpine Electronics Inc 車載周辺状況提示装置
JP2007249364A (ja) * 2006-03-14 2007-09-27 Denso Corp 安全運転支援システム及び安全運転支援装置
JP2008001182A (ja) * 2006-06-21 2008-01-10 Nissan Motor Co Ltd 車両用視覚情報呈示装置及び車両用視覚情報呈示方法
JP2008070955A (ja) * 2006-09-12 2008-03-27 Sumitomo Electric Ind Ltd 移動体を表示するための表示システム、車載装置、画像送信装置及び表示方法
JP2014106147A (ja) * 2012-11-28 2014-06-09 Fujitsu Ltd 交差点検出方法および交差点検出システム
JP2014206888A (ja) * 2013-04-15 2014-10-30 本田技研工業株式会社 車両の運転支援装置
WO2015025350A1 (fr) * 2013-08-19 2015-02-26 三菱電機株式会社 Dispositif de commande d'affichage monté sur véhicule
JP2016091084A (ja) * 2014-10-30 2016-05-23 マツダ株式会社 車両の警報装置

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2020235303A1 (fr) * 2019-05-17 2020-11-26 株式会社東海理化電機製作所 Dispositif de commande et système de présentation
WO2022123922A1 (fr) * 2020-12-11 2022-06-16 株式会社Ｎｔｔドコモ Système de traitement de l'information
JPWO2022123922A1 (fr) * 2020-12-11 2022-06-16

Also Published As

Publication number Publication date
JP6703183B2 (ja) 2020-06-03
JPWO2018163266A1 (ja) 2019-07-25

Similar Documents

Publication Publication Date Title
US9771022B2 (en) Display apparatus
US9589194B2 (en) Driving assistance device and image processing program
WO2017068694A1 (fr) Procédé d'aide au stationnement et dispositif d'aide au stationnement
JP4719590B2 (ja) 車載周辺状況提示装置
CN110546699B (zh) 推荐驾驶输出装置、推荐驾驶输出方法和推荐驾驶输出系统
CN107599966A (zh) 将车辆中平视显示器的驾驶员注意力分散最小化的系统和方法
JP6443716B2 (ja) 画像表示装置、画像表示方法及び画像表示制御プログラム
JP7077616B2 (ja) 表示制御装置および表示制御方法
US20040233124A1 (en) Process for depicting various image data on a vehicle display
US20210001723A1 (en) Line-of-sight guidance device
JP6415382B2 (ja) 移動体用画像生成装置及びナビゲーション装置
KR102416446B1 (ko) 증강현실 기반 차량용 인포테인먼트 시스템 및 차량용 인포테인먼트 시스템 운용 방법
CN113165510B (zh) 显示控制装置、方法和计算机程序
JP2019040634A (ja) 画像表示装置、画像表示方法及び画像表示制御プログラム
WO2018163266A1 (fr) Dispositif et procédé de commande d'affichage
KR101209796B1 (ko) 전경 투과 기능을 갖는 차량용 표시장치 및 이의 표시방법
JP2018092290A (ja) 車両用表示装置
JP2022041244A (ja) 車載表示装置、方法およびプログラム
JP7202195B2 (ja) 表示システム、走行制御装置、表示制御方法およびプログラム
WO2020174601A1 (fr) Dispositif d'estimation de niveau de vigilance, dispositif d'aide à la conduite automatique et procédé d'estimation de niveau de vigilance
JP2022049711A (ja) 車両制御装置及び方法
JP2017005352A (ja) 車載表示装置及び車両後方映像表示方法
KR101744718B1 (ko) 차량용 표시 시스템 및 그 제어방법
JPWO2019224972A1 (ja) 車両用表示制御装置および車両用表示制御方法
JP2022041245A (ja) 車両用表示制御装置、方法、プログラムおよび車両用表示システム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17900098

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2019504157

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17900098

Country of ref document: EP

Kind code of ref document: A1