WO2018101274A1 - Safety confirmation device - Google Patents

Safety confirmation device Download PDF

Info

Publication number
WO2018101274A1
WO2018101274A1 PCT/JP2017/042661 JP2017042661W WO2018101274A1 WO 2018101274 A1 WO2018101274 A1 WO 2018101274A1 JP 2017042661 W JP2017042661 W JP 2017042661W WO 2018101274 A1 WO2018101274 A1 WO 2018101274A1
Authority
WO
WIPO (PCT)
Prior art keywords
index
driver
unit
vehicle
display
Prior art date
Application number
PCT/JP2017/042661
Other languages
French (fr)
Japanese (ja)
Inventor
幸真 永畑
浩一郎 本多
亘 野木森
秀二 上田
Original Assignee
アイシン精機株式会社
アイシン・エィ・ダブリュ株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by アイシン精機株式会社, アイシン・エィ・ダブリュ株式会社 filed Critical アイシン精機株式会社
Publication of WO2018101274A1 publication Critical patent/WO2018101274A1/en

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K28/00Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions
    • B60K28/02Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions responsive to conditions relating to the driver
    • B60K28/06Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions responsive to conditions relating to the driver responsive to incapacity of driver
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08Interaction between the driver and the control system
    • B60W50/14Means for informing the driver, warning the driver or prompting a driver intervention
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/16Anti-collision systems

Definitions

  • the present invention relates to a safety confirmation device.
  • An apparatus for confirming the state of a driver in a moving body such as an automobile is known.
  • the state of the driver is confirmed by the behavior of the driver (for example, a pointing confirmation operation).
  • This invention is made in view of the above, and is providing the safety confirmation apparatus which can confirm a driver
  • the safety confirmation device of the present invention detects an orientation of the driver's face or line of sight, and an indicator output unit that outputs an indicator to be visually recognized by the driver of the moving body. And a determination unit that determines whether to issue a warning based on the position of the index and the direction of the face or the line of sight.
  • the safety confirmation device can determine the state of the driver more appropriately without releasing the driver's hand from the steering unit, compared with the case where the state of the driver is determined by pointing, etc. It can be determined whether or not.
  • the index output unit may change the positions of a plurality of the indices at random.
  • the index output unit may output the index during automatic operation of the moving body.
  • the safety confirmation device can confirm the state of the driver while maintaining the safety of the driver.
  • the determination unit determines whether to switch from the automatic driving to the driver's manual driving based on the position of the index and the direction of the driver's face or line of sight. You may judge.
  • the safety confirmation device since the safety confirmation device switches from automatic operation to manual operation based on the position of the index and the driver's line of sight, it can be more appropriately switched to manual operation.
  • the indicator output unit may cause the indicator to be output to a meter display device that displays a mirror or a meter provided in the moving body.
  • the safety confirmation device can output the indicator and confirm the driver's state without providing a new space.
  • the indicator output unit may repeat displaying the indicator in a single safety check a predetermined number of times in advance at different times.
  • the safety confirmation device can confirm the driver's state a predetermined number of times, the driver's state can be confirmed with higher accuracy.
  • FIG. 1 is a view of the vicinity of a dashboard in a passenger compartment of a vehicle according to an embodiment.
  • FIG. 2 is a block diagram showing a vehicle control system.
  • FIG. 3 is a block diagram illustrating functions of the ECU that functions as a safety confirmation device.
  • FIG. 4 is a diagram illustrating an example of an index displayed by the index output unit.
  • FIG. 5 is a flowchart of the safety confirmation process executed by the control unit.
  • FIG. 1 is a view in the vicinity of a dashboard in a passenger compartment of a vehicle 10 according to the embodiment.
  • the vehicle 10 is an example of a moving body.
  • the vehicle 10 may be, for example, an automobile (an internal combustion engine automobile) using an internal combustion engine (engine, not shown) as a drive source, or an automobile (electric vehicle) using an electric motor (motor, not shown) as a drive source. Or a fuel cell vehicle or the like, or a vehicle (hybrid vehicle) using both of them as drive sources.
  • the vehicle 10 can be mounted with various transmissions, and various devices (systems, components, etc.) necessary for driving the internal combustion engine and the electric motor can be mounted.
  • the method, the number, the layout, and the like of devices related to driving of the wheels in the vehicle 10 can be variously set.
  • the vehicle 10 includes a steering unit 12, a plurality of (for example, three) mirrors 14R, 14L, and 14C, a plurality of indicator display units 15a, 15b, and 15c, a monitor device 16, and an instrument.
  • a display device 18 and an in-vehicle imaging unit 20 are provided.
  • Steering unit 12 is a member that is operated by the driver to steer the wheels and change the traveling direction of the vehicle 10.
  • An example of the steering unit 12 is a steering wheel or a handle provided in front of the driver's seat.
  • Mirrors 14R and 14L are door mirrors provided outside the vehicle.
  • the mirror 14 ⁇ / b> C is a room mirror provided inside the vehicle 10.
  • the mirror 14 ⁇ / b> R is provided on the right side of the vehicle 10 on the side of the dashboard 32.
  • the mirror 14 ⁇ / b> L is provided on the left side surface of the vehicle 10 on the side of the dashboard 32.
  • the mirror 14C is provided above the dashboard 32 and at the center in the left-right direction.
  • the mirrors 14 ⁇ / b> R, 14 ⁇ / b> L, and 14 ⁇ / b> C are disposed on the vehicle 10 so as to be directed rearward.
  • the mirrors 14R, 14L, and 14C reflect the situation around the rear of the vehicle 10.
  • the mirrors 14R, 14L, and 14C are, for example, half mirrors or electronic mirrors, and transmit certain light. Thereby, the image of the index of the index display unit 15 described later is transmitted.
  • the indicator display units 15a, 15b, and 15c are image display devices such as a liquid crystal display device that displays images.
  • An example of an image displayed by the index display units 15a, 15b, and 15c is an index.
  • the index display unit 15a is provided inside the mirror 14R.
  • the index display unit 15b is provided inside the mirror 14C.
  • the index display unit 15c is provided inside the mirror 14L.
  • the monitor device 16 outputs an image and sound, and receives input from a passenger including a driver.
  • the monitor device 16 includes a central display device 26, an audio output device 28, and an operation input unit 30.
  • the central display device 26 is, for example, a liquid crystal display device that can display an image.
  • the central display device 26 displays an image such as route guidance of the navigation system.
  • the central display device 26 also has a function as an index display unit 15d that displays an index.
  • the audio output device 28 is, for example, a speaker.
  • the sound output device 28 outputs sound such as road guidance and warnings.
  • the operation input unit 30 is, for example, a touch panel that can transmit an image of the central display device 26.
  • the operation input unit 30 is provided on the surface of the central display device 26.
  • the operation input unit 30 receives input from an occupant including a driver.
  • the instrument display device 18 is provided inside the dashboard 32 and in front of the steering unit 12.
  • the instrument display device 18 is a liquid crystal display device capable of displaying an image, for example.
  • the instrument display device 18 displays an image of the instrument indicating the measurement value of the vehicle 10.
  • the instrument display device 18 displays an image of a speedometer that indicates the speed of the vehicle 10 that is an example of a measurement value, an image of a tachometer that indicates the number of revolutions of an engine that is another example of the measurement value, and the like.
  • the instrument display device 18 also has a function as an index display unit 15e that displays an index.
  • the in-vehicle imaging unit 20 is a digital camera having, for example, a CCD (charge-coupled device) or a CMOS (complementary metal-oxide semiconductor) sensor.
  • the in-vehicle imaging unit 20 is installed, for example, on the upper surface of the dashboard 32 in front of the steering unit 12.
  • the in-vehicle imaging unit 20 is directed rearward.
  • the in-vehicle image capturing unit 20 captures a face including at least the eye part of the driver sitting behind the steering unit 12 and uses the captured image data of the driver's captured image (hereinafter referred to as a face image). Generate.
  • the in-vehicle image capturing unit 20 can capture any position (for example, the steering unit 12, the front of the console, the top of the windshield, etc.) as long as it can capture the driver's face image (preferably, the front image of the driver's face). May be arranged.
  • FIG. 2 is a block diagram showing a control system of the vehicle 10.
  • the vehicle 10 further includes an ECU (Electronic Control Unit) 40 and an in-vehicle network 42.
  • the ECU 40 is an example of the safety confirmation device 50.
  • the in-vehicle imaging unit 20, the indicator display unit 15, the monitor device 16, the instrument display device 18, and the ECU 40 function as the safety confirmation system 52.
  • ECU40 is a computer, for example.
  • the ECU 40 governs overall control of the vehicle 10 by cooperation of hardware and software (that is, a program).
  • the ECU 40 includes a CPU (Central Processing Unit) 40a, a ROM (Read Only Memory) 40b, a RAM (Random Access Memory) 40c, a display control unit 40d, a voice control unit 40e, and an SSD (Solid State Drive) 40f. Is provided.
  • the CPU 40a, ROM 40b, and RAM 40c may be integrated in the same package.
  • the CPU 40a is an example of a hardware processor, reads a program stored in a nonvolatile storage device such as the ROM 40b, and executes various arithmetic processes and controls according to the program.
  • the ROM 40b stores each program and parameters necessary for executing the program.
  • the RAM 40c temporarily stores various types of data used in computations by the CPU 40a.
  • the display control unit 40d mainly performs the image processing of the image obtained by the in-vehicle imaging unit 20 and the data conversion of the display image to be displayed on the index display unit 15 and the display devices 18 and 26 in the arithmetic processing in the ECU 40. Etc.
  • the voice control unit 40e mainly executes voice processing to be output to the voice output device 28 among the arithmetic processing in the ECU 40.
  • the SSD 40f is a rewritable nonvolatile storage unit, and maintains data even when the power of the ECU 40 is turned off.
  • the in-vehicle network 42 is, for example, a CAN (Controller Area Network).
  • the in-vehicle network 42 electrically connects the ECU 40 and the operation input unit 30 so that signals and information such as control signals and operation contents can be transmitted and received.
  • FIG. 3 is a block diagram for explaining the function of the ECU 40 that functions as the safety confirmation device 50.
  • the ECU 40 includes a control unit 54 and a storage unit 56.
  • the control unit 54 is realized as a function of the CPU 40a, the display control unit 40d, and the voice control unit 40e.
  • the storage unit 56 is realized as a function of the ROM 40b, the RAM 40c, and the SSD 40f.
  • the control unit 54 includes an index output unit 60 and a determination unit 62.
  • the control unit 54 functions as the index output unit 60 and the determination unit 62 by reading a safety confirmation program.
  • Part or all of the index output unit 60 and the determination unit 62 may be configured by hardware such as a circuit including an ASIC (Application Specific Integrated Circuit).
  • the index output unit 60 outputs an index to be visually recognized by the driver of the vehicle 10. For example, the index output unit 60 outputs the index during the automatic driving of the vehicle 10. Specifically, the index output unit 60 outputs index image data to the index display unit 15, thereby causing the index display unit 15 to display and output a visible index.
  • the index output unit 60 may repeat displaying the index on any of the plurality of index display units 15 at different times in one safety check. For example, the index output unit 60 may repeat the display of the index a predetermined number of times (for example, 3 times) in one safety check. In this case, the index output unit 60 may randomly change the positions of the plurality of indices in one safety check.
  • the index output unit 60 may randomly change the positions of a plurality of indices for each different safety check.
  • the index output unit 60 may randomly change the position of the index based on a random number table or the like stored in the storage unit 56.
  • the index output unit 60 outputs the position of the output index to the determination unit 62.
  • the determination unit 62 determines whether or not the vehicle 10 has entered the diagnosis section during automatic driving.
  • the diagnosis section is a section for confirming the safety of a driver who performs manual driving, and is a part of the automatic driving section.
  • the diagnosis section is, for example, a point that is a predetermined distance or a predetermined time before the point to switch to manual driving (that is, the automatic driving section side).
  • the predetermined distance or the predetermined time is a distance or time at which the safety of the driver can be confirmed by outputting the index.
  • the determination unit 62 acquires the position of the index from the index output unit 60.
  • the determination unit 62 acquires, from the in-vehicle image capturing unit 20, data of a captured image obtained by capturing a face including at least eyes of the driver of the vehicle 10 while traveling in the diagnostic section by automatic driving.
  • the determination unit 62 detects the position of the driver's face or eyes along with the direction of the driver's face or line of sight of the vehicle 10 based on the acquired face or eye image in the captured image.
  • the direction of the face or line of sight is described as “line of sight”
  • the position of the face or eye is described as “reference point”.
  • the determination unit 62 determines whether or not to issue a warning based on the position of the index and the line-of-sight direction. For example, when the determination unit 62 has an index at least in the line-of-sight direction starting from the reference point, that is, when the driver is looking at the direction of the index, the driver is awake and safe, so that the warning is unnecessary. judge. Note that the determination unit 62 may determine that the warning is unnecessary when there is an index on the line of sight and in the vicinity of the line of sight. In this case, the determination unit 62 outputs a position change instruction, which is an instruction to change the position where the index is displayed, to the index output unit 60.
  • a position change instruction which is an instruction to change the position where the index is displayed
  • the determination unit 62 warns that the driver is not awake and safe. Judge that it should be. Note that the determination unit 62 may determine that a warning should be given when there is no index on the line of sight and in the vicinity of the line of sight. If it is determined that a warning is to be notified, the determination unit 62 causes the audio output device 28 to output an audio warning.
  • An example of the warning is a notification regarding safety, and may be a buzzer sound or a human voice for awakening the driver. Note that the determination unit 62 may cause the display devices 18 and 26 to output an image warning when notifying the warning.
  • the determination unit 62 may determine whether to switch from automatic driving to manual driving by the driver based on the position of the index and the line-of-sight direction. Specifically, when the number of times that the determination unit 62 determines that there is an index at least in the line-of-sight direction starting from the reference point is equal to or more than a predetermined number of times set in advance, and the vehicle 10 enters the manual driving section It is determined that the automatic operation is switched to the driver's manual operation. In other words, the determination unit 62 determines to switch to manual operation when the number of times determined that the warning is unnecessary is equal to or greater than the specified number and the vehicle 10 enters the manual operation section.
  • the determination unit 62 may determine whether to stop automatically. For example, the determination unit 62 may determine whether or not to automatically stop by comparing the time during which the display of the index is continued with a predetermined determination time. When the determination unit 62 determines that the vehicle should be automatically stopped, the vehicle 10 is automatically stopped.
  • the storage unit 56 stores a safety confirmation program executed by the control unit 54, data necessary for executing the program, data generated by executing the program, and the like.
  • the storage unit 56 includes, as data necessary for the execution of the program, position information of a diagnosis section that is a section for executing safety confirmation processing, a specified number of times for determining the end of display of an index, a determination time for determining an automatic stop, The index image data and the like are stored.
  • the storage unit 56 stores captured image data of the driver's face as data generated by executing the program.
  • the storage unit 56 may be realized by a storage device (so-called cloud) on a network.
  • FIG. 4 is a diagram illustrating an example of an index displayed by the index output unit 60.
  • the positional relationship between the index display units 15a, 15b, 15c, 15d, and 15e shown in FIG. 4 is schematic.
  • the indicator output unit 60 displays the indicators MK1, MK2, MK3, MK4, and MK5 on the indicator display units 15a, 15b, 15c, 15d, and 15e during the automatic operation.
  • the index output unit 60 displays the indexes MK1, MK2, and MK3 on the index display units 15a, 15b, and 15c provided on the mirrors 14R, 14C, and 14L.
  • the index output unit 60 displays the index MK4 on the central display device 26 that functions as the index display unit 15d.
  • the index output unit 60 displays the index MK5 on the instrument display device 18 that functions as the index display unit 15e.
  • the index output unit 60 outputs the indices MK1, MK2, MK3, MK4, and MK5 to the left, right, up, and down ahead of the driver.
  • the indicators MK1 to MK5 are images including numbers in a circle, but the image of the indicator MK is not limited to these examples.
  • the indicator output unit 60 displays the indicators MK1 to MK5 one by one.
  • the index output unit 60 causes any one of the index MKs to be output to any one of the index display units 15, and then causes another index MK to be displayed on another index display unit 15.
  • the index output unit 60 randomly selects the index display unit 15 to be displayed.
  • the index output unit 60 repeats the display of the index MK at least a specified number of times in one safety check.
  • FIG. 5 is a flowchart of the safety confirmation process executed by the control unit 54.
  • the control unit 54 executes a safety confirmation process by reading a safety confirmation program during automatic operation.
  • the determination unit 62 determines whether or not the vehicle 10 during automatic driving is in a manual driving diagnostic section (S102). For example, the determination unit 62 compares the position information of the vehicle 10 acquired from a GPS (Global Positioning System) terminal and the like with the position information of the diagnosis section stored in the storage unit 56 so that the vehicle 10 It is determined whether or not. When the determination unit 62 determines that the vehicle 10 is not in the diagnostic section (S102: No), the determination unit 62 enters a standby state.
  • GPS Global Positioning System
  • the voice output device 28 If the determination unit 62 determines that the vehicle 10 is in the diagnostic section (S102: Yes), the voice output device 28 outputs a diagnosis start voice guidance and outputs a diagnosis start instruction to the index output unit 60 (S104). .
  • the determination unit 62 causes the voice output device 28 to output a voice guidance such as “Please look at the index to be displayed now”.
  • the index output unit 60 when acquiring a diagnosis start instruction during automatic driving, displays the index MK on the index display unit 15 and outputs the position of the index MK to the determination unit 62 (S106). For example, the index output unit 60 displays the index MK1 on the index display unit 15a.
  • the position of the index MK may be the position of the index display unit 15 displaying the index MK.
  • the determining unit 62 determines whether the line-of-sight direction is appropriate (S108). Specifically, the determination unit 62 acquires captured image data obtained by capturing the driver's face from the in-vehicle image capturing unit 20. The determination unit 62 detects the line-of-sight direction and the reference point based on the captured image. The determination unit 62 determines whether or not the visual line direction is appropriate based on the visual line direction starting from the reference point and the position of the index MK. The determination unit 62 determines that the line-of-sight direction is appropriate when the index MK exists on the line-of-sight direction starting from the reference point (or in the vicinity of the line-of-sight direction). On the other hand, the determination unit 62 determines that the line-of-sight direction is inappropriate when the index MK does not exist on the line-of-sight direction starting from the reference point (or in the vicinity of the line-of-sight direction).
  • the determination unit 62 determines whether or not to automatically stop because the driver's state is not normal. (S110). For example, the determination unit 62 may determine whether to stop automatically by comparing the time during which the display of the index MK is continued with a predetermined determination time. Specifically, the determination unit 62 determines not to stop automatically if the time during which the display of the indicator MK is continued is less than the determination time. On the other hand, if the time for which the display of the indicator MK is continued is longer than the determination time, that is, if the driver has not watched the indicator MK for a long time and is not likely to be awake, judge.
  • the determination unit 62 determines that the vehicle does not stop automatically (S110: No), it causes the audio output device 28 to output a warning sound (S112). In other words, the determination unit 62 outputs a warning based on the position of the index MK and the driver's line-of-sight direction in step S108. The determination unit 62 may cause the audio output device 28 to output a warning based on a buzzer sound or the like.
  • the determination unit 62 continues to display the index MK and repeats steps S108 to S110. If the determination part 62 determines that it should stop automatically (S110: Yes), it will control the vehicle 10 and will stop automatically at a safe place (S114). Thereby, the control part 54 complete
  • the determination unit 62 determines whether or not to end the display of the index MK because the driver's state is normal. Is determined (S116). For example, the determination unit 62 determines whether or not to end the display of the index MK depending on whether or not the display count of the index MK is equal to or greater than a specified number. Specifically, the determination unit 62 determines to continue displaying the index MK if the number of times the index MK is displayed is less than the specified number. On the other hand, if the number of times the index MK is displayed is equal to or greater than the specified number, the determination unit 62 determines that the display of the index MK is terminated because the driver is sufficiently awake.
  • the determination unit 62 determines to continue displaying the index MK (S116: No), it outputs a position change instruction to the index output unit 60.
  • the index output unit 60 upon acquiring the position change instruction, changes the display position of the index MK and newly sets it (S118).
  • the index output unit 60 displays the index MK (for example, the index MK2 on the index display unit 15b) on the index display unit 15 different from the previously displayed index display unit 15a.
  • the index output unit 60 may randomly change the display position of the index MK.
  • the index output unit 60 may randomly change the position and display order of the index MK for each safety check.
  • the single safety check here is from the start to the end shown in FIG. Accordingly, in the current safety confirmation process, the index output unit 60 first displays the index MK1 on the index display unit 15a.
  • the index output unit 60 first displays the index display unit 15b on the index display unit 15b.
  • the indicator MK2 may be displayed.
  • the index output unit 60 deletes the displayed index MK and causes the index display unit 15 selected based on the changed display position to display the index MK (S106). Thereafter, the determination unit 62 repeats S108 and subsequent steps.
  • the determination unit 62 determines whether or not the vehicle 10 is in the manual operation section (S120). For example, the determination unit 62 determines whether or not the vehicle 10 is in the manual driving section based on the position of the vehicle 10 acquired from the GPS terminal.
  • the determination unit 62 determines that the vehicle 10 is not in the manual operation section (S120: No)
  • the determination unit 62 enters a standby state.
  • the vehicle 10 during automatic operation is switched to manual operation (S122), and control of the vehicle 10 is transferred to the driver. .
  • the determination unit 62 actively determines the driver's state based on the position of the index MK displayed by the index output unit 60 and the driver's line-of-sight direction. Determine whether to warn or not. Accordingly, the safety confirmation device 50 can more appropriately determine the state of the driver without separating the driver's hand from the steering unit 12 as compared with the case where the state is determined by the driver's pointing or the like. It can be determined whether or not to warn.
  • the safety confirmation device 50 since the index output unit 60 randomly changes the positions of the plurality of indices MK, the driver's state is more accurately compared with the case where the driver is used to displaying the indices in the same pattern. It can be confirmed well. Further, in the safety confirmation device 50, by randomly changing the position of the index MK, it is possible to reduce the direction in which the index MK is not displayed depending on the traveling state (for example, the traveling direction) of the vehicle 10. As a result, the safety confirmation device 50 can cause the driver's line of sight to be directed in all directions around the vehicle 10 to cause safety confirmation by outputting a plurality of indices MK.
  • the index output unit 60 outputs the index during the automatic driving, it is possible to confirm the driver's state while maintaining the driver's safety.
  • the safety confirmation device 50 since the automatic operation is switched to the manual operation based on the position of the index MK and the driver's line of sight, it is possible to more appropriately switch to the manual operation.
  • the index output unit 60 outputs the index MK to the mirrors 14R, 14C, 14L, the instrument display device 18 and the like, so that the driver's state can be confirmed without providing a new space.
  • the index display unit 15 is an image display device such as a liquid crystal display device, but the present invention is not limited to this.
  • the index display unit 15 may be an image projection device (so-called projector) that projects an image onto a mirror 14R, 14C, 14L, or the like.
  • the safety check during automatic driving is taken as an example, but the present invention is not limited to this.
  • the above-described embodiment may be applied to the state confirmation and awakening of the driver during manual driving.

Abstract

This safety confirmation device is provided with an indicator output unit that outputs an indicator to be visually recognized by a driver of a moving body, and a determination unit that detects a direction of the face or line of sight of the driver and determines whether to issue a warning or not on the basis of a position of the indicator and the direction of the face or line of sight.

Description

安全確認装置Safety confirmation device
 本発明は、安全確認装置に関する。 The present invention relates to a safety confirmation device.
 自動車等の移動体において、運転者の状態を確認する装置が知られている。このような装置では、運転者の挙動(例えば、指差し確認動作)によって、運転者の状態を確認している。 An apparatus for confirming the state of a driver in a moving body such as an automobile is known. In such an apparatus, the state of the driver is confirmed by the behavior of the driver (for example, a pointing confirmation operation).
特開2015-184975号公報Japanese Patent Laying-Open No. 2015-184975
 しかしながら、上述の技術では、指差しのために運転者が操舵部から手を外す必要があり、確認のための行為が適切とは言えないといった課題がある。 However, the above-described technique has a problem that the driver needs to remove his / her hand from the steering part for pointing, and the action for confirmation cannot be said to be appropriate.
 本発明は、上記に鑑みてなされたものであって、適切に運転者の状態を確認できる安全確認装置を提供することにある。 This invention is made in view of the above, and is providing the safety confirmation apparatus which can confirm a driver | operator's state appropriately.
 上述した課題を解決し、目的を達成するために、本発明の安全確認装置は、移動体の運転者に視認させる指標を出力させる指標出力部と、前記運転者の顔または視線の向きを検出して、前記指標の位置と前記顔または前記視線の向きとに基づいて、警告を通知するか否かを判定する判定部と、を備える。 In order to solve the above-described problems and achieve the object, the safety confirmation device of the present invention detects an orientation of the driver's face or line of sight, and an indicator output unit that outputs an indicator to be visually recognized by the driver of the moving body. And a determination unit that determines whether to issue a warning based on the position of the index and the direction of the face or the line of sight.
 これにより、安全確認装置は、指差し等によって運転者の状態を判定する場合に比べて、運転者の手を操舵部から離させることなく、より適切に運転者の状態を判定して、警告するか否かを判定できる。 As a result, the safety confirmation device can determine the state of the driver more appropriately without releasing the driver's hand from the steering unit, compared with the case where the state of the driver is determined by pointing, etc. It can be determined whether or not.
 また、本発明の安全確認装置において、前記指標出力部は、複数の前記指標の位置をランダムに変化させてもよい。 Further, in the safety confirmation device of the present invention, the index output unit may change the positions of a plurality of the indices at random.
 これにより、安全確認装置は、同じパターンで指標を表示して運転者が慣れている場合に比べて、運転者の状態をより精度よく確認することができる。 This allows the safety confirmation device to check the driver's state with higher accuracy than when the driver is used to displaying the index in the same pattern.
 また、本発明の安全確認装置において、前記指標出力部は、前記移動体の自動運転中に前記指標を出力させてもよい。 Moreover, in the safety confirmation device of the present invention, the index output unit may output the index during automatic operation of the moving body.
 これにより、安全確認装置は、運転者の安全を維持しつつ、運転者の状態を確認できる。 Thereby, the safety confirmation device can confirm the state of the driver while maintaining the safety of the driver.
 また、本発明の安全確認装置において、前記判定部は、前記指標の位置と前記運転者の顔または視線の向きとに基づいて、前記自動運転から前記運転者の手動運転に切り替えるか否かを判定してもよい。 In the safety confirmation device of the present invention, the determination unit determines whether to switch from the automatic driving to the driver's manual driving based on the position of the index and the direction of the driver's face or line of sight. You may judge.
 このように安全確認装置は、指標の位置と運転者の視線方向とに基づいて、自動運転から手動運転に切り替えるので、より適切に手動運転へ切り替えることができる。 Thus, since the safety confirmation device switches from automatic operation to manual operation based on the position of the index and the driver's line of sight, it can be more appropriately switched to manual operation.
 また、本発明の安全確認装置において、前記指標出力部は、前記移動体に設けられたミラーまたは計器を表示する計器表示装置に前記指標を出力させてもよい。 Further, in the safety confirmation device of the present invention, the indicator output unit may cause the indicator to be output to a meter display device that displays a mirror or a meter provided in the moving body.
 このように安全確認装置は、新たなスペースを設けることなく、指標を出力させて運転者の状態を確認できる。 Thus, the safety confirmation device can output the indicator and confirm the driver's state without providing a new space.
 また、本発明の安全確認装置において、前記指標出力部は、1回の安全確認において、前記指標を表示させることを、時間をずらして予め定められた規定回数繰り返してもよい。 Further, in the safety confirmation device of the present invention, the indicator output unit may repeat displaying the indicator in a single safety check a predetermined number of times in advance at different times.
 このように安全確認装置は、運転者の状態を予め定められた規定回数確認できるため、より精度よく運転者の状態を確認できる。 Thus, since the safety confirmation device can confirm the driver's state a predetermined number of times, the driver's state can be confirmed with higher accuracy.
図1は、実施形態の車両の車室内のダッシュボード近傍の図である。FIG. 1 is a view of the vicinity of a dashboard in a passenger compartment of a vehicle according to an embodiment. 図2は、車両の制御系を示すブロック図である。FIG. 2 is a block diagram showing a vehicle control system. 図3は、安全確認装置として機能するECUの機能を説明するブロック図である。FIG. 3 is a block diagram illustrating functions of the ECU that functions as a safety confirmation device. 図4は、指標出力部が表示させる指標の一例を示す図である。FIG. 4 is a diagram illustrating an example of an index displayed by the index output unit. 図5は、制御部が実行する安全確認処理のフローチャートである。FIG. 5 is a flowchart of the safety confirmation process executed by the control unit.
 以下の例示的な実施形態等の同様の構成要素には共通の符号を付与して、重複する説明を適宜省略する。 The same constituent elements as in the following exemplary embodiments will be denoted by common reference numerals, and redundant description will be appropriately omitted.
 <実施形態>
 図1は、実施形態の車両10の車室内のダッシュボード近傍の図である。車両10は、移動体の一例である。車両10は、例えば、内燃機関(エンジン、図示されず)を駆動源とする自動車(内燃機関自動車)であってもよいし、電動機(モータ、図示されず)を駆動源とする自動車(電気自動車、燃料電池自動車等)であってもよいし、それらの双方を駆動源とする自動車(ハイブリッド自動車)であってもよい。また、車両10は、種々の変速装置を搭載することができるし、内燃機関や電動機を駆動するのに必要な種々の装置(システム、部品等)を搭載することができる。また、車両10における車輪の駆動に関わる装置の方式、個数、及び、レイアウト等は、種々に設定することができる。
<Embodiment>
FIG. 1 is a view in the vicinity of a dashboard in a passenger compartment of a vehicle 10 according to the embodiment. The vehicle 10 is an example of a moving body. The vehicle 10 may be, for example, an automobile (an internal combustion engine automobile) using an internal combustion engine (engine, not shown) as a drive source, or an automobile (electric vehicle) using an electric motor (motor, not shown) as a drive source. Or a fuel cell vehicle or the like, or a vehicle (hybrid vehicle) using both of them as drive sources. Further, the vehicle 10 can be mounted with various transmissions, and various devices (systems, components, etc.) necessary for driving the internal combustion engine and the electric motor can be mounted. In addition, the method, the number, the layout, and the like of devices related to driving of the wheels in the vehicle 10 can be variously set.
 図1に示すように、車両10は、操舵部12と、複数(例えば、3個)のミラー14R、14L、14Cと、複数の指標表示部15a、15b、15cと、モニタ装置16と、計器表示装置18と、車内撮像部20とを備える。 As shown in FIG. 1, the vehicle 10 includes a steering unit 12, a plurality of (for example, three) mirrors 14R, 14L, and 14C, a plurality of indicator display units 15a, 15b, and 15c, a monitor device 16, and an instrument. A display device 18 and an in-vehicle imaging unit 20 are provided.
 操舵部12は、車輪を転舵させて車両10の進行方向を変更させるために運転者が操作する部材である。操舵部12の一例は、運転席の前方に設けられたステアリングホイールまたはハンドルである。 Steering unit 12 is a member that is operated by the driver to steer the wheels and change the traveling direction of the vehicle 10. An example of the steering unit 12 is a steering wheel or a handle provided in front of the driver's seat.
 ミラー14R、14Lは、車両の外部に設けられたドアミラーである。ミラー14Cは、車両10の内部に設けられたルームミラーである。ミラー14Rは、ダッシュボード32の側方であって、車両10の右側面に設けられている。ミラー14Lは、ダッシュボード32の側方であって、車両10の左側面に設けられている。ミラー14Cは、ダッシュボード32の上方であって、左右方向における中央部に設けられている。ミラー14R、14L、14Cは、後方に向けられて車両10に配置されている。これにより、ミラー14R、14L、14Cは、車両10の後方の周辺の状況を映す。ミラー14R、14L、14Cは、例えば、ハーフミラーまたは電子ミラーであって、一定の光を透過する。これにより、後述する指標表示部15の指標の画像を透過する。 Mirrors 14R and 14L are door mirrors provided outside the vehicle. The mirror 14 </ b> C is a room mirror provided inside the vehicle 10. The mirror 14 </ b> R is provided on the right side of the vehicle 10 on the side of the dashboard 32. The mirror 14 </ b> L is provided on the left side surface of the vehicle 10 on the side of the dashboard 32. The mirror 14C is provided above the dashboard 32 and at the center in the left-right direction. The mirrors 14 </ b> R, 14 </ b> L, and 14 </ b> C are disposed on the vehicle 10 so as to be directed rearward. As a result, the mirrors 14R, 14L, and 14C reflect the situation around the rear of the vehicle 10. The mirrors 14R, 14L, and 14C are, for example, half mirrors or electronic mirrors, and transmit certain light. Thereby, the image of the index of the index display unit 15 described later is transmitted.
 指標表示部15a、15b、15cは、例えば、画像を表示する液晶表示装置等の画像表示装置である。指標表示部15a、15b、15cが表示する画像の一例は、指標である。指標表示部15aは、ミラー14Rの内部に設けられている。指標表示部15bは、ミラー14Cの内部に設けられている。指標表示部15cは、ミラー14Lの内部に設けられている。指標表示部15a、15b、15cのそれぞれを区別する必要がない場合、指標表示部15と記載する。 The indicator display units 15a, 15b, and 15c are image display devices such as a liquid crystal display device that displays images. An example of an image displayed by the index display units 15a, 15b, and 15c is an index. The index display unit 15a is provided inside the mirror 14R. The index display unit 15b is provided inside the mirror 14C. The index display unit 15c is provided inside the mirror 14L. When it is not necessary to distinguish each of the index display parts 15a, 15b, and 15c, it will be referred to as an index display part 15.
 モニタ装置16は、画像及び音声を出力するとともに、運転者を含む乗員からの入力を受け付ける。モニタ装置16は、中央表示装置26と、音声出力装置28と、操作入力部30とを有する。中央表示装置26は、例えば、画像を表示可能な液晶表示装置である。中央表示装置26は、ナビゲーションシステムの道案内等の画像を表示する。尚、中央表示装置26は、指標を表示する指標表示部15dとしての機能も有する。音声出力装置28は、例えば、スピーカである。音声出力装置28は、道案内等、及び、警告等の音声を出力する。操作入力部30は、例えば、中央表示装置26の画像を透過可能なタッチパネルである。操作入力部30は、中央表示装置26の表面に設けられている。操作入力部30は、運転者を含む乗員からの入力を受け付ける。 The monitor device 16 outputs an image and sound, and receives input from a passenger including a driver. The monitor device 16 includes a central display device 26, an audio output device 28, and an operation input unit 30. The central display device 26 is, for example, a liquid crystal display device that can display an image. The central display device 26 displays an image such as route guidance of the navigation system. The central display device 26 also has a function as an index display unit 15d that displays an index. The audio output device 28 is, for example, a speaker. The sound output device 28 outputs sound such as road guidance and warnings. The operation input unit 30 is, for example, a touch panel that can transmit an image of the central display device 26. The operation input unit 30 is provided on the surface of the central display device 26. The operation input unit 30 receives input from an occupant including a driver.
 計器表示装置18は、ダッシュボード32の内部であって、操舵部12の前方に設けられている。計器表示装置18は、例えば、画像を表示可能な液晶表示装置である。計器表示装置18は、車両10の計測値を示す計器の画像を表示する。例えば、計器表示装置18は、計測値の一例である車両10の速度を示すスピードメータの画像、及び、計測値の他の例であるエンジンの回転数を示すタコメータの画像等を表示する。尚、計器表示装置18は、指標を表示する指標表示部15eとしての機能も有する。 The instrument display device 18 is provided inside the dashboard 32 and in front of the steering unit 12. The instrument display device 18 is a liquid crystal display device capable of displaying an image, for example. The instrument display device 18 displays an image of the instrument indicating the measurement value of the vehicle 10. For example, the instrument display device 18 displays an image of a speedometer that indicates the speed of the vehicle 10 that is an example of a measurement value, an image of a tachometer that indicates the number of revolutions of an engine that is another example of the measurement value, and the like. The instrument display device 18 also has a function as an index display unit 15e that displays an index.
 車内撮像部20は、例えば、CCD(charge-coupled device)またはCMOS(complementary metal-oxide semiconductor)センサ等を有するデジタルカメラである。車内撮像部20は、例えば、操舵部12の前方のダッシュボード32の上面に設置されている。車内撮像部20は、後方に向けられている。これにより、車内撮像部20は、操舵部12の後方に着座している運転者の少なくとも眼の部分を含む顔を撮像して、運転者の撮像画像(以下、顔画像)の撮像画像データを生成する。尚、車内撮像部20は、運転者の顔画像(好ましくは、運転者の顔の正面の画像)を撮像できれば、いずれの位置(例えば、操舵部12、コンソールの前方、フロントガラスの上部等)に配置されていてもよい。 The in-vehicle imaging unit 20 is a digital camera having, for example, a CCD (charge-coupled device) or a CMOS (complementary metal-oxide semiconductor) sensor. The in-vehicle imaging unit 20 is installed, for example, on the upper surface of the dashboard 32 in front of the steering unit 12. The in-vehicle imaging unit 20 is directed rearward. As a result, the in-vehicle image capturing unit 20 captures a face including at least the eye part of the driver sitting behind the steering unit 12 and uses the captured image data of the driver's captured image (hereinafter referred to as a face image). Generate. The in-vehicle image capturing unit 20 can capture any position (for example, the steering unit 12, the front of the console, the top of the windshield, etc.) as long as it can capture the driver's face image (preferably, the front image of the driver's face). May be arranged.
 図2は、車両10の制御系を示すブロック図である。図2に示すように、車両10は、ECU(Electronic Control Unit)40と、車内ネットワーク42とを更に備える。ECU40は、安全確認装置50の一例である。例えば、車内撮像部20、指標表示部15、モニタ装置16、計器表示装置18、及び、ECU40は、安全確認システム52として機能する。 FIG. 2 is a block diagram showing a control system of the vehicle 10. As shown in FIG. 2, the vehicle 10 further includes an ECU (Electronic Control Unit) 40 and an in-vehicle network 42. The ECU 40 is an example of the safety confirmation device 50. For example, the in-vehicle imaging unit 20, the indicator display unit 15, the monitor device 16, the instrument display device 18, and the ECU 40 function as the safety confirmation system 52.
 ECU40は、例えば、コンピュータである。本実施形態では、ECU40は、ハードウェアとソフトウェア(即ち、プログラム)が協働することにより、車両10の制御全般を司る。 ECU40 is a computer, for example. In the present embodiment, the ECU 40 governs overall control of the vehicle 10 by cooperation of hardware and software (that is, a program).
 ECU40は、CPU(Central Processing Unit)40aと、ROM(Read Only Memory)40bと、RAM(Random Access Memory)40cと、表示制御部40dと、音声制御部40eと、SSD(Solid State Drive)40fとを備える。CPU40a、ROM40b及びRAM40cは、同一パッケージ内に集積されていてもよい。 The ECU 40 includes a CPU (Central Processing Unit) 40a, a ROM (Read Only Memory) 40b, a RAM (Random Access Memory) 40c, a display control unit 40d, a voice control unit 40e, and an SSD (Solid State Drive) 40f. Is provided. The CPU 40a, ROM 40b, and RAM 40c may be integrated in the same package.
 CPU40aは、ハードウェアプロセッサの一例であって、ROM40b等の不揮発性の記憶装置に記憶されたプログラムを読み出し、当該プログラムにしたがって各種の演算処理および制御を実行する。ROM40bは、各プログラム及びプログラムの実行に必要なパラメータ等を記憶する。RAM40cは、CPU40aでの演算で用いられる各種のデータを一時的に記憶する。表示制御部40dは、ECU40での演算処理のうち、主として、車内撮像部20で得られた画像の画像処理と、指標表示部15及び表示装置18、26に表示させる表示用の画像のデータ変換等を実行する。音声制御部40eは、ECU40での演算処理のうち、主として、音声出力装置28に出力させる音声の処理を実行する。SSD40fは、書き換え可能な不揮発性の記憶部であって、ECU40の電源がオフされた場合にあってもデータを維持する。 The CPU 40a is an example of a hardware processor, reads a program stored in a nonvolatile storage device such as the ROM 40b, and executes various arithmetic processes and controls according to the program. The ROM 40b stores each program and parameters necessary for executing the program. The RAM 40c temporarily stores various types of data used in computations by the CPU 40a. The display control unit 40d mainly performs the image processing of the image obtained by the in-vehicle imaging unit 20 and the data conversion of the display image to be displayed on the index display unit 15 and the display devices 18 and 26 in the arithmetic processing in the ECU 40. Etc. The voice control unit 40e mainly executes voice processing to be output to the voice output device 28 among the arithmetic processing in the ECU 40. The SSD 40f is a rewritable nonvolatile storage unit, and maintains data even when the power of the ECU 40 is turned off.
 車内ネットワーク42は、例えば、CAN(Controller Area Network)である。車内ネットワーク42は、ECU40と、操作入力部30とを制御信号及び操作内容等の信号及び情報を送受信可能に電気的に接続する。 The in-vehicle network 42 is, for example, a CAN (Controller Area Network). The in-vehicle network 42 electrically connects the ECU 40 and the operation input unit 30 so that signals and information such as control signals and operation contents can be transmitted and received.
 図3は、安全確認装置50として機能するECU40の機能を説明するブロック図である。図3に示すように、ECU40は、制御部54と、記憶部56とを有する。制御部54は、CPU40a、表示制御部40d、及び、音声制御部40eの機能として実現される。記憶部56は、ROM40b、RAM40c、及び、SSD40fの機能として実現される。 FIG. 3 is a block diagram for explaining the function of the ECU 40 that functions as the safety confirmation device 50. As shown in FIG. 3, the ECU 40 includes a control unit 54 and a storage unit 56. The control unit 54 is realized as a function of the CPU 40a, the display control unit 40d, and the voice control unit 40e. The storage unit 56 is realized as a function of the ROM 40b, the RAM 40c, and the SSD 40f.
 制御部54は、指標出力部60と、判定部62とを有する。制御部54は、安全確認用のプログラムを読み込むことによって、指標出力部60及び判定部62として機能する。指標出力部60及び判定部62の一部または全部は、ASIC(Application Specific Integrated Circuit)を含む回路等のハードウェアによって構成してもよい。 The control unit 54 includes an index output unit 60 and a determination unit 62. The control unit 54 functions as the index output unit 60 and the determination unit 62 by reading a safety confirmation program. Part or all of the index output unit 60 and the determination unit 62 may be configured by hardware such as a circuit including an ASIC (Application Specific Integrated Circuit).
 指標出力部60は、車両10の運転者に視認させる指標を出力させる。例えば、指標出力部60は、車両10の自動運転中に指標を出力させる。具体的には、指標出力部60は、指標の画像データを指標表示部15へ出力することによって、視認可能な指標を指標表示部15に表示させて出力させる。指標出力部60は、1回の安全確認において、時間をずらして複数の指標表示部15のいずれかに指標を表示させることを繰り返してよい。指標出力部60は、例えば、1回の安全確認において、指標の表示を予め定められた規定回数(例えば、3回)繰り返してよい。この場合、指標出力部60は、1回の安全確認において、複数の指標の位置をランダムに変更してよい。また、指標出力部60は、異なる安全確認毎に、複数の指標の位置をランダムに変更してよい。指標出力部60は、記憶部56に格納された乱数テーブル等に基づいて、指標の位置をランダムに変更してよい。指標出力部60は、出力させた指標の位置を判定部62へ出力する。 The index output unit 60 outputs an index to be visually recognized by the driver of the vehicle 10. For example, the index output unit 60 outputs the index during the automatic driving of the vehicle 10. Specifically, the index output unit 60 outputs index image data to the index display unit 15, thereby causing the index display unit 15 to display and output a visible index. The index output unit 60 may repeat displaying the index on any of the plurality of index display units 15 at different times in one safety check. For example, the index output unit 60 may repeat the display of the index a predetermined number of times (for example, 3 times) in one safety check. In this case, the index output unit 60 may randomly change the positions of the plurality of indices in one safety check. In addition, the index output unit 60 may randomly change the positions of a plurality of indices for each different safety check. The index output unit 60 may randomly change the position of the index based on a random number table or the like stored in the storage unit 56. The index output unit 60 outputs the position of the output index to the determination unit 62.
 判定部62は、自動運転中に車両10が診断区間に進入したか否かを判定する。診断区間は、手動運転をする運転者の安全確認をするための区間であって、自動運転区間の一部である。診断区間は、例えば、手動運転に切り替える地点から所定距離または所定時間だけ前(即ち、自動運転区間側)の地点である。所定距離または所定時間は、指標を出力して運転者の安全を確認できる距離または時間である。判定部62は、診断区間に進入したと判定すると、指標の表示を開始させるための診断開始指示を指標出力部60に出力する。 The determination unit 62 determines whether or not the vehicle 10 has entered the diagnosis section during automatic driving. The diagnosis section is a section for confirming the safety of a driver who performs manual driving, and is a part of the automatic driving section. The diagnosis section is, for example, a point that is a predetermined distance or a predetermined time before the point to switch to manual driving (that is, the automatic driving section side). The predetermined distance or the predetermined time is a distance or time at which the safety of the driver can be confirmed by outputting the index. When the determination unit 62 determines that the diagnosis section has been entered, the determination unit 62 outputs a diagnosis start instruction for starting display of the index to the index output unit 60.
 判定部62は、指標出力部60から指標の位置を取得する。判定部62は、診断区間を自動運転で走行中に、車両10の運転者の少なくとも眼を含む顔を撮像した撮像画像のデータを車内撮像部20から取得する。判定部62は、取得した撮像画像内の顔または眼の画像に基づいて、車両10の運転者の顔または視線の向きとともに、運転者の顔または眼の位置を検出する。以下の説明において、顔または視線の向きを“視線方向”と記載し、顔または眼の位置を“基準点”と記載する。 The determination unit 62 acquires the position of the index from the index output unit 60. The determination unit 62 acquires, from the in-vehicle image capturing unit 20, data of a captured image obtained by capturing a face including at least eyes of the driver of the vehicle 10 while traveling in the diagnostic section by automatic driving. The determination unit 62 detects the position of the driver's face or eyes along with the direction of the driver's face or line of sight of the vehicle 10 based on the acquired face or eye image in the captured image. In the following description, the direction of the face or line of sight is described as “line of sight”, and the position of the face or eye is described as “reference point”.
 判定部62は、指標の位置と視線方向とに基づいて、警告を通知するか否かを判定する。例えば、判定部62は、基準点を起点とする少なくとも視線方向上に指標がある場合、即ち、運転者が指標の方向を見ている場合、運転者は覚醒しており安全なので、警告不要と判定する。尚、判定部62は、視線方向上及び視線方向上の近傍に指標がある場合、警告不要と判定してもよい。この場合、判定部62は、指標を表示する位置を変更させる指示である位置変更指示を指標出力部60に出力する。一方、判定部62は、基準点を起点とする視線方向上に指標がない場合、即ち、運転者が指標の方向を見ていない場合、運転者は覚醒しておらず安全ではないので、警告すべきと判定する。尚、判定部62は、視線方向上及び視線方向上の近傍に指標がない場合、警告すべきと判定してもよい。判定部62は、警告を通知すると判定した場合、音声出力装置28に音声による警告を出力させる。警告の一例は、安全に関する通知であって、運転者を覚醒させるためのブザー音または人の声等であってよい。尚、判定部62は、警告を通知する場合、画像による警告を表示装置18、26に出力させてもよい。 The determination unit 62 determines whether or not to issue a warning based on the position of the index and the line-of-sight direction. For example, when the determination unit 62 has an index at least in the line-of-sight direction starting from the reference point, that is, when the driver is looking at the direction of the index, the driver is awake and safe, so that the warning is unnecessary. judge. Note that the determination unit 62 may determine that the warning is unnecessary when there is an index on the line of sight and in the vicinity of the line of sight. In this case, the determination unit 62 outputs a position change instruction, which is an instruction to change the position where the index is displayed, to the index output unit 60. On the other hand, when there is no index in the line-of-sight direction starting from the reference point, that is, when the driver does not look at the direction of the index, the determination unit 62 warns that the driver is not awake and safe. Judge that it should be. Note that the determination unit 62 may determine that a warning should be given when there is no index on the line of sight and in the vicinity of the line of sight. If it is determined that a warning is to be notified, the determination unit 62 causes the audio output device 28 to output an audio warning. An example of the warning is a notification regarding safety, and may be a buzzer sound or a human voice for awakening the driver. Note that the determination unit 62 may cause the display devices 18 and 26 to output an image warning when notifying the warning.
 判定部62は、指標の位置と視線方向とに基づいて、自動運転から運転者の手動運転に切り替えるか否かを判定してよい。具体的には、判定部62は、基準点を起点とする少なくとも視線方向上に指標があると判定した回数が予め設定された規定回数以上であって、車両10が手動運転区間に進入した場合、自動運転から運転者の手動運転に切り替えると判定する。換言すれば、判定部62は、警告不要と判定した回数が規定回数以上であって、車両10が手動運転区間に進入した場合、手動運転に切り替えると判定する。 The determination unit 62 may determine whether to switch from automatic driving to manual driving by the driver based on the position of the index and the line-of-sight direction. Specifically, when the number of times that the determination unit 62 determines that there is an index at least in the line-of-sight direction starting from the reference point is equal to or more than a predetermined number of times set in advance, and the vehicle 10 enters the manual driving section It is determined that the automatic operation is switched to the driver's manual operation. In other words, the determination unit 62 determines to switch to manual operation when the number of times determined that the warning is unnecessary is equal to or greater than the specified number and the vehicle 10 enters the manual operation section.
 判定部62は、自動停車すべきか否かを判定してよい。例えば、判定部62は、指標の表示を継続した時間と予め定められた判定時間とを比較して自動停車するか否かを判定してよい。判定部62は、自動停車すべきと判定した場合、車両10を自動停車する。 The determination unit 62 may determine whether to stop automatically. For example, the determination unit 62 may determine whether or not to automatically stop by comparing the time during which the display of the index is continued with a predetermined determination time. When the determination unit 62 determines that the vehicle should be automatically stopped, the vehicle 10 is automatically stopped.
 記憶部56は、制御部54が実行する安全確認用のプログラム、プログラムの実行に必要なデータ、及び、プログラムの実行によって生成されるデータ等を記憶する。記憶部56は、プログラムの実行に必要なデータとして、安全確認処理を実行する区間である診断区間の位置情報、指標の表示の終了を判定する規定回数、自動停車を判定するための判定時間、指標の画像データ等を記憶する。記憶部56は、プログラムの実行によって生成されるデータとして、運転者の顔の撮像画像データを記憶する。記憶部56は、ネットワーク上の記憶装置(いわゆる、クラウド)等によって実現してもよい。 The storage unit 56 stores a safety confirmation program executed by the control unit 54, data necessary for executing the program, data generated by executing the program, and the like. The storage unit 56 includes, as data necessary for the execution of the program, position information of a diagnosis section that is a section for executing safety confirmation processing, a specified number of times for determining the end of display of an index, a determination time for determining an automatic stop, The index image data and the like are stored. The storage unit 56 stores captured image data of the driver's face as data generated by executing the program. The storage unit 56 may be realized by a storage device (so-called cloud) on a network.
 図4は、指標出力部60が表示させる指標の一例を示す図である。図4に示す指標表示部15a、15b、15c、15d、15eの位置関係は、概略である。図4に示すように、指標出力部60は、自動運転中に指標MK1、MK2、MK3、MK4、MK5を指標表示部15a、15b、15c、15d、15eに表示させる。具体的には、指標出力部60は、指標MK1、MK2、MK3をミラー14R、14C、14Lに設けられた指標表示部15a、15b、15cに表示させる。指標出力部60は、指標MK4を指標表示部15dとして機能する中央表示装置26に表示させる。指標出力部60は、指標MK5を指標表示部15eとして機能する計器表示装置18に表示させる。これにより、指標出力部60は、運転者よりも前方の左右上下に指標MK1、MK2、MK3、MK4、MK5を出力させる。指標MK1、MK2、MK3、MK4、MK5を区別する必要がない場合、指標MKと記載する。図4に示す例では、指標MK1~指標MK5は、円内に数字を含む画像となっているが、指標MKの画像は、これらの例に限定されない。また、図4に示す例では、全ての指標MK1~指標MK5が表示されているが、安全確認処理において、指標出力部60は、指標MK1~指標MK5を1個ずつ表示させる。指標出力部60は、いずれかの指標MKをいずれかの指標表示部15に出力させ、次に、別の指標MKを別の指標表示部15に表示させる。指標出力部60は、表示させる指標表示部15をランダムに選択する。指標出力部60は、1度の安全確認において、この指標MKの表示を少なくとも規定回数繰り返す。 FIG. 4 is a diagram illustrating an example of an index displayed by the index output unit 60. The positional relationship between the index display units 15a, 15b, 15c, 15d, and 15e shown in FIG. 4 is schematic. As shown in FIG. 4, the indicator output unit 60 displays the indicators MK1, MK2, MK3, MK4, and MK5 on the indicator display units 15a, 15b, 15c, 15d, and 15e during the automatic operation. Specifically, the index output unit 60 displays the indexes MK1, MK2, and MK3 on the index display units 15a, 15b, and 15c provided on the mirrors 14R, 14C, and 14L. The index output unit 60 displays the index MK4 on the central display device 26 that functions as the index display unit 15d. The index output unit 60 displays the index MK5 on the instrument display device 18 that functions as the index display unit 15e. As a result, the index output unit 60 outputs the indices MK1, MK2, MK3, MK4, and MK5 to the left, right, up, and down ahead of the driver. When it is not necessary to distinguish the indices MK1, MK2, MK3, MK4, and MK5, they are described as an index MK. In the example shown in FIG. 4, the indicators MK1 to MK5 are images including numbers in a circle, but the image of the indicator MK is not limited to these examples. In the example shown in FIG. 4, all the indicators MK1 to MK5 are displayed, but in the safety confirmation process, the indicator output unit 60 displays the indicators MK1 to MK5 one by one. The index output unit 60 causes any one of the index MKs to be output to any one of the index display units 15, and then causes another index MK to be displayed on another index display unit 15. The index output unit 60 randomly selects the index display unit 15 to be displayed. The index output unit 60 repeats the display of the index MK at least a specified number of times in one safety check.
 図5は、制御部54が実行する安全確認処理のフローチャートである。制御部54は、自動運転中に安全確認用のプログラムを読み込むことによって、安全確認処理を実行する。 FIG. 5 is a flowchart of the safety confirmation process executed by the control unit 54. The control unit 54 executes a safety confirmation process by reading a safety confirmation program during automatic operation.
 図5に示すように、判定部62は、自動運転中の車両10が手動運転の診断区間か否かを判定する(S102)。判定部62は、例えば、GPS(Global Positioning System)の端末等から取得した車両10の位置情報と、記憶部56に記憶された診断区間の位置情報とを比較することによって、車両10が診断区間か否かを判定する。判定部62は、車両10が診断区間でないと判定すると(S102:No)、待機状態となる。 As shown in FIG. 5, the determination unit 62 determines whether or not the vehicle 10 during automatic driving is in a manual driving diagnostic section (S102). For example, the determination unit 62 compares the position information of the vehicle 10 acquired from a GPS (Global Positioning System) terminal and the like with the position information of the diagnosis section stored in the storage unit 56 so that the vehicle 10 It is determined whether or not. When the determination unit 62 determines that the vehicle 10 is not in the diagnostic section (S102: No), the determination unit 62 enters a standby state.
 判定部62は、車両10が診断区間であると判定すると(S102:Yes)、診断開始の音声案内を音声出力装置28に出力させるとともに、診断開始指示を指標出力部60へ出力する(S104)。例えば、判定部62は、“今から表示する指標の方を見てください”等の音声案内を音声出力装置28に出力させる。 If the determination unit 62 determines that the vehicle 10 is in the diagnostic section (S102: Yes), the voice output device 28 outputs a diagnosis start voice guidance and outputs a diagnosis start instruction to the index output unit 60 (S104). . For example, the determination unit 62 causes the voice output device 28 to output a voice guidance such as “Please look at the index to be displayed now”.
 指標出力部60は、自動運転中に診断開始指示を取得すると、指標MKを指標表示部15に表示させるとともに、指標MKの位置を判定部62へ出力する(S106)。指標出力部60は、例えば、指標表示部15aに指標MK1を表示させる。尚、指標MKの位置は、指標MKを表示している指標表示部15の位置であってもよい。 The index output unit 60, when acquiring a diagnosis start instruction during automatic driving, displays the index MK on the index display unit 15 and outputs the position of the index MK to the determination unit 62 (S106). For example, the index output unit 60 displays the index MK1 on the index display unit 15a. The position of the index MK may be the position of the index display unit 15 displaying the index MK.
 判定部62は、視線方向が適切か否かを判定する(S108)。具体的には、判定部62は、運転者の顔を撮像した撮像画像のデータを車内撮像部20から取得する。判定部62は、撮像画像に基づいて、視線方向及び基準点を検出する。判定部62は、基準点を起点とした視線方向と指標MKの位置とに基づいて、視線方向が適切か否かを判定する。判定部62は、基準点を起点とした視線方向上(または視線方向の近傍)に指標MKが存在する場合、視線方向が適切と判定する。一方、判定部62は、基準点を起点とした視線方向上(または視線方向の近傍)に指標MKが存在しない場合、視線方向が不適切と判定する。 The determining unit 62 determines whether the line-of-sight direction is appropriate (S108). Specifically, the determination unit 62 acquires captured image data obtained by capturing the driver's face from the in-vehicle image capturing unit 20. The determination unit 62 detects the line-of-sight direction and the reference point based on the captured image. The determination unit 62 determines whether or not the visual line direction is appropriate based on the visual line direction starting from the reference point and the position of the index MK. The determination unit 62 determines that the line-of-sight direction is appropriate when the index MK exists on the line-of-sight direction starting from the reference point (or in the vicinity of the line-of-sight direction). On the other hand, the determination unit 62 determines that the line-of-sight direction is inappropriate when the index MK does not exist on the line-of-sight direction starting from the reference point (or in the vicinity of the line-of-sight direction).
 判定部62は、運転者が指標MKの方向を見ておらず、視線方向が適切でないと判定した場合(S108:No)、運転者の状態が正常でないので、自動停車するか否かを判定する(S110)。例えば、判定部62は、指標MKの表示を継続した時間と予め定められた判定時間とを比較して自動停車するか否かを判定してよい。具体的には、判定部62は、指標MKの表示を継続した時間が判定時間未満であれば、自動停車しないと判定する。一方、判定部62は、指標MKの表示を継続した時間が判定時間以上であれば、即ち、運転者が指標MKを長時間見ておらず覚醒していない可能性が高い場合、自動停車すると判定する。 If the driver does not look at the direction of the index MK and determines that the line-of-sight direction is not appropriate (S108: No), the determination unit 62 determines whether or not to automatically stop because the driver's state is not normal. (S110). For example, the determination unit 62 may determine whether to stop automatically by comparing the time during which the display of the index MK is continued with a predetermined determination time. Specifically, the determination unit 62 determines not to stop automatically if the time during which the display of the indicator MK is continued is less than the determination time. On the other hand, if the time for which the display of the indicator MK is continued is longer than the determination time, that is, if the driver has not watched the indicator MK for a long time and is not likely to be awake, judge.
 判定部62は、自動停車しないと判定すると(S110:No)、音声出力装置28に警告の音声を出力させる(S112)。換言すれば、判定部62は、ステップS108における指標MKの位置と運転者の視線方向とに基づいて、警告を出力させる。判定部62は、ブザー音等による警告を音声出力装置28に出力させてよい。 If the determination unit 62 determines that the vehicle does not stop automatically (S110: No), it causes the audio output device 28 to output a warning sound (S112). In other words, the determination unit 62 outputs a warning based on the position of the index MK and the driver's line-of-sight direction in step S108. The determination unit 62 may cause the audio output device 28 to output a warning based on a buzzer sound or the like.
 この後、判定部62は、指標MKの表示を継続してステップS108からS110を繰り返す。判定部62は、自動停車すべきと判定すると(S110:Yes)、車両10を制御して、安全な場所に自動停車させる(S114)。これにより、制御部54は、安全確認処理を終了する。 Thereafter, the determination unit 62 continues to display the index MK and repeats steps S108 to S110. If the determination part 62 determines that it should stop automatically (S110: Yes), it will control the vehicle 10 and will stop automatically at a safe place (S114). Thereby, the control part 54 complete | finishes a safety confirmation process.
 判定部62は、運転者が指標MKの方向を見ており、視線方向が適切であると判定した場合(S108:Yes)、運転者の状態が正常なので、指標MKの表示を終了させるか否かを判定する(S116)。例えば、判定部62は、指標MKの表示回数が規定回数以上か否かで、指標MKの表示を終了させるか否かを判定する。具体的には、判定部62は、指標MKの表示回数が規定回数未満であれば、指標MKの表示を継続すると判定する。一方、判定部62は、指標MKの表示回数が規定回数以上であれば、運転者が充分に覚醒しているので、指標MKの表示を終了すると判定する。 When the driver is looking at the direction of the index MK and determines that the line-of-sight direction is appropriate (S108: Yes), the determination unit 62 determines whether or not to end the display of the index MK because the driver's state is normal. Is determined (S116). For example, the determination unit 62 determines whether or not to end the display of the index MK depending on whether or not the display count of the index MK is equal to or greater than a specified number. Specifically, the determination unit 62 determines to continue displaying the index MK if the number of times the index MK is displayed is less than the specified number. On the other hand, if the number of times the index MK is displayed is equal to or greater than the specified number, the determination unit 62 determines that the display of the index MK is terminated because the driver is sufficiently awake.
 判定部62は、指標MKの表示を継続させると判定すると(S116:No)、指標出力部60に位置変更指示を出力する。 When the determination unit 62 determines to continue displaying the index MK (S116: No), it outputs a position change instruction to the index output unit 60.
 指標出力部60は、位置変更指示を取得すると、指標MKの表示位置を変更して新たに設定する(S118)。指標出力部60は、先に表示した指標表示部15aと異なる指標表示部15に指標MK(例えば、指標表示部15bに指標MK2)を表示させる。ここで、指標出力部60は、指標MKの表示位置をランダムに変更してもよい。更に、指標出力部60は、安全確認毎に指標MKの位置及び表示順序をランダムに変更してよい。ここでいう、1回の安全確認は、図5に示すスタートからエンドまでのことである。従って、今回の安全確認処理では、指標出力部60は、最初、指標表示部15aに指標MK1を表示させたが、次の安全確認処理では、指標出力部60は、最初、指標表示部15bに指標MK2を表示させてよい。指標出力部60は、表示中の指標MKを消去するとともに、変更した表示位置に基づいて選択した指標表示部15に指標MKを表示させる(S106)。この後、判定部62は、S108以降を繰り返す。 The index output unit 60, upon acquiring the position change instruction, changes the display position of the index MK and newly sets it (S118). The index output unit 60 displays the index MK (for example, the index MK2 on the index display unit 15b) on the index display unit 15 different from the previously displayed index display unit 15a. Here, the index output unit 60 may randomly change the display position of the index MK. Furthermore, the index output unit 60 may randomly change the position and display order of the index MK for each safety check. The single safety check here is from the start to the end shown in FIG. Accordingly, in the current safety confirmation process, the index output unit 60 first displays the index MK1 on the index display unit 15a. However, in the next safety confirmation process, the index output unit 60 first displays the index display unit 15b on the index display unit 15b. The indicator MK2 may be displayed. The index output unit 60 deletes the displayed index MK and causes the index display unit 15 selected based on the changed display position to display the index MK (S106). Thereafter, the determination unit 62 repeats S108 and subsequent steps.
 判定部62は、指標MKの表示を終了させると判定すると(S116:Yes)、車両10が手動運転区間か否かを判定する(S120)。例えば、判定部62は、GPSの端末から取得した車両10の位置に基づいて、車両10が手動運転区間か否かを判定する。 When the determination unit 62 determines to end the display of the index MK (S116: Yes), it determines whether or not the vehicle 10 is in the manual operation section (S120). For example, the determination unit 62 determines whether or not the vehicle 10 is in the manual driving section based on the position of the vehicle 10 acquired from the GPS terminal.
 判定部62は、車両10が手動運転区間でないと判定すると(S120:No)、待機状態となる。一方、判定部62は、車両10が手動運転区間であると判定すると(S120:Yes)、自動運転中の車両10を手動運転に切り替えて(S122)、車両10の制御を運転者に委譲する。これにより、制御部54は、安全確認処理を終了する。 When the determination unit 62 determines that the vehicle 10 is not in the manual operation section (S120: No), the determination unit 62 enters a standby state. On the other hand, when the determination unit 62 determines that the vehicle 10 is in the manual operation section (S120: Yes), the vehicle 10 during automatic operation is switched to manual operation (S122), and control of the vehicle 10 is transferred to the driver. . Thereby, the control part 54 complete | finishes a safety confirmation process.
 上述したように、ECU40である安全確認装置50では、指標出力部60が表示させた指標MKの位置と運転者の視線方向とに基づいて、判定部62が、運転者の状態を能動的に判定して、警告するか否かを判定する。これにより、安全確認装置50は、運転者の指差し等によって状態を判定する場合に比べて、運転者の手を操舵部12から離させることなく、より適切に運転者の状態を判定して、警告するか否かを判定できる。 As described above, in the safety confirmation device 50 that is the ECU 40, the determination unit 62 actively determines the driver's state based on the position of the index MK displayed by the index output unit 60 and the driver's line-of-sight direction. Determine whether to warn or not. Accordingly, the safety confirmation device 50 can more appropriately determine the state of the driver without separating the driver's hand from the steering unit 12 as compared with the case where the state is determined by the driver's pointing or the like. It can be determined whether or not to warn.
 安全確認装置50は、指標出力部60が複数の指標MKの位置をランダムに変化させるので、同じパターンで指標を表示して運転者が慣れている場合に比べて、運転者の状態をより精度よく確認することができる。また、安全確認装置50では、指標MKの位置をランダムに変化させることによって、車両10の走行状態(例えば、進行方向)等に依存して、指標MKが表示されない方向を低減することができる。この結果、安全確認装置50は、複数の指標MKを出力させることによって、車両10の周囲の全方向に運転者の視線を向けさせて安全確認させることができる。 In the safety confirmation device 50, since the index output unit 60 randomly changes the positions of the plurality of indices MK, the driver's state is more accurately compared with the case where the driver is used to displaying the indices in the same pattern. It can be confirmed well. Further, in the safety confirmation device 50, by randomly changing the position of the index MK, it is possible to reduce the direction in which the index MK is not displayed depending on the traveling state (for example, the traveling direction) of the vehicle 10. As a result, the safety confirmation device 50 can cause the driver's line of sight to be directed in all directions around the vehicle 10 to cause safety confirmation by outputting a plurality of indices MK.
 安全確認装置50では、指標出力部60が自動運転中に指標を出力させるので、運転者の安全を維持しつつ、運転者の状態を確認できる。 In the safety confirmation device 50, since the index output unit 60 outputs the index during the automatic driving, it is possible to confirm the driver's state while maintaining the driver's safety.
 安全確認装置50では、指標MKの位置と運転者の視線方向とに基づいて、自動運転から手動運転に切り替えるので、より適切に手動運転へ切り替えることができる。 In the safety confirmation device 50, since the automatic operation is switched to the manual operation based on the position of the index MK and the driver's line of sight, it is possible to more appropriately switch to the manual operation.
 安全確認装置50では、指標出力部60が、ミラー14R、14C、14L及び計器表示装置18等に指標MKを出力させるので、新たなスペースを設けることなく、運転者の状態を確認できる。 In the safety confirmation device 50, the index output unit 60 outputs the index MK to the mirrors 14R, 14C, 14L, the instrument display device 18 and the like, so that the driver's state can be confirmed without providing a new space.
 上述の実施形態の各構成の機能、配置、個数、及び、接続関係等は適宜変更してよい。また、上述のフローチャートの処理の順序は適宜変更してよい。 The function, arrangement, number, connection relationship, and the like of each component of the above-described embodiment may be changed as appropriate. In addition, the order of the processes in the flowcharts described above may be changed as appropriate.
 上述の実施形態では、指標表示部15が液晶表示装置等の画像表示装置を例としてあげたが、これに限定されない。例えば、指標表示部15は、画像をミラー14R、14C、14L等に投影する画像投影装置(いわゆる、プロジェクタ)等であってもよい。 In the above-described embodiment, the index display unit 15 is an image display device such as a liquid crystal display device, but the present invention is not limited to this. For example, the index display unit 15 may be an image projection device (so-called projector) that projects an image onto a mirror 14R, 14C, 14L, or the like.
 上述の実施形態では、自動運転中の安全確認を例に挙げたが、これに限定されない。例えば、手動運転中の運転者の状態確認及び覚醒に上述の実施形態を適用してもよい。 In the above-described embodiment, the safety check during automatic driving is taken as an example, but the present invention is not limited to this. For example, the above-described embodiment may be applied to the state confirmation and awakening of the driver during manual driving.
 本発明の実施形態を説明したが、これらの実施形態は、例として提示したものであり、発明の範囲を限定することは意図していない。これら新規な実施形態は、その他の様々な形態で実施されることが可能であり、発明の要旨を逸脱しない範囲で、種々の省略、置き換え、変更を行うことができる。これら実施形態やその変形は、発明の範囲や要旨に含まれるとともに、請求の範囲に記載された発明とその均等の範囲に含まれる。 Although embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the scope of the invention. These embodiments and modifications thereof are included in the scope and gist of the invention, and are included in the invention described in the claims and the equivalents thereof.

Claims (6)

  1.  移動体の運転者に視認させる指標を出力させる指標出力部と、
     前記運転者の顔または視線の向きを検出して、前記指標の位置と前記顔または前記視線の向きとに基づいて、警告を通知するか否かを判定する判定部と、
     を備える安全確認装置。
    An index output unit for outputting an index to be visually recognized by the driver of the moving body;
    A determination unit that detects a direction of the driver's face or line of sight and determines whether to issue a warning based on the position of the index and the direction of the face or the line of sight;
    A safety confirmation device comprising:
  2.  前記指標出力部は、複数の前記指標の位置をランダムに変化させる
     請求項1に記載の安全確認装置。
    The safety check device according to claim 1, wherein the index output unit randomly changes positions of the plurality of indexes.
  3.  前記指標出力部は、前記移動体の自動運転中に前記指標を出力させる
     請求項1または2に記載の安全確認装置。
    The safety check device according to claim 1, wherein the index output unit outputs the index during automatic operation of the moving body.
  4.  前記判定部は、前記指標の位置と前記運転者の顔または視線の向きとに基づいて、前記自動運転から前記運転者の手動運転に切り替えるか否かを判定する
     請求項3に記載の安全確認装置。
    The safety check according to claim 3, wherein the determination unit determines whether to switch from the automatic driving to the driver's manual driving based on the position of the index and the direction of the driver's face or line of sight. apparatus.
  5.  前記指標出力部は、前記移動体に設けられたミラーまたは計器を表示する計器表示装置に前記指標を出力させる
     請求項1から4のいずれか1項に記載の安全確認装置。
    The safety confirmation device according to any one of claims 1 to 4, wherein the index output unit causes the instrument display device that displays a mirror or instrument provided in the moving body to output the index.
  6.  前記指標出力部は、1回の安全確認において、前記指標を表示させることを、時間をずらして予め定められた規定回数繰り返す
     請求項1から5のいずれか1項に記載の安全確認装置。
     
    The safety check device according to any one of claims 1 to 5, wherein the index output unit repeats displaying the index in a single safety check by shifting a predetermined number of times in advance.
PCT/JP2017/042661 2016-12-01 2017-11-28 Safety confirmation device WO2018101274A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2016234206A JP2018092318A (en) 2016-12-01 2016-12-01 Safety confirmation device
JP2016-234206 2016-12-01

Publications (1)

Publication Number Publication Date
WO2018101274A1 true WO2018101274A1 (en) 2018-06-07

Family

ID=62242401

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2017/042661 WO2018101274A1 (en) 2016-12-01 2017-11-28 Safety confirmation device

Country Status (2)

Country Link
JP (1) JP2018092318A (en)
WO (1) WO2018101274A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7111510B2 (en) 2018-06-01 2022-08-02 フォルシアクラリオン・エレクトロニクス株式会社 State determination device, driving support device, state determination method, and driving support method

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002352228A (en) * 2001-05-25 2002-12-06 Toshiba Corp Image processing system and driving support system using the same
JP2007094618A (en) * 2005-09-28 2007-04-12 Omron Corp Notification controller and notification control method, recording medium, and program
JP2014181020A (en) * 2013-03-21 2014-09-29 Denso Corp Travel control device
JP2015184975A (en) * 2014-03-25 2015-10-22 富士通テン株式会社 Device for vehicle and vehicle control method
JP2016024509A (en) * 2014-07-16 2016-02-08 株式会社デンソーアイティーラボラトリ Vehicular alert system
JP2016115356A (en) * 2014-12-12 2016-06-23 ソニー株式会社 Automatic drive control device, automatic drive control method, and program

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002352228A (en) * 2001-05-25 2002-12-06 Toshiba Corp Image processing system and driving support system using the same
JP2007094618A (en) * 2005-09-28 2007-04-12 Omron Corp Notification controller and notification control method, recording medium, and program
JP2014181020A (en) * 2013-03-21 2014-09-29 Denso Corp Travel control device
JP2015184975A (en) * 2014-03-25 2015-10-22 富士通テン株式会社 Device for vehicle and vehicle control method
JP2016024509A (en) * 2014-07-16 2016-02-08 株式会社デンソーアイティーラボラトリ Vehicular alert system
JP2016115356A (en) * 2014-12-12 2016-06-23 ソニー株式会社 Automatic drive control device, automatic drive control method, and program

Also Published As

Publication number Publication date
JP2018092318A (en) 2018-06-14

Similar Documents

Publication Publication Date Title
JP6380002B2 (en) Perimeter monitoring device
US9809167B1 (en) Stopped vehicle traffic resumption alert
US10913496B2 (en) Parking assistance device
EP2990265B1 (en) Vehicle control apparatus
US7382240B2 (en) Warning device in a vehicle
US8566017B2 (en) Driving support apparatus for vehicle
CN107408349B (en) Information presentation device and information presentation method
WO2016067544A1 (en) Vehicle-mounted attention-attracting system and notification control device
US20180257565A1 (en) Drive assist apparatus
US11021103B2 (en) Method for enriching a field of view of a driver of a transportation vehicle with additional information, device for use in an observer transportation vehicle, device for use in an object, and transportation vehicle
US11591018B2 (en) Parking assistance device
JP2016182906A (en) Operation support system
JP2018144526A (en) Periphery monitoring device
WO2018150642A1 (en) Surroundings monitoring device
CN110696614B (en) System and method for controlling vehicle functions via driver HUD and passenger HUD
JP2017151606A (en) Inattentiveness/overlooking reminding system and computer program
CN114103976A (en) Display control device, system, control method and recording medium for vehicle
WO2018101274A1 (en) Safety confirmation device
JP2017068672A (en) Driving support device
JP6840998B2 (en) Obstacle detector
JP6124745B2 (en) In-vehicle system
JP2018076019A (en) Image processing device
JP2019031176A (en) Display device for vehicle
JP2016164010A (en) On-vehicle camera system
US11220181B2 (en) Operation control device, operation control method, and storage medium

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17875562

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17875562

Country of ref document: EP

Kind code of ref document: A1