WO2016013153A1 - Système de notification pour véhicule, dispositif de commande de notification, et dispositif de notification - Google Patents

Système de notification pour véhicule, dispositif de commande de notification, et dispositif de notification Download PDF

Info

Publication number
WO2016013153A1
WO2016013153A1 PCT/JP2015/003123 JP2015003123W WO2016013153A1 WO 2016013153 A1 WO2016013153 A1 WO 2016013153A1 JP 2015003123 W JP2015003123 W JP 2015003123W WO 2016013153 A1 WO2016013153 A1 WO 2016013153A1
Authority
WO
WIPO (PCT)
Prior art keywords
notification
driver
level
medium
mode
Prior art date
Application number
PCT/JP2015/003123
Other languages
English (en)
Japanese (ja)
Inventor
信輔 久次
Original Assignee
株式会社デンソー
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 株式会社デンソー filed Critical 株式会社デンソー
Publication of WO2016013153A1 publication Critical patent/WO2016013153A1/fr

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R21/00—Arrangements or fittings on vehicles for protecting or preventing injuries to occupants or pedestrians in case of accidents or other traffic risks
    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • G08G1/16—Anti-collision systems

Definitions

  • the present disclosure relates to a vehicle notification system, a notification control device, and a notification device that are used in a vehicle and notify a driver.
  • Patent Document 1 when a driver performs a starting operation, the degree of danger is determined based on the position where the detection target object around the host vehicle exists and the driver's line-of-sight direction, and a warning corresponding to the degree of danger is given to the driver.
  • a device (referred to as a notification device) is disclosed.
  • warning modes there are modes that appeal to the driver's hearing by sound output from the speaker, modes that appeal to the driver's vision using a display device, modes that appeal to the driver's tactile sense by vibrating the vibration device, etc. Illustrated.
  • Patent Document 2 discloses a notification device that performs notification so that a stimulus corresponding to the driver's state and driving environment is applied to the driver's visual, auditory, and tactile senses in order to maintain the driver's arousal state. Has been.
  • the notification device also changes the notification mode stepwise (or continuously) according to the driver's awakening level and the driving environment.
  • the inventor of the present application has found the following regarding the vehicle notification system, the notification control device, and the notification device.
  • each of the plurality of notification devices has its own rules. Based on this, the notification mode is changed stepwise to perform notification.
  • the warning sound output interval is shortened stepwise according to the state quantity to be notified, while another notification is performed.
  • the device changes the display color step by step according to the state quantity targeted by the device, while the notification mode by sound output remains constant.
  • the parameters of the notification mode appealing to the driver's hearing include the volume, the frequency of the warning sound, the output interval of the warning sound, etc.
  • the parameters of the notification mode appealing to the driver's vision include brightness, color, presence / absence of flashing , Flashing speed etc.
  • the parameters of the notification mode appealing to the tactile sense of the driver include the magnitude of vibration, the frequency, and the vibration interval.
  • An object of the present disclosure is to provide a notification system having a plurality of notification devices that notify information about different objects in stages, and from the aspect of notification performed by a certain notification device, the urgency and seriousness of the information being notified
  • Another object is to provide a vehicle notification system, a notification control device, and a notification device that are easily recognized by a driver.
  • the vehicle notification system includes a notification device that notifies the driver of information about the predetermined state quantity via at least one of the driver's visual sense, auditory sense, and tactile sense.
  • Each of the plurality of notification devices includes a plurality of notification devices that determine a notification level representing the strength of appealing information to the driver from a state quantity targeted by the notification device, and determines a notification mode according to the determined notification level. The notification is carried out by changing the target. The notification mode at each notification level is determined based on a predetermined notification rule that defines a notification mode for each notification level.
  • the notification rule includes at least one type of visual element among visual elements that are elements that change the number of notification level steps adopted by each notification device and a notification mode appealing to the driver's vision (hereinafter, visual notification mode).
  • a value for each notification level, a value for each notification level of at least one type of auditory element among the auditory elements that are elements that change the mode of notification appealing to the driver's hearing (hereinafter referred to as auditory notification mode), and the driver A value for each notification level of at least one type of tactile element of tactile elements that are elements for changing a notification mode (hereinafter referred to as a tactile notification mode) to appeal to the tactile sense of the visual element,
  • Each of the auditory element and the tactile element is set so that the strength with which the element appeals to the driver's sensory organ increases as the notification level increases.
  • the notification control device is a device that requests to notify information about a predetermined state quantity, and appeals the driver to information that is about to be notified based on the state quantity.
  • a notification medium for determining a notification level representing strength and requesting notification in a notification mode corresponding to the notification level, and a notification medium for notifying the driver of information information is provided to the driver through the visual sense of the driver.
  • Visual notification medium used to notify the driver auditory notification medium used to notify the driver of information via the driver's hearing, and tactile sense used to notify the driver of information via the driver's sense of touch
  • a vehicle notification system that includes at least one notification medium, and controls the operation of the notification medium and the notification device.
  • the notification control device receives a request from the notification device, and a notification implementation that realizes notification of the mode requested by the notification device by operating the notification medium based on the request received by the notification request reception unit. And a notification device management unit that instructs the notification mode requested by the notification device to be a notification mode in accordance with a notification rule that defines a notification mode for each notification level.
  • the notification rule includes the number of notification level steps adopted by the notification device, the value for each notification level of at least one type of visual element among visual elements that are elements that change the mode of notification using a visual notification medium, and A value for each notification level of at least one type of auditory element, which is an element that changes the manner of notification using an auditory notification medium, and a tactile sense that is an element that changes the manner of notification using a tactile notification medium
  • a value for each notification level of at least one tactile element of the elements is determined, and each of the visual element, the auditory element, and the tactile element becomes an element of the driver as the notification level increases. It is set to increase the strength of appealing to the sensory organs.
  • the notification device includes, as a notification medium for notifying the driver of information, a visual notification medium used for notifying the driver of information via the driver's vision, An auditory notification medium used for notifying the driver of information via hearing, a tactile notification medium used for notifying the driver of information via the driver's tactile sense, and controlling the operation of the notification medium.
  • a notification control device that notifies information in a predetermined manner, and causes the notification control device to notify the driver of information about a predetermined state quantity.
  • the notification device includes a notification level determination unit that determines a notification level, which is a degree of strength that appeals to the driver for information to be notified, based on the state quantity, and a notification medium that is used for notification of information among the notification media. It is determined based on a notification medium selection unit to be selected, a predetermined notification rule for determining a notification mode for each notification level, and a notification level determined by the notification level determination unit, using the notification medium selected by the notification medium selection unit.
  • a notification processing unit that requests the notification control device to perform notification in the notification mode, and the notification rule includes a number of notification level steps adopted by the notification device and a notification mode using a visual notification medium.
  • the visual elements that are elements that change the value of each of the visual elements of the visual element
  • a small number of auditory elements that are elements that change the manner of notification using the auditory information medium
  • a value for each notification level of at least one auditory element and a value for each notification level of at least one tactile element of tactile elements that are elements that change the notification mode using the tactile notification medium The visual element, the auditory element, and the tactile element are all set so that the strength with which the element appeals to the driver's sensory organ increases as the notification level increases.
  • the notification control device and the notification device, it is possible to provide commonality in the pattern of change according to the notification level of the notification mode of each notification device.
  • the visual element mode defined by the notification rule is uniquely determined according to the notification level even if the notification device is different, the driver can recognize the notification level from the visual element mode.
  • a notification control device, and a notification device in a vehicle notification system having a plurality of notification devices that notify information about different objects in stages, notification by a certain notification device is transmitted to a driver. It is possible to make it easier to recognize the urgency and seriousness that is going on.
  • FIG. 1 is a block diagram illustrating an example of a schematic configuration of a vehicle notification system according to the present embodiment.
  • FIG. 2 is a schematic view of the appearance around the driver seat.
  • FIG. 3 is a block diagram illustrating an example of a schematic configuration of the notification control device and the notification device,
  • FIG. 4 is a diagram illustrating an example of a notification rule,
  • FIG. 5 is a diagram illustrating an example of a notification rule,
  • FIG. 6 is a schematic diagram showing an example of a visual notification mode using HUD by the inter-vehicle distance notification device, FIG.
  • FIG. 7 is a schematic diagram showing an example of a visual notification mode using HUD by the inter-vehicle distance notification device
  • FIG. 8 is an example of a mode in which the type of the notification medium is changed according to the notification level.
  • FIG. 9 is a schematic diagram showing an example of a visual notification mode using the right electronic side mirror by the rear vehicle notification device
  • FIG. 10 is a schematic diagram illustrating an example of a visual notification mode using the right electronic side mirror by the rear vehicle notification device, It is an example of the schematic structure of the alerting
  • FIG. 1 is a diagram illustrating an example of a schematic configuration of a vehicle notification system 100 according to the present embodiment.
  • FIG. 2 is an external view of the vicinity of the driver's seat of a vehicle (hereinafter, the host vehicle) on which the vehicle notification system 100 is mounted.
  • the vehicle notification system 100 includes an in-vehicle sensor group 11, a surrounding monitoring camera 12, a detection object sensor 13, a driver monitor system 14, an inter-vehicle distance notification device 20A, a rear vehicle notification device 20B, and a lane departure notification device. 20C, the wakefulness maintaining device 20D, and the notification control device 30 are provided.
  • the inter-vehicle distance notification device 20A, the rear vehicle notification device 20B, the lane departure notification device 20C, and the awake state maintaining device 20D are examples of the notification device.
  • the vehicle notification system 100 includes a head-up display (hereinafter referred to as HUD: Head-Up Display) 51, a meter display 52, a center display 53, an electronic room mirror 54, an electronic side mirror 55, a portable terminal display 56, decorative lighting. 57, side speaker 61, center speaker 62, portable terminal speaker 63, grasping part tactile sensation generating device 71, seat tactile sensation generating device 72, portable terminal tactile sensation generating device 73, steering switch 74, touch panel 75 with tactile sensation generating function, and remote operation device 76.
  • the narrow-area communication unit 81 is provided.
  • the portable terminal display 56, the portable terminal speaker 63, and the portable terminal tactile sensation generating device 73 are provided in the portable terminal 4 brought into the passenger compartment by the user.
  • the vehicle notification system 100 cooperates with the mobile terminal 4 to control the display screen of the mobile terminal display 56 provided in the mobile terminal 4, the output sound from the mobile terminal speaker 63, and the operation of the mobile terminal tactile generating device 73. It has a configuration that can.
  • the mobile terminal 4 a known smartphone, tablet terminal, or the like can be used.
  • the mobile terminal such as a smartphone is installed in a state where an application program (hereinafter referred to as an application) for operating as the mobile terminal 4 included in the vehicle notification system 100 is installed and the application is being executed. It operates as the portable terminal 4 in the form.
  • an application an application program for operating as the mobile terminal 4 included in the vehicle notification system 100
  • the application is being executed. It operates as the portable terminal 4 in the form.
  • the HUD 51, meter display 52, center display 53, electronic room mirror 54, electronic side mirror 55, and portable terminal display 56 are all display devices that display information.
  • the side speaker 61, the center speaker 62, and the portable terminal speaker 63 are all audio output devices that output audio (including simple sounds).
  • the grip part tactile sensation generating device 71, the seat tactile sensation generating device 72, and the mobile terminal tactile sensation generating device 73 are all tactile sensation generating devices that stimulate the tactile sensation of the driver by operating an actuator (electric motor, vibration element, etc.).
  • the portable terminal tactile sensation generating device 73 may be configured as, for example, a device that stimulates a driver's tactile sense by vibrating a vibration element (so-called vibrator).
  • the steering switch 74, the touch panel 75 with a tactile sensation generation function, and the remote operation device 76 are input devices for a user to give instructions to various devices mounted on the vehicle, and a driver that performs the input operation. It has a function to stimulate the sense of touch. That is, the steering switch 74, the touch panel 75 with a tactile sensation generating function, and the remote operation device (haptic device) 76 also function as a tactile sensation generating apparatus that stimulates the tactile sense of the driver.
  • An outline of the operation of the various notification devices 20A to 20D that is, the inter-vehicle distance notification device 20A, the rear vehicle notification device 20B, the lane departure notification device 20C, the awake state maintaining device 20D, and the notification control device 30 is as follows. .
  • the notification devices 20A to 20D request the notification control device 30 to notify the driver of information about different state quantities via various notification media.
  • Each of the notification devices 20A to 20D notifies the driver of information on the state quantity in a plurality of stages of notification modes according to the high necessity (risk level, urgency level, etc.) of appealing to the driver. This is requested to the notification control device 30.
  • the notification control device 30 performs notification in a predetermined notification mode based on requests from the notification devices 20A to 20D, and the notification mode requested by each of the notification devices 20A to 20D conforms to a notification rule described later. It plays a role of instructing to become a notification mode.
  • the notification mode appealing to the driver's vision is referred to as a visual notification mode
  • the notification mode appealing to the auditory sense is referred to as an auditory notification mode
  • the notification mode appealing to the sense of touch is referred to as a tactile notification mode.
  • the notification device included in the vehicle notification system 100 is not limited to the inter-vehicle distance notification device 20A, the rear vehicle notification device 20B, the lane departure notification device 20C, and the awake state maintaining device 20D. It is only necessary to provide a known notification device that performs notification in a notification manner that changes in a plurality of stages to the driver based on the state quantity targeted by the notification device.
  • the notification device 20 performs a notification of a series of operations in which the notification device 20 requests the notification control device 30 to execute notification and the notification control device 30 performs notification based on the request.
  • the notification by the notification device 20 includes a mode in which the notification device 20 causes the notification control device 30 to notify.
  • the display devices 51 to 56, the decorative lighting 57, the sound output devices 61 to 63, and the tactile sensation generation devices 71 to 76 serve as interfaces for the notification control device 30 to notify various information based on requests from the notification device 20. Function.
  • the display devices 51 to 56 display an image output from the notification device 20, thereby functioning as an interface (visual notification medium) for the notification device 20 to notify the driver of various information through the driver's vision.
  • the decorative lighting 57 also functions as a visual notification medium by emitting light with a light emission pattern (light color, blinking, etc.) based on an instruction from the notification device 20.
  • the audio output devices 61 to 63 output an audio based on an instruction from the notification device 20, thereby allowing the notification device 20 to notify the driver of various information through the driver's hearing (an audio notification medium and an audio notification medium).
  • the tactile sensation generating devices 71 to 76 function as an interface (noted as a tactile notification medium) for notifying the driver of various information through the driver's tactile sense by stimulating the driver's tactile sense based on an instruction from the notification device 20. To do.
  • the display devices 51 to 56 and the decorative lighting 57 it is not necessary to provide all of the display devices 51 to 56 and the decorative lighting 57, and it is sufficient to provide at least one.
  • the constituent elements included in the vehicle notification system 100 are connected to each other via a known in-vehicle network so that they can communicate with each other.
  • the in-vehicle sensor group 11 is a variety of sensors that detect the state of the host vehicle. For example, a vehicle speed sensor, an acceleration sensor, a gyro sensor, a GNSS receiver, a steering angle sensor, a brake stroke sensor, an accelerator pedal sensor, a direction indication A lever position sensor and the like are included.
  • the vehicle speed sensor detects the traveling speed of the host vehicle
  • the acceleration sensor detects the acceleration acting on the host vehicle.
  • the GNSS receiver acquires data indicating the current position of the GNSS receiver by receiving radio waves from a satellite used in GNSS (Global Navigation Satellite System).
  • GNSS Global Navigation Satellite System
  • the GNSS receiver may be a GPS receiver.
  • the gyro sensor detects the rotational angular velocity around the vertical axis of the host vehicle, and the steering angle sensor detects the steering angle based on the steering angle.
  • the brake stroke sensor detects the depression amount of the brake pedal, and the accelerator pedal sensor detects the depression amount of the accelerator pedal.
  • the direction indicating lever position sensor detects whether the direction indicating lever is in a left turn position or a right turn position. Data detected by various sensors included in the in-vehicle sensor group 11 is sequentially output to the inter-vehicle distance notification device 20A, the rear vehicle notification device 20B, the lane departure notification device 20C, the awake state maintaining device 20D, and the like.
  • the periphery monitoring camera 12 is a camera having a predetermined range around the host vehicle as a shooting range.
  • the peripheral monitoring camera 12 may be realized by one camera or may be realized by a plurality of cameras.
  • a front camera 12A, a rear camera 12B, a left side camera 12C, and a right side camera 12D are provided.
  • the front camera 12A is installed, for example, in the vicinity of the electronic room mirror in the vehicle interior so as to photograph a predetermined range in front of the host vehicle.
  • the rear camera 12B is installed, for example, on the upper part of the rear window so as to capture a predetermined range behind the host vehicle.
  • the left side camera 12C may be installed, for example, in the vicinity of the left door, the left front fender, or the like so that a predetermined range from the left side to the rear side of the host vehicle is the shooting range.
  • the right side camera 12D may be installed, for example, in the vicinity of the right door, the right front fender, or the like so that a predetermined range from the right side to the rear side of the host vehicle is the shooting range.
  • an infrared camera or the like can be employed in addition to an optical camera such as a CCD camera.
  • the peripheral monitoring camera 12 is realized by an optical camera.
  • the image data (or video signal) captured by the periphery monitoring camera 12 is also transmitted to a predetermined notification device 20 such as an inter-vehicle distance notification device 20A in addition to a predetermined notification medium such as an electronic room mirror 54 and an electronic side mirror 55. Output sequentially.
  • the periphery monitoring camera 12 is configured such that the front, rear, left side, and right side of the host vehicle are set as shooting ranges, but the present invention is not limited thereto. As another aspect, it may be configured such that only a part (for example, the front side) around the own vehicle is set as the shooting range.
  • the detection target sensor 13 detects the distance, relative position, and relative speed of the detection target existing in a predetermined range around the host vehicle.
  • a well-known millimeter wave radar, laser radar, infrared sensor, ultrasonic sensor, or the like can be used.
  • the detection target sensor 13 is realized by a millimeter wave radar. That is, the detection target sensor 13 has a distance to the detection target and the detection target based on a shift or phase change between the transmission time of the exploration wave and the reception time of the reflected wave of the exploration wave. Detect direction and relative speed.
  • the detection object sensor 13 may also be realized by one sensor or a plurality of sensors.
  • the detection target sensor 13 detects a detection target existing in a predetermined range behind the host vehicle and a front detection target sensor 13A that detects a detection target existing in a predetermined range in front of the host vehicle.
  • the rear detection object sensor 13B is provided.
  • the forward detection target sensor 13A may be installed near the center of the front bumper so as to transmit the exploration wave to a predetermined range in front of the host vehicle.
  • the rear detection object sensor 13B may be installed near the center of the rear bumper so as to transmit the exploration wave to a predetermined range behind the host vehicle.
  • the detection target object sensor for detecting the detection target object of the left side and the right side of the own vehicle in this embodiment, it is not restricted to this. That is, it is good also as a structure provided with the detection target sensor which exists in each predetermined range of the left side and the right side.
  • an omnidirectional laser radar or the like may be used as the detection object sensor. In this case, the front, rear, left side, and right side detection target objects can be detected by the omnidirectional detection target sensor.
  • the driver monitor system 14 is a system that acquires information for determining the state of the driver (sleeping or looking aside).
  • the driver monitor system 14 includes a driver monitor 14A that captures a driver's face image, a biometric information sensor 14B that measures biometric information of the driver, and the like.
  • the driver monitor 14A is an optical camera, for example, and sequentially captures a range including the driver's face (for example, every 100 milliseconds).
  • the driver monitor 14A is installed on the steering column cover.
  • driver monitor 14A may be installed in the upper part by the side of the driver's seat of a windshield.
  • the driver monitor 14A may employ an infrared camera that can capture an image even in an environment with little visible light by detecting infrared rays.
  • the biological information sensor 14B is one of a brain wave sensor that measures brain waves, a blood pressure sensor that measures blood pressure, a pulse sensor that measures heart rate, a heart rate sensor that measures heart rate, and a respiratory sensor that measures respiration rate. It may be realized by a plurality of combinations. These sensors may be incorporated in the driver's seat, may be provided on the steering wheel, or may be mounted on the driver's wrist, for example.
  • Image data captured by the driver monitor 14A and data detected by the biological information sensor 14B are sequentially output to the awake state maintaining device 20D.
  • the driver monitor system 14 may be configured to include either the driver monitor 14A or the biological information sensor 14B.
  • the HUD 51 is a well-known head-up display that displays various information by projecting a virtual image on a part of the windshield in front of the driver's seat. For example, the HUD 51 displays an image indicating the guidance route and an icon image indicating the inter-vehicle distance from the preceding vehicle superimposed on the actual road.
  • a HUD image an image projected on the windshield by the HUD 51 is referred to as a HUD image.
  • the area on the windshield (51A in FIG. 2) on which the HUD image is displayed is formed below the driving field of view to be secured when the driver performs driving, and the driver visually recognizes the front of the vehicle.
  • the HUD image can be visually recognized. As a result, the amount of line-of-sight movement of the driver is reduced, the focus adjustment load can be reduced, and safety can be improved.
  • the meter display 52 is arranged at the upper part of the driver panel side of the instrument panel, and displays various information such as the vehicle speed, the rotational speed of the engine (internal combustion engine), the fuel remaining amount in the fuel tank, and the like.
  • the meter display 52 is capable of full color display, for example, and can be configured using a liquid crystal display, an organic EL display, or the like.
  • the center display 53 is arranged near the center of the instrument panel in the vehicle width direction.
  • the center display 53 is also capable of full color display, and can be configured using a liquid crystal display, an organic EL display, or the like.
  • the electronic rearview mirror 54 is a device that enables the driver to visually recognize the rear by displaying an image taken by the rear camera 12B instead of the conventional rearview mirror.
  • the image processing device (not shown) provided in the electronic room mirror 54 controls the range displayed on the electronic room mirror 54 in the range captured by the rear camera 12B and the display mode of the image by a known method. do it.
  • the electronic side mirror 55 is a device that displays images taken by the left side camera 12C and the right side camera 12D instead of the conventional door mirror or fender mirror. By looking at the driver and the electronic side mirror 55, the range from the left side to the rear left side of the host vehicle and the range from the right side to the rear right side can be indirectly visually recognized.
  • the electronic side mirror 55 includes a left electronic side mirror 55L that displays an image captured by the left side camera 12C and a right electronic side mirror 55R that displays an image captured by the right side camera 12D.
  • the range displayed on the left electronic side mirror 55L and the display mode of the image may be controlled by a known method by an image processing device (not shown) provided in the left electronic side mirror 55L. The same applies to the right electronic side mirror 55R.
  • the decorative lighting 57 is a light source provided around the driver's seat in the passenger compartment, and is realized by, for example, a light emitting diode (LED).
  • the decorative lighting 57 is configured to be able to emit light by switching light of a plurality of colors defined in the notification rule.
  • the side speaker 61 includes a left side speaker 61L and a right side speaker 61R respectively provided at both ends in the vehicle width direction of the instrument panel as shown in FIG.
  • the left side speaker 61L and the right side speaker 61R are both known sound output devices, and output sound according to instructions from various notification devices 20A to 20D and the notification control device 30.
  • the center speaker 62 is an audio output device installed near the center of the instrument panel in the vehicle width direction.
  • the center speaker 62 also outputs sound according to instructions from the various notification devices 20A to 20D and the notification control device 30.
  • the grip portion tactile sensation generating device 71 is a tactile sense generating device provided in the grip portion of the steering wheel.
  • the grip part tactile sensation generating device 71 operates according to instructions from the notification device 20 and the notification control device 30 to stimulate the driver's tactile sense.
  • the arousal state maintaining device 20D gives a stimulus to the driver's hand by vibrating the grip part tactile sensation generating device 71 at a predetermined strength or frequency or generating a reaction force.
  • the seat tactile sensation generating device 72 is, for example, a tactile sensation generating device provided on the seat surface of the driver's seat.
  • the seat tactile sensation generating device 72 also operates according to instructions from the notification device 20 and the notification control device 30 to stimulate the driver's tactile sense.
  • the seat tactile sensation generating device 72 is provided on the entire driver's seat, that is, on a seating portion, a backrest portion, and a headrest portion.
  • the mechanism for stimulating the sense of touch of the driver may be provided only in a part of the seating portion, the backrest portion, and the headrest portion.
  • the steering switch 74 is a mechanical switch provided around the steering wheel. By operating the steering switch 74, for example, the driver can switch the operation states (on / off) of the notification devices 20A to 20D.
  • the steering switch 74 includes an actuator, and can change an operational feeling such as a reaction force applied to a driver operating the steering switch 74.
  • the touch panel 75 with a tactile sensation generation function is a touch panel laminated on the display panel of the center display 53.
  • the driver can operate various devices mounted on the vehicle by touching the touch panel 75 with a tactile sensation generation function.
  • the touch panel 75 with a tactile sensation generating function includes an actuator, and can change a reaction force applied to a driver who performs a touch operation.
  • the remote operation device 76 is an input device (a so-called haptic device) that is arranged on the center console and remotely operates various devices mounted on the vehicle such as a navigation device and an air conditioner.
  • the remote operation device 76 is linked to the center display 53, and the driver operates the remote operation device 76 to move the cursor displayed on the center display 53 or to select an icon pointed to by the cursor. can do.
  • the remote operation device 76 can change the operation load, the displacement amount, the generated force, the click feeling, etc. by controlling the operation of the actuator. For example, when the cursor moves on a selectable icon image, the remote operation device 76 operates a built-in actuator to give a tactile sensation as if the switch was actually touched to the driver's hand. More specifically, the sign of the reaction force applied to the driver's hand is changed from a positive value (that is, a repulsive force) to a negative value (a pulling force), so that the cursor is drawn into the switch. Give the driver a feeling of going. Parameters such as an operation load, a displacement amount, a generated force, and a click feeling are changed based on an instruction from the notification device 20.
  • the narrow-area communication unit 81 is a communication interface for the notification control device 30 to perform wireless communication with the mobile terminal 4 by a known short-range wireless communication technology.
  • the portable terminal 4 is used as a notification interface by various notification devices 20A to 20D in a state where communication connection with the notification control device 30 is established via the narrow area communication unit 81.
  • the notification control device 30 will be described. Then, an example of a structure of the alerting
  • the inter-vehicle distance notification device 20A causes the notification control device 30 to perform notification in a notification mode according to the distance between the vehicle existing in front of the host vehicle (that is, the preceding vehicle) and the host vehicle during the operation of the following traveling function. Request. That is, the inter-vehicle distance notification device 20A is a device that notifies the driver of the inter-vehicle distance between the preceding vehicle and the host vehicle. The inter-vehicle distance is equivalent to the state quantity to be notified to the inter-vehicle distance notification device 20A. The distance between the preceding vehicle and the host vehicle may be specified based on the detection results of the front detection target sensor 13A and the front camera 12A.
  • the follow-up running function is a function for controlling the drive system of the vehicle so that the inter-vehicle distance from the preceding vehicle is maintained at a predetermined distance (target inter-vehicle distance).
  • a known technique may be used for this follow-up running function.
  • the rear vehicle notification device 20B is present in the current traveling lane and other vehicles (hereinafter simply referred to as a rear vehicle) existing behind the host vehicle (including diagonally behind) in the lane adjacent to the traveling lane (referred to as an adjacent lane). It is a device that informs the driver of the distance between vehicles. That is, the rear vehicle notification device 20B is a device that notifies the driver of information about the inter-vehicle distance between the rear vehicle and the host vehicle.
  • the presence / absence of the rear vehicle, the distance from the host vehicle, and the like may be obtained by using the detection result of the rear detection object sensor 13B or the image data taken by the peripheral monitoring camera 12.
  • the lane departure notification device 20C determines whether or not the host vehicle is likely to depart from the lane (traveling lane) in which the host vehicle is currently traveling, and performs notification in a notification mode according to the determination result. This is requested to the notification control device 30. That is, the lane departure notifying device 20C is a device that notifies the driver that the host vehicle is about to depart from the traveling lane.
  • the traveling lane may be specified by detecting a white line from the image of the front camera 12A. Also, whether or not the host vehicle is about to depart from the driving lane is determined by whether or not the host vehicle is approaching the white line, and if it is approaching, the vehicle between the host vehicle and the approaching white line. What is necessary is just to determine based on the distance of the width direction, approach speed, etc.
  • reporting control apparatus 30 is made to alert
  • the state quantity for the lane departure notifying device 20C is a parameter used for calculating the possibility that the own vehicle departs from the lane or the possibility.
  • the state quantity is a distance in the vehicle width direction between the host vehicle and the white line, and an approach speed.
  • the lane departure notifying device 20C operates when traveling at a predetermined speed (for example, 60 km / h) or more. Further, the lane departure notifying device 20C functions when the driver recognizes that the driver intentionally drives the vehicle so that it crosses the white line, such as when operating a blinker or accelerating. The notification request by is canceled.
  • a predetermined speed for example, 60 km / h
  • the lane departure notifying device 20C functions when the driver recognizes that the driver intentionally drives the vehicle so that it crosses the white line, such as when operating a blinker or accelerating. The notification request by is canceled.
  • the arousal state maintaining device 20D estimates the driver's arousal level and requests the notification control device 30 to perform notification in a notification mode according to the estimated awakening level. For example, when the degree of arousal is below a predetermined threshold, notification for awakening the driver is performed. Moreover, the alerting
  • the awakening degree here represents the degree to which the driver's consciousness is clear, and the case where the awakening degree is small means that the driver is in a sleepy state.
  • This arousal level corresponds to a state quantity for the awake state maintaining apparatus 20D.
  • the driver's awakening degree may be estimated based on the driver's face image taken by the driver monitor 14A and the detection result of the biological information sensor 14B.
  • a known technique may be applied to the method for estimating the driver's arousal level.
  • the degree of arousal may be determined from the face image based on the face orientation, the degree of eyelid opening, the pattern of eyelid movement, and the like.
  • the notification control device 30 is configured as a normal computer, and includes a well-known CPU, a non-volatile memory such as a ROM and a flash memory, a volatile memory such as a RAM, an I / O, and a bus line connecting these configurations ( All are not shown).
  • the storage unit 31 included in the notification control device 30 is a storage area realized by a nonvolatile memory such as a flash memory or a ROM.
  • the storage unit 31 stores programs and data for executing various processes, and data indicating notification rules described later (referred to as notification rule data).
  • the CPU realizes various functions by executing the above-described program.
  • the notification control device 30 includes a notification medium management unit F31, a notification device management unit F32, a notification request reception unit F33, and a notification execution unit F34 as functional blocks as shown in FIG.
  • the notification medium management unit F31 recognizes and manages a device that functions as a notification medium. More specifically, the notification medium management unit F31 indicates that the display devices 51 to 56, the decorative lighting 57, the sound output devices 61 to 63, and the tactile sense generation devices 71 to 76 can be used as notification media. Hold as.
  • the portable terminal display 56, the portable terminal speaker 63, and the portable terminal tactile sensation generating device 73 are recognized as being usable as a notification medium is a case where communication connection with the portable terminal 4 is established.
  • the notification medium management unit F31 performs processing for recognizing a device added to the in-vehicle network as a notification medium. Thereby, the various alerting
  • the notification device management unit F32 manages the notification device 20 included in the vehicle notification system 100. That is, the notification device management unit F32 according to the present embodiment has an internal state that the vehicle notification system 100 includes an inter-vehicle distance notification device 20A, a rear vehicle notification device 20B, a lane departure notification device 20C, and a wakefulness maintaining device 20D. Hold as. Each of these notification devices 20A to 20D corresponds to a request source (notification request source) that requests to perform notification using a predetermined notification medium.
  • the notification device management unit F32 provides information on devices that can be used as the notification medium acquired by the notification medium management unit F31 to the notification devices 20A to 20D.
  • the information on the notification medium includes the type of the notification medium, the model number of the device, the application, the installation location, the input / output data correspondence format, and the like.
  • the use of the electronic room mirror 54 is a display of an image taken by the rear camera 12B.
  • the notification medium is a display device, the screen size and the like are also included in the information of the notification medium.
  • Each of the notification devices 20A to 20D can acquire information on the notification medium from the notification device management unit F32, thereby selecting an appropriate notification medium and performing information notification using the notification medium.
  • the notification devices 20A to 20D may directly acquire information on notification media that can be used via the in-vehicle network.
  • the notification device management unit F32 provides the notification rule data stored in the storage unit 31 to each of the notification devices 20A to 20D, and the notification mode requested by each of the notification devices 20A to 20D An instruction is given so that the notification mode conforms to the notification rule.
  • the notification rule is a rule that defines a notification mode at each stage and a pattern for changing the notification mode according to the stage when the notification device 20 changes the notification mode in stages.
  • the notification rule defines the number of notification modes that each notification device 20A to 20D changes stepwise.
  • the degree of strength with which the notification device 20 appeals information to the driver is expressed in four stages (referred to as notification levels). That is, each of the notification devices 20A to 20D notifies the notification mode by changing the notification mode in four stages according to the notification level.
  • the notification level is determined to be higher as the necessity of appealing information targeted for notification to the driver in the notification device 20 is higher. For example, if the notification level corresponds to the risk level, the notification level is set higher as the risk level is higher. More specifically, when the notification level is 1, it is a safe state, when the notification level is 2, a weak attention state, when the notification level is 3, a strong attention state, and when the notification level is 4. Should represent each dangerous state.
  • Each notification device 20 performs notification in a notification mode that attracts the driver's attention by increasing the stimulus given to the sensory organ of the driver as the notification level is higher.
  • the notification level is set to four levels, but the present invention is not limited to this. There may be five stages or three stages.
  • the notification rule includes at least one element (referred to as a visual element) constituting a visual notification aspect, at least one element (referred to as an auditory element) included in an auditory notification aspect, and at least constituting a tactile notification aspect.
  • a value for each notification level of one type of element (referred to as a tactile element) is determined.
  • reporting aspect here refers to the element which changes an alerting
  • determining a value for each notification level of an element means determining a change pattern corresponding to the notification level of the summary element.
  • elements constituting the visual notification mode there are various elements such as display color (in other words, wavelength of light), brightness, presence / absence of blinking, blinking speed, and the like. Further, the size of the icon image displayed on the display device, the content of the display image (such as a symbol), the content of the text, and the like also correspond to visual elements.
  • the icon image here is an image that simply represents information to be notified to the driver, for example.
  • the icon image includes a marker image that points to a detection target to be noticed by the driver.
  • the marker image is an image that highlights the detection target object by surrounding the detection target object to which the driver's attention is directed by a rectangular frame (that is, a marker frame).
  • the notification rule prescribes values for each notification level with respect to the wavelength of light (that is, the color), the display size of the icon image, and the thickness of the marker frame line.
  • the wavelength is set so that the wavelength is shortened to 540, 580, 620, and 660 nm as the notification level increases from 1, 2, 3, and 4 as shown in FIG.
  • the color of the image displayed on the display devices 51 to 56 and the color of the light output from the decorative lighting 57 (collectively, these are used as display colors) have a notification level of 1 to 2, 3, 4 As it goes up, it changes in the order of green, yellow, orange, and red.
  • the visual notification mode is stronger to the driver's vision as the notification level increases by making the wavelength closer to the red wavelength according to the notification level. It becomes a mode to give a stimulus.
  • the visual notification mode is a mode that gives the driver a sense of crisis and seriousness.
  • a mode that gives the driver a sense of crisis or seriousness is also referred to as a sharper notification mode.
  • the proportionality constant of the notification level Lv here is 40 nm as an example.
  • the display color is an element used regardless of the content of the information to be notified when the notification device performs visual notification.
  • the display color is common not only when the display devices 51 to 56 capable of changing a relatively large number of elements are employed as the notification medium, but also when the decorative lighting 57 is employed as the notification medium. Can be changed.
  • the notification rule by specifying a value for each notification level Lv of the display color, at least the notification device 20 that performs visual notification has a common display color according to the notification level Lv. Informs at. Thereby, the change pattern according to the notification level Lv of the visual notification mode by the notification device 20 can be provided with commonality.
  • the display size of the icon image is such that the display magnification Pb of the icon is 1.2, 1.4, 1 as the notification level increases to 2, 3 and 4 with reference to the display size when the notification level Lv is 1. .6. That is, the icon display magnification Pb is increased in conjunction with the notification level Lv.
  • a notification that employs a mode in which an icon image is displayed on a predetermined display device as a visual notification mode The device 20 enlarges and displays the icon image as the notification level increases. That is, the visual notification mode of the notification device 20 adopting a mode in which an icon image is displayed on a predetermined display device as the visual notification mode can be made common.
  • notification devices 20 that perform visual notification adopt a mode in which an icon image is displayed on a predetermined display device as a visual notification mode. It is assumed that the rule for the element is not applied to the notification device 20 that does not employ a mode in which an icon image is displayed on a predetermined display device as a visual notification mode.
  • every visual element is for every alerting
  • the present invention is not limited to this. Since the display area provided in the display device is finite, visual elements such as a change in display size and display frame line thickness may be exceptionally processed so as not to be affected by the notification rule.
  • the notification device 20 adopting a mode for displaying a marker image as a visual notification mode is any notification device, The higher the notification level Lv, the thicker the frame of the marker image is displayed.
  • the rules and specific setting values for changing the display color, the icon display size, and the thickness of the marker frame line according to the notification level Lv are exemplified.
  • the elements to be changed in conjunction with the notification level Lv are not limited to these.
  • the blinking speed of the display image may be linked to the notification level Lv.
  • the notification medium used for notification by the notification device 20 includes a light source, the luminous intensity (or luminance) may be increased according to the notification level Lv.
  • the auditory element There are various auditory elements such as a sound volume such as a warning sound (so-called buzzer) and a voice message, a tone color (that is, a frequency) of the warning sound, a warning sound output duration, and a warning sound output frequency.
  • a sound volume such as a warning sound (so-called buzzer) and a voice message
  • a tone color that is, a frequency
  • the notification rule prescribes a value for each notification level Lv with respect to the frequency of the warning sound and the volume of the sound.
  • the frequency of the warning sound is increased to 500, 1000, 1500, and 2000 Hz as the notification level Lv increases to 1, 2, 3, and 4 as shown in FIG. Thereby, the stimulus given to the driver's hearing becomes sharper according to the notification level Lv.
  • the proportional constant of the notification level Lv here is 500 Hz as an example, but 400 Hz or 600 Hz may be used. Further, it may be expressed by a linear function having an initial value.
  • the volume Qb of the output sound is increased as the notification level Lv is increased.
  • the sound volume Qb is set to 55, 60, 65, and 70 [dB] as the notification level Lv increases to 1, 2, 3, and 4.
  • the volume Qb is an auditory element that is commonly used by any notification device as long as it is the notification device 20 that performs auditory notification. That is, it is an element that utilizes not only the notification device 20 that outputs a warning sound but also the notification device 20 that outputs a voice message. Therefore, in the notification rule, by defining a value for each notification level Lv of the volume, the notification device 20 that performs at least auditory notification is a change in volume that is common to all the notification devices 20 according to the notification level Lv. Announcement is performed with a pattern. Thereby, the change pattern according to the notification level Lv of the auditory notification mode by the notification device 20 can be made common.
  • examples of rules and specific setting values for changing the volume Qb and the frequency Qa of the warning sound according to the notification level Lv are given as auditory elements.
  • the warning sound output duration, output frequency, and the like may be linked to the notification level Lv. For example, the higher the notification level Lv, the longer the output duration of the warning sound, or the higher the notification level Lv, the higher the output frequency of the warning sound.
  • tactile elements There are various tactile elements such as vibration frequency, vibration intensity, vibration duration, and vibration interval.
  • tactile sensation generation function provided in an input device such as the remote operation device 76
  • an operation load, a generated force, a click feeling, a feeling of unevenness, and the like can be set as control parameters.
  • the notification rule prescribes a value for each notification level Lv with respect to the vibration frequency and the strength of vibration.
  • the vibration frequency Ra may be increased to 50, 100, 150, and 200 Hz as the notification level Lv increases to 1, 2, 3, and 4. Thereby, the stimulus given to the tactile sense of the driver becomes sharper according to the notification level Lv.
  • the proportional constant of the notification level Lv is 50 [Hz] as an example, but may be 40 [Hz] or 60 [Hz]. Moreover, you may have an initial value.
  • the notification device 20 By determining the value for each notification level Lv of the vibration frequency Ra in the notification rule, the notification device 20 that performs notification using at least a tactile sensation has a common vibration frequency Ra according to the notification level Lv. Carry out notifications. Thereby, the change pattern according to the notification level Lv of the tactile notification mode by the notification device 20 can be made common.
  • the acceleration Rb corresponding to the strength of vibration may be increased as the notification level Lv increases.
  • the acceleration Rb is set to 20, 40, 60, 80 [m / s ⁇ 2] as the notification level Lv increases to 1, 2, 3, and 4.
  • force (unit: N) instead of acceleration (unit: m / s ⁇ 2) may be adopted as an element corresponding to the strength of vibration.
  • the values for each notification level Lv are determined for the vibration frequency Ra and the acceleration Rb of the vibration element, but the vibration duration time, vibration interval, and the like may be linked to the notification level Lv.
  • the vibration duration time may be increased as the notification level Lv is increased, and the vibration interval may be decreased as the notification level Lv is increased.
  • the values of the various elements exemplified above as visual elements, auditory elements, and tactile elements all increase (or decrease) at a constant rate as the notification level Lv increases. That is, the change pattern according to the notification level Lv of each element is unified. Therefore, a sense of unity can be generated in the degree of increase in the notification level Lv that the driver feels through each sensory organ. Thereby, the driver can feel the change of the notification level Lv and the notification level Lv in any of visual, auditory, and tactile senses.
  • the notification request receiving unit F33 acquires a notification request signal input from the notification device 20, and passes it to the notification execution unit F34.
  • the notification request signal includes data specifying a notification medium used for notification and a notification mode on the notification medium.
  • the notification execution unit F34 performs notification based on the notification request signal acquired by the notification request reception unit F33. That is, the notification medium specified by the notification device 20 is operated in the specified notification mode.
  • Each of the notification devices 20A to 20D includes a state quantity acquisition unit F21, a notification level determination unit F22, a notification medium selection unit F23, and a notification processing unit F24 as functional blocks as shown in FIG.
  • the functional blocks F21 to F24 provided in each notification device 20 differ only in the target state quantity, the notification medium used for notification, and the determination criteria for the notification level Lv. Therefore, for the sake of convenience, each functional block will be described taking the inter-vehicle distance notification device 20A as an example.
  • the code of the state quantity acquisition unit is F21A
  • the code of the notification level determination unit is F22A
  • a notification medium is selected.
  • the code of the part is represented as F23A
  • the code of the notification processing unit is represented as F24A.
  • the state quantity acquisition unit F21A acquires a state quantity that is a target of notification by the inter-vehicle distance notification device 20A. As described above, the inter-vehicle distance notification device 20A performs notification in a manner corresponding to the inter-vehicle distance from the preceding vehicle. That is, the state quantity acquisition unit F21A acquires the inter-vehicle distance from the preceding vehicle.
  • the notification level determination unit F22A determines the notification level Lv based on the state quantity acquired by the state quantity acquisition unit F21A (here, the inter-vehicle distance from the preceding vehicle) and a preset target inter-vehicle distance.
  • the target inter-vehicle distance may be a constant value regardless of the traveling speed, or a different value may be applied depending on the traveling speed.
  • a plurality of patterns for changing the target inter-vehicle distance that changes according to the traveling speed may be prepared.
  • it has a plurality of patterns such as a long-distance pattern that maintains a relatively long inter-vehicle distance, a short-distance pattern that maintains a relatively short inter-vehicle distance, and a middle-distance pattern that corresponds to the middle of the long-distance and short-distance patterns.
  • a long-distance pattern that maintains a relatively long inter-vehicle distance
  • a short-distance pattern that maintains a relatively short inter-vehicle distance
  • a middle-distance pattern that corresponds to the middle of the long-distance and short-distance patterns.
  • the target inter-vehicle distance at a traveling speed of 80 km / h is 50 m.
  • the notification level determination unit F22A determines the notification level Lv to be 1 when the inter-vehicle distance is equal to or greater than a first threshold (for example, 50 m) determined according to the target inter-vehicle distance. Further, when the inter-vehicle distance is smaller than the first threshold and equal to or larger than a second threshold (for example, 45 m) smaller than the first threshold, the notification level Lv is determined to be 2.
  • a first threshold for example, 50 m
  • a second threshold for example, 45 m
  • the notification level Lv is determined to be 3.
  • the notification level Lv is determined to be 4.
  • the notification level determination unit F22A determines that the notification level Lv is higher as the inter-vehicle distance is smaller.
  • the thresholds for determining these notification levels Lv may be designed as appropriate.
  • the notification medium selection unit F ⁇ b> 23 ⁇ / b> A selects a notification medium to be used for notification out of devices that can be used as the notification medium acquired from the notification control device 30.
  • a notification medium used for notification may be fixed or dynamically changed.
  • the HUD 51, the right side speaker 61R, and the grip portion tactile sense generating device 71 are selected.
  • the notification processing unit F24A determines a notification mode for each notification medium selected by the notification medium selection unit F23A according to the notification level Lv determined by the notification level determination unit F22A, and indicates the notification mode in the notification medium. Data (output data) is generated. Then, a notification request signal including output data is output to the notification control device 30.
  • the notification processing unit F24 generates, as output data, data for displaying the icon image Icn shown in FIG. 6 on the HUD 51 (referred to as HUD data) and outputs the data to the notification control device 30.
  • the HUD data includes data designating the display color and size of the icon image Icn and the display position in the HUD image.
  • FIG. 6 shows an example of a display mode of the icon image Icn when the notification level Lv is 1. Further, it is assumed that the icon image Icn is displayed on the HUD 51 while the inter-vehicle distance notification device 20A is operating.
  • the notification processing unit F24 outputs data (sound output data) indicating the frequency and volume of the warning sound output from the right side speaker 61R to the notification control device 30 as output data.
  • the audio output data may be audio data that is output from the right side speaker 61R as it is, or data that specifies the volume and frequency.
  • the notification processing unit F24 outputs data indicating a mode of vibrating the grip unit tactile sensation generating device 71 to the notification control device 30.
  • the notification mode for each notification medium is determined based on the notification level Lv determined by the notification level determination unit F22A and the notification rule indicated in the notification rule data. That is, the notification mode determined by the notification processing unit F24A for each notification medium is a mode according to the notification rules.
  • the notification processing unit F24A changes the display color of the icon image Icn to green, yellow, orange, and red according to the notification level Lv, and displays the display size based on the notification level Lv. It is displayed in a size that is 1 time, 1.2 times, 1.4 times, and 1.6 times the size.
  • the display size (see FIG. 6) based on the icon image Icn is displayed in green.
  • the notification level Lv is 4, as shown in FIG. 7, it is displayed in 1.6 times the display size shown in FIG. 6 and in red.
  • the icon image Icn is configured to include three block figures arranged in the vehicle traveling direction regardless of whether the notification level Lv is 1 or 4. That is, the notification processing unit F24A displays the icon image Icn including a certain number (three in this case) of block graphics regardless of the notification level Lv, but is not limited thereto. The number of block graphics included in the icon image Icn may be changed according to the notification level Lv.
  • the number of block graphics included in the icon image Icn may be reduced. Since the inter-vehicle distance notification device 20A determines that the notification level Lv is higher as the inter-vehicle distance is shorter, the number of block figures plays a role of expressing the inter-vehicle distance from the preceding vehicle.
  • a warning sound having a frequency of a warning sound output from the right side speaker 61R of 500, 1000, 1500, 2000 [Hz] according to the notification level Lv is output, and the volume is also 55, 60, 65, It is increased according to 70 [dB] and the notification level Lv.
  • the vibration frequency when vibrating the grip part tactile sensation generating device 71 is increased in the order of 50, 100, 150, 200 [Hz] according to the notification level Lv, and the acceleration is increased to 20, 40, Increase in the order of 60, 80 [m / s ⁇ 2].
  • FIG. 8 shows an example in which visual notification is performed at any notification level, while auditory notification and tactile notification are employed when the notification level is 2 or higher.
  • the auditory notification is performed from the state where the notification level Lv is 2, the setting value of the auditory parameter defined when the notification level Lv of the notification rule is 2 is applied.
  • the state quantity acquisition unit F21A, the notification level determination unit F22A, the notification medium selection unit F23A, and the notification processing unit F24A included in the inter-vehicle distance notification device 20A have been described above, but the same applies to the other notification devices 20.
  • the state quantity acquisition unit F21 provided in the rear vehicle notification device 20B may acquire the inter-vehicle distance between the host vehicle and the rear vehicle.
  • the vehicle to be notified may be a vehicle behind the own vehicle lane (that is, a succeeding vehicle).
  • the vehicle behind the adjacent lane corresponding to the change destination may be included in the notification target.
  • Whether or not the host vehicle is about to change the lane may be determined based on the position information of the direction indicating lever input from the in-vehicle sensor group 11 and the steering operation by the driver.
  • the rear vehicle traveling in the adjacent lane is about to change the lane to the traveling lane of the own vehicle
  • the rear vehicle may be included in the notification target.
  • the case where it is determined that the vehicle behind the adjacent lane is about to change lanes may be a case where blinking of the direction indicator lamp of the vehicle behind is detected from the image taken by the periphery monitoring camera 12.
  • the vehicle-to-vehicle communication is available and the information transmitted by the vehicle-to-vehicle communication includes the position information of the direction indicator lever of the transmitting vehicle
  • the direction indication included in the vehicle information transmitted from the rear vehicle The determination may be based on lever position information.
  • the notification level determination unit F22 may determine the notification level Lv based on the inter-vehicle distance between the host vehicle and the rear vehicle.
  • the notification medium employed by the lane departure notification device 20C may be, for example, the electronic room mirror 54, the electronic side mirror 55, the side speaker 61, and the grip portion tactile sense generating device 71.
  • the electronic side mirror 55 and the side speaker 61 may designate and use a device on the side (right side or left side) on which the host vehicle is changing lanes.
  • the rear vehicle notification device 20B employs the right electronic side mirror 55R as the visual notification medium, and as a visual notification mode, highlights the other vehicle approaching from the rear right side of the host vehicle with the marker image Mrk. Is adopted.
  • FIG. 9 shows a visual notification mode when the notification level determination unit F22 of the rear vehicle notification device 20B determines that the notification level Lv is 1. That is, in FIG. 9, the frame line of the marker image Mrk is displayed in green, and the frame line is displayed with a reference thickness. The area surrounded by the frame line of the marker image Mrk is adjusted according to the display size of the target vehicle on the display screen of the right electronic side mirror 55R.
  • FIG. 10 shows a visual notification mode when the notification level determination unit F22 of the rear vehicle notification device 20B determines that the notification level is 4. That is, in FIG. 10, the frame line of the marker image Mrk is displayed in red, and the thickness of the frame line Pc is 1.6 times the thickness of the frame line shown in FIG.
  • the visual notification mode (see FIGS. 6 and 7) by the inter-vehicle distance notification device 20A and the visual notification mode (see FIGS. 9 and 10) by the rear vehicle notification device 20B are compared.
  • the inter-vehicle distance notification device 20A displays the icon image Icn on the HUD 51 and changes the display mode (color and display size) according to the notification level Lv.
  • the rear vehicle notification device 20B displays the marker image Mrk on the right electronic side mirror 55R, and changes the display mode (color and thickness of the frame line) according to the notification level Lv.
  • each notification device displays the display color of the icon image Icn and the marker image Mrk in a color according to the notification rule according to the notification level Lv.
  • each notification device 20A, 20B performs notification in a visual notification mode according to a notification rule, so that the change pattern of the visual notification mode according to the notification level Lv has commonality (display color here). be able to. Then, the driver can recognize the notification level Lv in each notification device 20 from the display color.
  • the visual notification mode of the inter-vehicle distance notification device 20A and the rear vehicle notification device 20B has been described and the effects of the present embodiment have been described. However, the same effects can be achieved with the auditory notification mode and the tactile notification mode.
  • inter-vehicle distance notification device 20A and the rear vehicle notification device 20B have been described in detail.
  • the other notification devices 20C and D may be similarly designed.
  • the notification level determination unit F22 included in the lane departure notification device 20C is based on the distance in the vehicle width direction between the host vehicle and the white line and the moving speed of the host vehicle in the vehicle width direction (that is, the approach speed to the white line).
  • the notification level Lv may be determined.
  • the notification medium employed by the lane departure notification device 20C may be, for example, the meter display 52, the electronic side mirror 55, the side speaker 61, and the grip portion touch sense generation device 71.
  • the electronic side mirror 55 and the side speaker 61 may be used by specifying a device on the side (right side or left side) where a white line on which the host vehicle is likely to deviate exists.
  • the notification level determination unit F22 provided in the wakefulness maintaining device 20D may determine the notification level Lv according to the degree of wakefulness.
  • the notification medium selected by the notification medium selection unit F23 of the wakefulness maintaining device 20D is, for example, the meter display 52, the center display 53, the side speaker 61, the center speaker 62, the seat tactile generation device 72, the decorative lighting 57, or the like. That's fine.
  • the notification medium selected by the notification medium selection unit F23 may be increased according to the notification level Lv. Moreover, you may utilize the portable terminal display 56, the portable terminal speaker 63, and the portable terminal tactile sense production
  • each notification device 20 performs notification in the notification mode according to the notification rule, so that the change pattern according to the notification level Lv of the notification mode adopted by each notification device 20 Commonality can be provided. As a result, it is possible to reduce a sense of incongruity felt by the driver due to a difference in the change pattern of the notification mode for each notification device 20, and further, the notification mode currently being performed and the urgency and seriousness of the information being reported Can be recognized in association with each other.
  • the visual element, the auditory element, and the tactile element defined in the notification rule are uniquely determined according to the notification level, so that the driver can recognize the notification level Lv.
  • the frequency components are increased at a constant rate as the notification level Lv increases in any of the visual notification mode, the auditory notification mode, and the tactile notification mode.
  • the higher the frequency component the sharper the notification mode becomes, and the driver can easily detect that the notification is being performed.
  • the frequency component according to the notification level it is possible for the driver to easily detect that the information is being notified, and the urgency and seriousness of the information being notified is determined by the driver. Can be easily recognized.
  • the notification rule stipulates that the change pattern of the notification mode of the notification device 20 that performs notification using the elements specified in the notification rule is not different. That is, by introducing a notification rule, it is possible to suppress the diversity of notification modes implemented by the driver. By suppressing the diversity of notification modes implemented by the driver, it is possible to reduce the load required for the driver to recognize the information notified by the notification mode.
  • the vehicle notification system the notification control device, and the notification device are not limited to the above-described embodiment, and the following embodiment is also included in the technical scope of the present disclosure.
  • the following embodiment is also included in the technical scope of the present disclosure.
  • various modifications can be made without departing from the scope of the invention.
  • the notification device 20 requests the notification control device 30 to execute notification, and the notification control device 30 performs notification based on the request.
  • the configuration is not limited thereto.
  • the notification device 20 may directly output the data for output to the notification medium to perform notification.
  • the notification control device 30 and the various notification devices 20 are represented by separate blocks, but these may be realized by a single device.
  • the notification control device 30 may have a function corresponding to each of the various notification devices 20 as shown in FIG. 11 (this is a modified example). That is, the inter-vehicle distance notification unit F20A is the inter-vehicle distance notification device 20A, the rear vehicle notification unit F20B is the rear vehicle notification device 20B, the lane departure notification unit F20C is the lane departure notification device 20C, and the awake state maintaining unit F20D is the awake state. Each corresponds to the maintenance device 20D.
  • an indicator for example, a warning light
  • the lighting color of the indicator may be emitted in a color according to the notification rule. Good.
  • the interface for notifying the driver of information through the sense of touch may be installed on the accelerator pedal, the brake pedal, or the clutch pedal, or may be realized by combining them.
  • the detection target sensor 13 detects the vehicle
  • the detection target may be a guardrail, a pedestrian, a bicycle, or the like.
  • the driver is notified of the inter-vehicle distance from the preceding vehicle and the rear vehicle, the behavior of the host vehicle with respect to the traveling lane, and the driver's awakening state, but the present invention is not limited thereto.
  • the vehicle notification system 100 is based on information outside the host vehicle (traveling environment, etc.), information inside the host vehicle acquired by the in-vehicle sensor group 11, driver information acquired by the driver monitor system 14, and the like. This corresponds to a notification device 20 that performs notification.
  • the information outside the host vehicle includes a distance from an object around the host vehicle, a relative speed, the presence / absence of a signal, a lighting color, a road sign, a degree of congestion, a road surface condition, and the like.
  • state quantities using information outside and inside the own vehicle include the degree of danger of steering operation with respect to the road surface condition (magnitude of frictional force), the degree of excess of the own vehicle running speed with respect to the statutory speed, and fuel consumption and so on.
  • the driver information corresponds to the line-of-sight direction, continuous operation time, continuous travel distance, and the like.
  • the state quantity determined based on the information of the driver in addition to the above-mentioned degree of arousal, the degree of fatigue, the possibility of driving aside, etc. are assumed.
  • the vehicle notification system notifies the driver of information on the predetermined state quantity via at least one of the driver's visual sense, auditory sense, and tactile sense.
  • a plurality of notification devices are provided, and each of the plurality of notification devices determines a notification level representing the strength of appealing information to the driver from a state quantity targeted by the notification device, and according to the determined notification level Notification is performed by changing the notification mode stepwise.
  • the notification mode at each notification level is determined based on a predetermined notification rule that defines a notification mode for each notification level.
  • the notification rule includes at least one type of visual element among visual elements that are elements that change the number of notification level steps adopted by each notification device and a notification mode appealing to the driver's vision (hereinafter, visual notification mode).
  • auditory notification mode a value for each notification level of at least one type of auditory element among the auditory elements that are elements that change the mode of notification appealing to the driver's hearing
  • a tactile notification mode A value for each notification level of at least one type of tactile element of tactile elements that are elements for changing a notification mode
  • Each notification device included in the vehicle notification system performs notification in a notification mode according to a common notification rule.
  • This notification rule defines values for each notification level of visual elements, auditory elements, and tactile elements. Of the various elements that change the notification mode, the set value of the element defined by the notification rule is uniquely determined according to the notification level.
  • the respective visual notifications are the same aspect (ie, the same color).
  • the element is changed in the same pattern in accordance with the notification rule in each notification device.
  • the vehicle notification system commonality can be provided in the pattern of change according to the notification level of the notification mode of each notification device.
  • the visual element mode defined by the notification rule is uniquely determined according to the notification level even if the notification device is different, the driver can recognize the notification level from the visual element mode.
  • the notification rule is set so that the strength (for example, color, size, brightness, etc.) that the visual element appeals to the driver's sensory organ (here, vision) increases as the notification level increases. Therefore, the recognizability of the notification level by the driver can be improved.
  • the set value for each notification level of the visual element, the auditory element, and the tactile element is set such that the higher the notification level is, the stronger the element appeals to the driver's sensory organ. That is, the notification level represents the strength of appealing the information to be notified to the driver.
  • the high notification level corresponds to the high degree of urgency and risk
  • the fact that the driver can easily recognize the notification level means that the urgency and risk level of the information being notified is high. It means that the driver can easily recognize it.
  • a vehicle notification system in a vehicle notification system having a plurality of notification devices that notify information about different objects in stages, the urgency and seriousness that notification by a certain notification device is trying to convey to the driver Can be easily recognized.
  • the notification control device is a device that requests to notify information about a predetermined state quantity, and appeals to the driver information to be notified based on the state quantity.
  • a notification medium for determining a notification level representing strength and requesting notification in a notification mode corresponding to the notification level, and a notification medium for notifying the driver of information information is provided to the driver through the visual sense of the driver.
  • Visual notification medium used to notify the driver auditory notification medium used to notify the driver of information via the driver's hearing, and tactile sense used to notify the driver of information via the driver's sense of touch
  • a notification control device that is used in a vehicle notification system that includes at least one notification medium and that controls operations of the notification medium and the notification device.
  • a notification request receiving unit that receives a request from the notification device, a notification execution unit that realizes notification of the mode requested by the notification device by operating the notification medium based on the request received by the notification request reception unit; And a notification device management unit that instructs the notification mode requested by the notification device to be a notification mode according to a notification rule that defines a notification mode for each notification level, and the notification rule is a notification level adopted by the notification device.
  • the number of stages, the value for each notification level of at least one visual element among the visual elements that are elements for changing the notification mode using the visual notification medium, and the notification mode using the auditory notification medium are changed.
  • a value for each notification level of one kind of tactile element is determined, and each of the visual element, the auditory element, and the tactile element appeals to the driver's sensory organ as the notification level increases.
  • the strength is set so as to increase.
  • the notification device includes a visual notification medium used for notifying the driver of information via a driver's vision as a notification medium for notifying the driver of information, An auditory notification medium used for notifying the driver of information via hearing, a tactile notification medium used for notifying the driver of information via the driver's tactile sense, and controlling the operation of the notification medium.
  • a notification device that is used in a vehicle notification system including a notification control device that notifies information in a predetermined mode, and that informs the notification control device of information about a predetermined state quantity to a driver, the notification device A notification level determination unit that determines a notification level, which is a degree of strength that appeals to the driver for information to be notified, based on the state quantity; A notification medium selection unit that selects a notification medium to be used for notification of information of the body, a predetermined notification rule that determines a notification mode for each notification level using the notification medium selected by the notification medium selection unit, and a notification level A notification processing unit that requests the notification control device to perform notification in a notification mode determined based on the notification level determined by the determination unit, and the notification rule is a notification level of the notification level adopted by the notification device.
  • the number of stages, the value for each notification level of at least one visual element among the visual elements that are elements that change the notification mode using the visual notification medium, and the element that changes the notification mode using the auditory notification medium At least one tactile element among tactile elements that are elements that change the value of the notification level of at least one of the auditory elements and the notification mode using the tactile notification medium.
  • the visual element, the auditory element, and the tactile element all have a strength to appeal to the driver's sensory organs as the notification level increases. It is characterized by being set to.
  • the display devices 51 to 56 are examples of a notification medium and a visual notification medium.
  • the decorative lighting 57 is an example of a notification medium or a visual notification medium.
  • the audio output devices 61 to 63 are examples of notification media and auditory notification media.
  • the tactile sensation generating devices 71 to 76 are examples of a notification medium and a tactile notification medium.
  • embodiments, configuration, and aspect of the vehicle notification system, the notification control device, and the notification device have been described above, but the embodiment, configuration, and aspect related to the vehicle notification system, the notification control device, and the notification device have been described above. It is not limited to each embodiment, each structure, and each aspect.
  • embodiments, configurations, and aspects related to a vehicle notification system, a notification control device, and a notification device are also obtained for embodiments, configurations, and aspects obtained by appropriately combining technical units disclosed in different embodiments, configurations, and aspects. Included within the scope of embodiments.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Mechanical Engineering (AREA)
  • Traffic Control Systems (AREA)

Abstract

La présente invention concerne un système de notification destiné à un véhicule équipé de multiples dispositifs de notification (20A, 20B, 20C, 20D) permettant de signaler à un conducteur des informations concernant une grandeur d'état prédéterminée par l'intermédiaire d'au moins l'un des sens visuel, auditif et tactile du conducteur Chacun de la pluralité de dispositifs de notification exécute une notification lorsqu'il a déterminé un niveau de notification qui indique l'intensité déclenchant la fourniture d'une invite destinée à informer le conducteur. Des modes de notification sont déterminés sur la base de règles de notification prédéterminées qui définissent un mode de notification pour chaque niveau de notification. Les règles de notification définissent le nombre de niveaux de notification, la valeur d'au moins un type de composante visuelle pour chaque niveau de notification, la valeur d'au moins un type de composante auditive pour chaque niveau de notification, et la valeur d'au moins un type de composante tactile pour chaque niveau de notification. La composante visuelle, la composante auditive et la composante tactile sont réglées de manière à ce que l'intensité déclenchant la fourniture d'une invite pour ces composantes aux organes sensoriels du conducteur augmente.
PCT/JP2015/003123 2014-07-24 2015-06-23 Système de notification pour véhicule, dispositif de commande de notification, et dispositif de notification WO2016013153A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2014-151056 2014-07-24
JP2014151056A JP2016024778A (ja) 2014-07-24 2014-07-24 車両用報知システム、報知制御装置、及び報知装置

Publications (1)

Publication Number Publication Date
WO2016013153A1 true WO2016013153A1 (fr) 2016-01-28

Family

ID=55162702

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2015/003123 WO2016013153A1 (fr) 2014-07-24 2015-06-23 Système de notification pour véhicule, dispositif de commande de notification, et dispositif de notification

Country Status (2)

Country Link
JP (1) JP2016024778A (fr)
WO (1) WO2016013153A1 (fr)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017187759A1 (fr) * 2016-04-27 2017-11-02 株式会社デンソー Système d'assistance, terminal portatif, et dispositif embarqué
JP2017200812A (ja) * 2016-04-27 2017-11-09 株式会社デンソー 支援システム、携帯端末、及び車載装置
JP2019106109A (ja) * 2017-12-14 2019-06-27 クラリオン株式会社 運転支援装置、及び運転支援方法
CN110015247A (zh) * 2017-12-28 2019-07-16 丰田自动车株式会社 显示控制装置和显示控制方法
CN113173137A (zh) * 2020-01-24 2021-07-27 丰田自动车株式会社 车辆报知装置
WO2022131367A1 (fr) * 2020-12-18 2022-06-23 株式会社村上開明堂 Système de surveillance de l'intérieur d'un habitacle de véhicule
US11565713B2 (en) * 2017-06-02 2023-01-31 Honda Motor Co., Ltd. Vehicle control system, vehicle control method, and vehicle control program

Families Citing this family (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2017161423A (ja) * 2016-03-10 2017-09-14 株式会社デンソー 車載用情報提示装置、情報提示方法
JP2017215962A (ja) * 2016-05-31 2017-12-07 株式会社Ｓｏｋｅｎ 運転支援装置、運転支援方法
WO2017208694A1 (fr) * 2016-06-02 2017-12-07 株式会社デンソー Appareil d'assistance à la conduite
JP6489447B2 (ja) * 2016-11-04 2019-03-27 マツダ株式会社 車両の制御装置
JP6489446B2 (ja) * 2016-11-04 2019-03-27 マツダ株式会社 車両の制御装置
JP2018156462A (ja) 2017-03-17 2018-10-04 東芝メモリ株式会社 移動体及びそれを含む運転支援システム
JP2018156539A (ja) * 2017-03-21 2018-10-04 三菱自動車工業株式会社 警告装置
JP2019073078A (ja) * 2017-10-12 2019-05-16 矢崎総業株式会社 自動運転時情報伝達方法および車載情報提示装置
EP3474253B1 (fr) * 2017-10-20 2024-04-10 Honda Research Institute Europe GmbH Communication guidée par le regard pour une aide à la mobilité
JP7158839B2 (ja) * 2017-10-24 2022-10-24 フォルシアクラリオン・エレクトロニクス株式会社 運転支援装置、及び運転支援方法
JP2019192090A (ja) * 2018-04-27 2019-10-31 トヨタ自動車株式会社 支援システム
JP6853807B2 (ja) * 2018-10-18 2021-03-31 株式会社東海理化電機製作所 覚醒維持装置、制御装置、およびプログラム
WO2020110781A1 (fr) * 2018-11-30 2020-06-04 パナソニックＩｐマネジメント株式会社 Dispositif de commande d'état, système de commande d'état et procédé de commande d'état
DE112019007095T5 (de) 2019-03-28 2022-01-05 Honda Motor Co., Ltd. Sattelaufsitzfahrzeug
KR102291720B1 (ko) * 2019-11-13 2021-08-19 충남대학교산학협력단 주행보조장치
JP2022095228A (ja) * 2020-12-16 2022-06-28 パナソニックＩｐマネジメント株式会社 表示制御装置、表示制御システム及び表示制御方法
EP4197838A1 (fr) * 2021-12-20 2023-06-21 Toyota Jidosha Kabushiki Kaisha Procédé et système d'assistance à un conducteur d'un véhicule routier

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004094367A (ja) * 2002-08-29 2004-03-25 Toyota Motor Corp 車両用安全装置
US20040145494A1 (en) * 2003-01-08 2004-07-29 Scholz John Arthur Microwave vehicle-to-vehicle warning system
JP2005056372A (ja) * 2003-03-26 2005-03-03 Fujitsu Ten Ltd 車両制御装置、車両制御方法および車両制御プログラム
JP2010198100A (ja) * 2009-02-23 2010-09-09 Honda Motor Co Ltd 車両用の他者接近認知支援装置
JP2011169739A (ja) * 2010-02-18 2011-09-01 Nec Corp ナビゲーション装置及びナビゲーション方法

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004094367A (ja) * 2002-08-29 2004-03-25 Toyota Motor Corp 車両用安全装置
US20040145494A1 (en) * 2003-01-08 2004-07-29 Scholz John Arthur Microwave vehicle-to-vehicle warning system
JP2005056372A (ja) * 2003-03-26 2005-03-03 Fujitsu Ten Ltd 車両制御装置、車両制御方法および車両制御プログラム
JP2010198100A (ja) * 2009-02-23 2010-09-09 Honda Motor Co Ltd 車両用の他者接近認知支援装置
JP2011169739A (ja) * 2010-02-18 2011-09-01 Nec Corp ナビゲーション装置及びナビゲーション方法

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017187759A1 (fr) * 2016-04-27 2017-11-02 株式会社デンソー Système d'assistance, terminal portatif, et dispositif embarqué
JP2017200812A (ja) * 2016-04-27 2017-11-09 株式会社デンソー 支援システム、携帯端末、及び車載装置
US11565713B2 (en) * 2017-06-02 2023-01-31 Honda Motor Co., Ltd. Vehicle control system, vehicle control method, and vehicle control program
JP2019106109A (ja) * 2017-12-14 2019-06-27 クラリオン株式会社 運転支援装置、及び運転支援方法
JP7042604B2 (ja) 2017-12-14 2022-03-28 フォルシアクラリオン・エレクトロニクス株式会社 運転支援装置、及び運転支援方法
CN110015247A (zh) * 2017-12-28 2019-07-16 丰田自动车株式会社 显示控制装置和显示控制方法
CN113173137A (zh) * 2020-01-24 2021-07-27 丰田自动车株式会社 车辆报知装置
CN113173137B (zh) * 2020-01-24 2022-11-18 丰田自动车株式会社 车辆报知装置
WO2022131367A1 (fr) * 2020-12-18 2022-06-23 株式会社村上開明堂 Système de surveillance de l'intérieur d'un habitacle de véhicule

Also Published As

Publication number Publication date
JP2016024778A (ja) 2016-02-08

Similar Documents

Publication Publication Date Title
WO2016013153A1 (fr) Système de notification pour véhicule, dispositif de commande de notification, et dispositif de notification
JP6319349B2 (ja) 情報提示装置
JP6342856B2 (ja) 車両制御装置
US11062598B2 (en) Method, mobile user device, and computer program for producing visual information for at least one occupant of a vehicle
KR20190001145A (ko) 차량용 인터페이스 시스템
JP6172106B2 (ja) 車両用情報提示装置
US9994235B2 (en) Human-machine interface device and method for sensory augmentation in a vehicle environment
CN109835257B (zh) 显示装置及具有该显示装置的车辆
JP6848927B2 (ja) 自動運転車両の情報提供装置
JP2007196854A (ja) 運転支援装置および運転支援方法
JP2018049601A (ja) 運転席と少なくとも一つの乗員席とを備える車両、及び、交代運転者及び又は少なくとも一人の同乗者に現在経験されている運転状況についての情報を提供する方法
JP6471575B2 (ja) 車両用表示制御装置及び車両用表示ユニット
WO2016157892A1 (fr) Appareil de présentation d'informations
JP2019081450A (ja) 表示装置、表示制御方法、及びプログラム
JP2021174436A (ja) 制御装置
JP2018120352A (ja) 依存度推定装置
JP2024067296A (ja) 注意喚起システム及び注意喚起方法
JP2017039461A (ja) 車両用表示装置とその制御方法
WO2016157891A1 (fr) Appareil de présentation d'informations
JP7372381B2 (ja) 交通安全支援システム
JP7372382B2 (ja) 交通安全支援システム
JP7422177B2 (ja) 交通安全支援システム
JP7469358B2 (ja) 交通安全支援システム
JP7351114B2 (ja) ヘッドアップディスプレイ装置
JP2023151648A (ja) 交通安全支援システム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15825287

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15825287

Country of ref document: EP

Kind code of ref document: A1