WO2007055099A1

WO2007055099A1 - Driver’s mental state information providing system

Info

Publication number: WO2007055099A1
Application number: PCT/JP2006/321290
Authority: WO
Inventors: Masatoshi Yanagidaira; Mitsuo Yasushi
Original assignee: Pioneer Corporation
Priority date: 2005-11-09
Filing date: 2006-10-25
Publication date: 2007-05-18

Abstract

At least one of the following is executed or stopped: a first support for selecting a predetermined first music composition (awaking music composition) from a plurality of music compositions and acoustically outputting it, a second support for displaying on a road map at least one parking-enabled place in the vicinity of the current vehicle position, a third support for adjusting the sound volume of the acoustic output to a predetermined volume, and a fourth support for selecting a predetermined second music composition (relaxing music composition) from a plurality of music compositions and acoustically outputting it.

Description

Specification

Driver mental state information provision system

Technical field

The present invention relates to a driver mental state information providing system that provides various types of information according to the mental state of a driver while driving a vehicle.

Background art

[0002] Japanese Patent Application Laid-Open No. 2004-24704 detects a driver's mental state such as drowsiness and fatigue, and compares the numerical value of the mental state with a predetermined threshold value to determine the driver's state. A system for providing information on a driver's mental state is disclosed in which it is determined whether or not the mental state has deteriorated so as to be an obstacle to safe driving.

[0003] In such a driver mental state information providing system, when it is determined that the driver's mental state has deteriorated as described above while displaying an image showing the transition of the driver's mental state on the display as needed. Raise an alarm.

[0004] However, there was a case where the driver's mental state could not be restored to a normal state even by an alarm, and the accident prevention effect was not obtained sufficiently.

Disclosure of the invention

[0005] One object of the present invention is to provide a driver mental state information providing system having a high accident prevention effect.

[0006] The driver mental state information providing system according to the first aspect of the present invention is a driver mental state information providing system that provides information corresponding to the mental state of the driver of the vehicle, and indicates the current position of the vehicle. Navigation device that includes a display that displays a map image with a mark added on the road map, and a recording medium that records audio signals corresponding to a plurality of music pieces. An audio device for outputting; a mental state detecting means for detecting the mental state of the driver; and selecting and reading and reproducing the first first musical piece of the plurality of musical pieces according to the mental state. First support for controlling the audio device, the navigation system for displaying at least one parking spot located in the vicinity of the current position on the road map. Equipment A second support for controlling the audio device, a third support for controlling the audio device for adjusting the volume at the time of the sound output to a predetermined volume, and selecting and reading the second music from the plurality of music. Control means for executing or stopping at least one of the fourth supports for controlling the audio device to be reproduced.

[0007] In the driver mental state information providing system of the present invention, according to the mental state of the driver, the first support for selecting and outputting the first musical piece from a plurality of musical pieces, and the current position of the vehicle 2nd support to display at least one parking spot located near the road map on the road map, 3rd support to adjust the volume during sound output to a predetermined volume, and select the second song from multiple songs Then, execute or stop at least one of the 4th assistance that outputs sound. According to the powerful configuration, it is possible to provide optimum support for recovering the driver's mental state from the drowsiness state to the normal state, or from the tension state to the normal state. In other words, when sleepiness is mild, the first music is output as sound to assist in preventing the progress of sleepiness. If the drowsiness is severe, the support for rest is repeated by displaying and guiding nearby parking spots. The driver should concentrate on driving with moderate tension. If tension occurs frequently due to long-time driving, the accumulation will cause mental fatigue. Therefore, in order to reduce the fatigue that has been accumulated due to tension, the second song is output as sound. In this way, compared to a system that only informs the driver that the patient has become sleepy by switching the support method according to the changing state of the mental state, or performing or removing another support repeatedly. Accident prevention effect can be enhanced.

Brief Description of Drawings

[0008] FIG. 1 shows a configuration of a driver mental state information providing system according to an embodiment of the present invention.

[FIG. 2] FIG. 2 is a flowchart of optimization support control executed by the control unit shown in FIG.

[FIG. 3] FIG. 3 shows a state transition detection subroutine for a normal state force.

[FIG. 4] FIG. 4 shows a state transition detection subroutine for a normal state force.

FIG. 5 shows a display example of the first support execution selection image.

[Figure 6] Figure 6 shows an example of a road map that includes parking spots displayed during the second support. Show.

[FIG. 7] FIG. 7 shows a state transition detection subroutine for a tension state force.

FIG. 8 shows a display example of a fourth support execution selection image.

[FIG. 9] FIG. 9 shows a state transition detection subroutine for sleepiness.

[FIG. 10] FIG. 10 shows an example of an image representing the transition of sleepiness depth and the transition of tension depth, respectively.

[FIG. 11] FIG. 11 is a diagram showing transition states of mental states.

BEST MODE FOR CARRYING OUT THE INVENTION

In FIG. 1, a sensor 10 indicates an electrical signal corresponding to a potential difference between two predetermined points on the skin surface of the driver of the vehicle, or skin vibration generated on the driver's skin surface, or blood flow volume of the subject. An electrical signal corresponding to the pulse is supplied to BPF (Band Pass Filter) 11. The sensor 10 is provided, for example, at a portion of the gripping portion of the steering wheel of the vehicle that comes into contact with the driver's hand or a portion that contacts the driver's body that is covered in the driver's side seat belt. The BPF 11 extracts only the signal component corresponding to the movement of the driver's myocardium from the powerful electric signal and supplies it to the AZD conversion unit 12. The AZD conversion unit 12 converts the signal supplied from the BPF 11 into a digital signal, and supplies this to the heart rate measurement unit 13 and the heart rate fluctuation measurement unit 14 as a myocardial pulse signal CS (electrocardiogram signal). The heart rate measurement unit 13 measures the heart rate based on the myocardial pulse signal CS, and supplies heart rate data CN indicating the heart rate to the control unit 15 sequentially at predetermined intervals. The heart rate fluctuation measurement unit 14 measures the 0.15-0.4 [Hz] component in the time fluctuation component of the beat interval by the myocardial pulse signal CS as a heart rate HF (high frequency) value, and represents this heart rate HF value. Heart rate fluctuation data RSA is sequentially supplied to the control unit 15 at predetermined intervals.

[0010] The control unit 15 applies a predetermined mental state determination process (described later) to the heart rate data CN and the heart rate fluctuation data RSA, so that the driver is drowsy or nervous, Alternatively, it is determined which mental state is normal. The control unit 15 supplies a mental state signal MOD representing the determined mental state to the mental state memory 16. For example, when the controller 15 determines that the driver is in a normal state, the control unit 15 is “0”. When the driver 15 determines that the driver is in a tension state, the control unit 15 determines that the driver is in a sleepy state. 2 '' becomes A mental state signal MOD having a value is supplied to the mental state memory 16. When the driver is in a tension state, the control unit 15 obtains the tension depth, generates tension depth data DK representing the tension depth, and supplies it to the mental state memory 16. On the other hand, when the driver is in a sleepy state, the control unit 15 obtains the depth of sleepiness, generates sleepiness depth data DN representing the depth of sleepiness, and supplies it to the mental state memory 16.

[0011] The control unit 15 provides the following support for restoring the driver's mental state to the normal state in accordance with the driver's mental state (normal state, drowsiness state, tension state) as described above. Commands for prompting execution or stop of the first to fourth support are supplied to the navigation device 19 and the audio system 21 described later.

[0012] First Assistance: Playing sleepiness songs

Second support: Display of parking points

Third support: Volume down

Fourth Support: Playing relaxing songs

The controller 15 overwrites and stores the first support execution flag SF1 having the logic level “1” during execution of the first support and the logic level “0” during non-execution in the internal register. The controller 15 overwrites and stores the second support execution flag SF2 of the logic level “1” during execution of the second support and the logic level “0” during non-execution in the internal register. The control unit 15 overwrites and memorizes the third support execution flag SF3 of the logical level “1” during execution of the third support and the logical level “0” during non-execution in the internal register. The controller 15 overwrites and stores the fourth support execution flag SF4 of the logical level “1” during execution of the fourth support and the logical level “0” during non-execution in the internal register. Note that the initial value of each of the first support execution flag SF1 to the fourth support execution flag SF4 is a logical level “0” indicating non-execution.

The mental state memory 16 overwrites and stores the mental state signal MOD supplied from the control unit 15. Each time the sleepiness depth data DN is supplied from the control unit 15, the mental state memory 16 sequentially stores the supplied sleepiness depth data DN. Each time the tension depth data DK is supplied from the control unit 15, the mental state memory 16 sequentially stores the supplied tension depth data DK. In other words, in the mental state memory 16, a plurality of sleepiness depth data DN and a plurality of links acquired up to the present time are stored together with one mental state signal MOD. Zhang depth data DK is accumulated and stored. When the readout command signal is supplied from the control unit 15, the mental state memory 16 reads the mental state signal MOD or the accumulated and stored V, the plurality of sleepiness depth data DN and the tension depth data DK, and controls the control unit. Supply to 15.

[0014] When the drowsiness depth data DN and the tension depth data DK are supplied from the control unit 15, the mental state monitor image generation unit 17 performs a mental state monitor based on the drowsiness depth data DN and the tension depth data DK. A mental state monitor image signal VSS representing an image (described later) is generated and supplied to the image composition unit 18. When the first support (or fourth support) execution selection image display command is supplied from the control unit 15, the mental state monitor image generation unit 17 should execute the first support (or fourth support). A mental state monitor image signal VSS representing an image for allowing the driver to select whether or not is supplied to the image composition unit 18.

The navigation device 19 obtains the current position of the vehicle by receiving a radio wave from a GPS (Global Positioning System) satellite (not shown). The navigation device 19 reads a road map within a predetermined range including the current position of the vehicle from a map database (not shown) in which information on road maps and various stores and service facilities is stored. A map image signal V NV representing a current map image with a mark indicating the current position of the host vehicle added thereto is generated and supplied to the image composition unit 18. The navigation device 19 is an image that should guide the road route from the current position of the vehicle to the destination when the operator (driver) performs the route guidance to the destination. A map image signal VNV superimposed on the current map image is generated and supplied to the image composition unit 18.

When the second support execution command is supplied from the control unit 15, the navigation device 19 is a road map within a predetermined range including at least one parking spot that exists in the vicinity of the current position of the host vehicle. Is retrieved from the map database and read out. In short, the navigation device 19 is a parking point that is closest to the current position of the vehicle, a parking point that is the second closest to the current position of the vehicle, and the third closest. The map database is searched for a road map that includes at least one of the parking points that are close to the 1 ^^ th position (k is a natural number). The navigation device 19 is located on the road map from the current position of the vehicle. For example, the map image signal VNV in which the route to the parking available point selected by the driver is highlighted (for example, blinking) is generated and supplied to the image composition unit 18. During this time, when the second support stop command is supplied from the control unit 15, the navigation device 19 displays the map image signal VNV from which the highlighting for the parking possible point and the route to the parking possible point is canceled. Is supplied to the image composition unit 18 and the search operation for the parking possible point as described above is stopped.

[0017] The image composition unit 18 generates an image signal representing an image in which an image represented by the mental state monitor image signal VSS is superimposed on an image represented by the map image signal VNV, and displays the image signal as a display device. Supply to 20. The display device 20 displays an image corresponding to the image signal supplied from the image composition unit 18.

The audio system 21 includes a recorded information reproduction device 210, a radio receiver 211, an amplifier 212, and a speaker 213.

The recorded information reproducing apparatus 210 reads and reproduces the audio signal for each song recorded on a recording medium (eg, CD, DVD, MD, hard disk, DRAM, flash memory, etc.) and amplifiers 212 To supply. The powerful recording medium includes at least two songs selected by the driver for relieving drowsiness (hereinafter referred to as sleepiness-resolving music) and music selected for relaxation (hereinafter referred to as relaxation music). Is recorded. When the first support execution command is issued from the control unit 15, the recorded information reproducing apparatus 210 reads and reproduces the audio signal corresponding to the drowsiness-removing music as described above with the power of the recording medium. On the other hand, when the fourth support execution command is issued from the control unit 15, the recorded information reproducing apparatus 210 reads and reproduces the audio signal corresponding to the relaxed music as described above. During this time, if the control unit 15 issues a first support (or fourth support) stop command, the recorded information playback apparatus 210 stops the playback operation of the drowsiness-resolving music (or relaxing music) as described above. To do.

[0020] The radio receiver 211 supplies an audio signal obtained by receiving and demodulating a radio broadcast wave to the amplifier 212.

The amplifier 212 selectively amplifies the amplitude of one audio signal designated by the operator from among the audio signals supplied from the recorded information reproducing apparatus 210 and the radio receiver 211, and this amplification. The recorded audio signal is supplied to the speaker 213. Spi The first power 213 outputs a sound according to the powerful audio signal. When the third support execution command is supplied from the control unit 15, the amplifier 212 amplifies the supplied audio signal at an amplification factor corresponding to a predetermined small volume to the speaker 213. Supply. That is, the playback volume for the audio signal is reduced in response to the third support execution command. In the meantime, when the third support stop command is issued from the control unit 15, the amplifier 212 amplifies the audio signal with the amplification factor restored to the volume immediately before the volume is lowered.

[0022] The operation device 22 accepts various operations by the driver, such as pressing a key (or touch sensor) corresponding to various operation contents or by voice, and controls operation signals corresponding to the operations. Supply to part 15.

Next, the operation of the optimization support device shown in FIG. 1 will be described.

FIG. 2 is a diagram showing a mental state optimization support control flow executed by the control unit 15.

In FIG. 2, first, the control unit 15 takes in the heart rate data CN supplied from the heart rate measuring unit 13, and uses the heart rate indicated by the heart rate data CN as an initial heart rate ICN as a built-in register ( (Step Sl). Next, the control unit 15 adds the result obtained by adding the predetermined offset value OF to the initial heart rate ICN as the tension category value TNK when classifying the normal state or drowsiness state from the tension state. Store in register (step S2). Next, the control unit 15 stores a mental state signal MOD of “0” indicating a normal state as an initial value of the mental state signal MOD in the mental state memory 16 (step S3). Next, the control unit 15 reads the mental state signal MOD stored in the mental state memory 16 and takes it in (step S4). Next, the control unit 15 determines whether or not the mental state signal MOD captured in step S4 is “0” indicating a normal state (step S5), and if “0”, it is determined as! / ヽ. If yes, it is determined whether it is “2” indicating sleepiness (step S6).

If it is determined in step S5 that the mental state signal MOD is “0” indicating the normal state, the control unit 15 proceeds to the execution of the state transition detection subroutine of the normal state force (step S5). S7). In step S6, the mental state signal MOD is “2” indicating sleepiness. If it is determined that the tension state is “1”, the control unit 15 proceeds to the execution of the state transition detection subroutine from the tension state (step S8). When it is determined in step S6 that the mental state signal MOD is “2” indicating the sleepiness state, the control unit 15 proceeds to the execution of the state transition detection subroutine from the sleepiness state (step S9).

FIG. 3 and FIG. 4 show the flow of a state transition detection subroutine from the normal state in step S7.

In FIG. 3, the control unit 15 first sequentially takes heart rate data CN for 6 samples every 10 seconds within 1 minute, and stores them in the built-in register as heart rate data CN1 to CN6 ( Step S71). In other words, within 1 minute, the first heart rate data CN acquired is CN1, CN2 is the second heart rate data CN2, CN3 is the third heart rate data CN3, and the fourth heart rate data CN3 The captured heart rate data CN is stored in the internal register as CN4, the fifth acquired heart rate data CN as CN5, and the sixth acquired heart rate data CN as CN6. Next, the control unit 15 determines whether or not all of the heart rate data CN1 to CN6 are less than the tension classification value TNK stored in the built-in register (step S72).

[0029] In step S72, when it is determined that at least one of the heart rate data CN1 to CN6 is not smaller than the tension division value TNK, the control unit 15 makes a spirit of “1” indicating a tension state. The state signal MOD is overwritten and stored in the mental state memory 16 (step S73). Next, the control unit 15 takes in the heart rate data CN, and multiplies the difference between the heart rate data CN and the tension category value TNK stored in the built-in register by a predetermined sensitivity coefficient, The mental state memory 16 is overwritten and stored as the tension depth data DK representing the depth of the step (step S730). Next, the control unit 15 determines whether or not the tension depth data DK is larger than a predetermined tension depth threshold DKR (step S731). That is, it is determined whether or not the driver's degree of tension exceeds the tension depth threshold value DKR by executing Step S731. When it is determined in step S731 that the tension depth data DK is larger than the tension depth threshold D KR, the control unit 15 supplies the third support execution command to the audio system 21 (step S732). In response to the third support execution command, The amplifier 212 of the radio system 21 lowers the volume by reducing the amplification factor when amplifying the audio signal by a predetermined amount. Next, the control unit 15 rewrites the value of the third support execution flag SF3 stored in the built-in register to the logical level “1” indicating that the third support is being executed (step S733). .

[0030] If the driver's mental state shifts to normal state force tension state, and the degree of tension is high enough to exceed the predetermined tension depth threshold DKR, the situation inside and outside that causes the driver's tension It is necessary to ensure safety by concentrating on. Therefore, third support is implemented to reduce the volume during radio playback.

[0031] On the other hand, if it is determined in step S72 that the heart rate data CN1 to CN6 are all smaller than the tension category value TNK, the control unit 15 reduces the heart rate based on the heart rate data CN1 to CN6. Detect whether or not there is a tendency. The control unit 15 stores the logic level 1 in the built-in register when detecting that the heart rate tends to decrease, and otherwise the logic level 0 (step S74). Next, the control unit 15 determines whether or not the decreasing tendency flag FR stored in the built-in register is at a logic level 1 indicating a decreasing tendency of the heart rate (step S75). If it is determined in step S75 that the decrease tendency flag FR is not at logic level 1, that is, if it is determined that the heart rate is not in a decrease tendency, the control unit 15 sets “0” indicating a normal state. The mental state signal MOD "is overwritten and stored in the mental state memory 16 (step S76).

[0032] If it is determined in step S75 that the decrease tendency flag FR is at logic level 1, that is, if it is determined that the heart rate is in a decrease tendency, the control unit 15 performs the process as described above. The sixth heart rate data CN6 captured is stored in the built-in register as return heart rate data RR (step S77). Next, the control unit 15 overwrites and stores the mental state signal MOD “2” indicating the sleepiness state in the mental state memory 16 (step S78).

[0033] Although the human heart rate varies depending on the posture, temperature, mental state, and the like, the mental state such as sleepiness is the main factor that changes the heart rate because the posture and the ambient temperature hardly change during driving. It is known that when a driver's mental state transitions from a normal state to a sleepy state, the driver's heart rate generally decreases. Therefore, if it is determined in steps S74 and S75 that the driver's heart rate is decreasing, the driver is determined to be drowsy. I tried to do it.

Next, the control unit 15 determines whether or not the fourth support execution flag SF4 stored in the internal register is at the logic level “1” (step S780). When it is determined in step S780 that the fourth support execution flag SF4 is the logic level “1”, the control unit 15 supplies the fourth support stop command to the audio system 21 (step S781). In response to the fourth support stop command, the recorded information playback apparatus 210 of the audio system 21 stops the playback operation of the relaxed music as described above, and is not subject to playback immediately before performing the playback operation on the relaxed music. Move to the playback operation of the recorded music. Next, the control unit 15 rewrites the value of the fourth support execution flag SF4 stored in the built-in register to the logic level “0” indicating that the fourth support is not being executed (step S 782 ).

[0035] That is, when the driver's mental state shifts to a normal state force sleepiness state, first, the driver's tension is relieved and the playback operation (fourth support) for the relaxed music is performed. Stop (steps S780 to S782).

[0036] After the execution of step S782, or when it is determined in the upper step S780 that the fourth support execution flag SF4 is not at the logic level "1", the control unit 15 proceeds to the execution of step S783. That is, the control unit 15 takes in the heart rate data CN, and multiplies the result of multiplying the difference between the heart rate data CN and the return heart rate data RR stored in the internal register by a predetermined sensitivity coefficient. Is supplied to the mental state memory 16 as sleepiness depth data DN representing the depth of the subject (step S783). Next, the control unit 15 determines whether or not the sleepiness depth data DN is larger than a predetermined first sleepiness depth threshold DN 1 (step S 78 4). That is, by executing step S784, it is determined whether or not the degree of sleepiness of the driver is so high that it exceeds the first sleepiness depth threshold DN1. When it is determined in step S784 that the sleepiness depth data DN is larger than the predetermined first sleepiness depth threshold DN1, the control unit 15 stores the first support execution flag SF1 stored in the internal register. It is determined whether or not the logic level is “1” (step S 785). If it is determined in step S785 that the first support execution flag SF1 is not at the logic level “1”, that is, if it is determined that the first support is not currently implemented, the control unit 15 performs step S786. Execute. That is, the control unit 15 determines whether or not the first support (reproduction of the drowsiness elimination song) should be performed. A first support execution selection image display command to superimpose and display an image for selection by the transfer person is supplied to the mental state monitor image generation unit 17 (step S786). By executing step S786, the display device 20 causes the driver to select whether or not to perform the first support as shown in FIG. An image obtained by superimposing the image PG1 on the currently displayed image is displayed for a predetermined period. In step S7 86, a message that warns the driver that sleepiness may occur, for example, “There is a possibility of falling asleep” as shown in FIG. Provide a message to the driver by voice. During this time, the driver uses the operation device 22 to specify whether or not the power is required to execute the first support (reproduction of drowsiness elimination music). The control unit 15 determines whether or not an operation signal corresponding to the execution of the first support (reproduction of sleepiness relief music) is supplied from the operation device 22 (step S787). If it is determined in step S787 that the operation signal corresponding to the execution of the first support has been supplied, the control unit 15 supplies the first support execution command to the audio system 21 (step S788). In response to the first support execution command, the recorded information reproducing apparatus 210 of the audio system 21 stops the reproducing operation for the currently reproduced music and starts the reproducing operation of the drowsiness eliminating music as described above. Next, the control unit 15 rewrites the value of the first support execution flag SF1 stored in the internal register to the logic level “1” indicating that the first support is being executed (step S789). After execution of step S789, or when it is determined in step S785 that the first support execution flag SF1 is at the logic level “1”, that is, the first support is already being implemented, or step S787 is entered. When it is determined that the operation signal for executing the first support is not supplied, the control unit 15 executes Step S790. That is, the control unit 15 determines whether or not the sleepiness depth data DN is greater than a predetermined second sleepiness depth threshold DN2 (DN2> DN1) (step S790). By executing step S790, it is determined whether or not the degree of sleepiness of the driver is so high that it exceeds a second sleepiness depth threshold value DN2 representing a greater sleepiness depth than the first sleepiness depth threshold value DN1. If it is determined in step S790 that the sleepiness depth data DN is greater than the predetermined second sleepiness depth threshold DN2, the control unit 15 supplies the second support execution command to the navigation device 19 (step S791). ). In response to the second support execution command, the navigation device 19 is a small number that exists in the vicinity of the current position of the host vehicle. Search the map database for a road map within the specified range including at least one parking spot and read it out. Then, the navigation device 19 displays the map image signal VNV in which the road from the current position of the vehicle to the parking available point selected by the driver is highlighted (for example, blinking) on the road map. Supplied to the image composition unit 18. Therefore, at this time, as shown in FIG. 6, the display device 20 displays an image in which the parking area PA and the route RT from the current vehicle position CP to the parking area PA are highlighted (shown by broken lines). indicate.

[0038] After executing step S791, the control unit 15 rewrites the value of the second support execution flag SF2 stored in the built-in register to the logic level “1” indicating that the second support is being executed. (Step S792).

[0039] That is, when the driver's mental state shifts to the normal state force sleepiness state, if the sleepiness level (sleepiness depth data DN) is high enough to exceed the first sleepiness depth threshold DN1, the audio system 21 By playing the sleepiness-resolving song (first support), the driver is relieved of sleepiness (steps S784 to S789). Further, when the driver's sleepiness level increases and exceeds the second sleepiness depth threshold DN2, the parking device is highlighted on the navigation device 19 (second support), so that the driver can rest. To help relieve sleepiness (steps S790 to S792).

[0040] After execution of steps S76, S733, or S792, or step S731 [trowel tension depth data DK is determined not to be greater than the tension depth threshold DKR, the controller 15 Exits the state transition detection subroutine flow of the normal state force shown in FIGS. 3 and 4, and returns to the execution of the optimization support control flow shown in FIG. If it is determined in step S784 that the sleepiness depth data DN is not greater than the first sleepiness depth threshold DN1, or the control unit 15 determines that the sleepiness depth data DN is greater than the second sleepiness depth threshold DN2 in step S790. Even if it is determined that it is not large, the process returns to the execution of the optimization support control flow shown in FIG.

FIG. 7 is a diagram showing a state transition detection subroutine flow from the tension state in step S8 in the optimization support control flow shown in FIG.

In FIG. 7, the control unit 15 takes in the heart rate data CN for one sample (step S81), and determines whether or not the force is greater than the tension category value ΤΝΚ (step S8). 2). If it is determined in step S82 that the heart rate data CN for one sample is greater than the tension category value TNK, the control unit 15 determines whether the difference between the captured heart rate data CN and the tension category value TNK has a predetermined sensitivity. The multiplication result obtained by multiplying the coefficient is supplied to the mental state memory 16 as tension depth data DK representing the depth of tension (step S83). The mental state memory 16 additionally stores the supplied tension depth data DK each time step S83 is executed. Next, the control unit 15 determines whether or not the tension depth data DK is larger than the tension depth threshold DKR (step S830). In step S830, if it is determined that the tension depth data DK is greater than the tension depth threshold DKR, the control unit 15 stores the third support execution flag SF3 in the built-in register. It is determined whether it is “1” (step S831). If it is determined in step S831 that the third support execution flag SF3 is not at the logic level “1”, the control unit 15 supplies the third support execution command to the audio system 21 (step S832). . In response to the third support execution command, the amplifier 212 of the audio system 21 amplifies the supplied audio signal at an amplification factor corresponding to a predetermined small volume. That is, the playback volume for the audio signal is reduced in response to the third support execution command. Next, the control unit 15 rewrites the value of the third support execution flag SF3 stored in the built-in register to the logic level “1” indicating that the third support is being executed (step S833). .

[0043] If the driver's mental state is in tension and the degree of tension is high enough to exceed the predetermined tension depth threshold DKR, concentrate on the internal and external situations that cause the driver's tension. It is necessary to ensure safety by receiving. Therefore, the third support to reduce the volume during radio and music playback is implemented.

On the other hand, if it is determined in step S830 that the tension depth data DK is not greater than the tension depth threshold DKR, the control unit 15 determines that the third support execution flag SF3 stored in the built-in register is at the logic level. It is determined whether or not the force is “1” (step S834). If it is determined in step S834 that the third support execution flag SF3 is the logic level “1”, the control unit 15 supplies a third support stop command to the audio system 21 (step S835). In response to the third support stop command, the amplifier 212 of the audio system 21 increases the amplification factor to adjust the volume during music playback immediately before the execution of the third support. Return the volume to. Next, the control unit 15 rewrites the value of the third support execution flag SF3 stored in the built-in register to the logic level “0” (step S836).

[0045] In other words, if the driver's mental state is in tension, but the degree of tension is lower than the predetermined tension depth threshold DKR, the driver can concentrate on the situation inside and outside to ensure safety. Stop the third support (decreasing the volume when playing music).

[0046] If it is determined in step S82 that the value of the heart rate data CN is not greater than the tension category value TNK, the control unit 15 sends a mental state signal MOD of "0" indicating a normal state to the mental state memory. (Step S84). Next, the control unit 15 determines whether or not the third support execution flag SF3 stored in the built-in register has a logic level “1” (step S840). When it is determined in step S840 that the third support execution flag SF3 is the logical level “1”, the control unit 15 supplies the third support stop command to the audio system 21 (step S841). In response to the powerful third support stop command, the amplifier 212 of the audio system 21 increases the amplification factor to return the volume at the time of music playback to the volume immediately before the execution of the third support. Next, the control unit 15 rewrites the value of the third support execution flag SF3 stored in the built-in register to the logic level “0” (step S842).

[0047] That is, when the driver's mental state recovers to a tension state and a normal state, first, the third support (music) is made to ensure that the driver concentrates on the internal and external situations. (Volume reduction during playback) is stopped.

[0048] After the execution of step S842, or when it is determined in step S840 that the third support execution flag SF3 is not at the logic level "1", that is, the third support is not implemented, the control unit 15 The mental state motor image generation unit 17 sends a fourth support execution selection image display command to superimpose an image for allowing the driver to select the power to perform the fourth support (reproduction of relaxed music). Supply (step S844). By executing step S844, the display device 20 causes the driver to select whether or not to perform the fourth support as shown in FIG. An image superimposed on the currently displayed image is displayed for a predetermined period. During this time, the driver uses the operation device 22 to designate whether or not the power is to be executed in the fourth support (reproduction of the relaxed song). The control unit 15 It is determined whether or not the operation signal corresponding to the execution of the fourth support (reproduction of relaxed music) is supplied from the operation device 22 (step S845). If it is determined in step S845 that the operation signal corresponding to the execution of the fourth support is supplied, the control unit 15 supplies the fourth support execution command to the audio system 21 (step S846). In response to the fourth support execution instruction, the recorded information playback apparatus 210 of the audio system 21 stops the playback operation for the currently playing song and starts the relaxing song playback operation as described above. Next, the control unit 15 rewrites the value of the fourth support execution flag SF4 stored in the built-in register to the logic level “1” indicating that the fourth support is being executed (step S847).

[0049] After execution of steps S833, S836, or S847, the control unit 15 exits the state transition detection subroutine flow from the tension state shown in FIG. 7 and performs the optimization support control flow shown in FIG. Return to execution. The control unit 15 determines that the third support execution flag SF3 is not at the logic level “1” in step S831, or the third support execution flag SF3 is not at the logic level “1” in step S834. If determined, the process exits the state transition detection subroutine flow from the tension state shown in FIG. 7, and returns to the execution of the optimization support control flow shown in FIG. When the fourth support execution flag SF4 is determined to be the logical level “1” in step S843, or in step S845, the control unit 15 responds to the execution of the fourth support (reproduction of relaxed music). When it is determined that the operation signal has been supplied, the state transition detection subroutine flow from this tension state is exited, and the optimization support control flow shown in FIG. 2 is executed again.

FIG. 9 shows a state transition detection subroutine flow from the sleepiness state in step S9 in the optimization support control flow shown in FIG.

In FIG. 9, the control unit 15 first sequentially takes heart rate data CN for 6 samples every 10 seconds within 1 minute, and stores them in the built-in register as heart rate data CN1 to CN6 ( Step S91). Next, the control unit 15 determines whether all of the heart rate data CN1 to CN6 is stored in the built-in register and is smaller than the return heart rate data RR (step S92). If it is determined in step S92 that all of the heart rate data CN1 to CN6 are smaller than the return heart rate data RR, the control unit 15 determines whether the captured heart rate data CN and the return heart rate data RR are Multiply the difference by a predetermined sensitivity factor The calculated multiplication result is supplied to the mental state memory 16 as sleepiness depth data DN representing the depth of sleepiness (step S93). The mental state memory 16 additionally stores the supplied sleepiness depth data DN every time step S93 is executed. Next, the control unit 15 determines whether or not the sleepiness depth data DN is greater than a predetermined first sleepiness depth threshold DN1 (step S930). That is, by executing step S930, it is determined whether or not the degree of sleepiness of the driver is so high that it exceeds the first sleepiness depth threshold DN1. If it is determined in step S930 that the sleepiness depth data DN is greater than the predetermined first sleepiness depth threshold DN1, the control unit 15 uses the first support execution flag SF1 stored in the internal register as a logic. It is determined whether or not the level is “1” (step S931). If it is determined in step S931 that the first support execution flag SF1 is not at the logic level “1”, that is, if it is determined that the first support is not currently implemented, the control unit 15 Step S9 32 is executed. In other words, the control unit 15 sends a first support execution selection image display command to display an image for superimposing an image for the driver to select whether or not to execute the first support (reproduction of sleepiness relief music). This is supplied to the monitor image generation unit 17 (step S932). By executing step S932, the display device 20 causes the driver to select whether or not to perform the first support as shown in FIG. 5, that is, whether or not to reproduce the drowsiness-resolving song. PG1 Is displayed over a predetermined period of time in an image superimposed on the currently displayed image. In step S932, a message that warns the driver that sleepiness may occur, for example, “There is a possibility of falling asleep” as shown in FIG. To the driver by voice. During this time, the driver uses the operation device 22 to specify whether or not the first support (reproduction of drowsiness elimination music) is executed. The control unit 15 determines whether or not an operation signal corresponding to the execution of the first support (reproduction of sleepiness relief music) is supplied from the operation device 22 (step S933). If it is determined in step S933 that the operation signal corresponding to the execution of the first support is supplied, the control unit 15 supplies the first support execution command to the audio system 21 (step S934). In response to the first support execution command, the recorded information playback apparatus 210 of the audio system 21 stops the playback operation for the currently playing song and starts the playback operation of the drowsiness eliminating song as described above. Next, the control unit 15 uses the first support execution flag stored in the built-in register. The value of SF1 is rewritten to the logic level “1” to indicate that the first support is being executed (step S 935).

[0052] After execution of step S935, or when it is determined in step S931 that the first support execution flag SF1 is at the logic level “1”, that is, the first support is already being executed, or the step If it is determined in step S933 that the operation signal corresponding to the execution of the first support is not supplied, the control unit 15 executes the following step S936. That is, the control unit 15 determines whether or not the sleepiness depth data DN is greater than a predetermined second sleepiness depth threshold DN2 (DN2> DN1) (step S936). By executing step S936, it is determined whether or not the degree of sleepiness of the driver is so high that it exceeds a second sleepiness depth threshold DN2 that represents a greater sleepiness depth than the first sleepiness depth threshold DN1. If it is determined in step S936 that the sleepiness depth data DN is greater than the predetermined second sleepiness depth threshold DN2, the control unit 15 determines whether or not the second support execution flag SF2 is a logic level “1”. (Step S937). If it is determined in step S937 that the second support execution flag SF2 is not the logical level “1”, that is, if it is determined that the second support is not being executed, the control unit 15 issues a second support execution command. This is supplied to the navigation device 19 (step S938). In response to the second support execution command, the navigation device 19 also searches the map data base for a road map within a predetermined range that includes at least one parking spot that is present in the vicinity of the current position of the host vehicle. Read this out. Then, the navigation device 19 displays the map image signal VNV in which the route from the current position of the vehicle to the parking available point selected by the driver is highlighted (for example, blinking) on the road map. The image is supplied to the image composition unit 18. Therefore, as shown in FIG. 6, the display device 20 displays an image in which the parking area PA and the route from the current vehicle position CP to the parking area PA are highlighted (indicated by broken lines).

[0053] After execution of step S938, the control unit 15 rewrites the value of the second support execution flag SF2 stored in the built-in register to the logic level “1” indicating that the second support is being executed. (Step S939).

[0054] That is, when the driver's mental state is drowsiness, if the drowsiness level (sleepiness depth data DN) is high enough to exceed the first sleepiness depth threshold DN1, the audio system By playing the sleepiness-resolving music on the system 21 (first support), the driver's sleepiness is relieved (steps S930 to S935). Furthermore, if the driver's drowsiness level increases and exceeds the second drowsiness depth threshold DN2, the navigation device 19 highlights the parking available point (second support), thereby Encourage breaks to help eliminate drowsiness (Steps S936-S939).

[0055] In step S92, when it is determined that at least one of the heart rate data CN1 to CN6 is not smaller than the return heart rate data RR, the control unit 15 has a spirit of "0" indicating a normal state. The state signal MOD is supplied to the mental state memory 16 (step S94). Next, the control unit 15 determines whether or not the first support execution flag SF 1 stored in the built-in register is at the logic level “1” (step S 940). If it is determined in step S940 that the first support execution flag SF1 is at the logic level “1”, that is, if it is determined that the first support is being executed, the control unit 15 performs the first support (sleepiness). A first support stop command for stopping the playback of the resolved music is supplied to the audio system 21 (step S941). In response to the first support stop command, the recorded information playback device 210 of the audio system 21 stops playback of the sleepiness-resolving song and plays the song that was the playback target before the sleepiness-resolving song. Resume operation. Next, the control unit 15 rewrites the value of the first support execution flag SF1 stored in the internal register to the logic level “0” indicating that the first support is not being executed (step S). 942).

[0056] After the execution of step S942, or when it is determined in step S940 that the first support execution flag SF1 is not at the logic level "1", or in step S936, the sleepiness depth data DN is the second sleepiness. When it is determined that it is not greater than the depth threshold DN2, the control unit 15 determines whether or not the second support execution flag SF2 is a force having the logic level “1” (step S943). If it is determined in step S943 that the second support execution flag SF2 is at the logic level “1”, that is, if it is determined that the second support is being executed, the control unit 15 performs the second support execution. A stop command is supplied to the navigation device 19 (step S944). In response to the second support stop command, the navigation device 19 generates the map image signal VN V from which the highlighting of the parking area PA and the route to the parking area PA as shown in FIG. At the same time, the search operation for the parking available point is stopped. [0057] After execution of step S944, the control unit 15 sets the value of the second support execution flag SF2 stored in the built-in register to a logical level “0” indicating that the second support is not being executed. Rewrite (Step S945).

[0058] That is, when the driver's mental state recovers to the normal state of sleepiness, the first support (playback of sleepiness relief music) is stopped (steps S941 and S942) and the second support (parking is possible) Stop the route guidance display to the point (steps S944 and S945).

After executing step S939 or S945, the control unit 15 exits the state transition detection subroutine flow from the sleepiness state shown in FIG. 9 and returns to the execution of the optimization support control flow shown in FIG. If it is determined in step S937 that the second support execution flag SF2 is at the logic level “1”, or the control unit 15 determines in step S943 that the second support execution flag SF2 is at the logic level “1”. If it is determined that it is not, the state transition detection subroutine for vigorous sleepiness state force exits the subroutine flow and returns to the execution of the optimization support control flow shown in FIG. Even if it is determined in step S930 that the sleepiness depth data DN is not larger than the first sleepiness depth threshold DN1, the control unit 15 exits the state transition detection subroutine flow for sleepiness state force as shown in FIG. Returning to the execution of the optimization support control flow shown in FIG.

In FIG. 2, after execution of step S7 (shown in FIGS. 3 and 4), execution of step S8 (shown in FIG. 7), or execution of step S9 (shown in FIG. 9), the control unit 15 It is determined whether or not the operation signal for displaying the mental state monitor image is supplied from the operation device 22 (step S10). That is, it is determined whether or not the driver has performed a display instruction operation of the mental state monitor image with the operation device 22. If it is determined in step S10 that an operation signal for displaying a mental state monitor image has been supplied, the control unit 15 accumulates and stores in the mental state memory 16 a plurality of sleepiness depth data DN and A plurality of tension depth data DK are read and supplied to the mental state monitor image generation unit 17 (step Sl l). By executing step S11, the mental state monitor image generation unit 17 visually displays time-series changes in sleepiness depth based on the plurality of sleepiness depth data DN and tension based on the plurality of tension depth data DK. A mental state monitor image signal VSS that represents a graph that visually shows the transition of the depth in time series is generated and supplied to the image composition unit 18. As a result, the display device 20 estimates the sleepiness depth in the currently displayed image as shown in FIG. An image in which image A representing transition and image B representing transition in tension depth are superimposed on each other is displayed. Note that image A includes lines (indicated by broken lines) representing the first sleepiness depth threshold DN1 and the second sleepiness depth threshold DN2, and image B includes a line representing the tension depth threshold DKR.

(Shown with a broken line).

[0061] After execution of step S11 or when it is determined in step S10 that an operation signal for displaying a mental state monitor image is not supplied, the control unit 15 returns to the execution of step S4, Repeat steps S4 to S11.

[0062] Hereinafter, an operation by executing steps S4 to S11 will be described with reference to FIG.

[0063] First, when the driver has been in the normal state until just before that, the control unit 15 performs the driver's adjustment based on the state transition detection process from the normal state (FIGS. 3 and 4) in step S7. It is determined whether the divine state has maintained a normal state and has shifted to a deviant state, such as the power of drunkenness, drowsiness or tension. That is, if it is determined in step S72 shown in FIG. 3 that the heart rate data CN indicating the driver's heart rate does not continue to be smaller than the tension category value TNK for one minute, the control unit 15 Determines that the driver's mental state has shifted to the tension state as shown in FIG. 11 (step S73). At this time, if the driver's degree of tension! ヽ (Tension depth data DK) is greater than the predetermined threshold (Tension depth threshold DKR), the driver is asked to concentrate on the situation inside and outside. Third support for securing, that is, the reproduction volume of the audio system 21 is reduced (step S732). On the other hand, if the heart rate data CN is determined to be smaller than the tension category value TNK for 1 minute and it is determined in step S75 that the heart rate does not tend to decrease! / Then, the control unit 15 determines that the driver's mental state maintains the normal state as shown in FIG. 11 (step S76). If it is determined that the heart rate data CN is smaller than the tension category value TNK for 1 minute and it is determined in step S75 that the heart rate tends to decrease, the control unit 15 As shown in FIG. 11, it is determined that the normal state power has also changed to the sleepy state as shown in FIG. 11 (step S78). At this time, if the driver's sleepiness level (sleepiness depth data DN) is larger than the predetermined first threshold (first sleepiness depth threshold DN1), the first support for relieving the sleepiness, that is, Sleepiness with Audio System 21 Play the resolved song (step S788). In addition, if the driver's drowsiness becomes stronger and the degree exceeds the predetermined second threshold (second drowsiness depth threshold DN2), the second support is provided to encourage the driver to take a break and help to eliminate drowsiness. In other words, the navigation device 19 displays a road map highlighting at least one parking spot located in the vicinity of the current vehicle position (step S791).

[0064] Next, when the driver is in a tension state immediately before that, the control unit 15 determines the driver's mental state based on the state transition detection process (FIG. 7) from the tension state in step S8. It is determined whether the tension state is maintained or whether the state transitions to the normal state. That is, if it is determined in step S82 shown in FIG. 7 that the heart rate data CN indicating the driver's heart rate is greater than the tension category value TNK, the control unit 15 As shown in Fig. 11, it is judged that the spiritual state of the person continues to be in tension. At this time, if the degree of tension of the driver (tensile depth data DK) is larger than a predetermined threshold (tensile depth threshold DKK), the third support for relieving the tension, that is, playback in the audio system 21 The volume is reduced (step S832). Note that if the driver is in tension, but the degree of tension (Tension Depth Data DK) is smaller than a predetermined threshold (Tension Depth Threshold D KK), the execution of the third support as described above is stopped. Thus, the playback volume in the audio system 21 is returned to the volume before forcibly decreasing (step S835). On the other hand, if it is determined in step S82 shown in FIG. 7 that the heart rate data CN indicating the heart rate of the driver is not greater than the tension category value TNK, the control unit 15 determines the mental state of the driver. As shown in FIG. 11, it is determined that the state has changed to the normal state (step S84). At this time, the third support for ensuring the driver's concentration on the internal and external situations, that is, the forced reduction of the playback volume is stopped and the volume is restored (step S841). Support, that is, the relaxation music is played back in the audio system 21 (step S846).

[0065] If the driver is in a sleepy state until just before that, the control unit 15 determines that the driver's mental state is sleepy based on the state transition detection process from the sleepy state in step S9 (Fig. 9). Determine whether the force is maintaining the state, or whether it has transitioned to the normal state. That is, in step S92 shown in FIG. 9, the heart rate data CN 1 to 6 indicating the heart rate for one minute of the driver are all smaller than the return heart rate indicated by the return heart rate data RR. And If determined, the control unit 15 determines that the driver's mental state continues to be drowsy as shown in FIG. At this time, if the driver's sleepiness level (sleepiness depth data DN) is greater than a predetermined first threshold (first sleepiness depth threshold DN1), the first support for canceling the sleepiness, that is, audio The system 21 plays the sleepiness-reducing song (step S934). In addition, when the driver's drowsiness becomes strong and the degree exceeds the predetermined second threshold (second drowsiness depth threshold DN2), the second support that encourages the driver to take a break and help to eliminate drowsiness, That is, the navigation device 19 displays a road map highlighting at least one parking spot located in the vicinity of the current vehicle position (step S 938). On the other hand, if it is determined in step S92 that at least one of the heart rate data CN1 to CN6 is not smaller than the return heart rate data RR, the control unit 15 determines that the driver's mental state is sleepy as shown in FIG. It is determined that the force has also changed to the normal state (step S94). At this time, the first support and the second support for eliminating the drowsiness described above are stopped (Steps S 941 and S 944).

[0066] In the system for providing information on the driver's mental state as shown in Fig. 1 above, the first predetermined song (drowsiness-relieving song) is selected as the center of multiple songs according to the driver's mental state. 1st support for sound output, 2nd support for displaying at least one parking location near the current position of the vehicle on the road map, 3rd for adjusting the volume during sound output to the specified volume Execute or stop at least one of the support and the fourth support that selects and outputs a predetermined second music (relaxed music) from a plurality of music. This will provide the driver with optimal support for recovering the driver's mental state from drowsiness to normal or from tension to normal. Accident prevention effect can be enhanced compared to a system with only one.

[0067] This application is based on Japanese Patent Application No. 2005-324636 (filed on Nov. 9, 2005), and the contents of the Japanese Patent Application are incorporated herein.

Claims

The scope of the claims

[1] A driver mental state information providing system that provides information corresponding to the mental state of a vehicle driver,

A navigation device including a display for displaying a map image in which a mark indicating the current position of the vehicle is added to the road map;

Audio signals corresponding to a plurality of music pieces are recorded !, an audio device that reads and reproduces the audio signal from a recording medium, and outputs the audio signal;

Mental state detection means for detecting the driver's mental state;

First support for controlling the audio device to select, read and play the first medium of the plurality of music according to the mental state, at least one parking located near the current position is possible A second support for controlling the navigation device for displaying a point on the road map, a third support for controlling the audio device for adjusting the volume during sound output to a predetermined volume, and the plurality Control means for executing or stopping at least one of the fourth supports for controlling the audio device to select and read and reproduce the second music from among the music of Driver mental state information providing system.

[2] The control means executes the first support or the first support and the second support when the mental state changes from a normal state to a sleepy state,

When the mental state changes from the normal state to the tension state, the third support is performed,

When the mental state changes from the sleepy state to the normal state, the first support and the second support are stopped,

The driver mental state information providing system according to claim 1, wherein when the mental state changes from the tension state to the normal state, the fourth support is executed instead of the third support.

[3] Further comprising: a sleepiness depth detection means for detecting the driver's sleepiness depth; and a tension depth detection means for detecting the driver's tension depth;

When the mental state changes from a normal state to a sleepy state, the control means When the sleepiness depth is greater than the predetermined first sleepiness threshold and smaller than the predetermined second sleepiness threshold, the first support is executed, while the sleepiness depth is greater than the second sleepiness threshold. 3. The driver mental state information providing system according to claim 2, wherein the second support is executed together with the first support in the case of an increase.

[4] means for causing the display to display an image for allowing the driver to specify whether or not to execute the first support and an image for allowing the driver to specify whether or not the power for executing the fourth support is to be executed;

Operating means for designating execution of the first support or the fourth support, and the control means is the first support or the first only when the execution is designated by the operation means. 4. The driver mental state information providing system according to claim 2, wherein the support is executed.

5. The driver mental state information providing system according to claim 1, wherein the control means reduces the sound volume at the time of the sound output in the third support.