JP2023135807A - Warning presentation method, warning presentation device, and warning presentation program - Google Patents

Abstract

To provide a warning presentation method, a warning presentation device, and a warning presentation program capable of keeping an awakening effect by presenting new warning.SOLUTION: A warning presentation method #100 is a method for presenting warning to a warning object person by a warning generation section which generates warning when reduction of an awakening level of the warning object person is detected. The warning presentation method #100 includes: a localization reaction detection process #120 of detecting presence/absence of a localization reaction of the warning object person with respect to the warning; and a warning change instruction process #130 of instructing the warning generation section to generate warning after changing when the localization reaction of the warning object person is not detected in the localization reaction detection process #120. The warning change instruction process #130 includes a process of determining that the warning object person gets used to the warning when the localization reaction of the warning object person is not detected, so as to instruct the warning generation section to generate warning after changing the warning.SELECTED DRAWING: Figure 5

Description

The present invention relates to an alarm presentation method, an alarm presentation device, and an alarm presentation program for presenting a warning to a person to be warned by an alarm generation unit that generates an alarm when a decrease in alertness level of the person to be warned is detected.

Systems that mainly detect the drowsiness of a car driver and issue a warning may present a different alarm sound or issue a warning depending on the driver's level of drowsiness, mental and physical condition, and whether or not he or she has responded to the alarm. Appropriate warnings are presented by changing the threshold values used to determine whether a warning has occurred.

A conventional drowsiness alarm device (hereinafter referred to as prior art 1) includes a drowsiness level determining means for determining the driver's drowsiness level, and a preliminary warning means for issuing a preliminary warning when the drowsiness level exceeds an alarm threshold. , an alarm means for issuing a main alarm to prompt the driver to wake up from drowsiness after the preliminary alarm; a response detection means for detecting the response behavior of the driver after the preliminary alarm; The threshold value changing means is provided to change the threshold value to a higher value (see, for example, Patent Document 1). In this prior art 1, the preliminary warning and the main warning are appropriately performed at a drowsiness level that more closely matches the sense of the driver while driving the vehicle.

A conventional drowsy driving warning device (hereinafter referred to as conventional technology 2) includes a driver image drowsiness level determining means for determining a driver's drowsiness level determined based on a photographed image of the driver, and a driver image drowsiness level determination unit that determines the driver's drowsiness level based on the behavior of the vehicle. a vehicle behavior drowsiness level determination means for determining a vehicle behavior drowsiness level, a total drowsiness level determination means for determining a total drowsiness level based on these drowsiness levels, and an alarm level setting means for setting an alarm level based on a frequency distribution of the total drowsiness level. (For example, see Patent Document 2). In this prior art 2, the driver's drowsiness level is accurately determined and a warning is output from the output device in accordance with the driver's drowsiness level.

The conventional notification system (hereinafter referred to as conventional technology 3) includes a first detection means that detects a correlation value of the degree of drowsiness of the driver based on the driver's facial image, and a first detection means that detects the correlation value of the driver's drowsiness level based on the driver's biological information. a second detection means for detecting a correlation value of the degree of effort to awaken the driver; a second detection means for instructing an alarm based on the correlation value of the degree of drowsiness of the driver; (See, for example, Patent Document 3). In Prior Art 3, when the driver makes an effort to wake up and becomes less sleepy, the warning is reduced or stopped, thereby preventing the warning from continuing after the driver's level of sleepiness has decreased.

Japanese Patent Application Publication No. 2019-113925

Japanese Patent Application Publication No. 2019-016178

Japanese Patent Application Publication No. 2012-093867

In conventional techniques 1 to 3, when the driver becomes drowsy, an alert sound is presented to the driver to wake him up, but if the driver experiences this alarm sound many times, he or she may become accustomed to the alarm sound. This causes the problem that the same effect as the original cannot be obtained.

An object of the present invention is to provide an alarm presentation method, an alarm presentation device, and an alarm presentation program that can maintain the awakening effect by presenting a new alarm.

The present invention solves the above problems by means of solving the problem as described below.
Note that although the description will be given with reference numerals corresponding to the embodiments of the present invention, the present invention is not limited to these embodiments.
As shown in FIGS. 1 to 3 and 5, the invention of claim 1 is such that when a decrease in the alertness level of the person (M) to be alerted is detected, an alarm generation unit (6c) that generates an alarm generates this alarm. An alarm presentation method for presenting a warning to a person to be warned, comprising: a localization reaction detection step (#120) of detecting the presence or absence of a localization reaction of the person to be warned in response to the warning; This is an alarm presentation method (#100) including an alarm change command step (#130) of instructing the alarm generation unit to change the alarm and generate it when the localization reaction is not detected.

The invention according to claim 2 is the warning presentation method according to claim 1, in which, in the warning change command step (#120), when the localization reaction of the warning target person is not detected, the warning target person This method of presenting an alarm includes the step of determining that the user has become accustomed to the alarm, and instructing the alarm generator to change the alarm and issue the alarm.

The invention according to claim 3 is the alarm presenting method according to claim 1 or 2, in which, as shown in FIGS. 3 and 5, in the localization reaction detection step (#120), the alarm generating section The alarm change command step (#130) includes a step of detecting the presence or absence of a temporary decrease in the heart rate of the person to be alerted immediately after the occurrence of the alarm change command step (#130). This method of presenting an alarm includes the step of instructing the alarm generator to change the alarm sound and generate the alarm sound when a temporary decrease in the alarm sound is not detected.

The invention according to claim 4 is the alarm presenting method according to claim 1 or 2, in which the localization reaction detection step (#120) is performed on the alarm target person immediately after the alarm generation section generates the alarm sound. The alarm change command step (#130) includes a step of detecting the presence or absence of a temporary decrease in the pulse rate, and the alarm change command step (#130) includes: The method for presenting an alarm includes the step of instructing the alarm generator to generate a different alarm sound.

The invention according to claim 5 is the alarm presentation method according to claim 1 or 2, in which the localization reaction detection step (#120) is performed on the alarm target person immediately after the alarm generation section generates the alarm sound. The alarm change command step (#130) includes a step of detecting the presence or absence of a temporary increase in electrodermal activity of the person to be alerted, and the alarm change command step (#130) includes a step of detecting a temporary increase in electrodermal activity of the person to be alerted. The method for presenting an alarm includes the step of instructing the alarm generator to change the alarm sound and generate the alarm sound when the alarm sound is not heard.

The invention according to claim 6 is the alarm presentation method according to claim 1 or 2, in which the localization reaction detection step (#120) is performed on the alarm target person immediately after the alarm generation section generates the alarm sound. The alarm change command step (#130) includes a step of detecting the presence or absence of a temporary decrease in skin temperature, and the alarm change command step (#130) is performed when a temporary decrease in the skin temperature of the alarm subject is not detected in the localization reaction detection step. The warning presenting method may include a step of instructing the warning generator to generate a modified warning sound.

The invention according to claim 7 is the alarm presentation method according to claim 1 or 2, in which the localization reaction detection step (#120) is directed to the alarm target person immediately after the alarm generation section generates the alarm sound. The alarm change command step (#130) includes a step of detecting the presence or absence of a characteristic increase in brain waves expressed, and the alarm change command step (#130) includes a step of detecting a characteristic increase in brain waves expressed in the subject of the alarm in the localization reaction detection step. The method for presenting an alarm includes the step of instructing the alarm generator to change the alarm sound and generate the alarm sound when the alarm sound is not heard.

As shown in FIGS. 1 to 3, the invention according to claim 8 provides an alarm generating unit (6c) that generates an alarm when a decrease in alertness level of the person (M) to be alerted is detected. An alarm presentation device that presents a warning to a person, the localization reaction detection unit (6f) detecting the presence or absence of a localization reaction of the person to be alerted to the warning, and a localization reaction detection unit that detects the localization reaction of the person to be alerted to the warning. The alarm presentation device (6) includes an alarm change command section (6g) that instructs the alarm generating section to change the alarm and issue the alarm when the alarm is not detected.

As shown in FIGS. 1 to 3 and 6, the invention of claim 9 is such that when a decrease in the alertness level of the person (M) to be alerted is detected, the alarm generating unit (6c) generates the alert. An alarm presentation program for presenting a warning to a person to be warned, comprising a localization reaction detection procedure (S140, S170, S210) for detecting the presence or absence of a localization reaction of the person to be warned in response to the warning, and a localization reaction detection procedure. an alarm change command procedure (S150, S190) for instructing the alarm generation unit to change the alarm and generate the alarm when the localization response of the alarm target person is not detected in the alarm display; It is a program.

According to this invention, the alerting effect can be maintained by presenting a new alarm.

BRIEF DESCRIPTION OF THE DRAWINGS It is a block diagram which shows typically the arousal level fall prevention support system provided with the warning presentation apparatus based on 1st Embodiment of this invention. 1 is a configuration diagram schematically showing a warning presentation device according to a first embodiment of the present invention. It is a graph which shows typically the detection operation of the localization reaction detection part of the alarm presentation device based on 1st Embodiment of this invention. It is a graph showing, as an example, a change in the average heart rate before and after presenting the warning, which is detected by the localization reaction detection unit of the warning presenting device according to the first embodiment of the present invention. 1 is a process diagram of a warning presentation method according to a first embodiment of the present invention. FIG. 3 is a flowchart for explaining the operation of the warning presentation device according to the first embodiment of the present invention.

(First embodiment)
Hereinafter, a first embodiment of the present invention will be described in detail with reference to the drawings.
The driver M shown in FIG. 1 is a person to whom a warning is presented by the warning presentation device 6. The driver M is, for example, a power vehicle crew member who is always on duty in a railway vehicle such as a locomotive, an electric vehicle, or an internal combustion vehicle equipped with a power generating device.

The alertness level reduction prevention support system 1 shown in FIG. 2 is a system that supports the prevention of the alertness level of a driver M while driving a train. The alertness level reduction prevention support system 1 detects the face of the driver M based on the captured image of the driver M, extracts feature points, and determines the alertness level of the driver M based on the feature points of the driver M's face. By estimating the level of drowsiness, the occurrence of drowsiness in the driver M is detected and a warning is presented to the driver M. The arousal level reduction prevention support system 1 includes a photographing device 2, a face detecting device 3, an arousal degree estimating device 4, a physiological index measuring device 5, an alarm presenting device 6, and the like.

The photographing device 2 is a device for photographing the driver M. The photographing device 2 is installed in the driver's cabin (crew's cabin) of the train, and photographs the head of the driver M inside the driver's cabin. The photographing device 2 is adaptable to various light environments in the driver's cabin, and includes an infrared irradiator 2a that irradiates the driver M with infrared rays at an appropriate amount of light, a near-infrared camera 2b that photographs the driver M, and the like. There is.

The face detection device 3 is a device that detects the driver M's face. The face detection device 3 detects the face of the driver M based on the head image of the driver M photographed by the photographing device 2, and extracts feature points of the driver M. The face detection device 3 extracts the face region of the driver M from the driver M's head image by machine learning. Here, machine learning is a type of artificial intelligence, and is a computer algorithm that automatically improves by learning from experience. Machine learning enables identification or prediction by grasping the characteristics of data by learning the data.

The alertness level estimation device 4 is a device that estimates the alertness level of the driver M. The wakefulness estimation device 4 analyzes the face image of the driver M detected by the face detection device 3 and calculates the wakefulness estimated value (drowsiness rating value). The alertness estimation device 4 estimates the alertness level of the driver M by multivariate analysis or machine learning based on the image of each frame of the driver M's feature points, or Based on the series of images, the driver M's alertness level is estimated by machine learning. The alertness estimation device 4 outputs an alarm command signal to the alarm presentation device 6 and instructs the alarm presentation device 6 to perform an alarm presentation operation so that the alarm presentation device 6 presents an alert according to the estimated alertness value. .

The physiological index measuring device 5 is a device that measures the physiological index of the driver M. The physiological index measuring device 5 measures the heart rate of the driver M as a physiological index. Here, the heart rate is the number of times the heart beats within a certain period of time. The physiological index measuring device 5 is, for example, a device that is attached to a mass control steering wheel that is manually operated by the driver M when driving and measures the heart rate of the driver M, or a device that is attached to the clothing or arm that the driver M is wearing. This is a biological signal acquisition device such as a clothing-type or wristwatch-type wearable device that measures the driver M's heart rate. The physiological index measuring device 5 outputs the measured heart rate of the driver M to the warning presentation device 6 as physiological index data.

The warning presenting device 6 shown in FIGS. 2 and 3 is a device that presents a warning to the driver M using the warning generating section 6c when a decrease in the alertness level of the driver M is detected. The warning presentation device 6 presents a warning sound to the driver M when the alertness level estimation device 4 detects a decrease in the driver's M alertness level. The warning presenting device 6 presents a new and different warning to the driver M when no localization reaction is observed in the driver M immediately after presenting the warning to the driver M. Here, the term "orientation response" (orientation reflex) refers to a behavior in which, when a stimulus is presented to a living organism from the outside, it directs attention toward the direction of the stimulus. Orientation response is one of the physiological indicators in response to alarm sounds, and is a phenomenon such as a temporary decrease in heart rate that is observed when paying attention to a new item. The localization response disappears when the presentation of the alarm sound becomes routine and habituation (habituation or habituation) occurs. Here, habituation is a phenomenon in which a response to a certain stimulus gradually disappears as the stimulus is repeatedly presented, and is one of the concepts in psychology.

The warning presentation device 6 detects the presence or absence of the driver M's localization reaction based on the driver's M heart rate, and when the driver M's localization reaction is not detected, changes the warning and presents it. The warning presentation device 6 presents a warning according to the driver M's arousal level based on the estimated arousal degree estimated by the arousal degree estimating device 4. For example, the warning presentation device 6 generates a loud warning sound when the driver M is relatively sleepy, and generates a low warning sound when the driver M is relatively sleepy. As shown in FIG. 3, the alarm presentation device 6 includes an alarm command signal input section 6a, a physiological index data input section 6b, an alarm generation section 6c, an alarm data storage section 6d, a physiological index data storage section 6e, It includes a localization reaction detection section 6f, an alarm change command section 6g, an alarm condition setting section 6h, an alarm condition storage section 6i, an alarm presentation program storage section 6j, a control section 6k, and the like. The warning presentation device 6 is configured by, for example, a personal computer, and has a warning presentation program for presenting a warning to the driver M by the warning generation unit 6c when a decrease in the alertness level of the driver M is detected. The computer executes a predetermined process according to the following.

The alarm command signal input unit 6a shown in FIG. 3 is a means for inputting the alarm command signal output from the alertness level estimation device 4. The alarm command signal input section 6a is, for example, an interface (I/F) circuit that inputs an alarm command signal from the alertness level estimation device 4 to the control section 6k. The physiological index data input section 6b is a means for inputting physiological index data output from the physiological index measuring device 5. The physiological index data input section 6b is, for example, an interface (I/F) circuit that inputs an alarm command signal from the physiological index measuring device 5 to the control section 6k.

The alarm generating section 6c is a means for generating an alarm. The alarm generating unit 6c presents a warning to the driver M through hearing by generating an alarm sound. The alarm generation unit 6c is, for example, an acoustic device such as a speaker that converts an electrical signal into sound. The warning generation unit 6c presents a warning according to the driver M's wakefulness level (sleepiness level) based on the overall estimated value calculated by the wakefulness level estimating device 4. The alarm generation section 6c changes a plurality of alarms prepared in advance according to set change conditions based on the alarm data stored in the alarm data storage section 6d and the alarm condition data stored in the alarm condition storage section 6i. Occur.

The alarm data storage section 6d is a means for storing the alarm generated by the alarm generation section 6c as alarm data. The alarm data storage unit 6d is, for example, a storage device that stores a plurality of different types of alarm sounds as alarm sound data. The alarm data storage part 6d stores as alarm sound data a sound that can be distinguished from the running sound of the vehicle in which the driver M is riding, is not mistaken for the sound inside the passenger compartment or daily life sounds, and is easy to wake up. The alarm data storage unit 6d stores, for example, three types of alarms A to C with different alarm sounds as alarm data.

The physiological index data storage section 6e is a means for storing physiological index data output by the physiological index measuring device 5. The physiological index data storage unit 6e is, for example, a storage device that stores the heart rate of the driver M in correspondence with time so that it can be updated in chronological order.

The localization reaction detection unit 6f is a means for detecting whether or not the driver M has a localization reaction in response to an alarm. The localization reaction detection unit 6f detects the localization reaction within a predetermined period of time (for example, 10 seconds after the warning is presented) after the alarm generation unit 6c generates the alarm, based on the physiological index data stored in the physiological index data storage unit 6e. To detect. The localization reaction detection section 6f detects whether there is a temporary decrease in the heart rate of the driver M immediately after the alarm generation section 6c generates the alarm sound. For example, as shown in FIG. 3, the localization reaction detection unit 6f detects whether or not the heart rate has decreased within a predetermined time period ΔT from the alarm presentation time _T1 to the localization reaction detection end time _T2 . Here, the vertical axis shown in FIG. 3 is heart rate, and the horizontal axis is time. The localization reaction detection unit 6f determines that there is a localization reaction when the heart rate decreases immediately after the warning is presented, and determines that there is no localization reaction when the heart rate does not change or increases immediately after the warning is presented.

FIG. 4 is a graph showing, as an example, a change in average heart rate before and after the warning is presented. The vertical axis shown in FIG. 4 is the average heart rate (bpm), and the horizontal axis is the calculation time of the average heart rate. bpm (Beats Per Minute) is a unit of heart rate, and is the number of times the heart beats in one minute. As shown in Figure 4, statistical verification shows that when there is a possibility of a localization response, the heart rate is lower 10 seconds after the alarm is presented than the heart rate 1 minute before the alarm is presented; After a minute, the heart rate has recovered.

The localization reaction detection unit 6f shown in FIG. 3 determines whether the heart rate reduction rate is below the threshold value, and when the heart rate reduction rate is below the threshold value, there is no localization reaction and the heart rate reduction rate is below the threshold value. When exceeds the threshold value, it is determined that there is a localization response. Here, the heart rate decline rate is [bpmR-bpmA] when the average heart rate (bpmR) before the warning is presented (about 1 minute) and the average heart rate (bpmA) immediately after the warning (up to 10 seconds) *100/bpmR(%). The heart rate decrease rate takes a positive value when the average heart rate immediately after the alarm decreases, and takes a negative value when the average heart rate immediately after the alert increases. The heart rate reduction rate takes a value greater than zero when there is a localization response. The localization reaction detection unit 6f calculates the rate of decrease in heart rate based on the measurement results of the physiological index measuring device 5, and determines whether or not this rate of decrease in heart rate is less than or equal to a threshold value. The localization reaction detection section 6f outputs the detection result of the presence or absence of a localization reaction to the control section 6k as a localization reaction detection signal (localization reaction detection data).

The alarm change command section 6g is a means for instructing the alarm generation section 6c to change the alarm and generate it when the localization reaction detection section 6f does not detect the localization reaction of the driver M. The alarm change command section 6g instructs the alarm generation section 6c to change the alarm and generate it based on the detection result of the localization reaction detection section 6f. When the localization reaction of the driver M is not detected, the alarm change command unit 6g determines that the driver M is accustomed to the alarm, and instructs the alarm generation unit 6c to change the alarm and generate it. command. The alarm change command section 6g instructs the alarm generation section 6c to change the alarm and generate it when the localization reaction detection section 6f does not detect a temporary decrease in the heart rate of the driver M. As shown in FIG. 3, the alarm change command unit 6g determines that the driver M is not accustomed to the alarm when a decrease in heart rate is observed within the predetermined time ΔT and a localization reaction is detected. , does not instruct the alarm generation unit 6c to change the alarm. On the other hand, when a decrease in heart rate is not observed within the predetermined time ΔT and no localization reaction is detected, the alarm change command unit 6g determines that the driver M has become accustomed to the alarm, and the alarm change command unit 6g 6c to change the alarm.

The alarm condition setting section 6h is a means for setting conditions for the alarm generated by the alarm generation section 6c. The alarm condition setting section 6h sets changing conditions when changing and presenting a warning. The alarm condition setting unit 6h is, for example, an input device or an auxiliary input device that inputs various information to the alarm presentation device 6 through manual operation by a setter. When changing and presenting the alarm sound, the alarm condition setting unit 6h sets a change condition such that the alarm sound changes in stages, sets the order in which the alarm sound is presented as a change condition, Changing conditions are set so that the sound changes randomly, or changing conditions are set so that the alarm sound changes from one with a high drowsiness awakening effect to the other with a low alarm sound. The alarm condition setting unit 6h is set, for example, to present different alarms A to C in the order of alarms A to C. The alarm condition setting unit 6h outputs the set change conditions to the control unit 6k as change condition data.

The alarm condition storage section 6i is a means for storing the alarm conditions set by the alarm condition setting section 6h. The alarm condition storage section 6i is, for example, a storage device that stores the alarm conditions set by the alarm condition setting section 6h in an updatable manner as alarm condition data.

The warning presentation program storage section 6j is a means for storing a warning presentation program for presenting a warning to the driver M by the warning generating section 6c when a decrease in the alertness level of the driver M is detected. The alarm presentation program storage unit 6j is a storage device that stores an alarm presentation program read from an information recording medium or an alarm presentation program imported through a telecommunications line.

The control unit 6k is a central processing unit (CPU) that controls various operations related to the warning presentation device 6. The control section 6k reads out the warning presentation program from the warning presentation program storage section 6j, and executes a predetermined warning presentation process according to this warning presentation program. For example, the control unit 6k causes the alarm generating unit 6c to generate an alarm when an alarm command signal is input from the alarm command signal input unit 6a, reads alarm data from the alarm data storage unit 6d, and issues an alarm based on the alarm data. Generates an alarm in the generation section 6c, outputs the physiological index data input from the physiological index data input section 6b to the physiological index data storage section 6e, and instructs the physiological index data storage section 6e to store the physiological index data. , reads physiological index data from the physiological index data storage section 6e and outputs it to the localization reaction detection section 6f, instructs the localization reaction detection section 6f to detect the presence or absence of a localization reaction, or uses the detection result of the localization reaction detection section 6f. Based on this, the alarm change command section 6g is instructed to change the alarm, the alarm condition data output from the alarm condition setting section 6h is output to the alarm condition storage section 6i, or the alarm condition data is stored in the alarm condition storage section 6i. It reads the alarm condition data from the alarm condition storage section 6i and causes the alarm generation section 6c to generate an alarm based on the alarm condition data. The control section 6k includes an alarm command signal input section 6a, a physiological index data input section 6b, an alarm generation section 6c, an alarm data storage section 6d, a physiological index data storage section 6e, a localization reaction detection section 6f, an alarm change command section 6g, An alarm condition setting section 6h, an alarm condition storage section 6i, an alarm presentation program storage section 6j, and the like are connected to each other so as to be able to communicate with each other.

Next, a warning presentation method according to the first embodiment of the present invention will be described.
Warning presentation method #100 shown in FIG. 5 is a method in which the warning generation unit 6c presents a warning to the driver M when a decrease in the alertness level of the driver M is detected. The alarm presentation method #100 includes an alarm presentation step #110, a localization reaction detection step #120, an alarm change command step #130, an alarm presentation step #140, and the like.

Warning presentation step #110 is a step of presenting a warning to the driver M. When the alertness level estimating device 4 estimates that the alertness level of the driver M is decreasing, the alertness level estimating device 4 outputs an alarm command signal to the alert presenting device 6, and the alert generating unit 6c of the alert presenting device 6 Generates an alarm.

Localization response detection step #120 is a step of detecting whether or not the driver M has a localization response to the alarm. The localization reaction detection section 6f evaluates the physiological index data of the driver M immediately after the alarm generation section 6c generates the alarm, and determines whether or not there is a localization reaction. In the localization reaction detection step #120, as shown in FIG. 3, the presence or absence of a temporary decrease in the heart rate of the driver M is detected immediately after the alarm generation unit 6c generates the alarm sound. For example, based on the physiological index data of the driver M immediately after the alarm occurs, the localization reaction detection unit 6f determines whether the rate of decrease in heart rate is below a threshold value, and the rate of change in heart rate is below the threshold value. When this is the case, the localization reaction detection unit 6f determines that there is no localization reaction by the driver M.

Alarm change command step #130 is a step of instructing the alarm generator 6c to change the alarm and generate it when the localization reaction of the driver M is not detected in the localization reaction detection step #120. In the alarm change command step #130, when the localization reaction of the driver M is not detected, it is determined that the driver M is accustomed to the alarm, and the alarm generation unit 6c changes the alarm so that it occurs. command. In the warning change command step #130, as shown in FIG. 3, when a temporary decrease in the heart rate of the driver M is not detected in the localization reaction detection step #120, the warning sound is changed so that the warning sound is generated. A command is given to the alarm generating section 6c. For example, if driver M does not show a localization response, it is thought that the driver M has become accustomed to the presentation of the warning and the driver M's localization response has disappeared. The alarm change command section 6g issues a command to the alarm generating section 6c.

Warning presentation step #140 is a step of presenting a warning to the driver M. When the alarm change command section 6g instructs to change the alarm, the alarm generation section 6c presents a new and different alarm. For example, the alarm generating section 6c generates an alarm B that is different from the first alarm A. After the warning presentation step #140, the process returns to the localization reaction detection step #120, and in the localization reaction detection step #120, the localization reaction detection unit 6f determines whether or not there is a localization reaction of the driver M to the new alarm B, and the localization reaction detection step #120 The subsequent steps are repeated.

Next, the operation of the warning presentation device according to the first embodiment of the present invention will be explained.
In the following, the operation of the control unit 6k shown in FIG. 3 will be mainly explained, and a case where three different types of alarms A to C are presented will be explained as an example.
In step (hereinafter referred to as S) 100 shown in FIG. 6, the control unit 6k reads the warning presentation program from the warning presentation program storage unit 6j. When the control unit 6k reads the warning presentation program, the control unit 6k executes a series of warning presentation processing.

In S110, the control section 6k instructs the physiological index data storage section 6e to store the physiological index data. When the driver M starts driving, the physiological index measuring device 5 starts measuring the physiological index of the driver M. As a result, the physiological index measuring device 5 outputs physiological index data to the control section 6k through the physiological index data input section 6b of the alarm presentation device 6, and the physiological index data storage section 6e stores this physiological index data in chronological order. For example, the physiological index measuring device 5 starts measuring the heart rate of the driver M, and the heart rate data is stored in the physiological index data storage section 6e as physiological index data.

In S120, the control unit 6k determines whether an alarm command signal has been input. The alertness level estimating device 4 estimates the alertness level of the driver M based on the photographed image of the driver M taken by the photographing device 2. When the alertness level of the driver M is below the threshold and the alertness level estimation device 4 determines that the alertness level of the driver M is decreasing, the alertness level estimation device 4 sends an alarm command signal to the alarm presentation device 6. An alarm command signal is output to the control section 6k through the input section 6a. When the control unit 6k determines that the alarm command signal has been input, the process proceeds to S130, and when the control unit 6k determines that the alarm command signal has not been input, the control unit 6k repeats the determination of S120 until the alarm command signal is input. .

In S130, the control section 6k instructs the alarm generating section 6c to present the alarm A. The control unit 6k reads alarm data from the alarm data storage unit 6d, and outputs this alarm data to the alarm generation unit 6c, and the control unit 6k reads alarm condition data from the alarm condition storage unit 6i. The control section 6k outputs this alarm condition data to the alarm generation section 6c. As a result, the alarm generator 6c generates an alarm sound corresponding to the alarm A to the driver M.

In S140, the control unit 6k instructs the localization reaction detection unit 6f to detect whether or not the driver M has a localization reaction. The control section 6k reads physiological index data from the physiological index data storage section 6e, and outputs this physiological index data to the localization reaction detection section 6f. As a result, based on the physiological index data before the presentation of the alarm A and the physiological index data immediately after the presentation of the alarm _A , as shown in FIG _. The localization reaction detection unit 6f detects whether or not the driver M has a localization reaction. For example, the localization reaction detection unit 6f detects the heart rate decrease rate of the driver M, and determines whether or not the driver M has a localization reaction. When the localization reaction detection unit 6f determines that there is a localization reaction of the driver M, the process returns to S120, and when the control unit 6k determines that an alarm command signal has been input in S120, the same warning A is presented again in S130. On the other hand, when the localization reaction detection unit 6f determines that there is no localization reaction from the driver M, the process advances to S150.

In S150, the alarm change command section 6g instructs the alarm generation section 6c to change the alarm A. When the localization reaction detection section 6f does not detect the localization reaction of the driver M, the localization reaction detection section 6f outputs a localization reaction detection signal to the control section 6k so that the alarm generated by the alarm generation section 6c is changed. The control unit 6k issues a command to the alarm change command unit 6g. The control unit 6k reads alarm data from the alarm data storage unit 6d, and outputs this alarm data to the alarm generation unit 6c, and the control unit 6k reads alarm condition data from the alarm condition storage unit 6i. The control section 6k outputs this alarm condition data to the alarm generation section 6c. For example, when the alarm change command unit 6g instructs the alarm generation unit 6c to change the alarm, the order in which three types of alarms A to C are generated is determined based on the alarm data and alarm condition data each time an alarm command signal is input. The alarm generation unit 6c determines. As a result, the alarm change command unit 6g instructs the alarm generation unit 6c to change the alarm A to alarm B and issue the alarm.

In S160, the control section 6k instructs the alarm generation section 6c to present the alarm B. As a result, the alarm generator 6c presents the driver M with an alarm sound corresponding to the alarm B instead of the alarm A. In S170, the control unit 6k instructs the localization reaction detection unit 6f to detect whether or not the driver M has a localization reaction. When the localization reaction detection section 6f determines that there is a localization reaction of the driver M, the process proceeds to S180, and when the localization reaction detection section 6f determines that there is no localization reaction of the driver M, the process proceeds to S190. In S180, the control unit 6k determines whether an alarm command signal has been input. When the control unit 6k determines that the alarm command signal has been input, the process returns to S160, and the same alarm B is presented again in S160. On the other hand, when the control unit 6k determines that the alarm command signal is not input, the control unit 6k repeats the determination in S160 until the alarm command signal is input.

In S190, the alarm change command section 6g instructs the alarm generation section 6c to change the alarm B. As a result, the alarm change command section 6g instructs the alarm generating section 6c to change the alarm B to the alarm C and issue the alarm. In S200, the control section 6k instructs the alarm generating section 6c to present the alarm C. As a result, the alarm generator 6c presents an alarm sound corresponding to alarm C to the driver M instead of alarm B. In S210, the control unit 6k instructs the localization reaction detection unit 6f to detect whether or not the driver M has a localization reaction. When the localization reaction detection unit 6f determines that there is a localization reaction from the driver M, the process proceeds to S220, and when the localization reaction detection unit 6f determines that there is no localization reaction from the driver M, the control unit 6k executes a series of warning presentation processes. finish. In S220, the control unit 6k determines whether an alarm command signal has been input. When the control unit 6k determines that the alarm command signal has been input, the process returns to S200, and the same alarm C is presented again in S200. On the other hand, when the control unit 6k determines that the alarm command signal is not input, the control unit 6k repeats the determination in S220 until the alarm command signal is input.

The warning presentation method, warning presentation device, and warning presentation program according to the first embodiment of the present invention have the following effects.
(1) In the first embodiment, the alarm generation unit detects the presence or absence of a localization reaction of the driver M in response to an alarm, and changes the alarm to generate it when the localization reaction of the driver M is not detected. Command 6c. Therefore, by presenting a new and different warning to the driver M, it is possible to prompt the driver M to wake up, and prevent the driver M from becoming accustomed to the warning and reducing the driver M's alertness level. Awakening effect can be maintained.

(2) In this first embodiment, when the localization reaction of the driver M is not detected, it is determined that the driver M has become accustomed to the alarm, and the alarm is changed to generate an alarm. A command is given to the generating section 6c. As a result, in order to cope with the habituation of each driver M to warnings, the localization reaction of the driver M is measured, and when this localization reaction exceeds a certain threshold, the localization reaction to the warning is determined. can be determined to have disappeared. Therefore, by automatically issuing a new alarm, it is possible to maintain the initial awakening effect or to encourage the return of the awakening effect.

(3) In the first embodiment, the alarm generating unit 6c detects whether there is a temporary decrease in the heart rate of the driver M immediately after generating the alarm sound, and detects whether or not the heart rate of the driver M is temporarily decreased. If not detected, the alarm generation unit 6c is instructed to generate a different alarm sound. For this reason, for example, when the drowsiness of the driver M is detected during the operation of a railway vehicle and a warning sound is presented to the driver M, the sounding sound may become accustomed to the driver M by repeating the sound many times, reducing the wakefulness effect. When indicated by physiological indicators, the initial arousal effect can be maintained by presenting a new alarm sound.

(Second embodiment)
In the following, parts that are the same as those shown in FIGS. 1 to 6 are given the same numbers and detailed explanations will be omitted.
In the second embodiment, unlike the first embodiment, the presence or absence of a localization reaction of the driver M is detected based on the driver M's pulse, and an alarm is issued when the localization reaction of the driver M is not detected. Change and occur. The physiological index measuring device 5 shown in FIG. 2 measures the pulse of the driver M as a physiological index. The physiological index measuring device 5 is, for example, a wristwatch-type biosignal acquisition device that is attached to a mass control handle that is manually operated by the driver M while driving and measures the pulse of the driver M. The physiological index measuring device 5 outputs the measured pulse of the driver M to the warning presentation device 6 as physiological index data.

The warning presentation device 6 detects the presence or absence of a localization reaction of the driver M based on the driver's M pulse, and when the localization reaction of the driver M is not detected, a warning is changed and generated. Here, a pulse is a beat that occurs in an artery when the heart pumps blood. The physiological index data storage unit 6e stores, for example, the driver M's pulse in a chronologically updatable manner in correspondence with time. The localization reaction detection section 6f detects the presence or absence of a temporary decrease in the pulse rate of the driver M immediately after the alarm generation section 6c generates the alarm sound. The localization reaction detection unit 6f determines that there is a localization reaction when the pulse rate decreases immediately after presentation of the alarm, and determines that there is no localization reaction when the pulse rate does not change or increases immediately after presentation of the alarm. The alarm change command section 6g instructs the alarm generation section 6c to change the alarm sound and generate it when the localization reaction detection section 6f does not detect a temporary decrease in the pulse of the driver M.

The warning presentation method, warning presentation device, and warning presentation program according to the second embodiment of the present invention have the following effects in addition to the effects of the first embodiment.
In the first embodiment, the alarm generation unit 6c detects whether there is a temporary decrease in the pulse rate of the driver M immediately after generating the alarm sound, and no temporary decrease in the pulse rate of the driver M is detected. Sometimes, the controller 6c instructs the alarm generator 6c to generate a different alarm sound. Therefore, by measuring the pulse rate, which has a high correlation with the heart rate, it is possible to detect a decrease in the wakefulness effect and maintain the initial wakefulness effect by presenting a new alarm sound.

(Third embodiment)
In the third embodiment, unlike the first and second embodiments, the presence or absence of the localization reaction of the driver M is detected based on the electrodermal activity of the driver M, and the localization reaction of the driver M is detected. If it is not detected, the alarm will be changed and generated. Here, Electro Dermal Activity (EDA) is electrical activity induced from an electrode attached to the area of mental sweating. Electrodermal activity generally occurs when the electrical phenomenon caused by the activity of eccrine sweat glands is decorated by the conditions of the skin and sweat gland ducts. Electrodermal activity includes skin conductance response (SCR), which is the electrical conductivity of the skin, and skin potential activity (SPA), which is the electrical potential difference of the skin.

The physiological index measuring device 5 shown in FIG. 2 measures the electrodermal activity of the driver M as a physiological index. The physiological index measuring device 5 is, for example, a biological signal acquisition device that is attached to the skin of the driver M and measures the electrical resistance or potential difference (absolute value of skin potential) between two points on the skin of the driver M as electrodermal activity. It is. The physiological index measuring device 5 outputs the measured electrodermal activity of the driver M to the warning presentation device 6 as physiological index data.

The warning presentation device 6 detects the presence or absence of the driver M's localization reaction based on the driver's M electrodermal activity, and changes the warning to generate when the driver M's localization reaction is not detected. The physiological index data storage unit 6e stores, for example, the electrodermal activity of the driver M in a chronologically updatable manner in correspondence with time. The localization reaction detection unit 6f detects whether there is a temporary increase in the electrodermal activity of the driver M immediately after the alarm generation unit 6c generates the alarm sound. The localization reaction detection unit 6f determines that there is a localization reaction when the electrodermal activity increases immediately after the warning is presented, and determines that there is no localization reaction when the electrodermal activity does not change or decreases immediately after the warning is presented. When the localization reaction detection section 6f does not detect a temporary increase in the electrodermal activity of the driver M, the alarm change command section 6g instructs the alarm generation section 6c to change the alarm sound and generate it.

The warning presentation method, warning presentation device, and warning presentation program according to the third embodiment of the present invention have the following effects in addition to the effects of the first embodiment.
In the first embodiment, the alarm generation unit 6c detects whether there is a temporary increase in the electrodermal activity of the driver M immediately after generating the alarm sound, and detects whether there is a temporary increase in the electrodermal activity of the driver M. If no alarm is detected, the alarm generator 6c is instructed to generate a different alarm sound. Therefore, by measuring the electrodermal activity that appears as a localization response, it is possible to detect a decrease in the arousal effect and maintain the initial arousal effect by presenting a new alarm sound.

(Fourth embodiment)
In this fourth embodiment, unlike the first to third embodiments, the presence or absence of a localization reaction of the driver M is detected based on the skin temperature of the driver M, and the localization reaction of the driver M is detected. If not, the alarm will be changed and generated. The physiological index measuring device 5 shown in FIG. 2 measures the skin temperature of the driver M as a physiological index. The physiological index measuring device 5 is, for example, a biological signal acquisition device that is attached to the skin of the driver M or measures the peripheral skin temperature of the driver M in a non-contact manner at a distance from the driver M. The physiological index measuring device 5 outputs the measured skin temperature of the driver M to the warning presentation device 6 as physiological index data.

The warning presentation device 6 detects the presence or absence of a localization reaction of the driver M based on the skin temperature of the driver M, and changes the warning to generate when the localization reaction of the driver M is not detected. The physiological index data storage unit 6e stores, for example, the skin temperature of the driver M in a chronologically updatable manner in correspondence with time. The localization reaction detection section 6f detects whether there is a temporary decrease in the skin temperature of the driver M immediately after the alarm generation section 6c generates the alarm sound. The localization reaction detection unit 6f determines that there is a localization reaction when the skin temperature decreases immediately after the presentation of the alarm, and determines that there is no localization reaction when the skin temperature does not change or increases immediately after the presentation of the warning. When the localization reaction detection section 6f does not detect a temporary decrease in the skin temperature of the driver M, the alarm change command section 6g instructs the alarm generation section 6c to change the alarm sound and generate it.

The warning presentation method, warning presentation device, and warning presentation program according to the fourth embodiment of the present invention have the following effects in addition to the effects of the first embodiment.
In the fourth embodiment, the alarm generation unit 6c detects whether or not there is a temporary decrease in the skin temperature of the driver M immediately after generating the alarm sound, and the temporary decrease in the skin temperature of the driver M is detected. If there is no alarm, the alarm generator 6c is instructed to generate a different alarm sound. For this reason, for example, by measuring the peripheral skin temperature that decreases due to vasoconstriction when there is a localization response such as the driver's nose, we can detect a decrease in the arousal effect and present a new alarm sound. The awakening effect can be maintained.

(Fifth embodiment)
In the fifth embodiment, unlike the first to fourth embodiments, the presence or absence of the localization reaction of the driver M is detected based on the characteristic brain waves of the driver M, and the localization reaction of the driver M is detected. When the alarm is not detected, the alarm is changed and generated. Here, an electroencephalogram (EEG) is a signal that records potential changes that occur with the activity of brain nerve cells. A characteristic electroencephalogram is, for example, a P200 component or a P300 component that represents a positive voltage shift 200 to 300 milliseconds after stimulus presentation.

The physiological index measuring device 5 shown in FIG. 2 measures characteristic brain waves of the driver M as a physiological index. The physiological index measuring device 5 is, for example, a biological signal acquisition device such as an electroencephalograph that is attached to the head of the driver M and measures the brain waves of the driver M. The physiological index measuring device 5 outputs the characteristic brain waves of the driver M after measurement to the warning presentation device 6 as physiological index data.

The warning presenting device 6 detects the presence or absence of a localization reaction of the driver M based on the characteristic brain waves of the driver M, and changes and generates an alarm when the localization reaction of the driver M is not detected. The physiological index data storage unit 6e stores, for example, the brain waves of the driver M in an updatable manner in chronological order in correspondence with time. The localization reaction detection unit 6f detects the presence or absence of a characteristic temporary increase in brain waves that occurs in the driver M immediately after the alarm generation unit 6c generates the alarm sound. The localization reaction detection unit 6f determines that there is a localization reaction when the characteristic brain waves that appear immediately after the presentation of the alarm increases, and determines that there is no localization reaction when the characteristic brain waves that occur immediately after the presentation of the warning do not increase. . The alarm change command section 6g instructs the alarm generation section 6c to change the alarm sound when the localization reaction detection section 6f does not detect a temporary increase in characteristic brain waves occurring in the driver M. command.

The warning presentation method, warning presentation device, and warning presentation program according to the fifth embodiment of the present invention have the following effects in addition to the effects of the first embodiment.
In the fifth embodiment, the alarm generating unit 6c detects the presence or absence of a temporary increase in the characteristic brain waves appearing in the driver M immediately after generating the alarm sound, and detects the presence or absence of a temporary increase in the characteristic brain waves appearing in the driver M. If no temporary increase in the alarm is detected, the alarm generator 6c is instructed to generate a different alarm sound. Therefore, it is possible to detect a decrease in the arousal effect by measuring the characteristic brain waves that are significantly expressed when there is a localization response, and to maintain the initial arousal effect by presenting a new alarm sound. can.

(Other embodiments)
This invention is not limited to the embodiments described above, and various modifications and changes can be made as described below, and these are also within the scope of this invention.
(1) In this embodiment, the case where the person to be warned is the driver M has been described as an example, but the present invention can also be applied to the case where the person to be warned is the conductor. Further, in this embodiment, the case where the person to be warned is a crew member of a railway vehicle has been described as an example, but the present invention can also be applied to a case where a person to be warned is a crew member of a transportation means such as a car, an airplane, or a ship. can be applied. Further, in this embodiment, the present invention can be applied to a case where the alert target is a worker who operates a machine, an instrument, or a device used in a plant, factory, construction site, or the like.

(2) In this embodiment, the case where the alertness level of the driver M is estimated and the alarm command signal is output has been explained as an example, but a threshold value is set for each driver M and The present invention can also be applied to a case where an alarm command signal is output depending on the degree of wakefulness. In this case, a warning may be presented to the driver M after the level of alertness becomes high, a warning may be presented to the driver M when the level of alertness is low, or a warning may be issued depending on the level of alertness of each driver M. can be presented. Furthermore, in this embodiment, the case where heart rate, pulse, electrodermal activity, skin temperature, or characteristic brain waves are measured as physiological indicators has been described as an example, but other physiological indicators other than these physiological indicators can also be measured. The present invention can also be applied to the case of measurement.

(3) In this embodiment, the case where the presence or absence of a localization response is detected based on the rate of decrease in heart rate has been described as an example, but The present invention can also be applied to the case of detecting the presence or absence of a localization reaction. In this case, it can be determined that there is a localization response when the heart rate change rate decreases to a value below 100%, and that there is no localization response when the heart rate change rate increases to a value of 100% or more. Further, in this embodiment, the case where the alarm presentation device 6 is provided with the alarm generation section 6c has been described as an example, but an alarm generation device is provided separately from the alarm presentation device 6, and the alarm presentation device 6 generates an alarm. The present invention can also be applied to the case of instructing the device to change the alarm.

(4) In this embodiment, the case where the alarm generation unit 6c generates an alarm that the driver M can recognize through hearing has been described as an example, but the alarm that the driver M can recognize through sight or smell etc. The present invention can also be applied to the case where the alarm generation section 6c generates an alarm. For example, although the case where the alarm generating section 6c generates a plurality of alarm sounds has been described as an example, the present invention can also be applied to a case where the alarm generating section 6c generates a plurality of odors or a plurality of displays in addition to the alarm sound. Can be applied. Further, in this embodiment, the case where three types of alarms A to C are presented is explained as an example, but the present invention can also be applied to the case where two or four or more types of alarms are presented. .

(5) In this embodiment, the case where the alarm is changed and presented after detecting the presence or absence of a localization response based on whether or not the threshold has been exceeded has been described as an example, but each time the alarm is changed and presented. The present invention can also be applied to the case where the presence or absence of a localization reaction is detected by changing the threshold value. Further, in this embodiment, the case where a series of alarm presentation processes is terminated when there is no localization response after presentation of alarm C has been described as an example, but the present invention is not limited to such alarm presentation processing. do not have. For example, if there is no localization response after presenting warning C, the series of warning presentation processes may be repeated by returning to presenting warning A, or if no arousal effect is observed even after presenting warning C, driver M's The present invention can also be applied to cases where the status is notified to a driving command center or the like.

1 Arousal level decline prevention support system 2 Photographic device 3 Face detection device 4 Arousal degree estimation device 5 Physiological index measuring device 6 Alarm presentation device 6c Alarm generation section 6f Orientation reaction detection section 6g Alarm change command section 6k Control section M Driver (alarm Target audience)
T ₁ Alarm presentation time T ₂ Localization reaction detection end time ΔT Predetermined time

Claims (9)

An alarm presentation method for presenting a warning to a person to be alerted by an alarm generation unit that generates an alarm when a decrease in alertness level of the person to be alerted is detected,
a localization reaction detection step of detecting the presence or absence of a localization reaction of the alarm target person in response to the alarm;
an alarm change command step of instructing the alarm generation unit to change the alarm and generate it when the localization reaction of the person to be alarmed is not detected in the localization reaction detection step;
Alarm presentation method including. In the warning presentation method according to claim 1,
In the alarm change command step, when the localization reaction of the alarm target person is not detected, it is determined that the alarm target person is in a state of being accustomed to the alarm, and the alarm is changed and the alarm is issued. Includes a process for issuing commands to the alarm generating unit;
A warning presentation method characterized by: In the warning presentation method according to claim 1 or 2,
The localization reaction detection step includes a step of detecting the presence or absence of a temporary decrease in the heart rate of the person to be alerted immediately after the alarm generation unit generates the alarm sound,
The alarm change commanding step instructs the alarm generating unit to change the alarm sound and generate it when a temporary decrease in the heart rate of the alarm subject is not detected in the localization reaction detection step. including the process;
A warning presentation method characterized by: In the warning presentation method according to claim 1 or 2,
The localization reaction detection step includes a step of detecting the presence or absence of a temporary decrease in the pulse rate of the alarm subject immediately after the alarm generation unit generates the alarm sound,
The alarm change command step is a step of instructing the alarm generator to change the alarm sound and generate it when a temporary decrease in the pulse of the alarm subject is not detected in the localization reaction detection step. including;
A warning presentation method characterized by: In the warning presentation method according to claim 1 or 2,
The stereotactic reaction detection step includes a step of detecting the presence or absence of a temporary increase in electrodermal activity of the alarm subject immediately after the alarm generation unit generates the alarm sound,
The alarm change commanding step instructs the alarm generator to change the alarm sound and generate it when a temporary increase in electrodermal activity of the alarm subject is not detected in the localization reaction detection step. including the process of
A warning presentation method characterized by: In the warning presentation method according to claim 1 or 2,
The localization reaction detection step includes a step of detecting the presence or absence of a temporary decrease in the skin temperature of the alarm subject immediately after the alarm generation unit generates the alarm sound,
The alarm change commanding step instructs the alarm generator to change the alarm sound and generate it when a temporary decrease in the skin temperature of the alarm subject is not detected in the localization reaction detection step. including the process;
A warning presentation method characterized by: In the warning presentation method according to claim 1 or 2,
The localization reaction detection step includes a step of detecting the presence or absence of a characteristic increase in brain waves occurring in the alarm subject immediately after the alarm generation unit generates the alarm sound,
The alarm change commanding step instructs the alarm generation unit to change the alarm sound and generate it when a characteristic increase in brain waves occurring in the alarm subject is not detected in the localization reaction detection step. including the process of
A warning presentation method characterized by: An alarm presentation device that presents a warning to a person to be alerted by an alarm generation unit that generates an alarm when a decrease in alertness level of the person to be alerted is detected,
a localization reaction detection unit that detects the presence or absence of a localization reaction of the alarm target person in response to the alarm;
an alarm change command section that instructs the alarm generation section to change the alarm and issue the alarm when the localization reaction detection section does not detect a localization response of the person to be alerted;
An alarm presentation device comprising: An alarm presentation program for presenting a warning to a person to be alerted by an alarm generation unit that generates an alarm when a decrease in alertness of the person to be alerted is detected,
a localization reaction detection procedure for detecting the presence or absence of a localization reaction of the alarm target person in response to the alarm;
an alarm change command procedure for instructing the alarm generation unit to change the alarm and generate it when the localization reaction of the person to be alarmed is not detected in the localization reaction detection procedure;
An alarm presentation program that causes a computer to execute the following.

Images