JP2020021147A - Portable terminal device, information processing method, and program - Google Patents

Abstract

To provide a portable terminal device capable of generating a notification to prompt generation of a stimulus at a time appropriate for awakening a driver.SOLUTION: A portable terminal device 30 is provided, comprising: biological information acquisition means BS for acquiring biological information of a user; transmission means 44 configured to transmit the biological information and a first threshold to a stimulus control device configured to start assistance for awakening the user when a numerical value generated based on the biological information of the user exceeds the first threshold; and storage means 43 configured to store the first threshold. Such an arrangement allows for urging the driver to use a vibration generator using the first threshold unique to the owner of the portable terminal device 30 even if the owner of the portable terminal device 30 switches to another automobile. In other words, the arrangement allows for urging the use of the vibration generator based on the unique first threshold regardless of a vehicle the driver is on.SELECTED DRAWING: Figure 11

Description

  The present invention relates to a mobile terminal device, an emotion processing method, and a program.

  2. Description of the Related Art There is known an awakening support device that supports the awakening of a driver by emitting a warning sound or the like in order to prevent a driver of an automobile from falling asleep.

  Such a wake-up support device asks the driver whether he / she wants wake-up support when the driver's drowsiness level reaches a criterion, and provides wake-up support when he / she wants to get wake-up support. A support device is disclosed in Patent Document 1.

Japanese Patent No. 5375571

  In the awakening support device of Patent Literature 1, as the time from asking the driver whether to start the support of awakening to obtaining an answer is shorter, the drowsiness degree reference to ask the driver is set lower. Is disclosed. However, the time required for a driver to answer a question depends on various circumstances.

  For example, when the degree of sleepiness of the driver is strong, the driver may not notice the question of the awakening support device. For this reason, the problem that the driver cannot be stimulated at an appropriate timing can be cited as an example of the problem.

  SUMMARY An advantage of some aspects of the invention is to provide a mobile terminal device that can provide a stimulus at an appropriate timing for awakening a user.

  The portable terminal device according to claim 1 of the present application is a biometric information acquisition unit configured to acquire biometric information of a user, wherein the biometric information acquisition unit acquires the biometric information of the user when a value generated based on the biometric information exceeds a first threshold. The stimulus control device that starts supporting the awakening of a person includes a transmission unit that transmits the biological information and the first threshold value, and a storage unit that stores the first threshold value.

  An information processing method according to claim 8 of the present application is an information processing method executed by a portable terminal device, wherein when a numerical value generated based on biological information of a user exceeds a first threshold value, the user wakes up Storing the first threshold value of the stimulus control device that starts the support of the user, acquiring the biological information of the user, and transmitting the biological information and the first threshold value to the stimulus control device. And the step of performing

  The program according to claim 9, wherein the computer has a first control unit of the stimulus control device that starts supporting the user's awakening when a numerical value generated based on the biological information of the user exceeds a first threshold value. Storing the biological information of the user, and transmitting the biological information and the first threshold value to the stimulus control device. .

  The recording medium according to claim 10 of the present application is configured such that when a numerical value generated based on the biological information of the user exceeds a first threshold value, the stimulus control device of the stimulus control device that starts awakening of the user is activated. Storing a first threshold value, acquiring the biological information of the user, and transmitting the biological information and the first threshold value to the stimulus control device. It is recorded.

FIG. 2 is a functional block diagram of the stimulus control device according to the first embodiment. FIG. 4 is an explanatory diagram illustrating an example of a table of a threshold DB stored in a storage unit. FIG. 2 is an explanatory diagram illustrating a display mode of the display device in FIG. 1. FIG. 2 is an explanatory diagram illustrating a display mode of the display device in FIG. 1. FIG. 2 is an explanatory diagram illustrating a display mode of the display device in FIG. 1. FIG. 4 is a flowchart illustrating a process performed by the stimulus control device according to the first embodiment. FIG. 9 is a flowchart illustrating a process performed by the stimulus control device according to the second embodiment. FIG. 4 is an explanatory diagram illustrating an example of a table of a threshold DB stored in a storage unit. FIG. 4 is an explanatory diagram illustrating an example of a table of a threshold DB stored in a storage unit. FIG. 14 is a flowchart illustrating a process performed by the stimulus control device according to the fourth embodiment. FIG. 14 is a flowchart illustrating a process performed by the stimulus control device according to the fourth embodiment. FIG. 14 is a block diagram illustrating a configuration of a stimulus control device according to a fifth embodiment. FIG. 14 is a block diagram illustrating a configuration of a portable terminal device connected to a stimulus control device according to a fifth embodiment. FIG. 19 is a flowchart illustrating processing by the mobile terminal device according to the fifth embodiment. FIG. 13 is a flowchart illustrating a process performed by the stimulus control device according to the fifth embodiment. FIG. 13 is a flowchart illustrating a process performed by the stimulus control device according to the fifth embodiment.

  Hereinafter, the stimulus control device 10 according to the first embodiment will be described. The stimulus control device 10 is mounted on a moving body such as an automobile. The moving object may be a moving object other than an automobile, such as a bicycle, a motorcycle, an airplane, or the like. In the present embodiment, a case will be described in which a stimulus control device is mounted on an automobile, which is an example of a moving object.

  FIG. 1 illustrates functional blocks of a stimulus control device 10 according to the first embodiment. As shown in FIG. 1, the input unit 20 is an interface unit connected so as to be able to acquire data from the biological sensor BS and the display input device DS. The stimulus control device 10 receives data from the biological sensor BS and the display input device DS via the input unit 20.

  The biological sensor BS is a driver that drives a car, that is, a sensor that acquires biological information of a user. The biological sensor BS is communicably connected to the stimulus control device 10 by wire or wirelessly. Examples of the biological information include a driver's body temperature, a pulse per predetermined time, a blood pressure, a respiratory rate per predetermined time, a number of blinks per predetermined time, and a number of yawns per predetermined time.

  The biological sensor BS is any device that measures such biological information. For example, when measuring the pulse of the driver, the biological sensor BS is a pulse meter having a pulse measurement function. When measuring the blood pressure of the driver, the biological sensor BS is a sphygmomanometer having a blood pressure measurement function. When measuring the respiratory rate of the driver, the biological sensor BS is a measuring device that measures the vertical movement of the driver's chest wall captured by a camera. When measuring the number of blinks of the driver, the biological sensor BS is a measuring device that measures the vertical movement of the driver's eyelids, which is captured by a camera. These devices may be devices provided in a car or a wearable computer worn by a driver.

  The display input device DS is a touch panel display that allows a driver to input arbitrary information to the stimulus control device 10. Specifically, for example, it is a touch panel monitor in which a display such as a liquid crystal display capable of displaying an image and a touch pad are combined. The display input device DS only needs to be disposed at a place where the display input device DS can be visually recognized by the driver and is accessible to the driver. The display input device DS may be provided, for example, on a center console of an automobile.

  The vibration generating device VB is a vibrator that applies vibration that is a stimulus that urges the driver to wake up in response to an instruction from the stimulus control device 10. That is, the vibration generation device VB functions as a stimulating unit that prompts the driver to wake up. The vibration generator VB may be provided at a place where vibration can be given to the driver. The display input device DS may be built in the driver's seat of the vehicle, and may apply vibration to the seat surface of the driver's seat. Further, the display input device DS may be built in a steering wheel of an automobile to apply vibration to the steering wheel.

  The output unit 22 is an interface unit connected to the vibration generator VB. The stimulation control device 10 can control the start and stop of the vibration of the vibration generator VB via the output unit 22.

  The storage device 23 includes, for example, a hard disk device, an SSD (Solid State Drive), a flash memory, and the like. The storage device 23 stores various programs such as a basic input output system (BIOS) and software.

  Also, a first threshold value (hereinafter, referred to as a first threshold value) that is a threshold value of a driver's drowsiness level that provides information for generating information about a driver's drowsiness level from biological information and a notification that prompts use of the vibration generator VB. Can be stored. Specifically, the storage device 23 can store a threshold DB (Data Base) in which the first threshold is recorded for each driver.

  The control unit 24 is realized by a computer having a CPU (Central Processing Unit) 24a as an arithmetic processing device, a ROM (Read Only Memory) 24b as a main storage device, and a RAM (Random Access Memory) 24c. The CPU 24a reads a program corresponding to the processing content from the ROM 24b or the storage device 23, loads the program on the RAM 24c, and realizes various functions in cooperation with the loaded program.

  The input unit 20, the output unit 22, the storage device 23, and the control unit 24 are connected to each other via a system bus 25.

  The control unit 24 can acquire the biological information of the driver received via the input unit 20. The control unit 24 can obtain a stimulus stop instruction from the driver to the vibration generator VB. Specifically, the control unit 24 can acquire a stop instruction input from the display input device DS via the input unit 20.

  The control unit 24 can generate a value such as a numerical value based on the biological information received via the input unit 20. Specifically, the control unit 24 can generate a numerical value related to the degree of drowsiness of the driver based on the biological information of the driver. Hereinafter, the numerical value generated by the control unit 24 is simply referred to as a drowsiness degree value.

  The control unit 24 can notify the driver when the drowsiness degree value exceeds the first threshold value. The control unit 24 performs, for example, a display prompting the use of the vibration generator VB on the display input device DS. The notification by the control unit 24 is not limited to the display on the display input device DS. For example, the control unit 24 outputs a voice prompting use of the vibration generation device VB from a speaker (not shown) mounted on the automobile. Is also good.

  The control unit 24 can instruct the vibration generator VB to start stimulation. Specifically, the control unit 24 transmits a signal for instructing start of stimulation to the vibration generation device VB via the output unit 22 in response to an input operation of the display input device DS by the driver.

  The control unit 24 can set the first threshold based on the drowsiness degree value of the driver at the time of acquiring the stop instruction. Specifically, the control unit 24 is stored in the storage device 23 based on the drowsiness degree value obtained when the stop instruction information for stopping the vibration of the vibration generation device VB input by the display input device DS is obtained. The first threshold stored in the threshold DB is updated and set.

  The control unit 24 can specify one driver from a plurality of drivers. That is, the control unit 24 sets the first threshold value for each driver based on the drowsiness degree value at the time of acquiring the stop instruction.

  FIG. 2 shows an example of a table of the threshold DB stored in the storage device 23. When the drowsiness degree value of the driver of the vehicle exceeds the first threshold value, the control unit 24 notifies the user of the use of the vibration generator VB. As shown in FIG. 2, as the first threshold value of the initial setting (initial value), the drowsiness degree value of the driver is set to “6”. In this embodiment and the following embodiments, the drowsiness degree value is a numerical value in ten steps. As the drowsiness degree value approaches "10", the awake state of the driver is in a lower state. The driver's awake state is in a higher state as the drowsiness degree value approaches "1".

  When the driver performs an operation to stop the vibration of the vibration generator VB, the control unit 24 receives a stop instruction. The control unit 24 sets the first threshold based on the drowsiness degree value at the time of receiving the stop instruction.

  For example, when the first threshold value is set to “6” and the assumed drowsiness degree value at the time of acquiring the stop instruction is “3”, the control unit 24 sets the setting when the expected result is obtained. Make settings to maintain the status.

  When the drowsiness degree value of the driver at the time of obtaining the stop instruction is “5” or “4”, the driver is considered to be more awake than the assumed state. That is, the drowsiness degree value generated based on the biological information is generated with a numerical value higher than the actual driver state. In this case, the control unit 24 sets the first threshold to be higher. Specifically, when the drowsiness degree value at the time of acquiring the stop instruction is “5”, the control unit 24 sets the first threshold value to “8”. When the drowsiness degree value at the time of acquisition of the stop instruction is “4”, the control unit 24 sets the first threshold value to “7”.

  Furthermore, when the drowsiness degree value of the driver at the time of acquisition of the stop instruction is “1” or “2”, the driver is considered to be in a state of being more drowsy than the assumed state. That is, the drowsiness degree value generated based on the biological information is generated with a numerical value lower than the actual driver state. In this case, the control unit 24 sets the first threshold value to be low. Specifically, when the drowsiness degree value at the time of acquiring the stop instruction is “1”, the control unit 24 sets the first threshold value to “4”. When the drowsiness degree value at the time of acquiring the stop instruction is “2”, the control unit 24 sets the first threshold value to “5”.

  Note that the control unit 24 sets a first threshold for generating vibration of the vibration generator VB for each driver. The identification of the driver is not particularly limited. For example, the driver may be identified by biometric authentication for identifying an individual by reading a fingerprint or a vein pattern. The specification of the driver may be performed, for example, by reading a storage medium storing the information of the driver. Specifically, driver information may be read from an IC (integrated circuit) chip embedded in the card. Alternatively, one or more drivers may be stored in the storage device 23 in advance, and the information on the registered driver may be read from the storage device 23 by the user operating the display input device DS.

  FIG. 3 shows a display mode of the display input device DS. FIG. 3A shows a display mode of the display input device DS at the start of driving of the vehicle, that is, when the drowsiness degree value of the driver does not exceed the first threshold value.

  As shown in FIG. 3A, the display input device DS includes a state display region VR indicating the vibration state of the vibration generator VB, a switching region SR for operating the switching of generation or stop of the vibration of the vibration generator VB, An adjustment area AR for adjusting the intensity of vibration of the generator VB and a biological information area BR for displaying a drowsiness degree value and a heart rate of the driver are shown.

  In FIG. 3A, for example, "refresh", which is an operation button for starting the vibration of the vibration generator VB, is displayed in the switching region SR in a white character color on a blue background. In the state display area VR, "vibration" indicating the vibration state of the vibration generator VB is displayed in a white background on a blue background. In the adjustment area AR, "down" which is an operation button for weakening the vibration of the vibration generator VB and "up" which is an operation button for increasing the vibration of the vibration generator VB are displayed in a white character color on a blue background. I have.

  FIG. 3B shows a display mode of the display input device DS when the drowsiness degree value of the driver exceeds the first threshold value. As shown in FIG. 3B, when the drowsiness degree value of the driver exceeds the first threshold value, the control unit 24 performs a display urging the driver to use the vibration generator VB. For example, the switching area SR is displayed as “refresh” in a black character color on an orange background color, for example. Further, the state display area VR and the adjustment area AR are displayed in the same manner as in the case of FIG. 3A, that is, displayed in a white background with a blue background color. As described above, the switching area SR is displayed so as to be more prominent than the state display area VR and the adjustment area AR.

  FIG. 3C shows a display mode of the display input device DS when the vibration of the vibration generator VB is generated. As shown in FIG. 3C, when the vibration generating device VB is vibrating, the switching region SR is displayed in the same manner as in the case of FIG. 3B, that is, displayed in a black character color on an orange background color. . Further, in the state display area VR, for example, "vibration" is displayed in a black character color on a green background color to indicate that the vibration generator VB is vibrating. The adjustment area AR is displayed in the same manner as in FIG. 3A, that is, in a white background with a blue background color.

  FIG. 4 shows a processing flow of the control unit 24. The control unit 24 starts the process with, for example, an engine start of the automobile as a trigger. As shown in FIG. 4, the control unit 24 acquires biological information from the biological sensor BS (Step S101). In step S101, the control unit 24 functions as a biological information acquisition unit.

  Note that the control unit 24 may acquire the biological information every predetermined time and sequentially store the acquired biological information in the storage device 23.

  The control unit 24 generates a drowsiness degree value based on the biological information acquired in step S101 (step S102). In step S102, the control unit 24 functions as a numerical value generation unit that generates a numerical value based on the biological information.

  The control unit 24 determines whether the drowsiness degree value generated in step S102 exceeds the first threshold value (step S103). When the control unit 24 determines that the drowsiness level value does not exceed the first threshold in the determination of step S103 (step S103: N), the control unit 24 acquires the biological information again (step S101) and generates a drowsiness level value (step S101). In step S102, it is determined whether the generated drowsiness degree value exceeds the first threshold value (step S103).

  In the determination of step S103, when the control unit 24 determines that the drowsiness level value exceeds the first threshold value (step S103: Y), the control unit 24 issues a notification urging the use of the vibration generator VB (step S104). In step S104, the control unit 24 functions as a notification unit that notifies the driver when the drowsiness degree value exceeds the first threshold value. Specifically, the control unit 24 performs a display on the display input device DS to prompt the driver to use the vibration generator VB. For example, the control unit 24 causes the switching area SR of the display input device DS to highlight "refresh" with a black character color on an orange background color.

  When the driver inputs a start instruction to start the vibration of the vibration generating device VB from the display input device DS, the start instruction is transmitted from the display input device DS.

  The control unit 24 determines whether there is a start instruction transmitted from the display input device DS within a predetermined time (step S105). When the control unit 24 determines that there is no start instruction in the determination of step S105 (step S105: N), the control unit 24 determines whether a predetermined time has elapsed (step S106).

  If the predetermined time has not elapsed in the determination of step 106 (step S106: N), the control unit 24 returns to the process of step S104. If the predetermined time has elapsed in the determination of step 106 (step S106: Y), the control unit 24 ends the process.

  When the driver inputs a stop instruction to stop the vibration of the vibration generating device VB from the display input device DS, the stop instruction is transmitted from the display input device DS.

  When determining in step S105 that there is a start instruction (step S105: Y), the control unit 24 determines whether a stop instruction transmitted from the display input device DS has been acquired (step S107). In step S107, the control unit 24 functions as a stop instruction obtaining unit that obtains a vibration stop instruction for the vibration generator VB.

  When the control unit 24 determines that the stop instruction has been acquired in the determination of step S107 (step S107: Y), the control unit 24 acquires the biological information of the driver at the time of acquiring the stop instruction (step S108), and acquires the biological information acquired in step S108. A drowsiness degree value is generated based on the information (step S109).

  The control unit 24 sets a first threshold based on the drowsiness degree value generated in step S109 (step S110). In step S110, the control unit 24 functions as a setting unit that sets the first threshold based on the drowsiness degree value when the stop instruction is acquired.

  The determination in step S107 is repeated until a stop instruction is obtained (step S107: N). The processing of the control unit 24 described above is repeated until, for example, the engine of the automobile stops.

  The drowsiness degree value generated in step S109 may be stored in the storage device 23 each time the drowsiness degree value generation processing in step S109 is performed. In this case, the control unit 24 obtains the drowsiness degree value obtained when the stop instruction is obtained a plurality of times, and sets the first threshold based on the drowsiness degree value obtained over the plurality of times. You may.

  Specifically, for example, the control unit 24 calculates the average value of the drowsiness degree values generated by the four most recent drowsiness degree value generation processes in step S109, and based on the calculated average value, One threshold may be set. Further, for example, the control unit 24 may calculate the average value of all the drowsiness degree values generated in step S109, and set the first threshold based on the calculated average value. Further, for example, the control unit 24 extracts an arbitrary plurality of drowsiness degree values from the drowsiness degree values generated in step S109, calculates an average value, and calculates a first threshold based on the calculated average value. May be set. Further, for example, the control unit 24 may set the first threshold based on the moving average of the drowsiness degree value generated in step S109.

  In this embodiment, the vibration generator VB is used as the stimulating means. However, the stimulating unit is not limited to the vibration generating device, and may be, for example, a speaker that outputs sound. Further, as another stimulating means, an air conditioner mounted on a moving body may be used. For example, the driver may be stimulated by lowering the indoor temperature of the moving body. Alternatively, the driver may be stimulated by blowing cold air from an air conditioner on the driver's face. Further, the driver may be stimulated by outputting a fragrance having a high arousal effect such as mint.

  Further, in the present embodiment, the control unit 24 generates the drowsiness degree value based on the biological information of the driver. When the generated drowsiness degree value exceeds the first threshold value, the control unit 24 notifies the driver to use the vibration generator VB. However, the control unit 24 may notify the driver to use the vibration generation device VB based on the biological information of the driver without generating the drowsiness degree value. For example, the control unit 24 may notify the driver to use the vibration generator VB when numerical values of the driver's heart rate, respiratory rate, blood pressure, and the like exceed threshold values.

  If the driver adjusts the vibration intensity of the vibration generator VB on the way, the first threshold may be set according to the increase or decrease of the vibration intensity. Specifically, when the driver increases the vibration, the first threshold may be increased. Further, when the driver weakens the vibration, the first threshold may be lowered.

  As described above, according to the stimulus control device 10 according to the present embodiment, when the driver performs the stop operation of the vibration generation device VB, that is, based on the drowsiness degree value at the time of acquiring the stop instruction, the driver is notified of the driver. A threshold value of a drowsiness degree value for notifying the user of using the vibration generator VB is set. Therefore, it is possible to prompt the user to generate a stimulus in an appropriate state. Therefore, it is possible to provide a stimulus at an appropriate timing for awakening the user.

  That is, the drowsiness degree value when the stop operation of the vibration generator VB is performed is a state in which the driver is surely awake. It is estimated that the driver's drowsiness level value at this time has little variation and a constant value can be obtained. By setting the first threshold based on such a constant drowsiness degree value, it is possible to generate a stimulus in a state appropriate for the user.

  Second Embodiment A stimulus control device 10 according to a second embodiment will be described. The stimulus control device 10 according to the first embodiment sets the threshold value of the drowsiness level value to be notified to the driver, that is, the first threshold value, based on the drowsiness level value when the stop instruction is acquired. The stimulus control device 10 according to the second embodiment is different from the stimulus control device 10 according to the first embodiment in that the first threshold value is set based on the drowsiness degree value when the driver performs the start operation of the vibration of the vibration generation device VB. different. Note that the same components as those in the first embodiment are denoted by the same reference numerals, and description thereof is omitted. The same applies to the following embodiments.

  The control unit 24 can obtain a vibration start instruction from the driver to the vibration generator VB. Specifically, the control unit 24 can acquire a start instruction input from the display input device DS via the input unit 20.

  The control unit 24 sets a threshold value of the drowsiness level value that prompts the use of the vibration generation apparatus VB based on the drowsiness level value obtained when the driver performs the start operation of the vibration generation apparatus VB, that is, based on the drowsiness level value obtained when the start instruction is acquired. I do.

  FIG. 5 shows a processing flow of the control unit 24. As shown in FIG. 5, the control unit 24 acquires biological information from the biological sensor BS (Step S201), and generates a drowsiness degree value based on the biological information acquired in Step S201 (Step S202).

  The control unit 24 determines whether a start instruction has been acquired (step S203). In step S203, the control unit 24 functions as a start instruction obtaining unit that obtains a vibration start instruction from the driver for the vibration generator VB.

  When the control unit 24 determines that the start instruction has been obtained in the determination of step S203 (step S203: Y), the control unit 24 sets a first threshold based on the biological information at the time of obtaining the start instruction (step S204).

  When the control unit 24 determines that the start instruction has not been acquired in the determination in step S203 (step S203: N), the control unit 24 determines whether the drowsiness degree value generated in step S202 exceeds the first threshold (step S205). ). The subsequent steps S206 to S212 correspond to steps S104 to S110 in FIG.

  As described above, according to the stimulus control device 10 according to the present embodiment, when the driver performs the stop operation of the vibration generation device VB, that is, based on the drowsiness degree value at the time of acquiring the stop instruction, the driver is notified of the driver. A threshold value of a drowsiness degree value for notifying the use of the vibration generator VB, that is, a first threshold value is set. Therefore, it is possible to prompt the user to generate a stimulus in an appropriate state. Therefore, it is possible to provide a stimulus at an appropriate timing for awakening the user.

  Further, a threshold value of the drowsiness level value to be notified to the driver is set based on the drowsiness level value when the driver performs the vibration start operation of the vibration generation device VB, that is, based on the start instruction acquired. That is, according to the stimulus control device 10 according to the present embodiment, it is possible to set the drowsiness degree value when the driver needs assistance in awakening as the first threshold value. Therefore, it is possible to generate a stimulus in a state appropriate for the user.

  Third Embodiment A stimulus control device according to a third embodiment will be described. The stimulus control device 10 according to the first embodiment sets the threshold of the drowsiness level value that notifies the driver to use the vibration generator VB, that is, the first threshold value, based on the drowsiness level value when the stop instruction is acquired. . The stimulus control device 10 according to the fourth embodiment is different from the stimulus control device 10 according to the first embodiment in that the first threshold value is set in consideration of the intensity of the stimulus of the vibration generator VB.

  The control unit 24 can set the first threshold value according to the vibration intensity of the vibration generator VB.

  FIG. 6 shows an example of a table of the threshold DB stored in the storage device 23. When the driver performs an operation to stop the vibration of the vibration generation device VB, the control unit 24 acquires a stop instruction. The control unit 24 sets the first threshold based on the drowsiness degree value at the time of acquiring the stop instruction.

  As shown in FIG. 6, for example, a case where the first threshold is set to “6” will be described. When the stimulus intensity is “medium”, the control unit 24 changes the setting state when the expected result is obtained, that is, when the drowsiness degree value when the stop instruction is received is “3”. Make settings to maintain.

  When the stimulus intensity is “medium” and the sleepiness degree value of the driver at the time of obtaining the stop instruction is “5” or “4”, the driver is considered to be more awake than expected. . That is, the drowsiness degree value generated based on the biological information is generated with a numerical value higher than the actual driver state. In this case, the control unit 24 sets the first threshold to be higher. Specifically, when the drowsiness degree value at the time of acquiring the stop instruction is “5”, the control unit 24 sets the first threshold value to “8”. When the drowsiness degree value at the time of acquisition of the stop instruction is “4”, the control unit 24 sets the first threshold value to “7”.

  Further, when the stimulus intensity is “medium”, and when the drowsiness degree value of the driver at the time of obtaining the stop instruction is “1” or “2”, the driver is in a state where drowsiness is stronger than expected. It is believed that there is. That is, the drowsiness degree value generated based on the biological information is generated with a numerical value lower than the actual driver state. In this case, the control unit 24 sets the first threshold value to be low. Specifically, when the drowsiness degree value at the time of acquiring the stop instruction is “1”, the control unit 24 sets the first threshold value to “4”. When the drowsiness degree value at the time of acquiring the stop instruction is “2”, the control unit 24 sets the first threshold value to “5”.

  When the stimulus intensity is “weak”, the control unit 24 changes the setting state when the expected result is obtained, that is, when the drowsiness degree value when the stop instruction is received is “2”. Make settings to maintain.

  When the stimulus intensity is “weak” and the driver's drowsiness level value at the time of obtaining the stop instruction is “5” to “3”, the driver is considered to be more awake than expected. . That is, the drowsiness degree value generated based on the biological information is generated with a numerical value higher than the actual driver state. In this case, the control unit 24 sets the first threshold to be higher. Specifically, when the drowsiness degree value at the time of acquisition of the stop instruction is “5”, the control unit 24 sets the first threshold value to “9”. When the drowsiness degree value at the time of acquisition of the stop instruction is “4”, the control unit 24 sets the first threshold value to “8”. Furthermore, when the drowsiness degree value at the time of acquisition of the stop instruction is “3”, the control unit 24 sets the first threshold value to “7”.

  When the stimulus intensity is “weak” and the drowsiness degree value of the driver at the time of acquisition of the stop instruction is “1”, the driver is considered to be in a state of being more drowsy than the assumed state. That is, the drowsiness degree value generated based on the biological information is generated with a numerical value lower than the actual driver state. In this case, the control unit 24 sets the first threshold value to be low. Specifically, when the drowsiness degree value at the time of acquiring the stop instruction is “1”, the control unit 24 sets the first threshold value to “5”.

  When the stimulus intensity is “strong”, the control unit 24 changes the setting state when the expected result is obtained, that is, when the drowsiness degree value when the stop instruction is received is “4”. Make settings to maintain.

  When the stimulus intensity is “strong” and the driver's drowsiness level value at the time of acquisition of the stop instruction is “5”, the driver is considered to be more awake than expected. That is, the drowsiness degree value generated based on the biological information is generated with a numerical value higher than the actual driver state. In this case, the control unit 24 sets the first threshold to be higher. Specifically, when the drowsiness degree value at the time of acquiring the stop instruction is “5”, the control unit 24 sets the first threshold value to “7”.

  When the stimulus intensity is “strong” and the driver's drowsiness level value at the time of acquisition of the stop instruction is “1” to “3”, the driver is in a state where drowsiness is stronger than expected. Conceivable. That is, the drowsiness degree value generated based on the biological information is generated with a numerical value lower than the actual driver state. In this case, the control unit 24 sets the first threshold value to be low. Specifically, the control unit 24 sets the first threshold value to “3” when the drowsiness degree value at the time of acquiring the stop instruction is “1”. When the drowsiness degree value at the time of acquisition of the stop instruction is “2”, the control unit 24 sets the first threshold value to “4”. Further, when the drowsiness degree value at the time of acquiring the stop instruction is “3”, the control unit 24 sets the first threshold value to “5”.

  As described above, according to the stimulus control device 10 according to the present embodiment, when the driver performs the stop operation of the vibration generation device VB, that is, based on the drowsiness degree value at the time of acquiring the stop instruction, the driver is notified of the driver. The threshold of the sleepiness degree value to be notified is set. Therefore, it is possible to prompt the user to generate a stimulus in an appropriate state. Therefore, it is possible to provide a stimulus at an appropriate timing for awakening the user.

  Further, the control unit 24 sets a threshold value of the drowsiness degree value to be notified to the driver based on the intensity of the vibration of the vibration generating device VB. For this reason, the control unit 24 can set the first threshold value according to the vibration intensity. Therefore, it is possible to prompt the user to generate a stimulus in an appropriate state. Therefore, it is possible to provide a stimulus at an appropriate timing for awakening the user.

  A stimulus control device 10 according to a fourth embodiment will be described. The stimulus control device 10 according to the first embodiment sets the threshold of the drowsiness level value that notifies the driver to use the vibration generator VB, that is, the first threshold value, based on the drowsiness level value when the stop instruction is acquired. . The stimulus control device 10 according to the fourth embodiment is configured to stop the stimulation of the vibration generation device VB based on the drowsiness level value when the driver performs the stop operation of the vibration generation device VB. Is different from the stimulus control device 10 of the first embodiment in that

  The control unit 24 can instruct the vibration generator VB to stop vibration when the drowsiness degree value of the driver exceeds a second threshold (hereinafter, referred to as a second threshold). That is, the second threshold value is a drowsiness degree value of the driver that stops the stimulation of the vibration generation device VB. The control unit 24 sets the second threshold value according to the drowsiness degree value of the driver at the time of acquiring the stop instruction.

  FIG. 7 shows an example of a table of the threshold DB stored in the storage device 23. When the driver performs an operation to stop the vibration of the vibration generator VB, the control unit 24 receives a stop instruction. The control unit 24 sets the first threshold value and the second threshold value based on the drowsiness degree value at the time of receiving the stop instruction.

  As shown in FIG. 7, for example, a case where the first threshold is set to “6” and the second threshold is set to “3” will be described. When the expected result is obtained, that is, when the drowsiness degree value at the time of receiving the stop instruction is “3”, the control unit 24 performs the setting for maintaining the setting state.

  When the drowsiness degree value of the driver at the time of obtaining the stop instruction is “5” or “4”, the driver is considered to be more awake than the assumed state. That is, the drowsiness degree value generated based on the biological information is generated with a numerical value higher than the actual driver state. In this case, the control unit 24 sets the first threshold and the second threshold to be higher. Specifically, when the drowsiness degree value at the time of obtaining the stop instruction is “5”, the control unit 24 sets the first threshold value to “8” and sets the second threshold value to “5”. When the drowsiness degree value at the time of acquisition of the stop instruction is “4”, the control unit 24 sets the first threshold value to “7” and the second threshold value to “4”.

  Furthermore, when the drowsiness degree value of the driver at the time of acquisition of the stop instruction is “1” or “2”, the driver is considered to be in a state of being more drowsy than the assumed state. That is, the drowsiness degree value generated based on the biological information is generated with a numerical value lower than the actual driver state. In this case, the control unit 24 sets the first threshold and the second threshold to be lower. Specifically, when the drowsiness degree value at the time of acquiring the stop instruction is “1”, the control unit 24 sets the first threshold value to “4” and sets the second threshold value to “1”. When the drowsiness degree value at the time of acquisition of the stop instruction is “2”, the control unit 24 sets the first threshold value to “5” and the second threshold value to “2”.

  8 and 9 show a processing flow of the control unit 24. The processing in steps S301 to S306 is the same as the processing in steps S101 to S106 described with reference to FIG.

  As shown in FIGS. 8 and 9, the control unit 24 acquires biological information (step S307), and generates a drowsiness degree value based on the biological information acquired in step S307 (step S308).

  The control unit 24 determines whether or not the drowsiness degree value generated in Step S308 is lower than the second threshold (Step S309). When determining in step S309 that the drowsiness degree value generated in step S308 is not below the second threshold (step S309: N), the control unit 24 determines whether a stop instruction has been acquired (step S310). .

  When determining in step S310 that the control unit 24 has obtained the stop instruction (step S310: Y), the control unit 24 obtains the biological information when the stop instruction was obtained (step S311). The control unit 24 generates a drowsiness degree value based on the biological information acquired in step S311 (step S312), and sets a first threshold value and a second threshold value based on the drowsiness degree value (step S313).

  In the determination of step S310, when the control unit 24 determines that the stop instruction has not been acquired (step S310: N), the process returns to the process of acquiring the biological information of step S307.

  In the determination of step S309, when the control unit 24 determines that the drowsiness degree value generated in step S308 is lower than the second threshold (step S309: Y), the control unit 24 instructs the vibration generator VB to stop vibration. The data is transmitted (step S314). After the process in step S314, the control unit 24 stops the process.

  As described above, according to the stimulus control device according to the present embodiment, when the driver performs the stop operation of the vibration generation device VB, that is, based on the drowsiness degree value obtained when the control unit 24 obtains the stop instruction. , The threshold value of the drowsiness degree value that prompts the use of the vibration generator VB is set. Therefore, it is possible to prompt the user to generate a stimulus in an appropriate state. Therefore, it is possible to provide a stimulus at an appropriate timing for awakening the user.

  According to the stimulus control device of the present embodiment, the drowsiness degree value at which the control unit 24 stops the stimulation of the vibration generation device VB based on the drowsiness degree value when the driver performs the stop operation of the vibration generation device VB. Set the threshold of. For this reason, the vibration of the vibration generator VB can be stopped when the awake state of the driver is optimal. Therefore, it is possible to optimize the usability of the driver.

  Thus, the control unit 24 transmits a stop instruction to the vibration generator VB when the drowsiness degree value of the driver falls below the second threshold value. Therefore, the vibration of the vibration generation device VB can be stopped without the driver performing the stop operation, so that the convenience of the user can be improved.

  The second threshold for stopping the vibration of the vibration generator VB may be set based on the drowsiness degree value when the control unit 24 acquires the start instruction. In such a case, the control unit 24 transmits a stop instruction to the vibration generator VB when the drowsiness degree value of the driver falls below the second threshold value. Therefore, the vibration of the vibration generation device VB can be stopped without the driver performing the stop operation, so that the convenience of the user can be improved.

  A stimulus control device 10 according to a fifth embodiment will be described. The stimulus control device 10 of the above-described embodiment stores the threshold of the drowsiness degree value to be notified to the driver, that is, the first threshold, in the storage device 23. The stimulus control device 10 according to the fifth embodiment is different from the stimulus control device 10 of the above-described embodiment in that the first threshold is obtained from an external device.

  In the present embodiment, a case will be described in which the first threshold is acquired from the portable terminal device 30 connected to the stimulus control device 10.

  FIG. 10 shows a configuration of the stimulus control device 10 according to the fifth embodiment. As shown in FIG. 10, the communication unit 26 of the stimulus control device 10 is an interface unit communicably connected to the portable terminal device 30 by wireless such as Bluetooth (registered trademark). The communication with the stimulus control device 10 may be performed in a wired manner.

  The stimulus control device 10 can communicate with the mobile terminal device 30. Specifically, the control unit 24 can receive the biological information, the first threshold value, and the second threshold value transmitted from the mobile terminal device 30. The control unit 24 can transmit the first threshold value and the second threshold value set by the control unit 24 to the mobile terminal device 30.

  FIG. 11 illustrates a configuration of the portable terminal device 30 connected to the stimulus control device 10 according to the fifth embodiment. The mobile terminal device 30 is, for example, a wearable computer that can be worn on a driver's arm. The mobile terminal device 30 may be any mobile communication device capable of communicating with the stimulus control device 10 other than the wearable computer, and may be, for example, a smartphone. Further, the portable terminal device 30 may be a combination of a wearable computer and a portable communication device.

  As shown in FIG. 11, the input unit 40 is an interface unit connected so as to be able to acquire data from the biological sensor BS. The mobile terminal device 30 receives data from the biological sensor BS via the input unit 40.

  The biological sensor BS is a sensor that acquires biological information of a driver who drives an automobile. The biological sensor BS is incorporated in, for example, a wearable computer. The biological sensor BS is a pulsimeter that measures a pulse per predetermined time of the driver.

  The biological sensor BS may measure biological information such as the driver's body temperature, blood pressure, the number of breaths per predetermined time, the number of blinks per predetermined time, and the number of yawns per predetermined time, in addition to the pulse of the driver.

  Note that the biological sensor BS does not have to be a device incorporated in the wearable computer. For example, the biometric sensor BS may generate biometric information by analyzing information obtained from an image of a camera mounted on an automobile. For example, when the biological sensor BS measures the driver's respiratory rate, the biological sensor BS is a measuring device that measures the vertical movement of the driver's chest wall captured by a camera. When measuring the number of blinks of the driver, the biological sensor BS is a measuring device that measures the vertical movement of the driver's eyelids, which is captured by a camera.

  The communication unit 42 is an interface unit that is communicably connected to the stimulus control device 10 by wire or wirelessly. The mobile terminal device 30 can communicate with the stimulus control device 10.

  The storage device 43 includes, for example, a hard disk device, an SSD (Solid State Drive), a flash memory, and the like. The storage device 23 stores various programs such as a basic input output system (BIOS) and software.

In addition, the storage device 43 can store information for generating information on the degree of drowsiness of the driver from the biological information and a first threshold value which is a threshold value of the degree of drowsiness of the driver that issues a notification urging the use of the vibration generator VB. . Further, the storage device 43 can store a threshold value of a drowsiness degree value at which the stimulation of the vibration generation device VB is stopped, that is, a second threshold value.
Specifically, the storage device 43 stores the first threshold value and the second threshold value, which are the initial setting values, in the threshold value DB. Note that the threshold DB is not limited to the first threshold and the second threshold that are the initial setting values, and may store, for example, the first threshold and the second threshold transmitted from the stimulus control device 10.

  The control unit 44 is realized by a computer having a CPU (Central Processing Unit) 44a as an arithmetic processing device, a ROM (Read Only Memory) 44b as a main storage device, and a RAM (Random Access Memory) 44c. The CPU 44a reads out a program corresponding to the processing content from the ROM 44b or the storage device 43, loads the program on the RAM 44c, and realizes various functions in cooperation with the loaded program.

  The input unit 40, the communication unit 42, the storage device 43, and the control unit 44 are connected to each other via a system bus 45.

  The control unit 44 can acquire the biological information of the driver received via the input unit 40.

  The control unit 44 can transmit the biological information and the first threshold to the stimulus control device 10. Further, the control unit 44 can transmit the threshold value of the drowsiness degree value at which the stimulation of the vibration generation device VB is stopped, that is, the second threshold value, to the stimulation control device 10. Further, the control unit 44 can transmit the identification information of the mobile terminal device 30 to the stimulus control device 10.

  The control unit 44 can receive the first threshold value and the second threshold value updated by the stimulus control device 10 from the stimulus control device 10. Further, the control unit 44 can store the received first threshold value and the received second threshold value in the storage device 43.

  FIG. 12 is a flowchart showing the processing of the portable terminal device 30. As shown in FIG. 12, the control unit 44 determines whether communication has been established with the stimulus control device 10 (step S401). It should be noted that, in the determination in step 401, if the communication with the stimulus control device 10 is not established, the control unit 44 ends the process.

  When the control unit 44 determines that communication with the stimulus control device 10 has been established (step S401: Y), the control unit 44 reads the first threshold value from the threshold value DB of the storage device 43 and transmits the first threshold value to the portable terminal device 30 (step S402). In step S403, the control unit 44 functions as a transmission unit that transmits the biological information and the first threshold to the stimulus control device 10. In the process of step S403, the control unit 44 transmits the second threshold value and the identification information of the mobile terminal device 30.

  The control unit 44 sequentially starts transmitting the driver biometric information acquired by the stimulus control device 10 to the portable terminal device 30 (step S403). In step S403, the control unit 44 functions as a biological information acquiring unit that acquires the biological information of the driver.

  The control unit 44 determines whether a transmission stop instruction, which is an instruction to stop transmission of the biological information transmitted from the mobile terminal device 30, has been received (step S404). In step S404, the control unit 44 functions as a receiving unit that receives the first threshold value updated by the stimulus control device 10 from the stimulus control device 10. The determination in step S404 is repeated until a transmission stop instruction is received (step S404: N).

  When receiving the transmission stop instruction (Step S404: Y), the control unit 44 stops transmitting the biological information (Step S405).

  The control unit 44 determines whether the first threshold value has been received from the mobile terminal device 30 (Step S406). The determination in step S406 is repeated until the first threshold is received (step S406: N).

  When receiving the first threshold (Step S406: Y), the control unit 44 sets the received first threshold (Step S407). In step S407, the control unit 44 functions as a storage unit that stores the first threshold.

  13 and 14 show the processing of the stimulus control device 10. As illustrated in FIGS. 12 and 13, the control unit 24 acquires the first threshold and the second threshold transmitted from the mobile terminal device 30 (Step S501). At this time, the control unit 24 receives the identification information of the mobile terminal device 30. Thereby, the control unit 24 can set the first threshold value and the second threshold value for each identification information of the mobile terminal device 30.

  The control unit 24 starts receiving the biological information (step S502). The subsequent steps S503 to S512 are the same as the steps S302 to 312 in FIG.

  The control unit 24 transmits a transmission stop instruction for stopping the transmission of the biological information to the portable terminal device 30 (Step S513).

  The control unit 24 sets a first threshold value and a second threshold value based on the drowsiness degree value generated in step S512 (step S514).

  The control unit 24 transmits the first threshold value and the second threshold value set in Step S514 to the mobile terminal device 30 (Step S515).

  As described above, according to the stimulus control device 10 and the portable terminal device 30 of the present embodiment, the stimulus control device 10 acquires the first threshold value and the second threshold value stored in the portable terminal device 30. That is, the portable terminal device 30 stores the first threshold value and the second threshold value of the owner. For this reason, even when the owner of the portable terminal device 30 changes cars, it is possible to urge the driver to use the vibration generating device VB using the first threshold unique to the owner of the portable terminal device 30. It becomes possible. That is, the use of the vibration generator VB can be encouraged based on the unique first threshold regardless of the moving body on which the driver gets on. For example, even when the owner of the portable terminal device 30 uses a rental car, it is possible to prompt the driver to use the vibration generating device VB using the first threshold unique to the owner of the portable terminal device 30. . Therefore, it is possible to provide a stimulus at an appropriate timing for awakening the user.

  In this embodiment, the stimulus control device 10 generates the drowsiness degree value of the driver based on the biological information. However, the mobile terminal device 30 may generate the drowsiness degree value of the driver. When the portable terminal device 30 is configured as described above, the portable terminal device 30 may transmit the drowsiness degree value generated by the portable terminal device 30 to the stimulus control device 10 instead of the biological information. Further, the stimulus control device 10 may perform the processing shown in FIG. 11 based on the received drowsiness degree value, the first threshold value, and the second threshold value.

  In the present embodiment, the first threshold value is stored in the storage device 43 of the mobile terminal device 30. However, the first threshold value and the second threshold value may be stored in cloud computing such as online storage.

  When the first threshold value and the second threshold value are stored in the cloud computing, the mobile terminal device 30 downloads the first threshold value and the second threshold value uploaded in advance to the cloud computing, and temporarily The first threshold value and the second threshold value are set in the storage device 43. The portable terminal device 30 reads the first threshold value and the second threshold value from the storage device 43 and transmits the first threshold value and the second threshold value to the stimulus control device 10. When the mobile terminal device 30 receives the first threshold value and the second threshold value from the stimulus control device 10, the mobile terminal device 30 temporarily stores the received first threshold value and the second threshold value in the storage device 43, and uploads the stored first threshold value and the second threshold value to cloud computing. Cloud computing resets the uploaded first and second thresholds.

10 Stimulation control device 24 Control unit 30 Portable terminal device 44 Control unit VB Vibration generator

Claims (10)

Biological information acquisition means for acquiring the biological information of the user,
When the numerical value generated based on the biometric information of the user exceeds a first threshold value, transmitting the biometric information and the first threshold value to a stimulus control device that starts supporting the user in awakening. Means,
Storage means for storing the first threshold value;
A portable terminal device comprising:   The mobile terminal device according to claim 1, wherein the numerical value is a numerical value related to a degree of sleepiness of the user. A receiving unit that receives the first threshold updated by the stimulus control device from the stimulus control device,
3. The portable terminal device according to claim 1, wherein the storage unit stores the updated first threshold when the receiving unit receives the updated first threshold. The transmitting means transmits the second threshold value to the stimulus control device that stops supporting awakening when the numerical value exceeds a second threshold value,
4. The portable terminal device according to claim 1, wherein the storage unit stores the second threshold. A receiving unit that receives the second threshold updated by the stimulus control device from the stimulus control device,
5. The mobile phone according to claim 1, wherein the storage unit stores the updated second threshold value when the receiving unit receives the updated second threshold value. 6. Terminal device.   The mobile terminal device according to claim 1, wherein the transmitting unit transmits identification information of the mobile terminal to the stimulus control device. The transmitting means transmits the biological information and the first threshold to the stimulus control device mounted on the vehicle,
The portable terminal device according to any one of claims 1 to 7, wherein the receiving unit receives the first threshold updated by the on-board stimulus control device from the stimulus control device. An information processing method executed by a mobile terminal device,
Storing a first threshold of a stimulus control device that starts supporting the user's awakening when a numerical value generated based on biological information of the user exceeds a first threshold;
Acquiring the biological information of the user;
Transmitting the biological information and the first threshold value to the stimulus control device;
An information processing method comprising: On the computer,
Storing a first threshold of a stimulus control device that starts supporting the user's awakening when a numerical value generated based on biological information of the user exceeds a first threshold;
Acquiring the biological information of the user;
Transmitting the biological information and the first threshold value to the stimulus control device;
A program for executing On the computer,
Storing a first threshold of a stimulus control device that starts supporting the user's awakening when a numerical value generated based on biological information of the user exceeds a first threshold;
Acquiring the biological information of the user;
Transmitting the biological information and the first threshold value to the stimulus control device;
Recording medium on which a program for executing the program is recorded.

Images