JP2021077128A - Abnormality detection device, abnormality detection method, and program - Google Patents

Abstract

To provide an abnormality detection device, an abnormality detection method, and a program which are based on a simple determination logic.SOLUTION: An abnormality detection device in accordance with an embodiment of the present invention includes: plural sensors that acquire body information on a user and information other than the body information; and a control unit that adds or subtracts a value according to a result of authentication based on the body information and a value according to another information, to or from a cumulative value, and determines an abnormality according to the cumulative value.SELECTED DRAWING: Figure 3

Description

The present invention relates to anomaly detection devices, anomaly detection methods, and programs.

In recent years, an abnormality detection device has been proposed for a guardian to grasp an abnormality or the like of a protected person at a remote place. The abnormality detection device described in Patent Document 1 is attached to a protected person and detects an abnormality using a plurality of built-in sensors.

Japanese Patent No. 6353946

However, the abnormality detection device described in Patent Document 1 detects an abnormality of a protected person for each sensor. Therefore, as the number of sensors increases, there is a problem that the determination logic for detecting an abnormality becomes complicated.

The present invention has been made in view of the above problems, and an object of the present invention is to provide an abnormality detection device, an abnormality detection method, and a program having a simple determination logic.

According to one aspect of the present invention, a plurality of sensors that acquire user's biometric information and information other than the biometric information, and a value according to the result of authentication based on the biometric information and the other information are supported. Provided is an abnormality detection device including a control unit that adds or subtracts a value from the cumulative value and determines an abnormality of the user according to the cumulative value.

According to another aspect of the present invention, a step of acquiring the user's biometric information and information other than the biometric information by a plurality of sensors, a value according to the result of authentication based on the biometric information, and the other information. Provided is an abnormality detection method including a step of adding or subtracting a value according to a value to a cumulative value and determining an abnormality of the user according to the cumulative value.

According to another aspect of the present invention, a step of acquiring the user's biometric information and information other than the biometric information by a plurality of sensors, a value according to the result of authentication based on the biometric information, and the other information. A program is provided that causes a computer to execute an abnormality detection method including a step of adding or subtracting a value according to the above to a cumulative value and determining an abnormality of the user according to the cumulative value.

According to the present invention, it is possible to provide an abnormality detection device, an abnormality detection method, and a program having a simple determination logic.

It is a block diagram of the abnormality detection system in 1st Embodiment of this invention. It is a block diagram of the mobile terminal in 1st Embodiment of this invention. It is a functional block diagram of the mobile terminal in 1st Embodiment of this invention. This is an example of a time change of the cumulative value in the first embodiment of the present invention. It is a main flowchart of the abnormality determination method in 1st Embodiment of this invention. It is a flowchart which shows the detail of the GPS positioning process in 1st Embodiment of this invention. It is a flowchart which shows the detail of the acceleration detection processing in 1st Embodiment of this invention. It is a flowchart which shows the details of the process of face authentication and fingerprint authentication in 1st Embodiment of this invention. It is a flowchart which shows the detail of the gait authentication process in 1st Embodiment of this invention. It is a flowchart which shows the detail of the short-range wireless communication connection processing in 1st Embodiment of this invention. It is a block diagram of the wearable terminal in the 3rd Embodiment of this invention. It is a block diagram of the abnormality detection apparatus in 4th Embodiment of this invention.

Hereinafter, embodiments of the present invention will be described with reference to the drawings. The same reference numerals throughout the specification mean substantially the same components.

[First Embodiment]
FIG. 1 is a block diagram of an abnormality detection system according to the present embodiment. The abnormality detection system includes a mobile terminal (abnormality detection device) 1 possessed by a protected person (user) such as a child or an elderly person, a mobile terminal 2 possessed by a guardian or a nurse, and a server 8. The mobile terminal 1 is, for example, a smartphone or the like, and includes a plurality of sensors capable of detecting the state of the protected person, and can determine an abnormality of the protected person based on the detection value of each sensor. Abnormalities of the protected person include, for example, the protected person moving to a place significantly away from his / her home, shelter or school, the protected person wandering, distress, falling, falling, or being injured. The mobile terminal 1 may be stolen, the protected person may lose the mobile terminal 1, and the like. The abnormality of the protected person is not limited to these, and the protected person may encounter an accident, the protected person may be kidnapped, and the like. Like the mobile terminal 1, the mobile terminal 2 is composed of a smartphone or the like, and can receive an abnormality notification transmitted from the mobile terminal 1. The mobile terminal 1 can communicate with the mobile terminal 2 and the server 8 via a network 9 such as a mobile communication network. Further, the mobile terminal 1 can communicate with the mobile terminal 2 by the network 9, Wi-Fi (registered trademark), Bluetooth (registered trademark), or NFC (Near Field Communication).

The server 8 can communicate with the mobile terminals 1 and 2 via the network 9. For example, the server 8 has a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), a storage device, and a display. It is equipped with a device, an input device, a communication I / F (Interface), and the like. The storage device is, for example, a large-capacity storage device such as a hard disk. When the mobile terminal 1 detects an abnormality, the server 8 may deploy a notification to the police, fire department, school, shelter, etc., in addition to the notification to the guardian or the nurse. The server 8 may perform abnormality detection based on the detection value of the sensor acquired by the mobile terminal 1.

FIG. 2 is a block diagram of a mobile terminal according to the present embodiment. The mobile terminal 1 includes a CPU 101, a ROM 102, a RAM 103, a storage device 104, a display 105, a touch sensor 106, a first wireless communication I / F 107, a second wireless communication I / F 108, a GPS (Global Positioning System) 109, an imaging unit 110, and a fingerprint. It includes a sensor 111, an acceleration sensor 112, a gyro sensor 113, a temperature sensor 114, a humidity sensor 115, and a bus 120. The parts are connected to each other via the bus 120.

The CPU 101 controls each part of the mobile terminal 1 by an application program. The ROM 102 is composed of a non-volatile memory and stores an application program for controlling each part of the mobile terminal 1. The RAM 103 provides a memory area required for the operation of the CPU 101. The storage device 104 is composed of a non-volatile memory, an external memory, and the like.

The display 105 is composed of, for example, a liquid crystal display, an OLED (Organic Light Emitting Diode) display, an LED (Light Emitting Diode) display, and the like. A touch sensor 106 is arranged on the surface of the display 105. The touch sensor 106 includes a capacitance type or resistance type detection circuit.

The first wireless communication I / F 107 is a communication unit that performs wireless communication in a mobile communication network, and is, for example, a third generation mobile communication, LTE (Long Term Evolution), a fourth generation mobile communication, a fifth generation mobile communication, and the like. Is feasible.

The second wireless communication I / F108 is a communication unit that transmits / receives data by wireless communication, and executes, for example, short-range wireless communication such as Bluetooth, wireless communication by wireless LAN connection such as Wi-Fi, infrared wireless communication, and the like. It is configured to be possible.

GPS109 has an antenna that receives radio waves from GPS satellites. The GPS 109 can acquire accurate information on the latitude, longitude, and altitude at which the mobile terminal 1 is located, based on the time difference of radio waves received from a plurality of GPS satellites.

The imaging unit 110 is, for example, an area sensor such as a CCD (Charge Coupled Device) sensor or a CMOS (Complementary Metal Oxide Sensor) sensor. The image pickup unit 110 can take an image of the face of the protected person and acquire face image data used for face recognition.

The fingerprint sensor 111 includes a capacitance type or ultrasonic type detection circuit, and reads the fingerprint of the protected person. When the protected person touches the fingerprint sensor 111 with a predetermined finger, the fingerprint sensor 111 can acquire the fingerprint data of the protected person.

The acceleration sensor 112 detects the acceleration of the mobile terminal 1 based on a mechanical displacement measurement type, an optical type, a semiconductor type, or the like. Further, the gyro sensor 113 detects a change in the orientation of the mobile terminal 1 based on a rotary mechanical type, an optical type, a vibration type, or the like.

The temperature sensor 114 is composed of an NTC (Negative Temperature Coefficient) thermistor or the like. The electrode of the NTC thermistor is a ceramic element obtained by firing oxides such as manganese, nickel, and cobalt. The temperature sensor 114 can detect the change in the resistance of the electrode with respect to the change in temperature, and can detect the temperature around the mobile terminal 1. The humidity sensor 115 includes a polymer moisture-sensitive film or a comb-shaped electrode to detect humidity. The temperature sensor 114 and the humidity sensor 115 can detect the temperature and humidity around the protected person.

FIG. 3 is a functional block diagram of the mobile terminal according to the present embodiment. The CPU 101 executes functions as a face authentication unit 131, a fingerprint authentication unit 132, a gait authentication unit 133, a cumulative unit 134, a cumulative unit 135, a determination unit 136, and a notification unit 137. The CPU 101 acquires signals from each of the image pickup unit 110, the fingerprint sensor 111, the gyro sensor 113, the GPS 109, the acceleration sensor 112, and the second wireless communication I / F 108.

The face recognition unit 131 authenticates the protected person by comparing the face image data of the protected person captured by the imaging unit 110 with the reference data. The reference data is face image data of the protected person registered in advance, and is obtained by imaging the face of the protected person from a plurality of directions with the imaging unit 110. The face recognition unit 131 compares the feature amounts of the face image data and the reference data. Here, the feature amount may be, for example, the positional relationship of eyes, nose, mouth, eyebrows, ears, and the like.

The fingerprint authentication unit 132 authenticates the protected person by comparing the fingerprint data of the protected person acquired by the fingerprint sensor 111 with the reference data. The reference data is the fingerprint data of the protected person registered in advance, and is obtained by reading the protected person's finger with the fingerprint sensor 111. The fingerprint authentication unit 132 compares the feature amounts of the fingerprint patterns of the fingerprint data and the reference data. The feature amount of the fingerprint pattern may include, for example, a branch point of the fingerprint pattern, a separation point of the fingerprint pattern, a center point of the fingerprint pattern, and a confluence point of a plurality of fingerprint patterns.

The gait authentication unit 133 authenticates the protected person by comparing the walking data of the protected person acquired by the acceleration sensor 112 and the gyro sensor 113 with the reference data. The reference data is a feature amount obtained in advance from the walking pattern of the protected person, and is obtained when the protected person walks while holding the mobile terminal 1. The feature quantity may include, for example, the average of acceleration, the standard deviation of acceleration, the time change of acceleration, and the like. In addition, when the protected person holds the mobile terminal 1 by hand, hangs it around the neck via a strap or the like, stores it in a chest pocket, or stores it in a trouser pocket, a plurality of cases are used. It is desirable that the reference pattern is acquired in advance.

The cumulative unit 134 holds the cumulative value A (first cumulative value) and accumulates the value according to the authentication result based on the biological information. The biological information may include, for example, face image data, fingerprint data, gait data, and the like. The cumulative unit 134 adds or subtracts a value according to the authentication results of the face authentication unit 131, the fingerprint authentication unit 132, and the gait authentication unit 133 to the cumulative value A. In cases where the protected person cannot perform authentication due to an accident or injury, the protected person does not have the mobile terminal 1, or a person other than the protected person has the mobile terminal 1. Parental identity verification fails. From this, it can be considered that an abnormality has occurred in the protected person when the personal authentication of the protected person fails. If the authentication fails, the cumulative unit 134 adds a predetermined value to the cumulative value A. The larger the cumulative value A, the higher the possibility that the protected person has an abnormality. Here, the cumulative value A is represented by a positive integer of 0 or more, and can change in the range of 0 to 127, for example.

The cumulative unit 135 holds a cumulative value B (second cumulative value) and accumulates values according to information other than biological information. Information other than biological information may include, for example, position information, acceleration, short-range wireless communication connection information, and the like. The cumulative unit 135 adds a value corresponding to the detected values of the GPS 109, the acceleration sensor 112, and the second wireless communication I / F 108 to the cumulative value B. When the protected person moves to a dangerous area, or when the protected person moves at a speed exceeding the walking speed, the cumulative unit 135 adds a predetermined value to the cumulative value B. Similar to the cumulative value A, the larger the cumulative value B, the higher the possibility that the protected person has an abnormality. Here, the range of the cumulative value B is a positive integer of 0 or more, and can be, for example, 0 to 127.

The determination unit 136 determines whether or not the protected person has an abnormality based on the cumulative values A and B. In the present embodiment, the determination unit 136 determines the presence or absence of an abnormality based on the comparison between the cumulative value A and the threshold value th_A (first threshold value) and the comparison between the cumulative value B and the threshold value th_B (second threshold value). When the cumulative value A is equal to or greater than the threshold value th_A, or at least when the cumulative value B is equal to or greater than the threshold value th_B, the determination unit 136 determines that an abnormality has occurred in the protected person.

The notification unit 137 transmits a notification to the guardian's mobile terminal 2 when the determination unit 136 determines the abnormality of the protected person. The notification may be, for example, an e-mail describing the content of the anomaly, a short message describing the content of the anomaly, the location information of the protected person, an alarm, a call transmission, or the like.

In this way, the value according to the result of the authentication based on the biological information and the value according to the plurality of sensor detection values are added or subtracted from the cumulative value. By comparing the cumulative value with the threshold value, the mobile terminal can detect the abnormality of the protected person.

FIG. 4 is an example of the time change of the cumulative value in the present embodiment. In FIG. 4, the horizontal axis represents time and the vertical axis represents cumulative values.

FIG. 4A shows a cumulative value A, and the cumulative value A is added or subtracted according to the result of biometric authentication of the protected person. At time t0, the cumulative value A is set to the initial value "0". The CPU 101 acquires walking data from the acceleration sensor 112 and the gyro sensor 113 every predetermined time, for example, every 5 minutes, and performs gait authentication. The CPU 101 adds or subtracts the cumulative value A according to the authentication result. At time t0, the CPU 101 acquires walking data from the acceleration sensor 112 and the gyro sensor 113, and determines whether or not the protected person possesses the mobile terminal 1 by gait authentication. If the authentication result based on the walking data is a failure, the CPU 101 adds a predetermined value, for example, "10" to the cumulative value A. When the threshold value th_A is "25", the cumulative value A is less than the threshold value th_A, so that the mobile terminal 1 determines that no abnormality has occurred in the protected person. If the gait authentication is successful at time t1, the CPU 101 subtracts a predetermined value, for example, "5" from the cumulative value A. If the gait authentication fails consecutively at the times t2 and t3, the CPU 101 adds "10" to the cumulative value A, respectively. When the cumulative value A becomes equal to or higher than the threshold value th_A at time t3, the CPU 101 determines that an abnormality has occurred in the protected person, and transmits a notification to the mobile terminal 2 that the abnormality has occurred in the protected person. When a person other than the protected person possesses the mobile terminal 1, there is a high possibility that some abnormality has occurred in the protected person. Therefore, it is possible to determine the abnormality of the protected person based on the value of the cumulative value A.

FIG. 4B shows a cumulative value B, and the cumulative value B is added according to the position and moving speed of the protected person. At time t0, the cumulative value B is set to the initial value "0". The CPU 101 acquires a detected value from the GPS 109, the acceleration sensor 112, and the second wireless communication I / F 108 every predetermined time, for example, every 5 minutes, and adds the cumulative value B according to the detected value. At time t1, the CPU 101 acquires the position information from the GPS 109 and determines whether or not the protected person is located within the action range permitted in advance. When the protected person is located outside the action range, the CPU 101 adds a predetermined value, for example, "10" to the cumulative value B. When the threshold value th_B is "25", the cumulative value B is less than the threshold value th_B, so that the mobile terminal 1 does not determine that the protected person has an abnormality. When the protected person continues to be located outside the action range at the times t2 and t3, the CPU 101 adds "10" to the cumulative value B, respectively. When the cumulative value B exceeds the threshold value th_B at time t3, the CPU 101 determines that an abnormality has occurred in the protected person, and transmits a notification to the mobile terminal 2 that the abnormality has occurred in the protected person. If the protected person is located outside the range of action for more than a predetermined time, it is highly possible that the protected person has some abnormality. Therefore, it is possible to determine the abnormality of the protected person based on the value of the cumulative value B.

In this way, the value corresponding to the detected abnormality is added or subtracted from the cumulative value. By accumulating the values according to the authentication result, it is possible to contribute to the abnormality detection even if the authentication result is obtained by an uncertain authentication method. Further, by accumulating the values corresponding to the detected values, even the detected values of the sensor that cannot be immediately determined to be abnormal can contribute to the abnormal detection.

FIG. 5 is a main flowchart of the abnormality determination method in the present embodiment. First, the guardian inputs the information of the protected person into the mobile terminal 1. The information of the protected person is, for example, gender, date of birth, height, weight, and the like. The guardian inputs the telephone number, e-mail address, etc. of the guardian's mobile terminal 2 into the mobile terminal 1 as the information of the notification destination when an abnormality is detected. Further, the guardian uses a map application or the like to register the action range permitted to the protected person in the mobile terminal 1 as a white list. The permitted range of action may be, for example, a home, a shelter, a nursing home, a school, a school route, or the like. Further, the guardian sets a short-range wireless communication connection in each of the mobile terminal 1 and the mobile terminal 2. Further, the guardian registers the face image data of the protected person used for face recognition, the fingerprint data of the protected person used for fingerprint authentication, and the walking data of the protected person used for gait authentication in the mobile terminal 1 (step S101). ).

After performing the above processing, the mobile terminal 1 initializes the cumulative values A and B to "0" (step S102), and starts executing the abnormality detection of the protected person. First, the mobile terminal 1 determines whether or not the abnormality determination interval has elapsed (step S103). The interval of abnormality determination can be, for example, 5 minutes. If the abnormality determination interval has not elapsed (NO in step S103), the mobile terminal 1 returns to step S103 and repeats the determination in step S103 until the abnormality determination interval elapses. On the other hand, when the abnormality determination interval has elapsed (YES in step S103), the mobile terminal 1 has GPS positioning process (step S105), acceleration detection process (step S106), gait authentication process (step S107), and near field communication. The range wireless communication connection process (step S108) is executed. The processes of steps S105 to S108 may be executed in parallel or sequentially in a predetermined order. In the present embodiment, a case where these processes are executed in parallel will be described.

Based on the abnormality detection result of the protected person executed in steps S105 to S108, the mobile terminal 1 determines the abnormality using the cumulative values A and B (step S110). When the cumulative value A is not equal to or greater than the threshold value th_A and the cumulative value B is not equal to or greater than the threshold value th_B (NO in step S110), the mobile terminal 1 determines that the protected person is normal and transmits a notification to the mobile terminal 2. do not.

On the other hand, when the cumulative value A is equal to or higher than the threshold value th_A, or at least when the cumulative value B is equal to or higher than the threshold value th_B (YES in step S110), the mobile terminal 1 determines that the protected person has an abnormality. Then, the notification is transmitted to the guardian's mobile terminal 2 (step S111).

Next, the mobile terminal 1 determines whether or not the instruction to end the abnormality detection has been given from the mobile terminal 2 (step S112). When the instruction to end the abnormality detection is not given (NO in step S112), the mobile terminal 1 repeats the abnormality detection process (steps S103 to S111). On the other hand, when the instruction to end the abnormality detection is given (YES in step S112), the mobile terminal 1 stops the abnormality detection. The instruction to end the abnormality detection may be given by the guardian performing a predetermined operation on the mobile terminal 1. For example, if the guardian's face image data or fingerprint data is registered in the mobile terminal 1 in advance and the guardian's personal authentication is successful in the mobile terminal 1, the mobile terminal 1 may end the abnormality detection. The mobile terminal 1 stops abnormality detection, transmits GPS positioning information, an authentication result, a log of the detected abnormality, and the like to the server 8 and saves the log (step S115). When the above processing is completed, the mobile terminal 1 ends the processing for determining the abnormality.

FIG. 6 is a flowchart showing the details of the GPS positioning process (step S105) of FIG. First, the mobile terminal 1 acquires the position information of the mobile terminal 1 from the GPS 109 and obtains the average moving speed (step S121). Next, the mobile terminal 1 determines whether or not the acquired position is within the action range permitted by the protected person (see step S101) (step S122). When the acquired position is within the permitted action range (YES in step S122), the mobile terminal 1 initializes the cumulative value B to “0” (step S123). On the other hand, when the acquired position is not within the permitted action range (NO in step S122), the mobile terminal 1 determines whether or not the moving speed is less than a predetermined speed (step S124). The predetermined speed is set to the walking speed of the protected person, for example, 10 km / h. If the moving speed is less than the predetermined speed (YES in step S124), it is considered that the protected person is slowly moving away from the permitted range of action. In this case, the mobile terminal 1 adds a small value corresponding to the moving speed to the cumulative value B (step S125). For example, if the threshold th_B is "30", the predetermined value can be "15". If it is determined that the protected person is moving from the permitted range of action at a moving speed of less than 10 km / h two or more times in a row, the cumulative value B exceeds the threshold value th_B, causing an abnormality in the protected person. It is judged that it was. When the moving speed is equal to or higher than the predetermined speed (NO in step S124), it is considered that the protected person is moving away from the permitted range of action at high speed. The mobile terminal 1 adds a large value according to the moving speed to the cumulative value B (step S126). For example, the value "30" is added to the cumulative value B, and the cumulative value B exceeds the threshold value th_B. That is, at the same time that it is detected that the protected person deviates from the permitted range of action, the abnormality of the protected person is determined. In this way, by adding the weighted value according to the moving speed to the cumulative value B, it is possible to determine the abnormality of the protected person at an early stage. When the above processing is completed, the mobile terminal 1 ends the abnormality detection by GPS positioning, and returns to the main flowchart of FIG.

FIG. 7 is a flowchart showing the details of the acceleration detection process (step S106) of FIG. First, the mobile terminal 1 detects the acceleration by the acceleration sensor 112 (step S131). Next, the mobile terminal 1 determines whether or not the detected acceleration is less than a predetermined acceleration (step S132). For example, when an abnormality such as a protected person falling from a high place or a protected person falling occurs, the detected acceleration becomes large. When the detected acceleration is less than the predetermined acceleration (YES in step S132), the mobile terminal 1 determines that no abnormality has occurred in the protected person. The mobile terminal 1 does not require face authentication and fingerprint authentication, finishes abnormality detection by acceleration detection, and returns to the main flowchart. On the other hand, when the detected acceleration is equal to or higher than the predetermined acceleration (NO in step S132), the mobile terminal 1 determines that there is a high possibility that an abnormality has occurred in the protected person, and further, the protected person himself / herself. Perform authentication. That is, the mobile terminal 1 executes a face authentication or fingerprint authentication process in order to confirm the safety of the protected person (step S133). When the above processing is completed, the mobile terminal 1 ends the abnormality detection by the acceleration detection, and returns to the main flowchart of FIG.

FIG. 8 is a flowchart showing details of the face authentication and fingerprint authentication processing (step S133) of FIG. The face recognition and fingerprint recognition processes are executed when a large acceleration is detected (NO in step S132). The mobile terminal 1 prompts the protected person to perform at least one of face authentication and fingerprint authentication in order to confirm the safety of the protected person (step S141). When the protected person executes face recognition, the mobile terminal 1 acquires the image data of the protected person's face and compares the face image data with the pre-registered reference data. When the protected person performs fingerprint authentication, the mobile terminal 1 acquires the fingerprint data of the protected person using the fingerprint sensor 111, and compares the fingerprint data with the pre-registered reference data. The mobile terminal 1 determines whether or not face authentication or fingerprint authentication is successful (step S142). When face authentication or fingerprint authentication is successful (YES in step S142), it is determined that the safety of the protected person has been confirmed, and the mobile terminal 1 initializes the cumulative value A to "0" (step S143). Face recognition and fingerprint recognition are completed, and the process returns to step S133 (see FIG. 7).

On the other hand, if face authentication or fingerprint authentication fails (NO in step S142), there may be a reason that the face image data or fingerprint data of the protected person cannot be acquired in addition to the authentication by a third party other than the protected person. There is sex. For example, since the operation of the mobile terminal 1 by the protected person is not appropriate, if the face of the protected person deviates from the imaging range of the imaging unit 110, the mobile terminal 1 may fail in face recognition. Also, if the finger is wet, the mobile terminal 1 may fail the fingerprint authentication. Therefore, the mobile terminal 1 processes face authentication or fingerprint authentication (step) from the start of the first authentication in step S141 until the predetermined time limit elapses (NO in step S144). S141 and S142) are repeated. The time limit can be, for example, 5 minutes. When the elapsed time reaches the time limit (YES in step S144), the mobile terminal 1 determines that an abnormality has occurred in the protected person, and the mobile terminal 1 adds a predetermined value to the cumulative value A (step S145). ). In step S144, the mobile terminal 1 may determine the occurrence of an abnormality by using the number of failures of face authentication or fingerprint authentication instead of the elapsed time. For example, when the face authentication or the fingerprint authentication fails three times, the mobile terminal 1 may determine that the protected person has an abnormality. When the above processing is completed, the mobile terminal 1 ends the abnormality detection by face authentication or fingerprint authentication, and returns to step S133 (see FIG. 7).

FIG. 9 is a flowchart showing the details of the gait authentication process (step S107) of FIG. First, the mobile terminal 1 executes gait authentication of the protected person based on the walking data obtained by the acceleration sensor 112 and the gyro sensor 113 (step S151). Next, the mobile terminal 1 determines whether or not the personal authentication by gait authentication is successful (step S152). If the gait authentication is successful (YES in step S152), the mobile terminal 1 determines that no abnormality has occurred in the protected person, and initializes the cumulative value A to "0" (step S153). Alternatively, the mobile terminal 1 may subtract a predetermined value from the cumulative value A. For example, if the protected person possesses the mobile terminal 1 and walks normally, the gait authentication can be successful. When the gait authentication fails (NO in step S152), the mobile terminal 1 determines that an abnormality has occurred in the protected person, and adds a predetermined value to the cumulative value A (step S154). For example, when the walking pattern changes due to the injury of the protected person, it can be determined that the protected person has an abnormality when the person other than the protected person possesses the mobile terminal 1. When the above processing is completed, the mobile terminal 1 ends the abnormality detection by gait authentication, and returns to the main flowchart of FIG.

FIG. 10 is a flowchart showing the short-range wireless communication connection process (step S108) of FIG. First, the mobile terminal 1 attempts a short-range wireless communication connection with the mobile terminal 2 via the second wireless communication I / F 108 (step S161). Next, the mobile terminal 1 determines whether or not the connection with the mobile terminal 2 is successful (step S162). When the short-range wireless communication connection between the mobile terminal 1 and the mobile terminal 2 is successful (YES in step S162), it is considered that the protected person and the guardian are close to each other. In this case, since the guardian can confirm the safety of the protected person, the mobile terminal 1 initializes the cumulative values A and B to "0" (step S163). On the other hand, when the short-range wireless communication connection between the mobile terminal 1 and the mobile terminal 2 fails (NO in step S162), it is considered that the protected person and the guardian are separated from each other. In this case, since the guardian does not confirm the safety of the protected person, the mobile terminal 1 maintains the cumulative values A and B. When the above processing is completed, the mobile terminal 1 ends the abnormality detection by the short-range wireless communication connection, and returns to the main flowchart of FIG.

As described above, according to the present embodiment, the value according to the result of authentication based on the biometric information of the protected person and the value according to the information of a plurality of sensors are added or subtracted from the cumulative value and accumulated. Anomalies of the protected person can be detected according to the value. As a result, the determination logic for detecting an abnormality can be easily configured.

In this embodiment, the temperature sensor 114 and the humidity sensor 115 may be combined to detect an abnormality of the protected person. For example, if the temperature sensor 114 and the humidity sensor 115 detect a high temperature and high humidity condition, there may be a risk of heat stroke of the protected person. In such a case, the mobile terminal 1 can notify the protected person of the high temperature and high humidity state and take measures to prevent heat stroke. The mobile terminal 1 may be provided with a cumulative unit separately from the cumulative units 134 and 135, and may be used for determining abnormality detection such as heat stroke.

Further, in the present embodiment, the abnormality is determined for each of the cumulative value A related to authentication and the cumulative value B related to the position and the like, but the abnormality may be determined using the value obtained by adding the cumulative values A and B. ..

[Second Embodiment]
Subsequently, the abnormality detection device in this embodiment will be described. The abnormality detection device in the present embodiment is different from the abnormality detection device in the first embodiment in that the notification is changed according to the cumulative value. Hereinafter, a configuration different from that of the first embodiment will be mainly described.

When the mobile terminal 1 detects an abnormality, the mobile terminal 1 performs an operation such as notifying the mobile terminal 2. At this time, the mobile terminal 1 can change the operation of the mobile terminals 1 and 2 according to the respective sizes of the cumulative values A and B. For example, as the cumulative values A and B increase, the mobile terminal 1 can increase the notification volume or the vibration of the vibration in the mobile terminal 2. As a result, the guardian can easily grasp the degree of abnormality of the protected person.

When there are a plurality of guardians or nurses, the mobile terminal 2 possessed by each guardian or nurse may be prioritized. The mobile terminal 1 may select the mobile terminal 2 for notification according to the priority and the magnitude of the cumulative values A and B. For example, when the cumulative values A and B become large, the mobile terminal 1 can notify not only the mobile terminal 2 having a high priority but also the mobile terminal 2 having a low priority. The mobile terminal 1 may notify the police, fire department, etc. in addition to the guardian or the nurse.

As described above, according to the present embodiment, the notification method, notification content, notification destination, and the like can be changed according to the degree of abnormality.

[Third Embodiment]
Subsequently, the abnormality detection device in this embodiment will be described. The abnormality detection device in this embodiment uses a wearable terminal in addition to the configuration in the first embodiment. Hereinafter, a configuration different from that of the first embodiment will be mainly described.

FIG. 11 is a block diagram of the wearable terminal according to the present embodiment. The wearable terminal 4 is a terminal worn by a protected person, and may be, for example, a terminal worn on a wrist, an arm, or the like using a wristband, an arm band, or the like. The wearable terminal 4 includes a CPU 401, a ROM 402, a RAM 403, a display 405, a touch sensor 406, a wireless communication I / F 407, an LED 408, a PD (Photodiode) 409, and a bus 410. The parts are connected to each other via the bus 410.

The CPU 401 controls each part of the wearable terminal 4 by an application program. The ROM 402 is composed of a non-volatile memory and stores an application program for controlling each part of the wearable terminal 4. The RAM 403 provides a memory area required for the operation of the CPU 401.

The display 405 is composed of, for example, a liquid crystal display, an OLED display, an LED display, and the like. A touch sensor 406 is arranged on the surface of the display 405. The touch sensor 406 includes a capacitance type or resistance type detection circuit.

The wireless communication I / F407 is a communication unit that transmits / receives data by wireless communication, and enables short-range wireless communication such as Bluetooth, wireless communication by wireless LAN connection such as Wi-Fi, infrared wireless communication, and the like. It is composed. The wearable terminal 4 can wirelessly communicate with the mobile terminal 1 via the wireless communication I / F 407.

The LED 408 and PD 409 are sensors for measuring the pulse rate and the like of the protected person. The LED 408 is an LED that irradiates infrared light, green light, or the like, and irradiates the skin of the protected person with light. The PD409 receives the light of the LED 408 reflected on the skin of the protected person. It is desirable that the LEDs 408 and PD409 are provided adjacent to each other on the surface of the protected person in contact with the skin. The wearable terminal 4 can estimate the pulse rate and the like by using the light emitted by the LED 408 and the light received by the PD 409. The pulse rate and the like may be estimated by the mobile terminal 1. In this case, the wearable terminal 4 transmits data such as the amount of light of the LED 408 and the PD 409 to the mobile terminal 1.

The wearable terminal 4 can estimate the pulse rate of the protected person based on the acquired pulse rate. Further, the wearable terminal 4 can determine whether or not the estimated pulse rate is within a predetermined pulse rate range, and can detect an abnormality of the protected person. The predetermined pulse rate range is preferably a pulse rate range according to the health condition of the protected person, a pulse rate range based on advice from a doctor, and the like.

The cumulative unit 135 (see FIG. 3) can add a value corresponding to the pulse rate of the protected person to the cumulative value B. The mobile terminal 1 can acquire the pulse rate of the protected person via the second wireless communication I / F 108. When the pulse rate of the protected person is out of the predetermined range, the cumulative unit 135 adds a predetermined value to the cumulative value B. When the pulse rate of the protected person is continuously out of the predetermined range, a predetermined value is continuously added to the cumulative value B, and the cumulative value B may be equal to or higher than the threshold value th_B. For example, assume that the predetermined value is "10", the threshold th_B is "30", and the anomaly detection is executed at 5-minute intervals. When the pulse rate of the protected person is out of the predetermined pulse rate range for 15 minutes in a row, the cumulative value B becomes the threshold value th_B or more. The mobile terminal 1 determines that an abnormality has occurred in the pulse rate of the protected person, and transmits a notification to the guardian's mobile terminal 2. In this way, the mobile terminal 1 can detect the abnormality of the protected person by adding the value corresponding to the pulse rate to the cumulative value B. The mobile terminal 1 can easily combine the pulse rate detected by the wearable terminal 4 with the abnormality detection.

As described above, according to the present embodiment, the mobile terminal can acquire the pulse rate and the like of the protected person by using a wearable terminal or the like. The mobile terminal can determine the abnormality of the protected person by adding or subtracting the value according to the biological information acquired from other devices or the like or the value according to the sensor detection value or the like to the cumulative value. As a result, even if the biological information or the sensor detection value used for the abnormality detection is newly added, the abnormality detection with a simple determination logic becomes possible.

[Fourth Embodiment]
A fourth embodiment of the present invention will be described with reference to FIG. FIG. 12 is a block diagram of the abnormality detection device according to the present embodiment.

The abnormality detection device 5 is a cumulative value of a plurality of sensors 6 that acquire the user's biometric information and information other than the biometric information, and a value according to the result of authentication based on the biometric information and a value according to the other information. Is provided with a control unit 7 that adds or subtracts information to and determines a user's abnormality according to the cumulative value.

According to such a configuration, the plurality of sensors 6 acquire the biometric information of the user and information other than the biometric information. The control unit 7 adds or subtracts a value according to the result of authentication based on the biometric information of the user and a value according to other information to the cumulative value, and determines an abnormality according to the cumulative value. This makes it possible to detect anomalies using a simple determination logic.

Although the present invention has been described above with reference to the embodiments, the present invention is not limited to the above embodiments. Various changes that can be understood by those skilled in the art can be made to the structure and details of the present invention within the scope of the present invention.

Further, in order to realize the functions of each of the above-described embodiments, a process of recording a program that operates the configuration of the embodiment on a recording medium, reading the program recorded on the recording medium as a code, and executing the program on a computer. Methods are also included in the scope of each embodiment. That is, a computer-readable recording medium is also included in the scope of each embodiment. Further, not only the recording medium on which the above-mentioned computer program is recorded, but also the computer program itself is included in each embodiment.

Some or all of the above embodiments may also be described, but not limited to:

(Appendix 1)
A plurality of sensors that acquire the user's biological information and information other than the biological information, and
A control unit that adds or subtracts a value according to the result of authentication based on the biometric information and a value according to the other information to the cumulative value and determines an abnormality of the user according to the cumulative value.
Anomaly detection device.

(Appendix 2)
The abnormality detection device according to Appendix 1, wherein the control unit determines the abnormality when the cumulative value is equal to or greater than a threshold value.

(Appendix 3)
The cumulative value has a first cumulative value and a second cumulative value.
The abnormality detection device according to Appendix 2, wherein the control unit accumulates a value according to the result of the authentication in the first cumulative value and accumulates a value according to the other information in the second cumulative value.

(Appendix 4)
The threshold has a first threshold and a second threshold.
The control unit determines that the abnormality is in the case of at least one of the case where the first cumulative value is equal to or higher than the first threshold value or the case where the second cumulative value is equal to or higher than the second threshold value. Anomaly detection device.

(Appendix 5)
The value according to the result of the authentication is added to the first cumulative value when the authentication fails.
The other information represents the position of the user, and the value corresponding to the other information is added to the second cumulative value when the position is out of a predetermined range. Detection device.

(Appendix 6)
The abnormality detection device according to any one of Supplementary note 3 to 5, wherein the authentication includes at least one of gait authentication, face authentication, and fingerprint authentication.

(Appendix 7)
When the mobile terminal owned by the guardian of the user and the abnormality detection device can be connected by short-range wireless communication, the first cumulative value and the second cumulative value are initialized to predetermined values. The abnormality detection device according to any one of 6.

(Appendix 8)
When the control unit determines the abnormality, it transmits a notification indicating the abnormality to a terminal of a third party other than the user, and sends the notification according to the magnitude of the first cumulative value or the second cumulative value. The abnormality detection device according to any one of Appendix 3 to 7, which is to be changed.

(Appendix 9)
A step of acquiring the user's biological information and information other than the biological information by a plurality of sensors, and
A step of adding or subtracting a value according to the result of authentication based on the biometric information and a value according to the other information to the cumulative value, and determining an abnormality of the user according to the cumulative value.
Anomaly detection method comprising.

(Appendix 10)
A step of acquiring the user's biological information and information other than the biological information by a plurality of sensors, and
A step of adding or subtracting a value according to the result of authentication based on the biometric information and a value according to the other information to the cumulative value, and determining an abnormality of the user according to the cumulative value.
A program that causes a computer to execute an abnormality detection method.

1,2: Mobile terminal 4: Wearable terminal 8: Server 9: Network 101,401: CPU
102, 402: ROM
103, 403: RAM
104: Storage device 105,405: Display 106,406: Touch sensor 107: First wireless communication I / F
108: Second wireless communication I / F
109: GPS
110: Imaging unit 111: Fingerprint sensor 112: Accelerometer 113: Gyro sensor 114: Temperature sensor 115: Humidity sensor 120, 410: Bus 131: Face recognition unit 132: Fingerprint authentication unit 133: Amount authentication unit 134, 135: Cumulative Unit 136: Judgment unit 137: Notification unit 407: Wireless communication I / F
408: LED
409: PD
A, B: Cumulative value th_A, th_B: Threshold

Claims (10)

A plurality of sensors that acquire the user's biological information and information other than the biological information, and
A control unit that adds or subtracts a value according to the result of authentication based on the biometric information and a value according to the other information to the cumulative value and determines an abnormality of the user according to the cumulative value.
Anomaly detection device. The abnormality detection device according to claim 1, wherein the control unit determines the abnormality when the cumulative value is equal to or greater than a threshold value. The cumulative value has a first cumulative value and a second cumulative value.
The abnormality detection device according to claim 2, wherein the control unit accumulates a value according to the result of the authentication in the first cumulative value and accumulates a value according to the other information in the second cumulative value. The threshold has a first threshold and a second threshold.
The third aspect of claim 3, wherein the control unit determines that the abnormality is at least when the first cumulative value is equal to or higher than the first threshold value or when the second cumulative value is equal to or higher than the second threshold value. Anomaly detector. The value according to the result of the authentication is added to the first cumulative value when the authentication fails.
The other information represents the position of the user, and the value corresponding to the other information is added to the second cumulative value when the position is out of a predetermined range according to claim 3 or 4. Anomaly detector. The abnormality detection device according to any one of claims 3 to 5, wherein the authentication includes at least one of gait authentication, face authentication, and fingerprint authentication. 3. Claim 3 for initializing the first cumulative value and the second cumulative value to a predetermined value when the mobile terminal possessed by the guardian of the user and the abnormality detection device can be connected by short-range wireless communication. 6. The abnormality detection device according to any one of 6. When the control unit determines the abnormality, it transmits a notification indicating the abnormality to a terminal of a third party other than the user, and sends the notification according to the magnitude of the first cumulative value or the second cumulative value. The abnormality detection device according to any one of claims 3 to 7, which is to be changed. A step of acquiring the user's biological information and information other than the biological information by a plurality of sensors, and
A step of adding or subtracting a value according to the result of authentication based on the biometric information and a value according to the other information to the cumulative value, and determining an abnormality of the user according to the cumulative value.
Anomaly detection method comprising. A step of acquiring the user's biological information and information other than the biological information by a plurality of sensors, and
A step of adding or subtracting a value according to the result of authentication based on the biometric information and a value according to the other information to the cumulative value, and determining an abnormality of the user according to the cumulative value.
A program that causes a computer to execute an abnormality detection method.

Images