JP6863779B2 - Door system and monitoring method using door system - Google Patents

Description

The present invention relates to a door system and a monitoring method using the door system, and in particular, it is possible to naturally acquire information on the activity status and health condition when a user enters and exits a door without using a wearable device. The present invention relates to a door system capable of notifying a user's abnormality and a monitoring method using the door system.

With the advent of an aging society with a declining birthrate, monitoring the activity status and health status of the elderly, especially the elderly living alone, has become a social issue. By acquiring biometric information from wearable devices worn by users such as the elderly and sharing the biometric information with family and community observers, it is possible to monitor the user's activity status and health status, and the observer can monitor the user's activity status and health status. You can know the abnormality.

In Patent Document 1, biometric information of a resident is acquired by a sensor attached to bedding so as not to impair the comfort of the resident, and when an abnormality (life or death) of the resident is detected from this biological information, the information is described. A home monitoring device that notifies the observer to that effect is described. It is also described that the accuracy of abnormality detection is improved by combining the biological information with the number of times the door is opened and closed.

Patent Document 2 describes a communication management system that dynamically forms a communication network between users and supports activation of communication regarding the health and life of users. In this communication management system, the user's vital data and daily life sounds are acquired by a wearable device attached to the user, the user's state is judged from the information, and a communication network is dynamically formed.

Japanese Unexamined Patent Publication No. 2014-149751 Japanese Unexamined Patent Publication No. 2015-5259

However, the home-based monitoring device described in Patent Document 1 only determines abnormalities related to life and death of home-based persons, and detects abnormalities such as activity status and health status other than life-and-death of home-based persons. Not. In addition, only the observer such as a family member can know the abnormality of the person at home, and when the observer such as a family member lives in a distant place, it takes time for the observer to go to the person at home. , There is a problem that the abnormality cannot be dealt with promptly.

The communication management system described in Patent Document 2 has a problem that the user needs to wear a wearable device in order to acquire vital data, which impairs the comfort of the user's life. Further, if the wearable device is forgotten to be attached or the battery is exhausted, there is a problem that vital data cannot be acquired. Furthermore, since all vital data is transmitted to the cloud server in order to form a communication network, there is a risk that personal information regarding the health condition of the individual user will be leaked, and there is also a problem of increasing the burden on the cloud server.

The present invention solves the above-mentioned problems, and can naturally acquire information on the activity status and health condition when a user goes in and out of a door without using a wearable device, and can notify the abnormality. It is an object of the present invention to provide a door system, a control device for the door system, and a monitoring method using the door system. Another object of the present invention is to provide a door system in which personal information such as a user's health condition is not leaked and a monitoring method using the door system.

In order to solve the above problems, the door system of the present invention is an activity information acquisition unit having at least one sensor provided inside the door and acquiring activity information of a user who enters and exits the door, and is activity information. It has an activity information acquisition unit that acquires the activity information of the user without requiring the operation of the user who is aware of the acquisition, and at least one sensor provided on the door, and obtains biometric information of the user who enters and exits the door. A biometric information acquisition unit for acquiring biometric information, which acquires biometric information of the user without requiring an operation of the user who is aware of the acquisition of biometric information, and a door or a door provided near the door. From the dialogue unit for interacting with the user who goes in and out of the user in a predetermined manner, the activity information acquired by the activity information acquisition unit, and the dialogue voice by the dialogue unit, the activity status of the user going out, at home, or going out can be determined. A control unit that has a function of generating personal data of the user from the confirmed and confirmed activity status of the user and the biometric information acquired by the biometric information acquisition unit, and a function of detecting an abnormality of the user from the personal data. The control unit includes a communication unit that notifies the observer of an abnormality detected by the control unit via a network, and a storage unit that stores personal data generated by the control unit. Further, it has a function of acquiring emotions when the user goes out and when returning home from the dialogue voice by the dialogue unit and a function of analyzing the relationship between the emotions and the destination, and the storage unit has the analyzed emotions and going out. you save the relationship between the above as personal data.

Here, the control unit further has a function of generating shared data in a format in which the individual user cannot be identified from the personal data, and the communication unit uses the shared data generated by the control unit on the network. It is also preferable to send it to the server.

Further, it is also preferable that the control unit has a function of generating the outing pattern data of the user from the personal data, and detects an abnormality of the user including the outing pattern data.

Further, it is also preferable that the control unit has a function of identifying an individual user from the dialogue voice by the dialogue unit.

Further, it is also preferable that the abnormality notification means provided on the outside of the door is provided, and the control unit notifies the user when an abnormality is detected by the abnormality notification means.

Further, it is also preferable that the door or a display unit provided near the door is provided so that personal data stored in the storage unit can be appropriately displayed.

The present invention can be realized as a monitoring method using the door system.

In the present invention, since the door or the vicinity of the door that always passes when going out or returning home is provided with an activity information acquisition function, a biological information acquisition function, and a voice recognition function, it is not necessary to use a wearable device and a special operation is required. It is possible to naturally acquire the user's outing history and health status without having to do so. In addition, when the acquired activity information, biological information, and activity pattern data differ from the normal ones beyond the set threshold value, it is judged that the user is abnormal, so that the user's abnormal behavior or changes in health status can be changed. Since it is possible to detect alive and alive, it is possible to promptly notify the observer of a user's abnormality.

In addition, personal data, shared data, and outing pattern data are generated from the acquired activity information and biometric information, and only the shared data is sent to a server connected to a network such as the Internet, reducing the risk of leakage of personal information. can do. In addition, by sharing and utilizing shared data such as the user's outing with the local community so that the individual user cannot be identified, the destination of the local people can be known, and the motivation to go out and communication can be promoted. It can be connected to support.

In addition, by recognizing the user's emotions from the dialogue voice in the dialogue section and analyzing the relationship between the user's outing and emotions, it is possible to recognize which outing the user prefers, which is recommended for the user. You can be informed of events such as.

Furthermore, by notifying the user of an abnormality by means of an abnormality notification means such as an LED provided on the outside of the door, even if a monitor such as a family member lives in a distant place and it is difficult to immediately confirm it. People in the vicinity will soon be able to recognize it and deal with it.

As described above, according to the present invention, it is possible to manage the constant health condition of the user, especially the elderly, so that the healthy life expectancy can be extended, and the burden of long-term care for a monitor such as a family member can be increased. It can be reduced and lead to a reduction in medical expenses. In addition, since the risk of leakage of personal information can be reduced, the risk of fraudulent damage by the user can be reduced.

It is a block diagram which shows outline of the whole monitoring system using the door system of this invention. It is a functional block diagram which shows one Embodiment of the door system of this invention. It is a figure which shows an example of the door composition in the door system of this invention, FIG. (A) shows the inside of a door, and FIG. (B) shows the outside of a door. It is a figure which shows the specific example of the personal data stored in the storage part. It is a figure which shows the specific example of the shared data stored in a storage part. It is a figure which shows the specific example of the outing pattern data which is stored in the storage part. It is a figure which shows the specific example of the analysis result of the relationship between the going out and the emotion stored in the memory part. It is explanatory drawing which shows the example of the abnormality detection processing in an abnormality detection part, FIG. 3A shows an abnormality detection threshold value, and FIG. 2B shows an abnormality detection condition. It is a flowchart which shows the acquisition process of activity information and biometric information in a door system, FIG. (A) shows the operation when the user goes out, and FIG. (B) shows the operation when the user returns home. It is a flowchart which shows the abnormality detection processing in an abnormality detection part. It is a functional block diagram which shows one Embodiment of a server. It is a figure which shows the specific example of the user biometric information stored in the storage part of a server. It is a figure which shows the specific example of the user activity information stored in the storage part of a server. It is a figure which shows the specific example of the statistical information stored in the storage part of a server. It is a flowchart which shows the process in a server.

Hereinafter, the present invention will be described with reference to the drawings.

FIG. 1 is a configuration diagram schematically showing a monitoring system using the door system of the present invention.

This monitoring system acquires activity information and biometric information when users a and b enter and exit the door 20, and detects and notifies an abnormality of the user from the information on a network N such as the Internet. It is configured by connecting to a server S and a monitor terminal such as a family F or a public institution P via a PC, for example, a PC.

Hereinafter, the configuration of the door system of the present invention will be described in detail.

FIG. 2 is a functional block diagram showing an embodiment of the door system of the present invention. Further, FIG. 3 is a diagram showing an example of a door configuration in the door system of the present invention, in which FIG. 3A shows the inside of the door and FIG. 3B shows the outside of the door.

The door system of the present embodiment includes a biological information acquisition unit 21, an activity information acquisition unit 22, a dialogue unit 23, a display unit 24, an abnormality notification means 25, a control unit 26, a storage unit 27, and a communication unit 28.

In the following description, it is assumed that all the components of the door system are provided on the door 20, but in this door system, some sensors of the biometric information acquisition unit 21 and the activity information acquisition unit 22 are provided on the door 20. It may be mounted, and other components may be provided in the house near the door or away from the door 20. Therefore, the door system of the present invention does not require that all the components included in the door system be mounted on the door 20, and even if some of the components are provided in the vicinity of the door or in a house away from the door 20. It's a good one.

The biometric information acquisition unit 21 acquires the biometric information of the user, and includes, for example, a heart rate sensor and an infrared thermometer provided on the doorknob inside the door. The heart rate sensor can acquire the user's heart rate, and the infrared thermometer can acquire the user's body temperature in a non-contact manner. The infrared thermometer may be provided in the vicinity of the door 20.

The heart rate (pulse) sensor is already known, for example, as described in NTT DOCOMO Technical Journal Vol.18 No.4 p61-64. Also, http://www.yuden.co.jp/jp/solutions/piezoelectric/scene/
Discloses a heart rate sensor using a piezoelectric element. Such a technique can be used to acquire biometric information.

The activity information acquisition unit 22 is for acquiring activity information as to whether the user is out of the office or at home. For example, a door sensor for detecting the opening / closing of a door and a motion sensor provided on the upper part inside the door. Equipped with a sensor. Since the motion sensor only needs to detect the user entering and exiting the door 20, it may be provided in the vicinity of the door 20.

The dialogue unit 23 is a voice input / output unit used for interacting with a user in a predetermined dialogue mode, and includes, for example, a microphone and a speaker. The microphone and the speaker may be provided in the vicinity of the door 20.

The display unit 24 is, for example, a touch panel, and appropriately displays the biological information acquired by the biological information acquisition unit 21 and the activity information acquired by the activity information acquisition unit 22, and the user himself / herself or the observer can display the health condition of the user. To be able to grasp. In addition, the display unit 24 appropriately displays the area information transmitted from the server S, as will be described later. The display unit 24 may be provided in the vicinity of the door 20, or a personal computer or the like owned by the user may be used.

When the abnormality notification means 25 detects a user abnormality from the biometric information acquired by the biological information acquisition unit 21 or the activity information acquired by the activity information acquisition unit 22 by the control unit 26, the abnormality notification means 25 notifies the abnormality to the outside. For example, an LED provided at or near the upper part of the outside of the door is provided. Since the user's abnormality is notified to the outside by lighting the LED or the like, a nearby person can quickly recognize the abnormality even if he / she is not the observer.

The control unit 26 includes an information processing unit 261 that processes the biometric information acquired by the biometric information acquisition unit 21 and the activity information acquired by the activity information acquisition unit 22, a voice processing unit 262 that processes the dialogue voice by the dialogue unit 23, and the voice processing unit 262 that processes the dialogue voice by the dialogue unit 23. The abnormality detection unit 263 for detecting a user's abnormality is provided. The control unit 26 does not need to be provided in the door 20, and may be provided in the vicinity of the door 20 or in the house. Further, the functions of each unit of the control unit 26 may be realized by software.

The information processing unit 261 includes a shared data generation unit, a personal data generation unit, and an outing pattern data generation unit, and the personal data generation unit includes biometric information and activity information acquired by the biometric information acquisition unit 21 and the activity information acquisition unit 22. Is converted into personal data, the shared data generation unit converts biological information and activity information into shared data, and the outing pattern data generation unit generates outing pattern data from the activity information of personal data.

The voice processing unit 262 includes a voiceprint authentication unit, a voice recognition unit, and a dialogue voice generation unit. The voiceprint authentication unit is provided to identify an individual user from the dialogue voice and to connect the identified individual user with personal data, shared data, and outing pattern data. Further, the voice recognition unit recognizes the dialogue content of the dialogue voice, and the dialogue voice generation unit generates the dialogue voice with the user in a predetermined form.

In addition, the voice recognition unit recognizes the emotions of the user when going out / returning home, such as the magnitude, strength, high / low, and intonation of the dialogue voice. The judgment index for classifying the user's emotions may be obtained by a statistical method or learning for many people. For example, http://www.agi-web.co.jp/index.html
http://medical-pst.com/products-2/emotion
The technology of emotion recognition is introduced in. Such technology can be used to acquire user emotions.

The anomaly detection unit 263 detects the user's abnormality from the biometric information and activity information of personal data or the combination of the biometric information and the activity information, notifies the abnormality to the monitor of the family F or the public institution P, and at the same time, the door. The abnormality notification means 25 provided on the outside of the 20 notifies the outside.

The storage unit 27 stores personal data and shared data converted by the information processing unit 261 of the control unit 26, and further stores the outing pattern data generated by the outing pattern data generation unit of the information processing unit 261. Personal data, shared data, and outing pattern data are stored for a certain period of time or a certain number of data in the past, and when new data is acquired, the oldest ones are deleted.

The communication unit 28 controls communication between the door system and the server S or the observer (family F or public institution P) via the network N such as the Internet. The storage unit 27 and the communication unit 28 do not need to be provided in the door 20, and may be provided in the vicinity of the door 20 or in the house.

FIG. 4 is a specific example of personal data stored in the storage unit 27.

First, as personal data, an ID (personal ID) is given to each user, and user information such as physical information (age, gender, height, weight), address (not shown), etc. is registered in advance in association with the personal ID. .. In addition, the average value of the user's body temperature and heartbeat measured during a certain period in the past is also saved as personal data, and is updated when a new body temperature or heartbeat is acquired by the biological information acquisition unit 21.

The personal ID is used by the server S to manage the shared data, but as will be described later, the shared data transmitted from the door system side to the server S includes information that links the personal ID and the individual user. Therefore, the individual user is not identified only by the personal ID, and privacy is protected by this.

In addition, the storage unit 27 contains personal data such as the date and time of activity, whether to go out or go home, where to go, temperature, weather, body temperature and heartbeat biometric information, and emotions when going out / returning home (normal / happy / angry / sad). Save information such as.

Information on the date and time of the activity, whether to go out or go home, and where to go can be obtained from the dialogue voice by the activity information acquisition unit 22 and the dialogue unit 23 of the door 20, and the temperature and weather are the weather published on the Internet. You can get it from the situation. In addition, the biological information of body temperature and heartbeat can be acquired from the biological information acquisition unit 21 of the door 20, and the emotions of the user when going out / returning home are the magnitude, strength, high / low, and intonation of the dialogue voice by the dialogue unit 23. It can be obtained by recognizing such things. The judgment index for classifying the user's emotions may be obtained by a statistical method or learning for many people.

FIG. 5 is a specific example of the shared data stored in the storage unit 27.

The shared data is generated by converting personal information by the shared data generation unit of the information processing unit 261. For example, user information including personal ID, age and gender, outing / home status and activities including going out. The biometric information of the body temperature and the heartbeat acquired by the information and biometric information acquisition unit 21 is converted into the biometric information of the body temperature and the heartbeat.

The conversion from personal information to shared data can be performed using a predetermined threshold value. For example, for user information, the age (60s, 70s, 80s, etc.) is obtained from the age, and the age is stored in the storage unit 27 as shared data. Regarding the activity information, the user's status (whether he / she is out or at home) is determined based on the detection by the motion sensor and the door sensor, and the determination result is stored in the storage unit 27 as shared data.

Further, regarding the body temperature of the biological information, the body temperature of the personal information is classified into normal fever, low-grade fever or high fever by using a preset threshold value. For example, if the temperature is lower than 37.0 ° C, it is classified as normal heat, if it is 37.0 ° C or higher and lower than 38.0 ° C, it is classified as low-grade fever, and if it is 38.0 ° C or higher, it is classified as high heat. In addition, the heart rate is classified into normal, high, and low by comparing with the average value so far. For example, it is classified as high or low depending on whether or not it deviates from the range of the average value of ± 20%.

FIG. 6 is a specific example of the outing pattern data stored in the storage unit 27.

The outing pattern data is generated every day by the outing pattern data generation unit of the information processing unit 261. For example, the number of outings and the frequency of going out for each time zone, the number of outings for the last 7 days, and the last 2 days. Includes the number of times you go out for a minute and the number of times you go out on the day. In FIG. 5, the number of times of going out for the last 7 days and the number of times of going out for the last 2 days are obtained and saved, but how many days of going out are saved is set according to the abnormality detection condition.

For the number of outings for each time zone, the number of measurement days, the total number of outings in the measurement days, and the average number of outings per day are also saved. The number of outings is measured, for example, throughout the year. The number of measurement days (7 days, 2 days), the total number of outings, and the average number of outings per day are also saved for the number of outings for the last 7 days and the last 2 days. Although not shown here, if conditions such as temperature, weather, and day of the week are set and outing pattern data is acquired for each condition, each of these conditions is included in the abnormality detection conditions to detect the user's abnormality in detail. can do. In addition, since it is expected that the number of times the user goes out and the place to go out will change depending on the season, the season may be included in the abnormality detection condition. For example, anomaly detection conditions can be determined by comparing with the average number of outings per day in the relevant season last year. If the conditions for acquiring the outing pattern data are set in detail, the acquisition and processing of the data will be burdensome, but the user abnormality can be detected under the detailed abnormality detection conditions.

Each data of the outing pattern data of FIG. 6 can be obtained by the following procedures (1) to (4).
(1) Count the number of times you go out on the day from the activity information of personal information for each time zone and save it.
(2) The number of measurement days is incremented every day.
(3) Add the number of outings on the day to the total number of outings, and calculate the average number of outings per day from the number of measurement days and the total number of outings.
(4) From the activity information of personal data, add the number of times of going out for each time zone of the day to the time zone of going out. Furthermore, the frequency of going out for each time zone (ratio) is obtained from the total number of times of going out and the number of times of going out for each time zone.
(5) The same applies to the latest 7 days and the last 2 days.

The storage unit 27 may analyze the relationship between going out and emotions and store the analysis result. The user's preference can be obtained using this analysis result, and regional information such as event information that matches the user's preference can be provided to the user. For example, if the analysis result is sent from the user side to the server S side, the area information that suits the preference on the server S side can be selected and sent to the user side, or all the areas sent from the server S side. From the information, the user can select the area information that suits the preference of the analysis result, and display it with priority.

FIG. 7 is a specific example of the analysis result stored in the storage unit 27.

From the emotions of personal data, the relationship between the emotions after going out and the emotions after going out is statistically obtained, and the relationship between the emotions after going out (normal, joy, anger, sadness) with respect to the outing is calculated as a percentage (%). For example, for the user of the analysis result of FIG. 6, the regional information regarding the “○ △ center” having a large ratio of “joy” of emotions after going out is recommended.

FIG. 8 is an explanatory diagram showing an example of an abnormality detection process in the abnormality detection unit 263.

In order to determine the user's abnormality from the biometric information, threshold values are set for the body temperature and heartbeat of the biometric information of personal data. As shown in FIG. 8A, it is preferable to set a plurality of threshold values. The threshold value 1 in this example is a value for determining an abnormality by combining with other information, and even if the threshold value is exceeded by itself, it is not determined as an abnormality. The threshold value 2 is a value for determining an abnormality by itself, and if the threshold value is exceeded, the abnormality is determined regardless of other conditions. FIG. 8B shows an example of an abnormality detection condition set for determining an abnormality. In this way, the abnormality detection condition for determining the abnormality is set, and when the abnormality detection condition is satisfied, the observer is notified that there is a possibility that the user has an abnormality.

As shown in FIG. 6, if the number of outings for the last 7 days or the last 2 days is calculated and saved, the user may go out in a week or 2 days when the number of outings is extremely small or extremely large. It is possible to notify the observer that there may be an abnormality in.

In the example of FIG. 8, when the body temperature is high fever of 38 ° C. or higher or the heart rate is + 30% or higher on average, it is judged as abnormal according to the condition (1), and the body temperature is 37 ° C. to 38 ° C. If it is 30%, it is judged to be abnormal according to condition (2). However, if the body temperature is low-grade fever at 37 ° C to 38 ° C and the heartbeat is near the average value, or if the heartbeat is near the average value + 20 to 30%, but the body temperature is near the average value, it is not judged to be abnormal.

It is also possible to determine the user's abnormality based on the outing pattern data. This determination can be made, for example, by referring to the outing frequency for each time zone of the outing pattern data. In a specific example, it is determined that the user has an abnormality when he / she goes out more than a certain number of times in a certain period of time in recent years, even though the frequency of going out is low until now. The condition (3) in FIG. 8 (b) is this judgment condition. Here, the frequency of going out is less than 5% until now, but in the last week, there have been five or more times of going out. If so, it is determined to be abnormal. Further, the abnormality may be determined on condition that the number of times of going out in a day is less than the set value. For example, if there are two days in which the person does not go out even once, it is determined to be abnormal.

It is also possible to determine the user's abnormality from the combination of the biological information and the outing pattern data. For example, if either the body temperature or the heart rate of the biological information is abnormal and the number of times of going out in a day is less than a certain level, it is determined to be abnormal. According to this, the accuracy of abnormality detection can be improved as compared with the case where the biological information is used alone or when the outing pattern data is used alone, and it is determined that the abnormality is abnormal as compared with the case where the outing pattern data is used alone. The time to do so can be shortened.

Next, the processing in the door system of the present invention will be described.

FIG. 9 is a flowchart showing the process of acquiring activity information and biometric information in the door system, FIG. 9A shows the process when the user goes out, and FIG. 9B shows the process when the user returns home. The processing at the time is shown.

As shown in FIG. 9A, when the user approaches the front door 20 when going out, the motion sensor of the activity information acquisition unit 22 reacts (S1), and the speaker of the dialogue unit 23 makes a voice announcement, for example. , A voice announcement is played asking where to go or where to go. When the user announces that he / she is going out and where he / she is going according to this voice announcement, the dialogue voice is input to the voice processing unit 262 through the microphone of the dialogue unit 23. The voice recognition unit of the voice processing unit 262 recognizes the dialogue voice, confirms the outing (S2), acquires the result of the outing confirmation (S3), and determines whether or not the user goes out (S4). If it is determined that the user is not going out, the process is terminated, but if it is determined that the user is not going out, the outing destination recognized from the dialogue voice is confirmed (S5).

Next, the voiceprint authentication unit of the voice processing unit 262 identifies the individual user from the voiceprint of the dialogue voice (S6), then acquires the user's emotion from the dialogue voice (S7), and further, the confirmed outing Get (S8).

The outing and emotions acquired as described above are stored as personal data in the storage unit 27 (S9). At the same time, the outing / returning status of going out is stored in the storage unit 27 as personal data.

Next, when the user grasps the doorknob while going out, the heart rate sensor provided on the doorknob acquires the user's heart rate (S10). In addition, an infrared thermometer installed near the door 20 or the door 20 measures the user's body temperature in a non-contact manner and acquires the information (S11).

The heartbeat and body temperature acquired as described above are stored as personal data in the storage unit 27. In addition, the average body temperature and average heart rate of the personal data are updated to newly obtained values including the body temperature and heart rate acquired this time, and are stored in the storage unit 27 (S13).

Next, when the user goes out from the door 20, the door sensor reacts (S14), and the time is stored in the storage unit 27 as the date and time when the personal data goes out (S15).

The personal data acquired as described above is converted by the shared data generation unit so that the individual user cannot be identified, and is stored in the storage unit 27 as shared data (S16). This shared data is transmitted from the communication unit 28 to the server S via the network N and shared with the local community (S17).

As shown in FIG. 9B, the door sensor responds when the door 20 opens when the user returns home (S21). After that, when the user enters the house, the motion sensor reacts (S22) and a voice announcement is played. When the user emits a dialogue voice according to this voice announcement, the voice recognition unit recognizes it, confirms whether the user has returned home (S23), and determines whether or not the user has returned home (S24). If it is determined that the user has not returned home, the process is terminated, but if it is determined that the user has returned home, the date and time of returning home is saved as personal data in the storage unit 27 (S25). At the same time, the out-of-home / return status is stored in the storage unit 27 as personal data.

Next, the voiceprint authentication unit identifies the individual user from the voiceprint of the user's dialogue voice (S26), and then acquires the user's emotion from the voice (S27). The acquired emotions are stored in the storage unit 27 as personal data (S28).

Next, the shared data generation unit updates the status of the activity information of the shared data at home (S29), and clears the out-of-home and biometric information of the shared data (S30). This shared data is transmitted from the communication unit 28 to the server S via the network N and shared with the local community (S31).

FIG. 10 is a flowchart showing an abnormality detection process in the abnormality detection unit 263. This abnormality detection process is executed at a predetermined time or at regular time intervals when the user's biometric information is acquired.

First, the latest biometric information is acquired from the personal data stored in the storage unit 27 (S41), and it is determined whether or not it exceeds the threshold value (1 or 2) (S42). Here, if it is determined that the biological information does not exceed the threshold value, the process proceeds to S44, but if it is determined that the threshold value is exceeded, it is further determined whether or not the abnormality detection condition is satisfied (S43).

If it is determined that the abnormality detection condition is not satisfied, the process proceeds to S44, but if it is determined that the abnormality detection condition is satisfied, the communication unit 28 notifies the observer of the abnormality via the network N (S46). Further, the abnormality notification means 25 outside the door is turned on and controlled (S47).

In S44, the outing pattern data is acquired (S44), and it is determined whether the outing pattern data alone or the combination of the biological information and the outing pattern data satisfies the abnormality detection condition (S45).

If it is determined that the abnormality detection condition is not satisfied, the process is terminated, but if it is determined that the abnormality detection condition is satisfied, the communication unit 28 notifies the observer of the abnormality by e-mail or the like via the network N. (S46), and further control the lighting of the abnormality notification means 25 outside the door (S47).

FIG. 11 is a functional block diagram showing an embodiment of the server S.

As shown in FIG. 11, the server S of the present embodiment includes a control unit 30, a storage unit 31, and a communication unit 32, aggregates information from users a and b and a public institution P, and manages it as shared data. ..

The control unit 30 includes an information processing unit 301 and a statistical information generation unit 302, and the information processing unit 301 processes shared data transmitted from the user's door system and regional information transmitted from the public institution P. The statistical information generation unit 302 generates statistical information from the shared data transmitted and saved from the user side, and if it receives new shared data from the user side and saves it, it seeks new statistical information including it. , Update to it.

The storage unit 31 stores the shared information processed by the information processing unit 301 as user biometric information and user activity information, and also stores regional information received from the public institution P. The storage unit 31 further stores the statistical information generated by the statistical information generation unit 302. Statistical information is shared with each user and used as user's health management support and communication support.

The communication unit 32 controls communication between the server S and the door system of the users a and b and the monitor terminal of the family F or the public institution P.

FIG. 12 is a diagram showing a specific example of user biometric information stored in the storage unit 31 of the server S.

In the user biometric information, the ID (personal ID) and the biometric information of the shared data are listed and saved in a corresponding form, and when the shared data is received from the user side, the update time is saved. ..

FIG. 13 is a diagram showing a specific example of user activity information stored in the storage unit 31 of the server S.

In the user activity information, when the status of the shared data received from the user side is out of the office, the personal ID and the outing place are saved, and further, the total number of people currently out of the office is saved for each outing place. For example, 5 people are stored in XX Park, 3 people are stored in XX Supermarket, and 2 people are stored in XX Hospital. In addition, when the status of the shared data received from the user side is home, the information of the corresponding personal ID is deleted and the total number of people is updated.

FIG. 14 is a diagram showing a specific example of statistical information stored in the storage unit 31 of the server S.

In the statistical information, data that statistically represents the user biometric information of the shared data received from the user side is stored. Statistical information represents the health status of people in the area, and in the statistical information generation unit 302, for example, the number or proportion of people with normal, low-grade fever, or high body temperature, the number of people with normal, high, or low heart rate, or The ratio etc. are calculated, and the value is saved as statistical information. Data that aggregates the degree of crowding (number of people) of people for each location from user activity information may be saved as statistical information.

Local information is local event information and notification information received from public institutions. For example, local event information from government agencies such as city halls, alerts to residents based on health statistics information, etc., and this information is shared with users and local communities. As described above, the user can browse the regional information according to the statistically requested taste, and the local person can appropriately request and browse the regional information from a PC or the like.

FIG. 15 is a flowchart showing processing on the server S.

Server S starts listening for shared data transmitted from the door system of users a and b or regional information transmitted from the monitor terminal of public institution P (S51), and when it receives the data (S52), It is determined whether the received data is the shared data from the door systems of users a and b or the regional information from the monitor terminal of the public institution P (S53).

Here, when the received data is determined to be the area information from the public institution P, the received data is stored in the storage unit 31 as the area information (S59).

When the received data is determined to be shared data from users a and b in S53, it is determined whether the status of the activity information is out of the office or at home (S54). Here, when the status of the activity information is determined to be out of the office, the personal ID of the received shared data and the outing destination are added to the storage unit 31 as user activity information and saved (S55), and the user of the storage unit 31 is saved. Update the biometric information of the corresponding personal ID in the biometric information (S56). Further, new statistical information including the newly added user biometric information is generated by the statistical information generation unit 302 and stored in the storage unit 31 (S57).

When the status of the activity information is determined to be at home in S54, the user activity information of the same personal ID as the personal ID of the received shared data is deleted from the storage unit 31.

Although the embodiments of the present invention have been described above, the present invention is not limited to the above-described embodiments, but also includes various modifications.

For example, it is estimated that the user goes out or goes home from the information of the motion sensor or the door sensor, but the confirmation or the dialogue voice of the go-out cannot be recognized. If the unrecognizable situation continues for a certain number of times or for a certain period of time or longer, the user's abnormality (suspicion of dementia) can be detected using that as an abnormality detection condition, and the observer can be notified to that effect.

Further, in the above embodiment, the individual user is identified by the voiceprint authentication of the dialogue voice, but if the doorknob is provided with the fingerprint acquisition means or the camera is provided near the door, the individual user is identified from the acquired fingerprint or image. be able to.

Further, the door system of the present invention does not have to be in the form already installed in the door or in the vicinity of the door, and some of the components thereof can be mounted on the door, and other components can be mounted in the vicinity of the door or in a house away from the door. It suffices if it is configured so that it can be installed in the door.

Further, the present invention is also effective as a monitoring method using the door system.

20 ... door, 21 ... biometric information acquisition unit, 22 ... activity information acquisition unit, 23 ... dialogue unit, 24 ... display unit, 25 ... abnormality notification means, 26,30 ...・ ・ Control unit, 27,31 ・ ・ ・ Storage unit, 28,32 ・ ・ ・ Communication unit, 261,301 ・ ・ ・ Information processing unit, 262 ・ ・ ・ Voice processing unit, 263 ・ ・ ・ Abnormality detection unit, 302 ・ ・・ Statistical information generator, a, b ・ ・ ・ user, F ・ ・ ・ family, N ・ ・ ・ network (Internet), P ・ ・ ・ public institution, S ・ ・ ・ server

Claims (10)

It is an activity information acquisition unit that has at least one sensor provided inside the door and acquires activity information of a user who enters and exits the door, and does not require an operation of the user who is conscious of acquiring the activity information. The activity information acquisition department that acquires user activity information,
A biometric information acquisition unit having at least one sensor provided on the door and acquiring biometric information of a user entering and exiting the door, without requiring the user's operation conscious of biometric information acquisition. The biometric information acquisition unit that acquires the biometric information of
A dialogue unit provided at or near the door for interacting with a user entering and exiting the door in a predetermined manner.
From the activity information acquired by the activity information acquisition unit and the dialogue voice by the dialogue unit, the activity status of the user going out, at home, or on the go is confirmed, and the confirmed user activity status and the biometric information acquisition unit A control unit having a function of generating personal data of the user from the biometric information acquired by the user and a function of detecting an abnormality of the user from the personal data.
When an abnormality is detected by the control unit, a communication unit that notifies the observer to that effect via the network, and a communication unit.
A storage unit for storing personal data generated by the control unit is provided .
The control unit further has a function of acquiring emotions when the user goes out and when returning home from the dialogue voice by the dialogue unit, and a function of analyzing the relationship between the emotions and the destination, and the storage unit analyzes the emotions. door system which is characterized that you saved the relationship between emotion and go as personal data. The control unit further has a function of generating shared data in a format that does not identify the individual user from the personal data, and the communication unit transmits the shared data generated by the control unit to a server on the network. The door system according to claim 1. The control unit further has a function of generating outing pattern data of the user from the personal data, and is characterized in that an abnormality of the user is detected including the outing pattern data according to claim 1 or 2. The door system described. The door system according to any one of claims 1 to 3, wherein the control unit further has a function of identifying an individual user from a dialogue voice by the dialogue unit. Further, an abnormality notification means provided on the outside of the door is provided.
The door system according to any one of claims 1 to 4 , wherein the control unit notifies the user when an abnormality is detected by the abnormality notification means. The door according to any one of claims 1 to 5 , further comprising a display unit provided on or near the door, and capable of appropriately displaying personal data stored in the storage unit. system. It is a monitoring method using a door system.
It has at least one sensor provided inside the door, and enters and exits the door acquired by the activity information acquisition unit that acquires the activity information of the user without requiring the operation of the user who is conscious of the activity information acquisition. From the activity information of the user and the dialogue voice by the dialogue unit for interacting with the user who enters and exits the door at or near the door in a predetermined manner, the activity status of the user going out, at home, or going out can be determined. Steps to check and
By the biometric information acquisition unit that has the confirmed activity status of the user and at least one sensor provided on the door, and acquires the biometric information of the user without the need for the user's operation conscious of the biometric information acquisition. A personal data generation step that generates personal data of the user from the acquired biometric information, and
Anomaly detection step that detects anomalies of the user from the personal data generated in the personal data generation step, and
When an abnormality of the user is detected in the abnormality detection step, the step of notifying the observer to that effect via the communication unit and the network, and
Have a personal data storage step of storing personal data generated by the personal data generating step,
Further, in the personal data generation step, emotions when the user goes out and when returning home are acquired from the dialogue voice by the dialogue unit, the relationship between the emotions and the outing destination is analyzed, and in the personal data storage step, the personal data is obtained. A monitoring method characterized by storing the relationship between emotions analyzed in the generation step and going out as personal data. Further, a shared data generation step of generating shared data in a format in which the individual user cannot be identified from the personal data,
The monitoring method according to claim 7 , further comprising a step of transmitting the shared data to a server on the network. Further, it has an outing pattern generation step of generating outing pattern data of the user from the personal data.
The monitoring method according to claim 7 or 8 , wherein the abnormality detection step detects an abnormality of the user including the outing pattern data generated in the outing pattern generation step. Any one of claims 7 to 9 , wherein the abnormality notification step includes an abnormality notification step for notifying the user when an abnormality is detected in the abnormality detection step by an abnormality notification means provided on the outside of the door. The monitoring method described in 1.

Images