JP7274081B2 - Monitoring device, monitoring method and monitoring program - Google Patents

Description

The present invention relates to a watching device, a watching method, and a watching program.

Recently, in developed countries, the number of elderly people living alone is increasing along with the declining birthrate and aging population. When a single elderly person has a child, the single elderly person often lives in a place away from the child. Therefore, it is a big worry for children that they do not know how their parents are doing. Therefore, a system for knowing the state of a single elderly person living in a remote place has become widespread.

The life watching device of Patent Literature 1 receives detection of a person being watched over by a motion sensor installed in the living room. The device recognizes the start, end, etc. of sleep of the person being watched over by applying a predetermined threshold value to the cumulative number of detections of the person being watched over within a predetermined period of time. That is, the device determines that sleep begins when the cumulative number of sensor responses becomes sparse (there is no sensor response for one hour), and that sleep ends when the cumulative number of sensor responses becomes dense.

Patent No. 6145907

In the life watching device of Patent Document 1, the accuracy of recognizing the start and end of sleep of the watched person decreases depending on the setting of the threshold. Moreover, the device simply determines that the person being watched is sleeping when the person being watched is not in the living room. In other words, the device leaves the substantive determination of whether or not the person being watched over was actually asleep while the person was not in the living room.

For example, if the person being watched is not in the living room at night, the watcher would like to know whether it means sleeping or going out. Also, the watcher wants to know whether or not it can be determined that the person being watched was asleep before waking up temporarily at night and stopping by the living room to go to the bathroom or the like. Of course, it is difficult to completely satisfy the needs of such watchers. However, there is a demand for a technique that can meet such needs even a little.
SUMMARY OF THE INVENTION Accordingly, it is an object of the present invention to accurately acquire the sleep time of a single person at night.

The watching device of the present invention acquires sensor information for receiving information indicating that the person being watched over is in the living room or information indicating that the person being watched over is not in the living room from a sensor installed in the living room of the person being watched over. part of the information indicating that the person being watched over is not in the living room, the information acquired by the sensor at night is reconsidered as information indicating that the person being watched over is asleep, and the person being watched over is asleep. a sensor information processing unit that re-reviews information that satisfies a predetermined condition among the displayed information to information indicating that the person being watched over is not in the living room.
Other means are described in the detailed description.

ADVANTAGE OF THE INVENTION According to this invention, the sleep time at night of a single person can be acquired correctly.

It is a figure explaining the environment of this embodiment, and the structure of a watching apparatus. (a) and (b) are figures explaining the information which a sensor acquires. It is a figure which shows an example of the information from a sensor. It is a figure which shows an example of state information. It is a figure further explaining the second review. It is a figure which shows an example of activity level information. It is a flow chart of a current state display processing procedure. It is a flow chart of a life rhythm/sleep time display processing procedure. It is an example of a "current situation" screen. It is an example of an active mass screen. It is an example of a life rhythm screen. It is an example of a sleep time screen.

EMBODIMENT OF THE INVENTION Hereinafter, the form (it is called "this embodiment") for implementing this invention is demonstrated in detail, referring drawings. This embodiment is an example in which a child or a relative watches over a single elderly person. However, the present invention can be broadly applied to instances in which one person is watched by another person as they move back and forth between the living room and the bedroom.

(Configuration of environment and monitoring device)
FIG. 1 is a diagram for explaining the configuration of the environment and monitoring device of this embodiment. A person 5 to be watched lives in a residence 6 . In the residence 6, there are no residents other than the watched over person 5 who is an elderly person living alone. The residence 6 has a plurality of rooms, including a living room 6a and a bedroom 6b. The living room 6a and the bedroom 6b are independent rooms with a corridor, a wall, etc. interposed therebetween. The watched person 5 spends the longest time in the living room 6a among the living rooms other than the bedroom 6b. When the person to be watched over 5 is at home, he/she spends most of the daytime in the living room 6a and sleeps in the bedroom 6b at night. Sensors (described later in detail) are installed on the wall, ceiling, etc. of the living room 6a.

The watching device 1 is a general server and constitutes a watching service center. This center watches over a plurality of persons to be watched, to whom the sensors 2 are arranged. This server includes a central control unit 11 , an input device 12 such as a mouse and a keyboard, an output device 13 such as a display, a main storage device 14 , an auxiliary storage device 15 and a communication device 16 . These are interconnected by a bus. The auxiliary storage device 15 stores state information 32 and activity level information 33 (both of which will be described later in detail). The sensor information acquisition unit 21 and the sensor information processing unit 22 in the main storage device 14 are programs. The central control unit 11 reads out these programs from the auxiliary storage device 15 and loads them into the main storage device 14 to implement the functions of the respective programs (details will be described later). The auxiliary storage device 15 may be configured independently from the watching device 1 .

The watching device 1 is connected to the sensor 2 and the terminal device 3 via the network 4 . The terminal device 3 of this embodiment is a portable computer operated by a watcher (not shown). However, the terminal device 3 may be a computer other than a portable computer.

(sensor)
2A and 2B are diagrams for explaining information acquired by the sensor 2. FIG. Sensor 2 is, for example, a three-dimensional camera. The three-dimensional camera acquires whether or not the person to be watched 5 is in the living room 6a, and if so, the three-dimensional coordinate values of the position of the center of gravity (or the position of the head). Then, the sensor 2 obtains the amount of activity based on the three-dimensional coordinate values. In FIG. 2(a), the watched person 5 is in the living room 6a. At this time, the sensor 2 transmits the information "presence" indicating that the person being watched over 5 is in the living room 6a, the amount of activity ♭, and the year, month, day, hour, minute, and second (reference numeral 7a) of the time when these were generated, to the network. 4 to the watching device 1 in real time.

In FIG. 2(b), the watched person 5 is not in the living room 6a. At this time, the sensor 2 monitors, via the network 4, the information "absence" indicating that the person 5 to be watched is not in the living room 6a, and the year, month, day, hour, minute, and second (code 7b) of the time when it was generated. Transmit to device 1 in real time.

Although the details will be described later, the three-dimensional coordinate values are information for the sensor 2 to calculate the amount of activity of the person being watched 5 . The sensor 2 may measure the amount of heat generated by the person 5 to be watched, minute movements of the body, etc. without contact. Ultimately, if the monitoring device 1 can know "presence", "absence", the amount of activity, and the time when these are acquired based on the information acquired by the sensor 2, what kind of sensor 2 can be used? good too.

In general, the person being watched 5 dislikes that his or her own video is leaked to others, including relatives. Therefore, even if the image of the person being watched over 5 can be acquired, the sensor 2 does not transmit the image to the watching device 1 . What is transmitted is data other than video (codes 7a and 7b).

When the sensor information acquisition unit 21 acquires information from the sensor 2 , the sensor information processing unit 22 processes the information at that time, stores necessary information, and transmits the information to the terminal device 3 . When the sensor information processing unit 22 receives the information of "presence" or "absence" from the sensor 2, the time at which "presence" changed to "absence" and the time at which "absence" changed to "presence" are stored in the state. Store in information 32 . In other words, the sensor information processing unit 22 stores the time at which "presence" and "absence" change. Moreover, when the information from the sensor 2 is "presence", the sensor information processing part 22 memorize|stores the time and active mass. Then, the sensor information processing unit 22 transmits to the terminal device 3 of the watcher to be described later that the user is in the living room if the person is "in the room" and the amount of activity, and if the person is "absent", the information that the person is not in the living room is sent along with the time. . Note that the "presence" or "absence" information from the sensor is not used after processing by the sensor information processing unit 22, which will be described later.

(Information from sensor)
Next, what can be learned based on the information from the sensor 2 will be described. FIG. 3 is a diagram showing an example of information 310 from the sensor 2. As shown in FIG. From the sensor, the ID of the person being watched over, the state of the person being watched over, and the amount of activity of the person being watched over are transmitted in association with the time.

The time in the time column 101 is the year, month, day, hour, minute, and second when the sensor 2 acquires the information indicated by the reference numeral 7a in FIG. 2(a) or the information indicated by the reference numeral 7b in FIG. 2(b). In this embodiment, the sensor 2 acquires this information every 5 minutes.
The watched person ID in the watched person ID column 102 is an identifier that uniquely identifies the watched person. In the example of FIG. 3, only "P01" is shown for simplification of explanation. However, the watching device 1 can simultaneously execute processes for a plurality of persons to be watched.

The status in the status column 103 is either "presence" indicating that the person-to-be-watched 5 is in the living room 6a, or "absence" indicating that the person-to-be-watched 5 is not in the living room 6a.

The amount of activity in the amount of activity column 105 is a value obtained by measuring the activity state of the person being watched over by the sensor 2 and quantifying it. In the activity amount column 105 whose state is "absence", "-" indicating that there is no information is entered. In the activity amount column 105 in which the state is "presence", "b" abbreviates different values. "♭♭" indicates that the value is an abnormal value that is not normally assumed (details will be described later).

Looking at FIG. 3, the following can be understood.
- From 00:00:00 to 00:05:00 on November 20, 2018, the person to be watched P01 was in the living room 6a.
- From 00:10:00 to 01:55:00, the watched person P01 was not in the living room 6a. It is highly likely that the person being watched over P01 was in the bedroom 6b during this time.
- From 02:00:00 to 02:10:00, the watched person P01 was in the living room 6a. During this time, it is highly likely that the person being watched over P01 woke up once and passed through the living room 6a to go to the bathroom, or stayed in the living room because he could not fall asleep.

- From 02:15:00 to 06:55:00, the watched person P01 was not in the living room 6a. It is highly likely that the person being watched over P01 was in the bedroom 6b during this time.
- From 07:00:00 to 20:55:00, the watched person P01 was in the living room 6a.
- From 21:00:00 on November 20, 2018 to 13:00:00 on November 21, 2018, the person being watched P01 was not in the living room 6a. During this time, the person being watched over P01 appears to be in the bedroom 6b at first glance, but there is a high possibility that he has gone out to a relative's house, for example. A horizontal double line indicates that the date has changed.
- From 13:05:00 to 13:10:00, the watched person P01 was in the living room 6a.

- The person being watched over P01 was doing some activity when he was in the living room 6a. During the daytime, this activity includes cleaning the inside of the living room 6a, getting up from the sofa and going to the window to look at the garden, and going to the table from the window to eat. There is a high possibility that it is an action such as passing through the living room 6a to go to.
・The amount of activity at 20:50:00 on November 20, 2018 is an abnormal value. At this time, there is a high possibility that a situation completely unrelated to the activities of the person being watched 5 occurs, such as a pet sleeping in the hallway entering the living room 6a and running around, or a neighbor's laundry entering through the window.

A watcher who knows these things comes to have the following concerns 1 to 3, for example.
<Concern 1> Although the person being watched 5 went to the bedroom 6b once, it may be difficult to fall asleep. If so, it is the same as doing something in the living room 6a after all, and sleep time should be insufficient.
<Concern 2> The person being watched 5 may have stayed at someone's house at night. If so, it would be fine if he slept well and behaved well at that house, but not only did he not get enough sleep, but he might have caused trouble for that house.

<Concern 3> The amount of activity of the person being watched 5 at a certain time is clearly abnormal. This outlier may be the result of incorporating some external factor. If so, it's nothing to worry about, but if not, you may be experiencing unexpected symptoms of illness.
A feature of the watching device 1 of the present embodiment is that it eliminates the concerns described above, or, even if it does not eliminate them, it prevents the watching person from having excessive concerns.

(status information)
FIG. 4 is a schematic diagram showing an example in which information obtained by processing and processing sensor information by the sensor information processing unit 22 is stored in the state information 32. As shown in FIG. The left side of the vertical double line of status information 32 is the same as information from sensors 310 (FIG. 3). However, the data that is actually stored is the data in the column on the right side of the double line corresponding to the time when the state changed for each watched person ID. In association with the time stored in the time column 101, the state (after review) column 106 describes the state (after review), and the summary column 107 describes the summary. The status (after review) column 106 further includes a column after replacement 106a, a column after first review 106b, a column after second review 106c, and a final result column 106d. The post-replacement column 106a, the post-first review column 106b, the post-second review column 106c, and the final result column 106d are information transmitted to the terminal device 3 of the watcher along with the time.

"After review" in the term "state (after review)" is paired with "initial value" in the term "state (initial value)". However, hereinafter, in order to avoid complication of expression, "(after review)" in the word "state (after review)" will be omitted unless misunderstanding is caused. Note that "reviewing" means deleting certain information and replacing it with other information, or correcting or correcting certain information to other information. The watching device 1 performs replacement (simple conversion to words for the user), first review, and second review (modification reflecting the meaning of absence) to convert "absence" to "sleep", especially at night. Extract what can be evaluated as ".

(replace)
The status of the post-replacement column 106a is either "in the living room (activity #)" or "not in the living room". The sensor information processing unit 22 of the watching device 1 replaces the state (initial value) in the state (initial value) column 103 according to rules 1 and 2 below. "#" abbreviates different values.
<Rule 1> When the state (initial value) is "absence", the sensor information processing unit 22 replaces it with "not in the living room".

<Rule 2> When the state (initial value) is “in the room”, the sensor information processing unit 22 acquires the amount of activity. Then, the sensor information processing unit 22 applies the acquired amount of activity to the activity level information 33 (described later as FIG. 6) to acquire the corresponding activity category. The activity category acquired here is either "low", "medium" or "high". The sensor information processing unit 22 "is in the living room (low activity level)", "is in the living room (medium activity level)" or "is in the living room (high activity level)" according to the acquired activity category. is classified as a state after replacement. In other words, "I am in the living room (activity amount #)" in FIG.

(First review)
The status in column 106b after the first review is either "sleep", "in living room (activity #)" or "not in living room". A blank in the post-review column 106b indicates "same as left" (details will be described later). The sensor information processing unit 22 reviews the state of the post-replacement column 106a according to rules 11 and 12 below.

<Rule 11> The sensor information processing unit 22 determines that the information sent from the sensor 2 is "absence" and the time is included in the nighttime operation period (from 18:00 on the day to 4:00 on the next day). or not. If the result of the determination is "Yes", the sensor information processing section 22 further divides into the following cases.

The sensor information processing unit 22 stores the time when the information from the sensor 2 changes from "presence" to "absence" during night operation hours. After this change, when "absent" instead of "in the room" is continuously transmitted a predetermined number of times (for example, 12 times for one hour), the sensor information processing unit 22 detects the continuous "not in the living room". to "sleep". In other words, the sensor information processing unit 22 temporarily treats the fact that the user was not in the living room at night as positive “sleep” for health.

That is, when "presence" is transmitted during the nighttime operation period and then changes from "presence" to "absence", the sensor information processing unit 22 stores the time. After that, when "absent" is continuously transmitted a predetermined number of times (for example, 12 times for one hour) (counted by a counter), the sensor information processing unit 22 sets a "sleep flag" in association with the stored time. stand up Then, the sensor information processing unit 22 determines that "not in the living room" after the sleep flag are all "sleep". In this case, the sensor information processing unit 22 deletes the information itself "not in the living room" after the time the sleep flag was set, and changes "not in the living room" after the time the sleep flag was set to "sleep". Along with reviewing, the display of the terminal device 3 is rewritten from "not in the living room" to "sleep".
Otherwise, the sensor information processing unit 22 maintains "not in the living room" as the state after the first review.

In the example described above, the sensor information processing unit 22 sets the sleep flag at the change time when "absence" continues for a predetermined number of times. However, the sensor information processing unit 22 sets a sleep flag and a flag to invalidate the sleep flag at the time of change, and erases the flag to invalidate the sleep flag when "absence" continues for a predetermined number of times. You can enable it.

<Rule 12> The sensor information processing unit 22 detects that the sleep flag is set and the information from the sensor 2 is " When the state changes from "absent" to "in the room", it is judged as "wake up" (108e), the time is recorded, and a message to that effect is transmitted to the terminal device 3. The rules are to account for the start and end of the state "sleep".

In addition, in the column 106b after the first review in FIG. 4, the description of "I am in the living room (activity amount #)" which is maintained as it is is omitted. This is because "I am in the living room (activity amount #)" is interpreted as it is regardless of whether it is daytime or nighttime, and the sensor information processing unit 22 “I am in the living room (activity level #)” will not be reviewed. A blank in the first post-review column 106b means "same as left" (the same applies to the second post-review column 106c).

(Second review)
The states in column 106c after the second review are "sleep", "in living room (activity #)", "not in living room", "start of sleep (go to bed)" and "end of sleep (wake up)". (blank indicates "same as left"). The sensor information processing unit 22 reviews the state of the first post-review column 106b according to rules 21 to 24 below.

<Rule 21> When the information sent from the sensor 2 is “in the room” and the activity amount sent accompanying this is “♭♭”, the sensor information processing unit 22 determines “living room (108f). In other words, it is clarified that the abnormal value can be ignored so as not to give unnecessary concern to the watcher.

<Rule 22> When the sleep flag is set and during the nighttime operating hours, the sensor 2 sends "presence", and this "presence" occurs a predetermined number of times (for example, 3 times for 15 minutes). If the above continues, the sensor information processing unit 22 revises "sleep" before "in the living room (activity level #)" to "not in the living room" (108a to 108c). The sensor information processing unit 22 leaves the sleep flag as it is and raises a flag indicating that the sleep flag is invalid. At this time, the sensor information processing unit 22 also rewrites the display of the terminal device 3 from "sleep" to "not in the living room".

In addition, when the "presence" is less than the predetermined number of times, the sensor information processing unit 22 continues the "sleep" without raising the invalid flag. The sensor information processing unit 22 continues the "sleep" state by determining that the person is "in the room" for a short period of time and intends to go to bed soon. However, the sensor information processing unit 22 displays “sleep” and “in the living room (activity amount #)” on the terminal device 3 . In addition, the sensor information processing unit 22 also counts this short period of “in-room” into the monthly sleeping hours and the weekly sleeping hours, as will be described later.

After that, the sensor information processing unit 22 performs the determination according to rule 11, and determines that the person being watched is "sleep" again. Only sleep is evaluated as sleep.
A case where there are three or more "sleep" groups will be described later with reference to FIG.

<Rule 23> According to Rule 11, the sensor information processing unit 22 was determined to be “sleep” after entering the nighttime operation period, and as a result of not having been “in the room” after that, at 12:00 on the next day. If it is not determined that the user has woken up by then, the "sleep" during that time is revised to "not in the living room" (108g to 108j). In other words, the sensor information processing unit 22 does not evaluate it as "sleep" when the person being watched over seems to have gone out at night.

<Rule 24> After the processing according to Rules 21 to 23, if the first sleep is not evaluated as sleep, the sensor information processing unit 22 determines that the second sleep out of the consecutive “sleep” in the column 106b after the first review "Sleep" at the time when the sleep flag is raised is changed to "Sleep start (sleep)" (108d). On the other hand, when the first sleep is evaluated as sleep after the processing according to rules 21 to 23, the sensor information processing unit 22 selects the first sleep flag among the consecutive "sleep" in the column 106b after the first review. "Sleep" at the time when you stand up is reviewed as "Sleep start (sleep)" (not shown).

(Final result)
After performing the replacement, the first review, and the second review, the sensor information processing unit 22 stores the final state in the column 106d as the final result. The summary column 107 describes the actions of the watched person and the like solely for the purpose of understanding the invention, and is not data generated by the watching device 1 .

(Supplementary explanation for the second review)
FIG. 5 is a conceptual diagram further explaining the second review. The horizontal axis of FIG. 5 is time (time). The period from 18:00 on the current day to 4:00 on the next day is the night operation time zone. A shaded rectangle indicates that the state (initial value) at that time is "presence" in the living room 6a, and is called "presence zone". A blank rectangle indicates that the state (initial value) at that time is "absent", i.e., not in the living room 6a, and is called an "absent zone". The horizontal width of the zone in which the room is present indicates the number of consecutively arranged "in the room" state (initial value) in FIG. The horizontal width of the absent band indicates the number of consecutively arranged "absent" states (initial value) in FIG. 4 in the vertical direction.

In the absence zone, "sleep→sleep" or "sleep→not in the living room" is described. Before "→" is the state after the first review, and after "→" is the state after the second review. Although not shown, if an absence period appears in a time period other than the nighttime operation period, the absence period is maintained as "not in the living room" (not subject to review). Hereafter, the example of the 2nd review at night is divided into five typical patterns, and is demonstrated.

<Pattern 1> Absence zones 41a, 41b and 41c sandwich presence zones 42a and 42b. Actually, the sensor information processing unit 22 maintains the "sleep" of 41a because the "presence" does not continue for 15 minutes or longer. Here, the term “sandwich” is used to make the explanation easier to understand (the same applies hereinafter). The horizontal widths of the room-occupancy zones 42a and 42b are both less than a predetermined threshold value (for example, 15 minutes). At this time, the sensor information processing unit 22 maintains "sleep" for the absence zones 41a, 41b, and 41c. In addition, there are occupancy zones immediately to the left of the absence zone 41a and to the immediate right of the absence zone 41c. This represents the period of stay in the room required as a condition for determining sleep (the same applies to patterns 2 to 4 below).

<Pattern 2> Absence zones 43a, 43b and 43c sandwich presence zones 44a and 44b. The horizontal width of the zone 44a in the room is equal to or greater than a predetermined threshold, and the width of the zone 44b in the room is smaller than the predetermined threshold. At this time, the sensor information processing unit 22 maintains "sleep" for the absence periods 43b and 43c, and revises "sleep" to "not in the living room" for the absence period 43a.

<Pattern 3> Absence zones 45a, 45b and 45c sandwich presence zones 46a and 46b. The horizontal width of the room-occupation zone 46a is less than a predetermined threshold, and the horizontal width of the room-occupation zone 46b is equal to or greater than the predetermined threshold. At this time, the sensor information processing unit 22 maintains "sleep" for the absence period 45c, and revises "sleep" to "not in the living room" for the absence periods 45a and 45b.

<Pattern 4> The left end of the absence zone 47 is after 18:00, and the right end is after 4:00 and before 12:00. At this time, the sensor information processing unit 22 maintains “sleep” for the absent zone 47 . An example of an extremely long absence period is shown as pattern 4, and the absence period that starts after 18:00 and continues past 4:00 the next morning has "sleep→sleep" described in it (absence period 41c, 43c and 45c).

<Pattern 5> The left end of the absence zone 48 is after 18:00, and the right end is after 12:00. At this time, the sensor information processing unit 22 changes “sleep” to “not in the living room” for the absence period 48 . Note that there is also an in-room zone immediately to the left of the absent zone 48 . This is because if there are 12 consecutive “absences” immediately after “absence” in the night operation period, the start of the state that seems to be sleep is taken as the start of sleep at the time when it changes to “absence”. be. On the other hand, there is no occupied zone immediately to the right of the absent zone 48 . This means that the presence in the room has not been confirmed at this time.

(Activity level information)
FIG. 6 is a diagram showing an example of the activity level information 33. As shown in FIG. In the activity level 33, in association with the activity level stored in the activity level column 111, the activity category is stored in the activity category column 112, the state is stored in the state column 113, and the amount of activity is stored in the activity amount column 114. there is
The activity level in the activity level column 111 is an identifier that uniquely identifies the level of the amount of activity. Incidentally, the activity level "0" corresponds to the state "absence". Other activity levels are two-digit numbers, with the tens digits "1", "2" and "3" corresponding to the activity categories "low", "medium" and "high" respectively. there is Numbers "1" to "8" in the ones digit indicate the order in which the amount of activity is arranged in ascending order in each activity segment.

The state of the state column 113 is the same as the state of FIG.
The amount of activity in the amount of activity column 114 is the same as the amount of activity in FIG. 3, but here it is a specific numerical value. The user can arbitrarily select the type of activity (movement distance, calorific value, etc.). The value of the amount of activity here simply indicates that "the amount of activity gradually increases from top to bottom". The amount of activity is stored in association with the time when "in room" is sent.

(Current status display processing procedure)
FIG. 7 is a flow chart of the current state display processing procedure. 9 and 10 will be referred to as appropriate during the description.
In step S201, the sensor information acquisition unit 21 of the watching device 1 acquires current sensor information. Specifically, the sensor information acquisition unit 21 acquires the latest state of the information 310 (FIG. 3) from the sensor.

In step S202, the sensor information acquisition unit 21 acquires activity categories. Specifically, the sensor information acquisition unit 21 acquires the corresponding activity category from the activity level information 33 (FIG. 6) based on the state and the amount of activity acquired in step S201. If the status acquired in step S201 is “absence”, the sensor information acquisition unit 21 measures a period during which “absence” continues (referred to as “absence time”). count up each time.

In step S203, the sensor information processing unit 22 of the watching device 1 displays the "current state" screen 51 (FIG. 9, reference numerals 51a to 51d) on the terminal device 3 of the watching person. Specifically, firstly, the sensor information processing unit 22 generates the “current situation” screen 51 based on the state, activity amount, activity category, and absence time. The "current state" screens 51a to 51c are examples in which the state acquired in step S201 is "in the room". The "current situation" screens 51a-51c have "in-room" fields 52a-52c. Further, the "current situation" screens 51a-51c may have icons 55a-55c showing the behavior of the watched person against the backdrop of the living room, and graphs 56a-56c showing the amount of activity.

For example, the "current situation" screen 51a indicates that the amount of activity of the person being watched is "low" by an icon 55a in which the person being watched is sitting in the living room. Similarly, the "current state" screen 51b indicates that the amount of activity of the person being watched is "medium" by an icon 55b in which the person being watched is standing on the floor of the living room. The "current state" screen 51c indicates that the amount of activity of the person being watched over is "high" by an icon 55c in which the person being watched over is walking in the living room.

An example of the case where the status acquired in step S201 is "absence" is the "current status" screen 51d. The “current state” screen 51d has an “absence” column 52d and an absence time column 54. FIG. Furthermore, the "current situation" screen 51d may have a graph 56d showing the amount of activity ("0"). The "current situation" screen 51d indicates that the person being watched is not in the living room by not displaying the icon indicating the person being watched.
Secondly, the sensor information processing unit 22 transmits data to be displayed as the generated “current situation” screen 51 to the terminal device 3 and displays it.

In step S204, the sensor information processing unit 22 aggregates the amount of activity. Specifically, the sensor information processing unit 22 uses the information 310 ( FIG. 3 ) from the sensor to aggregate daily, weekly, and monthly activity amounts.
In step S205, the sensor information processing unit 22 displays the activity amount screen 61 (FIG. 10). Specifically, first, the sensor information processing unit 22 uses the daily activity amount, the weekly activity amount, and the monthly activity amount to display the daily activity amount screen 61a and the weekly activity amount screen 61a, respectively. An amount screen 61b and a monthly activity amount screen 61c are generated. The activity amount screens 61a-61c have line graphs 62a-62c showing the activity amount in chronological order.
Secondly, the sensor information processing unit 22 transmits data to be displayed as the generated activity amount screens 61a to 61c to the terminal device 3 according to the watcher's selection, and causes the screens to be displayed.
After that, the current state display processing procedure is terminated.

(Life Rhythm/Sleep Time Display Processing Procedure)
FIG. 8 is a flowchart of a life rhythm/sleep time display processing procedure. 11 and 12 will be referred to as appropriate during the description.
In step S<b>301 , the sensor information acquisition unit 21 of the watching device 1 acquires sensor information transmitted from the sensor 2 . When the acquired information changes from the previous state, the sensor information acquisition unit 21 stores the time. The sensor information acquisition unit 21 stores the amount of activity in association with the time when the state changes to "in the room". When the sensor information acquisition unit 21 changes to "absence", the sensor information acquisition unit 21 counts up each time "absence" is sent.

In step S302, the sensor information processing unit 22 of the watching device 1 creates state information 32 (FIG. 4). Specifically, the sensor information processing unit 22 adds the state column 106 (which is initially blank) to the sensor information acquired in step S301, and sets the state information 32 associated with the time.

In step S303, the sensor information processing unit 22 performs replacement each time information from the sensor 2 is transmitted. Specifically, the sensor information processing unit 22 performs replacement according to rules 1 and 2 as described above. At this stage, the post-replacement column 106a of the state information 32 is filled. Here, the sensor information processing unit 22 replaces “absent” with “not in the living room” and “in the room” with “in the living room (activity level #)”.

In step S304, the sensor information processing part 22 performs the 1st review, when the above described predetermined conditions are met. Specifically, the sensor information processing unit 22 performs the first review according to Rules 11 to 13 as described above. At this stage, the first post-review column 106b of the status information 32 is filled (including blanks meaning "same left"). Here, the sensor information processing unit 22 pays attention to the sleep flag, and changes part of "not in the living room" to "sleep".

In step S305, the sensor information processing part 22 performs 2nd review, when predetermined conditions are met like 1st review. Specifically, the sensor information processing unit 22 executes the second review according to the rules 21 to 24 as described above. Here, the sensor information processing unit 22 pays attention to the invalidated sleep flag (details will be described later), and re-examines part of "sleep" as "sleep". At this stage, the second post-review column 106c of the status information 32 is filled (including blanks meaning "same left").

In step S306, the sensor information processing unit 22 determines the final result. Specifically, the sensor information processing unit 22 stores the final result as described above. At this stage, the final result column 106d of the state information 32 is filled.

In step S307, the sensor information processing unit 22 generates data for displaying the life rhythm screen 71 (FIG. 11) on the terminal device 3 of the watcher. Specifically, the sensor information processing unit 22 generates life rhythm data based on the final result stored in step S306. The life rhythm screen 71 of the terminal device 3 is a time-series display in which the most recent day is color-coded for each final result state (“sleep”, “in the living room (activity amount #)”, “not in the living room”). It has a bar graph 72 . The sensor information processing unit 22 can also generate past bar graphs on a daily basis 73a, a weekly basis 73b, and a monthly basis 73c.

In step S<b>308 , the sensor information processing unit 22 generates data for displaying the sleep time screen 81 ( FIG. 12 ) on the terminal device 3 . Specifically, the sensor information processing unit 22 generates sleep time data based on the final result (“sleep start (sleep)” and “sleep end (wake up)”) stored in step S306. A sleep time screen 81 of the terminal device 3 has a column 82 showing the sleep time of today (the previous night) and a graph 83 showing the sleep time and its time period for several days before the previous day. It should be noted that the graph 83 should be viewed by long scrolling in the vertical direction. The sensor information processing unit 22 can also generate the graph 83 on a daily, weekly and monthly basis.

In addition, the sensor information processing unit 22 does not transmit the life rhythm screen and the sleep time screen to the terminal device 3 at the timing of steps S307 and S308, but at the timing of the first review and the second review, the terminal The screen displayed on the device 3 may be rewritten. That is, instead of the sensor information processing unit 22 creating the screen, the terminal device 3 side may sequentially create the screen based on the information sent from the watching device 1 .

After that, the life rhythm/sleep time display processing procedure ends.

For example, as a result of watching the "current state" screen several times from 19:00 on one day to 11:30 on the next day, the state of being watched continued to be "sleep" during that time. do. However, as a result of the watcher looking at the life rhythm screen after 12:00 on the next day, the state of being watched has actually continued from 19:00 on the previous day to the present, and he is not in the living room. It may turn out that there was This corresponds to pattern 5 in FIG. The sensor information processing unit 22 of the watching device 1 may transmit and display the following message to the terminal device 3 at the time when "sleep→not in the living room" is reviewed. An example of a message is "You reported sleeping, but it turns out you weren't in the living room."

Next, the terminal device 3 will be briefly described. The diagrams and graphs shown in FIGS. 9 to 12 are displayed on the terminal device 3, but if these diagrams are sent from the watching device 1 every five minutes, for example, problems such as it takes time to receive occur. do. In this embodiment, by downloading a plurality of formats to be displayed based on the data transmitted from the watching device 1 when receiving the watching service, it is possible to display only by receiving the data.
When the watcher presses an update button (not shown), the diagrams and graphs are updated.

(Effect of this embodiment)
The effects of the watching device of this embodiment are as follows.
(1) The watching device can extract a period of time during which the person being watched is not in the living room at night and is believed to be truly asleep.
(2) The watching device can classify and acquire the amount of activity of the person being watched according to its level.
(3) The watching device can avoid judging that the period of the first sleep when the watched person has the first sleep and the second sleep at night is sleeping.
(4) The watching device can avoid judging that the person being watched is sleeping during a period when the person being watched seems to have gone out at night.
(5) The watching device enables the watcher to visually check the sleep time or activity amount of the person being watched on a daily, weekly and monthly basis.
(6) The watching device makes it possible for the watcher to visually recognize the movements of the watcher over the course of a day.
(7) The watching device can notify the watcher that the review of "sleep→not in the living room" has been performed.

In addition, the present invention is not limited to the above-described embodiments, and includes various modifications. For example, the above-described embodiments have been described in detail for easy understanding of the present invention, and are not necessarily limited to those having all the described configurations. In addition, it is possible to replace part of the configuration of one embodiment with the configuration of another embodiment, and it is also possible to add the configuration of another embodiment to the configuration of one embodiment. Moreover, it is possible to add, delete, or replace a part of the configuration of each embodiment with another configuration.

1 Watching device 2 Sensor 3 Terminal device 4 Network 5 Watched person 11 Central control device 12 Input device 13 Output device 14 Main storage device 15 Auxiliary storage device 16 Communication device 21 Sensor information acquisition unit 22 Sensor information processing unit 32 State information 33 Activity Level information 301 Information from sensors

Claims (9)

a sensor information acquisition unit that receives information indicating that the person being watched over is in the living room or information indicating that the person being watched over is not in the living room from a sensor installed in the living room of the person's residence;
reviewing the information obtained by the sensor at night, out of the information indicating that the person being watched over is not in the living room, to information indicating that the person being watched over is sleeping;
a sensor information processing unit for reconsidering information that satisfies a predetermined condition among the information indicating that the person being watched over is sleeping to information indicating that the person being watched over is not in the living room;
A monitoring device comprising: The sensor information acquisition unit is
acquiring the amount of activity of the person being watched over from the sensor, or calculating the amount of activity of the person being watched over based on arbitrary information acquired from the sensor;
The sensor information processing unit is
classifying the information indicating that the person being watched over is in the living room based on the amount of activity;
The watching device according to claim 1, characterized by: The sensor information processing unit is
The information indicating that the person being watched over is in the living room is chronologically continuous after the information indicating that the person being watched over is sleeping, and the person being watched over is in the living room. If the time width of the information indicating is greater than or equal to a predetermined threshold,
reconsidering information indicating that the person being watched over is sleeping to information indicating that the person being watched over is not in the living room;
The watching device according to claim 2, characterized by: The sensor information processing unit is
When the information indicating that the person being watched over is sleeping is continuous in time series until a predetermined time without inserting the information indicating that the person being watched over is in the living room,
reconsidering information indicating that the person being watched over is sleeping to information indicating that the person being watched over is not in the living room;
The watching device according to claim 3, characterized by: The sensor information processing unit is
aggregating the sleep time or amount of activity of the person being watched over on a daily, weekly or monthly basis, and displaying the aggregated results on a terminal device operated by the person being watched over;
The watching device according to claim 4, characterized by: The sensor information processing unit is
The period during which the person-to-be-be-watched was in the living room during the day is displayed on the terminal device for each of the categories, and the period during the day during which the person-to-be-be-watched was not in the living-room and sleeping are displayed. causing the terminal device to display the period during which the
The watching device according to claim 5, characterized by: The sensor information processing unit is
causing the terminal device to display that the information satisfying a predetermined condition among the information indicating that the person being watched over is sleeping has been revised to the information indicating that the person being watched over is not in the living room;
The watching device according to claim 6, characterized by: The sensor information acquisition unit of the monitoring device is
receiving information indicating that the person being watched over is in the living room or information indicating that the person being watched over is not in the living room from a sensor installed in the living room of the person being watched over;
The sensor information processing unit of the monitoring device,
reviewing the information obtained by the sensor at night, out of the information indicating that the person being watched over is not in the living room, to information indicating that the person being watched over is sleeping;
reviewing information that satisfies a predetermined condition among the information indicating that the person being watched over is sleeping to information indicating that the person being watched over is not in the living room;
A monitoring method for a monitoring device, characterized by: For the sensor information acquisition part of the monitoring device,
executing a process of receiving information indicating that the person being watched over is in the living room or information indicating that the person being watched over is not in the living room from a sensor installed in the living room of the person being watched over;
For the sensor information processing unit of the monitoring device,
reviewing the information obtained by the sensor at night, out of the information indicating that the person being watched over is not in the living room, to information indicating that the person being watched over is sleeping;
causing the information indicating that the person being watched over is sleeping and satisfying a predetermined condition to be re-reviewed as the information indicating that the person being watched over is not in the living room;
A monitoring program to operate the monitoring device.

Images