JPWO2020009107A1 - Information processing equipment, sensor boxes, and programs - Google Patents

Abstract

The screen (6000) does not include buttons for events that are prioritized above a given rank. On the other hand, the screen (6010) includes a button corresponding to an event given a priority higher than a given order. The screen (6000) displays the buttons (6001 to 6005) in the same manner. On the other hand, the screen (6010) displays each of the buttons (6001 to 6005) in a manner according to the priority given to the notification corresponding to each button.

Description

The present disclosure relates to information processing in a watching system, and more particularly to the output of notifications about a watching target.

In facilities such as hospitals and welfare facilities for the elderly, there is a strong demand to reduce the burden on staff. In such facilities, when an abnormal condition occurs in a resident, the staff is notified of the occurrence. In addition, each resident operates the nurse call slave unit, so that the staff is notified that the operation has been performed.

Various techniques have been conventionally proposed for calling staff using a nurse call slave unit (or a care call slave unit). For example, in Patent Document 1 (Japanese Unexamined Patent Publication No. 2008-229172), when a plurality of patients make a call using a nurse call slave unit, a call from a patient whose biological information represents an abnormal value is made from another call. Also disclose the technology to give priority to notification.

Japanese Unexamined Patent Publication No. 2008-229172

In the above facilities, as the number of residents increases, notifications about each resident are given a more appropriate priority, which requires a technique for making the work of staff more efficient.

The present disclosure has been conceived in light of such circumstances, and its purpose is to provide technology for giving more appropriate priorities to notifications about what to watch over.

According to certain aspects of the present disclosure, a priority assigning unit that prioritizes notifications about the watched object based on the abnormal state of the watched object identified based on the biometric information of the watched object detected by the sensor. An information processing device is provided, which includes an output unit that outputs a notification about the object to be watched and a priority.

The abnormal condition may include the operation of the care call slave unit by the watching target.
When the abnormal state is an operation of the care call slave unit by the monitoring target, the priority giving unit may give a priority based on the elapsed time from the operation.

The priority assigning unit assigns a higher priority to the notification based on the abnormal condition identified based on the biological information detected by the sensor than the notification based on the abnormal condition identified based on the operation of the care call slave unit. You may.

The priority may depend on the records entered for the watch.
The biological information detected by the sensor may include at least one of vital information, position information, behavioral information, and excretion information.

The output unit may output the notification in a manner according to the priority.
The output unit may display two or more notifications arranged in order of priority given to each notification.

The output unit may display the notification together with information indicating the priority given to the notification.

The priority information may include at least one of characters, pictures, and images.

It may further include an update unit that updates the criteria for assigning priorities by using the history of at least one of vital information, location information, behavior information, and excretion information about the object to be watched.

According to other aspects of the disclosure, prioritize notifications about the watched object based on the sensor and the abnormal condition of the watched object identified based on the biometric information of the watched object detected by the sensor. A sensor box is provided that includes a priority-imparting unit and an output unit that outputs notifications and priorities regarding the monitoring target.

According to yet another aspect of the present disclosure, by being executed by the computer of the information processing terminal, the computer is based on the abnormal state of the watched object identified based on the biometric information of the watched object detected by the sensor. , A program is provided that executes a step of giving priority to the notification about the monitoring target and a step of outputting the notification and the priority of the monitoring target.

The step of outputting the notification and the priority regarding the watch target may include displaying the notification in a priority-based manner.

According to the present disclosure, not only the biological information represents an abnormal value, but also the notification about the monitoring target is prioritized based on the abnormal state of each monitoring target specified based on the biological information. Will be done. As a result, the notification about each monitoring target is given a priority according to the situation of the monitoring target. Therefore, more detailed and appropriate priorities are given among the notifications about the plurality of watch targets.

It is a figure which shows an example of the structure of a monitoring system. It is a figure for demonstrating an example of the detection range of a sensor in a living room 900. It is a figure which shows the hardware configuration of the sensor box 100 of the monitoring system, the management server 200, and a mobile terminal 300. It is a figure which shows the hardware configuration of the cloud server 400. It is a figure which shows an example of the functional structure of a monitoring system. It is a figure which shows another example of the functional structure of a monitoring system. It is a flowchart of the process executed in order to give priority to the notification about each resident 800 by the priority giving unit 152. It is a flowchart of the subroutine of step S102. It is a flowchart of the process executed for the output of the notification information in a mobile terminal 300. It is a figure for demonstrating the specific example of the display of the notification information on the display 305. It is a figure for demonstrating the specific example of the display of the notification information on the display 305. FIG. 10B is a diagram showing an example of a screen displayed by the mobile terminal 300 in which the button 6003 in the screen 6010 of FIG. 10B is operated. It is a figure which shows an example of the screen displayed on each mobile terminal 300 when the staff NA operates the button 6003 of the screen 6010, and then operates the button 6014 of the screen 6011. It is a figure which shows another example of the notification according to a priority. It is a figure which shows still another example of the notification according to a priority. It is a figure which shows still another example of the notification according to a priority. It is a figure which shows still another example of the notification according to a priority. It is a figure which shows another example of the functional structure of a monitoring system. It is a figure which shows still another example of the functional structure of a monitoring system.

An embodiment of the monitoring system will be described below with reference to the drawings. In the following description, the same parts and components are designated by the same reference numerals. Their names and functions are the same. Therefore, these explanations will not be repeated.

[Monitoring system configuration]
FIG. 1 is a diagram showing an example of a configuration of a watching system. As an example of the object to be watched over, the occupants of each living room provided in the living room area RM of the facility are adopted. In the monitoring system of FIG. 1, living rooms 900A and 900B are provided in the living room area RM. The living room 900A is assigned to the resident 800A. The living room 900B is assigned to the resident 800B. In the example of FIG. 1, the number of living rooms included in the watching system is 2, but the number is not limited to this.

In the monitoring system, the sensor box 100A installed in the living room 900A, the sensor box 100B installed in the living room 900B, the management server 200 installed in the management center ST, and the access point AP are connected via the network NT. Will be done.

In the monitoring system, the mobile terminal 300A carried by the staff NA and the mobile terminal 300B carried by the staff NB are connected to the network NT via the access point AP. Further, the sensor boxes 100A and 100B, the management server 200, and the access point AP can communicate with the cloud server 400 via the network NT.

The living room 900A includes a bed 901A, a toilet 902A, and furniture 903A as equipment. A door sensor 510A for detecting the opening / closing of the door is installed on the door of the living room 900A. A toilet sensor 520A that detects the opening and closing of the toilet 902A is installed on the door of the toilet 902A. The bed 901A is equipped with an odor sensor 530A that acquires excretion information of the resident 800A. The resident 800A is equipped with a vital sensor 540A that detects the vital information of the resident 800A. An example of the vital information detected is the resident's body temperature. Another example is resident breathing. Yet another example is the resident's heart rate. Yet another example is two or more types of information in this information. In the living room 900A, the resident 800A can operate the care call slave unit 500A.

In the present specification, when referring to matters common to a plurality of sensor boxes 100A and 100B, the term "sensor box 100" which collectively refers to the sensor boxes 100A and 100B is used. Similarly, resident 800A, 800B, living room 900A, 900B, bed 901A, 901B, toilet 902A, 902B, furniture 903A, 903B, care call slave unit 500A, 500B, door sensor 510A, 510B, toilet sensor 520A, 520B, odor sensor Similarly for each of the 530A and 530B and the vital sensors 540A and 540B, the terms "resident 800", "living room 900", "toilet 902", "furniture 903", "care call slave unit 500", "door sensor 510" , "Toilet sensor 520", "Smell sensor 530", "Vital sensor 540" are used.

The sensor box 100A incorporates a sensor for detecting the behavior of an object in the living room 900A. An example of a sensor is a Doppler sensor for detecting the movement of an object. Another example is a camera. Still other examples are the care call slave unit 500, the door sensor 510, the toilet sensor 520, the odor sensor 530, or the vital sensor 540. The sensor box 100A includes at least one of these sensors as a sensor.

FIG. 2 is a diagram for explaining an example of the detection range of the sensor in the living room 900. In the example of FIG. 2, the sensor box 100 is installed on the ceiling CL of the living room 900.

Range AR schematically represents the detection range of the sensor. If the sensor is a Doppler sensor, the Doppler sensor detects behavior that occurs within range AR. If the sensor is a camera, the camera captures an image within range AR.

Returning to FIG. 1, the management server 200 installed in the management center ST is connected to the display 206 and the input device 209. The input device 209 is, for example, a keyboard.

In the monitoring system of FIG. 1, the number of mobile terminals connected to the network NT via the access point AP is set to 2 (mobile terminals 300A and 300B), but the number is not limited to this. In the present specification, when referring to matters common to the mobile terminals 300A and 300B, the term "mobile terminal 300" which collectively refers to the mobile terminals 300A and 300B is used.

The communication between each element in the monitoring system of FIG. 1 may be wired or wireless.

The sensor box 100 does not necessarily have to include the camera 105 and / or the Doppler sensor 106. The camera 105 and / or the Doppler sensor 106 may be provided outside the sensor box 100 in the same manner as the door sensor 510 and the like. The control device 101 may acquire the detection output of the camera 105 and / or the Doppler sensor 106 provided outside the sensor box 100 via a given interface.

The vital sensor 540 does not necessarily have to be attached to the resident. In one example, the vital sensor 540 is realized by an infrared sensor or the like installed away from the resident, and outputs vital information (body temperature) by detecting the temperature of the resident. In another example, the vital sensor 540 is implemented by the Doppler sensor 106. The Doppler sensor 106 irradiates the resident with microwaves. The microwave causes a Doppler effect due to a slight displacement of the chest due to the pulsation of the resident's heart, and fluctuates its frequency. The Doppler sensor 106 detects the resident's heartbeat based on the fluctuation of the frequency. In yet another example, the Doppler sensor 106 detects the resident's respiration.

[Structure of each element of the watching system]
FIG. 3 is a diagram showing the hardware configurations of the sensor box 100, the management server 200, and the mobile terminal 300 of the monitoring system. FIG. 4 is a diagram showing a hardware configuration of the cloud server 400. Hereinafter, an example of the configuration of each device in the monitoring system will be described with reference to FIGS. 3 and 4.

(Sensor box 100)
The sensor box 100 includes a control device 101, a ROM (Read Only Memory) 102, a RAM (Random Access Memory) 103, a communication interface 104, a camera 105, a Doppler sensor 106, a wireless communication device 107, and a storage device. It includes 120.

The control device 101 controls the sensor box 100. The control device 101 is composed of, for example, at least one integrated circuit. The integrated circuit is composed of, for example, at least one CPU (Central Processing Unit), at least one ASIC (Application Specific Integrated Circuit), at least one FPGA (Field Programmable Gate Array), or a combination thereof.

An antenna (not shown) or the like is connected to the communication interface 104. The sensor box 100 exchanges data with an external communication device via the antenna. External communication devices include, for example, a management server 200, a mobile terminal 300, an access point AP, a cloud server 400, and other communication terminals.

The camera 105 is a near-infrared camera in one implementation example. Near-infrared cameras include IR (Infrared) floodlights that project near-infrared light. By using a near-infrared camera, an image showing the inside of the living room 900 can be taken even at night. In another embodiment, the camera 105 is a surveillance camera that receives only visible light. In still another embodiment, a 3D sensor or a thermography camera may be used as the camera 105. The sensor box 100 and the camera 105 may be integrally configured or may be configured separately.

The Doppler sensor 106 is, for example, a microwave Doppler sensor that radiates and receives radio waves to detect the behavior (movement) of an object in the living room 900. As a result, the biometric information of the resident 800 in the living room 900 can be detected. In one example, the Doppler sensor 106 radiates microwaves in the 24 GHz band toward the bed 901 of each room 900 and receives the reflected waves reflected by the resident 800. The reflected wave is Doppler-shifted by the operation of the resident 800. The Doppler sensor 106 can detect the respiratory state and heart rate of the resident 800 from the reflected wave.

The wireless communication device 107 receives signals from the care call slave unit 500, the door sensor 510, the toilet sensor 520, the odor sensor 530, and the vital sensor 540, and transmits the signals to the control device 101. For example, the care call slave unit 500 includes a care call button 501, and when the care call button 501 is operated, a signal indicating that the operation has been performed is transmitted to the wireless communication device 107. Each of the door sensor 510, the toilet sensor 520, the odor sensor 530, and the vital sensor 540 transmits their respective detection outputs to the wireless communication device 107.

The storage device 120 is a storage medium such as a hard disk or an external storage device. The storage device 120 stores a program executed by the control device 101 and various data used for executing the program. The various data may include behavioral information of the resident 800.

If at least one of the above programs and data is a storage device accessible to the control device 101, a storage device other than the storage device 120 (for example, a storage area of the control device 101 (for example, a cache memory), ROM 102, etc.). It may be stored in the RAM 103, an external device (for example, a management server 200, a mobile terminal 300, etc.).

(Behavior information)
The above behavioral information will be described. The action information is, for example, information indicating that the resident 800 has executed a predetermined action. In one example, the predetermined actions are "wake up" indicating that the resident 800 has awakened, "get out of bed" indicating that the resident 800 has left the bedding, and "fall" that indicates that the resident 800 has fallen from the bedding. , And four actions of "falling" indicating that the resident 800 has fallen.

In one embodiment, the control device 101 generates behavioral information of the resident 800 associated with each room 900 based on an image captured by a camera 105 installed in each room 900. For example, the control device 101 detects the head of the resident 800 from the above image, and based on the time change of the size of the detected head of the resident 800, the resident 800 "wakes up" and "gets out of bed". , Detects "falls" and "falls". Hereinafter, a specific example of generating behavioral information will be described in more detail.

First, the storage device 120 stores the location area of the bed 901 in the living room 900, the first threshold Th1, the second threshold Th2, and the third threshold Th3. The first threshold Th1 discriminates the size of the resident's head between the lying posture and the sitting posture in the location area of the bed 901. The second threshold Th2 identifies whether or not the resident is in a standing posture based on the size of the resident's head in the living room 900 excluding the area where the bed 901 is located. The third threshold Th3 identifies whether or not the resident is in a lying position based on the size of the resident's head in the living room RM excluding the area where the bed 901 is located.

The control device 101 extracts a moving object region from the target image as a region of a person of the resident 800 by, for example, a background subtraction method or a frame subtraction method. The control device 101 is further derived from the extracted moving body region by a neural network learned for head detection by pattern matching using a head model prepared in advance by, for example, a circular or elliptical Hough transform. The head area of the resident 800 is extracted using the set threshold. The control device 101 detects "getting up", "getting out of bed", "falling", and "falling" from the position and size of the extracted head.

In the control device 101, the position of the head extracted as described above is within the location region of the bed 901, and the size of the head extracted as described above is laid down by using the first threshold Th1. When it is detected that the size of the posture has changed to the size of the sitting posture, it may be determined that the action "wake up" has occurred.

The control device 101 is a case where the position of the head extracted as described above moves from the inside of the location area of the bed 901 to the outside of the location area of the bed 901, and the size of the head extracted as described above. May determine that the behavior "getting out of bed" has occurred when it detects that the size has changed from a certain size to the size of the standing posture by using the second threshold Th2.

The control device 101 is a case where the position of the head extracted as described above moves from the inside of the location area of the bed 901 to the outside of the location area of the bed 901, and the size of the head extracted as described above. When the time changes from a certain size to the size of the lying posture by using the third threshold value Th3, it may be determined that the behavior "fall" has occurred.

In the control device 101, the position of the head extracted as described above is located in the living room 900 excluding the area where the bed 901 is located, and the size of the extracted head uses the third threshold Th3. When it is detected that the size has changed from a certain size to the size of the lying posture, it may be determined that the behavior "fall" has occurred.

As described above, in one specific example, the control device 101 of the sensor box 100 generates the behavior information of the resident 800. In the watching system, other elements may generate behavior information of the resident 800 by using the image in the living room 900.

(Management server 200)
The management server 200 includes a control device 201, a ROM 202, a RAM 203, a communication interface 204, a display interface 205, an operation interface 207, and a storage device 220.

The control device 201 controls the management server 200. The control device 201 is composed of, for example, at least one integrated circuit. An integrated circuit is composed of, for example, at least one CPU, at least one ASIC, at least one FPGA, or a combination thereof.

An antenna (not shown) or the like is connected to the communication interface 204. The management server 200 exchanges data with an external communication device via the antenna. External communication equipment includes, for example, a sensor box 100.

The display interface 205 is connected to the display 206, and sends an image signal for displaying an image to the display 206 in accordance with a command from the control device 201 or the like.

The operation interface 207 is, for example, a USB (Universal Serial Bus) terminal and is connected to the input device 209. The operation interface 207 receives a signal indicating a user operation from the input device 209. The input device 209 is, for example, a mouse, a keyboard, a touch panel, or other device capable of accepting a user's input operation.

The storage device 220 is a storage medium such as a hard disk or an external storage device. In one embodiment, the storage device 220 stores a program executed by the control device 201, which may be stored in another storage device accessible to the control device 201.

(Mobile terminal 300)
The mobile terminal 300 includes a control device 301, a RAM 303, a communication interface 304, a display 305, an input device 306, and a built-in memory 320.

The control device 301 controls the mobile terminal 300. The control device 301 is composed of, for example, at least one integrated circuit. An integrated circuit is composed of, for example, at least one CPU, at least one ASIC, at least one FPGA, or a combination thereof.

An antenna (not shown) or the like is connected to the communication interface 304. The mobile terminal 300 exchanges data with an external communication device via the antenna and the access point AP (FIG. 1). External communication devices include, for example, a sensor box 100, a management server 200, and the like.

The display 305 is realized by, for example, an organic EL (Electro Luminescence) display. The input device 306 is realized, for example, by a touch sensor superimposed on the display 305. The touch sensor receives various operations on the mobile terminal 300 by touch operations and outputs the contents of the operations to the control device 301.

The built-in memory 320 is, for example, a storage medium such as an eMMC (Embedded MultiMediaCard). As an example, the built-in memory 320 stores a program executed by the control device 301, but the program is stored in a storage device other than the built-in memory 320 if the storage device is accessible to the control device 301. May be good.

(Cloud server 400)
The cloud server 400 includes a control device 401, a ROM 402, a RAM 403, a communication interface 404, and a storage device 420.

The control device 401 controls the cloud server 400. The control device 401 is composed of, for example, at least one integrated circuit. An integrated circuit is composed of, for example, at least one CPU, at least one ASIC, at least one FPGA, or a combination thereof.

An antenna (not shown) or the like is connected to the communication interface 404. The cloud server 400 exchanges data with an external communication device via the antenna. External communication devices include, for example, a sensor box 100 and a management server 200.

The storage device 420 is a storage medium such as a hard disk or an external storage device. In one embodiment, the storage device 420 stores a program executed by the control device 401, which may be stored in another storage device accessible to the control device 401.

(Meaning of the term "program" in this specification)
In the watching system, various "programs" may be provided by being incorporated into a part of an arbitrary program rather than as a single program. Various "programs" can be realized by the cooperation of any plurality of programs. In one example, when the control device 101 of the sensor box 100 implements the functions described herein by executing the first program, the first program is a module of a part of the second program. May be used. Even if the first program does not include some modules for realizing the function, if it mainly contributes to the realization of the function, it deviates from the purpose of the program for realizing the function. It's not something to do. In addition, some or all of the functions described herein may be implemented by dedicated hardware. Further, the device that provides the functions described in the present specification may be provided by an external device as a so-called cloud service in part or all of the functions.

[Functional configuration]
FIG. 5 is a diagram showing an example of the functional configuration of the monitoring system. An example of the functional configuration of the monitoring system will be described with reference to FIG.

The sensor box 100 functions as an interface 150, a memory 151, and a priority assigning unit 152. The interface 150 is realized by, for example, a wireless communication device 107, and receives detection outputs from various sensors such as an odor sensor 530 and a vital sensor 540, and notifications from a care call slave unit 500. The memory 151 is realized by the storage device 120, and stores the care record of the resident 800 and the behavior information and the position information of the resident 800. In one example, the behavioral information and location information of the resident 800 are generated using, for example, an image taken by the camera 105.

The priority assigning unit 152 is realized by, for example, the control device 101, and uses at least one of the detection output, the care record, the behavior information, and the position information of various sensors to be used for each of the plurality of residents 800. Give priority to notifications. The priority giving unit 152 further transmits a notification about each of the plurality of residents 800 to the display unit 350 together with the priority given to each notification.

As shown in the examples of both FIGS. 5 and 6, the mobile terminal 300 functions as a display unit 350. The display unit 350 is realized by, for example, the display 305, and displays notifications about each of the plurality of occupants 800 according to the information received from the priority assigning unit 152 in a manner according to the priorities assigned as described above. do.

FIG. 6 is a diagram showing another example of the functional configuration of the monitoring system. Compared to the example of FIG. 5, the sensor box 100 further functions as an interface 153. The interface 153 is, for example, a part of the wireless communication device 107, and is realized by a dedicated circuit for communication with the care call slave unit 500. In the example of FIG. 6, when the care call button 501 is operated, the care call slave unit 500 transmits a signal indicating that the operation has been performed to the interface 153. When the interface 153 receives the signal, the interface 153 notifies the priority assigning unit 152 of the reception of the signal. The priority assigning unit 152 uses at least one of the detection output of various sensors, the care record, the behavior information, the position information, and the notification from the care call slave unit 500 to be used for each of the plurality of residents 800. Give priority to notifications.

In the example of FIG. 6, the management server 200 has a display unit 350 instead of the mobile terminal 300, as compared with the example of FIG. In the example of FIG. 6, notifications for each of the plurality of residents 800 are output not by the mobile terminal 300 but by the management server 200. In this sense, the management server functions as a care call master unit.

The notification for each of the plurality of residents 800 may be output by both the management server 200 and the mobile terminal 300.

[Process flow (input management)]
FIG. 7 is a flowchart of a process executed by the priority giving unit 152 to give a priority to the notification about each resident 800. The process of FIG. 7 is realized, for example, by the control device 101 executing a given program. The above processing will be described with reference to FIG. 7.

In step S100, the control device 101 of the sensor box 100 determines whether or not an event for the resident 800 has occurred in the living room 900 in which the sensor box 100 is installed. The control device 101 repeats the control of step S100 until it is determined that the event has occurred (NO in step S100), and when it is determined that the event has occurred (YES in step S100), the control device 101 advances the control to step S102. ..

An example of an event is the occurrence of an abnormal state of the resident 800 based on the detection outputs of various sensors.

An example of an abnormal state is that the detection output (vital information) of the vital sensor 540 shows an abnormal value, and the body temperature of the resident 800 may be higher than a given reference value, or the resident 800 may be. Breathing may not have been detected for a given time, or the heart rate of the resident 800 may have been out of the given range.

Another example of the abnormal condition is that the detection output of the odor sensor 530 showed a value corresponding to the excretion of the resident 800.

Yet another example of an abnormal condition is the occurrence of behavioral information that is classified as an abnormal condition (eg, "fall" or "fall").

Still other examples of abnormal conditions are that the location information of the resident 800 represents a specific position, that the history of the location information of the resident 800 shows a pattern associated with the abnormal condition, or that the history is in the normal state. Did not show the pattern associated with.

Yet another example of an abnormal condition is that a given prediction has occurred for the resident 800. One example of the prediction is that the scheduled time for excretion of the resident 800 has arrived.

Yet another example of the abnormal condition is the receipt of a notification from the care call slave unit 500 indicating that the care call button 501 has been operated.

In step S102, the control device 101 gives a priority to the event determined to have occurred in step S100. FIG. 8 is a flowchart of the subroutine in step S102. The content of the priority assignment process in step S102 will be described with reference to FIG.

In step S210, the control device 101 determines whether or not the event indicates an abnormal value in the vital information, and if so (YES in step S210), the event is in step S212. After assigning "priority 1" to, the control proceeds to step S290. If not (NO in step S210), the control device 101 proceeds to control in step S220.

In the present embodiment, the smaller the priority value, the higher the priority. For example, among "priority 1" to "priority 7", "priority 1" has the highest priority and "priority 7" has the lowest priority.

In step S220, the control device 101 determines whether or not the event is that the action information "fall" has occurred, and if so (YES in step S220), the event is in step S222. After assigning "priority 2" to, the control proceeds to step S290. If not (NO in step S220), the control device 101 proceeds to control in step S230.

In step S230, the control device 101 determines whether or not the event indicates whether the detection output of the odor sensor 530 indicates a value corresponding to excretion, and if so (YES in step S230). , After assigning "priority 3" to the event in step S232, the control proceeds to step S290. If not (NO in step S230), the control device 101 proceeds to control in step S240.

In step S240, the control device 101 determines whether or not the event indicates whether the position information of the resident 800 represents the position of the toilet 902, and if so (YES in step S240), the step. After assigning "priority 4" to the event in S242, the control proceeds to step S290. If not (NO in step S240), the control device 101 proceeds to control in step S250.

In step S250, the control device 101 determines whether or not the event is the arrival of the scheduled excretion time of the resident 800, and if so (YES in step S250), the step S252 is performed. After assigning "priority 5" to the event, the control proceeds to step S290. If not (NO in step S250), the control device 101 proceeds to control in step S260. In one example, the control device 101 acquires the scheduled excretion time based on the care record of the resident 800. For this purpose, the control device 101 may derive the scheduled time of the next excretion using the history of excretion in the care record of the resident 800 according to a given program, or may register the scheduled time of the next excretion in the care record. The scheduled time of the next excretion of the resident 800 may be read out. The long-term care record is, for example, a record created by Steffe that includes various information about each resident 800, including the time of excretion of each resident 800. The long-term care record is an example of a record input for the monitoring target with respect to the control device 101. The long-term care record may be created by hardware resources such as the control device 101 based on the detection output of the sensor for each resident 800.

In step S260, the control device 101 determines whether or not the event has passed a given time (for example, 10 minutes) or more from the operation of the care call button 501 by the resident 800, and if so (step). YES in S260), after giving "priority 6" to the event in step S262, the control proceeds to step S290. If not (NO in step S260), the control device 101 proceeds to control in step S272.

In the process shown in FIG. 8, in step S262, "priority 6" is given to the abnormal state based on the operation of the care call slave unit 500, while in steps S212, S222, S232, S242, and S252, the sensor "Priority 1" to "Priority 5" are assigned to the abnormal state based on the detection output. That is, the control device 101 gives a higher priority to the event based on the abnormal state based on the detection output of the sensor than the event based on the abnormal state based on the operation of the care call slave unit 500.

In step S272, the control device 101 assigns "priority 7" to the event, and then proceeds to control to step S290.

In step S290, the control device 101 transmits the event and the priority given to the event to the mobile terminal 300 as notification information. The communication interface 104 is used to transmit the notification information. In this sense, the control device 101 is an example of a priority giving unit that gives a priority, and the communication interface 104 is an example of an output unit that outputs an event (notification) and a priority.

In one implementation example, the control device 101 transmits the above notification information to the management server 200. When the management server 200 distributes the notification information to the mobile terminals 300 (mobile terminals 300A and 300B) via the access point AP, each mobile terminal 300 receives the notification information.

The mobile terminal 300 that has received the notification information displays the notification information. In the display of the notification information, as shown as the screen 6010 and the like in FIG. 10B described later, each notification is displayed on the display 305 of the mobile terminal 300 in a manner according to the priority given to the notification. In this sense, the display 305 of the mobile terminal 300 is an example of an output unit that outputs a notification in a manner according to the priority given to the notification. It should be noted that the notification is displayed in a manner according to the priority given to the notification, and as a result, the priority is displayed together with the notification.

[Process flow (notification information output)]
FIG. 9 is a flowchart of processing executed for output of notification information in the mobile terminal 300. The process of FIG. 9 is realized, for example, by the control device 301 executing a given program.

In step S300, the control device 301 determines whether or not the notification information has been received from at least one sensor box 100. The control device 301 repeats the control of step S300 until it is determined that the notification information has been received (NO in step S300), and when it is determined that the notification information has been received (YES in step S300), the control device 301 proceeds to the control in step S302. ..

In step S302, the control device 301 updates the display of the notification information on the display 305. After that, the control device 301 returns the control to step S300. The display of the notification information is an example of the output of the notification for each resident 800. In addition to the display, the notification may be output by voice, vibration, or a combination thereof.

10A and 10B are diagrams for explaining a specific example of displaying notification information on the display 305. FIG. 10A shows screen 6000. FIG. 10B shows the screen 6010.

Screen 6000 of FIG. 10A displays notifications for each resident 800 in a predetermined order. More specifically, the screen 6000 is a notification (notification information) arranged on the right side of each of the five buttons 6001 to 6005 and the buttons 6001 to 6005, which represent the respective states of the five occupants 800. Includes a string representing the time when

For example, the button 6001 includes the display of the name (A) of the resident 800 of "Room 101", which is an example of the living room 900. To the right of the button 6001, a character string (19:01) representing the time when the notification was generated is displayed. The screen 6000 displays the five buttons 6001 to 6005 in an order according to the occurrence time of the event corresponding to each button. The event occurrence time may be the time when the mobile terminal 300 starts displaying the notification, or the time when the sensor box 100 transmits the notification information corresponding to the notification to the mobile terminal 300. It may be the time when the event based on the notification information corresponding to the notification occurs.

The screen 6010 of FIG. 10B includes buttons 6001 to 6005, similar to the screen 6000. The screen 6000 of FIG. 10A is a screen that does not include a button for an event that has been given a priority of a given order or higher, whereas the screen 6010 of FIG. 10B is given a priority of a given order or higher. It is a screen including buttons corresponding to the event. The screen 6000 displays the buttons 6001 to 6005 in the same manner, while the screen 6010 displays each of the buttons 6001 to 6005 in a manner according to the priority given to the notification corresponding to each button.

As an example of a priority-based embodiment, the control device 301 adjusts the color of the buttons on the screen 6010. In the example of FIG. 10B, the button 6003 displays the notification given the "priority 1", and the button 6004 displays the notification given the "priority 5". Buttons 6001, 6002, 6005 display a notification given a priority of "priority 6" or lower. The control device 301 displays the buttons 6001 to 6005 in a color corresponding to the priority assigned to each button. More specifically, the control device 301 displays the button 6003, the button 6004, and the buttons 6001, 6002, 6005 in different colors.

As another example of the priority-based aspect, the control device 301 displays a button corresponding to the notification together with a character string indicating the priority given to the notification. The screen 6010 displays the character string "priority first place" on the right side of the button 6003. The character string represents the priority (priority 1) given to the notification corresponding to the button 6003. The screen 6010 displays the character string "priority 5th place" on the right side of the button 6004. The character string represents the priority (priority 5) given to the notification corresponding to the button 6004. In the example of FIG. 10B, a character string such as "priority 1st place" is displayed only for the button corresponding to the notification given the priority higher than the given priority, but such a character string is displayed for all the priorities. The character string may be displayed.

The control device 301 may display a button corresponding to the prioritized notification together with the content of the event on which the notification is based. As an example of such a display, the control device 301 displays the character string "with heat generation" on the screen 6010 to the right of the button 6003. This string is based on the fact that the event based on the notification of button 6003 is that the body temperature of the resident 800, which is an example of vital information, is higher than a given value. As another example, the control device 301 displays the character string "toilet time" on the screen 6010 to the right of the button 6004. This string is based on the fact that the event based on the notification of button 6004 is that the scheduled time for excretion of the resident 800 has arrived.

[Operations for notifications about residents and subsequent updates of notifications]
In the watching system, the staff operates the buttons corresponding to the events that the Steffe can handle among the buttons displayed on the screen 6010. The control device 301 of the mobile terminal 300 updates the display on the display 305 when the button is operated.

FIG. 11 is a diagram showing an example of a screen displayed by the mobile terminal 300 in which the button 6003 in the screen 6010 of FIG. 10B is operated. The screen 6011 of FIG. 11 shows information on the event corresponding to the touched button. The screen 6011 includes columns 6012, 6013 and buttons 6014, 6015.

Column 6012 includes a living room 900 (Room 103) corresponding to the touched button and a resident 800 (Mr. C). Column 6013 represents the content of the event corresponding to the touched button. Button 6014 is a button for manifesting intention corresponding to the event. The button 6015 is a button for returning the display on the display 305 to the screen 6010. When the button 6015 is operated, the control device 301 returns the display on the display 305 to the screen 6010.

On the other hand, when the button 6014 is operated, the control device 301 notifies the other mobile terminal 300 that the button operation has been performed via the access point AP. As a result, the control device 301 of the other mobile terminal 300 updates the screen 6010 so as to stop the display of the button 6003.

FIG. 12 is a diagram showing an example of a screen displayed on each mobile terminal 300 when the staff NA operates the button 6003 on the screen 6010 and then operates the button 6014 on the screen 6011. The screen 6017 of FIG. 12 does not include the button 6003 as compared to the screen 6010 of FIG. 10B. This is because the event corresponding to the button 6003 is handled by the staff NA, so that the staff does not need to be notified any more.

[Specific example of notification]
The watching system may perform notification according to the priority given to the event by other modes than the mode shown on the screen 6010 shown in FIG. 10B.

(Arrangement of buttons according to priority)
FIG. 13 is a diagram showing another example of notification according to priority. As shown in the example of FIG. 13, the mobile terminal 300 may display the corresponding event at the upper part of the screen as the button is given the higher priority.

On the screen 6020 of FIG. 13, the control device 301 arranges the button 6003 corresponding to the event to which the "priority 1" is given at the highest position, and then corresponds to the event to which the "priority 5" is given. Button 6004 is arranged, and below the button 6004, buttons 6001, 6002, 6005 corresponding to the events given the priority of priority 6 or less are arranged.

In addition, on the screen, two or more buttons may be arranged according to the priority order corresponding to each button. As long as the buttons are arranged according to the priority, the two or more buttons may be arranged so as to be located on the lower side or the left or right side as the priority is higher.

(Display of information corresponding to priority (event content))
Each of FIGS. 14 and 15 is a diagram illustrating still another example of prioritized notification. In each of the example of FIG. 14 and the example of FIG. 15, the mobile terminal 300 displays the information corresponding to the priority (event content) together with the button.

The control device 301 displays the image 6901 corresponding to the event corresponding to the button 6003 on the screen 6030 of FIG. Image 6901 is an example of information representing the content of the event. The event on which the notification of button 6003 is based is the fever of the resident 800 (ie, the body temperature is higher than a given reference value). Image 6901 shows that the human head is hot. As a result, the staff who sees the screen 6030 can more intuitively grasp the state of the resident 800 corresponding to the button 6003.

The control device 301 displays the image 6902 corresponding to the event corresponding to the button 6004 on the screen 6030 of FIG. Image 6902 is another example of information representing the content of an event. The event based on the notification of button 6004 is the arrival of the scheduled excretion time of the resident 800. Image 6902 is a pictogram of the toilet. As a result, the staff who sees the screen 6030 can more intuitively grasp the state of the resident 800 corresponding to the button 6004.

Images 6901 and 6902 are examples (pictures) of information indicating the priority order. Another example is the character strings "priority 1st place" and "priority 5th place" in the image 6010 and the like in FIG. 10B. The information indicating the priority may be an image such as a photograph showing a predetermined registered toilet in the mobile terminal 300 or the like.

On the screen 6040 of FIG. 15, the control device 301 has a character string “heat generation_38.3 ° C.!” Explaining an event (event corresponding to the button 6003) to which “priority 1” is given to the right side of the button 6003. Is displayed. In this example, the sensor box 100 that has detected the abnormal state of the resident transmits vital information based on the abnormal state to the mobile terminal 300 as notification information. In order to display the screen 6040, the control device 301 may extract information (body temperature of the resident) for explaining the event from the vital information included in the notification information.

On the screen 6040 of FIG. 15, the control device 301 has a character string “3 hours have passed since the last toilet” explaining an event (event corresponding to the button 6004) to which “priority 5” is given to the right side of the button 6004. Is displayed. In this example, the sensor box 100 that has detected the abnormal state of the resident transmits a long-term care record based on the abnormal state to the mobile terminal 300 as notification information. In order to display the screen 6040, the control device 301 may extract information for explaining the event (elapsed time from the time of the previous excretion of the resident) from the care record included in the notification information.

(Display of treatment details)
FIG. 16 is a diagram showing still another example of prioritized notification. In the example of FIG. 16, the mobile terminal 300 displays information indicating the action content required of the staff for the event corresponding to the button together with the button.

On the screen 6050 of FIG. 16, the control device 301 displays the character string “image confirmation” in addition to the character string “heat generation” on the right side of the button 6003 corresponding to the event to which “priority 1” is given. .. The character string "image confirmation" means confirming an image representing the detection output of the resident's vital information.

In this example, the sensor box 100 that has detected the abnormal state of the resident may transmit vital information based on the abnormal state to the mobile terminal 300 as notification information. In this case, the control device 301 of the mobile terminal 300 identifies the treatment for the abnormal state corresponding to the vital information based on the vital information transmitted from the sensor box 100. In this example, the sensor box 100 may also specify the content of the treatment for the abnormal state of the resident based on the vital information of the resident. In this case, the sensor box 100 transmits the treatment content to the mobile terminal 300 together with the notification information.

On the screen 6050 of FIG. 16, the control device 301 displays the character string “image confirmation” in addition to the character string “toilet time” on the right side of the button 6004 corresponding to the event to which the “priority 5” is given. do. The character string "image confirmation" means confirming an image representing the detection output of the resident's odor sensor 530 or the toilet sensor 520.

In this example, the sensor box 100 that has detected the abnormal state of the resident identifies the action corresponding to the abnormal state (arrival of the scheduled excretion time) to the mobile terminal 300 together with the notification information, and informs the contents of the action. It may be transmitted to the mobile terminal 300. On the other hand, the mobile terminal 300 that has received the notification information may specify the content of the action corresponding to the event (abnormal state) of the notification information. When an abnormal state related to the arrival of the scheduled excretion time occurs, the sensor box 100 may transmit the detection output of the resident's odor sensor 530 or the toilet sensor 520 to the mobile terminal 300 together with the notification information. Upon seeing the display on the screen 6050, Steffe can confirm the detection output of the odor sensor 530 or the toilet sensor 520 and estimate the urgency of responding to the resident corresponding to the button 6003.

In one example, the staff understands that if the odor sensor 530 detects the resident's excretion, it is more urgent than if it did not. In another example, the staff understands that when the toilet sensor 520 detects the resident's entry into the toilet 902, it is less urgent than when it does not detect entry / exit.

[Centralized management by management server]
According to the configuration shown in FIG. 5, in the monitoring system, the sensor box 100 detects the abnormal state of the resident, gives priority to the abnormal state, and then carries the notification information about the abnormal state. It was sent to the terminal 300. The mobile terminal 300 outputs a notification for each of the residents according to the received notification information. Notifications for each of the residents were output in a manner according to the priority given to each notification. In the monitoring system, the elements that detect abnormal conditions, assign priorities, and output notifications are not limited to those shown in FIG.

FIG. 17 is a diagram showing another example of the functional configuration of the monitoring system. In the example of FIG. 17, the management server 200 collectively manages the data. That is, the management server 200 functions as a data management unit 250, and further functions as a priority giving unit 152. The data management unit 250 is realized by, for example, a storage device 220, and stores various types of data. The priority giving unit 152 is realized by, for example, the control device 201.

Each sensor box 100 has at least one of the detection outputs of various sensors (odor sensor 530, vital sensor 540, etc.) and the behavior information and / or position information of the resident generated from the detection outputs of the various sensors. , Send to the management server 200. The data management unit 250 of the management server 200 stores the data received from each sensor box 100 and the care record of each resident input via the communication interface 204 and / or the operation interface 207.

The priority assigning unit 152 detects the occurrence of at least one event (abnormal state) for each resident, as described in step S100 of FIG. When the occurrence of the abnormal state is detected, the priority assigning unit 152 assigns a priority to the abnormal state of each resident as described in steps S210 to S272 of FIG. Then, the priority giving unit 152 transmits each event and the priority given to the event to the mobile terminal 300 as notification information.

In the example of FIG. 17, the mobile terminal 300 functions as a display unit 350. As described in steps S300 and S302 of FIG. 9, the display unit 350 outputs a notification about each resident according to the notification information transmitted from the management server 200 (prioritization unit 152).

[Management by application of mobile terminal]
FIG. 18 is a diagram showing still another example of the functional configuration of the monitoring system. In the example of FIG. 18, the mobile terminal 300 functions as the priority giving unit 152. In one example, an application for generating and outputting notification information about a resident (hereinafter referred to as "resident watching application") is installed in each mobile terminal 300, and the control device 301 of the mobile terminal 300 is installed. By executing the resident watching application, the mobile terminal 300 functions as the priority giving unit 152. Similar to the example of FIG. 17, the management server 200 functions as a data management unit 250.

The prioritization unit 152 acquires the data received from each sensor box 100 and the care record of each resident input via the communication interface 204 and / or the operation interface 207 from the data management unit 250. The transmission of these information from the data management unit 250 to the priority giving unit 152 may be a push type (due to a reception request from the data management unit 250) or a pull type (from the priority giving unit 152). It may be due to a transmission request).

For example, the priority giving unit 152 determines whether or not an event (abnormal state) has occurred for each resident by using the data received from the data management unit 250 at regular intervals (step S100), and at least When it is determined that an event (abnormal state) has occurred for one resident, priority is given to the newly determined event (steps S210 to S272). The priority assigning unit 152 outputs notifications corresponding to each event according to the priority (steps S300 to S302).

[Update of priority criteria by learning]
In the embodiment described above, priorities are given to each event (abnormal state) using, for example, the criteria shown as steps S210 to S272 in FIG. The criteria can be updated by learning using the history of at least one of the resident's vital information, location information, behavior information, and excretion information.

In one example, the detection output of each sensor at regular time intervals (2 to 3 seconds) and the action information generated from the detection output are transmitted to the cloud server 400 and stored in the storage device 420. The control device 401 generates a second event from the data stored in the storage device 420 by machine learning or deep learning with a certain probability or more within the first time after the occurrence of the first event. When the knowledge is obtained, the priority given to the first event may be changed before and after the lapse of the first time from the occurrence of the first event.

In one example, the control device 401 is said to fall (behavioral information) within 1 minute after the resident is located at a specific place (bed edge) by machine learning or deep learning using data about a resident. We get the finding that an event occurs with a probability greater than or equal to a given value. In this case, the control device 401 gives the device functioning as the priority giving unit 152 the priority given to the event "located in a specific place" for the resident, and the occurrence of the event. After that, instruct to change before 1 minute and after 1 minute. More specifically, the control device 401 instructs to update the criteria for assigning the priority so that the priority after 1 minute has passed after the event has occurred is higher than the priority before 1 minute has passed. do.

The device that gives priority to each event may update the priority as described above. In the example shown in FIG. 18, the mobile terminal 300 assigns a priority to each event. The control device 301 itself provided in such a mobile terminal 300 may update the criteria for assigning priorities by machine learning or deep learning as described above.

Further, in the monitoring system, the device for giving the priority or another device may accept the input of the information for updating the priority. The criteria for prioritization may be updated as the information is entered.

It should be considered that each embodiment disclosed this time is exemplary in all respects and is not restrictive. The scope of the present invention is shown by the claims rather than the above description, and it is intended that all modifications within the meaning and scope equivalent to the claims are included. In addition, the inventions described in the embodiments and the modifications are intended to be implemented, either alone or in combination, wherever possible.

100, 100A, 100B sensor box, 101, 201, 301, 401 control device, 104, 204, 304, 404 communication interface, 105 camera, 106 Doppler sensor, 107 wireless communication device, 120, 220, 420 storage device, 150, 153 interface, 151 memory, 152 prioritization unit, 200 management server, 205 display interface, 206,305 display, 250 data management unit, 300,300A, 300B mobile terminal, 320 built-in memory, 350 display unit, 400 cloud server, 500,500A, 500B Care call handset, 501 Care call button, 510, 510A, 510B Door sensor, 520, 520A, 520B Toilet sensor, 530, 530A, 530B sensor, 540, 540A, 540B Vital sensor, 800, 800A, 800B Person, 900,900A, 900B living room, 901,901A,901B bed, 902,902A,902B toilet, 903,903A,903B furniture.

Claims (14)

A priority assigning unit that gives priority to notifications about the monitoring target based on the abnormal state of the monitoring target identified based on the biological information of the monitoring target detected by the sensor.
An information processing device including an output unit that outputs the notification about the object to be watched and the priority. The information processing device according to claim 1, wherein the abnormal state includes an operation of a care call slave unit by the monitoring target. The information processing device according to claim 2, wherein the priority-giving unit gives priority based on the elapsed time from the operation when the abnormal state is an operation of the care call slave unit by the monitoring target. The priority assigning unit gives a higher priority to the notification based on the abnormal state identified based on the biological information detected by the sensor than the notification based on the abnormal state identified based on the operation of the care call slave unit. The information processing apparatus according to claim 2 or 3, wherein the information processing apparatus according to claim 2 or 3. The information processing apparatus according to any one of claims 1 to 4, wherein the priority depends on the record input for the monitoring target. The information processing apparatus according to any one of claims 1 to 5, wherein the biological information detected by the sensor includes at least one of vital information, position information, behavior information, and excretion information. The information processing device according to any one of claims 1 to 6, wherein the output unit outputs the notification in a manner according to the priority order. The information processing apparatus according to claim 7, wherein the output unit arranges and displays two or more of the above notifications in order of priority given to each of the above notifications. The information processing device according to claim 7 or 8, wherein the output unit displays the notification together with information indicating the priority given to the notification. The information processing apparatus according to claim 9, wherein the information representing the priority order includes at least one of characters, pictures, and images. 1 The information processing apparatus according to any one of claims 10. With the sensor
A priority assigning unit that gives priority to notifications about the monitoring target based on the abnormal state of the monitoring target identified based on the biological information of the monitoring target detected by the sensor.
A sensor box including an output unit that outputs the notification about the object to be watched and the priority. By being executed by the computer of the information processing terminal, the computer
A step of prioritizing notifications about the watched object based on the abnormal state of the watched object identified based on the biometric information of the watched object detected by the sensor.
A program that executes a step of outputting the notification and the priority of the monitoring target. 13. The program of claim 13, wherein the step of outputting the notification and the priority of the watched object comprises displaying the notification in a manner according to the priority.

Images