WO2020009107A1 - Information processing device, sensor box, and program - Google Patents

Abstract

A display (6000) does not include a button for an event provided with priority higher than a given order. On the contrary, a display (6010) includes a button corresponding to an event provided with priority higher than the given order. The display (6000) displays buttons (6001 to 6005) in the same manner. On the contrary, the display (6010) displays the buttons (6001 to 6005) respectively in a manner according to the priority provided in notifications corresponding to respective buttons.

Description

Information processing device, sensor box, and program

(4) The present disclosure relates to information processing in a watching system, and particularly to output of a notification about a watching target.

施 設 In hospitals and welfare facilities for the elderly, there is a strong demand for reducing the burden on staff. In such a facility, when an abnormal condition occurs in the resident, the staff is notified of the occurrence. When each resident operates the nurse call slave unit, the staff is notified that the operation has been performed.

Various techniques have been proposed for calling a staff member using a nurse call slave (or a care call slave). For example, Patent Literature 1 (Japanese Patent Application Laid-Open No. 2008-229172) discloses that, when a plurality of patients make a call using a nurse call slave unit, a call from a patient whose biological information indicates an abnormal value is different from another call. Also disclose the technology that gives priority to notification.

JP 2008-229172 A

In the above facilities, due to the increase in the number of occupants, more appropriate priorities are given to notifications for each occupant, and as a result, there is a need for a technique for making the work of staff more efficient.

The present disclosure has been devised in view of the above circumstances, and an object thereof is to provide a technique for giving a more appropriate priority to a notification of a watching target.

According to an aspect of the present disclosure, a priority assigning unit that assigns a priority to a notification about the watching target based on an abnormal state of the watching target specified based on biological information of the watching target detected by the sensor. And an output unit that outputs a notification about the watching target and a priority order.

The abnormal state may include an operation of the care call slave device by the watching target.
When the abnormal state is an operation of the care call slave unit by the watching target, the priority assigning unit may assign the priority based on the elapsed time from the operation.

The priority assigning unit assigns a higher priority to the notification based on the abnormal state specified based on the biological information detected by the sensor than the notification based on the abnormal state specified based on the operation of the care call slave unit. You may.

The priority may depend on a record input for the watching target.
The biological information detected by the sensor may include at least one of vital information, position information, behavior information, and excretion information.

The output unit may output the notification in a mode according to the priority.
The output unit may display the two or more notifications arranged in accordance with the priority assigned to each notification.

The output unit may display the notification together with information indicating the priority assigned to the notification.

情報 The information indicating the priority may include at least one of a character, a picture, and an image.

更新 The information processing apparatus may further include an update unit that updates a priority order criterion by using at least one history of vital information, position information, action information, and excretion information of the watching target.

According to another aspect of the present disclosure, based on the sensor and the abnormal state of the watching target identified based on the biological information of the watching target detected by the sensor, the notification about the watching target is given a priority. A sensor box including a priority assigning unit and an output unit that outputs a notification about a watching target and a priority order is provided.

According to still another aspect of the present disclosure, being executed by the computer of the information processing terminal, the computer causes the computer to perform processing based on the abnormal state of the watching target identified based on the biological information of the watching target detected by the sensor. A program is provided for executing a step of assigning a priority to the notification of the watching target and a step of outputting the notification and the priority of the watching target.

ス テ ッ プ The step of outputting the notification and the priority of the watching target may include displaying the notification in a mode according to the priority.

According to the present disclosure, not only that the biological information indicates an abnormal value, but also based on the abnormal state of each watching target identified based on the biological information, a priority is given to the notification of the watching target. Is done. As a result, the notification about each watching target is given a priority according to the status of the watching target. Therefore, priorities are given in more detail and appropriately between the notifications about the plurality of watching targets.

It is a figure showing an example of composition of a watching system. FIG. 9 is a diagram for explaining an example of a detection range of a sensor in a living room 900. FIG. 2 is a diagram illustrating a hardware configuration of a sensor box 100, a management server 200, and a mobile terminal 300 of the watching system. FIG. 3 is a diagram showing a hardware configuration of a cloud server 400. It is a figure showing an example of functional composition of a watching system. It is a figure showing other examples of functional composition of a watching system. It is a flowchart of the process which the priority provision part 152 performs in order to give a priority to the notification about each resident 800. It is a flowchart of a subroutine of step S102. 6 is a flowchart of a process executed for outputting notification information in the mobile terminal 300. FIG. 9 is a diagram for describing a specific example of display of notification information on a display 305. FIG. 9 is a diagram for describing a specific example of display of notification information on a display 305. FIG. 10B is a diagram illustrating an example of a screen displayed by the mobile terminal 300 when a button 6003 in the screen 6010 in FIG. 10B is operated. FIG. 10 is a diagram illustrating an example of a screen displayed on each mobile terminal 300 when a staff NA operates a button 6003 on a screen 6010 and then operates a button 6014 on a screen 6011. It is a figure showing other examples of a notice according to a priority. FIG. 14 is a diagram illustrating still another example of notification according to a priority order. FIG. 14 is a diagram illustrating still another example of notification according to a priority order. FIG. 14 is a diagram illustrating still another example of notification according to a priority order. It is a figure showing other examples of functional composition of a watching system. It is a figure showing still another example of functional composition of a watching system.

Hereinafter, an embodiment of a watching system will be described with reference to the drawings. In the following description, the same parts and components are denoted by the same reference numerals. Their names and functions are the same. Therefore, the description will not be repeated.

[Configuration of watching system]
FIG. 1 is a diagram illustrating an example of a configuration of a watching system. As an example of a watching target, a resident in each room provided in the room region RM of the facility is adopted. In the watching system of FIG. 1, rooms 900A and 900B are provided in the room area RM. Living room 900A is assigned to resident 800A. Living room 900B is assigned to resident 800B. In the example of FIG. 1, the number of rooms included in the watching system is two, but the number is not limited to this.

In the watching system, the sensor box 100A installed in the living room 900A, the sensor box 100B installed in the living room 900B, the management server 200 installed in the management center ST, and the access point AP are connected via the network NT. Is done.

In the watching system, the portable terminal 300A carried by the staff NA and the portable terminal 300B carried by the staff NB are connected to the network NT via the access point AP. Further, the sensor boxes 100A and 100B, the management server 200, and the access point AP can communicate with the cloud server 400 via the network NT.

The living room 900A includes a bed 901A, a toilet 902A, and furniture 903A as facilities. A door sensor 510A that detects opening and closing of the door is installed on the door of the living room 900A. A toilet sensor 520A that detects the opening and closing of the toilet 902A is installed on the door of the toilet 902A. Bed 901A is provided with odor sensor 530A for acquiring excretion information of resident 800A. The resident 800A is wearing a vital sensor 540A that detects vital information of the resident 800A. One example of detected vital information is the resident's body temperature. Another example is the resident's breathing. Yet another example is the resident's heart rate. Still another example is two or more types of information among these pieces of information. In living room 900A, resident 800A can operate care call slave device 500A.

で は In this specification, the term “sensor box 100”, which generically refers to the sensor boxes 100A and 100B, is used to refer to matters common to the plurality of sensor boxes 100A and 100B. Similarly, residents 800A and 800B, rooms 900A and 900B, beds 901A and 901B, toilets 902A and 902B, furniture 903A and 903B, care call slave units 500A and 500B, door sensors 510A and 510B, toilet sensors 520A and 520B, and odor sensors Similarly, for each of 530A, 530B and vital sensors 540A, 540B, the terms “resident 800”, “room 900”, “toilet 902”, “furniture 903”, “care call child device 500”, “door sensor 510” , “Toilet sensor 520”, “odor sensor 530”, and “vital sensor 540” are used.

The sensor box 100A has a built-in sensor for detecting the behavior of an object in the living room 900A. One example of a sensor is a Doppler sensor for detecting the movement of an object. Another example is a camera. Still other examples are the care call slave device 500, the door sensor 510, the toilet sensor 520, the odor sensor 530, or the vital sensor 540. The sensor box 100A includes at least one of these sensors as a sensor.

FIG. 2 is a diagram for explaining an example of the detection range of the sensor in the living room 900. In the example of FIG. 2, the sensor box 100 is installed on the ceiling CL of the living room 900.

The range AR schematically represents the detection range of the sensor. When the sensor is a Doppler sensor, the Doppler sensor detects a behavior that has occurred within the range AR. When the sensor is a camera, the camera captures an image within the range AR.

に Returning to FIG. 1, the management server 200 installed in the management center ST is connected to the display 206 and the input device 209. The input device 209 is, for example, a keyboard.

In the watching system of FIG. 1, the number of mobile terminals connected to the network NT via the access point AP is two ( mobile terminals 300A and 300B), but the number is not limited to this. In this specification, when referring to items common to the mobile terminals 300A and 300B, the term “mobile terminal 300” that generically refers to the mobile terminals 300A and 300B is used.

Communication between the elements in the watching system of FIG. 1 may be wired or wireless.

Note that the sensor box 100 does not necessarily need to include the camera 105 and / or the Doppler sensor 106. The camera 105 and / or the Doppler sensor 106 may be provided outside the sensor box 100 like the door sensor 510 and the like. The control device 101 may acquire the detection output of the camera 105 and / or the Doppler sensor 106 provided outside the sensor box 100 via a given interface.

The vital sensor 540 does not necessarily have to be worn by the resident. In one example, the vital sensor 540 is realized by an infrared sensor or the like installed at a distance from the resident, and outputs vital information (body temperature) by detecting the temperature of the resident. In another example, vital sensor 540 is implemented by Doppler sensor 106. The Doppler sensor 106 emits microwaves to the resident. The microwave causes a Doppler effect due to slight displacement of the chest due to the pulsation of the resident's heart, and changes its frequency. The Doppler sensor 106 detects a resident's heartbeat based on the fluctuation of the frequency. In yet another example, the Doppler sensor 106 detects a resident's breathing.

[Configuration of each element of the watching system]
FIG. 3 is a diagram illustrating a hardware configuration of the sensor box 100, the management server 200, and the mobile terminal 300 of the watching system. FIG. 4 is a diagram illustrating a hardware configuration of the cloud server 400. Hereinafter, an example of a configuration of each device in the watching system will be described with reference to FIGS. 3 and 4.

(Sensor box 100)
The sensor box 100 includes a control device 101, a read only memory (ROM) 102, a random access memory (RAM) 103, a communication interface 104, a camera 105, a Doppler sensor 106, a wireless communication device 107, and a storage device. 120.

(4) The control device 101 controls the sensor box 100. The control device 101 is composed of, for example, at least one integrated circuit. The integrated circuit includes, for example, at least one CPU (Central Processing Unit), at least one ASIC (Application Specific Integrated Circuit), at least one FPGA (Field Programmable Gate Array), or a combination thereof.

ア ン テ ナ An antenna (not shown) and the like are connected to the communication interface 104. The sensor box 100 exchanges data with an external communication device via the antenna. External communication devices include, for example, management server 200, mobile terminal 300, access point AP, cloud server 400, other communication terminals, and the like.

The camera 105 is a near-infrared camera in one implementation. The near-infrared camera includes an IR (Infrared) projector that emits near-infrared light. By using the near-infrared camera, an image representing the inside of the living room 900 can be captured even at night. In another implementation, camera 105 is a surveillance camera that receives only visible light. In still other implementations, a 3D sensor or a thermographic camera may be used as camera 105. The sensor box 100 and the camera 105 may be configured integrally, or may be configured separately.

The Doppler sensor 106 is, for example, a microwave Doppler sensor, and emits and receives radio waves to detect the behavior (movement) of an object in the living room 900. Thereby, the biological information of the resident 800 in the living room 900 can be detected. In one example, the Doppler sensor 106 radiates a microwave in the 24 GHz band toward the bed 901 of each living room 900 and receives a reflected wave reflected by the resident 800. The reflected wave has been Doppler shifted by the operation of the resident 800. The Doppler sensor 106 can detect the respiratory state and the heart rate of the resident 800 from the reflected wave.

The wireless communication device 107 receives signals from the care call slave device 500, the door sensor 510, the toilet sensor 520, the odor sensor 530, and the vital sensor 540, and transmits the signal to the control device 101. For example, care call slave device 500 includes care call button 501, and when care call button 501 is operated, transmits a signal indicating that the operation has been performed to wireless communication device 107. Each of the door sensor 510, the toilet sensor 520, the odor sensor 530, and the vital sensor 540 transmits their respective detection outputs to the wireless communication device 107.

The storage device 120 is, for example, a storage medium such as a hard disk or an external storage device. The storage device 120 stores a program executed by the control device 101 and various data used for executing the program. The various data may include behavior information of the resident 800.

At least one of the above-described programs and data is a storage device other than the storage device 120 (for example, a storage area (for example, a cache memory or the like) of the control device 101, a ROM 102, The RAM 103 may be stored in an external device (for example, the management server 200 or the mobile terminal 300).

(Behavior information)
The above behavior information will be described. The action information is, for example, information indicating that the resident 800 has performed a predetermined action. In one example, the predetermined actions are “wake up” indicating that the resident 800 has woken up, “getting out” indicating that the resident 800 has left the bedding, and “falling down” indicating that the resident 800 has fallen off the bedding. , And “falling” indicating that the resident 800 has fallen.

In one embodiment, control device 101 generates behavior information of resident 800 associated with each room 900 based on an image captured by camera 105 installed in each room 900. The control device 101 detects, for example, the head of the resident 800 from the image, and based on the detected time change of the size of the head of the resident 800, “wakes up” and “gets out of the resident 800”. , "Fall" and "fall" are detected. Hereinafter, a specific example of the generation of the behavior information will be described in more detail.

First, the storage device 120 stores the location area of the bed 901 in the living room 900, the first threshold Th1, the second threshold Th2, and the third threshold Th3. The first threshold Th1 identifies the size of the resident's head between the lying position and the sitting position in the area where the bed 901 is located. The second threshold value Th2 identifies whether or not the resident is in the standing posture based on the size of the resident's head in the living room 900 excluding the area where the bed 901 is located. The third threshold value Th3 identifies whether or not the resident is in the recumbent posture based on the size of the resident's head in the room RM excluding the area where the bed 901 is located.

The control device 101 extracts a moving object region from the target image as a region of the resident 800 by, for example, the background subtraction method or the frame difference method. The control device 101 further derives from the extracted moving body region by, for example, a circular or elliptical Hough transform, by pattern matching using a prepared head model, or by a neural network learned for head detection. The head area of the resident 800 is extracted using the threshold value thus set. The control device 101 detects “wake up”, “get out of bed”, “fall” and “fall” from the extracted position and size of the head.

The control device 101 determines that the position of the head extracted as described above is within the area where the bed 901 is located, and the size of the head extracted as described above is lying down by using the first threshold Th1. When it is detected that the size of the posture has changed to the size of the sitting posture, it may be determined that the action “wake up” has occurred.

The control device 101 determines that the position of the head extracted as described above moves from within the area where the bed 901 is located to outside the area where the bed 901 is located, and the size of the head extracted as described above. May detect that the action “leaving out of bed” has occurred when it has detected that the size has changed from a certain size to the size of the standing posture by using the second threshold value Th2.

The control device 101 determines that the position of the head extracted as described above moves from within the area where the bed 901 is located to outside the area where the bed 901 is located, and the size of the head extracted as described above. If the time changes from a certain size to a recumbent size by using the third threshold value Th3, it may be determined that the action “fall” has occurred.

The control device 101 is configured such that the position of the head extracted as described above is located in the living room 900 excluding the area where the bed 901 is located, and the size of the extracted head uses the third threshold Th3. When it is detected that the size has changed from a certain size to the size of the lying posture, it may be determined that the action “fall” has occurred.

As described above, in one specific example, the control device 101 of the sensor box 100 generates the behavior information of the resident 800. In the watching system, another element may generate the behavior information of the resident 800 using the image in the living room 900.

(Management server 200)
The management server 200 includes a control device 201, a ROM 202, a RAM 203, a communication interface 204, a display interface 205, an operation interface 207, and a storage device 220.

(4) The control device 201 controls the management server 200. The control device 201 is composed of, for example, at least one integrated circuit. The integrated circuit includes, for example, at least one CPU, at least one ASIC, at least one FPGA, or a combination thereof.

ア ン テ ナ An antenna (not shown) and the like are connected to the communication interface 204. The management server 200 exchanges data with an external communication device via the antenna. The external communication device includes, for example, the sensor box 100.

The display interface 205 is connected to the display 206 and sends an image signal for displaying an image to the display 206 in accordance with a command from the control device 201 or the like.

The operation interface 207 is, for example, a USB (Universal Serial Bus) terminal, and is connected to the input device 209. Operation interface 207 receives a signal indicating a user operation from input device 209. The input device 209 is, for example, a mouse, a keyboard, a touch panel, or another device capable of accepting a user's input operation.

The storage device 220 is, for example, a storage medium such as a hard disk or an external storage device. In one implementation, the storage device 220 stores a program to be executed by the control device 201, but the program may be stored in another storage device that can be accessed by the control device 201.

(Mobile terminal 300)
The mobile terminal 300 includes a control device 301, a RAM 303, a communication interface 304, a display 305, an input device 306, and a built-in memory 320.

(4) The control device 301 controls the mobile terminal 300. The control device 301 is composed of, for example, at least one integrated circuit. The integrated circuit includes, for example, at least one CPU, at least one ASIC, at least one FPGA, or a combination thereof.

ア ン テ ナ An antenna (not shown) and the like are connected to the communication interface 304. The mobile terminal 300 exchanges data with an external communication device via the antenna and the access point AP (FIG. 1). The external communication device includes, for example, the sensor box 100, the management server 200, and the like.

The display 305 is realized by, for example, an organic EL (Electro Luminescence) display. The input device 306 is realized by, for example, a touch sensor superimposed on the display 305. The touch sensor receives various operations on the mobile terminal 300 by a touch operation, and outputs the contents of the operations to the control device 301.

The internal memory 320 is a storage medium such as eMMC (Embedded MultiMediaCard). As an example, the built-in memory 320 stores a program executed by the control device 301. The program is stored in a storage device other than the built-in memory 320 as long as the storage device is accessible by the control device 301. Is also good.

(Cloud server 400)
The cloud server 400 includes a control device 401, a ROM 402, a RAM 403, a communication interface 404, and a storage device 420.

(4) The control device 401 controls the cloud server 400. The control device 401 is composed of, for example, at least one integrated circuit. The integrated circuit includes, for example, at least one CPU, at least one ASIC, at least one FPGA, or a combination thereof.

ア ン テ ナ An antenna (not shown) and the like are connected to the communication interface 404. The cloud server 400 exchanges data with an external communication device via the antenna. The external communication device includes, for example, the sensor box 100 and the management server 200.

The storage device 420 is, for example, a storage medium such as a hard disk or an external storage device. In one implementation, the storage device 420 stores a program executed by the control device 401, but the program may be stored in another storage device that can be accessed by the control device 401.

(Significance of the term "program" in this specification)
In the watching system, various “programs” may be provided as a part of an arbitrary program, not as a single program. Various “programs” can be realized by cooperation of arbitrary plural programs. In one example, when the control device 101 of the sensor box 100 implements a function described herein by executing the first program, the first program includes a part of a module of the second program. May be used. Even if the first program does not include some modules for realizing the function, if the first program mainly contributes to the realization of the function, the first program deviates from the purpose of the program for realizing the function. It does not do. Further, some or all of the functions described in this specification may be realized by dedicated hardware. Furthermore, in an apparatus that provides the functions described in this specification, some or all of the functions may be provided as a so-called cloud service from an external apparatus.

[Function configuration]
FIG. 5 is a diagram illustrating an example of a functional configuration of the watching system. An example of a functional configuration of the watching system will be described with reference to FIG.

The sensor box 100 functions as the interface 150, the memory 151, and the priority assigning unit 152. Interface 150 is implemented, for example, by wireless communication device 107 and receives detection outputs from various sensors such as odor sensor 530 and vital sensor 540, and a notification from care call slave device 500. The memory 151 is realized by the storage device 120, and stores a care record of the resident 800, and behavior information and position information of the resident 800. In one example, the behavior information and the location information of the resident 800 are generated using an image captured by the camera 105, for example.

The priority assigning unit 152 is realized by, for example, the control device 101, and uses at least one of detection output of various sensors, nursing record, action information, and position information to obtain information about each of the plurality of residents 800. Prioritize notifications. The priority assigning unit 152 further transmits a notification about each of the plurality of residents 800 to the display unit 350 together with the priority assigned to each notification.

携 帯 As shown in both the examples of FIGS. 5 and 6, the portable terminal 300 functions as the display unit 350. The display unit 350 is realized by, for example, the display 305, and displays a notification about each of the plurality of residents 800 according to the information received from the priority assignment unit 152 in a manner according to the priority assigned as described above. I do.

FIG. 6 is a diagram showing another example of the functional configuration of the watching system. Compared to the example of FIG. 5, the sensor box 100 further functions as an interface 153. The interface 153 is, for example, a part of the wireless communication device 107 and is realized by a dedicated circuit for communication with the care call slave device 500. In the example of FIG. 6, when the care call button 501 is operated, the care call slave device 500 transmits a signal indicating that the operation has been performed to the interface 153. Upon receiving the signal, the interface 153 notifies the priority assignment unit 152 of the reception of the signal. The priority order assigning unit 152 uses at least one of the detection output of various sensors, nursing record, action information, position information, and a notification from the care call slave device 500, for each of the plurality of residents 800. Prioritize notifications.

例 In the example of FIG. 6, the management server 200 has a display unit 350 instead of the mobile terminal 300 as compared with the example of FIG. In the example of FIG. 6, the notification about each of the plurality of residents 800 is output not in the mobile terminal 300 but in the management server 200. In this sense, the management server functions as a care call master.

Note that the notification for each of the plurality of residents 800 may be output on both the management server 200 and the mobile terminal 300.

[Processing flow (input management)]
FIG. 7 is a flowchart of a process executed by the priority assigning unit 152 to assign a priority to a notification about each resident 800. The processing in FIG. 7 is realized, for example, by the control device 101 executing a given program. The above processing will be described with reference to FIG.

In step S100, control device 101 of sensor box 100 determines whether an event for resident 800 has occurred in living room 900 in which sensor box 100 is installed. Control device 101 repeats the control in step S100 until it determines that the event has occurred (NO in step S100), and when it determines that the event has occurred (YES in step S100), proceeds to step S102. .

One example of the event is the occurrence of an abnormal state of the resident 800 based on the detection output of various sensors.

An example of the abnormal state is that the detection output (vital information) of the vital sensor 540 indicates an abnormal value, and the body temperature of the resident 800 may be higher than a given reference value, or the resident 800 May not have been detected for a given period of time, or the heart rate of the resident 800 may be outside a given range.

Another example of the abnormal state is that the detection output of the odor sensor 530 indicates a value corresponding to the excretion of the resident 800.

Another example of the abnormal state is that action information classified as the abnormal state (for example, “fall” or “fall”) has occurred.

Still another example of an abnormal state is that the location information of the resident 800 represents a specific location, that the history of the location information of the resident 800 indicates a pattern associated with the abnormal state, or that the history is in a normal state. Did not show the pattern associated with.

Yet another example of an abnormal condition is that a given prediction has occurred for the resident 800. One example of the prediction is that the scheduled time for excretion of the resident 800 has arrived.

Another example of the abnormal state is that a notification indicating that the care call button 501 has been operated from the care call slave device 500 has been received.

In step S102, the control device 101 assigns priorities to the events determined to have occurred in step S100. FIG. 8 is a flowchart of the subroutine of step S102. With reference to FIG. 8, the contents of the priority assignment processing in step S102 will be described.

In step S210, control device 101 determines whether or not the event is that the vital information indicates an abnormal value. If so (YES in step S210), the event is determined in step S212. After giving “priority 1” to, control is advanced to step S290. Otherwise (NO in step S210), control device 101 advances the control to step S220.

In this embodiment, the smaller the value of the priority, the higher the priority. For example, of "Priority 1" to "Priority 7", "Priority 1" has the highest priority, and "Priority 7" has the lowest priority.

In step S220, control device 101 determines whether or not the event is the occurrence of action information “fall” (YES in step S220). , The control proceeds to step S290. Otherwise (NO in step S220), control device 101 advances the control to step S230.

In step S230, control device 101 determines whether or not the event indicates that the detection output of odor sensor 530 indicates a value corresponding to excretion, and if so (YES in step S230). After assigning “priority 3” to the event in step S232, the control proceeds to step S290. Otherwise (NO in step S230), control device 101 advances the control to step S240.

In step S240, control device 101 determines whether or not the event is that the location information of resident 800 indicates the location of toilet 902, and if so (YES in step S240), the process proceeds to step S240. After assigning “priority 4” to the event in S242, the control proceeds to step S290. Otherwise (NO in step S240), control device 101 advances the control to step S250.

In step S250, control device 101 determines whether or not the event is that the scheduled time for excretion of resident 800 has arrived. If so (YES in step S250), control device 101 proceeds to step S252. After giving “priority 5” to the event, the control proceeds to step S290. Otherwise (NO in step S250), control device 101 advances the control to step S260. In one example, the control device 101 acquires the scheduled excretion time based on the care record of the resident 800. For this purpose, the control device 101 may derive the scheduled time of the next excretion using the excretion history in the nursing care record of the resident 800 according to a given program, or a predetermined registration in the nursing care record. The next scheduled excretion time of the resident 800 may be read. The nursing care record is a record created by the staff and including various information about each resident 800, including the excretion time of each resident 800. The nursing record is an example of a record input to the control device 101 for the watching target. Note that the care record may be created by hardware resources such as the control device 101 based on the detection output of the sensor for each resident 800 and the like.

In step S260, control device 101 determines whether or not the event has passed a given time (for example, 10 minutes) since the operation of care call button 501 by resident 800, and if so, (step S260). (YES in S260), after assigning “priority 6” to the event in step S262, control proceeds to step S290. Otherwise (NO in step S260), control device 101 advances the control to step S272.

In the process illustrated in FIG. 8, “priority level 6” is assigned to the abnormal state based on the operation of the care call slave device 500 in step S262, while the sensor status of the sensor “Priority 1” to “priority 5” are assigned to the abnormal state based on the detection output. That is, control device 101 gives a higher priority to an event based on the abnormal state based on the detection output of the sensor than an event based on the abnormal state based on operation of care call slave device 500.

に て At step S272, control device 101 assigns “priority 7” to the event, and then proceeds to step S290.

In step S290, control device 101 transmits the event and the priority assigned to the event to portable terminal 300 as notification information. The communication interface 104 is used for transmitting the notification information. In this sense, the control device 101 is an example of a priority assigning unit that assigns a priority, and the communication interface 104 is an example of an output unit that outputs an event (notification) and the priority.

In one implementation example, the control device 101 transmits the notification information to the management server 200. The management server 200 distributes the notification information to each mobile terminal 300 ( mobile terminals 300A and 300B) via the access point AP, so that each mobile terminal 300 receives the notification information.

(4) The portable terminal 300 that has received the notification information displays the notification information. In the display of the notification information, each notification is displayed on the display 305 of the mobile terminal 300 in a manner according to the priority given to the notification, as shown as a screen 6010 in FIG. In this sense, the display 305 of the mobile terminal 300 is an example of an output unit that outputs a notification in a manner according to the priority assigned to the notification. Note that the notification is displayed in a manner according to the priority given to the notification, and as a result, the priority is displayed together with the notification.

[Processing flow (output of notification information)]
FIG. 9 is a flowchart of a process executed for outputting notification information in portable terminal 300. The processing in FIG. 9 is realized, for example, by the control device 301 executing a given program.

In step S300, control device 301 determines whether or not notification information has been received from at least one sensor box 100. Control device 301 repeats the control in step S300 until it determines that the notification information has been received (NO in step S300), and when it determines that the notification information has been received (YES in step S300), proceeds to step S302. .

In step S302, the control device 301 updates the display of the notification information on the display 305. After that, the control device 301 returns the control to step S300. The display of the notification information is an example of the output of the notification for each resident 800. The notification may be output by voice, vibration, or a combination thereof in addition to the display.

FIGS. 10A and 10B are diagrams for explaining a specific example of the display of the notification information on the display 305. FIG. FIG. 10A shows a screen 6000. FIG. 10B shows a screen 6010.

画面 Screen 6000 in FIG. 10A displays notifications about each resident 800 in a predetermined order. More specifically, the screen 6000 includes five buttons 6001 to 6005 representing the states of the five residents 800 and the notification (notification information) arranged on the right of each of the buttons 6001 to 6005. And a character string representing the time at which the event occurred.

For example, the button 6001 includes a display of the name (A) of the resident 800 in the “room 101” which is an example of the room 900. To the right of the button 6001, a character string (19:01) representing the time at which the notification occurred is displayed. Screen 6000 displays five buttons 6001 to 6005 in an order according to the time of occurrence of the event corresponding to each button. The event occurrence time may be the time when the mobile terminal 300 starts displaying the notification, or the time when the sensor box 100 transmits the notification information corresponding to the notification to the mobile terminal 300, The time at which the event based on the notification information corresponding to the notification has occurred may be used.

Screen 6010 in FIG. 10B includes buttons 6001 to 6005, similarly to screen 6000. The screen 6000 of FIG. 10A is a screen that does not include a button of an event that has been given a priority higher than a given rank, whereas the screen 6010 of FIG. 10B has a priority higher than a given rank. 13 is a screen including a button corresponding to the event. Screen 6000 displays buttons 6001 to 6005 in the same manner, while screen 6010 displays buttons 6001 to 6005 in a manner according to the priority given to the notification corresponding to each button.

As an example of the mode according to the priority order, the control device 301 adjusts the color of the button on the screen 6010. In the example of FIG. 10B, a button 6003 displays a notification given “priority 1”, and a button 6004 displays a notification given “priority 5”. Buttons 6001, 6002, and 6005 display notifications to which priorities of “priority 6” or lower are assigned. The control device 301 displays the buttons 6001 to 6005 in colors corresponding to the priorities assigned to the buttons. More specifically, control device 301 displays button 6003, button 6004, and buttons 6001, 6002, and 6005 in different colors.

As another example of the mode according to the priority order, control device 301 displays a button corresponding to the notification together with a character string indicating the priority order given to the notification. The screen 6010 displays a character string “first priority” to the right of the button 6003. The character string indicates the priority (priority 1) assigned to the notification corresponding to button 6003. The screen 6010 displays the character string “5th priority” to the right of the button 6004. The character string indicates the priority (priority 5) assigned to the notification corresponding to button 6004. In the example of FIG. 10B, a character string such as “first priority” is displayed only for a button corresponding to a notification with a priority higher than or equal to a given priority. Character strings may be displayed.

(4) The control device 301 may display a button corresponding to the notification to which the priority is assigned, together with the content of the event based on the notification. As an example of such a display, the control device 301 displays the character string “with heat” on the screen 6010 to the right of the button 6003. This character string is based on the fact that the event based on the notification of the button 6003 is that the body temperature of the resident 800, which is an example of vital information, is higher than a given value. As another example, control device 301 displays a character string “toilet time” on screen 6010 to the right of button 6004. This character string is based on the fact that the event based on the notification of the button 6004 is that the scheduled time for excretion of the resident 800 has come.

[Operations for notifications about tenants and subsequent notification updates]
In the watching system, the staff operates a button corresponding to an event that can be handled by the stiff among the buttons displayed on the screen 6010. When the button is operated, the control device 301 of the mobile terminal 300 updates the display on the display 305.

FIG. 11 is a diagram illustrating an example of a screen displayed by the mobile terminal 300 when the button 6003 in the screen 6010 of FIG. 10B is operated. A screen 6011 of FIG. 11 shows information of an event corresponding to the touched button. The screen 6011 includes columns 6012 and 6013 and buttons 6014 and 6015.

The column 6012 includes a living room 900 (room 103) corresponding to the touched button and a resident 800 (like C). A column 6013 indicates the content of the event corresponding to the touched button. The button 6014 is a button for displaying an intention corresponding to the event. A button 6015 is a button for returning the display on the display 305 to the screen 6010. When the button 6015 is operated, the control device 301 returns the display on the display 305 to the screen 6010.

On the other hand, when the button 6014 is operated, the control device 301 notifies the other mobile terminal 300 that the button operation has been performed via the access point AP. Thereby, control device 301 of another portable terminal 300 updates screen 6010 so that the display of button 6003 is stopped.

FIG. 12 is a diagram illustrating an example of a screen displayed on each mobile terminal 300 when the staff NA operates the button 6003 on the screen 6010 and then operates the button 6014 on the screen 6011. The screen 6017 in FIG. 12 does not include the button 6003 as compared with the screen 6010 in FIG. 10B. This is because the event corresponding to the button 6003 is handled by the staff NA, and there is no need to notify the staff any more.

[Specific example of notification]
The watching system can also perform the notification according to the priority given to the event according to another mode than the mode illustrated in the screen 6010 illustrated in FIG. 10B.

(Arrangement of buttons according to priority)
FIG. 13 is a diagram illustrating another example of the notification according to the priority order. As illustrated in the example of FIG. 13, the mobile terminal 300 may display a button in which a corresponding event is assigned a higher priority in an upper part of the screen.

The control device 301 arranges the button 6003 corresponding to the event assigned “priority 1” at the uppermost position on the screen 6020 of FIG. 13, and then corresponds to the event assigned “priority 5”. A button 6004 is arranged, and buttons 6001, 6002, and 6005 corresponding to events with priorities of 6 or lower are arranged below the button 6004.

で は Note that on the screen, two or more buttons may be arranged in accordance with the priority order corresponding to each button. As long as the buttons are arranged according to the priority, the two or more buttons may be arranged such that the higher the priority, the lower the position or the left or right.

(Display of information corresponding to the priority (contents of the event))
14 and 15 are diagrams illustrating still another example of the notification according to the priority order. In each of the example of FIG. 14 and the example of FIG. 15, the mobile terminal 300 displays information corresponding to the priority (contents of the event) together with the button.

The control device 301 displays an image 6901 corresponding to the event corresponding to the button 6003 on the screen 6030 in FIG. Image 6901 is an example of information indicating the content of the event. The event based on the notification of the button 6003 is a fever of the resident 800 (that is, the body temperature is higher than a given reference value). Image 6901 shows that the human head is hot. Thus, the staff who has viewed screen 6030 can more intuitively grasp the state of resident 800 corresponding to button 6003.

The control device 301 displays an image 6902 corresponding to the event corresponding to the button 6004 on the screen 6030 in FIG. Image 6902 is another example of information representing the content of the event. The event based on the notification of the button 6004 is the arrival of the resident 800's scheduled excretion time. Image 6902 is a pictogram of a toilet. Thus, the staff who has viewed screen 6030 can more intuitively grasp the state of resident 800 corresponding to button 6004.

The images 6901 and 6902 are examples (pictures) of information indicating the priority order. Another example is the character strings “first priority” and “fifth priority” in the image 6010 and the like in FIG. 10B. The information indicating the priority order may be an image such as a photograph indicating a registered toilet that is predetermined in the mobile terminal 300 or the like.

On the screen 6040 of FIG. 15, the control device 301 displays, on the right side of the button 6003, a character string “heat — 38.3 ° C.!” That describes an event to which “priority 1” has been assigned (an event corresponding to the button 6003). Is displayed. In this example, the sensor box 100 that has detected the abnormal state of the resident transmits vital information based on the abnormal state to the portable terminal 300 as notification information. The control device 301 may extract information (body temperature of the resident) for explaining the event from the vital information included in the notification information in order to display the screen 6040.

On the screen 6040 in FIG. 15, the control device 301 displays a character string “3 hours after the last toilet” describing an event to which “priority 5” has been assigned (an event corresponding to the button 6004) to the right of the button 6004. Is displayed. In this example, the sensor box 100 that has detected the abnormal state of the resident transmits the care record based on the abnormal state to the portable terminal 300 as notification information. In order to display screen 6040, control device 301 may extract information for explaining the event (elapsed time from the last excretion time of the resident) from the nursing record included in the notification information.

(Display of treatment details)
FIG. 16 is a diagram showing still another example of the notification according to the priority order. In the example of FIG. 16, the portable terminal 300 displays, together with the button, information indicating the action required by the staff for the event corresponding to the button.

The control device 301 displays the character string “image confirmation” in addition to the character string “fever” on the screen 6050 of FIG. 16 to the right of the button 6003 corresponding to the event to which “priority 1” has been assigned. . The character string “image confirmation” means confirming an image representing the detection output of the resident's vital information.

In this example, the sensor box 100 that has detected the abnormal state of the resident may transmit vital information based on the abnormal state to the portable terminal 300 as notification information. In this case, the control device 301 of the mobile terminal 300 specifies, based on the vital information transmitted from the sensor box 100, a measure for the abnormal state corresponding to the vital information. In this example, the sensor box 100 may also specify, based on the resident's vital information, the details of the treatment for the abnormal state of the resident. In this case, the sensor box 100 transmits the content of the treatment to the portable terminal 300 together with the notification information.

The control device 301 displays the character string “image confirmation” in addition to the character string “toilet time” on the screen 6050 of FIG. 16 to the right of the button 6004 corresponding to the event assigned “priority 5”. I do. The character string “image confirmation” means confirming an image representing the detection output of the odor sensor 530 or the toilet sensor 520 of the resident.

In this example, the sensor box 100 that has detected the abnormal state of the resident specifies the treatment corresponding to the abnormal state (arrival of the scheduled time of excretion) to the portable terminal 300 together with the notification information, and describes the content of the treatment. You may transmit to portable terminal 300. On the other hand, the portable terminal 300 that has received the notification information may specify the content of the treatment corresponding to the event (abnormal state) of the notification information. The sensor box 100 may transmit the detection output of the resident's odor sensor 530 or the toilet sensor 520 to the mobile terminal 300 together with the notification information when an abnormal state related to the arrival of the scheduled excretion time has occurred. The staff looking at the display of the screen 6050 checks the detection output of the odor sensor 530 or the toilet sensor 520, and can estimate the urgency of responding to the resident corresponding to the button 6003.

ス タ ッ フ In one example, the staff understands that the urgency is higher when the odor sensor 530 detects the excretion of the resident than when it does not. In another example, the staff understands that the urgency is lower when the toilet sensor 520 detects the occupant entering the toilet 902 than when the occupant does not detect the entrance.

[Centralized management by management server]
According to the configuration shown in FIG. 5, in the watching system, after the sensor box 100 detects an abnormal state of the resident and assigns a priority to the abnormal state, the notification information about the abnormal state is carried. Transmitted to terminal 300. The mobile terminal 300 outputs a notification for each of the residents according to the received notification information. Notifications for each of the tenants were output in a manner according to the priority given to each notification. In the watching system, the elements that execute the detection of the abnormal state, the assignment of the priority order, and the output of the notification are not limited to those illustrated in FIG.

FIG. 17 is a diagram showing another example of the functional configuration of the watching system. In the example of FIG. 17, the management server 200 manages data collectively. In other words, the management server 200 functions as the data management unit 250 and further functions as the priority assignment unit 152. The data management unit 250 is realized by, for example, the storage device 220 and stores various data. The priority assignment section 152 is realized by, for example, the control device 201.

Each sensor box 100 receives at least one of the detection output of various sensors (odor sensor 530, vital sensor 540, and the like) and the resident's behavior information and / or position information generated from the detection output of various sensors. , To the management server 200. The data management unit 250 of the management server 200 stores the data received from each sensor box 100 and the care record of each resident input via the communication interface 204 and / or the operation interface 207.

The priority assigning unit 152 detects the occurrence of at least one event (abnormal state) for each resident as described in step S100 of FIG. When the occurrence of an abnormal state is detected, the priority assigning section 152 assigns a priority to the abnormal state of each resident as described in steps S210 to S272 in FIG. Then, the priority assigning unit 152 transmits each event and the priority assigned to the event to the mobile terminal 300 as notification information.

In the example of FIG. 17, the portable terminal 300 functions as the display unit 350. The display unit 350 outputs a notification about each resident according to the notification information transmitted from the management server 200 (priority assignment unit 152), as described as steps S300 and S302 in FIG.

[Management by mobile terminal application]
FIG. 18 is a diagram illustrating still another example of the functional configuration of the watching system. In the example of FIG. 18, the mobile terminal 300 functions as the priority assigning unit 152. In one example, an application for generating and outputting notification information about a resident (hereinafter, referred to as a “resident monitoring application”) is installed in each mobile terminal 300, and the control device 301 of the mobile terminal 300 is By executing the resident watching application, the mobile terminal 300 functions as the priority assigning unit 152. 17, the management server 200 functions as the data management unit 250.

The priority assigning unit 152 acquires, from the data management unit 250, the data received from each sensor box 100 and the nursing care record of each resident input via the communication interface 204 and / or the operation interface 207. The transmission of these pieces of information from the data management unit 250 to the priority assignment unit 152 may be a push type (by a reception request from the data management unit 250) or a pull type (from the priority assignment unit 152). Transmission request).

The priority assigning unit 152 determines whether or not an event (abnormal state) has occurred for each resident using the data received from the data management unit 250 at regular time intervals, for example (step S100). When it is determined that an event (abnormal state) has occurred for one resident, a priority is given to the event newly determined to have occurred (steps S210 to S272). The priority assigning unit 152 outputs a notification corresponding to each event according to the priority (Steps S300 to S302).

[Update priority criteria by learning]
In the embodiment described above, each event (abnormal state) is assigned a priority using, for example, the criteria shown as steps S210 to S272 in FIG. The criterion can be updated by learning using the history of at least one of the resident's vital information, position information, behavior information, and excretion information.

In one example, the detection output of each sensor at regular intervals (2 to 3 seconds) and the behavior information generated from the detection output are transmitted to the cloud server 400 and stored in the storage device 420. The control device 401 uses the machine learning or the deep learning to generate a second event with a certain probability or more within a first time from the data stored in the storage device 420 after the first event occurs after the first event occurs. When the knowledge that the first event is performed is acquired, the priority given to the first event may be changed before and after the first time elapses from the occurrence of the first event.

In one example, the control device 401 calls the fall (behavior information) within one minute after the resident is located at a specific place (bed end) by machine learning or deep learning using data on a certain resident. The knowledge that an event occurs with a probability equal to or higher than a given value is obtained. In this case, the control device 401 assigns, to the device functioning as the priority assigning unit 152, the priority assigned to the event “located at a specific place” for the resident to the occurrence of the event. After that, the user is instructed to change before and after one minute. More specifically, the control device 401 instructs to update the priority assignment criteria so that the priority one minute after the event occurs is higher than the priority one minute before the event occurs. I do.

Note that a device that assigns a priority to each event may update the priority as described above. In the example illustrated in FIG. 18, the mobile terminal 300 assigns a priority to each event. The control device 301 provided in the portable terminal 300 itself may update the criterion for assigning the priority by the machine learning or the deep learning as described above.

In the monitoring system, a device to which the priority is assigned or another device may receive input of information for updating the priority. In accordance with the input of the information, the criterion for assigning the priority can be updated.

各 The embodiments disclosed this time are to be considered in all respects as illustrative and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims. Further, it is intended that the inventions described in the embodiments and the respective modifications are implemented individually or in combination as much as possible.

100, 100A, 100B {sensor box, 101, 201, 301, 401} control device, 104, 204, 304, 404 communication interface, 105 camera, 106 Doppler sensor, 107 wireless communication device, 120, 220, 420 storage device, 150, 153 interface, 151 memory, 152 priority assigning unit, 200 management server, 205 display interface, 206, 305 display, 250 data management unit, 300, 300A, 300B portable terminal, 320 built-in memory, 350 display unit, 400 cloud server, 500, 500A, 500B {care call slave unit, 501} care call button, 510, 510A, 510B {door sensor, 520, 520A, 520B} Ile sensor, 530, 530A, 530B sensor, 540, 540A, 540B vital sensor, 800, 800A, 800B resident, 900, 900A, 900B living room, 901, 901A, 901B bed, 902, 902A, 902B toilet, 903, 903A , 903B @ Furniture.

Claims (14)

1. Based on the abnormal state of the watching target identified based on the biological information of the watching target detected by the sensor, based on the abnormal state of the watching target, a priority order giving unit that gives a priority to the notification about the watching target,
   An information processing apparatus, comprising: an output unit that outputs the notification and the priority of a watching target.
2. The information processing apparatus according to claim 1, wherein the abnormal state includes an operation of the care call slave device by the watching target.
3. 3. The information processing device according to claim 2, wherein, when the abnormal state is an operation of the care call slave device by the watching target, the priority order assigning unit assigns a priority order based on an elapsed time from the operation.
4. The priority order giving unit is configured to give a notification based on the abnormal state specified based on the biological information detected by the sensor a higher priority than a notification based on the abnormal state specified based on the operation of the care call slave unit. The information processing device according to claim 2 or 3, wherein
5. The information processing apparatus according to any one of claims 1 to 4, wherein the priority order depends on a record input for the watching target.
6. The information processing apparatus according to any one of claims 1 to 5, wherein the biological information detected by the sensor includes at least one of vital information, position information, behavior information, and excretion information.
7. The information processing apparatus according to any one of claims 1 to 6, wherein the output unit outputs the notification in a manner according to the priority.
8. The information processing apparatus according to claim 7, wherein the output unit displays the two or more notifications arranged in accordance with the priority assigned to each of the notifications.
9. The information processing apparatus according to claim 7, wherein the output unit displays the notification together with information indicating a priority assigned to the notification.
10. The information processing apparatus according to claim 9, wherein the information indicating the priority includes at least one of a character, a picture, and an image.
11. 2. The apparatus according to claim 1, further comprising: an update unit that updates a criterion for assigning the priority using at least one history of vital information, position information, behavior information, and excretion information of the watching target. The information processing apparatus according to any one of claims 10 to 10.
12. Sensors and
    Based on the abnormal state of the watching target identified based on the biological information of the watching target detected by the sensor, based on the abnormal state of the watching target, a priority order giving unit that gives a priority to the notification about the watching target,
    A sensor box comprising: an output unit configured to output the notification and the priority of a watching target.
13. By being executed by the computer of the information processing terminal,
    Based on the abnormal state of the watching target identified based on the biological information of the watching target detected by the sensor, a step of giving a priority to the notification about the watching target,
    A program for executing the step of outputting the notification and the priority of the watching target.
14. 14. The program according to claim 13, wherein the step of outputting the notification and the priority of the watching target includes displaying the notification in a mode according to the priority.

Images