JP7327396B2 - Control program, report output method, and report output device - Google Patents

Description

TECHNICAL FIELD The present invention relates to a control program, a report output method, and a report output device, and more particularly to a control program, a report output method, and a report output device for outputting a report on a target person treated by staff.

In Japan, life expectancy has increased remarkably due to improvements in living standards, sanitary environments, and medical standards that have accompanied the post-war period of rapid economic growth. For this reason, coupled with the declining birth rate, Japan is becoming an aging society with a high rate of aging. In such an aging society, it is expected that the number of people requiring nursing care will increase due to illness, injury, aging, and the like.

BACKGROUND ART In facilities such as hospitals and welfare facilities for the elderly, persons requiring care may fall while walking or fall from a bed and be injured. Therefore, in order to enable nurses and caregivers to rush to the caregiver when the care recipient is in such a state, systems have been developed to detect the condition of the care recipient. there is

In the nurse call system disclosed in Patent Document 1 as such a system, it is determined whether the patient is getting up or getting out of bed from the image captured by a camera installed on the patient's bed. do. Then, when the patient wakes up or leaves the bed, the image picked up by the camera is displayed on the nurse call main unit provided in the nurse station.

In addition, regarding nursing care work, in order to prevent near-miss incidents from recurring due to an accident or a mistake in the countermeasures for near-miss incidents that lead to this, Patent Document 2 discloses a medical care system that determines whether or not a near-miss incident requiring countermeasures has occurred. An assist device is disclosed. This medical care support device calculates the degree of similarity (correction notification hit rate) between the case record input by the caregiver and past near-miss incidents recorded in the database. If it is, it is specified as countermeasure information that needs to be improved.

JP 2014-90913 A JP 2013-191184 A

However, although the nurse call system disclosed in Patent Literature 1 can detect when a patient gets up and leaves the bed, it cannot prevent accidents and near misses. In addition, the medical care support device disclosed in Patent Document 2 identifies errors in countermeasures against past near-miss incidents by comparing near-miss incidents that have occurred in the past. It does not prevent the occurrence of close calls that lead to each other.

The present invention has been made in view of the above circumstances, and a control program capable of outputting a report useful for preventing the occurrence of an event by analyzing an event that may lead to an accident, a report output method, and to provide a report output device.

The above problems of the present invention are solved by the following means.

(1) Accumulated event information of a predetermined event that may lead to an accident and image data associated with the event, based on the output of a detection unit that detects the movement of the subject in the observation area and the event information recording the predetermined event related to the subject in the observation area determined to have occurred, and the image obtained by photographing the observation area for a predetermined period including the time when the event occurred. a procedure (a) for obtaining data;
For the subject, the analysis result is visualized by analyzing the occurrence status of the event using the information on the occurrence status of the event or using the information on the occurrence status of the event and the image data. step (b) of creating a report to be
a step (c) of outputting the report created in the step (b);
A process including
The step (b) includes a step (b1) of displaying the image data for the period before and after the time when the number of occurrences of the event per unit period increases for the subject;
including a step (b2) for receiving comments input by the user,
In the step (b), a control program for causing a computer to execute a process of creating the report including the comments received in the step (b2) .
(2) accumulated event information of a predetermined event that may lead to an accident and image data associated with the event, based on the output of a detection unit that detects the movement of the subject in the observation area; and the event information recording the predetermined event related to the subject in the observation area determined to have occurred, and the image obtained by photographing the observation area for a predetermined period including the time when the event occurred. a procedure (a) for obtaining data;
For the subject, the analysis result is visualized by analyzing the occurrence status of the event using the information on the occurrence status of the event or using the information on the occurrence status of the event and the image data. step (b) of creating a report to be
a step (c) of outputting the report created in the step (b);
Based on the event information acquired in the procedure (a), it is determined whether or not the number of occurrences of the event per unit period has increased for the target person, and if it is determined that the increase has occurred, the target person a step (d) of creating a comment calling attention to the event of the person;
A process including
A control program for causing a computer to execute, in step (b), the process of creating the report including the comment created in step (d).
(3) accumulated event information of a predetermined event that may lead to an accident and image data associated with the event, based on the output of a detection unit that detects the movement of the subject in the observation area; and the event information recording the predetermined event related to the subject in the observation area determined to have occurred, and the image obtained by photographing the observation area for a predetermined period including the time when the event occurred. a procedure (a) for obtaining data;
For the subject, the analysis result is visualized by analyzing the occurrence status of the event using the information on the occurrence status of the event or using the information on the occurrence status of the event and the image data. step (b) of creating a report to be
a step (c) of outputting the report created in the step (b);
A process including
Executing a process on a computer, wherein the report created in the step (b) includes the image data of the period before and after the period when the number of occurrences of the event per unit period increased for the subject. control program to let

( 4 ) The control program according to any one of (1) to (3) above, wherein the information on the occurrence status of the event includes the number of occurrences of the event and the time of occurrence.

( 5 ) Any one of (1) to (4) above, wherein the predetermined event includes a fall event in which the fall of the subject is determined, or a fall event in which the fall of the subject is determined. Control program described in .

( 6 ) The staff who respond to the above-mentioned target person carry a mobile terminal,
Any one of (1) to ( 5 ) above, wherein the event information includes information indicating that the event has been confirmed, which is input by the staff through the mobile terminal in response to the occurrence of the event. Control program described in .

( 7 ) accumulated event information of a predetermined event that may lead to an accident and image data associated with the event, based on the output of a detection unit that detects the movement of the subject in the observation area; and the event information recording the predetermined event related to the subject in the observation area determined to have occurred, and the image obtained by photographing the observation area for a predetermined period including the time when the event occurred. Procedure (a) for acquiring data by the report output device ;
By analyzing the event occurrence status of the subject using the information on the occurrence status of the event or using the information on the occurrence status of the event and the image data, the report output device , a procedure (b) for creating a report in which the analysis results are visualized;
a step (c) in which the report output device outputs the report created in the step (b);
contains
The step (b) includes a step (b1) of displaying the image data for the period before and after the time when the number of occurrences of the event per unit period increases for the subject;
including a step (b2) for receiving comments input by the user,
The report output method , wherein in the step (b), the report including the comments received in the step (b2) is created .
(8) accumulated event information of a predetermined event that may lead to an accident and image data associated with the event, based on the output of a detection unit that detects the movement of the subject in the observation area; and the event information recording the predetermined event related to the subject in the observation area determined to have occurred, and the image obtained by photographing the observation area for a predetermined period including the time when the event occurred. Procedure (a) for acquiring data by the report output device;
By analyzing the event occurrence status of the subject using the information on the occurrence status of the event or using the information on the occurrence status of the event and the image data, the report output device , a procedure (b) for creating a report in which the analysis results are visualized;
a step (c) in which the report output device outputs the report created in the step (b);
Based on the event information acquired in the procedure (a), it is determined whether or not the number of occurrences of the event per unit period has increased for the target person, and if it is determined that the increase has occurred, the target person a step (d) in which the report output device creates a comment calling attention to the event of the person;
contains
The report output method, wherein in the step (b), the report including the comments created in the step (d) is created.
(9) accumulated event information of a predetermined event that may lead to an accident and image data associated with the event, based on the output of a detection unit that detects the movement of the subject in the observation area; and the event information recording the predetermined event related to the subject in the observation area determined to have occurred, and the image obtained by photographing the observation area for a predetermined period including the time when the event occurred. Procedure (a) for acquiring data by the report output device;
By analyzing the event occurrence status of the subject using the information on the occurrence status of the event or using the information on the occurrence status of the event and the image data, the report output device , a procedure (b) for creating a report in which the analysis results are visualized;
a step (c) in which the report output device outputs the report created in the step (b);
contains
The report output method, wherein the report created in the step (b) includes the image data of the period before and after the time when the number of occurrences of the event per unit period increases for the subject.

(10) accumulated event information of a predetermined event that may lead to an accident and image data associated with the event, based on the output of a detection unit that detects the movement of the subject in the observation area; and the event information recording the predetermined event related to the subject in the observation area determined to have occurred, and the image obtained by photographing the observation area for a predetermined period including the time when the event occurred. an acquisition unit that acquires data;
For the subject, the analysis result is visualized by analyzing the occurrence status of the event using the information on the occurrence status of the event or using the information on the occurrence status of the event and the image data. a creation unit that creates a report to be
an output unit that outputs the report created by the creation unit;
a control unit for displaying the image data of the period before and after the period when the number of occurrences of the event per unit period increased for the target person, and for accepting an input of a comment by a user;
with
The report output device, wherein the creation unit creates the report including the comments received by the control unit .
(11) accumulated event information of a predetermined event that may lead to an accident and image data associated with the event, based on the output of a detection unit that detects the movement of the subject in the observation area; and the event information recording the predetermined event related to the subject in the observation area determined to have occurred, and the image obtained by photographing the observation area for a predetermined period including the time when the event occurred. an acquisition unit that acquires data;
For the subject, the analysis result is visualized by analyzing the occurrence status of the event using the information on the occurrence status of the event or using the information on the occurrence status of the event and the image data. a creation unit that creates a report to be
an output unit that outputs the report created by the creation unit;
with
Based on the acquired event information, the creation unit determines whether or not the number of occurrences of the event per unit period has increased for the target person, and if it is determined that the increase has occurred, the target person a report output device that generates an attention-grabbing comment and generates the report containing the comment regarding the event of the .
(12) accumulated event information of a predetermined event that may lead to an accident and image data associated with the event, based on the output of a detection unit that detects the movement of the subject in the observation area; and the event information recording the predetermined event related to the subject in the observation area determined to have occurred, and the image obtained by photographing the observation area for a predetermined period including the time when the event occurred. an acquisition unit that acquires data;
For the subject, the analysis result is visualized by analyzing the occurrence status of the event using the information on the occurrence status of the event or using the information on the occurrence status of the event and the image data. a creation unit that creates a report to be
an output unit that outputs the report created by the creation unit;
with
The report output device, wherein the report created by the creation unit includes the image data of the period before and after the time when the number of occurrences of the event per unit period increases for the target person.

According to the present invention, event information of a predetermined event that may lead to an accident and image data associated with this event information are acquired, and information on the occurrence of the event or information on the event for the subject is acquired. By analyzing the event occurrence status using the information on the occurrence status and the image data, a report that visualizes the analysis results is created and output. As a result, it is possible to output a report useful for preventing the occurrence of an event that may lead to an accident.

It is a figure showing the whole watching system composition. It is a figure which shows the example of the detection part installed in the room of a subject. 4 is a block diagram showing a schematic configuration of a detection unit; FIG. 3 is a block diagram showing a schematic configuration of a server; FIG. 2 is a block diagram showing a schematic configuration of a staff terminal; FIG. It is a sequence chart which shows the procedure of the process of a watching system. It is an example of an event list stored in a storage unit. It is an example of the operation screen for confirming the event displayed on the staff terminal. 7 is a flow chart showing the procedure of report output processing according to the first embodiment. FIG. 10 is a diagram showing an example of visualizing analysis results of falling/falling in a certain subject; FIG. 10 is a diagram showing an example of a report outputting visualized analysis results; FIG. 11 is a flow chart showing a procedure of report output processing in a modified example; FIG.

Hereinafter, embodiments of the present invention will be described with reference to the attached drawings. In the description of the drawings, the same elements are denoted by the same reference numerals, and overlapping descriptions are omitted. Also, the dimensional ratios in the drawings are exaggerated for convenience of explanation, and may differ from the actual ratios.

(overall structure)
FIG. 1 is a diagram showing the overall configuration of the watching system according to the present embodiment, and FIG. 2 is a diagram showing an example of detection units installed around the bed in the subject's room.

As shown in FIG. 1, the monitoring system 1 includes a plurality of detection units 10, a server 20, a fixed terminal 30, and one or more staff terminals 40. FIG. Server 20 functions as a report output device. These are connected by wire or wirelessly so as to be able to communicate with each other via a network 50 such as a LAN (Local Area Network), a telephone network, or a data communication network. Network 50 may include repeaters, such as repeaters, bridges, routers, or cross-connects that relay communication signals. In the example shown in FIG. 1, the staff terminal 40, the detection unit 10, the server 20, and the fixed terminal 30 are mutually connected via a network 50 such as a wireless LAN (for example, a LAN conforming to the IEEE 802.11 standard) including an access point 51. Connected for communication.

The watching system 1 is arranged at an appropriate place according to the target person 70 . The target person 70 (also referred to as a person to be watched over or a person to be cared for) is, for example, a patient who needs nursing care due to illness or injury, a cared person who needs nursing care due to a decline in physical ability due to old age, or a person who lives alone. Those who live alone, etc. In particular, from the viewpoint of enabling early detection and early countermeasures, the subject 70 can be a person who needs detection when a predetermined inconvenient event such as an abnormal condition occurs to the person. Therefore, the watching system 1 is preferably installed in buildings such as hospitals, welfare facilities for the elderly, and dwelling units according to the type of the target person 70 . In the example shown in FIG. 1, the watching system 1 is placed in a facility that includes a plurality of rooms (living rooms) in which a plurality of subjects 70 reside and a plurality of rooms including a nurse station.

The detection unit 10 is arranged in each living room, which is the observation area of the subject 70 . In the example shown in FIG. 1, the four detection units 10 are arranged in the rooms of the subjects 70, Mr. A, Mr. B, Mr. C, and Mr. D, respectively. The observation area of the detector 10 includes the bed 60 . A staff member 80 (also referred to as a care staff member or a care staff member) who nurses or cares for a subject 70 carries a staff terminal 40, which is a portable terminal. However, the position, the number, and the like of each component included in the watching system 1 are not limited to the example shown in FIG. 1 . For example, server 20 may not be located at a nurse's station, but may be an external server unit connected to network 50 . Alternatively, the fixed terminal 30 may be omitted and the server 20 or the staff terminal 40 may perform the function.

(Detector 10)
FIG. 3 is a block diagram showing a schematic configuration of the detector. As shown in the figure, the detection unit 10 includes a control unit 11, a communication unit 12, a camera 13, a nurse call unit 14, and an audio input/output unit 15, which are interconnected by a bus.

The control unit 11 includes a CPU (Central Processing Unit), RAM (Random Access Memory), ROM (Read Only Memory), and other memories, and performs control and arithmetic processing of each unit of the detection unit 10 according to a program. Note that the control unit 11 may further include an HDD (Hard Disk Drive) as a memory.

The communication unit 12 is an interface circuit (for example, a LAN card, etc.) for communicating with other devices such as the server 20 , the fixed terminal 30 , or the staff terminal 40 via the network 50 .

The camera 13 is arranged, for example, on the ceiling or upper part of the wall of the living room, photographs an area including the bed 60 of the subject 70 directly below as an observation area, and outputs a photographed image (image data). The captured images include still images and moving images. Although the camera 13 is a near-infrared camera, a visible light camera may be used in place of this, or these may be used in combination.

The control unit 11 determines (recognizes) occurrence of a predetermined action of the subject 70 from the captured image captured by the camera 13 . Predetermined actions to be determined include "getting up" from the bed 60, "getting out of bed" from the bed 60, "falling" from the bed 60, and "falling" to the floor or the like.

The control unit 11 detects image silhouettes (hereinafter referred to as “human silhouettes”) from a plurality of captured images (moving images). A human silhouette can be detected, for example, by extracting a range of pixels with relatively large differences by a time difference method of extracting differences between images captured at different times. A person silhouette may be detected by a background subtraction method that extracts a difference between a captured image and a background image. The distinction between getting up, leaving the bed, falling, and falling is recognized from the posture of the target person 70 (for example, standing, sitting, lying down, etc.) from the detected human silhouette, and from the position relative to the bed 60 and other installations in the living room. be done. These recognitions may be performed by a program processed by the CPU of the control unit 11, or may be performed by a built-in processing circuit. In the following description, it is assumed that the control unit 11 determines the type of event and whether or not it has occurred. However, the present invention is not limited to this, and all or most of these recognition processes may be performed on the server 20 side, and the control section 11 may only transmit the captured image to the server 20 . If any type of action is recognized, the control unit 11 transmits a notification to the effect that the action (event described later) has occurred to the server 20 or the like.

The staff member 80 is a person who provides various services to the target person 70 according to the work. Services may include medical services and nursing services. Here, when the work of the staff 80 is nursing work for the target person 70, the contents of the correspondence regarding each event will be described. "Wake-up" is determined as an event, and if the determination is within a predetermined time (wake-up time set in the facility (for example, 7:00 to 8:00 am)), morning care is performed. This morning care includes washing the face, assistance with brushing teeth, wearing of dentures, assistance with changing clothes, and the like. In addition, if it is an event of "getting out of bed", wheelchair transfer and walking assistance may be required. Regular (regular) events other than the events determined by the detection unit 10 include beverages, meal assistance, excretion assistance, wheelchair transfer, walking assistance, and position change (bedsore prevention). For these periodic events, the nurse call unit 14 or the like may generate an alert at the scheduled time.

The nurse call unit 14 includes a push-button switch, and detects a nurse call (also called a care call) when the subject 70 pushes the switch. A nurse call may be detected by a voice microphone in place of the push-button switch. When the switch of the nurse call unit 14 is pressed, that is, when a nurse call is detected, the control unit 11 notifies the nurse call via the communication unit 12 and the network 50 (nurse call notification). It is transmitted to the server 20 or the like.

The voice input/output unit 15 is, for example, a speaker and a microphone, and enables voice communication by transmitting and receiving voice signals to and from the staff terminal 40 and the like via the communication unit 12 . Note that the voice input/output unit 15 may be connected to the detection unit 10 via the communication unit 12 as an external device of the detection unit 10 .

Further, the detection unit 10 includes a Doppler shift type body motion sensor that transmits and receives microwaves toward the direction of the bed 60 and detects the Doppler shift of the microwaves caused by body motion (for example, respiratory motion) of the subject 70. , may further comprise: This body motion sensor detects the body motion of the chest (vertical motion of the chest) associated with the breathing motion of the subject 70, and detects the disturbance of the cycle of the body motion of the chest and the body motion of the chest which is below a preset threshold value. When the amplitude at is detected, it is recognized as abnormal micromotion.

In this embodiment, the nurse call by the nurse call unit 14 and the change in the state recognized by the detection unit 10 regarding the subject 70, such as getting up, getting out of bed, falling, falling, abnormal micromotion, etc. An event that should be reported (notified) is called an event. The detection unit 10 transmits (outputs) information about the event that has occurred and the captured image to the server 20 .

(Server 20)
FIG. 4 is a block diagram showing a schematic configuration of the server. The server 20 includes a control section 21 , a communication section 22 and a storage section 23 . The server 20 may be provided in the same building as the living room for the subject 70, or may be provided in a remote location and connectable via a network. For example, the server 20 may be a cloud server virtually constructed by a plurality of servers arranged on a network such as the Internet. Each component is communicatively connected to each other by a bus. The storage unit 23 functions as a database and stores various types of information regarding the event list, the subject 70 and the staff 80 . The control unit 21 cooperates with the communication unit 22 to acquire event information of a predetermined event that may lead to an accident and image data for a predetermined period including the time when the event associated with the event occurs. functions as a department. The control unit 21 also functions as a creation unit that creates a report by analyzing the event occurrence status from the acquired data. The control unit 21 also functions as an output unit that outputs the created report by cooperating with the communication unit 22 . Since the control unit 21 and the communication unit 22 have functions similar to those of the components of the detection unit 10, detailed description thereof will be omitted. As will be described later, this event list contains information on various events including predetermined events that may lead to accidents (for example, events of falls and overturns). A predetermined event that may lead to an accident is also called a near-miss event, and if the situation continues as it is, an accident may occur.

The server 20 determines (identifies) to which subject 70 an event such as a nurse call, getting up, getting out of bed, falling, falling, etc. detected by the detection unit 10 relates to. This determination determines the target person 70 (that is, the occupant of the room) associated with the room number in which the detection unit 10 that detected the event is installed. Then, the determined event type and the target person 70 are associated with each other and added to the event list in the storage unit 23 . In this embodiment, if the subject 70 carries an IC tag, the subject 70 may be determined by reading the IC tag with an RFID reader provided in each room. . In addition, when a plurality of subjects 70 exist in one room, such as in a shared room, the subject 70 may be determined by arranging the detection unit 10 for each bed 60 . Further, in relation to this, by bringing the staff terminal 40 carried by the staff 80 closer to the RFID reader, the entry of each staff member 80 into the room may be detected.

(Fixed terminal 30)
The fixed terminal 30 is a so-called PC (Personal Computer), and includes a control section, a communication section, a display section, an input section, and an audio input/output section, each of which includes a CPU, a RAM, and the like. The fixed terminal 30 is arranged, for example, in a nurse station. In addition, when outputting a report, which will be described later, a user (staff 80, administrator who manages this staff 80, etc.) inputs instructions to display a report in which the analysis results are visualized in a chart or the like on the display unit, or an external For example, a printer (not shown) outputs the data on paper. In addition, the report may include a comment input by the user through the input unit while referring to the photographed image displayed on the display unit (display) of the fixed terminal 30, as will be described later.

In addition, the staff 80 or technical staff, etc., through the fixed terminal 30, when the detection unit 10 is attached to each room (living room), associate the room number and the detection unit 10, Positional information of the installed object, that is, calibration and designation of upward-view contour information by the camera 13 on the ceiling are performed. Also, identification information such as the name and ID number of the subject 70 who is hospitalized or resides in the room is associated with each room number.

(Staff terminal 40)
FIG. 5 is a block diagram showing a schematic configuration of the staff terminal 40. As shown in FIG. The staff terminal 40 includes a control section 41, a wireless communication section 42, a display section 43, an input section 44, and an audio input/output section 45, which are interconnected by a bus. The control unit 41 has a configuration similar to that of the control unit 11 of the detection unit 10, and includes a CPU, a RAM, a ROM, and the like. The wireless communication unit 42 enables wireless communication using standards such as Wi-Fi and Bluetooth (registered trademark), and wirelessly communicates with each device via the access point 51 or directly. The display unit 43 and the input unit 44 are touch panels, and a touch sensor as the input unit 44 is superimposed on the display surface of the display unit 43 made of liquid crystal or the like. The display unit 43 and the input unit 44 display various operation screens showing a list of a plurality of events included in the event list to the staff 80, and accept various operations through the operation screens. The voice input/output unit 45 is, for example, a speaker and a microphone, and enables the staff 80 to make voice calls with other staff terminals 40 via the wireless communication unit 42 . The staff terminal 40 is a device that functions as a user interface of the monitoring system 1, and can be configured by portable communication terminal devices such as tablet computers, smart phones, or mobile phones.

The staff member 80 performs login authentication processing through the assigned staff terminal 40 at the start of work. The staff 80 inputs the staff ID and password through the touch panel (display unit 43, input unit 44) of the staff terminal 40. FIG. The staff terminal 40 transmits this to the server 20 . The server 20 compares the authentication information stored in the storage unit 23 and transmits the authentication result corresponding to the authority of the staff 80 to the staff terminal 40, thereby completing the login authentication.

(Processing procedure of monitoring system)
Next, the process of accumulating event information and image data performed by the entire watching system 1 will be described with reference to FIG. 6 . FIG. 6 is a sequence chart showing the procedure of processing of the watching system.

(Step S110)
As shown in FIG. 6 , the detection unit 10 detects movement of the subject 70 in the observation area or an event of a nurse call by the subject 70 . Then, the detection unit 10 determines from the movement of the subject 70 whether or not another event such as a fall has occurred.

(Steps S120, S130)
When it is determined that an event has occurred, the event information is transmitted to the server 20 . Further, the detection unit 10 transmits image data obtained by photographing an observation area when an event occurs. In this case, if the type of the event that occurred is a specific type, for example, an event that may lead to an accident such as a fall, a predetermined time (for example, several seconds to several tens of seconds) before and after the time of occurrence, including the time of occurrence A moving image may be transmitted, and if the event is of another type, a still image at the time of occurrence may be transmitted. As another example, the detection unit 10 continuously transmits the captured images to the server 20, and the server 20 stores the captured images in a temporary storage unit for a predetermined time period (for example, the past several hours) while overwriting the captured images. . Then, when an event occurs and the server 20 receives event information from the detection unit 10, the server 20 may read still images or moving images around the time of occurrence from the temporary storage unit, and store them in association with the event. .

(Step S140)
Server 20 updates the event list. FIG. 7 is an example of an event list stored in the storage unit 23. As shown in FIG. Events included in the event list include getting up, getting out of bed, falling, falling, and nurse call as described above. The latest event sent in step S120 is added to the end of the event list.

As shown in FIG. 7, each event includes an automatically assigned primary key event ID, room number, target audience, event type, date and time of occurrence (time), image data, and information on response status. be The image data is, as described above, still image data or moving image data obtained by the detection unit 10 capturing an image when an event occurs, which is transmitted in step S130. The response status includes status, response staff, and response date and time (time). The status of support will be described later.

In the example shown in FIG. 7, the event with event ID 010 is a fall, and the events with event IDs 011 and 012 are nurse calls. Event IDs 013 to 015 are, in order, wake-up, getting out of bed, and falling, which occurred consecutively for one target person 70 (Mr. B). The status of the handling status of events with event IDs 010 to 012 is handled, and event IDs 013 to 015 are unhandled.

(Step S150)
When the event list is updated by detecting and adding a new event or changing the status of the event, the server 20 sends the updated event list to all staff terminals currently logged in. Deliver to 40. At this time, the delivery destination may be only the staff terminal 40 used by the staff 80 in charge of the target person 70 who caused the event. Each staff terminal 40 that has received the event list returns an acknowledgment command in response to receiving the event list from the server 20 (not shown). It should be noted that the transmission of the event list from the server 20 may be performed by transmitting only difference data. For example, only changed parts, that is, events that have been added or updated with respect to the previously transmitted event list, are transmitted to all staff terminals 40 as an event list.

(Step S160)
Each staff terminal 40 updates the display contents of the display unit 43 in response to receiving the event list from the server 20 .

FIG. 8 shows examples of operation screens 431 and 432 for inputting a response policy to an event displayed on the display unit 43 of the staff terminal 40 . An operation screen 431 shown in the figure is a screen on which an event list is displayed. The displayed events can be scrolled up and down by flicking.

Areas a11 and a12 of the operation screen 431 correspond to event IDs 011 and 012 of the event list in FIG. 7, respectively. Areas a11 and a12 display an icon indicating that it is a nurse call and that the response has been completed. Area a13 corresponds to event IDs 013 to 015 surrounded by a dashed frame in FIG. Since these are related to the same subject 70 (Mr. B), they are collectively displayed in the same area. In addition, since it is not supported, a thumbnail image is displayed in the area a13 so as to be easily distinguished from the supported one. This thumbnail image is created from a still image clipped from the moving image i015 (see FIG. 7) relating to the latest event (ID015). Text messages can be exchanged with other logged-in staff members 80 by operating the area a14. When the staff member 80 clicks on the area a13 on the operation screen 431, the control unit 41 causes the operation screen 431 to transition to the operation screen 432 for confirming the contents.

(Step S170)
The staff 80 confirms the contents of the event by the operation screen 432 displayed on the staff terminal 40 . In an area a21 of the operation screen 432, the ID of the subject 70 (name: Mr. B) who caused the event to occur (judged) and the ID of the staff 80 (name: staff A) who uses the staff terminal 40 are displayed. ing. The area a22 displays the elapsed time from the occurrence time of the event. As shown in the dashed frame in FIG. 7, for the target person 70 (Mr. B), the occurrence of events such as getting up, getting out of bed, and falling is continuously determined. In a22, icons representing "wake up" and "get out of bed" events other than the latest event are shown. The elapsed time (“elapsed 0 minutes”) shown in the area a22 is the elapsed time (rounded down to the nearest minute) after the occurrence of the latest event is determined. An area a23 shows characters and an icon indicating "overturn". A thumbnail image of the captured image at the time of overturn determination is displayed in the area a24. When the staff member 80 wants to confirm the situation of the subject 70 who caused the fall because the thumbnail image is not enough information, the staff member 80 operates the "talk" button or the "view" button located below. By operating the “talk” button, the user can talk with the target person 70 (Mr. B) through the voice input/output unit 15 . By operating the "view" button, the live video captured by the camera 13 can be viewed by streaming playback.

The staff 80 (staff A) decides to take the initiative in taking charge of the fall (ID015) displayed by operating the "correspond" button in the area a25. If not, the back button (triangular icon) in the area a26 is operated to return to the event list screen. While a certain staff member 80 is displaying the operation screen 432 shown in FIG. 8 and confirming the state of an event such as a fall, other staff members 80 are prohibited from doing so under the control of the server 20. . For example, even if another staff member 80 selects the same event (ID 013 to 015) while one staff member 80 is confirming the event status of the target person 70 (Mr. B), the operation screen 431 of the other staff member 80 is displayed. , the text "Confirming status" is displayed, and the "Corresponding" button is not displayed or cannot be selected.

(Steps S180, S190)
The staff terminal 40 transmits a response request regarding the selected event to the server 20 in response to the operation of the "response" button, and the server 20 responds with an approval notification.

(Step S200)
The server 20 updates the event list according to the process of step S180. Specifically, the status of the event list (ID 013 to 015: falls, etc.) is changed to handled. In this embodiment, the event selected by the staff 80 and displayed on the operation screen 432 is changed to "handled" in response to the operation of the above-described "handle" button. That is, by operating the "Response" button, a response status of "Responded", which is information indicating confirmation, is input, and it is assumed that the response has been made, and the date and time of response is recorded. More specifically, in the event list of FIG. 7, the times when the processes of steps S180 and S190 were performed are recorded in the corresponding date/time column. Note that the response date and time is not limited to this, and the staff 80 may record the time when the staff 80 entered the room of the target person 70 who caused an event such as a fall, a fall, a nurse call, etc. in the response date and time column. By inputting the response result on the operation screen, the response may be completed, and the input time may be recorded in the response date and time column. In addition, the server 20 transmits the updated event list to all logged-in staff members 80 in response to updating the event list.

An erroneous determination is included in determination of a predetermined event that may lead to an accident determined by the detection unit 10 to occur, that is, a fall event. If the criteria for determination are made stricter, there is a risk that failure to make a determination will occur when a fall or overturn actually occurs. On the other hand, if the criteria for determination are made too loose, erroneous determinations such as determining the occurrence of a fall or overturn event when a fall or overturn has not actually occurred are more likely to occur.

In this embodiment, since the judgment criteria are not strict so as to eliminate judgment omissions as much as possible, erroneous judgments are included to some extent. The staff 80 uses the staff terminal 40 to check the situation to determine whether this misjudgment has actually occurred. Specifically, the staff member 80 confirms the situation of the target person 70 through a call or a photographed image, thereby confirming that there is no need to actually go to the living room in the event of an erroneous determination. In addition, even if a fall actually occurs, there may be cases where no injury occurs and no particular response is required. You can omit the need to go to your room.

In this specification, when the detection unit 10 determines that an event such as a fall has occurred, it is counted as the number of occurrences even if the event does not actually occur. In other words, this number of occurrences can also be said to be the number of suspected occurrences of falls, falls, and the like.

As described above, when it is determined that an event such as a fall has occurred, the event information including the response status to the event is accumulated in the event list. Next, the process of analyzing the event occurrence status and response status using this accumulated event list, and creating and outputting a report that visualizes the analysis results will be described.

(Report output processing)
FIG. 9 is a flowchart showing a procedure of report output processing executed by the watching system 1 according to the first embodiment. The processing in FIG. 9 is mainly performed by the control unit 21 of the server 20 executing a program stored in the storage unit 23 .

(Step S310)
The control unit 21 of the server 20 accumulates (adds) event information of the event determined to occur in the event list of the storage unit 23 . Also, image data (still image or moving image) when an event occurs is stored in association with the event. This accumulation processing is performed by the above-described processing (FIG. 6).

(Step S320)
The control unit 21 acquires from the storage unit 23 the event information of a fall or overturn that may lead to an accident. This is initiated, for example, by a request from a user (staff 80, administrator managing this staff 80, etc.) through fixed terminal 30. FIG. A user selects a specific target person 70 through the fixed terminal 30 . The control unit 21 acquires the event information of the falling and tumbling related to the designated subject 70 . Note that an event of getting out of bed may be included as an event leading to another accident. For example, the posture of the subject 70 in the bed 60 at bedtime may change due to a change in the arrangement of furniture such as the bed 60 and the television in the living room. As a result, a part of the body such as the leg often protrudes from the bed 60, and many events of getting out of bed may be determined. In such an event, getting out of bed is an event that causes a fall out of bed, indirectly leading to an accident.

(Step S330)
The control unit 21 analyzes the number of falls and falls from the acquired event information. FIG. 10 is a diagram showing an example of visualization of analysis results of falls in a subject 70 (for example, Mr. B). This figure is a table showing the transition of the total number of occurrences (number of occurrences) of falls and falls for each hour of the day (from 6:00 to 5:00 (29:00) of the next day). The time periods in which one or more falls or fall events occurred are shown in gray in the table.

(Step S340)
The control unit 21 determines whether or not there has been an increase in the number of occurrences per unit period of falling events. This determination may be made in units of one hour or in units of one day. When the determination is made on a daily basis, it can be determined that there has been an increase if the number of occurrences on a certain day is a predetermined multiple or more of the average number of occurrences on the previous day or several days before that day. In the example shown in FIG. 10, the number of occurrences of 17 on October 21st is more than double the average number of occurrences of 6.5 for the previous two days (20th and 19th). It can be judged that there was an increase in the number of occurrences on the 21st of the month. If there is an increase, the process proceeds to step S350. On the other hand, if there is no increase, the process proceeds to step S360.

(Step S350)
The control unit 21 acquires image data associated with events before and after the increase period, and displays an image based on this image data on the display of the fixed terminal 30 used by the user (staff 80, administrator, etc.). indicate. The image to be displayed is a moving image (for example, several seconds to several tens of seconds), but may be a still image clipped from this moving image.

At this time, the information of the subject 70 stored in the storage unit 23 may be displayed on the display. The information about the subject 70 includes, for example, the walking state information of the subject 70 (independent, wheelchair, walker). When the front and back images are displayed, the control unit 21 analyzes the images to recognize the furniture, etc. (bed, walker, cane) in the living room. If there is a change in , an annotation image (enclosing frame, note, etc.) indicating that change may be added to the display image.

(Step S360)
The control unit 21 accepts comments to be added to the report. For example, comments from users are accepted through the fixed terminal 30 .

The user compares the two images before and after the increase period displayed on the display of the fixed terminal 30, and inputs the judgment result obtained as a comment. For example, by comparing images, if the arrangement of furniture, etc. in the living room has been changed in the images after the time when the number of events such as falls and falls has increased compared to the previous images, this furniture, etc. It can be assumed that the number of occurrences increased due to the change in the arrangement of The furniture includes not only fixed furniture such as beds, televisions, and chests of drawers, but also tools for walking such as walkers, wheelchairs, canes, and the like. For example, the number of events may increase due to changing the position of the wand to a different position than before.

Also, the information of the subject 70, for example, the walking state information of the subject 70 (independent, wheelchair, walker) may be compared with the actual walking state (photographed image) when the subject 70 is alone. Specifically, the actual walking state is determined from an image taken when the person falls or falls alone in a living room. If this is different from walking state information and it is found that the subject 70 is walking dangerously, which should not be done, this can be cited as the reason for the increase in falling events. An example of this dangerous running is when a subject 70 using a walker walks independently along a wall in a living room without using a walker.

(Step S370)
The control unit 21 creates a report based on the analysis results. Also, if a comment is received in step S360, the comment is added to the report.

(Step S380)
The control unit 21 outputs the report by displaying it on the display of the fixed terminal 30, printing it on paper from a printer, or transmitting the report data to the requested destination address.

FIG. 11 is a diagram showing an example of a report outputting visualized analysis results. FIG. 11 reflects the analysis results shown in FIG. 10, and shows a report regarding a predetermined event that may lead to an accident regarding the target person 70 (Mr. B) selected by the user. The upper table in FIG. 11 corresponds to the diagram shown in FIG. The two images in the middle row are captured images in the living room before and after the period when the increase occurred. The comments at the bottom are those received in step S360.

As described above, in the first embodiment, event information of a predetermined event that may lead to an accident and image data associated with this event information are acquired, and the number of occurrences of the event and the time of occurrence are obtained for the subject. , and image data to analyze the occurrence of events, create and output a report in which the occurrence of events is visualized based on the analysis results.

As a result, it is possible to analyze the number of falls detected from the daily behavior of the resident (subject 70) and the images of the falls, and output a report summarizing the results of picking out near misses. It helps prevent the occurrence of events that may lead to

The facility cannot grasp how the subject 70 behaves in the living room. That is, when the entrance door is closed, the staff member 80 cannot recognize the state of the room. Therefore, since it is not known that the resident has a dangerous behavior (such as walking that may lead to a fall), countermeasures will be considered after an accident occurs.

On the other hand, according to the present embodiment, by analyzing the fall event detected by the detection unit 10, the facility staff 80 cannot grasp the resident (subject 70) in the living room. Recognize risky behavior. In addition, by promoting countermeasures to reduce risky behavior (such as rearrangement of furniture), it is possible to reduce the occurrence of overturns and falls, thereby preventing accidents from occurring.

(Report output processing in monitoring system 1 according to modification)
In the embodiment shown in FIG. 10, input of comments from the user is accepted. On the other hand, in the modified example described below, the comment is automatically created on the control section 21 side. FIG. 12 is a flowchart showing report output processing in the modification.

(Steps S410 to S440)
Here, the control unit 21 performs the same processing as steps S310 to S340 shown in FIG. If there is an increase in the number of event occurrences, the process proceeds to step S465.

(Step S465)
The control unit 21 creates a comment calling attention to the increase. This comment uses fixed phrases, and is used to confirm whether the layout of furniture in the living room, etc., has been changed in the period before and after the increase, leading to an increase in overturning and falling. For example, the comment column of the report in FIG. 11 is a comment calling attention to the possible increase in such a case. Part or all of this comment may be stored in the storage unit 23 in advance.

Thus, by creating comments on the control unit 21 side, the same effect as in the first embodiment can be obtained, and a report can be created without the user having to bother creating comments.

(Other modifications)
In the above-described embodiment, the detection unit 10, the server 20, the fixed terminal 30, and the staff terminal 40 have been described as independent and separate devices. However, it is not limited to this, and several configurations may be integrated. For example, the functionality of server 20 may be integrated within fixed terminal 30 .

Moreover, the process in the watching system 1 which concerns on embodiment mentioned above may include steps other than the steps of the above-mentioned sequence chart or a flowchart, or may not include some of the steps mentioned above. Also, the order of steps is not limited to the embodiment described above. Furthermore, each step may be combined with other steps and executed as one step, may be executed while being included in other steps, or may be divided into a plurality of steps and executed.

Moreover, means and methods for performing various processes in the watching system 1 according to the above-described embodiment can be realized by either a dedicated hardware circuit or a programmed computer. The control program may be provided by a computer-readable recording medium such as a USB memory or a DVD (Digital Versatile Disc)-ROM, or may be provided online via a network such as the Internet. In this case, the program recorded on the computer-readable recording medium is usually transferred to and stored in a storage unit such as a hard disk. Further, the program may be provided as independent application software, or may be incorporated as a function into the software of the device such as the detection unit.

This application is based on a Japanese patent application (Japanese Patent Application No. 2018-122274) filed on June 27, 2018, the disclosure of which is incorporated herein by reference.

1 monitoring system 10 detection unit 11 control unit 12 communication unit 13 camera 14 nurse call unit 15 voice input/output unit 20 server 21 control unit 22 communication unit 23 storage unit 30 fixed terminal 40 staff terminal 41 control unit 42 wireless communication unit 43 display unit 44 input unit 45 voice input/output unit 50 network 51 access point 70 target person (cared person)
80 staff (caregivers)

Claims (12)

Accumulated event information of a predetermined event that may lead to an accident and image data associated with the event, generated based on the output of a detection unit that detects the movement of the subject in the observation area acquisition of the event information recording the predetermined event related to the subject in the observation area where Step (a) to
For the subject, the analysis result is visualized by analyzing the occurrence status of the event using the information on the occurrence status of the event or using the information on the occurrence status of the event and the image data. step (b) of creating a report to be
a step (c) of outputting the report created in the step (b);
A process including
The step (b) includes a step (b1) of displaying the image data for the period before and after the time when the number of occurrences of the event per unit period increases for the subject;
including a step (b2) for receiving comments input by the user,
In the step (b), a control program for causing a computer to execute a process of creating the report including the comments received in the step (b2) . Accumulated event information of a predetermined event that may lead to an accident and image data associated with the event, generated based on the output of a detection unit that detects the movement of the subject in the observation area acquisition of the event information recording the predetermined event related to the subject in the observation area where Step (a) to
For the subject, the analysis result is visualized by analyzing the occurrence status of the event using the information on the occurrence status of the event or using the information on the occurrence status of the event and the image data. step (b) of creating a report to be
a step (c) of outputting the report created in the step (b);
Based on the event information acquired in the procedure (a), it is determined whether or not the number of occurrences of the event per unit period has increased for the target person, and if it is determined that the increase has occurred, the target person a step (d) of creating a comment calling attention to the event of the person;
A process including
A control program for causing a computer to execute, in step (b), the process of creating the report including the comment created in step (d) . Accumulated event information of a predetermined event that may lead to an accident and image data associated with the event, generated based on the output of a detection unit that detects the movement of the subject in the observation area acquisition of the event information recording the predetermined event related to the subject in the observation area where Step (a) to
For the subject, the analysis result is visualized by analyzing the occurrence status of the event using the information on the occurrence status of the event or using the information on the occurrence status of the event and the image data. step (b) of creating a report to be
a step (c) of outputting the report created in the step (b);
A process including
Executing a process on a computer, wherein the report created in the step (b) includes the image data of the period before and after the period when the number of occurrences of the event per unit period increased for the subject. control program to let 4. The control program according to any one of claims 1 to 3, wherein the information on the occurrence status of the event includes the number of occurrences of the event and the time of occurrence. 5. The control program according to any one of claims 1 to 4, wherein the predetermined event includes a fall event in which it is determined that the subject has fallen or a fall event in which it is determined that the subject has fallen. . The staff who respond to the subject person carry a mobile terminal,
6. The event information according to any one of claims 1 to 5 , wherein the event information includes information input by the staff through the portable terminal in response to the occurrence of the event and indicating that the event has been confirmed. control program. Accumulated event information of a predetermined event that may lead to an accident and image data associated with the event, generated based on the output of a detection unit that detects the movement of the subject in the observation area and the image data obtained by photographing the observation area for a predetermined period including the time when the event occurred, Procedure (a) acquired by the report output device ;
By analyzing the event occurrence status of the subject using the information on the occurrence status of the event or using the information on the occurrence status of the event and the image data, the report output device , a procedure (b) for creating a report in which the analysis results are visualized;
a step (c) in which the report output device outputs the report created in the step (b);
contains
The step (b) includes a step (b1) of displaying the image data for the period before and after the time when the number of occurrences of the event per unit period increases for the subject;
including a step (b2) for receiving comments input by the user,
The report output method , wherein in the step (b), the report including the comments received in the step (b2) is created . Accumulated event information of a predetermined event that may lead to an accident and image data associated with the event, generated based on the output of a detection unit that detects the movement of the subject in the observation area and the image data obtained by photographing the observation area for a predetermined period including the time when the event occurred, Procedure (a) acquired by the report output device ;
By analyzing the event occurrence status of the subject using the information on the occurrence status of the event or using the information on the occurrence status of the event and the image data, the report output device , a procedure (b) for creating a report in which the analysis results are visualized;
a step (c) in which the report output device outputs the report created in the step (b);
Based on the event information acquired in the procedure (a), it is determined whether or not the number of occurrences of the event per unit period has increased for the target person, and if it is determined that the increase has occurred, the target person a step (d) in which the report output device creates a comment calling attention to the event of the person;
contains
The report output method , wherein in the step (b), the report including the comments created in the step (d) is created . Accumulated event information of a predetermined event that may lead to an accident and image data associated with the event, generated based on the output of a detection unit that detects the movement of the subject in the observation area and the image data obtained by photographing the observation area for a predetermined period including the time when the event occurred, Procedure (a) acquired by the report output device ;
By analyzing the event occurrence status of the subject using the information on the occurrence status of the event or using the information on the occurrence status of the event and the image data, the report output device , a procedure (b) for creating a report in which the analysis results are visualized;
a step (c) in which the report output device outputs the report created in the step (b);
contains
The report output method, wherein the report created in the step (b) includes the image data of the period before and after the time when the number of occurrences of the event per unit period increases for the subject. Accumulated event information of a predetermined event that may lead to an accident and image data associated with the event, generated based on the output of a detection unit that detects the movement of the subject in the observation area acquisition of the event information recording the predetermined event related to the subject in the observation area where an acquisition unit that
For the subject, the analysis result is visualized by analyzing the occurrence status of the event using the information on the occurrence status of the event or using the information on the occurrence status of the event and the image data. a creation unit that creates a report to be
an output unit that outputs the report created by the creation unit;
a control unit for displaying the image data of the period before and after the period when the number of occurrences of the event per unit period increased for the target person, and for accepting an input of a comment by a user;
with
The report output device, wherein the creation unit creates the report including the comments received by the control unit . Accumulated event information of a predetermined event that may lead to an accident and image data associated with the event, generated based on the output of a detection unit that detects the movement of the subject in the observation area acquisition of the event information recording the predetermined event related to the subject in the observation area where an acquisition unit that
For the subject, the analysis result is visualized by analyzing the occurrence status of the event using the information on the occurrence status of the event or using the information on the occurrence status of the event and the image data. a creation unit that creates a report to be
an output unit that outputs the report created by the creation unit;
with
Based on the acquired event information, the creation unit determines whether or not the number of occurrences of the event per unit period has increased for the target person, and if it is determined that the increase has occurred, the target person a report output device that generates an attention-grabbing comment and generates the report containing the comment regarding the event of the . Accumulated event information of a predetermined event that may lead to an accident and image data associated with the event, generated based on the output of a detection unit that detects the movement of the subject in the observation area acquisition of the event information recording the predetermined event related to the subject in the observation area where an acquisition unit that
For the subject, the analysis result is visualized by analyzing the occurrence status of the event using the information on the occurrence status of the event or using the information on the occurrence status of the event and the image data. a creation unit that creates a report to be
an output unit that outputs the report created by the creation unit;
with
The report output device, wherein the report created by the creation unit includes the image data of the period before and after the time when the number of occurrences of the event per unit period increases for the target person.