JPWO2020003704A1 - Control program, report output method, and report output device - Google Patents

Abstract

Outputs a report that visualizes the analysis results of the event occurrence status, which is useful for preventing the occurrence of events. The event information of a predetermined event that may lead to an accident and the image data associated with this event information are acquired, and for the target person 70, the event occurrence status information or the event occurrence status information and By analyzing the occurrence status of events using image data, a report that visualizes the analysis results is created and output.

Description

The present invention relates to a control program, a report output method, and a report output device, and relates to a control program, a report output method, and a report output device that output a report about a target person to be dealt with by staff.

In Japan, the longevity of life has become remarkable due to the improvement of living standards, the improvement of sanitary environment, and the improvement of medical standards due to the high economic growth after the war. For this reason, coupled with the decline in the birth rate, the aging society has a high aging rate. In such an aging society, it is expected that the number of long-term care recipients will increase due to illness, injury, and aging.

People requiring long-term care may fall while walking or fall out of bed and get injured in facilities such as hospitals and welfare facilities for the elderly. Therefore, in order for nurses and caregivers to be able to rush immediately when a person requiring long-term care becomes in such a state, the development of a system for detecting the state of the person requiring long-term care is being promoted. There is.

In the nurse call system disclosed in Patent Document 1 as such a system, it is determined from the image captured by the camera installed on the patient's bed whether or not the patient is in a state of getting up or getting out of bed. To do. Then, when the person gets up or gets out of bed, the nurse call master unit provided in the nurse station displays the captured image of the camera.

In addition, in order to prevent the recurrence of a hiyari hat case due to an accident or an incorrect countermeasure for the hiyari hat that leads to the accident, in patent document 2, medical care to determine whether or not a hiyari hat case requiring countermeasures has occurred. The support device is disclosed. In this medical care support device, the degree of similarity (correction notification hit rate) between the case record input by the caregiver and the past hiyari hat cases recorded in the database is calculated, and the correction notification hit rate is equal to or higher than the predetermined value. If so, it is specified as countermeasure information that needs improvement.

Japanese Unexamined Patent Publication No. 2014-90913 Japanese Unexamined Patent Publication No. 2013-191184

However, the nurse call system disclosed in Patent Document 1 can detect getting up and getting out of bed of a patient in bed, but cannot prevent accidents and hiatus. In addition, the medical care and long-term care support device disclosed in Patent Document 2 identifies that the countermeasures against the past hiyari hats are incorrect by comparing the generated hiyari hats with the past cases. It does not prevent the occurrence of connected hiyari hats.

The present invention has been made in view of the above circumstances, and is a control program, a report output method, which can output a report useful for preventing the occurrence of an event by analyzing an event that may lead to an accident. And to provide a report output device.

The above object of the present invention is solved by the following means.

(1) Based on the accumulated event information of a predetermined event that may lead to an accident and the image data associated with the event, which is the output of the detection unit that detects the movement of the target person in the observation area. The event information that recorded the predetermined event regarding the target person in the observation area for which the occurrence was determined, and the image obtained by photographing the observation area for a predetermined period including the time when the event occurred. Procedure (a) for acquiring data and
The analysis result is visualized by analyzing the occurrence status of the event with respect to the target person using the information on the occurrence status of the event, or using the information on the occurrence status of the event and the image data. Procedure (b) to create the report to be
The procedure (c) for outputting the report created in the above procedure (b) and
A control program that causes a computer to perform processing that includes.

(2) The control program according to (1) above, wherein the information on the occurrence status of the event includes the number of occurrences of the event and the occurrence time.

(3) The above-mentioned (1) or (2), wherein the predetermined event includes a fall event in which the fall of the target person is determined, or a fall event in which the fall of the target person is determined. Control program.

(4) The staff who responds to the target person carry a mobile terminal and carry it.
Any one of the above (1) to (3), wherein the information indicating that the event has been confirmed, which is input by the staff through the mobile terminal in response to the occurrence of the event, is included in the event information. The control program described in.

(5) The procedure (b) includes a procedure (b1) of displaying the image data of the target person in a period before and after the time when the number of occurrences of the event per unit period increases.
Including the procedure (b2) for accepting comment input by the user.
In the procedure (c), the control program according to any one of (1) to (4) above, which creates the report including the comment received in the procedure (b2).

(6) Further, when it is determined whether or not the number of occurrences of the event has increased per unit period for the target person based on the event information acquired in the procedure (a), and the occurrence of the increase is determined. Includes step (d) of creating a cautionary comment regarding the event of the subject.
The control program according to any one of (1) to (4) above, wherein in the procedure (b), the report including the comment created in the procedure (d) is created.

(7) The report created in the procedure (b) includes the image data of the target person during the period before and after the time when the number of occurrences of the event per unit period increased. The control program according to any one of 1) to (6) above.

(8) Based on the accumulated event information of a predetermined event that may lead to an accident and the image data associated with the event, which is the output of the detection unit that detects the movement of the target person in the observation area. The event information that recorded the predetermined event regarding the target person in the observation area for which the occurrence was determined, and the image obtained by photographing the observation area for a predetermined period including the time when the event occurred. Procedure (a) for acquiring data and
The analysis result is visualized by analyzing the occurrence status of the event with respect to the target person using the information on the occurrence status of the event, or using the information on the occurrence status of the event and the image data. Procedure (b) to create the report to be
The procedure (c) for outputting the report created in the above procedure (b) and
Report output method including.

(9) Based on the accumulated event information of a predetermined event that may lead to an accident and the image data associated with the event, which is the output of the detection unit that detects the movement of the target person in the observation area. The event information that recorded the predetermined event regarding the target person in the observation area for which the occurrence was determined, and the image obtained by photographing the observation area for a predetermined period including the time when the event occurred. The acquisition department that acquires data and
The analysis result is visualized by analyzing the occurrence status of the event with respect to the target person using the information on the occurrence status of the event, or using the information on the occurrence status of the event and the image data. The creation department that creates the report to be
An output unit that outputs the report created in the creation unit, and
A report output device.

According to the present invention, event information of a predetermined event that may lead to an accident and image data associated with this event information are acquired, and information on the occurrence status of the event or information on the event occurrence status of the target person or the event By analyzing the occurrence status of the event using the information on the occurrence status and the image data, a report in which the analysis result is visualized is created and output. This makes it possible to output a report that helps prevent the occurrence of events that may lead to accidents.

It is a figure which shows the whole structure of a watching system. It is a figure which shows the example of the detection part installed in the room of a subject. It is a block diagram which shows the schematic structure of the detection part. It is a block diagram which shows the schematic structure of a server. It is a block diagram which shows the schematic structure of the staff terminal. It is a sequence chart which shows the processing procedure of a monitoring system. This is an example of an event list stored in the storage unit. This is an example of an operation screen for checking the event displayed on the staff terminal. It is a flowchart which shows the procedure of output processing of the report in 1st Embodiment. It is a figure which shows the example which visualized the analysis result of a fall / fall in a certain subject. It is a figure which shows the example of the report which output the visualized analysis result. It is a flowchart which shows the procedure of output processing of a report in a modification.

Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings. In the description of the drawings, the same elements are designated by the same reference numerals, and duplicate description will be omitted. In addition, the dimensional ratios in the drawings are exaggerated for convenience of explanation and may differ from the actual ratios.

(overall structure)
FIG. 1 is a diagram showing an overall configuration of a monitoring system according to the present embodiment, and FIG. 2 is a diagram showing an example of a detection unit installed around a bed in a subject's room.

As shown in FIG. 1, the monitoring system 1 includes a plurality of detection units 10, a server 20, a fixed terminal 30, and one or more staff terminals 40. The server 20 functions as a report output device. These are connected to each other by wire or wirelessly via a network 50 such as a LAN (Local Area Network), a telephone network, or a data communication network so as to be communicable with each other. The network 50 may include repeaters such as repeaters, bridges, routers or cross-connects that relay communication signals. In the example shown in FIG. 1, the staff terminal 40, the detection unit 10, the server 20, and the fixed terminal 30 are connected to each other by a network 50 such as a wireless LAN including an access point 51 (for example, a LAN according to the IEEE802.11 standard). It is connected so that it can communicate.

The watching system 1 is arranged at an appropriate place according to the target person 70. The target person 70 (also referred to as a person to be watched over or a person to be cared for) is, for example, a patient who needs nursing care due to illness or injury, a person to be cared for due to deterioration of physical ability due to old age, or a person living alone. Those who live alone. In particular, from the viewpoint of enabling early detection and early coping, the subject 70 may be a person who needs the detection when a predetermined inconvenient event such as an abnormal state occurs in the person. Therefore, the watching system 1 is suitably arranged in a building such as a hospital, a welfare facility for the elderly, and a dwelling unit according to the type of the subject 70. In the example shown in FIG. 1, the watching system 1 is arranged in a facility including a plurality of rooms (living rooms) in which a plurality of target persons 70 are occupying and a plurality of rooms including a nurse station.

The detection unit 10 is arranged in each living room which is an observation area of the subject 70. In the example shown in FIG. 1, four detection units 10 are arranged in the living rooms of Mr. A, Mr. B, Mr. C, and Mr. D, who are the subjects 70, respectively. The observation area of the detection unit 10 includes a bed 60. The staff 80 (also referred to as a care staff or a care staff) who provides nursing or nursing care to the subject 70 carries a staff terminal 40, which is a mobile terminal, respectively. However, the position, number, and the like of each configuration included in the monitoring system 1 are not limited to the example shown in FIG. For example, the server 20 does not have to be located at the nurse station and may be an external server unit connected to the network 50. Further, the fixed terminal 30 may be omitted, and the server 20 or the staff terminal 40 may carry out the function.

(Detection unit 10)
FIG. 3 is a block diagram showing a schematic configuration of the detection unit. As shown in the figure, the detection unit 10 includes a control unit 11, a communication unit 12, a camera 13, a nurse call unit 14, and a voice input / output unit 15, which are connected to each other by a bus.

The control unit 11 is composed of a memory such as a CPU (Central Processing Unit), a RAM (Random Access Memory), and a ROM (Read Only Memory), and controls and performs arithmetic processing of each part of the detection unit 10 according to a program. The control unit 11 may further include an HDD (Hard Disk Drive) as a memory.

The communication unit 12 is an interface circuit (for example, a LAN card) for communicating with other devices such as a server 20, a fixed terminal 30, or a staff terminal 40 via a network 50.

The camera 13 is arranged on the ceiling or the upper part of the wall of the living room, for example, and photographs an area including the bed 60 of the subject 70 directly below as an observation area, and outputs a photographed image (image data). This captured image includes still images and moving images. Although the camera 13 is a near-infrared camera, a visible light camera may be used instead of the near-infrared camera, or these may be used in combination.

The control unit 11 determines (recognizes) the occurrence of a predetermined action of the target person 70 from the captured image taken by the camera 13. The predetermined action to be determined includes "getting up" from the bed 60, "getting out of bed" away from the bed 60, "falling" to fall from the bed 60, and "falling" to fall to the floor surface or the like.

The control unit 11 detects an image silhouette (hereinafter, referred to as “human silhouette”) from a plurality of captured images (moving images). The human silhouette can be detected, for example, by extracting a range of pixels having a relatively large difference by the time difference method for extracting the difference between images whose shooting times are before and after. The human silhouette may be detected by the background subtraction method that extracts the difference between the photographed image and the background image. The distinction between getting up, getting out of bed, falling, and falling is recognized from the detected person silhouette from the posture of the subject 70 (for example, standing, sitting, lying down, etc.) and the position relative to the installation in the living room such as the bed 60. Will be done. These recognitions may be performed by a program processed by the CPU of the control unit 11, or may be performed by a built-in processing circuit. In the following, it will be described that the control unit 11 side determines the type of event and the presence / absence of occurrence. However, the present invention is not limited to this, and the server 20 may perform all or most of these recognition processes, and the control unit 11 may only transmit the captured image to the server 20. When the control unit 11 recognizes any type of action, the control unit 11 transmits a notification to the server 20 or the like that the action (event described later) has occurred.

The staff 80 is a person who performs various responses to the target person 70 according to the work. The work may include medical work and long-term care work. Here, when the work of the staff 80 is a long-term care work for the target person 70, the contents of correspondence regarding each event will be described. "Wake-up" is judged as an event, and if the judgment is within a predetermined time (wake-up time set at the facility (for example, 7:00 to 8:00 am)), morning care is performed. This morning care includes face washing, tooth brushing assistance, denture wearing, change of clothes assistance, and the like. In addition, if it is an event of "getting out of bed", wheelchair transfer and walking assistance may be required. In addition, as regular (regular) events other than the event determined by the detection unit 10, there are beverages, meal assistance, excretion assistance, wheelchair transfer, walking assistance, and postural change (pressure ulcer prevention). For these regular events, an alert may be generated at a fixed time by the nurse call unit 14 or the like.

The nurse call unit 14 includes a push button type switch, and detects a nurse call (also referred to as a care call) when the switch is pressed by the subject 70. The nurse call may be detected by a voice microphone instead of the push button type switch. When the switch of the nurse call unit 14 is pressed, that is, when the nurse call is detected, the control unit 11 notifies that there is a nurse call (nurse call notification) via the communication unit 12 and the network 50. Send to server 20 etc.

The voice input / output unit 15 is, for example, a speaker and a microphone, and enables a voice call by transmitting and receiving a voice signal to and from the staff terminal 40 and the like via the communication unit 12. The voice input / output unit 15 may be connected to the detection unit 10 via the communication unit 12 as an external device of the detection unit 10.

Further, the detection unit 10 uses a doppler shift type body motion sensor that transmits and receives microwaves in the direction of the bed 60 to detect the doppler shift of the microwave generated by the body movement (for example, respiratory movement) of the subject 70. , You may prepare further. This body movement sensor detects the body movement of the chest (up and down movement of the chest) accompanying the breathing movement of the subject 70, and the disorder of the cycle in the body movement of the chest and the body movement of the chest that is below a preset threshold value. When the amplitude in is detected, it is recognized as a microbody movement abnormality.

In the present embodiment, the nurse call by the nurse call unit 14 and the change in the state recognized by the detection unit 10 regarding the subject 70 are the changes in the state recognized by the staff 80 such as getting up, getting out of bed, falling, falling, and abnormal micromovement. An event that should be issued (notified) is called an event. The detection unit 10 transmits (outputs) information on the event that has occurred and a captured image to the server 20.

(Server 20)
FIG. 4 is a block diagram showing a schematic configuration of the server. The server 20 includes a control unit 21, a communication unit 22, and a storage unit 23. The server 20 may be provided in the same building as the living room for the target person 70, or may be provided in a remote location and can be connected via a network. For example, the server 20 may be a cloud server virtually constructed by a plurality of servers arranged on a network such as the Internet. Each configuration is communicatively connected to each other by a bus. The storage unit 23 functions as a database and stores various information about the event list, the target person 70, and the staff 80. The control unit 21 acquires event information of a predetermined event that may lead to an accident by cooperating with the communication unit 22, and image data for a predetermined period including a time when an event associated with the event occurs. Functions as a department. Further, the control unit 21 functions as a creation unit that creates a report by analyzing the occurrence status of an event from these acquired data. The control unit 21 also functions as an output unit that outputs the created report by cooperating with the communication unit 22. Since the other control unit 21 and the communication unit 22 have the same functions as the respective configurations of the detection unit 10, detailed description thereof will be omitted. As will be described later, this event list includes information on various events including predetermined events that may lead to an accident (for example, a fall or a fall event). A predetermined event that may lead to this accident is also called a hiyari hat, and if this condition continues, it may lead to an accident.

The server 20 determines (identifies) which target person 70 the event such as nurse call, getting up, getting out of bed, falling, falling, etc. detected by the detection unit 10 is related to. In this determination, the target person 70 (that is, the resident of the room) associated with the room number in which the detection unit 10 that has detected the event is installed is determined. Then, the determined event type and the target person 70 are associated with each other and added to the event list of the storage unit 23. In the present embodiment, when the target person 70 carries an IC tag, the determination of the target person 70 may be made by reading the IC tag with an RFID reader provided in each room. .. When a plurality of target persons 70 exist in one room in a shared room or the like, the target person 70 may be determined by arranging the detection unit 10 for each bed 60. Further, in connection with this, the staff terminal 40 carried by the staff 80 may be brought close to the RFID reader to detect the entry of each staff 80 into the room.

(Fixed terminal 30)
The fixed terminal 30 is a so-called PC (Personal Computer), and includes a control unit, a communication unit, a display unit, an input unit, and an audio input / output unit composed of a CPU, a RAM, and the like. The fixed terminal 30 is arranged in, for example, a nurse station. In addition, when outputting a report to be described later, by inputting an instruction from a user (staff 80, an administrator who manages this staff 80, etc.), a report in which the analysis result is visualized by a chart or the like is displayed on the display unit, or an external report is displayed. Output to paper from a printer (not shown). Further, as will be described later, this report may include a comment input from the input unit while referring to the captured image displayed on the display unit (display) of the fixed terminal 30.

Further, when the detection unit 10 is attached to each room (living room) through the fixed terminal 30, the staff 80 or the technical staff or the like can associate the room number with the detection unit 10 or in the living room such as the bed 60. The position information of the installation object, that is, the contour information of the upward view by the camera 13 on the ceiling is calibrated and designated. In addition, identification information such as the name and ID number of the subject 70 who is hospitalized or occupying is associated with each room number.

(Staff terminal 40)
FIG. 5 is a block diagram showing a schematic configuration of the staff terminal 40. The staff terminal 40 includes a control unit 41, a wireless communication unit 42, a display unit 43, an input unit 44, and a voice input / output unit 45, which are connected to each other by a bus. The control unit 41 includes a CPU, RAM, ROM, and the like as the same configuration as the control unit 11 of the detection unit 10. The wireless communication unit 42 enables wireless communication using standards such as Wi-Fi and Bluetooth (registered trademark), and wirelessly communicates with each device via the access point 51 or directly. The display unit 43 and the input unit 44 are touch panels, and a touch sensor as the input unit 44 is superimposed on the display surface of the display unit 43 composed of a liquid crystal or the like. The display unit 43 and the input unit 44 display to the staff 80 various operation screens displaying a list of a plurality of events included in the event list, and accept various operations through the operation screens. The voice input / output unit 45 is, for example, a speaker and a microphone, and enables voice communication by the staff 80 with another staff terminal 40 via the wireless communication unit 42. The staff terminal 40 is a device that functions as a user interface of the watching system 1, and can be configured by a portable communication terminal device such as a tablet computer, a smartphone, or a mobile phone.

At the start of business, the staff 80 performs a login authentication process through the assigned staff terminal 40. The staff 80 inputs the staff ID and password through the touch panel (display unit 43, input unit 44) of the staff terminal 40. The staff terminal 40 transmits this to the server 20. The server 20 collates the authentication information stored in the storage unit 23 and transmits the authentication result according to the authority of the staff 80 to the staff terminal 40 to complete the login authentication.

(Procedure for monitoring system processing)
Next, the event information and image data accumulation processing performed in the entire monitoring system 1 will be described with reference to FIG. FIG. 6 is a sequence chart showing the processing procedure of the watching system.

(Step S110)
As shown in FIG. 6, the detection unit 10 detects the movement of the subject 70 in the observation area or the event of the nurse call by the subject 70. Then, the detection unit 10 determines whether or not another event such as a fall or a fall has occurred based on the movement of the target person 70.

(Steps S120, S130)
Then, when it is determined that an event has occurred, the event information is transmitted to the server 20. Further, the detection unit 10 transmits the image data obtained by photographing the observation area when the event occurs. In this case, if the type of event that occurred is a specific type, for example, an event that may lead to an accident such as a fall or a fall, the predetermined time (for example, several seconds to several tens of seconds) before and after the occurrence time including the occurrence time. A moving image may be transmitted, and if it is another type of event, a still image at the time of occurrence may be transmitted. As another example, the detection unit 10 continuously transmits the captured image to the server 20, and the server 20 stores the captured image in the temporary storage unit for a predetermined time (for example, the past several hours) while overwriting. .. Then, when an event occurs and the event information is received from the detection unit 10, the server 20 may read a still image or a moving image before and after the time of occurrence from the temporary storage unit and save the event in association with the event. ..

(Step S140)
The server 20 updates the event list. FIG. 7 is an example of an event list stored in the storage unit 23. The events included in the event list include getting up, getting out of bed, falling, falling, and a nurse call as described above. The latest event transmitted in step S120 is added to the end of the event list.

As shown in FIG. 7, each event includes event ID, room number, target person, event type, occurrence date / time (time), image data, and correspondence status information, which are automatically assigned primary keys. Is done. As described above, the image data is still image or moving image data obtained by being photographed by the detection unit 10 when an event occurs, which was transmitted in step S130. Response status includes status, response staff, and response date (time). The correspondence status will be described later.

In the example shown in FIG. 7, the event of event ID 010 is a fall, and the events of event IDs 011 and 012 are nurse calls. Event IDs 013 to 015 are, in order, getting up, getting out of bed, and falling in succession for one subject 70 (Mr. B). The status of the response status related to the event of event IDs 010 to 012 has already been supported, and event IDs 013 to 015 are not supported.

(Step S150)
When a new event is detected and added, or the event status is changed, the server 20 updates the event list, and the updated event list is added to all logged-in staff terminals. Deliver to 40. The delivery destination at this time may be delivered only to the staff terminal 40 used by the staff 80 who is in charge of the target person 70 who generated the event. Each staff terminal 40 that has received the event list returns a receipt confirmation command in response to receiving the event list from the server 20 (not shown). The event list may be transmitted from the server 20 only by transmitting the difference data. For example, only the part that has changed from the event list transmitted immediately before, that is, the event that has been added or updated is transmitted as an event list to all staff terminals 40.

(Step S160)
Each staff terminal 40 updates the display content of the display unit 43 in response to receiving the event list from the server 20.

FIG. 8 is an example of operation screens 431 and 432 for inputting an event response policy displayed on the display unit 43 of the staff terminal 40. The operation screen 431 shown in the figure is a screen on which the event list is displayed in a list. The event to be displayed can be scrolled up and down by flicking.

The areas a11 and a12 of the operation screen 431 correspond to the event IDs 011 and 012 in the event list of FIG. 7, respectively. In the areas a11 and a12, an icon indicating that the call is a nurse call and that the correspondence has been completed are displayed. The area a13 corresponds to the event IDs 013 to 015 surrounded by the broken line frame in FIG. 7. Since these are related to the same subject 70 (Mr. B), they are displayed together in the same area. Further, since it is not supported, a thumbnail image is displayed in the area a13 so that it can be easily distinguished from the supported area. This thumbnail image is created from a still image cut out from the image i015 (see FIG. 7) of the moving image related to the latest event (ID015). By operating the area a14, text messages can be exchanged with other staff members 80 who are logged in. By accepting a click operation on the area a13 of the staff 80 on the operation screen 431, the control unit 41 transitions to the operation screen 432 for content confirmation.

(Step S170)
The staff 80 confirms the content of the event on the operation screen 432 displayed on the staff terminal 40. On the operation screen 432, the ID (name: Mr. B) of the target person 70 who generated (determined) the event and the ID (name: staff A) of the staff 80 who uses the staff terminal 40 are displayed in the area a21. ing. In the area a22, the elapsed time from the time when the event occurred is displayed. As shown in the broken line frame in FIG. 7, for the subject 70 (Mr. B), the occurrence of wake-up, wake-up, and fall events is continuously determined, and both are unsupported statuses. On a22, icons representing "wake-up" and "get-away" events other than the latest event are shown. The elapsed time (“elapsed 0 minutes”) shown in the area a22 is the elapsed time (rounded down to the nearest minute) after determining the occurrence of the latest event. In the area a23, a character and an icon indicating "fall" are shown. Further, in the area a24, a thumbnail image of the captured image at the time of the fall determination is displayed. The staff 80 operates the "speak" button and the "view" button at the bottom when the thumbnail image is insufficient as information and he / she wants to confirm the situation of the subject 70 who has caused the fall. By operating the "speak" button, it is possible to talk with the target person 70 (Mr. B) through the voice input / output unit 15. By operating the "view" button, the live video captured by the camera 13 can be viewed by streaming playback.

The staff 80 (staff A) decides to take the initiative in taking charge of the fall (ID015) displayed by operating the "corresponding" button in the area a25. If it does not correspond, the event list screen is returned by operating the back button (triangle icon) in the area a26. While a certain staff 80 displays the operation screen 432 shown in FIG. 8 and confirms the state of an event such as a fall, the server 20 controls the prohibition processing to the other staff 80. .. For example, even if one staff member 80 is checking the event status of the target person 70 (Mr. B) and another staff member 80 selects the same event (ID013 to 015), the operation screen 431 of the other staff member 80 Is displayed with the words "Checking status" and the "Corresponding" button is not displayed or cannot be selected.

(Steps S180, S190)
The staff terminal 40 sends a response request regarding the selected event to the server 20 in response to the operation of the "correspondence" button, and the server 20 returns an approval notification in response.

(Step S200)
The server 20 updates the event list according to the process of step S180. Specifically, the status of the event list (ID013 to 015: fall, etc.) is changed to supported. In the present embodiment, the event is changed to "corresponding" in response to the operation of the above-mentioned "corresponding" button for the event selected by the staff 80 and displayed on the operation screen 432. That is, by operating the "correspondence" button, the correspondence status of "corresponding", which is information indicating confirmation, is input, and the correspondence date and time is recorded assuming that the correspondence has been performed. More specifically, in the event list of FIG. 7, the time when the processing of steps S180 and S190 is performed is recorded in the corresponding date and time column. The response date and time is not limited to this, and the response date and time may be recorded in the response date and time column when the staff 80 enters the room of the target person 70 who has caused an event such as a fall, a fall, or a nurse call. The correspondence may be made by inputting the correspondence result on the operation screen of, and the input time may be recorded in the correspondence date and time column. In addition, the server 20 transmits the updated event list to all logged-in staff 80 in response to updating the event list.

The determination of a predetermined event that may lead to an accident for which the detection unit 10 has determined the occurrence, that is, a fall or fall event, includes an erroneous determination. If the judgment criteria are strict, there is a risk of omission of judgment when a fall or a fall actually occurs. On the other hand, if the criteria for determination are too loose, in reality, when a fall or a fall has not occurred, an erroneous determination such as determining the occurrence of a fall or a fall event is likely to occur.

In the present embodiment, since the judgment criteria are not strict so as to eliminate the judgment omission as much as possible, erroneous judgment is included to some extent. The staff 80 determines whether or not this erroneous determination has actually occurred by confirming the situation using the staff terminal 40. Specifically, the staff 80 can confirm that it is not necessary to actually go to the living room in the case of an erroneous determination by confirming the situation of the target person 70 by a telephone call or an image taken. In addition, even if a fall or a fall actually occurs, there may be cases where no injury occurs and no special action is required. In this case as well, by confirming that it is safe by calling the target person 70 or the like, it is possible to confirm that it is safe. You can omit the correspondence to go to the living room.

In this specification, when the detection unit 10 determines the occurrence of an event such as a fall or a fall, it is counted in the number of occurrences even if the fall, the fall, or the like does not actually occur. In other words, this number of occurrences can be said to be the number of suspected cases of falls, falls, etc.

As described above, when it is determined that an event such as a fall or a fall has occurred, event information including the response status to the event is accumulated in the event list. Next, using this accumulated event list, the process of analyzing the event occurrence status and response status, creating a report in which the analysis result is visualized, and outputting it will be described.

(Report output processing)
FIG. 9 is a flowchart showing a procedure of output processing of a report executed by the monitoring system 1 according to the first embodiment. The process of FIG. 9 is mainly performed by the control unit 21 of the server 20 executing the program stored in the storage unit 23.

(Step S310)
The control unit 21 of the server 20 accumulates (adds) event information of the event determined to occur in the event list of the storage unit 23. In addition, image data (still image or moving image) when an event occurs is stored in association with the event. This accumulation process is performed by the above-mentioned process (FIG. 6).

(Step S320)
The control unit 21 acquires information on a fall or fall event that may lead to an accident from the storage unit 23. This is started, for example, by a request from a user (staff 80, an administrator who manages the staff 80, etc.) through the fixed terminal 30. The user selects a specific target person 70 through the fixed terminal 30. The control unit 21 acquires fall / fall event information regarding the designated target person 70. An event of getting out of bed may be included as an event leading to another accident. For example, the posture of the subject 70 in the bed 60 at bedtime may change due to the change in the arrangement of furniture in the living room such as the bed 60 and the television. As a result, a part of the body such as legs often protrudes from the bed 60, and many events of getting out of bed may be determined. In such an event, getting out of bed causes a fall from the bed, which indirectly leads to an accident.

(Step S330)
The control unit 21 analyzes the number of falls and falls from the acquired event information. FIG. 10 is a diagram showing an example of visualizing the analysis result of a fall / fall in a certain subject 70 (for example, Mr. B). The figure is a table showing the total transition of the number of falls and the number of falls (number of occurrences) for each hour of one day (6:00 to 5:00 (29:00) the next day). In the table, the time zone in which one or more falls or fall events occurred is shown in gray.

(Step S340)
The control unit 21 determines whether or not there has been an increase in the number of falls or fall events per unit period. This judgment may be made on an hourly basis or on a daily basis. When judging on a daily basis, it can be judged that there is an increase when the number of occurrences on a certain day is a predetermined multiple or more with respect to the average number of occurrences on the previous day or several days before that day. In the example shown in FIG. 10, the number of occurrences on October 21 was 17 cases, which is more than double the average number of cases of 6.5 cases in the previous two days (20th and 19th). It can be judged that the number of occurrences increased on the 21st of March. If there is an increase, the process proceeds to step S350. On the other hand, if there is no increase, the process proceeds to step S360.

(Step S350)
The control unit 21 acquires image data associated with events before and after the increase period, and displays an image based on this image data on the display of the fixed terminal 30 used by the user (staff 80, administrator, etc.). indicate. The image to be displayed is a moving image (for example, several seconds to several tens of seconds), but it may be a still image cut out from this moving image.

At this time, the information of the target person 70 stored in the storage unit 23 may be displayed on the display. The information of the subject 70 includes, for example, walking state information (independence, wheelchair, walker) of the subject 70. Further, when displaying the front and rear images, the control unit 21 analyzes the images to recognize the furniture and the like (bed, walker, cane) in the living room, and arranges the furniture and the like in the two front and rear images. If there is a change in, an annotation image (box, cautionary statement, etc.) indicating that may be added to the display image.

(Step S360)
The control unit 21 accepts comments to be added to the report. For example, a comment from a user is accepted through a fixed terminal 30.

The user inputs the determination result obtained by comparing the two images before and after the increase time displayed on the display of the fixed terminal 30 as a comment. For example, by comparing the images, in the images after the time when the number of falls and falls events increased compared to the previous image, if the arrangement of furniture etc. in the living room is changed, this furniture etc. It can be estimated that the number of occurrences increased due to the change in the arrangement of. These furniture and the like include not only fixed furniture such as beds, televisions and porcelain, but also walking tools such as walkers, wheelchairs and canes. For example, changing the position where the wand is placed to a different position than before may increase the number of events that occur.

Further, the information of the target person 70, for example, the walking state information of the target person 70 (independence, wheelchair, walker) may be compared with the walking state (photographed image) when the subject is actually alone. Specifically, the actual walking state is determined from the images taken when a person falls or falls in the living room. Then, unlike the walking state information, if it is found that the subject 70 is walking dangerously, which should not be performed originally, this can be cited as the reason why the number of fall events has increased. As an example of this dangerous running, a subject 70 who uses a walker may walk independently along a wall in a living room without using a walker.

(Step S370)
The control unit 21 creates a report based on the analysis result. If a comment is received in step S360, the comment is added to the report.

(Step S380)
The control unit 21 outputs a report by displaying it on the display of the fixed terminal 30, printing it on paper from a printer, or transmitting report data to a destination address in response to a request.

FIG. 11 is a diagram showing an example of a report that outputs the visualized analysis result. FIG. 11 reflects the analysis results shown in FIG. 10 and shows a report on a predetermined event that may lead to an accident regarding the subject 70 (Mr. B) selected by the user. The upper table of FIG. 11 corresponds to the figure shown in FIG. The two images in the middle row are images taken in the living room before and after the time when the increase occurred. The lower comment was received in step S360.

As described above, in the first embodiment, the event information of a predetermined event that may lead to an accident and the image data associated with the event information are acquired, and the number of events and the time of occurrence of the event are acquired for the target person. , And, by analyzing the event occurrence status using the image data, a report in which the event occurrence status is visualized based on the analysis result is created and output.

As a result, it is possible to analyze the number of falls / falls and the images of falls / falls detected from the daily behavior of the resident (target person 70) and output a report summarizing the results of taking out the hiyari hat. It helps prevent the occurrence of events that may lead to.

At the facility, it is not possible to grasp what kind of behavior the subject 70 is doing in the living room. That is, when the entrance door is closed, the staff 80 cannot recognize the state of the room. Therefore, since it is not known that the resident has dangerous behavior (walking that may lead to a fall, etc.), it is necessary to consider countermeasures after the accident occurs.

On the other hand, according to the present embodiment, by analyzing the fall / fall event detected by the detection unit 10, the resident (target person 70) whose staff 80 of the facility cannot grasp is in the living room. You can know dangerous behavior. In addition, by encouraging measures to reduce dangerous behavior (such as changing the arrangement of furniture), it is possible to cause falls and falls, and prevent accidents caused by these.

(Report output processing in the monitoring system 1 related to the modified example)
In the embodiment shown in FIG. 10, input of a comment from the user is accepted. On the other hand, in the modification described below, the control unit 21 automatically creates a comment. FIG. 12 is a flowchart showing the output processing of the report in the modified example.

(Steps S410 to S440)
Here, the control unit 21 performs the same processing as in steps S310 to S340 shown in FIG. If there is an increase in the number of events, the process proceeds to step S465.

(Step S465)
The control unit 21 creates a comment calling attention to the increase. This comment uses a fixed phrase, and a comment is created to confirm whether changes such as the arrangement of furniture in the living room have been made in the period before and after the increase, which leads to an increase in falls. For example, the comment section of the report of FIG. 11 is a comment that calls attention to the increase that is expected in such a case. A part or all of this comment may be stored in the storage unit 23 in advance.

In this way, by creating a comment on the control unit 21 side, the same effect as that of the first embodiment can be obtained, and a report can be created without bothering the user to create a comment.

(Other variants)
In the above-described embodiment, the detection unit 10, the server 20, the fixed terminal 30, and the staff terminal 40 have been described as independent and separate devices. However, the present invention is not limited to this, and some configurations may be integrated. For example, the functions of the server 20 may be integrated in the fixed terminal 30.

Further, the process in the monitoring system 1 according to the above-described embodiment may include steps other than the steps of the sequence chart or the flowchart described above, or may not include a part of the steps described above. Further, the order of the steps is not limited to the above-described embodiment. Further, each step may be executed as one step in combination with other steps, may be executed by being included in other steps, or may be executed by being divided into a plurality of steps.

Further, the means and methods for performing various processes in the monitoring system 1 according to the above-described embodiment can be realized by either a dedicated hardware circuit or a programmed computer. The control program may be provided by a computer-readable recording medium such as a USB memory or a DVD (Digital Versaille Disc) -ROM, or may be provided online via a network such as the Internet. In this case, the program recorded on the computer-readable recording medium is usually transferred and stored in a storage unit such as a hard disk. Further, the above program may be provided as a single application software, or may be incorporated into the software of a device such as a detection unit as one function.

This application is based on a Japanese patent application (Japanese Patent Application No. 2018-122274) filed on June 27, 2018, the disclosure of which is referenced and incorporated as a whole.

1 Watching system 10 Detection unit 11 Control unit 12 Communication unit 13 Camera 14 Nurse call unit 15 Voice input / output unit 20 Server 21 Control unit 22 Communication unit 23 Storage unit 30 Fixed terminal 40 Staff terminal 41 Control unit 42 Wireless communication unit 43 Display unit 44 Input unit 45 Voice input / output unit 50 Network 51 Access point 70 Target person (care recipient)
80 staff (caregiver)

Claims (9)

It is generated based on the accumulated event information of a predetermined event that may lead to an accident and the output of the detection unit that detects the movement of the target person in the observation area, which is the image data associated with the event. The event information that recorded the predetermined event regarding the target person in the observation area for which the determination was made, and the image data obtained by photographing the observation area for a predetermined period including the time when the event occurred are acquired. Procedure (a) and
The analysis result is visualized by analyzing the occurrence status of the event with respect to the target person using the information on the occurrence status of the event, or using the information on the occurrence status of the event and the image data. Procedure (b) to create the report to be
The procedure (c) for outputting the report created in the above procedure (b) and
A control program that causes a computer to perform processing that includes. The control program according to claim 1, wherein the information on the occurrence status of the event includes the number of occurrences of the event and the occurrence time. The control program according to claim 1 or 2, wherein the predetermined event includes a fall event in which the fall of the target person is determined, or a fall event in which the fall of the target person is determined. The staff who responds to the target person carry a mobile terminal and carry it.
The information according to any one of claims 1 to 3 included in the event information, which is input by the staff through the mobile terminal and indicates that the event has been confirmed in response to the occurrence of the event. Control program. The procedure (b) includes a procedure (b1) of displaying the image data of the target person in a period before and after the time when the number of occurrences of the event per unit period increases.
Including the procedure (b2) for accepting comment input by the user.
The control program according to any one of claims 1 to 4, wherein in the procedure (c), the report including the comment received in the procedure (b2) is created. Further, based on the event information acquired in the procedure (a), it is determined whether or not the number of occurrences of the event has increased per unit period for the target person, and when it is determined that the increase has occurred, the occurrence of the increase is determined. Including the procedure (d) of creating a cautionary comment regarding the event of the target person.
The control program according to any one of claims 1 to 4, wherein in the procedure (b), the report including the comment created in the procedure (d) is created. Claim 1 to claim that the report created in step (b) includes the image data of the subject during the period before and after the time when the number of occurrences of the event per unit period increased. Item 6. The control program according to any one of Item 6. It is generated based on the accumulated event information of a predetermined event that may lead to an accident and the output of the detection unit that detects the movement of the target person in the observation area, which is the image data associated with the event. The event information that recorded the predetermined event regarding the target person in the observation area for which the determination was made, and the image data obtained by photographing the observation area for a predetermined period including the time when the event occurred are acquired. Procedure (a) and
The analysis result is visualized by analyzing the occurrence status of the event with respect to the target person using the information on the occurrence status of the event, or using the information on the occurrence status of the event and the image data. Procedure (b) to create the report to be
The procedure (c) for outputting the report created in the above procedure (b) and
Report output method including. It is generated based on the accumulated event information of a predetermined event that may lead to an accident and the output of the detection unit that detects the movement of the target person in the observation area, which is the image data associated with the event. The event information that recorded the predetermined event regarding the target person in the observation area for which the determination was made, and the image data obtained by photographing the observation area for a predetermined period including the time when the event occurred are acquired. Acquisition department and
The analysis result is visualized by analyzing the occurrence status of the event with respect to the target person using the information on the occurrence status of the event, or using the information on the occurrence status of the event and the image data. The creation department that creates the report to be
An output unit that outputs the report created in the creation unit, and
A report output device.

Images