WO2016152424A1

WO2016152424A1 - Display device and display method for monitored-person monitoring system, and monitored-person monitoring system

Info

Publication number: WO2016152424A1
Application number: PCT/JP2016/056463
Authority: WO
Inventors: 篤広野田; 山下　雅宣; 安紀辻
Original assignee: コニカミノルタ株式会社
Priority date: 2015-03-26
Filing date: 2016-03-02
Publication date: 2016-09-29
Also published as: JPWO2016152424A1; JP2019145143A; JP6512284B2

Abstract

This monitored-person monitoring system is a system that detects and monitors a monitored person that is a monitoring target. The display device and display method used in this monitored-person monitoring system display an image of the monitored person as well as an icon that represents determination results for the status of the monitored person. The icon represents a thing as a relatively simple, symbolic design such as a picture, a symbol, a diagram, or a combination thereof.

Description

Display device of monitored person monitoring system, display method thereof, and monitored person monitoring system

The present invention relates to a display device for a monitored person monitoring system and a display method for the monitored person monitoring system for monitoring a monitored person to be monitored and transmitting predetermined information about the monitored person to a receiving device, The present invention also relates to the monitored person monitoring system.

Japan (Japan) is an aging society, more specifically the ratio of population over 65 years old to the total population due to the improvement of living standards accompanying the post-war high economic growth, improvement of sanitary environment and improvement of medical standards, etc. It is a super-aging society with an aging rate exceeding 21%. In 2005, the total population was about 126.5 million, while the elderly population over the age of 65 was about 25.56 million. In 2020, the total population was about 124.11 million. There is also a prediction that the elderly population will be about 34.56 million. In such an aging society, nurses who need nursing or nursing care due to illness, injury, elderly age, etc., or those who need nursing care (such as those who require nursing care) are those who need nursing in a normal society that is not an aging society. This is expected to increase more than Japan, for example, is a society with a declining birthrate with a total fertility rate of 1.43 in 2013. For this reason, elderly care has been taking place in which elderly nurses, etc., are cared for by an elderly family (spouse, child, brother).

Employees requiring nursing care, etc. enter hospitals and facilities for welfare for the elderly (Japanese elderly law short-term entrance facilities, nursing homes for the elderly and special nursing homes for the elderly, etc.) and receive nursing and care. In such a facility, a situation in which a nurse or the like needs to be injured or fallen out of the bed, for example, by falling from the bed or falling while walking can occur. It is necessary to respond to such a situation as quickly as possible. Moreover, if such a situation is left unattended, it may develop into a more serious situation. For this reason, in the facility, nurses and caregivers regularly check their safety and state by patrol.

However, the increase in the number of nurses etc. cannot keep up with the increase in the number of nurses required, and the nursing industry and the care industry are chronically short of manpower. Furthermore, since the number of nurses, caregivers and the like is reduced in the semi-night shift and night shift hours compared to the day shift hours, the work load per person increases, and thus the work load is required to be reduced. In addition, the situation of the elderly care is not an exception in the facility, and it is often seen that elderly nurses and the like care for elderly nurses and the like. In general, physical strength declines when older, so the burden of nursing etc. becomes heavier than young nurses etc. even if they are healthy, and their movements and judgments are also delayed.

In order to reduce the labor shortage and the burden on nurses, a technology that complements nursing work and nursing care work is required. For this reason, in recent years, monitored person monitoring techniques for monitoring a monitored person to be monitored, such as a care recipient, have been researched and developed.

For example, there is a nurse call system disclosed in Patent Document 1 as one of such techniques. The nurse call system disclosed in Patent Document 1 is a nurse call slave unit that is installed in a bed and a patient calls a nurse, and a nurse call slave unit that is installed in a nurse station and responds to a call by the nurse call slave unit. A nurse call system having a nurse call parent device, a camera for imaging a patient on a bed from above the bed, and a state in which the patient wakes up from a captured image of the camera and a state in which the patient is separated from the bed State judging means for judging the occurrence of at least one of them and outputting a caution state occurrence signal, and the nurse call master unit has a notifying means for performing a notification operation upon receiving the caution state occurrence signal. The nurse call master unit has a monitor that displays a video and a video control unit that displays the captured video of the camera on the monitor when the attention state generation signal is received.

On the other hand, in terms of safety confirmation, a single person living alone is the same as the care recipient and the like and is a subject to be monitored.

By the way, in Patent Document 1, an image captured by a camera is displayed on a monitor so that a nurse can recognize the state of a patient. However, since the camera images the patient from above the bed, it is difficult to grasp the patient's state (situation) from the captured video (including moving images and still images). In particular, if an image is taken from directly above the patient, the image is captured with little change in the vertical direction (depth direction), so it is difficult to grasp the patient's condition with a moving image as well as a moving image. For example, it is difficult to determine whether the monitored person is crouching or falling. In addition, when the captured image is a moving image, it takes time to grasp the patient's state because the patient's state is grasped by looking at the movement of the patient. In particular, patients and elderly people have relatively little movement and take more time. As an issue when checking the situation with an image, in the case of a still image, since it is the image at the time of detection, the latest situation is not known. There is also a problem that the situation (why it has been notified) and the process up to now are not known, that is, the whole picture of the situation is unknown for both still images and moving images.

As mentioned above, accurate and quick judgment is important in nursing care to prevent accidents. Problems such as accidents that could not have been prevented because judgments were delayed could not be prevented, and when troubles such as a fall occurred in the monitored person, the response became slow and serious. In addition, it is a problem to make a wrong decision. Not only when it is judged that the accident is not an accident, but due to a misjudgment that it is not an accident but an accident, the work of the caregiver is increased and the problem of labor shortage is caused. There is also a problem that in a certain nursing care service, a large amount of labor is lost, and it becomes slow to notice another accident.

JP 2014-90913 A

The present invention has been made in view of the above circumstances, and its purpose is to display a monitored person monitoring system in which the state (situation) of the monitored person can be recognized more accurately and quickly. An apparatus, a display method, and the monitored person monitoring system are provided.

A monitored person monitoring system according to the present invention is a system that monitors a monitored person by detecting a monitored person, and the display device and the display method used in the monitored person monitoring system include An icon representing the image of the monitored person and the determination result of determining the state of the monitored person is displayed. The icons represent things expressed as symbols with relatively simple patterns, and are composed of pictures, symbols, figures, or combinations thereof. Therefore, the display device and the display method of the monitored person monitoring system and the monitored person monitoring system according to the present invention can recognize the state (situation) of the monitored person more accurately and quickly.

The above and other objects, features and advantages of the present invention will become apparent from the following detailed description and the accompanying drawings.

It is a figure which shows the structure of the to-be-monitored person monitoring system in embodiment. It is a figure which shows the structure of the portable terminal unit in the to-be-monitored person monitoring system of embodiment. It is a figure which shows each structure of the monitoring information table memorize | stored in the said portable terminal unit, and a detection unit information table. It is a figure which shows an example of the icon used with the to-be-monitored person monitoring system of embodiment. It is a flowchart which shows the operation | movement regarding the display of the monitoring information in the said portable terminal unit. It is a figure which shows an example of the standby display screen displayed on the said portable terminal unit. It is a figure which shows an example of the monitoring information display screen displayed on the said portable terminal unit which received the notification of the to-be-monitored person's rising. It is a figure which shows an example of the monitoring information display screen displayed on the said portable terminal unit which received the notification of the said to-be-monitored person's getting out after receiving the notification of the said waking up. It is a figure which shows an example of the monitoring information display screen displayed on the said portable terminal unit by a full screen display. It is a figure which shows an example of the prediction icon used with the to-be-monitored person monitoring system of embodiment.

Hereinafter, an embodiment according to the present invention will be described with reference to the drawings. In addition, the structure which attached | subjected the same code | symbol in each figure shows that it is the same structure, The description is abbreviate | omitted suitably. In this specification, when referring generically, it shows with the reference symbol which abbreviate | omitted the suffix, and when referring to an individual structure, it shows with the reference symbol which attached the suffix.

This monitored person monitoring system detects a monitored person (watched person) Ob that is a monitored object (watched object) to be monitored (monitored) and monitors the monitored person Ob. The display device used in the monitored person monitoring system displays an image of the monitored person Ob and a determination result obtained by determining the state of the monitored person Ob. In this embodiment, the display device displays the determination result with an icon representing the determination result instead of displaying the determination result or instead of displaying the determination result. The icons represent things expressed as symbols with relatively simple patterns, and are composed of pictures, symbols, figures, or combinations thereof. In the present embodiment, the image of the monitored person Ob is generated by a camera arranged immediately above the monitored person Ob, and is also a still image or a moving image (recorded moving image recorded in one example or real time in another example). Real-time video). Preferably, the image of the monitored person Ob is an image used when the determination is performed. In the present embodiment, the display device displays an elapsed time from the determination time when the determination is performed. In the present embodiment, the display device displays a plurality of the icons in time series. In the present embodiment, the display device displays a prediction icon representing a prediction determination result obtained by predicting a determination result of a monitored person Ob that will occur in the future, and displays the prediction icon only for a preset monitored person Ob. Configured. In this case, the display device displays the icon and the prediction icon in different displays.

FIG. 1 is a diagram illustrating a configuration of a monitored person monitoring system according to the embodiment. FIG. 2 is a diagram illustrating a configuration of the mobile terminal unit in the monitored person monitoring system according to the embodiment. FIG. 3 is a diagram showing each configuration of a monitoring information table and a detection unit information table stored in the portable terminal unit. FIG. 3A shows the monitoring information table, and FIG. 3B shows the detection unit information table. FIG. 4 is a diagram illustrating an example of icons used in the monitored person monitoring system according to the embodiment. FIG. 10 is a diagram illustrating an example of a prediction icon used in the monitored person monitoring system according to the embodiment.

Such a monitored person monitoring system MS includes, for example, one or a plurality of detection units (sensor units) SU (SU-1 to SU-4), a management server unit SV, and a fixed terminal as shown in FIG. A unit SP and one or a plurality of portable terminal units TA (TA-1, TA-2) are provided, which are wired or wireless, such as a LAN (Local Area Network), a telephone network and a data communication network ( Network, communication line) are connected to be communicable via NW. The network NW may be provided with relays such as repeaters, bridges, routers, and cross-connects that relay communication signals. In the example shown in FIG. 1, the plurality of detection units SU-1 to SU-4, the management server unit SV, the fixed terminal unit SP, and the plurality of portable terminal units TA-1 and TA-2 are wireless including an access point AP. A LAN (for example, a LAN according to the IEEE 802.11 standard) NW is connected to be communicable with each other.

The monitored person monitoring system MS is arranged at an appropriate place according to the monitored person Ob. The monitored person (person to be watched) Ob is, for example, a person who needs nursing due to illness or injury, a person who needs care due to a decrease in physical ability, a single person living alone, or the like. In particular, from the viewpoint of enabling early detection and early action, the monitored person Ob may be a person who needs the detection when a predetermined inconvenient event such as an abnormal state occurs in the person. preferable. For this reason, the monitored person monitoring system MS is suitably arranged in a building such as a hospital, a welfare facility for the elderly, and a dwelling unit according to the type of the monitored person Ob. In the example shown in FIG. 1, the monitored person monitoring system MS is disposed in a building of a care facility including a plurality of rooms RM in which a plurality of monitored persons Ob live and a plurality of rooms such as a nurse station ST. .

The detection unit SU has a communication function for communicating with other units SV, SP, and TA via the network NW, images the monitored person Ob, generates an image, and detects the monitored person Ob from the generated image. Equipment. More specifically, the detection unit SU, for example, a communication interface circuit (for example, a LAN card or the like) for communicating with other units SV, SP, and TA via a network, and transmitting and receiving microwaves Observed Ob The Doppler shift type body motion sensor that detects the monitored person Ob by detecting the microwave Doppler shift caused by the body movement (for example, breathing movement) of the person, and generates an image by imaging the monitored person Ob An image sensor, a data processing circuit for determining the state (situation) of the monitored person Ob as a detection result of the monitored person Ob based on the output (body movement sensor output) of the body movement sensor and the output (image) of the image sensor The control circuit is configured to include a control circuit that controls these and peripheral circuits thereof, and transmits the detection result to the management server unit SV. The image sensor (camera) is disposed, for example, above the monitored person Ob, particularly directly above (directly above). As described above, when the image sensor (camera) is arranged above the monitored person, particularly directly above, the monitored person monitoring system MS of the present embodiment is effective. The detection unit SU transmits the generated images (including still images and moving images) to other predetermined units SV, SP, and TA. In the present embodiment, the detection unit SU performs a voice call between the nurse call circuit for notifying the fixed call unit SP, the portable terminal unit TA, etc. of the nurse call, and the fixed terminal unit SP, the portable terminal unit TA, etc. A call circuit for performing a call and a nurse call and a voice call are possible. FIG. 1 shows four first to fourth detection units SU-1 to SU-4 as an example. The first detection unit SU-1 is one of the monitored persons Ob. The second detection unit SU-2 is arranged in the room RM-1 (not shown) of Ob-1, and the second detection unit SU-2 is arranged in the room RM-2 (not shown) of Mr. B Ob-2 who is one of the monitored persons Ob. The third detection unit SU-3 is arranged in a room RM-3 (not shown) of Mr. C Ob-3 who is one of the monitored persons Ob, and the fourth detection unit SU-4 It is arranged in the room RM-4 (not shown) of Mr. D Ob-4, one of the monitored persons Ob.

The management server unit SV has a communication function for communicating with other units SU, TA, and SP via the network NW, and receives the detection result related to the monitored person Ob and the image of the monitored person Ob from the detection unit SU. This is a device that manages information (monitoring information) related to monitoring of the monitored person Ob. When the management server unit SV receives the detection result related to the monitored person Ob and the image of the monitored person Ob from the detection unit SU, the management server unit SV receives a communication signal (monitoring information communication signal) containing the monitoring information related to monitoring the monitored person Ob. ) To the fixed terminal unit SP and the portable terminal unit TA. The management server unit SV provides the client with data corresponding to the request of the client (in this embodiment, the fixed terminal unit SP and the portable terminal unit TA). Such a management server unit SV can be configured by, for example, a computer with a communication function.

The fixed terminal unit SP includes a communication function for communicating with other units via the network NW, a display function for displaying predetermined information, an input function for inputting predetermined instructions and data, and the like. Functions as a user interface (UI) of the monitored person monitoring system MS by inputting a predetermined instruction or data to be given to the portable terminal unit TA, displaying a detection result or an image obtained by the detection unit SU, etc. Equipment. Such a fixed terminal unit SP can be configured by, for example, a computer with a communication function.

The mobile terminal unit TA has a communication function for communicating with other units SV, SP, SU via the network NW, a display function for displaying predetermined information, an input function for inputting predetermined instructions and data, and a voice call. It has a call function to perform, and inputs a predetermined instruction or data to be given to the management server unit SV or the detection unit SU, or displays the detection result or image obtained by the detection unit SU by a notification from the management server unit SV. It is a device that receives and displays the monitoring information related to the monitoring of the monitored person Ob.

The management server unit SV may be an example of the display device and may function as the display device, and the fixed terminal unit SP may be an example of the display device and may function as the display device. Here, a case where the mobile terminal unit TA is an example of the display device and functions as the display device will be described. When the management server unit SV is an example of the display device and functions as the display device, the management server unit SV can be configured in the same manner as described below. Also, when the fixed terminal unit SP is an example of the display device and functions as the display device, the fixed terminal unit SP can be configured in the same manner as described below.

In the present embodiment, for example, as shown in FIG. 2, such a portable terminal unit TA includes a terminal control processing unit (TA control processing unit) 41, a terminal storage unit (TA storage unit) 42, and a terminal communication interface. Unit (TA communication IF unit) 43, terminal sound input / output unit (TA sound input / output unit) 44, terminal input unit (TA input unit) 45, terminal display unit (TA display unit) 46, terminal interface unit (TAIF unit) 47.

The TA sound input / output unit 44 is connected to the TA control processing unit 41 and is a device for acquiring an external sound and inputting it to the portable terminal unit TA. It is a device for generating and outputting sound corresponding to a signal. The TA sound input / output unit 44 includes, for example, a microphone that converts sound acoustic vibrations into electrical signals, and a speaker that converts sound electrical signals into sound acoustic vibrations. The TA sound input / output unit 44 outputs an electric signal representing an external sound to the TA control processing unit 44, and converts the electric signal input from the TA control processing unit 44 into sound acoustic vibration and outputs the sound.

The TA input unit 45 is connected to the TA control processing unit 41, and is a device that accepts a predetermined operation and inputs it to the mobile terminal unit TA, for example, a plurality of input switches assigned a predetermined function. . Whether the predetermined operation includes, for example, an ID input operation for logging in or a response such as lifesaving, nursing, and assistance to the monitored person Ob notified of the detection result and the image. Various operations necessary for monitoring input operations and the like are included. The TA display unit 46 is connected to the TA control processing unit 41, and is monitored by a predetermined operation content input from the TA input unit 45 and the monitored person monitoring system MS according to the control of the TA control processing unit 41. It is a device that displays the monitoring information (for example, the status or image of the determined monitored person Ob) related to the monitoring of the monitored person Ob, and is a display apparatus such as an LCD (Liquid Crystal Display) and an organic EL display. . The TA display unit corresponds to an example of the display unit that performs display. In the present embodiment, the TA input unit 45 and the TA display unit 46 constitute a touch panel. In this case, the TA input unit 45 is a position input device that detects and inputs an operation position such as a resistance film method or a capacitance method. In this touch panel, a position input device is provided on the display surface of the TA display unit 46, one or more input content candidates that can be input are displayed on the TA display unit 46, and a user such as a nurse or a caregiver can When the display position where the input content to be input is displayed is touched, the position is detected by the position input device, and the display content displayed at the detected position is input to the portable terminal unit TA as the operation input content of the user.

The TAIF unit 47 is a device that is connected to the TA control processing unit 41 and inputs / outputs data to / from an external device according to the control of the TA control processing unit 41. For example, the Bluetooth (registered trademark) standard is used. An interface circuit, an interface circuit that performs infrared communication such as IrDA (Infrared Data Association) standard, and an interface circuit that uses USB (Universal Serial Bus) standard.

The TA communication IF unit 43 is a communication device that is connected to the TA control processing unit 41 and performs communication according to the control of the TA control processing unit 41. The TA communication IF unit 43 generates a communication signal containing data to be transferred input from the TA control processing unit 41 in accordance with a communication protocol used in the network NW of the monitored person monitoring system MS, and the generated communication The signal is transmitted to other units SU, SV, SP via the network NW. The TA communication IF unit 43 receives communication signals from other units SU, SV, SP via the network NW, extracts data from the received communication signals, and the TA control processing unit 41 can process the extracted data. The data is converted into data in a proper format and output to the TA control processing unit 41. The TA communication IF unit 43 corresponds to an example of the monitoring information receiving unit that receives the image of the monitored person Ob and the determination result.

The TA storage unit 42 is a circuit that is connected to the TA control processing unit 41 and stores various predetermined programs and various predetermined data under the control of the TA control processing unit 41. Examples of the various predetermined programs include a monitoring information screen display program that displays the image of the monitored person Ob and an icon representing the determination result, and a determination result prediction that predicts a determination result of the monitored person Ob that will occur in the future. A control processing program such as a program is included. The various predetermined data includes the data of the icon, the data of the monitored person Ob that displays an icon (predicted icon) representing the determination result predicted by the determination result prediction program, and the monitoring related to the monitored person Ob. Data necessary for executing each program such as monitoring information and detection unit information related to the detection unit SU is included. The TA storage unit 42 includes, for example, a ROM (Read Only Memory) that is a nonvolatile storage element, an EEPROM (Electrically Erasable Programmable Read Only Memory) that is a rewritable nonvolatile storage element, and the like. The TA storage unit 42 includes a RAM (Random Access Memory) that is a working memory of the so-called TA control processing unit 41 that stores data generated during execution of the predetermined program. The TA storage unit 42 functionally includes an icon storage unit 421, a predicted icon display monitored person storage unit 422, a monitoring information storage unit 423, and a detection unit information storage unit 424.

The icon storage unit 421 stores an icon symbolically representing the determination result in association with the determination result. More specifically, the icon storage unit 421 stores a plurality of icons representing the determination results in association with different types of determination results. For example, in the present embodiment, the detection unit SU determines whether the monitored person Ob is in the state of getting up, getting out of bed, falling and falling and abnormal movement of the minute body, and each of these determination results (wakeup, getting out of bed, falling and falling and Each icon (each image data of each icon) corresponding to the minute movement abnormality) is prepared in advance. For example, as shown in FIG. 4, a wake-up icon IC-1 that symbolically indicates that it is determined that the monitored person Ob has woken up, and a wakeup that symbolically indicates that the monitored person Ob has been determined to have left the floor. Icon IC-2, a fall / fall icon IC-3 that symbolically indicates that the monitored person Ob has been determined to have fallen, and a symbol that the monitored person Ob has been determined to be abnormal in microscopic movement Four icon ICs of the microscopic movement abnormality icon IC-4 represented in advance are prepared in advance. Each of these icons is stored in the icon storage unit 421 in association with each determination result. For example, a file (electronic file) in which icon data is stored, and a table (icon table) indicating the correspondence between the determination result and the file name of the icon that symbolically represents the determination result are stored in the icon storage unit 421. Stored in advance.

The predicted icon display monitored person storage unit 422 stores a monitored person identifier (monitored person ID) for identifying and identifying the monitored person Ob who should display the predicted icon. More specifically, for example, the detection icon of the detection unit SU that monitors the monitored person Ob of the monitored person ID is the predicted icon display as the monitored person ID of the monitored person Ob who should display the predicted icon. It is stored in the monitored person storage unit 422. Also, for example, the correspondence between the monitored person ID and the detection ID of the detection unit SU that monitors the monitored person Ob of the monitored person ID is stored in advance in the predicted icon display monitored person storage unit 422, and the predicted icon The monitored person ID of the monitored person Ob to be displayed may be stored in the predicted icon display monitored person storage unit 422 separately from the correspondence relationship. The monitored person ID of the monitored person Ob who should display the prediction icon is linked to the detection ID according to the correspondence relationship.

The monitoring information storage unit 423 stores the monitoring information related to monitoring the monitored person Ob. The monitoring information is determined as the state of the monitored person Ob at the detection unit SU having the detection ID associated with the detection ID and the detection unit identifier (detection ID) for identifying and identifying the detection unit SU. Information indicating the determination result (determination result information; in this embodiment, including awakening, getting out of bed, falling and falling, and abnormal micromotion), the detection unit SU associated with the detection ID and having the detection ID Ob Information (determination time information) indicating the time when the state of the person to be monitored is determined, the person being monitored Ob used when the state of the person being monitored Ob is determined by the detection unit SU associated with the detection ID and having the detection ID Still image (one of them (for example, the final image when judged using a plurality of images)), the detection unit S having the detection ID associated with the detection ID The communication address (for example, IP address) and the intention to execute the correspondence such as nursing for the monitored person Ob monitored by the detection unit SU having the detection ID associated with the detection ID Correspondence information indicating whether or not it is input to the portable terminal unit TA is included. Instead of the determination time, the reception time of the communication signal that received the determination result and the notification of the image may be used.

In this embodiment, this monitoring information is stored in the monitoring information storage unit 423 in a table format. The monitoring information table MT for registering the monitoring information includes, for example, a detection ID field 4231 for registering the detection ID and a detection unit SU corresponding to the detection ID registered in the detection ID field, as shown in FIG. 3A. A determination result field 4232 for registering the determination result information, a determination time field 4233 for registering the determination time information related to the detection unit SU corresponding to the detection ID registered in the detection ID field, and a detection ID field The still image field 4234 for registering the still image related to the detection unit SU corresponding to the detection ID, and the communication address (for example, IP) of the detection unit SU corresponding to the detection ID registered in the detection ID field as the acquisition destination of the live video. Video field 4235 for registering an address etc., A correspondence field 4236 for registering correspondence information indicating whether the intention of the correspondence to the monitored person Ob monitored by the detection unit SU corresponding to the detection ID registered in the knowledge ID field is registered, and a monitoring information communication signal A record is provided for each reception. In the correspondence field 4236, a flag indicating correspondence information indicating whether or not the corresponding intention is entered is registered. For example, in the present embodiment, in the correspondence field 4236, the flag “1” indicating that the intention of correspondence is input to the mobile terminal unit TA, or the intention of correspondence is input to the mobile terminal unit TA. A flag “0” signifying that there is no data is registered. In the still image field 4234, for example, still image data may be registered, and for example, a file name of still image data may be registered. In the example shown in FIG. 3A, in the first record, each of the detection ID field 4231, the determination result field 4232, the determination time field 4233, the still image field 4234, the moving image field 4235, and the corresponding field 4236 includes “SU-1 ”,“ Wake up ”,“ 06:32 ”,“ SP1 ”,“ ***. ***. ***. ** ”(** is an integer value) and“ 0 ”are registered, and the second In the record, each of the detection ID field 4231, the determination result field 4232, the determination time field 4233, the still image field 4234, the moving image field 4235, and the corresponding field 4236 includes “SU-1”, “leave bed”, “06:45”, “SP2”, “***. ***. ***. ***” (** is an integer value) and “0” are registered. To have.

In the example illustrated in FIG. 3A, the monitoring information table MT includes the moving image field 4235. However, a table indicating the correspondence between the detection ID and the communication address of the detection unit SU as the acquisition destination of the live moving image is the monitoring information. The moving image field 4235 may be omitted from the monitoring information table MT illustrated in FIG. 3A, which is prepared separately from the table MT and stored in the monitoring information storage unit 423.

The detection unit information storage unit 424 stores the detection unit information related to the detection unit SU. The detection unit information includes an installation location in the detection unit SU and a monitored person name monitored by the detection unit SU. In this embodiment, the detection unit information is stored in the detection unit information storage unit 424 in a table format. As shown in FIG. 3B, for example, the detection unit information table DT for registering the detection unit information includes a detection ID field 4241 for registering a detection ID, and the detection unit SU having the detection ID associated with the detection ID. An installation location field 4242 for registering the location of the monitored person, and a monitored person name field 4243 for registering the name of the monitored person Ob monitored by the detection unit SU associated with the detection ID and having the detection ID; And a record for each detection ID. In the example shown in FIG. 3B, in the first record, the detection ID field 4241, the arrangement location field 4242 and the monitored person name field 4243 are respectively “SU-1”, “101” and “K mountain M”. In the second record, “SU-2”, “102”, and “M River K” are respectively displayed in the detection ID field 4241, the arrangement location field 4242, and the monitored person name field 4243 in the second record. "Child" is registered.

The TA control processing unit 41 is a circuit for controlling each part of the mobile terminal unit TA according to the function of each part and processing monitoring information regarding monitoring of the monitored person Ob. The TA control processing unit 41 includes, for example, a CPU (Central Processing Unit) and its peripheral circuits. The TA control processing unit 41 functionally includes a terminal control unit (TA control unit) 411 and a terminal monitoring processing unit (TA monitoring processing unit) 412 by executing a control processing program. The display processing unit 4121 and the determination result prediction unit 4122 are functionally provided.

The TA control unit 411 controls each part of the mobile terminal unit TA according to the function of each part, and governs overall control of the mobile terminal unit TA.

The TA monitoring processing unit 412 processes the monitoring information related to monitoring the monitored person Ob.

The display processing unit 4121 of the TA monitoring processing unit 412 displays an icon IC corresponding to the determination result (one of the monitoring information) of the monitored person Ob contained in the monitoring information communication signal received by the TA communication IF unit 43. Is acquired from the icon storage unit 421, and the still image (one of the monitoring information) of the monitored person Observed in the monitoring information communication signal received by the acquired icon IC and the TA communication IF unit 43 is described above. This is displayed on the TA display unit 46.

In addition, when a plurality of monitoring information communication signals are received by the TA communication IF unit 43 at different times, the display processing unit 4121 receives the received monitoring information communication signals received by the TA communication IF unit 43. A plurality of icon ICs corresponding to each of the plurality of determination results of the observer Ob are acquired from the icon storage unit 421, the acquired plurality of icon ICs are displayed in time series on the TA display unit 46, and the TA communication IF unit 43 One of the plurality of images of the monitored person Ob accommodated in the plurality of monitoring information communication signals received in (1) is displayed on the TA display unit 46.

The determination result prediction unit 4122 predicts a determination result of the monitored person Ob that will be generated in the future and obtains a prediction determination result. For example, a state transition diagram representing transition of each state of the monitored person Ob is prepared in advance and stored in the TA storage unit 42, and the determination result prediction unit 4122 is obtained from the state transition diagram stored in the TA storage unit 42. A transition destination corresponding to the history of the state (situation) of the monitored person Ob is searched, and the searched transition destination is set as the prediction determination result. For example, the determination result prediction unit 4122 may create the state transition diagram from the history of the state of the monitored person Ob in the past.

And when the said prediction determination result is calculated | required by the determination result prediction part 4122, the said display process part 4121 is the determination result (above-mentioned) of the monitoring subject Ob accommodated in the monitoring information communication signal received by the TA communication IF part 43. Is acquired from the icon storage unit 421, and the icon IC corresponding to the prediction determination result predicted by the determination result prediction unit 4122 is used as the prediction icon from the icon storage unit 421. The TA display unit acquires the acquired icon IC and the predicted icon, and the still image (one of the monitoring information) of the monitored person Observed in the monitoring information communication signal received by the TA communication IF unit 43. 46. The still image is preferably an image used when the determination is performed. Thus, the user (monitoring person) can grasp the situation at the time of determination by referring to the image and icon at the time of determination, and can quickly and accurately determine the event that has occurred in the monitored person.

Further, when displaying the prediction icon, the display processing unit 4121 monitors the monitored person Ob corresponding to the image and the determination result received in the monitoring information communication signal received by the TA communication IF unit 43. When the person ID is stored in the predicted icon display monitored person storage unit 422, the predicted icon is displayed on the TA display unit 46, while the TA communication IF unit 43 receives the monitoring information communication signal. If the monitored person Ob of the monitored person Ob corresponding to the image and the determination result is not stored in the predicted icon display monitored person storage unit 422, the predicted icon is not displayed on the TA display unit 46. When displaying the prediction icon, the display processing unit 4121 displays the icon IC and the prediction icon on the TA display unit 46 differently. For example, the display processing unit 4121 displays the icon IC in a normal display, and displays the prediction icon in, for example, a highlight, blinking display, or a display color different from the display color of the icon IC. FIG. 10 shows, as an example, a fall / fall prediction icon IC-5 displayed in a blinking manner. In FIG. 10, the blinking display is expressed by a plurality of line segments extending radially from the fall / fall icon IC-3 and arranged around the fall / fall icon IC-3.

Such a portable terminal unit TA can be configured by a portable communication terminal device such as a so-called tablet computer, a smartphone, or a mobile phone.

Next, the operation of this embodiment will be described. In the monitored person monitoring system MS having such a configuration, each unit SU, SV, SP, TA, when the power is turned on, executes necessary initialization of each part and starts its operation. In the mobile terminal unit TA, the TA control processing unit 41 is functionally configured with a TA control unit 411 and a TA monitoring processing unit 412 by executing the control processing program, and the TA monitoring processing unit 412 includes a display processing unit. 4121 and the determination result estimation part 4122 are comprised functionally.

The monitored person monitoring system MS having the above configuration generally monitors each monitored person Ob by the following operation. The detection unit SU samples the output of the body motion sensor and the output of the image sensor at a predetermined sampling period, and based on the sampled output of the body motion sensor and the output of the image sensor, the state of the monitored person Ob (Situation) is determined. If it is determined as a result of this determination that the monitored person Ob is in a preset state (for example, in this embodiment, getting up, getting out of bed, falling over, abnormal movement of the minute body, etc.), the detection unit SU Detection ID, determination result information indicating a determination result determined as the state of the monitored person Ob, determination time information indicating the determination time, and still images (a plurality of images of the monitored person Ob used in the determination) If it is determined to be used, a communication signal (monitoring) containing image data of one of them (for example, the final image) and a communication address (for example, an IP address) of the own device as a communication destination for downloading a moving image. Information communication signal) is transmitted to the management server unit SV via the network NW. As the communication address of the own device, the communication address of the transmission source accommodated in the header may be used. The detection unit SU can determine the state (situation) of the monitored person Ob by a known technique. For example, the detection unit SU detects the body motion of the chest (vertical motion of the chest) accompanying the breathing motion of the monitored person Ob by the body motion sensor, and the period disturbance in the body motion of the chest or a preset threshold value When the amplitude in the body movement of the chest that is the following is detected, it is determined that the minute body movement is abnormal. Further, for example, the detection unit SU acquires an image of the monitored person Ob by the image sensor, detects the person area of the monitored person Ob from the acquired image, and monitors the monitored person from the aspect ratio of the detected person area. Ob's posture (for example, standing, sitting and lying) is detected, and the position of the detected person area is detected. Based on these determinations and the detected posture and position of the monitored person Ob, the above-mentioned wake-up, get-off and fall Determine the fall. When the management server unit SV receives the monitoring information communication signal from the detection unit SU via the network NW, the management server unit SV receives the determination result information, the determination time information, the still image data, and the moving image stored in the monitoring information communication signal. A communication address to be obtained is stored (recorded) in association with the detection ID, and this monitoring information communication signal is transmitted to the fixed terminal unit SP and the portable terminal unit TA, for example, by broadcast or multicast broadcast communication. . As a result, the state (situation) of the monitored person Ob is notified. When the communication address of the transmission source is also used as a communication address for obtaining a moving image, the communication address of the transmission source is the communication address of the management server unit SV by the transfer of the monitoring information communication signal by the management server unit SV. Therefore, the management server unit SV broadcasts the monitoring information communication signal after accommodating the communication address of the transmission source detection unit SU accommodated in the header in the payload of the monitoring information communication signal. In addition, the management server unit SV may transmit the monitoring information communication signal by unicast to the mobile terminal unit TA previously associated with the detection unit SU that has transmitted the monitoring information communication signal. When the fixed terminal unit SP and the portable terminal unit TA receive the monitoring information communication signal from the management server unit SV via the network NW, the monitoring information relating to the monitoring of the monitored person Ob contained in the monitoring information communication signal is received. indicate. The operation of displaying the monitoring information by the mobile terminal unit TA will be described in detail below. By such an operation, the monitored person monitoring system MS detects each monitored person Ob by each detecting unit SU, management server unit SV, fixed terminal unit SP, and portable terminal unit TA, and detects each monitored person Ob. Monitoring.

Next, an operation of displaying the monitoring information related to monitoring of the monitored person Ob in the monitored person monitoring system MS will be described. FIG. 5 is a flowchart showing an operation related to display of monitoring information in the portable terminal unit. FIG. 6 is a diagram illustrating an example of a standby display screen displayed on the mobile terminal unit. FIG. 7 is a diagram illustrating an example of a monitoring information display screen displayed on the mobile terminal unit that has received the notification of the person being woken up. FIG. 8 is a diagram illustrating an example of a monitoring information display screen displayed on the mobile terminal unit that has received the notification of getting out of the monitored person after receiving the notification of getting up. FIG. 9 is a diagram showing an example of a monitoring information display screen displayed in full screen display on the portable terminal unit.

In FIG. 5, the portable terminal unit TA is activated when the power is turned on, and when receiving a login operation by a monitor (user) such as a nurse or a caregiver, the TA monitor processing unit 412 performs communication addressed to itself. A standby screen for waiting for a signal is displayed on the TA display unit 46 (S11). For example, as shown in FIG. 6, the standby screen 51 includes a menu bar area 511 for displaying a menu bar, and a standby main area for displaying a message indicating standby (for example, “no notification”) and an icon. 512, a time region 513 for displaying the current time, a year / month / sunday region 514 for displaying the current year / month / sunday, and a user name region 515 for displaying the name of the user currently logged in to the mobile terminal unit TA Is provided.

Next, the portable terminal unit TA determines whether the TA control unit 411 has received a communication signal at the TA communication IF unit 43 (S12). If the communication signal is not received as a result of this determination (No), the portable terminal unit TA returns the process to S11. If the communication signal is received as a result of the determination (Yes), The portable terminal unit TA executes the following process S13.

In this process S13, when the communication signal is received, the portable terminal unit TA determines whether or not the received communication signal is a monitoring information communication signal by the TA monitoring processing unit 412. If the result of this determination is that the received communication signal is not a monitoring information communication signal (No), the portable terminal unit TA performs appropriate processing according to the received communication signal by the TA control processing unit 41. In step S31, the monitoring information display operation is terminated. On the other hand, when the received communication signal is a monitoring information communication signal as a result of the determination (Yes), the mobile terminal unit TA is accommodated in the received monitoring information communication signal by the TA monitoring processing unit 412. The registered information is registered in the monitoring information table MT and stored in the monitoring information storage unit 423 (S14), and the process S15 is executed. When registering each piece of information in the monitoring information table MT, the TA monitoring processing unit 412 registers a default flag “0” in the corresponding field 4236.

In this process S15, if the received communication signal is a monitoring information communication signal, the mobile terminal unit TA uses the determination result prediction unit 4122 to apply the received monitoring information communication signal to the predicted icon display monitor. It is determined whether or not. More specifically, the determination result predicting unit 4122 indicates that the detection ID contained in the received monitoring information communication signal is the monitored person Ob who should display the predicted icon in the predicted icon display monitored person storage unit 422. It is determined whether or not the received monitoring information communication signal is related to the predicted icon display supervisor depending on whether or not it is stored as the monitored person ID. As a result of this determination, the detection ID accommodated in the received monitoring information communication signal is stored in the predicted icon display monitored person storage unit 422 as the monitored person ID of the monitored person Ob who should display the predicted icon. If it is, the determination result prediction unit 4122 determines that the received monitoring information communication signal is applied to the prediction icon display monitor (Yes), and predicts the next determination result to obtain a prediction determination result ( S16) and process S17 are executed. On the other hand, as a result of the determination, the detection ID accommodated in the received monitoring information communication signal is used as the monitored person ID of the monitored person Ob who should display the predicted icon in the predicted icon display monitored person storage unit 422. If not stored, the determination result prediction unit 4122 determines that the received monitoring information communication signal is not related to the predicted icon display monitor (No), and executes step S17.

In the process S17, the mobile terminal unit TA uses the display processing unit 4121 to convert the monitoring information communication signal containing the same detection ID as the detection ID contained in the received monitoring information communication signal to the received monitoring information communication signal. It is determined whether or not the monitoring information screen of the monitoring information communication signal that has already been received (in the past) and has already been received is created for display. More specifically, the display processing unit 4121 registers the same detection ID as the detection ID accommodated in the received monitoring information communication signal in the detection field 4231 of the record in which the flag “0” is registered in the corresponding field 4236. It is determined whether or not the monitoring information screen of the already received monitoring information communication signal has been created for display by determining whether or not the monitoring information screen has already been received. As a result of this determination, if the same detection ID as the detection ID accommodated in the received monitoring information communication signal is not registered in the detection field 4231 of the record in which the flag “0” is registered in the correspondence field 4236, the same detection It is determined that the ID monitoring information communication signal has not been received (No), and the portable terminal unit TA executes the process S18. On the other hand, as a result of the determination, the portable terminal unit TA is accommodated in the received monitoring information communication signal. When the same detection ID as the detection ID is registered in the detection field 4231 of the record in which the flag “0” is registered in the correspondence field 4236, it is determined that the monitoring information communication signal of the same detection ID has already been received (Yes ), The portable terminal unit TA executes the process S19.

In this process S18, the portable terminal unit TA newly creates a monitoring information screen according to each piece of information (each data) contained in the received monitoring information communication signal by the display processing unit 4121. A monitoring information screen is displayed on the TA display unit 46.

This monitoring information screen is a screen for displaying the monitoring information related to monitoring of the monitored person Ob. The monitoring information screen 52 (52a), for example, as shown in FIG. 7, is monitored by a menu bar area 511, the location of the detection ID detection unit SU and the detection unit SU of the detection ID. Image of the monitored person name area 521 for displaying the name of the person Ob, the icon area 522 for displaying the elapsed time from the determination time (or reception time) and the icon IC, and the image taken by the detection unit SU of the detection ID An image area 523a for displaying (here, a still image), a “corresponding” button 524, a “speak” button 525, and a “watch live” button 526 are provided. The “corresponding” button 524 indicates that the user of the mobile terminal unit TA has an intention to execute the response such as nursing to the monitored person Ob monitored by the detection unit SU of the detection ID. It is a button for inputting to the mobile terminal unit TA an instruction to input to the unit TA and notify the fixed terminal unit SP and the other mobile terminal unit TA that the intention has been input. The “speak” button 525 is a button for inputting an instruction to connect the detection unit SU of the detection ID and the mobile terminal unit TA so as to be able to talk over the network NW. The “LIVE” button 526 is a button for inputting an instruction to display a moving image captured by the detection unit SU with the detection ID.

In order to create the monitoring information screen 52a according to each information accommodated in the received monitoring information communication signal, the display processing unit 4121 corresponds to the detection ID accommodated in the received monitoring information communication signal. The installation location and the name of the monitored person are searched from the detection unit information storage unit 424 using the detection ID as a search key, the elapsed time from the determination time accommodated in the received monitoring information communication signal is obtained, and the received The icon IC corresponding to the determination result accommodated in the monitoring information communication signal is searched from the icon storage unit 421 using the determination result as a search key. Then, the display processing unit 4121 displays a menu bar in the menu bar area 511, displays the searched arrangement location and monitored person name in the monitored person name area 521, and calculates the obtained elapsed time and the searched item. An icon IC is displayed in the icon area 522, an image (still image) contained in the received monitoring information communication signal is displayed in the image area 523a, a “corresponding” button 524, a “speak” button 525, and The monitoring information screen 52a is created by displaying the “View LIVE” button 526. Here, when creating the monitoring information screen 52a, if the prediction determination result is obtained in step S16, the display processing unit 4121 stores the icon IC corresponding to the prediction determination result as the prediction icon. The prediction determination result is searched from the unit 421 as a search key, and the searched prediction icons are also displayed in the icon area 522 in time series with respect to the searched icon IC. Then, the display processing unit 4121 displays the newly created monitoring information screen 52a on the TA display unit 46. Here, when displaying the monitoring information screen 52a on the TA display unit 46, if the prediction determination result is obtained in step S16, the display processing unit 4121 displays the icon IC and the prediction icon. It is displayed on the TA display unit 46 differently from the display. For example, the icon IC is always lit and displayed on the TA display unit 46, and the prediction icon is displayed on the TA display unit 46 in a blinking manner.

In this process S19, the portable terminal unit TA updates the monitoring information screen according to each information (each data) accommodated in the received monitoring information communication signal by the display processing unit 4121, and displays the updated monitoring information screen. Displayed on the TA display unit 46.

In order to update the monitoring information screen 52 according to each information accommodated in the received monitoring information communication signal, the display processing unit 4121 displays the elapsed time from the determination time accommodated in the received monitoring information communication signal. The icon IC corresponding to the determination result accommodated in the received monitoring information communication signal is searched from the icon storage unit 421 using the determination result as a search key. Then, the display processing unit 4121 displays the obtained elapsed time and the searched icon IC in the icon area 522 on the already displayed monitoring information screen 52, and is accommodated in the received monitoring information communication signal. The monitoring information screen 52 is updated by displaying the existing image (still image) in the image area 523a. Here, since the icon IC is displayed in the icon area 522 in accordance with the determination result accommodated in the monitoring information communication signal that has already been received, the searched icon IC of this time is already displayed. The icon ICs are displayed in the icon area 522 in time series. For example, if the determination result “getting up” is notified after the determination result “getting up” of the monitored person Ob is notified, the icon IC− representing the determination result “getting up” of the monitored person Ob shown in FIG. As shown in FIG. 8, the monitoring information screen 52a in which 1 is displayed in the icon area 522 has an icon IC-2 indicating the determination result “getting out” of the monitored person Ob and the icon IC indicating the determination result “getting up” -1 to the monitoring information screen 52b displayed in the icon area 522 side by side on the left side of the drawing. Here, when updating the monitoring information screen 52, if the prediction determination result is obtained in step S16, the display processing unit 4121 displays the icon IC corresponding to the prediction determination result, as in step S18. Is searched from the icon storage unit 421 using the prediction determination result as a search key, and the searched prediction icons are also displayed in the icon area 522 in time series with respect to the searched icon IC. When a prediction icon is further displayed on the monitoring information screen 52b shown in FIG. 8, this prediction icon is displayed on the left side of the drawing with respect to the icon IC-2 representing the determination result “getting out” of the monitored person Ob. become. Then, the display processing unit 4121 displays the updated monitoring information screen 52b on the TA display unit 46. Here, when the monitoring information screen 52b is displayed on the TA display unit 46, if the prediction determination result is obtained in step S16, the display processing unit 4121 displays the icon IC (shown in FIG. 8). In the example, the icons IC-1 and IC-2) are displayed on the TA display unit 46 differently from the display of the prediction icon.

Next to the process S18 or the process S19, the portable terminal unit TA determines whether or not the TA control processing unit 41 has accepted an input operation on the touch panel including the TA input unit 45 and the TA display unit 46. judge. If the input operation is not accepted as a result of this determination (No), the portable terminal unit TA returns the process to step S20. On the other hand, if the input operation is accepted as a result of the determination, the portable terminal unit TA The unit TA executes the next process S21.

In this process S21, the portable terminal unit TA performs an appropriate process according to the content of the input operation by the TA control processing unit 41, and ends the monitoring information display operation.

For example, when the mobile terminal unit TA accepts “tap” as the input operation by the TA control processing unit 41 on the touch panel including the TA input unit 45 and the TA display unit 46, the image area 523a is displayed as a full-screen image. A monitoring information screen 52c instead of the area 523b is displayed on the TA display unit 46. For example, as shown in FIG. 9, the monitoring information screen 52c includes a menu bar area 511, a monitored person name area 521, and an image (here, a still image) captured by the detection unit SU with the detection ID. , And a full screen display image area 523b displayed on the entire remaining area excluding the menu bar area 511 and the monitored person name area 521. By this full screen display, the monitor (user) can recognize the state of the monitored person Ob in more detail.

Further, for example, when the portable terminal unit TA receives an input operation of the “corresponding” button 524 by the TA control processing unit 41, the portable terminal unit TA corresponds to the monitoring information of the monitored person Ob currently displayed on the TA display unit 46. In the record in which the detection ID is registered in the detection ID field 4231, the flag (1) is registered in the correspondence field 4236, and the monitor (user) who is logged in to the mobile terminal unit TA is currently displaying the TA display unit 46. The fixed terminal unit SP and the other portable terminal unit TA are informed of the intention to execute the above-mentioned response such as nursing to the monitored person Ob displayed on the screen, and the target displayed on the TA display unit 46 is notified. The monitoring information screen 52 of the monitoring person Ob is deleted.

Further, for example, when the mobile terminal unit TA receives an input operation of the “speak” button 525 by the TA control processing unit 41, the mobile terminal unit TA and the detection unit SU that currently monitors the monitored person Ob displayed on the TA display unit 46. Then, the communication is made possible via the network NW.

Further, for example, when the portable terminal unit TA receives an input operation of the “view LIVE” button 526 by the TA control processing unit 41, the detection unit that currently monitors the monitored person Ob displayed on the TA display unit 46. It connects with SU so that a moving image can be downloaded via the network NW. Accordingly, the moving image of the monitored person Ob is displayed in the image area 523a or in the image area 523b switched by the “tap”.

As described above, the monitored person monitoring system MS, the display device of the monitored person monitoring system MS (typically, the mobile terminal unit TA in the above-described embodiment), and the display method of the monitored person monitoring system mounted thereon Displays not only the image of the monitored person Ob but also an icon IC that symbolically represents the determination result. For example, a monitor (user) such as a nurse or a caregiver refers to the icon IC to display the icon IC. The IC can be used as an aid for understanding the image, and the state (situation) of the monitored person Ob can be grasped more accurately and quickly from the image. For example, when the state of the monitored person Ob that can be grasped from the image matches the state of the monitored person Ob that can be grasped from the icon IC, the determination result itself represented symbolically by the icon IC is obtained from the image. The state of the monitored person Ob can be grasped accurately and more quickly. In addition, for example, when the state of the monitored person Ob that can be grasped from the image does not match the state of the monitored person Ob that can be grasped from the icon IC, the object that can be grasped from the image from the determination result represented symbolically by the icon IC. The state of the monitored person Ob can be grasped more accurately and more quickly from the image as having transitioned to the state of the monitoring person Ob. For example, when the image of the monitored person is the current image, the latest situation and the background can be grasped by referring to the current image and the icon.

More specifically, for example, when the monitor icon screen 52 and the image of the monitored person Ob walking are displayed on the monitoring information screen 52, the monitoring person Ob has left the monitored person Ob. Can be judged as walking. Further, for example, when the wake-up icon IC-1 and the image of sitting on the end of the bed of the monitored person Ob are displayed on the monitoring information screen 52, the monitoring person determines that the monitored person Ob is about to leave the floor. it can. Further, for example, when the wake-up icon IC-1 and the image of sleeping on the bed of the monitored person Ob are displayed on the monitoring information screen 52, the monitoring person has assumed that the monitored person Ob once woke up, but also fell asleep. I can judge. Further, for example, when the monitor information screen 52 displays the wake-up icon IC-1, the fall-and-fall icon IC-3, and the image of sitting on the bed of the monitored person Ob, the monitoring person Ob It can be determined that he got up and fell down, but returned to bed by himself. Further, for example, an image of the fall and fall icon IC-3 and the monitored person Ob next to the bed (still image at the determination time) is displayed on the monitoring information screen 52, and the moving image displayed by the “LIVE” button 526 is displayed. However, if the monitored object Ob is an image of the bed next to the image as in the still image at the determination time, the monitored person can determine that the monitored object Ob falls and cannot move.

A display method of the monitored person monitoring system MS, a display device of the monitored person monitoring system MS (typically, the mobile terminal unit TA in the above-described embodiment), and a display method of the monitored person monitoring system mounted thereon include a monitoring information screen 52. Since the elapsed time from the determination time is displayed, when the image of the monitored person is the current image, it is used when recognizing the deviation between the current state of the monitored person and the icon. The accuracy of the judgment of the situation that occurred to the person is improved.

The monitoring method of the monitored person MS, the display device of the monitored person monitoring system MS (typically, the portable terminal unit TA in the above-described embodiment) and the display method of the monitored person monitoring system mounted thereon include an icon IC. Since a plurality of displays are displayed in series, the monitor can recognize the history of the state (situation) of the monitored person Ob with reference to the plurality of icons IC arranged in time series.

The display method of the monitored person monitoring system MS, the display apparatus of the monitored person monitoring system MS (typically, the mobile terminal unit TA in the above-described embodiment) and the display method of the monitored person monitoring system mounted thereon include the prediction icon Since the information is displayed, the monitor can recognize a state that is likely to occur in the monitored person Ob.

The display method of the monitored person monitoring system MS, the display apparatus of the monitored person monitoring system MS (typically, the portable terminal unit TA in the above-described embodiment) and the display method of the monitored person monitoring system mounted thereon include a predicted icon display object. Since the monitor storage unit 422 is provided and the display processing unit 4121 controls the display and non-display of the prediction icon according to the stored contents, the display of the prediction icon can be set only for the monitored person Ob who needs the prediction determination result. For example, it is possible to set the display of the prediction icon only for the watched person Observing that is likely to cause a predetermined inconvenient event such as an abnormal state (for example, a fall or fall).

The display method of the monitored person monitoring system MS, the display apparatus of the monitored person monitoring system MS (typically, the portable terminal unit TA in the above-described embodiment) and the monitored person monitoring system mounted thereon are the icons IC Since the display is different from the display of the prediction icon, the monitor can easily recognize whether the displayed icon IC is the icon IC or the prediction icon.

In the above-described embodiment, the monitored person monitoring system MS is configured such that the detection unit SU determines the state (situation) of the monitored person Ob in order to reduce the information processing amount of the management server unit SV. However, the management server unit SV may be configured to receive, for example, the output of the body motion sensor and the output of the image sensor from the detection unit SU and determine the state (situation) of the monitored person Ob.

In the above-described embodiment, still images or substantially real-time moving images (real-time moving images) are displayed in the

image areas

523a and 523b. However, recorded recorded moving images may be displayed. The recorded moving image is, for example, a moving image recorded for a certain period of time before and after the determination time when the condition of the monitored person Ob is determined. Such a recorded moving image can accurately grasp the situation and can be used for elucidating the cause and taking preventive measures.

This specification discloses various modes of technology as described above, and the main technologies are summarized below.

A display device of a monitored person monitoring system according to an aspect includes an image of the monitored person and the monitored person in the monitored person monitoring system that monitors the monitored person by detecting the monitored person. The display device displays a determination result obtained by determining the state of the monitor, and displays the image of the monitored person and an icon representing the determination result. Preferably, the display device of the monitored person monitoring system detects an image of the monitored person and the monitored person's image in the monitored person monitoring system that detects the monitored person and monitors the monitored person. A display device that displays a determination result of determining a state, the monitoring information receiving unit that receives the image of the monitored person and the determination result, a display unit that performs display, and the determination result in association with the determination result An icon storage unit for storing an icon representing a determination result, and an icon corresponding to the determination result of the monitored person received by the monitoring information reception unit are acquired from the icon storage unit, and the acquired icon and the monitoring information reception A display processing unit for displaying an image of the monitored person received by the display unit on the display unit. The icons represent things expressed as symbols with relatively simple patterns, and are composed of pictures, symbols, figures, or combinations thereof.

Since such a display device displays not only an image of the monitored person but also an icon that symbolically represents the determination result, for example, a monitor (user) such as a nurse or a caregiver refers to the icon. Thus, the icon can be used as an aid for understanding the image, and the state (situation) of the monitored person can be grasped more accurately and quickly from the image. For example, when the state of the monitored person that can be grasped from the image matches the state of the monitored person that can be grasped from the icon, the determination result itself represented symbolically by the icon is more accurately obtained from the image. The state of the monitored person can be grasped earlier. In addition, for example, when the state of the monitored person that can be grasped from the image does not match the state of the monitored person that can be grasped from the icon, the monitored person that can be grasped from the image from the determination result that the icon symbolically represents It is possible to grasp the state of the person being monitored more accurately and more quickly from the image as having shifted to the state. For example, when the image of the monitored person is the current image, the latest situation and the background can be grasped by referring to the current image and the icon.

In another aspect, in the display device of the above-described monitored person monitoring system, the image of the monitored person is generated by a camera disposed immediately above the monitored person.

It is effective for a display device of a monitored person monitoring system that uses an image generated by a camera arranged directly above the monitored person for determination.

In another aspect, in the display device of the above-described monitored person monitoring system, the image of the monitored person is a still image or a moving image.

According to this, it is possible to provide a display device of a monitored person monitoring system that displays a still image or a moving image.

In another aspect, in the display device of the above-described monitored person monitoring system, the moving image is a recorded recorded moving image or a real-time real-time moving image.

According to this, it is possible to provide a display device of a monitored person monitoring system that displays a recorded moving image or a real-time moving image.

In another aspect, in the display device of the above-described monitored person monitoring system, the image of the monitored person is an image used when the determination is performed.

Such a display device of the monitored person monitoring system can grasp the situation at the time of determination by referring to the image and icon at the time of determination, and can quickly and accurately determine the event that has occurred in the monitored person.

In another aspect, in the display device of the above-described monitored person monitoring system, the display processing unit further displays an elapsed time from the determination time when the determination is performed on the display unit.

According to this, it is possible to provide a display device of the monitored person monitoring system that displays the elapsed time from the determination time. In particular, when the image of the monitored person is the current image, it is used when recognizing the deviation between the current state of the monitored person and the icon, thereby improving the accuracy of the determination of the situation that has occurred in the monitored person. .

In another aspect, in the display device of the above-described monitored person monitoring system, the display processing unit displays a plurality of the icons in time series. Preferably, in the display device of the above-described monitored person monitoring system, the monitoring information receiving unit receives a plurality of the images and determination results of the monitored person at different times, and the icon storage units are of different types. A plurality of icons representing the determination results are stored in association with the determination results, and the display processing unit displays a plurality of icons corresponding to the plurality of determination results of the monitored person received by the monitoring information receiving unit. Acquired from the icon storage unit, displays the acquired plurality of icons in time series on the display unit, and displays one of the images of the monitored person received by the monitoring information reception unit as the display To display.

Since such a display device displays a plurality of icons in time series, the monitor can recognize the history of the state (situation) of the monitored person by referring to the plurality of icons arranged in time series.

In another aspect, in the display device of the above-described monitored person monitoring system, the display processing unit further displays a prediction icon representing a prediction determination result obtained by predicting a determination result of the monitored person that will occur in the future. Preferably, the display device of the above-described monitored person monitoring system further includes a determination result prediction unit that predicts a determination result of the monitored person that will occur in the future, and the display processing unit is received by the monitoring information receiving unit. An icon corresponding to the determination result of the monitored person is acquired from the icon storage unit, an icon corresponding to the prediction determination result predicted by the determination result prediction unit is acquired from the icon storage unit as the prediction icon, and The acquired icon and prediction icon and the image of the monitored person received by the monitoring information receiving unit are displayed on the display unit. Preferably, in the display device of the above-described monitored person monitoring system, the determination result prediction unit determines a transition destination corresponding to a history of the state (situation) of the monitored person from the state transition diagram prepared in advance. A search is performed, and the searched transition destination is set as the prediction determination result. Preferably, in the above-described display device of the monitored person monitoring system, the determination result prediction unit creates the state transition diagram from the history of the state of the monitored person in the past.

Since such a display device displays a prediction icon, the monitor can recognize a state that is likely to occur in the monitored person.

In another aspect, in the display device of the above-described monitored person monitoring system, the display processing unit displays the prediction icon only for a preset monitored person. Preferably, the display device of the above-described monitored person monitoring system further includes a predicted icon display monitored person storage unit that stores a monitored person identifier for identifying and identifying the monitored person who should display the predicted icon. The display processing unit is configured to store the monitored person identifier of the monitored person corresponding to the image received by the monitoring information receiving part and the determination result in the predicted icon display monitored person storage unit. The prediction icon is displayed on the display unit.

Such a display measure can set the display of the prediction icon only to the monitored person who needs the prediction judgment result. For example, it is possible to set the display of the prediction icon only to a watched person who needs to be watched easily, which is likely to cause a predetermined inconvenient event such as an abnormal state (for example, falling or falling).

In another aspect, in the display device of the above-described monitored person monitoring system, the display processing unit displays the icon and the prediction icon in different displays. Preferably, in the display device of the above-described monitored person monitoring system, the display processing unit displays the icon and the prediction icon differently on the display unit.

Since such a display device displays the display of the icon and the display of the prediction icon in different displays, the monitor can determine whether the displayed icon is the icon or the prediction icon from the display. You can easily recognize another.

According to another aspect of the present invention, there is provided a display method of a monitored person monitoring system, wherein the monitored person image and the monitored object in the monitored person monitoring system that detects the monitored person and monitors the monitored person. A display method for displaying a determination result obtained by determining a state of a monitor, wherein the image of the monitored person and an icon representing the determination result are displayed. Preferably, the display method of the monitored person monitoring system includes a monitoring information receiving step for receiving a determination result obtained by determining the image of the monitored person and the state of the monitored person, and the monitored object received in the monitoring information receiving step. An acquisition step of acquiring an icon corresponding to the determination result of the person from an icon storage unit that stores in advance an icon representing the determination result in association with the determination result, the icon acquired in the acquisition step, and the monitoring information reception step And a display processing step of displaying the image of the monitored person received in step (1) on a display unit that performs display.

A monitored person monitoring system according to another aspect is a monitored person monitoring system that detects a monitored person that is a monitoring target and monitors the monitored person, the image of the monitored person and the monitored person The display apparatus in any one of these above-mentioned for displaying the determination result which determined the person's state is provided.

The display method of the monitored person monitoring system and the monitored person monitoring system display not only the image of the monitored person but also an icon that represents the determination result symbolically, so the supervisor refers to the icon. By doing so, the icon can be used as an aid for understanding the image, and the state (situation) of the monitored person can be grasped more accurately and quickly from the image.

This application is based on Japanese Patent Application No. 2015-65284 filed on March 26, 2015, the contents of which are included in this application.

In order to express the present invention, the present invention has been properly and fully described through the embodiments with reference to the drawings. However, those skilled in the art can easily change and / or improve the above-described embodiments. It should be recognized that this is possible. Therefore, unless the modifications or improvements implemented by those skilled in the art are at a level that departs from the scope of the claims recited in the claims, the modifications or improvements are not covered by the claims. To be construed as inclusive.

According to the present invention, it is possible to provide a display device of the monitored person monitoring system, the display method, and the monitored person monitoring system.

Claims

A display device in a monitored person monitoring system that detects a monitored person who is a monitoring target and monitors the monitored person,
A monitoring information receiving unit for receiving a determination result of determining the image of the monitored person and the state of the monitored person;
A display unit for displaying, and
An icon storage unit for storing an icon representing the determination result in association with the determination result;
An icon corresponding to the determination result of the monitored person received by the monitoring information receiving unit is acquired from the icon storage unit, and the acquired icon and the image of the monitored person received by the monitoring information receiving unit are displayed. A display processing unit for displaying on the unit,
Display device for monitored person monitoring system.
The image of the monitored person is an image generated by a camera arranged immediately above the monitored person.
The display device of the monitored person monitoring system according to claim 1.
The image of the monitored person is a still image or a moving image.
The display device of the monitored person monitoring system according to claim 1.
The moving image is a recorded recorded moving image or a real-time moving image in real time.
The display device of the monitored person monitoring system according to claim 3.
The image of the monitored person is an image used when the determination is performed.
The display device of the monitored person monitoring system according to any one of claims 1 to 4.
The display processing unit further displays an elapsed time from a determination time when the determination is performed on the display unit.
The display device of the monitored person monitoring system according to any one of claims 1 to 5.
The display processing unit displays a plurality of the icons in time series.
The display device of the monitored person monitoring system according to any one of claims 1 to 6.
A judgment result prediction unit that predicts a judgment result of the monitored person that will occur in the future;
The display processing unit further displays, as a prediction icon, an icon corresponding to a prediction determination result obtained by predicting a determination result of the monitored person that will occur in the future by the determination result prediction unit.
The display device for a monitored person monitoring system according to any one of claims 1 to 7.
The display processing unit displays the prediction icon only for a preset monitored person.
The display device of the monitored person monitoring system according to claim 8.
The display processing unit displays the icon and the prediction icon in different displays.
The display device of the monitored person monitoring system according to claim 8 or 9.
A display method in a monitored person monitoring system for detecting a monitored person who is a monitoring target and monitoring the monitored person,
A monitoring information receiving step for receiving a determination result of determining the image of the monitored person and the state of the monitored person;
An acquisition step of acquiring an icon corresponding to the determination result of the monitored person received in the monitoring information reception step from an icon storage unit that stores in advance an icon representing the determination result in association with the determination result;
A display processing step of displaying the icon acquired in the acquisition step and the image of the monitored person received in the monitoring information reception step on a display unit for displaying,
Display method of monitored person monitoring system.
A monitored person monitoring system that detects a monitored person to be monitored and monitors the monitored person,
The display device according to any one of claims 1 to 10, for displaying an image of the monitored person and a determination result of determining the state of the monitored person.
Monitored person monitoring system.