JP6512284B2 - Display Device of Monitored Person Monitoring System, Display Method of the Display Device, and Monitored Person Monitoring System - Google Patents

Description

  The present invention relates to a display device of a monitored person monitoring system that monitors a monitored person to be monitored and transmits predetermined information on the monitored person to a receiving device, and a displayed method of the monitored person monitoring system. Also, the present invention relates to the above-mentioned monitored person monitoring system.

  Japan (Japan) is an aging society, more specifically, the proportion of the population over the age of 65 with respect to the total population, due to the improvement of living standards along with the postwar high economic growth, the improvement of the sanitation environment and the improvement of the medical standards. It has become a super-aging society with an aging rate exceeding 21%. Also, in 2005, the total population was about 127.65 million, compared with about 25.56 million for the elderly population aged 65 and over, in 2020 the total population was about 124.11 million. The elderly population is expected to be about 34.56 million. In such an aging society, nurses who need nursing or nursing care due to illness, injury or old age or those who need a care (such as those who need nursing care) need nurses who occur in a normal society that is not an aging society The increase is expected compared to etc. And Japan is also a low birthrate society, for example, with a total fertility rate of 1.43 in 2013. Therefore, elder care is also taking place, where an elderly family member (spouse, child, brother) cares for elder nurses etc.

  Those who need nursing care, etc. enter facilities such as hospitals and nursing homes for the elderly (in Japan, they are nursing homes for the elderly, nursing homes for the elderly and nursing homes for the elderly, etc.), and receive nursing and nursing care. In such a facility, a person in need of care or the like may be injured, for example, by falling from a bed or falling while walking, or a situation may occur such as falling out of a bed and beating. It is necessary to respond to such a situation as soon as possible. In addition, leaving such a situation as it is may lead to a more serious situation. For this reason, in the above-mentioned facility, nurses, carers and the like regularly check the safety and condition by patrolling.

  However, the nursing industry and the care industry are chronically understaffed because the number of nurses and others can not keep up with the number of nurses and others required. Furthermore, since the number of nurses and carers etc. decreases during the night shift and night shift hours compared with the day shift hours, the workload per person increases, so it is required to reduce the load. In addition, the elderly care is not an exception at the facilities, and it is often seen that an elderly nurse or the like cares for an elderly nurse or the like. Generally, when you get older, your physical strength declines, and even if you are healthy, the burden of nursing etc. becomes heavier than younger nurses and so on, and its movement and judgment also become slower.

  In order to reduce such labor shortages and the burden of nurses etc., there is a need for techniques that complement nursing work and care work. For this reason, in recent years, there has been researched and developed a monitored person monitoring technology for monitoring (monitoring) a monitored person to be monitored, such as a nurse who needs nursing care.

  One such technique is, for example, a nurse call system disclosed in Patent Document 1. The nurse call system disclosed in this patent document 1 is installed in a bed and a nurse call slave machine for a patient to call a nurse, and installed in a nurse station for answering a call by the nurse call slave machine. A nurse call system having a nurse call master, a camera for imaging a patient on a bed from above the bed, and a state in which the patient is in an upper body and a patient is separated from the bed from an imaging image of the camera The nurse call master has notification means for notifying operation upon receiving the attention state occurrence signal. The state determination means determines the occurrence of at least one of the above and outputs an attention state occurrence signal. The nurse call master has a monitor for displaying an image and an image control unit for displaying an image captured by the camera on the monitor when the attention state generation signal is received.

  On the other hand, in terms of safety confirmation, a single person living alone is the same as the care recipient and the like, and is a person to be monitored.

  By the way, in the said patent document 1, the imaging video of a camera is displayed on a monitor so that a nurse can recognize the condition of a patient. However, since the camera images the patient from above the bed, it is difficult to grasp the patient's condition from the captured video (including moving images and still images). In particular, when an image is taken from directly above the patient, the change in the vertical direction (the depth direction) is small, so it is difficult to grasp the patient's condition, not only for still images but also for moving images. For example, it is difficult to determine whether the monitored person is squatting or falling. In addition, when the captured video is a moving image, the movement of the patient is seen to grasp the patient's state, so it takes time to grasp the patient's state. Patients and the elderly, in particular, have relatively little movement and take more time. In the case of a still image, it is an image at the detection time as a problem in the case of confirming the situation by an image, so the latest situation is not known. In the case of a moving image, the latest situation is known. There is also a problem that the situation (why it was notified) and the background to the present are unknown, that is, the whole picture of the situation can not be known whether it is a still picture or a moving picture.

  As mentioned above, accurate and quick judgment is important in nursing care to prevent accidents. Problems such as being unable to prevent an accident that could have been prevented due to a late judgment or making the response slow and severe when problems such as a fall occur in the monitored person also occur. It is also a problem to make a wrong judgment, not only when it is judged that the accident is not an accident, but also by the misjudgment that it is judged as an accident although it is not an accident, the work of carers increases and the task of shortage of labor There is also the problem of a large loss of labor in one care task and the delay in noticing another accident.

JP, 2014-90913, A

  The present invention is an invention made in view of the above-mentioned circumstances, and an object thereof is a display of a monitored person monitoring system in which a monitored person can recognize the status (state) of the monitored person more accurately and more quickly. An apparatus, a display method, and the monitored person monitoring system are provided.

  A monitored person monitoring system according to the present invention is a system for detecting a monitored person to be monitored and monitoring the monitored person, and a display device and a display method used for the monitored person monitoring system are: An image of the person to be monitored and an icon representing the determination result of determining the state of the person to be monitored are displayed. The icon is a symbolically expressing things with a relatively simple pattern or the like, and is configured of a picture, a symbol, a figure, or a combination of these. Therefore, the display device and display method of the monitored person monitoring system and the monitored person monitoring system according to the present invention can more accurately and quickly recognize the state (condition) of the monitored person.

  The above and other objects, features and advantages of the present invention will be apparent from the following detailed description and the accompanying drawings.

It is a figure which shows the structure of the to-be-monitored person monitoring system in embodiment. It is a figure which shows the structure of the portable terminal unit in the to-be-monitored person monitoring system of embodiment. It is a figure which shows each structure of the monitoring information table memorize | stored in the said portable terminal unit, and a detection unit information table. It is a figure which shows an example of the icon used with the to-be-monitored person monitoring system of embodiment. It is a flowchart which shows the operation | movement regarding the display of monitoring information in the said portable terminal unit. It is a figure which shows an example of the standby display screen displayed on the said portable terminal unit. It is a figure which shows an example of the monitoring information display screen displayed on the said portable terminal unit which received the notification of waking up of a to-be-monitored person. It is a figure which shows an example of the monitoring information display screen displayed on the said portable terminal unit which received the notification of leaving of the said monitored person after receiving the notification of the said rising. It is a figure which shows an example of the monitoring information display screen displayed by the said portable terminal unit by full screen display. It is a figure which shows an example of the prediction icon used with the to-be-monitored person monitoring system of embodiment.

  Hereinafter, an embodiment according to the present invention will be described based on the drawings. In addition, the structure which attached | subjected the same code | symbol in each figure shows that it is the same structure, and abbreviate | omits the description suitably. In the present specification, suffixes are generally indicated by reference numerals without suffixes, and individual configurations are indicated by subscripts.

  The monitored person monitoring system monitors the monitored person Ob by detecting a monitored person (observed person) Ob who is a monitoring target (a monitoring target) to be monitored (should watch). The display device used in the monitored person monitoring system displays the image of the monitored person Ob and the determination result of determining the state of the monitored person Ob. And in this embodiment, in addition to the display of the said determination result, or instead of the display of the said determination result, the said display apparatus displays the said determination result by the icon showing it. The icon is a symbolically expressing things with a relatively simple pattern or the like, and is configured of a picture, a symbol, a figure, or a combination of these. In the present embodiment, the image of the monitored person Ob is generated by a camera disposed immediately above the monitored person Ob, and a still image or a moving image (in one example, recorded moving image or real time in another example) Real-time animation). And Preferably, the image of the said to-be-monitored person Ob is an image used when performing the said determination. In the present embodiment, the display device displays an elapsed time from the determination time at which the determination is made. In the present embodiment, the display device displays a plurality of the icons in time series. In the present embodiment, the display device displays a prediction icon representing a predicted judgment result obtained by predicting the judgment result of the monitored person Ob to be generated in the future, and displays the predicted icon only for the predetermined monitored person Ob. Configured In this case, the display device displays the icon and the prediction icon in different displays.

  FIG. 1 is a diagram showing a configuration of a monitored person monitoring system in the embodiment. FIG. 2 is a diagram showing the configuration of a mobile terminal unit in the monitored person monitoring system of the embodiment. FIG. 3 is a view showing each configuration of a monitoring information table and a detection unit information table stored in the portable terminal unit. FIG. 3A shows the monitoring information table, and FIG. 3B shows the detection unit information table. FIG. 4 is a view showing an example of an icon used in the monitored person monitoring system of the embodiment. FIG. 10 is a diagram showing an example of a prediction icon used in the monitored person monitoring system of the embodiment.

  For example, as shown in FIG. 1, such a monitored person monitoring system MS includes one or more detection units (sensor units) SU (SU-1 to SU-4), a management server unit SV, and a fixed terminal. A unit SP and one or more mobile terminal units TA (TA-1 and TA-2) are wired or wireless, and are networks such as a LAN (Local Area Network), a telephone network, and a data communication network It is communicably connected via a network (communication line) NW. The network NW may be equipped with relays such as repeaters, bridges, routers, and cross connects that relay communication signals. In the example shown in FIG. 1, the plurality of detection units SU-1 to SU-4, the management server unit SV, the fixed terminal unit SP, and the plurality of portable terminal units TA-1 and TA-2 include the access point AP. They are communicably connected to each other by a LAN (for example, a LAN according to the IEEE 802.11 standard) NW.

  The monitored person monitoring system MS is disposed at an appropriate place according to the monitored person Ob. The monitored person (watching target person) Ob is, for example, a person who needs nursing due to illness or injury, a person who needs care due to a decrease in physical ability or the like, or a single person living alone. In particular, from the viewpoint of enabling early detection and coping, the person to be monitored Ob is a person who needs the detection when a predetermined adverse event such as an abnormal condition occurs in the person. preferable. For this reason, the person-to-be-monitored monitoring system MS is suitably disposed in buildings such as hospitals, welfare facilities for the elderly and dwelling units according to the type of the person to be monitored Ob. In the example shown in FIG. 1, the monitored person monitoring system MS is disposed in a building of a care facility provided with a plurality of rooms RM, in which a plurality of monitored persons Ob reside, and a plurality of rooms such as a nurse station ST. .

  The detection unit SU has a communication function of communicating with other units SV, SP, and TA via the network NW, picks up the monitored person Ob, generates an image, and detects the monitored person Ob from the generated image. It is a device. More specifically, the detection unit SU is, for example, a communication interface circuit (for example, a LAN card or the like) for communicating with other units SV, SP, TA via a network, a microwave, and the monitored person Ob A Doppler shift type body motion sensor that detects the monitored person Ob by detecting the Doppler shift of the microwave generated by the body movement (for example, breathing movement), and generates an image by imaging the monitored person Ob A data processing circuit that determines the state (situation) of the monitored person Ob as a detection result of the monitored person Ob based on an image sensor, an output (body motion sensor output) of the body movement sensor and an output (image) of the image sensor And a control circuit that controls these components and their peripheral circuits, and transmits the detection result to the management server unit SV. The image sensor (camera) is disposed, for example, above, particularly, directly above (directly above) the monitored person Ob. As described above, when the image sensor (camera) is disposed above, particularly, directly above the monitored person, the monitored person monitoring system MS of the present embodiment is effective. The detection unit SU transmits the generated image (including still image and moving image) to predetermined other units SV, SP, TA. In the present embodiment, the detection unit SU transmits a voice call with a nurse call circuit for notifying a nurse call to the fixed terminal unit SP, the portable terminal unit TA, etc., and the fixed terminal unit SP, the portable terminal unit TA, etc. It has a telephone call circuit that enables nurse calls and voice calls. In FIG. 1, four first to fourth detection units SU-1 to SU-4 are shown as an example, and the first detection unit SU-1 is Mr. A, who is one of the monitored persons Ob. The second detection unit SU-2 is disposed in a living room RM-1 (not shown) of Ob-1, and is disposed in a living room RM-2 (not shown) of Mr. B's Ob-2 who is one of the monitored persons Ob. The third detection unit SU-3 is disposed in a living room RM-3 (not shown) of Mr. C's Ob-3, who is one of the monitored persons Ob, and the fourth detection unit SU-4 is It is arrange | positioned by the room RM-4 (not shown) of Mr. D Ob-4 who is one of the to-be-monitored person Ob.

  The management server unit SV has a communication function of communicating with other units SU, TA, and SP via the network NW, and receives from the detection unit SU the detection result regarding the monitored person Ob and the image of the monitored person Ob It is a device that manages information (monitoring information) related to monitoring of the monitored person Ob. When the management server unit SV receives the detection result regarding the monitored person Ob and the image of the monitored person Ob from the detection unit SU, a communication signal (monitoring information communication signal containing the monitoring information related to monitoring of the monitored person Ob) ) To the fixed terminal unit SP and the portable terminal unit TA. The management server unit SV provides the client with data according to the request of the client (in the present embodiment, the fixed terminal unit SP, the portable terminal unit TA, etc.). Such a management server unit SV can be configured, for example, by a computer with a communication function.

  The fixed terminal unit SP includes a communication function for communicating with other units via the network NW, a display function for displaying predetermined information, and an input function for inputting predetermined instructions and data, etc. Function as the user interface (UI) of the person-to-be-monitored monitoring system MS by inputting predetermined instructions and data to be given to the portable terminal unit TA, displaying detection results and images obtained by the detection unit SU, etc. Devices that Such fixed terminal unit SP can be configured, for example, by a computer with a communication function.

  The portable terminal unit TA has a communication function of communicating with other units SV, SP, SU via the network NW, a display function of displaying predetermined information, an input function of inputting predetermined instructions and data, and a voice call. A call function etc. to be performed is provided, and predetermined instructions and data given to the management server unit SV and detection unit SU are input, or the detection result and image obtained by the detection unit SU are displayed by notification from the management server unit SV. It is an apparatus which receives and displays the said monitoring information regarding monitoring with respect to the to-be-monitored person Ob by doing etc.

  The management server unit SV may be an example of the display device and function as the display device, and the fixed terminal unit SP may be an example of the display device and function as the display device. Here, the case where the portable terminal unit TA is an example of the display device and functions as the display device will be described. When the management server unit SV is an example of the display device and functions as the display device, the management server unit SV can be configured as in the following description. Further, even when the fixed terminal unit SP is an example of the display device and functions as the display device, the fixed terminal unit SP can be configured as in the following description.

  In the present embodiment, such a mobile terminal unit TA is, for example, as shown in FIG. 2, a terminal control processing unit (TA control processing unit) 41, a terminal storage unit (TA storage unit) 42, and a terminal communication interface Unit (TA communication IF unit) 43, terminal sound input / output unit (TA sound input / output unit) 44, terminal input unit (TA input unit) 45, terminal display unit (TA display unit) 46, terminal interface unit And (TAIF unit) 47.

  The TA sound input / output unit 44 is a device connected to the TA control processing unit 41 for acquiring an external sound and inputting it to the portable terminal unit TA, and the electricity representing the sound according to the control of the TA control processing unit 41 It is a device for generating and outputting a sound corresponding to a signal. The TA sound input / output unit 44 is configured to include, for example, a microphone that converts acoustic vibration of sound into an electrical signal, and a speaker that converts the electrical signal of sound into acoustic vibration of sound. The TA sound input / output unit 44 outputs an electrical signal representing an external sound to the TA control processing unit 44, and converts the electrical signal input from the TA control processing unit 44 into acoustic vibration of sound and outputs the acoustic vibration.

  The TA input unit 45 is a device connected to the TA control processing unit 41, for example, a device that receives a predetermined operation and inputs the operation to the mobile terminal unit TA, and is, for example, a plurality of input switches to which predetermined functions are assigned. . In the predetermined operation, for example, whether or not to execute an ID input operation for logging in, or a response such as life saving, nursing, assistance, etc. to the monitored person Ob notified of the detection result and the image. It includes various operations and the like necessary for monitoring input operations and the like. The TA display unit 46 is connected to the TA control processing unit 41, and under the control of the TA control processing unit 41, predetermined operation content input from the TA input unit 45 and monitored by the monitored person monitoring system MS. It is a device that displays the monitoring information (for example, the determined status of the monitored person Ob, an image, etc.) related to the monitoring of the monitored person Ob, for example, a display device such as an LCD (liquid crystal display) and an organic EL display . The TA display unit corresponds to an example of the display unit that performs display. And, in the present embodiment, the TA input unit 45 and the TA display unit 46 constitute a touch panel. In this case, the TA input unit 45 is a position input device for detecting and inputting an operation position of, for example, a resistance film method or a capacitance method. In this touch panel, a position input device is provided on the display surface of the TA display unit 46, one or more input content candidates that can be input are displayed on the TA display unit 46, and a user such as a nurse or carer When the display position displaying the input content to be input is touched, the position is detected by the position input device, and the display content displayed at the detected position is input to the portable terminal unit TA as the operation input content of the user.

  The TAIF unit 47 is a device connected to the TA control processing unit 41 and performing data input / output with an external device according to the control of the TA control processing unit 41. For example, the Bluetooth (registered trademark) standard is used. The interface circuit is an interface circuit that performs infrared communication such as IrDA (Infrared Data Association) standard, an interface circuit that uses USB (Universal Serial Bus) standard, and the like.

  The TA communication IF unit 43 is a communication device that is connected to the TA control processing unit 41 and performs communication according to the control of the TA control processing unit 41. The TA communication IF unit 43 generates a communication signal containing the data to be transferred, which is input from the TA control processing unit 41, according to the communication protocol used in the network NW of the monitored person monitoring system MS, and generates the generated communication The signal is transmitted to the other units SU, SV, SP via the network NW. The TA communication IF unit 43 receives communication signals from the other units SU, SV, SP via the network NW, extracts data from the received communication signals, and the TA control processing unit 41 can process the extracted data. The data is converted into data of the following format and output to the TA control processing unit 41. The TA communication IF unit 43 corresponds to an example of the monitoring information receiving unit that receives the image of the monitored person Ob and the determination result.

  The TA storage unit 42 is a circuit that is connected to the TA control processing unit 41 and stores various predetermined programs and various predetermined data according to the control of the TA control processing unit 41. The various predetermined programs include, for example, a monitoring information screen display program that displays the image of the monitored person Ob and an icon representing the determination result, and a predicted result prediction that predicts the determined result of the monitored person Ob that will occur in the future A control processing program such as a program is included. The various predetermined data includes data of the icon, data of the monitored person Ob displaying an icon (predicted icon) representing the determination result predicted by the determination result prediction program, and the monitoring related to the monitored person Ob It includes data necessary for executing each program such as monitoring information and detection unit information on the detection unit SU. The TA storage unit 42 includes, for example, a ROM (Read Only Memory), which is a non-volatile memory element, and an Electrically Erasable Programmable Read Only Memory (EEPROM), which is a rewritable non-volatile memory element. The TA storage unit 42 includes, for example, a RAM (Random Access Memory) serving as a working memory of a so-called TA control processing unit 41 which stores data and the like generated during execution of the predetermined program. The TA storage unit 42 functionally includes an icon storage unit 421, a predicted icon display monitored person storage unit 422, a monitoring information storage unit 423, and a detection unit information storage unit 424.

  The icon storage unit 421 stores an icon symbolically representing the determination result in association with the determination result. More specifically, the icon storage unit 421 stores a plurality of icons representing the determination results in association with the determination results of different types. For example, in the present embodiment, the detection unit SU determines the status of the monitored person Ob as being uprising, leaving, falling over, falling over, or micro body movement abnormality, and the results of these determinations (uplifting, leaving, falling over, fall Each icon (each image data of each icon) corresponding to the micro movement abnormality is prepared in advance. For example, as shown in FIG. 4, a rising icon IC-1 symbolically indicating that the monitored person Ob is determined to be rising, and a leaving floor symbolically indicating that the monitored person Ob is determined to be leaving The icon IC-2, the falling falling icon IC-3 symbolically showing that it has been determined that the monitored person Ob has fallen, and the symbol that the monitored person Ob has been determined to be the movement abnormality of the body The four icons IC of the micro movement abnormality icon IC-4 to be displayed are prepared in advance. Each of these icons is stored in the icon storage unit 421 in association with each determination result. For example, a file (electronic file) storing icon data, and a table (icon table) indicating the correspondence between the determination result and the file name of the icon symbolically expressing the determination result are stored in the icon storage unit 421. Pre-stored.

  The predicted icon display monitored person storage unit 422 stores a monitored person identifier (monitored person ID) for specifying and identifying the monitored person Ob to display the predicted icon. More specifically, for example, a prediction icon is displayed as a monitoring person ID of the monitoring person Ob whose detection icon should be displaying the prediction icon, the detection ID of the detection unit SU monitoring the monitoring person Ob of the monitoring person ID It is stored in the monitored person storage unit 422. Further, for example, the correspondence relationship between the monitored person ID and the detection ID of the detection unit SU that monitors the monitored person Ob of the monitored person ID is stored in advance in the predicted icon display monitored person storage unit 422, and the predicted icon The to-be-monitored person ID of the to-be-monitored person Ob who should be displayed may be stored in the predicted icon display monitored person storage unit 422 separately from the correspondence relationship. The monitored person ID of the monitored person Ob who should display the predicted icon according to the correspondence relationship is linked to the detection ID.

  The monitoring information storage unit 423 stores the monitoring information related to monitoring of the monitored person Ob. The monitoring information is determined as the state of the monitored person Ob by the detection unit SU having the detection ID and a detection unit identifier (detection ID) for specifying and identifying the detection unit SU, and the detection ID. Information representing the determination result (determination result information; in the present embodiment, wake up, leaving, falling over, falling body movement abnormality included), the monitored person Ob in the detection unit SU associated with the detection ID and having the detection ID Information indicating the time when the state of the subject has been determined (determination time information), and the subject Ob used when the state of the subject Ob is determined by the detection unit SU associated with the detection ID and having the detection ID Still images (one of them (for example, the final image when determined using a plurality of images)), the detection unit S associated with the detection ID and having the detection ID And the communication address (e.g., IP address etc.) and the detection ID corresponding to the detection ID and the intention to execute the above-mentioned measures such as nursing for the monitored person Ob monitored by the detection unit SU It includes correspondence information and the like indicating whether or not it has been input to the portable terminal unit TA. Note that, instead of the determination time, the determination result and the reception time of the communication signal that has received the notification of the image may be used.

  This monitoring information is stored in the monitoring information storage unit 423 in the form of a table in the present embodiment. For example, as shown in FIG. 3A, the monitoring information table MT for registering the monitoring information covers the detection ID field 4231 for registering the detection ID and the detection unit SU corresponding to the detection ID registered in the detection ID field. A judgment result field 4232 for registering the judgment result information, a judgment time field 4233 for registering the judgment time information concerning the detection unit SU corresponding to the detection ID registered in the detection ID field, and a detection ID field registered A still image field 4234 for registering the still image according to the detection unit SU corresponding to the detection ID, and a communication address of the detection unit SU corresponding to the detection ID registered in the detection ID field as a live moving image acquisition destination (for example, IP A video field 4235 for registering an address etc.), Monitoring information communication signal including a correspondence field 4236 for registering correspondence information indicating whether or not the intention of the correspondence to the monitored person Ob monitored by the detection unit SU corresponding to the detection ID registered in the knowledge ID field is entered; Have a record for each receipt of In the correspondence field 4236, a flag indicating correspondence information indicating whether or not the intention of the correspondence is entered is registered. For example, in the present embodiment, in the corresponding field 4236, the flag “1” meaning that the intention of the correspondence is input to the portable terminal unit TA, or the intention of the correspondence is input to the portable terminal unit TA. A flag "0" indicating that there is no is registered. Note that, for example, image data of a still image may be registered in the still image field 4234, and for example, a file name of image data of a still image may be registered. In the example shown in FIG. 3A, in the first record, each of the detection ID field 4231, the determination result field 4232, the determination time field 4233, the still picture field 4234, the moving picture field 4235, and the corresponding field 4236 , “Wake up”, “06:32”, “SP1”, “**. **. **. **” (** is an integer value) and “0” are registered, and the second In the record, “SU-1”, “Becoming out of bed”, “06: 45” in the detection ID field 4231, the determination result field 4232, the determination time field 4233, the still picture field 4234, the moving picture field 4235 and the corresponding field 4236 respectively. "SP2", "**. **. **. **" (** is an integer value) and "0" are registered. To have.

  In the example illustrated in FIG. 3A, the monitoring information table MT includes the moving image field 4235, but a table indicating the correspondence between the detection ID and the communication address of the detecting unit SU as the acquisition destination of the live moving image is monitoring information. The moving image field 4235 may be omitted from the monitoring information table MT illustrated in FIG. 3A, which is prepared separately from the table MT and stored in the monitoring information storage unit 423.

  The detection unit information storage unit 424 stores the detection unit information related to the detection unit SU. The detection unit information includes the location of the detection unit SU and the name of the monitored person monitored by the detection unit SU. The detection unit information is stored in the detection unit information storage unit 424 in the form of a table in the present embodiment. The detection unit information table DT for registering the detection unit information is, for example, as shown in FIG. 3B, a detection ID field 4241 for registering a detection ID, and the detection unit SU having the detection ID associated with the detection ID. Location field 4242 for registering the installation location of the subject, and a monitored person name field 4243 for registering the name of the monitored person Ob monitored by the detection unit SU associated with the detection ID and associated with the detection ID And have a record for each detection ID. In the example shown in FIG. 3B, in the first record, “SU-1”, “101” and “K mountain M” are stored in the detection ID field 4242, the installation location field 4242 and the monitored person name field 4243 respectively. In the second record, "SU-2", "102" and "M river K" are registered in the detection ID field 4241, the arrangement location field 4242 and the monitored person name field 4243 respectively. "Child" is registered.

  The TA control processing unit 41 is a circuit for controlling the respective units of the mobile terminal unit TA according to the functions of the respective units and processing monitoring information related to the monitoring of the monitored person Ob. The TA control processing unit 41 is configured to include, for example, a CPU (Central Processing Unit) and its peripheral circuits. The TA control processing unit 41 functionally includes a terminal control unit (TA control unit) 411 and a terminal monitoring processing unit (TA monitoring processing unit) 412 by executing a control processing program, and the TA monitoring processing unit 412 The display processing unit 4121 and the determination result prediction unit 4122 are functionally provided.

  The TA control unit 411 controls each unit of the portable terminal unit TA according to the function of each unit, and controls the entire control of the portable terminal unit TA.

  The TA monitoring processing unit 412 processes the monitoring information related to monitoring of the monitored person Ob.

  The display processing unit 4121 of the TA monitoring processing unit 412 is an icon IC corresponding to the determination result (which is one of the monitoring information) of the monitored person Ob contained in the monitoring information communication signal received by the TA communication IF unit 43. Is acquired from the icon storage unit 421, and the still image (which is one of the monitoring information) of the monitored person Ob contained in the monitoring information communication signal received by the acquired icon IC and the TA communication IF unit 43 is It is displayed on the TA display unit 46.

  In addition, when a plurality of monitoring information communication signals are received by the TA communication IF unit 43 at different times, the display processing unit 4121 receives the plurality of monitoring information communication signals received by the TA communication IF unit 43. A plurality of icons IC corresponding to each of a plurality of judgment results of the observer Ob are acquired from the icon storage unit 421, and the plurality of acquired icons IC are arranged in time series and displayed on the TA display unit 46. The TA display unit 46 displays one of the plurality of images of the monitored person Ob contained in the plurality of monitoring information communication signals received in step b.

  The determination result prediction unit 4122 predicts the determination result of the subject Ob to be generated in the future, and obtains a prediction determination result. For example, from the state transition diagram stored in the TA storage unit 42, a state transition diagram representing the transition of each state of the monitored person Ob is prepared in advance and stored in the TA storage unit 42. A transition destination corresponding to the history of the state (state) of the person to be monitored Ob so far is searched, and the searched transition destination is taken as the prediction determination result. Further, for example, the determination result prediction unit 4122 may create the state transition diagram from the history of the state of the monitored person Ob in the past.

  Then, when the judgment result prediction unit 4122 obtains the prediction judgment result, the display processing unit 4121 judges the judgment result of the monitored person Ob contained in the monitoring information communication signal received by the TA communication IF unit 43 The icon IC corresponding to one of the monitoring information is acquired from the icon storage unit 421, and the icon IC corresponding to the prediction determination result predicted by the determination result prediction unit 4122 is used as the prediction icon from the icon storage unit 421. The above-mentioned TA display unit acquires still images (one of the above-mentioned monitoring information) of the obtained icon IC and predicted icon and the monitored information communication signal received by the TA communication IF unit 43 and the monitored person communication signal Displayed on 46 The still image is preferably an image used when the determination is made. Thus, the user (monitor) can grasp the situation at the time of determination by referring to the image and the icon at the time of determination, and can quickly and accurately determine the event which has occurred in the person to be monitored.

  In addition, when the predicted icon is displayed, the display processing unit 4121 monitors the image of the monitoring information communication signal received by the TA communication IF unit 43 and the monitored image of the monitored person Ob corresponding to the determination result. When the person's ID is stored in the predicted icon display monitored person storage unit 422, the predicted icon is displayed on the TA display unit 46, while the monitoring information communication signal received by the TA communication IF unit 43 is stored When the image and the monitored person ID of the monitored person Ob corresponding to the determination result are not stored in the predicted icon display monitored person storage unit 422, the predicted icon is not displayed on the TA display unit 46. Then, when displaying this prediction icon, the display processing unit 4121 causes the display of the icon IC and the display of the prediction icon to be displayed differently on the TA display unit 46. For example, the display processing unit 4121 displays the icon IC in a normal display, and displays the predicted icon in, for example, a highlight, a blinking display, or a display color different from the display color of the icon IC. FIG. 10 shows, as an example, a predicted icon IC-5 for falling and falling. In FIG. 10, the blinking display is expressed by a plurality of line segments that extend radially from the fall fall icon IC-3 and are arranged around the fall fall icon IC-3.

  Such a portable terminal unit TA can be configured by, for example, a portable communication terminal device such as a so-called tablet computer, a smartphone, or a mobile phone.

  Next, the operation of this embodiment will be described. In the monitored person monitoring system MS having such a configuration, each unit SU, SV, SP, and TA performs initialization of each necessary part when power is turned on, and starts its operation. In the portable terminal unit TA, the TA control unit 411 and the TA monitoring processing unit 412 are functionally configured in the TA control processing unit 41 by execution of the control processing program, and the TA monitoring processing unit 412 has a display processing unit. 4121 and the determination result prediction unit 4122 are functionally configured.

  The monitored person monitoring system MS configured as described above monitors each monitored person Ob by the following operation. The detection unit SU samples the output of the body movement sensor and the output of the image sensor at a predetermined sampling cycle, and the state of the person Ob to be monitored based on the sampled output of the body movement sensor and the output of the image sensor Determine the (condition). As a result of this determination, when it is determined that the monitored person Ob is in a preset state (for example, getting up, leaving, falling over, overturning, abnormal body movement, etc. in this embodiment), the detection unit SU detects Detection ID, determination result information indicating the determination result determined as the state of the monitored person Ob, determination time information indicating the determination time, still images of the monitored person Ob used in the determination (a plurality of images When it is determined using this, a communication signal (monitoring the image data of one of them (for example, the final image)) and the communication address (for example, IP address) of the own machine as a communication destination to download moving images An information communication signal is transmitted to the management server unit SV via the network NW. The communication address of the transmission source accommodated in the header may be shared as the communication address of the own device. The detection unit SU can determine the state (condition) of the monitored person Ob by a known technique. For example, the detection unit SU detects body movement of the chest (up and down movement of the chest) associated with the breathing movement of the monitored person Ob by the body movement sensor, and disturbance of the cycle in body movement of the chest or a preset threshold When the amplitude in the body movement of the chest which is the following is detected, it is determined that the micro movement abnormality is present. Further, for example, the detection unit SU acquires an image of the monitored person Ob by the image sensor, detects a human area of the monitored person Ob from the acquired image, and detects the monitored person from the aspect ratio of the detected human area The posture (for example, standing position, sitting position and lying position) of the Ob is determined, the position of the detected person area is detected, and the determination is made, based on the detected posture and position of the monitored person Ob. Determine the fall of the fall. When the management server unit SV receives the monitoring information communication signal from the detecting unit SU via the network NW, the management server unit SV determines the determination result information, the determination time information, the still image data and the moving image contained in the monitoring information communication signal. A communication address for obtaining is stored in correspondence with the detection ID (recording), and this monitoring information communication signal is directed to the fixed terminal unit SP and the portable terminal unit TA, for example, by broadcast communication of broadcast or multicast. . As a result, the state (condition) of the monitored person Ob is notified. When the communication address of the transmission source is also used as the communication address for obtaining a moving image, the communication address of the transmission source is the communication address of the management server unit SV due to the transfer of the monitoring information communication signal by the management server unit SV. Thus, the management server unit SV broadcasts the monitoring information communication signal after accommodating the communication address of the detection unit SU of the transmission source contained in the header in the payload of the monitoring information communication signal. In addition, the management server unit SV may unicast the monitoring information communication signal to the portable terminal unit TA associated in advance with the detection unit SU which has transmitted the monitoring information communication signal. When the fixed terminal unit SP and the portable terminal unit TA receive the monitoring information communication signal from the management server unit SV via the network NW, the monitoring information related to the monitoring of the monitored person Ob accommodated in the monitoring information communication signal is received. indicate. The operation of displaying the monitoring information by the portable terminal unit TA will be described in detail below. By such an operation, the monitored person monitoring system MS detects each monitored person Ob by each detection unit SU, the management server unit SV, the fixed terminal unit SP, and the portable terminal unit TA, and detects each monitored person Ob. I am monitoring.

  Next, an operation of displaying the monitoring information related to monitoring of the monitored person Ob in the monitored person monitoring system MS will be described. FIG. 5 is a flowchart showing an operation related to display of monitoring information in the portable terminal unit. FIG. 6 is a view showing an example of a standby display screen displayed on the mobile terminal unit. FIG. 7 is a view showing an example of a monitoring information display screen displayed on the portable terminal unit, which has received notification of wake-up of a person to be monitored. FIG. 8 is a view showing an example of a monitoring information display screen displayed on the portable terminal unit which has received notification of the wake-up of the person to be monitored after receiving the notification of getting up. FIG. 9 is a view showing an example of a monitoring information display screen displayed on the mobile terminal unit in full screen display.

  In FIG. 5, when the portable terminal unit TA is powered on and activated, and receives a login operation by a supervisor (user) such as a nurse or a carer, for example, the TA monitoring processing unit 412 transmits a communication addressed to the own device. A standby screen for waiting for a signal is displayed on the TA display unit 46 (S11). For example, as shown in FIG. 6, the standby screen 51 has a menu bar area 511 for displaying a menu bar, a message (for example, “not notified”) indicating that the user is in standby, and a standby main area for displaying an icon. 512, a time area 513 for displaying the current time, a date and day area 514 for displaying the current day of the week, and a user name area 515 for displaying the name of the user logged in to the portable terminal unit TA. Equipped with

  Next, the portable terminal unit TA causes the TA control unit 411 to determine whether or not the communication signal has been received by the TA communication IF unit 43 (S12). As a result of this determination, when the communication signal is not received (No), the portable terminal unit TA returns the process to S11, and as a result of the determination, when the communication signal is received (Yes), The mobile terminal unit TA executes the following process S13.

  In this process S13, when the communication signal is received, the portable terminal unit TA causes the TA monitoring processor 412 to determine whether the received communication signal is a monitoring information communication signal. As a result of this determination, when the received communication signal is not the monitoring information communication signal (No), the portable terminal unit TA executes appropriate processing according to the received communication signal by the TA control processing unit 41. The display operation of the monitoring information is ended (S31). On the other hand, when the received communication signal is the monitoring information communication signal (Yes) as a result of the determination, the portable terminal unit TA is accommodated in the received monitoring information communication signal by the TA monitoring processing unit 412. Each piece of information is registered in the monitoring information table MT and stored in the monitoring information storage unit 423 (S14), and the process S15 is executed. Note that, when registering the respective information in the monitoring information table MT, the TA monitoring processing unit 412 registers a default flag “0” in the corresponding field 4236.

  In this process S15, if the received communication signal is a monitoring information communication signal, the portable terminal unit TA causes the determination result prediction unit 4122 to apply the received monitoring information communication signal to the predicted icon display monitor It is determined whether or not. More specifically, the determination result prediction unit 4122 determines that the detected ID contained in the received monitoring information communication signal should display the predicted icon in the predicted icon display monitored person storage unit 422. It is determined whether or not the received monitoring information communication signal affects the predicted icon display monitor depending on whether or not it is stored as the monitored person ID. As a result of this determination, the detected ID contained in the received monitoring information communication signal is stored in the predicted icon display monitored person storage unit 422 as the monitored person ID of the monitored person Ob who should display the predicted icon. If yes, the determination result prediction unit 4122 determines that the received monitoring information communication signal is for the predicted icon display monitor (Yes), predicts the next determination result, and obtains a predicted determination result ( S16), the process S17 is performed. On the other hand, as a result of the determination, the detected ID contained in the received monitoring information communication signal is the predicted icon display in the monitored person storage unit 422 as the monitored person ID of the monitored person Ob who should display the predicted icon. If not stored, the determination result prediction unit 4122 determines that the received monitoring information communication signal does not apply to the predicted icon display monitor (No), and executes processing S17.

  In processing S17, the portable terminal unit TA receives the monitoring information communication signal received by the display processing unit 4121 by the monitoring information communication signal containing the same detection ID as the detection ID contained in the received monitoring information communication signal. It is determined whether the monitoring information screen of the monitoring information communication signal which has already been received before (in the past) and has already been received is created for display. More specifically, the display processing unit 4121 registers the same detection ID as the detection ID contained in the received monitoring information communication signal in the detection field 4231 of the record in which the flag “0” is registered in the corresponding field 4236. It is determined whether or not the monitoring information screen of the already received and already received monitoring information communication signal is created for display, by determining whether or not it is. As a result of this determination, if the same detection ID as the detection ID contained in the received monitoring information communication signal is not registered in the detection field 4231 of the record for registering the flag “0” in the corresponding field 4236, the same detection It is determined that the monitoring information communication signal of the ID has not been received (No), and the portable terminal unit TA executes the process S18, and as a result of the determination, it is accommodated in the received monitoring information communication signal. If the same detection ID as the detection ID is registered in the detection field 4231 of the record for which the flag “0” is registered in the corresponding field 4236, it is determined that the monitoring information communication signal of the same detection ID has already been received (Yes And the mobile terminal unit TA executes the process S19.

  In this process S18, the portable terminal unit TA newly creates a monitoring information screen according to each information (each data) contained in the received monitoring information communication signal by the display processing unit 4121 and creates this The monitor information screen is displayed on the TA display unit 46.

  The monitoring information screen is a screen for displaying the monitoring information related to the monitoring of the monitored person Ob. For example, as shown in FIG. 7, the monitoring information screen 52 (52a) is a monitored area monitored by a menu bar area 511, a location where a detection unit SU of a detection ID is disposed, and the detection unit SU of the detection ID. Monitored person name area 521 displaying the name of the person Ob, an icon area 522 displaying the elapsed time from the determination time (or reception time) and the icon IC, and an image captured by the detection unit SU of the detection ID An image area 523a for displaying (here, a still image), a "corresponding" button 524, a "speak" button 525, and a "view LIVE" button 526. The “corresponding” button 524 indicates that the user of the mobile terminal unit TA has an intention to execute the response, such as nursing, for the monitored person Ob monitored by the detection unit SU of the detection ID. It is a button for inputting into the portable terminal unit TA an instruction to be input to the unit TA and to notify the fixed terminal unit SP and other portable terminal units TA that the intention has been input. The “speak” button 525 is a button for inputting an instruction to connect the detection unit SU of the detection ID and the mobile terminal unit TA in a callable manner via the network NW. The “view LIVE” button 526 is a button for inputting an instruction to display a moving image captured by the detection unit SU of the detection ID.

  In order to create the monitoring information screen 52a according to each information contained in the received monitoring information communication signal, the display processing unit 4121 corresponds to the detection ID contained in the received monitoring information communication signal. The location of the installation and the name of the person being monitored are searched from the detection unit information storage unit 424 using the detection ID as a search key, and the elapsed time from the determination time contained in the received monitoring information communication signal is obtained. An icon IC corresponding to the determination result contained in the monitoring information communication signal is searched from the icon storage unit 421 using the determination result as a search key. Then, the display processing unit 4121 displays a menu bar in the menu bar area 511, displays the searched location and the monitored person name in the monitored person name area 521, and the obtained elapsed time and the searched The icon IC is displayed in the icon area 522, the image (still image) contained in the received monitoring information communication signal is displayed in the image area 523a, and a "corresponding" button 524, a "speak" button 525, and The monitor information screen 52 a is created by displaying the “view LIVE” button 526. Here, when the monitoring information screen 52a is created, if the prediction determination result is obtained in step S16, the display processing unit 4121 stores the icon IC corresponding to the prediction determination result as the prediction icon. The prediction judgment result is searched from the unit 421 as a search key, and the searched prediction icons are also arranged in time series with the searched icon IC and displayed in the icon area 522. Then, the display processing unit 4121 displays the newly created monitoring information screen 52 a on the TA display unit 46. Here, when the monitoring information screen 52a is displayed on the TA display unit 46, when the prediction determination result is obtained in step S16, the display processing unit 4121 displays the icon IC and the prediction icon. The display is displayed differently on the TA display unit 46. For example, the icon IC is constantly displayed on the TA display unit 46 and the prediction icon is displayed on the TA display unit 46 in a blinking manner.

  In the process S19, the portable terminal unit TA causes the display processing unit 4121 to update the monitoring information screen according to each information (each data) contained in the received monitoring information communication signal, and the updated monitoring information screen is displayed. Displayed on the TA display unit 46.

  In order to update the monitoring information screen 52 in accordance with the respective information contained in the received monitoring information communication signal, the display processing unit 4121 determines the elapsed time from the determination time contained in the received monitoring information communication signal. The icon IC corresponding to the determination result contained in the received monitoring information communication signal is obtained from the icon storage unit 421 using the determination result as a search key. Then, the display processing unit 4121 displays the obtained elapsed time and the searched icon IC in the icon area 522 on the monitoring information screen 52 already displayed, and is accommodated in the received monitoring information communication signal. The monitoring information screen 52 is updated by displaying an existing image (still image) in the image area 523a. Here, since the icon IC is displayed in the icon area 522 in accordance with the determination result contained in the monitoring information communication signal that has already been received, the current searched icon IC is already displayed. The icons are arranged in chronological order with respect to the icons IC and displayed in the icon area 522. For example, when the determination result “rising” of the monitored person Ob is notified and then the determination result “disengaging bed” is notified, an icon IC representing the determination result “rising” of the monitored person Ob shown in FIG. 7 In the monitoring information screen 52a in which 1 is displayed in the icon area 522, as shown in FIG. 8, an icon IC-2 representing the determination result "bead up" of the person to be monitored Ob represents an icon IC representing the determination result "wake up". The monitoring information screen 52 b displayed in the icon area 522 is displayed next to the left side of the drawing with respect to −1. Here, when the monitoring information screen 52 is updated, if the prediction determination result is obtained in the process S16, the display processing unit 4121 displays the icon IC corresponding to the prediction determination result as in the process S18. The prediction judgment result is searched from the icon storage unit 421 as a search key using the icon as a prediction icon, and the searched prediction icons are also displayed in the icon area 522 in chronological order with respect to the searched icon IC. When a prediction icon is further displayed on the monitoring information screen 52b shown in FIG. 8, this prediction icon is displayed next to the left of the page with respect to the icon IC-2 representing the determination result "bedding off" of the monitored person Ob. become. Then, the display processing unit 4121 displays the updated monitoring information screen 52 b on the TA display unit 46. Here, when the monitoring information screen 52b is displayed on the TA display unit 46, when the prediction determination result is obtained in the process S16, the display processing unit 4121 displays the icon IC (shown in FIG. 8). In the example, the icons IC-1 and IC-2) and the display of the predicted icon are displayed differently on the TA display unit 46.

  After the process S18 or after the process S19, the portable terminal unit TA determines whether the TA control processing unit 41 accepts an input operation on the touch panel including the TA input unit 45 and the TA display unit 46. judge. As a result of this determination, if the input operation is not accepted (No), the portable terminal unit TA returns the process to the process S20, and as a result of the determination, if the input operation is accepted, the portable terminal The unit TA executes the following process S21.

  In the process S21, the mobile terminal unit TA causes the TA control processing unit 41 to execute an appropriate process according to the content of the input operation, and ends the display operation of the monitoring information.

  For example, when the portable terminal unit TA receives “tap” as the input operation on the touch panel including the TA input unit 45 and the TA display unit 46 by the TA control processing unit 41, the image of the image area 523a is displayed on the full screen The monitor information screen 52 c replaced with the area 523 b is displayed on the TA display unit 46. For example, as shown in FIG. 9, the monitoring information screen 52c includes a menu bar area 511, a monitored person name area 521, and an image (here, a still image) captured by the detection unit SU of the detection ID. And an image area 523b of the full screen display displayed on the entire area except the menu bar area 511 and the monitored person name area 521. With this full screen display, the monitor (user) can recognize the situation of the monitored person Ob in more detail.

  Further, for example, when the TA control processing unit 41 receives an input operation of the “corresponding” button 524, the portable terminal unit TA corresponds to the monitoring information of the monitored person Ob currently displayed on the TA display unit 46. In the record in which the detection ID is registered in the detection ID field 4231, the flag “1” is registered in the corresponding field 4236, and the supervisor (user) who has logged in to the mobile terminal unit TA The fixed terminal unit SP and the other portable terminal unit TA are informed that there is an intention to execute the above-mentioned measures such as nursing for the monitored person Ob displayed on the screen, and the subject displayed on the TA display unit 46 The monitoring information screen 52 of the observer Ob is deleted.

  Further, for example, when the portable terminal unit TA receives an input operation of the “speak” button 525 by the TA control processing unit 41, the portable terminal unit TA and the detection unit SU that monitors the monitored person Ob currently displayed on the TA display unit 46 Connect to make calls via the network NW.

  Also, for example, when the portable terminal unit TA receives an input operation of the “view LIVE” button 526 by the TA control processing unit 41, a detection unit that monitors the monitored person Ob currently displayed on the TA display unit 46. Connect with downloadable videos via SU and network NW. As a result, the moving image of the person to be monitored Ob is displayed in the image area 523a or in the image area 523b switched by the "tap".

  As described above, the monitored person monitoring system MS, the display device of the monitored person monitoring system MS (typically, the portable terminal unit TA in the above embodiment), and the displayed method of the monitored person monitoring system installed thereon Since not only the image of the person to be monitored Ob but also the icon IC symbolically representing the determination result is displayed, for example, the monitor (user) such as a nurse or a caregiver sees the icon IC to refer to the icon The IC can be used as an aid for understanding the image, and from the image, it is possible to grasp the state (condition) of the person to be monitored Ob more accurately and quickly. For example, in the case where the state of the monitored person Ob that can be grasped from the image matches the state of the monitored person Ob that can be grasped from the icon IC, it is more The state of the person to be monitored Ob can be grasped accurately and quickly. Also, for example, when the state of the monitored person Ob that can be grasped from the image does not match the state of the monitored person Ob that can be grasped from the icon IC, the object that can be grasped from the image from the determination result symbolically represented by the icon IC. It is possible to grasp the state of the person to be monitored Ob more accurately and more quickly from the image, as it is shifted to the state of the observer Ob. For example, when the image of the person to be monitored is a current image, the latest situation and its history can be grasped by referring to the current image and the icon.

  More specifically, for example, when the take-off icon IC-2 and the image of the person being monitored Ob being walked are displayed on the monitoring information screen 52, the person being monitored is when the person being monitored Ob leaves. It can be determined that you are walking. Further, for example, when the rising icon IC-1 and the image sitting on the end of the bed of the monitored person Ob are displayed on the monitoring information screen 52, the monitoring person determines that the monitored person Ob is about to leave the room. it can. Also, for example, when the wake-up icon IC-1 and the image sleeping on the bed of the monitored person Ob are displayed on the monitoring information screen 52, the monitoring person decides that the monitored person Ob once got up but slept again It can be judged. Also, for example, when the rising icon IC-1, the falling falling icon IC-3, and the image sitting on the bed of the monitored person Ob are displayed on the monitoring information screen 52, the monitored person Ob is the monitored person Ob. I got up and fell down, but I can judge that I returned to my bed. Further, for example, the monitoring information screen 52 displays the falling falling icon IC-3 and an image (still image at the determination time) in which the monitored person Ob is next to the bed, and the moving image displayed by the “LIVE” button 526 However, in the case where the monitored subject Ob is an image lying next to the bed, as in the case of the still image at the determination time, the monitor can determine that the monitored subject Ob does not fall and can not move.

  The monitoring information screen 52 of the monitored person monitoring system MS, the display device of the monitored person monitoring system MS (typically, the portable terminal unit TA in the above embodiment) and the displayed method of the monitored person monitoring system implemented therein Since the elapsed time from the determination time is displayed on the screen, if the image of the monitored person is the current image, the monitored time can be used by recognizing the difference between the current state of the monitored person and the icon. The accuracy of the judgment of the situation arose

  The monitored person monitoring system MS, the display device of the monitored person monitoring system MS (typically, the portable terminal unit TA in the above embodiment) and the displayed method of the monitored person monitoring system implemented in the icon IC Since a plurality are displayed in series, the monitor can recognize the history of the state (status) of the person to be monitored Ob by referring to the plurality of icons IC arranged in time series.

  The display system of the monitored person monitoring system MS, the monitored person monitoring system MS (typically, the portable terminal unit TA in the above embodiment) and the displayed method of the monitored person monitoring system implemented thereon Since the display is made, the observer can recognize the state likely to occur to the monitored person Ob.

  The monitored person monitoring system MS, the display device of the monitored person monitoring system MS (in the above embodiment, typically the portable terminal unit TA), and the display method of the monitored person monitoring system implemented thereon are predicted icon display targets Since the monitor storage unit 422 is provided and the display processing unit 4121 controls the display and non-display of the prediction icon according to the stored contents, the display of the prediction icon can be set only for the monitored person Ob who needs the prediction determination result. For example, it is possible to set the display of the prediction icon only to the watched watcher Ob who is likely to cause a predetermined inconvenient event such as an abnormal state (for example, a fall or the like).

  The monitored person monitoring system MS, the display device of the monitored person monitoring system MS (typically, the portable terminal unit TA in the above embodiment) and the displayed method of the monitored person surveillance system implemented therein Since the display and the display of the prediction icon are displayed in different displays, the observer can easily recognize whether the icon IC being displayed is the icon IC or the prediction icon from the display.

  In the above-described embodiment, in order to reduce the amount of information processing of the management server unit SV, the monitored person monitoring system MS is configured such that the detection unit SU determines the state (situation) of the monitored person Ob. However, the management server unit SV may be configured to receive the output of the body movement sensor and the output of the image sensor from the detection unit SU, for example, to determine the state (condition) of the monitored person Ob.

  Further, in the above-described embodiment, a still image or a substantially real-time moving image (real-time moving image) is displayed in the image areas 523a and 523b, but a recorded moving image recorded may be displayed. For example, when the status of the monitored person Ob is determined, the recorded moving image is a motion image of a predetermined time before and after the determination time including the determination time. Such recorded moving images make it possible to accurately grasp the situation, and can be useful for elucidating the cause and preventive measures.

  Although the present specification discloses various aspects of the technology as described above, the main technologies are summarized below.

  The display device of a person-to-be-monitored monitoring system according to one aspect detects an image of the person to be monitored and the person to be monitored in a person-to-be-monitored monitoring system that detects the person to be monitored and monitors the person to be monitored. The display device displays the determination result obtained by determining the state of (1), and displays an image representing the image of the person to be monitored and the determination result. Preferably, the display device of the monitored person monitoring system detects an image of the monitored person and the image of the monitored person in the monitored person monitoring system that detects the monitored person to be monitored and monitors the monitored person. It is a display which displays a judgment result which judged a state, and it matches with a monitoring information reception part which receives the above-mentioned picture of the person to be monitored, and the judgment result, a display part which performs display, and the judgment result. An icon storage unit storing an icon indicating a determination result, and an icon corresponding to the determination result of the monitored person accepted by the monitoring information accepting unit are acquired from the icon storage unit, and the acquired icon and the monitoring information acceptance And a display processing unit that displays the image of the monitored person accepted by the unit on the display unit. The icon is a symbolically expressing things with a relatively simple pattern or the like, and is configured of a picture, a symbol, a figure, or a combination of these.

  Such a display device displays not only the image of the person to be monitored but also an icon symbolically representing the determination result. For example, a monitor (user) such as a nurse or a caregiver should refer to the icon. Thus, the icon can be used as an aid for understanding the image, and the state (condition) of the person to be monitored can be grasped more accurately and quickly from the image. For example, when the state of the person to be monitored which can be grasped from the image matches the state of the person to be monitored which can be grasped from the icon, the judgment result represented by the icon symbolically more accurately from the image The status of the person being monitored can be grasped more quickly. Further, for example, in the case where the state of the person to be monitored which can be grasped from the image does not match the state of the person to be monitored which can be grasped from the icon, the person to be monitored can be grasped from the image It is possible to grasp the state of the person to be monitored more accurately and more quickly from the image, assuming that the state has been shifted to the state of. For example, when the image of the person to be monitored is a current image, the latest situation and its history can be grasped by referring to the current image and the icon.

  In another aspect, in the display device of the above-described monitored person monitoring system, the image of the monitored person is generated by a camera disposed immediately above the monitored person.

  It is effective to a display device of a monitored person monitoring system using such an image generated by a camera disposed immediately above the monitored person for determination.

  In another aspect, in the display device of the above-described monitored person monitoring system, the image of the monitored person is a still image or a moving image.

  According to this, it is possible to provide a display device of a monitored person monitoring system that displays a still image or a moving image.

  In another aspect, in the display device of the above-described monitored person monitoring system, the moving image is recorded recorded moving image or real time real time moving image.

  According to this, it is possible to provide the display device of the monitored person monitoring system that displays the recorded moving image or the real time moving image.

  In another aspect, in the display device of the above-described monitored person monitoring system, the image of the monitored person is an image used when the determination is performed.

  In the display device of such a person-to-be-monitored monitoring system, the situation at the time of determination can be grasped by referring to the image and the icon at the time of determination, and an event occurring in the person to be monitored can be determined quickly and accurately.

  In another aspect, in the display device of the above-described monitored person monitoring system, the display processing unit further displays an elapsed time from a determination time at which the determination is made on the display unit.

  According to this, it is possible to provide the display device of the monitored person monitoring system displaying the elapsed time from the determination time. In particular, when the image of the person to be monitored is the current image, the accuracy of the determination of the situation caused to the person to be monitored is improved by using it when recognizing the deviation between the current state of the person to be monitored and the icon. .

  In another aspect, in the display device of the above-described monitored person monitoring system, the display processing unit displays a plurality of the icons in time series. Preferably, in the display device of the above-described monitored person monitoring system, the monitoring information receiving unit receives a plurality of the images of the monitored person and the determination result at different times, and the icon storage units are different types. A plurality of icons representing the determination results are stored in association with the respective determination results, and the display processing unit stores a plurality of icons corresponding to the plurality of determination results of the monitored person accepted by the monitoring information accepting unit. The plurality of icons acquired from the icon storage unit are arranged in time series and displayed on the display unit, and one of the plurality of images of the monitored person accepted by the monitoring information acceptance unit is displayed Display in the department.

  Since such a display device displays a plurality of icons in chronological order, the observer can recognize the history of the state (condition) of the person being monitored by referring to the plurality of icons arranged in chronological order.

  In another aspect, in the display device of the above-described monitored person monitoring system, the display processing unit further displays a predicted icon representing a predicted judgment result obtained by predicting the judgment result of the monitored person which will occur in the future. Preferably, the display device of the above-described monitored person monitoring system further includes a determination result predicting unit that predicts the determination result of the monitored person to be generated in the future, and the display processing unit is received by the monitoring information receiving unit An icon corresponding to the determination result of the person to be monitored is obtained from the icon storage unit, and an icon corresponding to the prediction determination result predicted by the determination result prediction unit is obtained from the icon storage unit as the prediction icon, The acquired icon and prediction icon and the image of the person to be monitored accepted by the monitoring information accepting unit are displayed on the display unit. Preferably, in the display device of the monitored person monitoring system described above, the determination result predicting unit determines a transition destination corresponding to the history of the state (situation) of the monitored person up to now from the prepared state transition diagram. A search is made, and the transition destination searched for is taken as the prediction judgment result. Further preferably, in the display device of the above-described monitored person monitoring system, the determination result prediction unit creates the state transition diagram from a history of the monitored person's state in the past.

  Such a display device displays the prediction icon, so that the observer can recognize the state likely to occur to the person to be monitored.

  In another aspect, in the display device of the monitored person monitoring system described above, the display processing unit displays the prediction icon only for the monitored person set in advance. Preferably, the display device of the above-mentioned monitored person monitoring system further includes a predicted icon display monitored person storage unit for storing a monitored person identifier for specifying and identifying the monitored person on which the predicted icon is to be displayed. The display processing unit stores the image received by the monitoring information reception unit and the monitored person identifier of the monitored person corresponding to the determination result in the predicted icon display monitored person storage unit. And displaying the prediction icon on the display unit.

  Such display measures can set the display of the prediction icon only to the monitored person who needs the prediction judgment result. For example, it is possible to set the display of the prediction icon only for the watched person who needs attention, which is likely to cause a predetermined adverse event such as an abnormal state (for example, a fall or the like).

  In another aspect, in the display device of the above-described monitored person monitoring system, the display processing unit displays the icon and the prediction icon in different displays. Preferably, in the display device of the above-described monitored person monitoring system, the display processing unit displays the icon and the prediction icon differently on the display unit.

  Since such a display device displays the display of the icon and the display of the prediction icon in different displays, the observer can determine whether the displayed icon is the icon or the prediction icon from the display. You can easily recognize another.

  According to another aspect of the present invention, there is provided a display method of a monitored person monitoring system, an image of the monitored person and the monitored person in a monitored person monitoring system for detecting the monitored person to be monitored and monitoring the monitored person. It is a display method which displays the determination result which determined the state of the monitoring person, Comprising: The image showing the said to-be-monitored person and the icon showing the said determination result are displayed. Preferably, the display method of the monitored person monitoring system includes a monitoring information receiving step of receiving an image of the monitored person and a determination result of determining the state of the monitored person, and the monitored point received in the monitoring information receiving step. Acquisition step of acquiring an icon corresponding to the determination result of the person in association with the determination result and storing the icon representing the determination result from the icon storage unit in advance, the icon acquired in the acquisition step, and the monitoring information reception step And a display processing step of displaying the image of the person to be monitored accepted at the display unit on the display unit.

  The monitored person monitoring system according to another aspect is a monitored person monitoring system for detecting a monitored person to be monitored and monitoring the monitored person, wherein an image of the monitored person and the monitored person are monitored. The display device according to any one of the above-described embodiments is provided to display the determination result of determining the state of the person.

  Since the display method of such a monitored person monitoring system and the monitored person monitoring system display not only the image of the monitored person but also an icon symbolically representing the determination result, the observer refers to the icon By doing this, the icon can be used as an aid for understanding the image, and the state (condition) of the person to be monitored can be grasped more accurately and quickly from the image.

  This application is based on Japanese Patent Application No. 2015-65284 filed on March 26, 2015, the contents of which are included in the present application.

  While the present invention has been properly and sufficiently described above through the embodiments with reference to the drawings in order to express the present invention, those skilled in the art can easily change and / or improve the above embodiments. It should be recognized that it is possible. Therefore, unless a change or improvement implemented by a person skilled in the art is at a level that deviates from the scope of the claims set forth in the claims, the change or the improvement is the scope of the rights of the claim It is interpreted as being included in

According to the present invention, it is possible to provide a display device of the monitored person monitoring system, the display method, and the monitored person monitoring system.

Claims (25)

A display device in a monitored person monitoring system that detects a monitored person who is a monitoring target and monitors the monitored person,
The display device is a mobile terminal device,
The monitoring information reception section in the state of the image and the monitored person on the person being monitored receives a result of the determination at least Bikaradadokoto normal,
A display unit for displaying;
An icon corresponding to the determination result of determining the state of the monitored person, and a display processing unit for displaying the image of the monitored person received by the monitoring information reception unit on the display unit;
Display unit of the monitored person monitoring system. The monitoring information receiving unit receives a determination result of determining at least one of getting up, leaving, and falling as the state of the monitored person .
The display apparatus of the to-be-monitored person monitoring system of Claim 1 . The image of the person to be monitored is an image generated by a camera disposed above the person to be monitored,
The display apparatus of the to-be-monitored person monitoring system of Claim 1 or Claim 2 . The image of the person to be monitored is a still image when the determination is performed,
The display apparatus of the to-be-monitored person monitoring system of any one of Claim 1 thru | or 3. Has an input unit that accepts a predetermined operation ,
When the operation by the input unit is accepted, the recorded moving image or the real time real time moving image is displayed in place of the still image .
The display apparatus of the to-be-monitored person monitoring system of Claim 4 . Has an input unit that accepts a predetermined operation ,
When the operation by the input unit is received, the image of the person to be monitored is displayed enlarged .
The display apparatus of the to-be-monitored person monitoring system of any one of Claim 1 thru | or 4 . The display processing unit further displays, on the display unit, an elapsed time from a determination time at which the determination is made.
The display apparatus of the to-be-monitored person monitoring system of any one of Claim 1 thru | or 6 . The display processing unit displays a plurality of icons corresponding to the determination result as the monitoring notification in chronological order as a history of the monitoring notification .
The display apparatus of the to-be-monitored person monitoring system according to any one of claims 3 to 7 subordinate to claim 2 or claim 2 . It further comprises a judgment result prediction unit that predicts the judgment result of the state of the person to be monitored that will occur in the future,
The display processing unit further displays, as a prediction icon, an icon corresponding to a prediction determination result obtained by predicting the determination result of the state of the monitored person to be generated in the future by the determination result prediction unit.
The display apparatus of the to-be-monitored person monitoring system of any one of Claim 3 thru | or 8 subordinate to Claim 2 or Claim 2 . The display processing unit displays the prediction icon only for a preset monitored person.
The display apparatus of the to-be-monitored person monitoring system of Claim 9 . The display processing unit displays the icon and the prediction icon in different display forms.
The display apparatus of the to-be-monitored person monitoring system of Claim 9 or Claim 10 . It is a display method in a to-be-monitored person monitoring system which detects the to-be-monitored person who is a monitoring object and monitors the said to-be-monitored person,
The monitoring information receiving step of receiving a result of the determination at least Bikaradadokoto normal as the state of the image and the monitored person on the person being monitored,
An icon corresponding to the determination result of determining the state of the person to be monitored and a display processing step of displaying an image of the person to be monitored received in the monitoring information receiving step on a display unit of a portable terminal device;
How to display the monitored person monitoring system. A computer program for causing a portable terminal device to display monitoring information of the person to be monitored in a person to be monitored monitoring system that detects the person to be monitored and monitors the person to be monitored.
The monitoring information receiving step of receiving a result of the determination at least Bikaradadokoto normal as the state of the image and the monitored person on the person being monitored,
A display processing step of displaying an icon corresponding to the determination result of determining the state of the monitored person and the image of the monitored person accepted in the monitoring information accepting step on the display unit of the portable terminal device;
Computer program to be executed by the processor. A monitored person monitoring system for detecting a monitored person to be monitored and monitoring the monitored person, comprising:
An imaging unit configured to capture an image of an image of a person to be monitored;
Detection means for detecting the person to be monitored;
From an output of said detecting means, determining means for determining at least Bikaradadokoto normal as the state of the monitored person,
Management means for receiving the image of the person to be monitored from the imaging means and the determination result of determining the state of the person to be monitored from the determination means, and outputting the image and the determination result;
Monitoring information receiving means for receiving the image from the managing means and the determination result;
Display means for displaying the image of the person to be monitored and the determination result;
An icon corresponding to the determination result and a display processing means for displaying the image of the person to be monitored accepted by the monitoring information accepting means on the display means ;
The portable terminal device includes the monitoring information receiving unit, the display unit, and the display processing unit.
Monitored person monitoring system. Said sensing means including a body movement sensor for detecting body motion of the monitored person by transmitting and receiving microwaves,
The monitored person monitoring system according to claim 14 . The determination means determines at least one of rising, leaving and falling as the state of the person to be monitored .
The monitored person monitoring system according to claim 14 or 15 . The image of the person to be monitored is an image generated by a camera disposed above the person to be monitored,
The monitored person monitoring system according to any one of claims 14 to 16 . The image of the person to be monitored is a still image when the determination is performed,
The monitored person monitoring system according to any one of claims 14 to 17 . The portable terminal device has an input unit for receiving a predetermined operation ,
When the portable terminal device receives an operation by the input unit, the mobile terminal device displays the recorded moving image or real time real time moving image in place of the still image .
The monitored person monitoring system according to claim 18 . The portable terminal device has an input unit for receiving a predetermined operation ,
The portable terminal apparatus enlarges and displays an image of the person to be monitored upon receiving an operation by the input unit .
The monitored person monitoring system according to any one of claims 14 to 18 . The display processing means further displays an elapsed time from the determination time at which the determination is made on the display means.
The monitored person monitoring system according to any one of claims 14 to 20 . The display processing means displays a plurality of icons corresponding to the determination result as the monitoring notification in chronological order as the history of the monitoring notification .
22. The monitored person monitoring system according to claim 16, which is dependent on claim 16 or claim 16 . It further comprises judgment result prediction means for predicting the judgment result of the state of the person to be monitored that will occur in the future,
The display processing means further displays, as a prediction icon, an icon corresponding to a predicted judgment result obtained by predicting the judgment result of the state of the person to be monitored which will occur in the future by the judgment result prediction means.
The monitored person monitoring system according to any one of claims 16 to 22 , which is subordinate to claim 16 or claim 16 . The display processing means displays the prediction icon only for a preset monitored person.
The monitored person monitoring system according to claim 23 . The display processing means displays the icon and the prediction icon in different display forms.
The monitored person monitoring system according to claim 23 or 24 .

Images