JP2017151675A - Central processing device and central processing method of monitored person monitoring system, and the monitored person monitoring system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a central processing device, a central processing method and a monitored person monitoring system that can further improve operation efficiency.SOLUTION: A central processing device according to the present invention is the central processing device of a monitored person monitoring system provided with: a plurality of sensor devices provided in correspondence with each of a plurality of monitored persons and detecting the monitored persons; the central processing device managing each monitoring information about each monitored person based on each detection result received from each of the plurality of sensor devices; and a plurality of terminal devices receiving the monitoring information and displaying the received monitoring information. A management server device SV serving as one example of the central processing device is configured to store an association relation of the sensor device with the terminal device serving as a transmission destination to which the monitoring information of the monitored person based on the detection result received from the sensor device is transmitted, and when receiving the detection result from the sensor device, transmit the detection result of the reception to the terminal device corresponding to the sensor device on the basis of the stored association relation, in which the association relation is a relation that is associated with the plurality of sensor devices with respect to one terminal device.SELECTED DRAWING: Figure 3

Description

  The present invention relates to a central processing unit and a central processing method of a monitored person monitoring system for monitoring a monitored person to be monitored using a plurality of devices, and the monitored person monitoring system.

  Japan has become an aging society, and more specifically, the aging rate, which is the ratio of the population over 65 years old to the total population due to the improvement of living standards accompanying the post-war high economic growth, improvement of the hygienic environment and improvement of medical care standards. However, it has become a super-aging society that exceeds 21%. In 2005, the total population was about 126.5 million, while the elderly population over the age of 65 was about 25.56 million. In 2020, the total population was about 124.11 million. There is also a prediction that the elderly population will be about 34.56 million. In such an aging society, nurses who need nursing or nursing care due to illness, injury, elderly age, etc., or those who need nursing care (such as those who require nursing care) are those who need nursing in a normal society that is not an aging society. This is expected to increase more than Japan, for example, is a society with a declining birthrate with a total fertility rate of 1.43 in 2013. For this reason, elderly care has been taking place in which elderly nurses, etc., are cared for by an elderly family (spouse, child, brother).

  Nurses and the like enter a facility such as a hospital or a welfare facility for the elderly (such as a short-term welfare facility for the elderly, a nursing home for the elderly and a nursing home for the elderly in Japanese law) and receive nursing and care. In such a facility, a situation in which a nurse or the like needs to be injured or fallen out of the bed, for example, by falling from the bed or falling while walking can occur. It is necessary to respond to such a situation as quickly as possible. Moreover, if such a situation is left unattended, it may develop into a more serious situation. For this reason, in the facility, nurses and caregivers regularly check their safety and state by patrol.

  However, the increase in the number of nurses and the like cannot keep up with the increase in the number of nurses and the like, and the nursing industry and the care industry are chronically short of manpower. Furthermore, since the number of nurses, caregivers and the like is reduced in the semi-night shift and night shift hours compared to the day shift hours, the work load per person increases, and thus the work load is required to be reduced. In addition, the situation of nursing care for the elderly is not an exception in the facility, and it is often seen that elderly nurses and the like care for elderly nurses and the like. In general, physical strength declines when older, so the burden of nursing etc. becomes heavier than young nurses etc. even if they are healthy, and their movements and judgments are also delayed.

  In order to reduce the labor shortage and the burden on nurses and the like, there is a demand for technology that complements nursing work and care work. For this reason, in recent years, monitored person monitoring techniques for monitoring a monitored person to be monitored, such as a care recipient, have been researched and developed.

  As one of such techniques, there is a nurse call system disclosed in Patent Document 1, for example. The nurse call system disclosed in Patent Document 1 is a nurse call slave unit that is installed in a bed and a patient calls a nurse, and a nurse call slave unit that is installed in a nurse station and responds to a call by the nurse call slave unit. A nurse call system having a nurse call parent device, a camera for imaging a patient on a bed from above the bed, and a state in which the patient wakes up from a captured image of the camera and a state in which the patient is separated from the bed State judging means for judging the occurrence of at least one of them and outputting a caution state occurrence signal, and the nurse call master unit has a notifying means for performing a notification operation upon receiving the caution state occurrence signal. The nurse call system transmits a captured image of the camera to the portable terminal upon receiving the attention state generation signal and a portable terminal carried by a nurse to respond to a call from the nurse call slave. Communication control means.

  On the other hand, in terms of safety confirmation, a single person living alone is the same as the care recipient and the like and is a person to be monitored.

JP 2014-90913 A

  By the way, in the practice of nursing and nursing care, for example, during a meal or recreation, a supervisor such as a nurse usually has a plurality of monitored subjects such as nurses in a predetermined place (canteens and restaurants). In some cases, recreation rooms, etc.) are sequentially prepared for travel. In such a case, in the nurse call system disclosed in Patent Document 1, since the state of the monitored person can be visually recognized by the notification of the attention state occurrence signal and the video, each of the monitored persons is prepared for movement. Can also improve business efficiency. However, in the nurse call system disclosed in Patent Document 1, an attention state generation signal is notified to a portable terminal (an example of a terminal device) for any patient (an example of a person to be monitored) if an attention state occurs. The For this reason, in the above case, the supervisor also receives notification of a caution state occurrence signal to a monitored person other than his / her charge, and notification of a caution state occurrence signal to a monitored person who is spatially far from his / her position. Therefore, it is impossible to smoothly take the monitored person ready to move, and eventually it becomes difficult to improve the work efficiency. Of course, other monitor responds to notification of a caution state occurrence signal to a monitored person other than his / her charge, notification of a caution condition occurrence signal to a monitored person far from his / her position spatially, etc. .

  The present invention has been made in view of the above circumstances, and its purpose is to provide a central processing unit and a central processing method for a monitored person monitoring system that can further improve business efficiency, and the monitored person monitoring system. Is to provide.

  As a result of various studies, the present inventor has found that the above object is achieved by the present invention described below. That is, the central processing unit according to one aspect of the present invention is provided corresponding to each of a plurality of monitored persons to be monitored, and a plurality of sensor devices that detect the monitored person, A central processing unit that manages each monitoring information related to each person to be monitored based on each detection result received from each of the plurality of sensor devices that are communicably connected, and the monitoring information that is communicably connected to the central processing unit A central processing unit in a monitored person monitoring system for monitoring each of the plurality of monitored persons, the communication unit for performing communication, and the sensor device A transmission tip for storing a correspondence relationship with a terminal device that is a transmission destination for transmitting monitoring information related to the monitored person based on a detection result received from the sensor device When the detection result is received from the information storage unit and the sensor device, the received detection result to the terminal device corresponding to the sensor device based on the correspondence stored in the transmission destination terminal information storage unit And the correspondence relationship is a relationship in which a plurality of sensor devices are associated with one terminal device.

  In addition, a central processing method according to another aspect of the present invention is provided corresponding to each of a plurality of monitored persons to be monitored, a plurality of sensor devices that detect the monitored person, and the plurality of sensor apparatuses A central processing unit that manages each monitoring information related to each monitored person based on each detection result that is communicably connected to each of the plurality of sensor devices, and a central processing unit that is communicably connected to the central processing unit A central processing method in a monitored person monitoring system for monitoring each of the plurality of monitored persons, comprising a plurality of terminal devices for receiving and displaying monitoring information, the sensor apparatus and receiving from the sensor apparatus A storage step of storing a correspondence relationship with a terminal device that is a transmission destination that transmits monitoring information related to the monitored person based on the detected result in a transmission destination terminal information storage unit; When receiving a detection result from the sensor device, a monitoring process for transmitting the received detection result to a terminal device corresponding to the sensor device based on the correspondence relationship stored in the transmission destination terminal information storage unit The correspondence relationship is a relationship in which a plurality of sensor devices are associated with one terminal device. Preferably, in the above-described central processing unit and central processing method, the correspondence relationship is dynamically changed according to the location of the terminal device. Preferably, in the above-described central processing unit and central processing method, the correspondence relationship is dynamically changed according to the location of the terminal device, and then fixed for a predetermined time.

  In such a central processing unit and a central processing method, the sensor device and the terminal device that is the transmission destination of the detection result detected by the sensor device are associated in a many-to-one relationship. The monitoring person) can avoid the notification of the detection result to the monitored person except his / her charge. In addition, by setting the correspondence relationship so that a plurality of sensor devices arranged in a certain spatial range are associated with one terminal device, the monitor is spatially far from his position. Notification of the detection result to the monitored person can be avoided. Therefore, in the above-described central processing unit and central processing method, even if the detection result is notified, it is a detection result of the monitored person in charge of the person or the monitored person within a certain spatial range, so it can be handled smoothly. In the above-described case, it is possible to smoothly take a person who is ready to move, so that the central processing apparatus and the central processing method can further improve business efficiency.

  A monitored person monitoring system according to another aspect of the present invention is provided corresponding to each of a plurality of monitored persons to be monitored, a plurality of sensor devices that detect the monitored person, A central processing unit that manages each monitoring information related to each monitored person based on detection results received from each of the plurality of sensor devices that are communicably connected to each of the sensor devices, and is connected to be able to communicate with the central processing unit A plurality of terminal devices for receiving and displaying the monitoring information, and a monitored person monitoring system for monitoring each of the plurality of monitored persons, wherein the central processing unit is the central processing unit described above It is characterized by being.

  Since such a monitored person monitoring system includes the above-described central processing unit, it is possible to further improve business efficiency.

  The central processing unit and the central processing method of the monitored person monitoring system and the monitored person monitoring system according to the present invention can further improve business efficiency.

It is a figure which shows the structure of the to-be-monitored person monitoring system in embodiment. It is a figure which shows the structure of the sensor apparatus in the to-be-monitored person monitoring system of embodiment. It is a figure which shows the structure of the management server apparatus in the to-be-monitored person monitoring system of embodiment. It is a figure which shows the structure of the server side monitoring information table memorize | stored in the said management server apparatus shown in FIG. It is a figure which shows the structure of the information table between apparatuses memorize | stored in the said management server apparatus shown in FIG. It is a figure which shows the structure of the server side sensor information table memorize | stored in the said management server apparatus shown in FIG. It is a figure which shows the structure of the portable terminal device in the to-be-monitored person monitoring system of embodiment. It is a flowchart which shows operation | movement of the said sensor apparatus shown in FIG. It is a flowchart which shows operation | movement of the said management server apparatus shown in FIG. It is a flowchart which shows operation | movement of the said portable terminal device shown in FIG. It is a figure which shows an example of the standby screen displayed on the portable terminal device shown in FIG. It is a figure which shows an example of the monitoring information screen displayed on the portable terminal device shown in FIG. It is a figure which shows an example of the nurse call reception screen displayed on the portable terminal device shown in FIG.

  Hereinafter, an embodiment according to the present invention will be described with reference to the drawings. In addition, the structure which attached | subjected the same code | symbol in each figure shows that it is the same structure, The description is abbreviate | omitted suitably. In this specification, when referring generically, it shows with the reference symbol which abbreviate | omitted the suffix, and when referring to an individual structure, it shows with the reference symbol which attached the suffix.

  The monitored person monitoring system in the embodiment monitors a monitored person (watched person) Ob that is a monitored object (watched object) to be monitored (watched), and corresponds to each of a plurality of monitored persons Ob. A plurality of sensor devices that detect the monitored person Ob, and are connected to each of the plurality of sensor apparatuses so as to communicate with each of the plurality of sensor apparatuses. A central processing unit that manages monitoring information, and a plurality of terminal devices that are communicably connected to the central processing unit and receive and display the monitoring information. The central processing unit of such a monitored person monitoring system is a communication unit that performs communication, the sensor device, and a transmission destination that transmits monitoring information related to the monitored person based on a detection result received from the sensor device. A transmission destination terminal information storage unit for storing a correspondence relationship with a certain terminal device; and when receiving a detection result from the sensor device, the sensor based on the correspondence relationship stored in the transmission destination terminal information storage unit A monitoring processing unit that transmits the received detection result to a terminal device corresponding to the device, and the correspondence relationship is a relationship in which a plurality of sensor devices are associated with one terminal device. In addition, although the said terminal device may be one type of apparatus, in this embodiment, the said terminal device is two types of apparatuses, a fixed terminal device and a portable terminal device. The main difference between these fixed terminal devices and portable terminal devices is that the fixed terminal device is fixedly operated, while the portable terminal device is operated by being carried by a supervisor (user) such as a nurse or a caregiver. Since the fixed terminal device and the mobile terminal device are substantially the same, in the following embodiments, the mobile terminal device will be mainly described.

  FIG. 1 is a diagram illustrating a configuration of a monitored person monitoring system according to the embodiment. FIG. 2 is a diagram illustrating a configuration of a sensor device in the monitored person monitoring system according to the embodiment. FIG. 3 is a diagram illustrating a configuration of the management server device in the monitored person monitoring system according to the embodiment. 4 is a diagram showing a configuration of a server-side monitoring information table stored in the management server device shown in FIG. FIG. 5 is a diagram showing a configuration of an inter-device information table stored in the management server device shown in FIG. 5A shows the configuration of the notification destination correspondence information table in the inter-device information table, and FIG. 5B shows the configuration of the communication address correspondence information table in the inter-device information table. FIG. 6 is a diagram showing a configuration of a server-side sensor information table stored in the management server device shown in FIG. FIG. 7 is a diagram illustrating a configuration of the mobile terminal device in the monitored person monitoring system according to the embodiment.

  More specifically, the monitored person monitoring system MS in the embodiment includes, for example, as shown in FIG. 1, one or a plurality of sensor devices SU (SU-1 to SU-12, sensor devices SU-5 to SU-. 12 is not shown), the management server device SV, the fixed terminal device SP, one or more portable terminal devices TA (TA-1 to TA-3, portable terminal device TA-3 is not shown), and a private branch exchange (PBX, Private branch exchange) CX, and these are connected to be communicable via a network (network, communication line) NW such as a LAN (Local Area Network) such as a wired or wireless connection. The network NW may be provided with repeaters such as repeaters, bridges, and routers that relay communication signals. In the example shown in FIG. 1, the plurality of sensor devices SU-1 to SU-12, the management server device SV, the fixed terminal device SP, the plurality of portable terminal devices TA-1 to TA-3, and the private branch exchange CX are L2 switches. Are connected to each other by a wired / wireless LAN (for example, a LAN in accordance with the IEEE 802.11 standard) NW including the LS and the access point AP. More specifically, the plurality of sensor devices SU-1 to SU-12, the management server device SV, the fixed terminal device SP, and the private branch exchange CX are connected to the line concentrator LS, and the plurality of portable terminal devices TA-1 to TA-3. Is connected to the line concentrator LS via the access point AP. The network NW constitutes a so-called intranet by using Internet protocol groups such as TCP (Transmission control protocol) and IP (Internet protocol).

  The monitored person monitoring system MS is arranged at an appropriate place according to the monitored person Ob. The monitored person (person to be watched) Ob is, for example, a person who needs nursing due to illness or injury, a person who needs care due to a decrease in physical ability, a single person living alone, or the like. In particular, from the viewpoint of enabling early detection and early action, the monitored person Ob may be a person who needs the detection when a predetermined inconvenient event such as an abnormal state occurs in the person. preferable. For this reason, the monitored person monitoring system MS is suitably arranged in a building such as a hospital, a welfare facility for the elderly, and a dwelling unit according to the type of the monitored person Ob. In the example shown in FIG. 1, the monitored person monitoring system MS is disposed in a building of a care facility including a plurality of living rooms RM in which a plurality of monitored persons Ob live and a plurality of living rooms such as a nurse station.

  The sensor device SU includes a communication function that communicates with other devices SV, SP, TA via the network NW, and is a device that notifies the management server device SV of a predetermined event related to the monitored person Ob. is there. The predetermined event is preferably a predetermined event that needs to be dealt with. For example, in the present embodiment, the predetermined event is a predetermined action and a nurse call set in advance in the monitored person Ob. For this reason, in this embodiment, the sensor device SU detects a predetermined action in the monitored person Ob, notifies (transmits) the detection result to the management server device SV as an example of the predetermined event, and accepts a nurse call. The nurse call is notified (transmitted) to the management server device SV as another example of the predetermined event, a voice call is performed with the terminal devices SP and TA, and an image including a moving image is generated to generate a terminal. It is a device that distributes moving images to the devices SP and TA. For example, as shown in FIG. 2, such a sensor device SU includes an imaging unit 11, a sensor side sound input / output unit (SU sound input / output unit) 12, a nurse call reception operation unit 13, and a sensor side control process. Unit (SU control processing unit) 14, sensor side communication interface unit (SU communication IF unit) 15, and sensor side storage unit (SU storage unit) 16.

  The imaging unit 11 is an apparatus that is connected to the SU control processing unit 14 and generates an image (image data) under the control of the SU control processing unit 14. The image includes a still image (still image data) and a moving image (moving image data). The imaging unit 11 is arranged so as to be able to monitor a space (location space, in the example shown in FIG. 1, a room (room) RM) where the monitored person Ob to be monitored is planned to be located. Then, the location space is imaged from above, an image (image data) overlooking the imaging target is generated, and the image (target image) of the imaging target is output to the SU control processing unit 14. Preferably, since there is a high probability that the entire monitored person Ob to be monitored can be imaged, the imaging unit 11 is positioned when the head of the monitored person Ob is located in the bedding (for example, a bed) on which the monitored person Ob is lying. It arrange | positions so that a to-be-photographed object can be imaged from right above the preset head planned position (usually arrangement | positioning position of a pillow) set beforehand. The sensor device SU uses the imaging unit 11 to acquire an image of the monitored person Ob taken from above the monitored person Ob, preferably an image taken from directly above the planned head position.

  Such an imaging unit 11 may be a device that generates an image of visible light, but in the present embodiment, it is a device that generates an infrared image so that the monitored person Ob can be monitored even in a relatively dark place. . For example, in this embodiment, the imaging unit 11 has an imaging optical system that forms an infrared optical image of an imaging target on a predetermined imaging surface, and a light receiving surface that matches the imaging surface. An area image sensor that is arranged and converts an infrared optical image in the imaging target into an electrical signal, and data representing an infrared image in the imaging target by performing image processing on the output of the area image sensor It is a digital infrared camera including an image processing unit that generates image data. In the present embodiment, the imaging optical system of the imaging unit 11 is preferably a wide-angle optical system (so-called wide-angle lens (including a fisheye lens)) having an angle of view that can image the entire living room RM in which the imaging unit 11 is disposed. .

  The SU sound input / output unit 12 is a circuit that inputs and outputs sound. That is, the SU sound input / output unit 12 is a circuit that is connected to the SU control processing unit 14 and generates and outputs a sound corresponding to an electrical signal representing sound according to the control of the SU control processing unit 14. It is a circuit for acquiring the sound of and inputting into the sensor apparatus SU. The SU sound input / output unit 12 includes, for example, a speaker that converts a sound electrical signal (sound data) into a sound mechanical vibration signal (acoustic signal), and a microphone that converts a sound mechanical vibration signal in the audible region into an electrical signal. And so on. The SU sound input / output unit 12 outputs an electric signal representing an external sound to the SU control processing unit 14, and converts the electric signal input from the SU control processing unit 14 into a sound mechanical vibration signal and outputs the sound. .

  The nurse call reception operation unit 13 is connected to the SU control processing unit 14 and is a switch circuit such as a push button switch for inputting the nurse call to the sensor device SU. Note that the nurse call reception operation unit 13 may be connected to the SU control processing unit 14 by wire, or may be connected to the SU control processing unit 14 by short-range wireless communication such as Bluetooth (registered trademark) standard.

  The SU communication IF unit 15 is a communication circuit that is connected to the SU control processing unit 14 and performs communication according to the control of the SU control processing unit 14. The SU communication IF unit 15 generates a communication signal containing the data to be transferred input from the SU control processing unit 14 according to the communication protocol used in the network NW of the monitored person monitoring system MS, and the generated communication The signal is transmitted to other devices SV, SP, TA via the network NW. The SU communication IF unit 15 receives communication signals from other devices SV, SP, and TA via the network NW, extracts data from the received communication signals, and the SU control processing unit 14 can process the extracted data. The data is converted into data in a proper format and output to the SU control processing unit 14. The SU communication IF unit 15 includes, for example, a communication interface circuit that complies with the IEEE 802.11 standard or the like.

  The SU storage unit 16 is a circuit that is connected to the SU control processing unit 14 and stores various predetermined programs and various predetermined data under the control of the SU control processing unit 14. Examples of the various predetermined programs include a SU control program that controls each unit of the sensor device SU according to the function of each unit, and a SU monitoring processing program that executes predetermined information processing related to monitoring of the monitored person Ob. And the like. In the SU monitoring processing program, a predetermined action in the monitored person Ob is detected, and a detection result is notified to the predetermined terminal devices SP and TA via the management server device SV as an example of the predetermined event. When a nurse call is received by the action detection processing program or the nurse call reception operation unit 13, this is notified to the management server device SV as another example of the predetermined event, and the SU sound input / output unit 12 or the like is used. A nurse call processing program for making a voice call with the terminal devices SP and TA, a SU streaming processing program for streaming the moving image generated by the imaging unit 11 to the terminal devices SP and TA that requested the moving image, and the like. included. For each of the various predetermined data, each program such as a sensor device identifier (sensor ID) that is an identifier for identifying and identifying the sensor device SU of the own device and a communication address of the management server device SV is executed. Data necessary for doing this is included. The SU storage unit 16 includes, for example, a ROM (Read Only Memory) that is a nonvolatile storage element, an EEPROM (Electrically Erasable Programmable Read Only Memory) that is a rewritable nonvolatile storage element, and the like. The SU storage unit 16 includes a RAM (Random Access Memory) that serves as a working memory of the so-called SU control processing unit 14 that stores data generated during execution of the predetermined program.

  The SU control processing unit 14 controls each unit of the sensor device SU according to the function of each unit, and notifies the management server device SV of predetermined events (events) related to the monitored person Ob. It is a circuit for. More specifically, in the present embodiment, the SU control processing unit 14 detects a predetermined action in the monitored person Ob and notifies the management server device SV of the detection result as an example of the predetermined event (notification, The nurse call is received, the nurse call is notified (notified and transmitted) to the management server device SV as another example of the predetermined event, a voice call is performed between the terminal devices SP and TA, and a moving image is transmitted. Is generated and a moving image is distributed to the terminal devices SP and TA. The SU control processing unit 14 includes, for example, a CPU (Central Processing Unit) and its peripheral circuits. The SU control processing unit 14 executes a sensor processing unit (SU control unit) 141, a behavior detection processing unit 142, a nurse call processing unit 143, and a sensor side streaming processing unit (SU streaming processing) by executing the control processing program. Part) 144 is functionally provided.

  The SU control unit 141 controls each part of the sensor device SU according to the function of each part, and governs overall control of the sensor device SU.

  The behavior detection processing unit 142 detects a predetermined behavior set in advance in the monitored person Ob, and notifies the management server device SV of a detection result as an example of the predetermined event. More specifically, in the present embodiment, the predetermined action includes, for example, wake-up when the monitored person Ob occurred, leaving the monitored person Ob away from the bedding, falling down when the monitored person Ob fell from the bedding, And four actions of the fall where the monitored person Ob fell. Then, for example, the behavior detection processing unit 142 detects the head of the monitored person Ob based on the target image captured by the imaging unit 11, and detects the temporal change in the size of the detected head of the monitored person Ob. Based on this, the rising, leaving, falling and falling of the monitored person Ob are detected. More specifically, first, the first threshold Th1 for identifying the location area of the bedding BD, the size of the head of the lying posture and the size of the head of the sitting posture in the location area of the bedding BD, the location area of the bedding BD The second threshold Th2 for identifying whether or not the head is in the standing posture in the living room RM except for the size of the head, and the size of the head in the lying position in the living room RM excluding the area where the bedding BD is located The third threshold value Th3 for identifying whether or not the value is stored in advance in the SU storage unit 16 as one of the various predetermined data. Then, the behavior detection processing unit 142 extracts a moving body region from the target image by using, for example, the background subtraction method or the frame subtraction method, and extracts, for example, a circular or elliptical Hough from the extracted moving body region. The head region of the monitored person Ob is extracted by conversion, for example, by pattern matching using a model of a head prepared in advance, or by, for example, a neural network learned for head detection, and the extracted head Detect waking up, getting out of bed, falling and falling from the position and size of. For example, the behavior detection processing unit determines that the position of the extracted head is within the region where the bedding BD is located, and the size of the extracted head is determined from the size of the lying posture by using the first threshold Th1. When the time changes to the size of the sitting posture, it is determined that the user is getting up and the rising is detected. For example, the behavior detection processing unit 142 is a case where the position of the extracted head changes over time from the location of the bedding BD to the outside of the location of the bedding, and the size of the extracted head is the second size. When the time Th is changed from a certain size to the size of the standing posture by using the threshold Th2, it is determined that the user has left the bed and the bed is detected. For example, the behavior detection processing unit 142 is a case where the position of the extracted head changes over time from the location where the bedding BD is located to the outside of the location where the bedding BD is located, and the size of the extracted head is the first size. When the time changes from a certain size to the size of the recumbent posture by using the three threshold Th3, it is determined that the vehicle has fallen, and the fall is detected. For example, the behavior detection processing unit 142 uses the third threshold value Th3 when the extracted head position is in the room RM excluding the location area of the bedding BD and the extracted head size is the third threshold Th3. When the time changes from the size to the size of the recumbent posture, it is determined that the vehicle has fallen, and the fall is detected.

  When the predetermined behavior is detected in this way, the behavior detection processing unit 142 notifies the event containing event information (event information) representing the content of the predetermined event (phenomenon) related to the monitored person Ob. The first event notification communication signal is notified to the management server device SV by the SU communication IF unit 15. More specifically, the behavior detection processing unit 142 is a communication signal (first event notification communication signal) containing a sensor ID of the own device, event information indicating the content of the event, and a target image used for detection of the predetermined behavior. ) Is transmitted to the management server device SV via the SU communication IF unit 15. In the present embodiment, the event information is one or more of getting up, getting out of bed, falling, falling, and nurse call (NC). Here, the behavior detection processing unit 142 detects the rising, leaving, falling, and One or more of the falls are accommodated in the first event notification communication signal as the event information. The image may be at least one of a still image and a moving image. In the present embodiment, as described later, first, a still image is notified, and the moving image is distributed in response to a user request. First, a moving image may be distributed, a still image and a moving image may be transmitted, and the still image and the moving image may be displayed on the terminal devices SP and TA by screen division.

  The nurse call processing unit 143 notifies the management server device SV of a first event notification communication signal accommodated as another example of the predetermined event when the nurse call reception operation unit 13 receives a nurse call. A voice call is performed with the terminal devices SP and TA by using the SU sound input / output unit 12 or the like. More specifically, when the nurse call reception operation unit 13 is input and operated, the nurse call processing unit 143 transmits the first event notification communication signal containing the nurse call as the sensor ID of the own device and the event information as the SU communication. The data is transmitted to the management server device SV via the IF unit 15. The nurse call processing unit 143 uses the SU sound input / output unit 12 and the like to perform a voice call with the terminal devices SP and TA, for example, by VoIP (Voice over Internet Protocol).

  When there is a video distribution request from the fixed terminal device SP or the portable terminal device TA via the communication IF unit 3, the SU streaming processing unit 144 sends the request to the fixed terminal device SP or the portable terminal device TA that has made the request. The moving image generated by the imaging unit 11 (for example, a live moving image) is distributed via the SU communication IF unit 15 by streaming reproduction.

  FIG. 1 shows, as an example, four first to fourth sensor devices SU-1 to SU-4 among the first to twelfth sensor devices SU-1 to SU-12. The device SU-1 is disposed in a room RM-1 (not shown) of Mr. A Ob-1, who is one of the monitored persons Ob, and the second sensor device SU-2 is one of the monitored persons Ob. The third sensor device SU-3 is arranged in the room RM-2 (not shown) of Mr. B Ob-2, and the room RM-3 (not shown) of Mr. C Ob-3 who is one of the monitored persons Ob. The fourth sensor device SU-4 is disposed in a room RM-4 (not shown) of Mr. D Ob-4, one of the monitored persons Ob. Note that the number of sensor devices SU is not limited to 12 and is arbitrary.

  The management server device SV has a communication function for communicating with other devices SU, TA, SP via the network NW. When the notification of the predetermined event is received from the sensor device SU, the management server device SV has information on monitoring of the monitored person Ob ( Monitoring information (in this embodiment, for example, the predetermined event (the type of the predetermined action detected by the sensor device SU or the nurse call received by the sensor device SU), the image (still image and moving image) of the monitored person Ob, and The time when the notification is received, etc.), the predetermined event is notified (re-notification, re-notification, transmission) to the predetermined terminal device SP, TA, and the client (the terminal device SP, TA, etc. in this embodiment) ) To the client, and manages the entire monitored person monitoring system MS. In this embodiment, a predetermined number of sensor devices SU among the plurality of sensor devices SU are associated with one terminal device SP, TA, and the management server device SV The predetermined event notified from the sensor device SU is transmitted to the one terminal device SP, TA associated therewith. For example, as shown in FIG. 3, the management server device SV includes a server-side communication interface unit (SV communication IF unit) 21, a server-side control processing unit (SV control processing unit) 22, and a server-side storage unit. (SV storage unit) 23.

  Similar to the SU communication IF unit 15, the SV communication IF unit 21 is a communication circuit that is connected to the SV control processing unit 22 and performs communication according to the control of the SV control processing unit 22. The SV communication IF unit 21 includes, for example, a communication interface circuit that complies with the IEEE 802.11 standard or the like.

  The SV storage unit 23 is a circuit that is connected to the SV control processing unit 22 and stores various predetermined programs and various predetermined data under the control of the SV control processing unit 22. Examples of the various predetermined programs include an SV control program for controlling each part of the management server device SV according to the function of each part, and an SV monitoring process for executing predetermined information processing related to monitoring of the monitored person Ob. A control processing program such as a program is included. The various predetermined data include a server identifier (server ID) for identifying the management server device SV and identifying the management server device SV, the monitoring information of the monitored person Ob, and the predetermined data. Data necessary for executing each program such as inter-device information indicating information between the devices SU, SP, and TA such as an event notification destination and sensor information related to the sensor device SU is included. In order to store the monitoring information, the inter-device information, and the sensor information, the SV storage unit 23 includes a server-side monitoring information storage unit (SV monitoring information storage unit) 231, an inter-device information storage unit 232, and a server-side sensor information storage. Unit (SV sensor information storage unit) 233 is functionally provided.

  The SV monitoring information storage unit 231 stores monitoring information of the monitored person Ob transmitted / received to / from each of the devices SU, SP, TA. More specifically, in the SV monitoring information storage unit 231, in this embodiment, as the monitoring information, information stored in communication signals such as a first event notification communication signal and a later-described correspondence reception notification communication signal is stored. Based on this, sensor ID, event information (event information, in this embodiment, getting up, getting out of the floor, falling, falling and nurse call), reception time, target image (still image and moving image), and presence / absence of countermeasure are stored in association with each other. The

  In the present embodiment, this monitoring information is stored in the SV monitoring information storage unit 321 in a table format. The server-side monitoring information table (SV monitoring information table) MT-SV for registering the monitoring information includes, for example, sensor IDs contained in communication signals received from the devices SU, SP, and TA as shown in FIG. A sensor ID field 2311 to be registered, an event field (event field) 2312 for registering event information accommodated in the received communication signal, a reception time field 2313 for registering a reception time of the received communication signal, and the reception A still image field 2314 for registering the still image accommodated in the received communication signal, and a communication address (for example, an IP address) of the sensor device SU corresponding to the sensor ID accommodated in the received communication signal as a live video acquisition source Etc.) and the received video signal 2315 and the received communication signal. A corresponding field 2316 for registering the presence or absence of the corresponding reception to the event information comprises a record for each communication signal thus received (for each event). In the still image field 2314, for example, still image data may be registered, and for example, a file name of still image data may be registered. In the response field 2316, as will be described later, the terminal devices SP and TA accept that the event information contained in the received communication signal is willing to respond (corresponding, treating, or taking measures) (“corresponding”). A flag (corresponding flag) indicating whether or not has been registered. For example, in the present embodiment, the correspondence field 2316 indicates that there is an intention (“corresponding”) to deal with event information (event information registered in the event field 2312) contained in the received communication signal. The terminal device SP or TA indicates that the corresponding flag “1” means that it has been received by the devices SP and TA, or the intention to deal with the event information contained in the received communication signal (“corresponding”). Corresponding flag “0” meaning that it is not accepted is registered. Note that by default, the correspondence field 2316 registers a correspondence flag “0” meaning “not accepted”. When the first event notification communication signal contains the detection time when the predetermined action is detected or the nurse call reception time when the nurse call is received, the detection time or the nurse is used instead of the reception time. The call reception time may be registered.

  In this embodiment, the inter-device information storage unit 232 indicates a notification destination (re-notification destination, re-notification destination, transmission destination) such as a first event notification communication signal transmitted from the sensor device SU as the inter-device information. , The correspondence between the sensor ID that is the transmission source and the terminal ID that is the notification destination (re-notification destination), the ID of each device SU, SP, TA (sensor ID, terminal ID) and its A correspondence relationship (communication address correspondence relationship) and the like with a communication address are stored. The terminal ID is a terminal identifier for identifying the terminal devices SP and TA and identifying the terminal devices SP and TA.

  In the present embodiment, the notification destination correspondence relationship and the communication address correspondence relationship are respectively stored in the inter-device information storage unit 232 in a table format. The notification destination correspondence information table AT for registering the notification destination correspondence relationship includes, for example, a transmission source field 2321 for registering the sensor ID of the transmission source sensor device SU and a transmission source field, as shown in FIG. A transmission destination terminal device SP that transmits a communication signal notified from the sensor device SU corresponding to the sensor ID registered in the sensor ID 2321, and a notification destination field 2322 that registers the terminal ID of the TA, and a sensor ID (sensor device SU ) Each with a record. The communication address correspondence relationship information table DT for registering the communication address correspondence relationship includes, for example, as shown in FIG. 5B, a terminal ID field 2323 for registering terminal IDs of the terminal devices SP and TA, and a terminal ID field 2323. And a communication address field 2324 for registering the communication address of the terminal device SP and TA corresponding to the terminal ID registered in the terminal ID, and a record for each terminal ID (terminal device SP, TA).

  Note that each of the sensor ID, server ID, and terminal ID may be, for example, a serial number composed of a predetermined symbol string, or may be a communication address (in this case, communication address correspondence can be omitted).

  In this embodiment, the notification destination correspondence relationship is a relationship in which a plurality of sensor devices SU are associated with one terminal device SP, TA. In the example shown in FIG. 5A, the first portable terminal device TA-1 is associated with four first to fourth sensor devices SU-1 to SU-4, and is transmitted in the first record. In the original field 2321, SU-1 to SU-4 are registered as those sensor IDs, and in the notification destination field 2322, TA-1 is registered as the terminal ID. The second portable terminal device TA-2 is associated with four fifth, sixth, ninth and tenth sensor devices SU-5, SU-6, SU-9, SU-10. In the second record, SU-5, SU-6, SU-9, and SU-10 are registered in the transmission source field 2321 as their sensor IDs, and TA-2 as their terminal IDs in the notification destination field 2322. Is registered. In addition, four seventh, eighth, eleventh, and twelfth sensor devices SU-7, SU-8, SU-10, and SU-12 are associated with the third mobile terminal device TA-3 (not shown). In the third record, SU-7, SU-8, SU-10, SU-12 are registered as the sensor IDs in the transmission source field 2321, and the terminal IDs are registered in the notification destination field 2322. TA-3 is registered.

  Although not shown in the drawings, the first to fourth sensor devices SU-1 to SU-4 are disposed in the first to fourth rooms RM-1 to RM-4 on the first floor, respectively. The 12 sensor devices SU-5 to SU-12 are respectively disposed in the fifth to twelfth living rooms RM-5 to RM-12 on the second floor. The first and second living rooms RM-1 and RM-2 are adjacent to each other, the third and fourth living rooms RM-3 and RM-4 are adjacent to each other, and the first living room RM-1 is a corridor. The second living room RM-2 faces the fourth living room RM-4 across the hallway, with the (passage) sandwiched therebetween. These fifth to eighth living rooms RM-5 to RM-8 are arranged in a line in this order, and the ninth to twelfth living rooms RM-9 to RM-12 are arranged in a line in this order, and arranged in these lines. The fifth to eighth living rooms RM-5 to RM-8 face the ninth to twelfth living rooms RM-9 to RM-12 arranged in a row with the corridor (passage) in between. For this reason, the notification destination correspondence shown in FIG. 5 (A) is that the first mobile terminal device TA-1 is spatially relatively close (spatially close) on the first floor. The user (monitor) who is associated with the plurality of first to fourth sensor devices SU-1 to SU-4 arranged in the first and second mobile terminals TA-1 will be described later. When an event notification is received, or when it is determined that care or assistance is necessary by visually recognizing the monitored person Ob in a live video, it is possible to rush quickly. For this reason, care and assistance can be performed in parallel with respect to a plurality of monitored persons Ob in charge of his / her own mind with a margin. Similarly, one second portable terminal device TA-2 has a plurality of fifth, sixth, ninth and tenth sensor devices arranged in a predetermined range relatively spatially on the second floor. It is associated with SU-5, SU-6, SU-9, and SU-10, and the supervisor who handles the second portable terminal device TA-2 receives a notification of an event or uses a live video. When it is determined that care or assistance is necessary by visually checking the monitored person Ob, it is possible to rush quickly. For this reason, care and assistance can be performed in parallel with respect to a plurality of monitored persons Ob in charge of his / her own mind with a margin.

  The SV sensor information storage unit 233 stores the sensor information. In the present embodiment, the sensor information is information related to the sensor device SU, and is information in which the sensor ID of the sensor device SU and the monitored person name of the monitored person Ob are associated with each other.

  In this embodiment, such sensor information is stored in the SV sensor information storage unit 233 in a table format. More specifically, the sensor information table ST-SV for registering sensor information includes, for example, a sensor ID field 2331 for registering a sensor ID and sensors registered in the sensor ID field 2331 as shown in FIG. An installation location field 2332 for registering an installation location of the sensor device SU having the ID, and a monitored person Ob (ie, the sensor) monitored by the sensor device SU having the sensor ID registered in the sensor ID field 2331 The monitored person name field 2333 for registering the monitored person name of the monitored person Ob) at the location of the sensor device SU having the sensor ID registered in the ID field 2331 and the sensor ID field 2331 are registered. Sensor device SU having the same sensor ID, its location and its monitored person And a remarks field 2334 for registering the remarks relating b, with a record for each sensor ID (i.e., sensor devices SU).

  The SV control processing unit 22 controls each unit of the management server device SV according to the function of each unit, and receives monitoring notification about the monitored person Ob when receiving the notification of the predetermined event from the sensor device SU. Then, the predetermined event is notified (re-notification, re-notification, transmission) to the predetermined terminal device SP and TA, data corresponding to the client's request is provided to the client, and the entire monitored person monitoring system MS is managed. It is a circuit for doing. The SV control processing unit 22 includes, for example, a CPU and its peripheral circuits. The SV control processing unit 22 functionally includes a server side control unit (SV control unit) 221 and a server side monitoring processing unit (SV monitoring processing unit) 222 by executing the control processing program.

  The SV control unit 221 controls each part of the management server apparatus SV according to the function of each part, and governs overall control of the management server apparatus SV.

  When the SV monitoring processing unit 222 receives the notification of the predetermined event from the sensor device SU, the SV monitoring processing unit 222 manages monitoring information related to monitoring of the monitored person Ob, and notifies the predetermined terminal device SP, TA of the predetermined event. is there. More specifically, when the SV monitoring processing unit 222 receives the first event notification communication signal from the sensor device SU, the SV monitoring processing unit 222 performs monitoring related to monitoring of the monitored person Ob contained in the received first event notification communication signal. Information is stored (recorded) in the SV monitoring information storage unit 231. Then, the SV monitoring processing unit 222 stores in the inter-device information storage unit 232 the report destination (rereport destination, transfer destination, transmission destination) corresponding to the sensor device SU that has transmitted the received first event notification communication signal. The second event notification communication signal is transmitted to the selected terminal devices SP and TA. This selection (search process) is performed based on the sensor ID corresponding to the sensor device SU that has transmitted the received first event notification communication signal. In the second event notification communication signal, if the event information accommodated in the first event notification communication signal is the predetermined action (one or more of getting up, getting out of bed, falling and falling), The communication address corresponding to the sensor device SU having the sensor ID accommodated in the first event notification communication signal is accommodated as the download destination of the sensor ID, the event information and the target image, and the moving image accommodated in the one event notification communication signal. Is done. This communication address is selected (searched) from the communication address correspondence relationship based on the sensor ID corresponding to the sensor device SU that has transmitted the received first event notification communication signal.

  The management server device SV is connected to the SV control processing unit 22 as necessary, as shown by a broken line in FIG. 3, for example, a server side input unit (SV input unit) for inputting various commands, various data, and the like. 24) Server side output unit (SV output unit) 25 that outputs various commands and various data input by the SV input unit 24 and monitoring information related to monitoring of the monitored person Ob, and data between external devices A server-side interface unit (SVIF unit) 26 or the like for performing input / output may be provided.

  Such a management server device SV can be configured by, for example, a computer with a communication function.

  The fixed terminal device SP includes a communication function for communicating with other devices SU, SV, TA via the network NW, a display function for displaying predetermined information, an input function for inputting predetermined instructions and data, and the like. The user interface (UI) of the monitored person monitoring system MS is input by inputting predetermined instructions and data to be given to the management server device SV and the portable terminal device TA, or displaying the monitoring information obtained by the sensor device SU. ). Such a fixed terminal device SP can be configured by, for example, a computer with a communication function. The fixed terminal device SP as an example of the terminal device operates in the same manner as the mobile terminal device TA. However, in this specification, a mobile terminal device TA that is another example of the terminal device will be described.

  The mobile terminal device TA has a communication function for communicating with other devices SV, SP, SU via the network NW, a display function for displaying predetermined information, an input function for inputting predetermined instructions and data, and a voice call. Including a call function to perform, inputting a predetermined instruction or data to be given to the management server device SV or the sensor device SU, displaying the monitoring information obtained by the sensor device SU by a notification from the management server device SV, This is a device for making a nurse call response or calling a voice call with the sensor device SU. In the present embodiment, for example, as shown in FIG. 7, such a mobile terminal device TA includes a terminal-side communication interface unit (TA communication IF unit) 31, a terminal-side control processing unit (TA control processing unit) 32, and A terminal side storage unit (TA storage unit) 33, a terminal side sound input / output unit (TA sound input / output unit) 34, a terminal side input unit (TA input unit) 35, and a terminal side display unit (TA display unit). 36 and a terminal-side interface unit (TAIF unit) 37.

  Similar to the SU sound input / output unit 12, the TA sound input / output unit 34 is connected to the TA control processing unit 32, and is a circuit for acquiring external sound and inputting it to the portable terminal device TA. It is a circuit for generating and outputting a sound corresponding to an electrical signal representing a sound according to the control of the processing unit 32.

  The TA input unit 35 is connected to the TA control processing unit 32 and is, for example, a circuit that accepts a predetermined operation and inputs it to the mobile terminal device TA, for example, a plurality of input switches assigned with a predetermined function. . The predetermined operation relates to, for example, an ID input operation for logging in, a voice call request operation and its end operation, a live video request operation and its end operation, and the notified event. Various operations necessary for monitoring, such as an input operation indicating that there is an intention (“corresponding”) to respond to the monitored person Ob, for example, lifesaving, nursing, nursing care, assistance, etc. included. The TA display unit 36 is connected to the TA control processing unit 32, and under the control of the TA control processing unit 32, the predetermined operation content input from the TA input unit 35 and the monitored target MS monitored by the monitored person monitoring system MS. The monitoring information related to the monitoring of the observer Ob (for example, the predetermined event (the type of the predetermined action detected by the sensor device SU or the nurse call received by the sensor device SU), the image (still image and moving image) of the monitored person Ob , And the time when the notification is received), and the like, for example, display devices such as an LCD (Liquid Crystal Display) and an organic EL display. In the present embodiment, the TA input unit 35 and the TA display unit 36 constitute a touch panel. In this case, the TA input unit 35 is a position input device that detects and inputs an operation position such as a resistance film method or a capacitance method. In this touch panel, a position input device is provided on the display surface of the TA display unit 36, and one or more input content candidates that can be input are displayed on the TA display unit 36. For example, a user such as a nurse or a caregiver ( When the monitor) touches the display position where the input content to be input is displayed, the position is detected by the position input device, and the display content displayed at the detected position is input to the portable terminal device TA as the operation input content of the user. Entered.

  The TAIF unit 37 is a circuit that is connected to the TA control processing unit 32 and inputs / outputs data to / from an external device under the control of the TA control processing unit 32. For example, the TAIF unit 37 uses the Bluetooth (registered trademark) standard. An interface circuit, an interface circuit that performs infrared communication such as the IrDA standard, and an interface circuit that uses the USB standard.

  Similar to the SU communication IF unit 15, the TA communication IF unit 31 is a communication circuit that is connected to the TA control processing unit 32 and performs communication according to the control of the TA control processing unit 32. The TA communication IF unit 31 includes, for example, a communication interface circuit that conforms to the IEEE 802.11 standard or the like.

  The TA storage unit 33 is a circuit that is connected to the TA control processing unit 32 and stores various predetermined programs and various predetermined data under the control of the TA control processing unit 32. Examples of the various predetermined programs include a TA control program for controlling each part of the mobile terminal device TA according to the function of each part, and a TA monitoring process for executing predetermined information processing related to monitoring of the monitored person Ob. A program, a call processing program for making a voice call with the sensor device SU by using the TA sound input / output unit 34, and the like. A control processing program such as a TA streaming processing program displayed on the TA display unit 36 is included. In the various predetermined data, it is necessary to execute each program such as the terminal ID of the own device, the screen information displayed on the TA display unit 36, the monitoring information of the monitored person Ob, and the sensor information related to the sensor device SU. Data. The TA storage unit 33 includes, for example, a ROM and an EEPROM. The TA storage unit 33 includes a RAM serving as a working memory for the so-called TA control processing unit 32 that stores data generated during execution of the predetermined program. In order to store each of the monitoring information and the sensor information, the TA storage unit 33 functions as a terminal side monitoring information storage unit (TA monitoring information storage unit) 331 and a terminal side sensor information storage unit (TA sensor information storage unit) 332. Be prepared.

  The TA monitoring information storage unit 331 stores the monitoring information. In the present embodiment, the TA monitoring information storage unit 331 includes, as the monitoring information, sensor ID and event information (event information, wake-up in this embodiment, received in the second event notification communication signal received from the management server device SV. The communication address of the sensor device SU to which images and moving images are downloaded, the reception time of the second event notification communication signal, the presence or absence of countermeasures, and the like are stored in association with each other. More specifically, as shown in FIG. 4, the TA monitoring information storage unit 331 stores the monitoring information in a terminal side monitoring information table (TA monitoring information table) MT-TA similar to the SV monitoring information table MT-SV. Remember.

  The TA sensor information storage unit 332 stores the sensor information. The TA sensor information storage unit 332 stores the sensor ID, the location, the monitored person name, and the remarks in association with each other. More specifically, as shown in FIG. 6, the TA sensor information storage unit 332 stores the sensor information in a terminal side sensor information table (TA sensor information table) ST-TA similar to the SV sensor information table ST-SV. Remember.

  The TA control processing unit 32 is a circuit for controlling each unit of the mobile terminal device TA according to the function of each unit, receiving and displaying the monitoring information of the monitored person Ob, and answering or calling a nurse call. It is. The TA control processing unit 32 includes, for example, a CPU and its peripheral circuits. The TA control processing unit 32 executes a terminal processing unit (TA control unit) 321, a terminal side monitoring processing unit (TA monitoring processing unit) 322, a call processing unit 323, and a terminal side streaming process by executing a control processing program. Unit (TA streaming processing unit) 324 functionally.

  The TA control unit 321 controls each part of the mobile terminal apparatus TA according to the function of each part, and controls the entire mobile terminal apparatus TA.

  The TA monitoring processing unit 322 executes predetermined information processing related to monitoring of the monitored person Ob. More specifically, when the TA monitoring processor 322 receives the second event notification communication signal transmitted by the management server device SV due to the first event notification communication signal transmitted by the sensor device SU. The monitoring information of the monitored person Ob is stored (recorded) in the TA monitoring information storage unit 331 based on each information (each data) accommodated in the received second event notification communication signal. The TA monitoring processing unit 322 displays a screen corresponding to each piece of information contained in the received second event notification communication signal on the TA display unit 36. Then, when receiving a predetermined input operation from the TA input unit 35, the TA monitoring processing unit 322 executes a predetermined process corresponding to the input operation.

  The call processing unit 323 performs a voice call with the sensor device SU by using the TA sound input / output unit 34 and the like. More specifically, for example, the call processing unit 323 transmits the first event notification communication signal that causes the transmission of the second event notification communication signal to the management server device SV using the TA sound input / output unit 34 or the like. For example, VoIP is performed with the transmission source sensor device SU.

  The TA streaming processing unit 324 receives distribution of the moving image from the sensor device SU, and displays the distributed moving image on the TA display unit 36 by streaming reproduction.

  Such a portable terminal device TA can be configured by a portable communication terminal device such as a so-called tablet computer, a smartphone, or a mobile phone.

  Next, the operation of this embodiment will be described. FIG. 8 is a flowchart showing the operation of the sensor device shown in FIG. FIG. 9 is a flowchart showing the operation of the management server apparatus shown in FIG. FIG. 10 is a flowchart showing the operation of the mobile terminal device shown in FIG. FIG. 11 is a diagram showing an example of a standby screen displayed on the mobile terminal device shown in FIG. FIG. 12 is a diagram illustrating an example of a monitoring information screen displayed on the mobile terminal device illustrated in FIG. 7. FIG. 13 is a diagram showing an example of a nurse call reception screen displayed on the mobile terminal device shown in FIG.

  In the monitored person monitoring system MS having the above-described configuration, each device SU, SV, SP, TA performs initialization of each necessary unit and starts its operation when the power is turned on. In the sensor device SU, by executing the control processing program, the SU control processing unit 14 is functionally configured with a SU control unit 141, a behavior detection processing unit 142, a nurse call processing unit 143, and a SU streaming processing unit 144. . In the management server device SV, an SV control processing unit 211 and an SV monitoring processing unit 222 are functionally configured in the SV control processing unit 21 by executing the control processing program. In the portable terminal device TA, the TA control processing unit 32 is functionally configured with a TA control unit 321, a TA monitoring processing unit 322, a call processing unit 323, and a TA streaming processing unit 324 by executing the control processing program. Is done.

  First, the operation of the sensor device SU will be described. The sensor device SU operates in the following manner for each frame or every several frames, thereby detecting a predetermined operation in the monitored person Ob and determining whether or not a nurse call is accepted. Yes.

  In FIG. 8, first, the sensor device SU acquires an image (image data) for one frame from the imaging unit 11 as the target image by the SU control unit 141 of the SU control processing unit 14 (S11).

  Next, the sensor device SU executes a behavior detection process for detecting a predetermined behavior in the monitored person Ob by the behavior detection processing unit 142 of the SU control processing unit 14 based on the target image acquired in the processing S11 ( S12). More specifically, the behavior detection processing unit 142 determines the success or failure of getting up, the success or failure of leaving the bed, the success or failure of the fall, and the success or failure of the fall.

  Next, the sensor device SU determines whether or not a predetermined behavior in the monitored person Ob is detected by the behavior detection processing unit 142 in the behavior detection processing S12. As a result of the determination, when the predetermined action is not detected (No), the sensor device SU next executes the process S15, while when the predetermined action is detected (Yes). The sensor device SU executes the next process S14 and then executes the process S15.

  In this process S14, in order to notify the predetermined actions detected in the processes S12 and S13 to the predetermined terminal apparatuses SP and TA via the management server apparatus SV, the sensor apparatus SU uses the action detection processing unit 142 to A first event notification communication signal relating to detection of the predetermined action is transmitted to the management server device SV as a predetermined event. More specifically, the behavior detection processing unit 142 stores the sensor ID of the own device, the predetermined event (here, one or more of getting up, getting out of bed, falling and falling) and the target image. An event notification communication signal is transmitted to the management server device SV via the SU communication IF unit 15.

  In the process S15, the sensor device SU determines whether the nurse call is accepted by the nurse call processing unit 143. That is, the processes S11 to S16 shown in FIG. 8 are repeatedly executed for each frame or every several frames. It is determined whether or not the call reception operation unit 13 has been operated. As a result of this determination, when the nurse call reception operation unit 13 is not operated and the nurse call is not received (No), the sensor device SU ends the current process, while the nurse call reception operation unit 13 Is operated and the nurse call is accepted (Yes), the sensor device SU ends the current process after executing the next process S16.

  In this process S16, in order to notify the nurse call that has been accepted in process S15 to the predetermined terminal devices SP and TA via the management server SV, the sensor device SU uses the nurse call processing unit 143 to make a nurse call. The 1st event notification communication signal regarding is transmitted to management server apparatus SV. More specifically, the nurse call processing unit 143 transmits a first event notification communication signal containing the sensor ID of the own device and nurse call reception information to the management server device SV via the SU communication IF unit 15.

  The sensor device SU operates as described above with respect to detection of a predetermined action and reception of a nurse call in the monitored person Ob.

  Next, the operation of the management server device SV will be described. On the other hand, in FIG. 9, the management server device SV determines whether or not the SV communication IF unit 21 has received a communication signal by the SV control unit 221 of the SV control processing unit 22 (S21). As a result of the determination, if the communication signal is not received (No), the management server device SV returns the process to S21. If the result of the determination is that the communication signal is received (Yes), The management server device SV executes the following process S22. That is, the management server device SV is waiting for reception of a communication signal.

  In the process S22, the management server apparatus SV determines the type of the received communication signal by the SV control unit 221. As a result of this determination, when the received communication signal is the first event notification communication signal (first event notification), the management server device SV executes the process S26 after executing the process S23, and When the received communication signal is not the first event notification communication signal (others), the process S26 is executed after the process S25 is executed.

  In the process S23, the management server apparatus SV processes the first event notification communication signal received from the sensor apparatus SU in the process S21 by the SV monitor processing section 222 of the SV control processing section 22. More specifically, first, the SV monitoring processing unit 222 stores monitoring information regarding monitoring of the monitored person Ob contained in the first event notification communication signal received from the sensor device SU in step S21. 231 is stored (recorded). Then, the SV monitoring processing unit 222 selects a notification destination corresponding to the sensor device SU that has transmitted the first event notification communication signal received in step S21 from the notification destination correspondence stored in the inter-device information storage unit 232 ( Search for. Next, the SV monitoring processing unit 222 transmits a second event notification communication signal to the selected notification destination terminal devices SP and TA. In the second event notification communication signal, as described above, when the event information contained in the first event notification communication signal received in the process S21 is the predetermined action, the second event notification communication signal is received in the process S21. A communication address corresponding to the sensor device SU having the sensor ID accommodated in the first event notification communication signal as a download destination of the sensor ID, the event information and the target image, and the moving image accommodated in the first event notification communication signal. Be contained. On the other hand, when the event information accommodated in the first event notification communication signal received in the process S21 is a nurse call, the sensor ID and event information accommodated in the first event notification communication signal received in the process S21. Is housed.

  In the process S25, the management server apparatus SV performs an appropriate process according to the communication signal received in the process S21 by the SV control processing unit 22.

  Then, in the process S26 executed after each of these processes S23 to S25, the management server apparatus SV determines whether or not its operation is ended (stopped) by the SV control processing unit 22. As a result of this determination, when the operation is finished (stopped) (Yes), the management server device SV finishes this process. On the other hand, when the operation is not finished (stopped) (No), the management server device SV The server device SV returns the process to step S21.

  Regarding the first event notification communication signal received from the sensor device SU, the management server device SV operates as described above.

  Next, operations of the terminal devices SP and TA will be described. Here, as an example, the operation of the mobile terminal device TA will be described. As described above, when the power is turned on and the operation starts, the portable terminal device TA accepts a login operation by a monitor (user) such as a nurse or a caregiver, and the TA monitor processing unit 322 automatically performs the login operation. A standby screen for waiting for a communication signal addressed to the machine is displayed on the TA display unit 36. For example, as shown in FIG. 11, the standby screen 51 includes a menu bar area 511 for displaying a menu bar, and a standby main area for displaying a message indicating that the user is waiting (for example, “no notification”) and an icon. 512, a time area 513 for displaying the current time, a year / month / sunday area 514 for displaying the current year / month / sunday, and a user name area 515 for displaying the name of the user who is currently logged in to the portable terminal device TA. Is provided.

  In FIG. 10, the portable terminal device TA determines whether or not the TA communication IF unit 31 has received a communication signal by the TA control unit 321 of the TA control processing unit 32 (S31). As a result of this determination, when the communication signal is not received (No), the mobile terminal device TA returns the process to S31, and as a result of the determination, when the communication signal is received (Yes) The portable terminal device TA executes the following process S32. That is, the mobile terminal device TA is waiting for reception of a communication signal.

  In the process S32, the portable terminal device TA determines the type of the received communication signal by the TA control unit 321. As a result of this determination, when the communication signal received in the process S31 is the second event notification communication signal (second event notification), the portable terminal device TA executes the next process S33, and in the process S31. When the received communication signal is not the second event notification communication signal (others), the process ends after executing the process S37 for performing an appropriate process according to the communication signal received in the process S31.

  In the process S33, the mobile terminal device TA monitors the monitored person Ob contained in the second event notification communication signal received from the management server apparatus SV in the process S31 by the TA monitoring processing unit 322 of the TA control processing unit 32. Is stored (recorded) in the TA monitoring information storage unit 331.

  Following this processing S33, the TA monitoring processing unit 322 displays a screen corresponding to each piece of information contained in the second event notification communication signal received in processing S31 on the TA display unit 36 (S34). S35 is executed. More specifically, when the event information accommodated in the second event notification communication signal received in step S31 is the predetermined action, the TA monitoring processing unit 322, for example, the monitoring information screen illustrated in FIG. 52 is displayed on the TA display unit 36. On the other hand, when the event information accommodated in the second event notification communication signal received in the process S31 is the nurse call, for example, a nurse call reception screen 53 shown in FIG. Is displayed on the TA display unit 36.

  The monitoring information screen 52 is a screen for displaying the monitoring information related to monitoring of the monitored person Ob. For example, as shown in FIG. 12, the monitoring information screen 52 includes a menu bar area 511, an arrangement location of the sensor device SU having a sensor ID accommodated in the second event notification communication signal received in the process S <b> 31, and the The monitored person name area 521 for displaying the name of the monitored person Ob monitored by the sensor device SU having the sensor ID, and the reception time of the second event notification communication signal received in the process S31 (or the predetermined action) A detection information display area 522 for displaying the elapsed time from the detection time) and the event information (the detection result of the predetermined action) contained in the second event notification communication signal received in the process S31; An image accommodated in the received second event notification communication signal (that is, a pair captured by the sensor device SU having the sensor ID). Image) (here includes an image area 523 for displaying a still image), "corresponding" button 524, a "talk" button 525, a "See LIVE" button 526.

  In order to display the location of the sensor device SU and the name of the monitored person Ob in the monitored person name area 521, the sensor ID contained in the second event notification communication signal received in step S31 is used as a search key. The location of the device SU and the name of the monitored person Ob are retrieved from the TA sensor information storage unit 332 and displayed. In the detection information display area 522, the detection results (in this embodiment, the names of getting up, getting out of bed, falling down, and falling down) contained in the second event notification communication signal received in step S31 may be displayed as they are. However, in this embodiment, it is displayed with an icon that symbolically represents the detection result. In order to display with this icon, the TA storage unit 33 stores each action and an icon representative of the action in association with each other in advance. In the example shown in FIG. 12, the detection information display area 522 displays a wake-up icon that symbolizes wake-up. In the monitoring information screen 52, the “corresponding” button 524 has an intention to perform a predetermined response (response, response) such as lifesaving, nursing, care, and assistance for the detection result displayed on the monitoring information screen 52. It is a button for inputting execution intention information indicating that the user of the mobile terminal device TA is present to the mobile terminal device TA. The “speak” button 525 is a button for requesting a voice call, and is used to input an instruction to connect the sensor device SU of the sensor ID and the mobile terminal device TA via the network NW. It is a button. The “LIVE” button 526 is a button for requesting a live video, and is a button for inputting an instruction to display a video captured by the sensor device SU of the sensor ID.

  The nurse call reception screen 53 is a screen for displaying reception of a nurse call. For example, as shown in FIG. 13, the nurse call reception screen 53 includes a menu bar area 511, a monitored person name area 521, a detection information display area 522, and a message (for example, “ A nurse call reception notification display area 531 for displaying “It is a nurse call”), a “corresponding” button 524, and a “speak” button 525. In the nurse call reception screen 53, the detection information display area 522 displays only the elapsed time from the reception time of the second event notification communication signal received in step S31 (or the reception time of reception of the nurse call). .

  The nurse call reception screen 53 may further include a “view LIVE” button 526.

  In the process S35, the portable terminal device TA determines whether or not an input operation is accepted by the TA control processing unit 32 using a touch panel including the TA input unit 35 and the TA display unit 36 (S35). If the input operation is not accepted as a result of this determination (No), the portable terminal device TA returns the process to step S35. On the other hand, if the input operation is accepted as a result of the determination, the portable terminal device TA returns The apparatus TA performs the following process S36.

  In this process S36, the portable terminal apparatus TA performs an appropriate process according to the content of the input operation by the TA control processing unit 32, and ends this process.

  For example, when the portable terminal device TA receives an input operation of the “corresponding” button 524 from the TA input unit 35 constituting the touch panel by the TA control processing unit 32 (that is, when the corresponding intention is received), first, The monitoring information of the monitored person Ob currently displayed on the TA display unit 36 is added to the effect that “corresponding” has been received and stored in the TA monitoring information storage unit 331. More specifically, the TA control processing unit 32 monitors the monitored person Ob currently displayed on the TA display unit 36 in the TA monitoring information table MT-TA stored in the TA monitoring information storage unit 331. Correspondence flag “1” indicating correspondence acceptance in the correspondence field 3316 of the record in which information is registered (here, the record in which the monitoring information contained in the second event notification communication signal received in the processing S31 is registered). Register. The TA control processing unit 32 accommodates the sensor ID corresponding to the monitoring information of the monitored person Ob displayed on the TA display unit 36 and information indicating that “corresponding” has been received (corresponding reception information). A communication signal (correspondence reception notification communication signal) is transmitted to the management server device SV. The management server device SV that has received this correspondence reception notification communication signal uses the SV control processing unit 22 to transmit a communication signal containing the sensor ID and the correspondence reception information contained in the received correspondence reception notification communication signal (corresponding reception well-known communication). Signal) to the terminal devices SP and TA by broadcast communication. As a result, regarding the sensor ID corresponding to the monitoring information of the monitored person Ob displayed on the TA display unit 36, the fact that “corresponding” has been received is synchronized between the terminal devices SP and TA.

  Further, for example, when the mobile terminal device TA receives an input operation of the “speak” button 525 by the TA control processing unit 32, the call processing unit 323 monitors the monitored person Ob displayed on the TA display unit 36. A communication signal (call request communication signal) containing information such as requesting a voice call is transmitted to the sensor device SU, and the sensor device SU is connected to the sensor device SU via the network NW so as to be able to make a voice call. As a result, a voice call can be made between the mobile terminal device TA and the sensor device SU. When the TA control processing unit 32 receives an input operation of an “end” button (not shown) that is a button for inputting an instruction to end a voice call, the portable terminal device TA causes the TA processing unit 323 to A communication signal (call end communication signal) containing information such as a request to end the voice call is transmitted to the sensor device SU that monitors the monitored person Ob displayed on the display unit 36. Thereby, the voice call between the mobile terminal device TA and the sensor device SU is terminated.

  Further, for example, when the mobile terminal device TA receives an input operation of the “watch live” button 526 by the TA control processing unit 32, the TA streaming processing unit 324 displays the monitored object currently displayed on the TA display unit 36. A communication signal (video distribution request communication signal) containing information such as requesting live video distribution is transmitted to the sensor device SU that monitors the person Ob, and the sensor device SU and the network NW corresponding thereto are transmitted. The video is connected to be downloadable via the sensor device SU, receives live video distribution from the sensor device SU, and displays the distributed video on the TA display unit 36 by streaming playback. On the monitoring information screen 52 that displays the live video, the video is displayed in the image area 523, and a “live end” button (not shown) is displayed instead of the “view live” button 526. As a result, live video is displayed on the mobile terminal device TA. The “live end” button (not shown) is a button for requesting the end of the moving image, and ends (stops) the distribution of the moving image picked up by the sensor device SU of the sensor ID and ends (stops) the display. This is a button for inputting an instruction to be performed. When the TA control processing unit 32 receives an input operation of the “live end” button, the portable terminal device TA monitors the monitored person Ob currently displayed on the TA display unit 36 by the TA streaming processing unit 324. A communication signal (moving image distribution end communication signal) containing information such as requesting the end of moving image distribution is transmitted to the sensor device SU, and a still image is displayed on the TA display unit 36. Accordingly, the mobile terminal device TA ends the live video display.

  Regarding the second event notification communication signal received from the management server device SV, the mobile terminal device TA operates as described above.

  As described above, in the monitored person monitoring system MS, the management server device SV as an example of the central processing unit, and the central processing method implemented in the management server device SV in the present embodiment, detection is performed by the sensor device SU and the sensor device SU. Since the terminal devices SP and TA that are the transmission destinations of the detected results are associated in a many-to-one relationship, the user (monitorer) who handles the terminal devices SP and TA is the monitored person Ob other than his / her responsibility. Notification of detection results for can be avoided. In addition, by setting the correspondence relationship so that a plurality of sensor devices SU spatially arranged within a certain range are associated with one terminal device SP, TA, the supervisor can spatially The notification of the detection result to the monitored person Ob far from the position can be avoided. Therefore, in the monitored person monitoring system MS, the management server device SV, and the central processing method, even if the detection result is notified, the monitored person Ob in charge of the person or the monitored person Ob within a certain spatial range. Therefore, it can be taken smoothly from the monitored person Ob ready to move in the above-described case. Therefore, the monitored person monitoring system MS, The management server device SV and the central processing method can improve the business efficiency.

  In the above-described embodiment, the correspondence relationship may be dynamically changed according to the location of the mobile terminal device TA. In such a case, preferably, the correspondence relationship is dynamically changed according to the location of the mobile terminal device TA, and then fixed for a predetermined time. For example, the location of the mobile terminal device TA can be detected by specifying an access point communicating with the mobile terminal device TA from among a plurality of access points. For this reason, by associating one access point with a plurality of sensor devices SU arranged within a certain range from the access point in advance, the correspondence relationship is established at the location of the mobile terminal device TA. Can be changed dynamically. More specifically, the management server device SV identifies an access point communicating with the mobile terminal device TA from among a plurality of access points, and a plurality of sensor devices SU associated with the identified access point. Is associated with the mobile terminal device TA as a correspondence relationship with the current location of the mobile terminal device TA.

  In order to express the present invention, the present invention has been properly and fully described through the embodiments with reference to the drawings. However, those skilled in the art can easily change and / or improve the above-described embodiments. It should be recognized that this is possible. Therefore, unless the modifications or improvements implemented by those skilled in the art are at a level that departs from the scope of the claims recited in the claims, the modifications or improvements are not covered by the claims. To be construed as inclusive.

MS Monitored Person Monitoring System SU, SU-1 to SU-4 Sensor Device SV Management Server Device SP Fixed Terminal Device TA, TA-1, TA-2 Mobile Terminal Device FT-SV, FT-TA Monitoring Function Operation Status Information Table 11 Imaging unit 12 Sensor side sound input / output unit (SU sound input / output unit)
13 Nurse call reception operation part 14 Sensor side control processing part (SU control processing part)
15 Sensor side communication interface part (SU communication IF part)
16 Sensor side storage unit (SU storage unit)
21 Server side communication interface part (SV communication IF part)
22 Server-side control processing unit (SV control processing unit)
23 Server side storage unit (SV storage unit)
31 Terminal side communication interface part (TA communication IF part)
32 Terminal-side control processing unit (TA control processing unit)
33 Terminal side storage unit (TA storage unit)
34 Terminal sound input / output unit (TA sound input / output unit)
35 Terminal side input section (TA input section)
36 Terminal side display section (TA display section)
37 Terminal side interface section (TAIF section)
141 Sensor side control unit (SU control unit)
142 Action Detection Processing Unit 143 Nurse Call Processing Unit 144 Sensor-side Streaming Processing Unit (SU Streaming Processing Unit)
221 Server-side control unit (SV control unit)
222 Server-side monitoring processing unit (SV monitoring processing unit)
231 Server-side monitoring information storage unit (SV monitoring information storage unit)
232 Inter-device information storage unit 233 Server-side sensor information storage unit (SV sensor information storage unit)
321 Terminal side control unit (TA control unit)
322 Terminal side monitoring processing unit (TA monitoring processing unit)
323 Call processing unit 324 Terminal side streaming processing unit (TA streaming processing unit)
331 Terminal side monitoring information storage unit (TA monitoring information storage unit)
333 Terminal side sensor information storage unit (TA sensor information storage unit)

Claims (3)

A plurality of sensor devices provided corresponding to each of a plurality of monitored persons to be monitored and connected to each of the plurality of sensor devices to detect the monitored person, and received from each of the plurality of sensor devices. A central processing unit that manages each monitoring information related to each monitored person based on each detection result, and a plurality of terminal devices that are connected to the central processing unit so as to be communicable and receive and display the monitoring information, The central processing unit in a monitored person monitoring system for monitoring each of a plurality of monitored persons,
A communication unit for communication;
A transmission destination terminal information storage unit that stores a correspondence relationship between the sensor device and a terminal device that is a transmission destination that transmits monitoring information related to the monitored person based on the detection result received from the sensor device;
When receiving a detection result from the sensor device, a monitoring process for transmitting the received detection result to a terminal device corresponding to the sensor device based on the correspondence relationship stored in the transmission destination terminal information storage unit With
The correspondence processing is a relationship in which a plurality of sensor devices are associated with one terminal device. A plurality of sensor devices provided corresponding to each of a plurality of monitored persons to be monitored and connected to each of the plurality of sensor devices to detect the monitored person, and received from each of the plurality of sensor devices. A central processing unit that manages each monitoring information related to each monitored person based on each detection result, and a plurality of terminal devices that are connected to the central processing unit so as to be communicable and receive and display the monitoring information, A central processing method in a monitored person monitoring system for monitoring each of a plurality of monitored persons,
A storage step of storing a correspondence relationship between the sensor device and a terminal device that is a transmission destination that transmits monitoring information related to the monitored person based on a detection result received from the sensor device in a transmission destination terminal information storage unit;
When receiving a detection result from the sensor device, a monitoring process for transmitting the received detection result to a terminal device corresponding to the sensor device based on the correspondence relationship stored in the transmission destination terminal information storage unit A process,
The central processing method, wherein the correspondence relationship is a relationship in which a plurality of sensor devices are associated with one terminal device. A plurality of sensor devices provided corresponding to each of a plurality of monitored persons to be monitored and connected to each of the plurality of sensor devices to detect the monitored person, and received from each of the plurality of sensor devices. A central processing unit that manages each monitoring information related to each monitored person based on each detection result, and a plurality of terminal devices that are connected to the central processing unit so as to be communicable and receive and display the monitoring information, A monitored person monitoring system for monitoring each of a plurality of monitored persons,
The monitored person monitoring system, wherein the central processing unit is the central processing unit according to claim 1.

Images