JP6740633B2 - Central processing unit and central processing method of monitored person monitoring system, and monitored person monitoring system - Google Patents

Description

The present invention relates to a central processing unit and a central processing method of a monitored person monitoring system for monitoring a monitored person to be monitored using a plurality of devices, and the monitored person monitoring system.

Japan is experiencing an aging society due to the improvement of living standards, the improvement of hygiene environment and the improvement of medical care levels following the post-war high economic growth, and more specifically, the aging rate, which is the ratio of the population aged 65 and over to the total population. Is over 21% in a super-aging society. In 2005, the total population was 127.65 million, but the number of elderly people aged 65 and over was 255.6 million, whereas in 2020, the total population was 124.11 million. It is predicted that the elderly population will be about 3,456,000. In such an aging society, those requiring nursing care or those requiring nursing care (nurses requiring care, etc.) due to illness, injury or aging, etc. It is expected to increase more than the above. Japan is also a declining birthrate society with a total fertility rate of 1.43 in 2013, for example. For this reason, elderly care is also occurring in which an elderly family member (spouse, child, brother) takes care of an elderly nurse.

Nursing-needed persons enter a facility such as a hospital or a welfare facility for the aged (short-term nursing home for the elderly, nursing home for the elderly and special nursing home for the elderly according to Japanese law) and receive nursing and care. In such a facility, a situation may occur in which a nurse or the like suffers an injury due to a fall from a bed, a fall during walking, or the like, gets out of the bed, and wanders around. It is necessary to respond to such a situation as soon as possible. Moreover, if such a situation is left untreated, it may develop into a more serious situation. For this reason, nurses, caregivers, and the like regularly check the safety and condition of the facilities at the facilities.

However, the increase in the number of nurses and the like cannot keep up with the increase in the number of nurses and the like, and there is a chronic labor shortage in the nursing industry and the nursing care industry. Further, the number of nurses, caregivers and the like decreases in the semi-night shift and night shift hours compared to the day shift hours, and the work load per person increases. Therefore, it is required to reduce the work load. In addition, the situation of old-age care is no exception in the above-mentioned facilities, and elderly nurses and the like often take care of elderly care recipients and the like. In general, physical strength deteriorates as a person ages, so even if they are healthy, the burden of nursing, etc. becomes heavier than that of young nurses, and their movements and judgments become slow.

In order to reduce the labor shortage and the burden on nurses and the like, there is a demand for technology that complements nursing work and nursing care work. Therefore, in recent years, a monitored person monitoring technique for monitoring (monitoring) a monitored person, which is a monitoring target such as a nurse requiring monitoring, has been researched and developed.

As one of such techniques, there is a nurse call system disclosed in Patent Document 1, for example. The nurse call system disclosed in Patent Document 1 is installed in a bed to allow a patient to call a nurse, and a nurse call device installed in a nurse station to answer a call by the nurse call device. A nurse call system having a nurse call base unit, which is a camera for imaging a patient on a bed from above the bed, and a state in which the patient is upright and a state in which the patient is separated from the bed based on the image captured by the camera. The nurse call master unit has a notifying unit that receives the caution state occurrence signal and performs a notification operation. Then, this nurse call system transmits a captured image of the camera to the mobile terminal in response to a mobile terminal carried by a nurse to respond to a call from the nurse call handset and the attention state generation signal. And a communication control unit for performing the communication.

On the other hand, in terms of safety confirmation, a single person living alone is the same as the person requiring care and is a monitored person.

JP, 2014-90913, A

By the way, in the practice of nursing and nursing care, for example, during meals, recreation, etc., a supervisor such as a nurse usually assigns a plurality of supervised persons such as nurses required to a predetermined place (a restaurant or a restaurant). Recreation rooms, etc.) may be taken in sequence to prepare for the move. In such a case, in the nurse call system disclosed in Patent Document 1, since the state of the monitored person can be visually recognized by the notification of the attention state generation signal and the image, each monitored person should be prepared to move. It is also possible to improve work efficiency. However, in the nurse call system disclosed in Patent Document 1, a caution state occurrence signal is notified to a mobile terminal (an example of a terminal device) of any patient (an example of a monitored person) when a caution state occurs. It For this reason, in the above case, the supervisor receives notification of the attention state generation signal to the monitored person excluding his/her own responsibility, notification of the attention state generation signal to the monitored person spatially far from his/her position, etc. However, the monitored person who is ready to move cannot be taken smoothly (smoothly), and eventually it becomes difficult to improve work efficiency. It should be noted that, of course, the other monitor responds to the notification of the attention state generation signal to the monitored person excluding his/her own charge, the notification of the attention state generation signal to the monitored person spatially distant from his/her position, etc. ..

The present invention is made in view of the above circumstances, and an object thereof is to provide a central processing unit and a central processing method of a monitored person monitoring system capable of further improving work efficiency, and the monitored person monitoring system. Is to provide.

As a result of various studies, the present inventor has found that the above object can be achieved by the present invention described below. That is, the central processing unit according to an aspect of the present invention is provided corresponding to each of a plurality of monitored persons who are monitoring targets, and a plurality of sensor devices that detect the monitored person, and a plurality of sensor devices, respectively. A central processing unit that manages each monitoring information related to each monitored person based on each detection result that is communicatively connected and received from each of the plurality of sensor devices, and the monitoring information that is communicably connected to the central processing unit Is a central processing unit in a monitored person monitoring system for monitoring each of the plurality of monitored persons, the communication unit performing communication, and the sensor device. , A destination terminal information storage unit that stores a correspondence relationship with a terminal device that is a transmission destination that transmits monitoring information regarding the monitored person based on the detection result received from the sensor device, and receives the detection result from the sensor device In the case of doing, the monitoring processing unit for transmitting the received detection result to the terminal device corresponding to the sensor device based on the correspondence relation stored in the destination terminal information storage unit, and the correspondence relation. Is characterized in that a plurality of sensor devices are associated with one terminal device.

Further, a central processing method according to another aspect of the present invention is provided corresponding to each of a plurality of monitored persons, which are monitoring targets, and a plurality of sensor devices for detecting the monitored person, and the plurality of sensor devices. A central processing unit that manages each monitoring information related to each monitored person based on each detection result received from each of the plurality of sensor devices that is communicatively connected to each of the plurality of sensor devices; A central processing method in a monitored person monitoring system for monitoring each of the plurality of monitored persons, comprising a plurality of terminal devices for receiving and displaying monitoring information, comprising: receiving from the sensor device and the sensor device; A storage step of storing in the destination terminal information storage section the correspondence relationship with the terminal device that is the transmission destination that transmits the monitoring information regarding the monitored person based on the detected result; and when the detection result is received from the sensor device. A monitoring processing step of transmitting the received detection result to a terminal device corresponding to the sensor device based on the correspondence relationship stored in the transmission destination terminal information storage unit, and the correspondence relationship is 1 It is characterized in that a plurality of sensor devices are associated with each terminal device. Preferably, in the above-described central processing unit and central processing method, the correspondence is dynamically changed according to the location of the terminal device. Preferably, in the central processing unit and the central processing method described above, the correspondence is dynamically changed according to the location of the terminal device and then fixed for a predetermined time.

In such a central processing unit and central processing method, since the sensor device and the terminal device which is the destination of the detection result detected by the sensor device are associated in a many-to-one correspondence, the user who handles the terminal device ( The (monitoring person) can avoid notifying the monitored person except the person in charge of the detection result. Also, by setting the correspondence so that a plurality of sensor devices spatially arranged within a certain range are associated with one terminal device, the supervisor is spatially far from his position. It is possible to avoid notification of the detection result to the monitored person. Therefore, in the above-mentioned central processing unit and central processing method, even if the detection result is notified, it is the detection result of the person in charge of the person in charge or the person being monitored within a certain spatial range. In the above case, the monitored person who is ready to move can be taken smoothly, and thus the central processing unit and the central processing method can further improve the work efficiency.

Then, a monitored person monitoring system according to another aspect of the present invention is provided corresponding to each of a plurality of monitored persons to be monitored, a plurality of sensor devices for detecting the monitored person, and the plurality of sensor devices. A central processing unit that communicates with each of the sensor devices and manages each piece of monitoring information about each of the monitored persons based on each detection result received from each of the plurality of sensor devices, and that is connected to the central processing unit so as to communicate with each other. A monitored person monitoring system for monitoring each of the plurality of monitored persons, comprising a plurality of terminal devices for receiving and displaying the monitored information, wherein the central processing unit is the central processing unit described above. It is characterized by being.

Since such a person-to-be-monitored system includes the above-mentioned central processing unit, it is possible to further improve the work efficiency.
Furthermore, a central processing unit according to another aspect of the present invention is provided corresponding to each of a plurality of monitored persons who are monitoring targets, and a plurality of sensor devices that detect the monitored person, and the plurality of sensor devices. A central processing unit that manages each monitoring information related to each monitored person based on each detection result received from each of the plurality of sensor devices that is communicatively connected to each of the plurality of sensor devices; The central processing unit in a monitored person monitoring system for monitoring each of the plurality of monitored persons, comprising a plurality of terminal devices for receiving and displaying monitoring information, the communication unit performing communication, and the sensor Device, a destination terminal information storage unit that stores a correspondence relationship between the device and a terminal device that is a transmission destination that transmits monitoring information regarding the monitored person based on the detection result received from the sensor device, and the detection result from the sensor device And a monitoring processing unit that transmits the received detection result to a terminal device corresponding to the sensor device based on the correspondence relationship stored in the transmission destination terminal information storage unit, The correspondence is a relationship in which a plurality of sensor devices are associated with one terminal device in each spatially fixed range, and the correspondence is dynamic according to the location of the terminal device. It is characterized by being changed to.
Furthermore, a central processing method according to another aspect of the present invention is provided corresponding to each of a plurality of monitored persons who are monitoring targets, and a plurality of sensor devices that detect the monitored person, and the plurality of sensor devices. A central processing unit that manages each monitoring information related to each monitored person based on each detection result received from each of the plurality of sensor devices that is communicatively connected to each of the plurality of sensor devices; A central processing method in a monitored person monitoring system for monitoring each of the plurality of monitored persons, comprising a plurality of terminal devices for receiving and displaying monitoring information, comprising: receiving from the sensor device and the sensor device; A storage step of storing in the destination terminal information storage section the correspondence relationship with the terminal device that is the transmission destination that transmits the monitoring information regarding the monitored person based on the detected result; and when the detection result is received from the sensor device. A monitoring processing step of transmitting the received detection result to a terminal device corresponding to the sensor device based on the correspondence stored in the destination terminal information storage unit, the correspondence being a space. Is a relationship in which a plurality of sensor devices are associated with one terminal device within a certain range, and the correspondence relationship is dynamically changed according to the location of the terminal device. Is characterized by.

The central processing unit and the central processing method of the monitored person monitoring system and the monitored person monitoring system according to the present invention can further improve the work efficiency.

It is a figure which shows the structure of the to-be-monitored person monitoring system in embodiment. It is a figure which shows the structure of the sensor apparatus in the to-be-monitored person monitoring system of embodiment. It is a figure which shows the structure of the management server apparatus in the to-be-monitored person monitoring system of embodiment. It is a figure which shows the structure of the server side monitoring information table memorize|stored in the said management server apparatus shown in FIG. It is a figure which shows the structure of the apparatus information table memorize|stored in the said management server apparatus shown in FIG. It is a figure which shows the structure of the server side sensor information table memorize|stored in the said management server apparatus shown in FIG. It is a figure which shows the structure of the portable terminal device in the to-be-monitored person monitoring system of embodiment. 3 is a flowchart showing the operation of the sensor device shown in FIG. 2. 4 is a flowchart showing an operation of the management server device shown in FIG. 3. 8 is a flowchart showing an operation of the mobile terminal device shown in FIG. 7. FIG. 8 is a diagram showing an example of a standby screen displayed on the mobile terminal device shown in FIG. 7. It is a figure which shows an example of the monitoring information screen displayed on the portable terminal device shown in FIG. It is a figure which shows an example of the nurse call reception screen displayed on the portable terminal device shown in FIG.

An embodiment of the present invention will be described below with reference to the drawings. It should be noted that in each of the drawings, the components denoted by the same reference numerals indicate the same components, and the description thereof will be omitted as appropriate. In the present specification, reference numerals without suffixes are used for generic names, and reference numerals with suffixes are used when referring to individual components.

The person-to-be-monitored monitoring system according to the embodiment monitors a person to be monitored (person to be watched) Ob which is a subject to be watched (to be watched) to be watched (to be watched), and corresponds to each of the plurality of people Ob to be watched. A plurality of sensor devices for detecting the person Ob to be monitored, and each of the person Ob to be monitored based on each detection result received from each of the plurality of sensor devices communicably connected to each of the plurality of sensor devices. A central processing unit that manages monitoring information, and a plurality of terminal devices that are communicatively connected to the central processing unit and that receive and display the monitoring information are provided. The central processing unit of such a monitored person monitoring system includes a communication unit that performs communication, the sensor device, and a transmission destination that transmits monitoring information regarding the monitored person based on a detection result received from the sensor device. A destination terminal information storage unit that stores a correspondence relationship with a certain terminal device, and, when a detection result is received from the sensor device, the sensor based on the correspondence relationship stored in the destination terminal information storage unit. A monitoring processing unit that transmits the received detection result is provided to a terminal device corresponding to the device, and the correspondence relationship is a relationship in which a plurality of sensor devices are associated with one terminal device. Note that the terminal device may be one type of device, but in the present embodiment, the terminal device is two types of devices, a fixed terminal device and a mobile terminal device. The main difference between the fixed terminal device and the mobile terminal device is that the fixed terminal device is fixedly operated, while the mobile terminal device is operated while being carried by a supervisor (user) such as a nurse or a caregiver. Since the fixed terminal device and the mobile terminal device are substantially the same, the mobile terminal device will be mainly described in the following embodiments.

FIG. 1 is a diagram showing a configuration of a monitored person monitoring system in the embodiment. FIG. 2 is a diagram showing a configuration of a sensor device in the monitored person monitoring system of the embodiment. FIG. 3 is a diagram showing the configuration of the management server device in the monitored person monitoring system of the embodiment. FIG. 4 is a diagram showing a configuration of a server-side monitoring information table stored in the management server device shown in FIG. FIG. 5 is a diagram showing a configuration of an inter-device information table stored in the management server device shown in FIG. 5A shows the configuration of the notification destination correspondence relationship information table of the inter-device information table, and FIG. 5B shows the configuration of the communication address correspondence relationship information table of the inter-device information table. FIG. 6 is a diagram showing a configuration of a server-side sensor information table stored in the management server device shown in FIG. FIG. 7: is a figure which shows the structure of the portable terminal device in the to-be-monitored person monitoring system of embodiment.

More specifically, the monitored person monitoring system MS in the embodiment, for example, as shown in FIG. 1, includes one or more sensor devices SU (SU-1 to SU-12, sensor devices SU-5 to SU-). 12 is not shown), a management server device SV, a fixed terminal device SP, one or a plurality of mobile terminal devices TA (TA-1 to TA-3, mobile terminal device TA-3 is not shown), and a private branch exchange. (PBX, Private branch exchange) CX, which are connected by wire or wirelessly via a network (network, communication line) NW such as a LAN (Local Area Network). The network NW may be equipped with a repeater such as a repeater, a bridge, and a router that relays communication signals. In the example shown in FIG. 1, the plurality of sensor devices SU-1 to SU-12, the management server device SV, the fixed terminal device SP, the plurality of mobile terminal devices TA-1 to TA-3, and the private branch exchange CX are L2 switches. Line concentrators (hubs, HUBs) LS and access points AP, which are communicatively connected to each other by a wired/wireless mixed LAN (for example, a LAN according to the IEEE 802.11 standard) NW. More specifically, the plurality of sensor devices SU-1 to SU-12, the management server device SV, the fixed terminal device SP and the private branch exchange CX are connected to the concentrator LS, and the plurality of mobile terminal devices TA-1 to TA-3. Is connected to the line concentrator LS via the access point AP. The network NW forms a so-called intranet by using Internet protocol groups such as TCP (Transmission control protocol) and IP (Internet protocol).

The monitored person monitoring system MS is arranged at an appropriate place according to the monitored person Ob. The person to be monitored (person to be watched over) Ob is, for example, a person who needs nursing due to illness or injury, a person who needs nursing care due to deterioration of physical ability, or a single person living alone. Particularly, from the viewpoint of enabling early detection and early action, the monitored person Ob may be a person who needs to be detected when a predetermined inconvenient event such as an abnormal state occurs in the person. preferable. Therefore, the monitored person monitoring system MS is preferably installed in a building such as a hospital, an aged welfare facility, and a dwelling unit according to the type of the monitored person Ob. In the example illustrated in FIG. 1, the monitored-person monitoring system MS is arranged in a building of a nursing care facility including a plurality of living rooms RM in which a plurality of monitored persons Ob live and a plurality of living rooms such as a nurse station.

The sensor device SU has a communication function for communicating with other devices SV, SP, TA via the network NW, and is a device for notifying the management server device SV of a predetermined event (event) related to the monitored person Ob. is there. The predetermined event (event) is preferably a predetermined event that needs to be dealt with, and in the present embodiment, for example, a predetermined action and a nurse call in the monitored person Ob. Therefore, in the present embodiment, the sensor device SU detects a predetermined action in the monitored person Ob, notifies (transmits) the detection result to the management server device SV as an example of the predetermined event, and accepts a nurse call. As another example of the predetermined event, the nurse call is notified (transmitted) to the management server device SV, a voice call is performed between the terminal devices SP and TA, and an image including a moving image is generated to generate the terminal. This is a device for distributing a moving image to the devices SP and TA. Such a sensor device SU, for example, as shown in FIG. 2, an imaging unit 11, a sensor side sound input/output unit (SU sound input/output unit) 12, a nurse call acceptance operation unit 13, and a sensor side control process. A unit (SU control processing unit) 14, a sensor side communication interface unit (SU communication IF unit) 15, and a sensor side storage unit (SU storage unit) 16.

The imaging unit 11 is a device that is connected to the SU control processing unit 14 and generates an image (image data) under the control of the SU control processing unit 14. The image includes a still image (still image data) and a moving image (moving image data). The imaging unit 11 is arranged so as to be able to monitor the space (location space, in the example shown in FIG. 1, the room (room) RM of the installation location) where the monitored person Ob, who is the monitoring target, is to be monitored. An image of the location space is picked up from above as an image pickup target, an image (image data) of the bird's-eye view of the image pickup target is generated, and the image of the image pickup target (target image) is output to the SU control processing unit 14. Preferably, since there is a high probability that the entire monitored person Ob to be monitored can be imaged, the imaging unit 11 determines that the head of the monitored person Ob is positioned in the bedding (such as a bed) on which the monitored person Ob lies down. It is arranged so that the imaging target can be imaged from immediately above a predetermined planned head position (usually the pillow disposition position). The sensor device SU acquires an image of the monitored person Ob from above the monitored person Ob, preferably an image captured from directly above the planned head position, by the image capturing unit 11.

The imaging unit 11 as described above may be a device that generates a visible light image, but in the present embodiment, it is a device that generates an infrared image so that the monitored person Ob can be monitored even in a relatively dark place. .. In the present embodiment, for example, such an image pickup unit 11 has an image forming optical system that forms an infrared optical image of an image pickup object on a predetermined image forming surface, and a light receiving surface is aligned with the image forming surface. And an area image sensor which is arranged and converts an infrared optical image of the imaging target into an electrical signal, and data representing an infrared image of the imaging target by image-processing the output of the area image sensor. The digital infrared camera includes an image processing unit that generates image data. In the present embodiment, the imaging optical system of the imaging unit 11 is preferably a wide-angle optical system (a so-called wide-angle lens (including a fisheye lens)) having an angle of view capable of imaging the entire living room RM in which the imaging unit 11 is arranged. ..

The SU sound input/output unit 12 is a circuit that inputs and outputs sounds. That is, the SU sound input/output unit 12 is a circuit that is connected to the SU control processing unit 14 and that generates and outputs a sound according to an electric signal representing the sound under the control of the SU control processing unit 14, Is a circuit for acquiring the sound of and inputting it to the sensor device SU. The SU sound input/output unit 12 includes, for example, a speaker that converts an electric signal of sound (sound data) into a mechanical vibration signal of sound (acoustic signal), and a microphone that converts a mechanical vibration signal of sound in the audible region into an electric signal. And the like. The SU sound input/output unit 12 outputs an electric signal representing an external sound to the SU control processing unit 14, and also converts the electric signal input from the SU control processing unit 14 into a mechanical vibration signal of sound and outputs the mechanical vibration signal. ..

The nurse call reception operation unit 13 is a switch circuit such as a push-button switch that is connected to the SU control processing unit 14 and that inputs a nurse call to the sensor device SU. The nurse call acceptance operation unit 13 may be connected to the SU control processing unit 14 by wire, or may be connected to the SU control processing unit 14 by short-distance wireless communication such as Bluetooth (registered trademark) standard.

The SU communication IF unit 15 is a communication circuit that is connected to the SU control processing unit 14 and performs communication under the control of the SU control processing unit 14. The SU communication IF unit 15 generates a communication signal containing the data to be transferred, which is input from the SU control processing unit 14, according to the communication protocol used in the network NW of the monitored person monitoring system MS, and the generated communication. The signal is transmitted to the other devices SV, SP, TA via the network NW. The SU communication IF unit 15 receives communication signals from other devices SV, SP, TA via the network NW, extracts data from the received communication signals, and the SU control processing unit 14 can process the extracted data. The data is converted into data of any format and output to the SU control processing unit 14. The SU communication IF unit 15 includes, for example, a communication interface circuit conforming to the IEEE 802.11 standard or the like.

The SU storage unit 16 is a circuit which is connected to the SU control processing unit 14 and stores various predetermined programs and various predetermined data under the control of the SU control processing unit 14. The various predetermined programs include, for example, a SU control program that controls each unit of the sensor device SU in accordance with the function of each unit, and a SU monitoring processing program that executes predetermined information processing regarding monitoring of the monitored person Ob. Control processing programs such as The SU monitoring processing program detects a predetermined action in the monitored person Ob and notifies the predetermined terminal device SP, TA of the detection result as an example of the predetermined event (event) via the management server device SV. When a nurse call is accepted by the action detection processing program or the nurse call accepting operation unit 13, the fact is notified to the management server SV as another example of the predetermined event, and the SU sound input/output unit 12 or the like is used. A nurse call processing program for making a voice call with the terminal devices SP and TA, and an SU streaming processing program for streaming the moving image generated by the imaging unit 11 to the terminal devices SP and TA that requested the moving image. included. On each of the various types of predetermined data, each program such as a sensor device identifier (sensor ID) that is an identifier for identifying and identifying the sensor device SU of the device itself and a communication address of the management server device SV is executed. It includes the data necessary for the operation. The SU storage unit 16 includes, for example, a ROM (Read Only Memory) which is a non-volatile storage element, and an EEPROM (Electrically Erasable Programmable Read Only Memory) which is a rewritable non-volatile storage element. The SU storage unit 16 includes a RAM (Random Access Memory) or the like that serves as a working memory of the so-called SU control processing unit 14 that stores data and the like generated during execution of the predetermined program.

The SU control processing unit 14 controls each unit of the sensor device SU in accordance with the function of each unit, and notifies the management server device SV of a predetermined event (event) related to the monitored person Ob that needs to be dealt with. It is a circuit for. More specifically, in the present embodiment, the SU control processing unit 14 detects a predetermined action in the monitored person Ob and notifies the management server SV of the detection result as an example of the predetermined event (notification, (Transmitting), accepting the nurse call, notifying (notifying and transmitting) the nurse call to the management server SV as another example of the predetermined event, and making a voice call with the terminal devices SP and TA, and moving images. An image including is generated and the moving image is distributed to the terminal devices SP and TA. The SU control processing unit 14 is configured to include, for example, a CPU (Central Processing Unit) and its peripheral circuits. The SU control processing unit 14 executes the control processing program, whereby the sensor side control unit (SU control unit) 141, the behavior detection processing unit 142, the nurse call processing unit 143, and the sensor side streaming processing unit (SU streaming process). Part) 144 functionally.

The SU control unit 141 controls each unit of the sensor device SU in accordance with the function of each unit, and controls the entire sensor device SU.

The behavior detection processing unit 142 detects a preset predetermined behavior of the monitored person Ob and notifies the management server SV of the detection result as an example of the predetermined event. More specifically, in the present embodiment, the predetermined action is, for example, a wake-up of the monitored person Ob, a wake-up of the monitored person Ob from the bedding, a fall of the monitored person Ob falling from the bedding, And the four behaviors of the fall of the monitored person Ob. Then, the behavior detection processing unit 142, for example, detects the head of the monitored person Ob based on the target image captured by the image capturing unit 11, and detects the temporal change in the size of the detected head of the monitored person Ob. Based on this, the wakeup, leaving the bed, fall, and fall of the monitored person Ob are detected. More specifically, first, the location area of the bedding BD, the first threshold value Th1 for identifying the size of the head in the recumbent posture and the size of the head in the sitting posture in the location area of the bedding BD, and the location area of the bedding BD 2nd threshold value Th2 for identifying whether or not it is the size of the head in the standing posture in the living room RM excluding the above, and the size of the head in the recumbent posture in the living room RM excluding the region where the bedding BD is located. The third threshold Th3 for identifying whether or not it is stored in advance in the SU storage unit 16 as one of the various kinds of predetermined data. Then, the action detection processing unit 142 extracts a moving body region from the target image as a region of the person of the monitored person Ob by, for example, the background difference method or the frame difference method, and extracts, for example, a circular or elliptical Hough from the extracted moving body region. The head region of the monitored person Ob is extracted by conversion, by pattern matching using a prepared head model, or by a neural network learned for head detection, and the extracted head is extracted. Detects wake-up, bed leaving, falls and falls from the position and size of. For example, the action detection processing unit determines that the position of the extracted head is within the location area of the bedding BD, and the size of the extracted head is calculated from the size of the recumbent posture by using the first threshold Th1. When it changes with time to the size of the sitting posture, it is determined that the user is awake and the awakening is detected. For example, the behavior detection processing unit 142 is a case where the position of the extracted head changes with time from within the area where the bedclothes BD is located to outside the area where the bedclothes is located, and the extracted size of the head is the second area. When the threshold value Th2 is used to change with time from a certain size to the size of the standing posture, it is determined that the user is out of bed and the above-mentioned leaving is detected. For example, when the action detection processing unit 142 changes the position of the extracted head with time from inside the area where the bedclothes BD is located to outside the area where the bedclothes BD is located, the size of the extracted head is the first area. When the size changes from a certain size to the size of the recumbent posture with time by using the three threshold value Th3, it is determined to fall and the fall is detected. For example, the behavior detection processing unit 142 uses the third threshold value Th3 when the extracted head position is in the room RM excluding the area where the bedding BD is located, and the extracted head size is the third threshold value Th3. When the size changes from the size of the body to the size of the recumbent posture with time, it is determined to be a fall and the fall is detected.

When the predetermined action is detected in this way, the action detection processing unit 142 stores the event information (event information) indicating the content of the predetermined event (event) related to the monitored person Ob, in order to notify the event. The SU communication IF unit 15 notifies the management server device SV of the first event notification communication signal. More specifically, the action detection processing unit 142 includes a communication signal (first event notification communication signal) containing a sensor ID of the device itself, event information indicating the content of the event, and a target image used for detecting the predetermined action. ) Is transmitted to the management server device SV via the SU communication IF unit 15. In the present embodiment, the event information is one or more of wake-up, wake-up, fall, fall, and nurse call (NC). Here, the action detection processing unit 142 detects the wake-up, wake-up, fall, and fall. One or more of the falls are accommodated in the first event notification communication signal as the event information. The image may be at least one of a still image and a moving image, and in the present embodiment, as will be described later, the still image is first notified and the moving image is delivered in response to a user's request. First, the moving image may be distributed, or the still image and the moving image may be transmitted, and the still image and the moving image may be displayed on the terminal devices SP and TA by screen division.

When the nurse call reception operation unit 13 receives a nurse call, the nurse call processing unit 143 notifies the management server device SV of a first event notification communication signal accommodating to that effect as another example of the predetermined event, By using the SU sound input/output unit 12 and the like, a voice call is made between the terminal devices SP and TA. More specifically, the nurse call processing unit 143, when the nurse call reception operation unit 13 is input, performs SU communication of the sensor ID of the own device and the first event notification communication signal accommodating the nurse call as the event information. It is transmitted to the management server SV via the IF unit 15. Then, the nurse call processing unit 143 uses the SU sound input/output unit 12 and the like to make a voice call with the terminal devices SP and TA by, for example, VoIP (Voice over Internet Protocol).

When there is a request for distribution of a moving image from the fixed terminal device SP or the mobile terminal device TA via the communication IF unit 3, the SU streaming processing unit 144 sends the request to the fixed terminal device SP or the mobile terminal device TA. The moving image generated by the image pickup unit 11 (for example, a live moving image) is distributed by streaming reproduction via the SU communication IF unit 15.

In FIG. 1, as an example, four first to fourth sensor devices SU-1 to SU-4 of the first to twelfth sensor devices SU-1 to SU-12 are shown, and the first sensor The device SU-1 is arranged in the room RM-1 (not shown) of Mr. A Ob-1 who is one of the monitored persons Ob, and the second sensor device SU-2 is one of the monitored persons Ob. The third sensor device SU-3 is arranged in the room RM-2 (not shown) of Mr. B Ob-2, and the third sensor device SU-3 is the room RM-3 (not shown) of Mr. Ob-3 of C who is one of the monitored persons Ob. And the fourth sensor device SU-4 is installed in the room RM-4 (not shown) of Mr. D Ob-4 who is one of the monitored persons Ob. Note that the number of sensor devices SU is not limited to 12 and is arbitrary.

The management server device SV has a communication function of communicating with other devices SU, TA, and SP via the network NW, and when receiving the notification of the predetermined event from the sensor device SU, information regarding monitoring of the monitored person Ob ( Monitoring information (in the present embodiment, for example, the predetermined event (a predetermined action type detected by the sensor device SU or a nurse call accepted by the sensor device SU), an image (still image and moving image) of the monitored person Ob, and (The time at which the notification is received, etc.)) is managed, and the predetermined event is notified (re-notification, re-notification, transmission) to the predetermined terminal devices SP and TA, and the client (in this embodiment, the terminal devices SP and TA, etc.). ) Is provided to the client to manage the entire monitored person monitoring system MS. In the present embodiment, one terminal device SP, TA is associated with a predetermined number of sensor devices SU of the plurality of sensor devices SU, and the management server device SV has the predetermined number of sensor devices SU. The predetermined event notified from the sensor device SU of 1 is transmitted to the one terminal device SP, TA associated with them. Such a management server device SV includes, for example, as shown in FIG. 3, a server-side communication interface unit (SV communication IF unit) 21, a server-side control processing unit (SV control processing unit) 22, and a server-side storage unit. (SV storage unit) 23.

Like the SU communication IF unit 15, the SV communication IF unit 21 is a communication circuit that is connected to the SV control processing unit 22 and performs communication under the control of the SV control processing unit 22. The SV communication IF unit 21 includes, for example, a communication interface circuit conforming to the IEEE 802.11 standard or the like.

The SV storage unit 23 is a circuit that is connected to the SV control processing unit 22 and stores various predetermined programs and various predetermined data under the control of the SV control processing unit 22. The various predetermined programs include, for example, an SV control program that controls each unit of the management server device SV according to the function of each unit, and an SV monitoring process that executes predetermined information processing for monitoring the monitored person Ob. A control processing program such as a program is included. The various predetermined data includes a server identifier (server ID) for identifying the management server device SV and identifying the management server device SV of the device itself, the monitoring information of the monitored person Ob, and the predetermined data. It includes data necessary for executing each program such as inter-device information indicating information among devices SU, SP, TA such as event notification destinations, sensor information regarding the sensor device SU, and the like. The SV storage unit 23 stores the server-side monitoring information storage unit (SV monitoring information storage unit) 231, the device-side information storage unit 232, and the server-side sensor information storage unit in order to store these monitoring information, inter-device information, and sensor information. The unit (SV sensor information storage unit) 233 is functionally provided.

The SV monitoring information storage unit 231 stores the monitoring information of the monitored person Ob transmitted/received to/from each of the devices SU, SP, TA. More specifically, in the present embodiment, the SV monitoring information storage unit 231 stores, as the monitoring information, information contained in communication signals such as a first event notification communication signal and a response reception notification communication signal described later. Based on this, the sensor ID, the event information (event information, waking up, leaving the bed, falling, falling, and nurse call in this embodiment), the reception time, the target image (still image and moving image), and the presence or absence of coping are stored in association with each other. It

In the present embodiment, this monitoring information is stored in the SV monitoring information storage unit 321 in a table format. The server-side monitoring information table (SV monitoring information table) MT-SV for registering this monitoring information indicates, for example, as shown in FIG. 4, the sensor ID contained in the communication signal received from each device SU, SP, TA. A sensor ID field 2311 to be registered, an event field (event field) 2312 for registering event information contained in the received communication signal, a reception time field 2313 for registering a reception time of the received communication signal, and the reception The still image field 2314 for registering the still image accommodated in the received communication signal and the communication address (for example, IP address) of the sensor device SU corresponding to the sensor ID accommodated in the received communication signal as the acquisition destination of the live moving image. Etc.) and a corresponding field 2316 for registering the presence/absence of correspondence for the event information contained in the received communication signal, and record for each received communication signal (for each event). Equipped with. In the still image field 2314, for example, image data of a still image may be registered, and for example, a file name of image data of a still image may be registered. In the correspondence field 2316, as will be described later, the terminal devices SP and TA accept that the event information contained in the received communication signal has an intention (correspondence, treatment, measure) to be dealt with (“corresponding”). A flag (corresponding flag) indicating whether or not it is registered. For example, in the present embodiment, the correspondence field 2316 indicates that there is an intention to deal with the event information (event information registered in the event field 2312) contained in the received communication signal (“corresponding”). Correspondence flag “1” meaning that the device SP or TA has accepted, or that the terminal device SP or TA has an intention to handle the event information contained in the received communication signal (“corresponding”) The corresponding flag “0”, which means not accepted, is registered. By default, the correspondence field 2316 is registered with the correspondence flag “0” meaning unaccepted. When the first event notification communication signal contains the detection time at which the predetermined action is detected or the nurse call reception time at which the nurse call is received, instead of the reception time, the detection time or the nurse The call reception time may be registered.

In the present embodiment, the inter-device information storage unit 232 indicates a notification destination (re-notification destination, re-notification destination, transmission destination) such as the first event notification communication signal transmitted from the sensor device SU in the present embodiment. , The correspondence between the sensor ID that is the transmission source and the terminal ID that is the notification destination (re-notification destination) (correspondence of the notification destination), and the IDs (sensor ID, terminal ID) of each of the devices SU, SP, and TA and their The correspondence relationship with the communication address (communication address correspondence relationship) and the like are stored. The terminal ID is a terminal identifier for identifying the terminal devices SP and TA and identifying the terminal devices SP and TA.

In the present embodiment, the notification destination correspondence relationship and the communication address correspondence relationship are respectively stored in the inter-device information storage unit 232 in a table format. For example, as shown in FIG. 5A, the notification destination correspondence relationship information table AT for registering this notification destination correspondence relationship includes a transmission source field 2321 for registering the sensor ID of the transmission source sensor device SU and a transmission source field. The sensor ID (sensor device SU) is provided with a notification destination field 2322 that registers the terminal ID of the transmission destination terminal device SP or TA that transmits the communication signal notified from the sensor device SU corresponding to the sensor ID registered in 2321. Each) has a record. The communication address correspondence information table DT for registering the communication address correspondence is, for example, as shown in FIG. 5B, a terminal ID field 2323 for registering the terminal IDs of the terminal devices SP and TA and a terminal ID field 2323. And a communication address field 2324 for registering the communication address of the terminal device SP, TA corresponding to the terminal ID registered in 1., and a record for each terminal ID (terminal device SP, TA).

Each of the sensor ID, the server ID, and the terminal ID may be, for example, a serial number or the like formed of a predetermined symbol string, or may be, for example, a communication address (in this case, the communication address correspondence can be omitted).

In the present embodiment, the notification destination correspondence relationship is a relationship in which a plurality of sensor devices SU are associated with one terminal device SP, TA. In the example shown in FIG. 5A, the first mobile terminal device TA-1 is associated with four first to fourth sensor devices SU-1 to SU-4, and is transmitted in the first record. SU-1 to SU-4 are registered as the sensor IDs in the original field 2321, and TA-1 is registered as the terminal ID in the notification destination field 2322. Further, four fifth, sixth, ninth, and tenth sensor devices SU-5, SU-6, SU-9, SU-10 are associated with the second mobile terminal device TA-2, and 2 In the second record, SU-5, SU-6, SU-9, and SU-10 are registered as their sensor IDs in the transmission source field 2321, and TA-2 as their terminal ID in the notification destination field 2322. Is registered. Further, four third, eighth, eleventh and twelfth sensor devices SU-7, SU-8, SU-10, SU-12 are associated with the third mobile terminal device TA-3 (not shown). In the third record, SU-7, SU-8, SU-10, SU-12 are registered as their sensor IDs in the transmission source field 2321, and their terminal IDs are registered in the notification destination field 2322 as their terminal IDs. TA-3 is registered.

Although illustration is omitted, the first to fourth sensor devices SU-1 to SU-4 are arranged in the first to fourth living rooms RM-1 to RM-4 on the first floor, respectively, and the fifth to fifth The 12 sensor devices SU-5 to SU-12 are arranged in the fifth to twelfth living rooms RM-5 to RM-12 on the second floor, respectively. The first and second living rooms RM-1 and RM-2 are adjacent to each other, the third and fourth living rooms RM-3 and RM-4 are adjacent to each other, and the first living room RM-1 is a corridor. The third living room RM-3 faces the third living room RM-3 across the (passage), and the second living room RM-2 faces the fourth living room RM-4 across the corridor. The fifth to eighth living rooms RM-5 to RM-8 are lined up in this order, and the ninth to twelfth living rooms RM-9 to RM-12 are lined up in this order and lined up in one row. The fifth to eighth rooms RM-5 to RM-8 face the ninth to twelfth rooms RM-9 to RM-12 arranged in a line across the corridor (passage). For this reason, the notification destination correspondence shown in FIG. 5(A) is such that one first mobile terminal device TA-1 is within a predetermined range spatially relatively close (spatial proximity) on the first floor. Is associated with the plurality of first to fourth sensor devices SU-1 to SU-4, and the user (supervisor) who handles the first mobile terminal device TA-1 will be described later. When receiving a notification of an event or when it is determined that the monitored person Ob needs to be cared for or assisted by watching a live video in a live video, it is possible to quickly rush. For this reason, it is possible to provide care and assistance in parallel to a plurality of monitored persons Ob who are in charge of their own in a relaxed manner. Similarly, one second portable terminal device TA-2 is provided with a plurality of fifth, sixth, ninth and tenth sensor devices arranged in a predetermined spatially relatively close range on the second floor. Corresponding to SU-5, SU-6, SU-9, and SU-10, the observer who handles the second mobile terminal device TA-2 receives an event notification or a live video. When the person Ob to be monitored is visually recognized and it is determined that care or assistance is necessary, the person Ob can be swiftly rushed. For this reason, it is possible to provide care and assistance in parallel to a plurality of monitored persons Ob who are in charge of their own in a relaxed manner.

The SV sensor information storage unit 233 stores the sensor information. In the present embodiment, the sensor information is information about the sensor device SU, and is information in which the sensor ID of the sensor device SU and the monitored person name of the monitored person Ob are associated with each other.

In the present embodiment, such sensor information is stored in the SV sensor information storage unit 233 in a table format. More specifically, the sensor information table ST-SV for registering sensor information includes, for example, as shown in FIG. 6, a sensor ID field 2331 for registering a sensor ID and a sensor registered in the sensor ID field 2331. An installation location field 2332 for registering the installation location of the sensor device SU having the ID, and a monitored person Ob (that is, the sensor) monitored by the sensor device SU having the sensor ID registered in the sensor ID field 2331. The monitored person name field 2333 for registering the monitored person name of the monitored person Ob) who is at the installation location of the sensor device SU having the sensor ID registered in the ID field 2331 and the sensor ID field 2331 are registered. The sensor device SU having the specified sensor ID, a remark field 2334 for registering remarks regarding the installation location and the monitored person Ob, and a record for each sensor ID (that is, the sensor device SU).

The SV control processing unit 22 controls each unit of the management server device SV according to the function of each unit, and when receiving the notification of the predetermined event from the sensor device SU, manages the monitoring information regarding the monitoring of the monitored person Ob. Then, the predetermined event is notified to predetermined terminal devices SP and TA (re-notification, re-notification, transmission), data corresponding to the client's request is provided to the client, and the entire monitored person monitoring system MS is managed. It is a circuit for doing. The SV control processing unit 22 includes, for example, a CPU and its peripheral circuits. The SV control processing unit 22 functionally includes a server-side control unit (SV control unit) 221 and a server-side monitoring processing unit (SV monitoring processing unit) 222 by executing the control processing program.

The SV control unit 221 controls each unit of the management server SV according to the function of each unit, and controls the entire management server SV.

When receiving the notification of the predetermined event from the sensor device SU, the SV monitoring processing unit 222 manages the monitoring information regarding the monitoring of the monitored person Ob, and notifies the predetermined terminal device SP, TA of the predetermined event. is there. More specifically, when the SV monitoring processing unit 222 receives the first event notification communication signal from the sensor device SU, the SV monitoring processing unit 222 monitors for the monitored person Ob contained in the received first event notification communication signal. Information is stored (recorded) in the SV monitoring information storage unit 231. Then, the SV monitoring processing unit 222 stores the notification destination (re-notification destination, transfer destination, transmission destination) corresponding to the sensor device SU that has transmitted the received first event notification communication signal in the inter-device information storage unit 232. Also, the second event notification communication signal is transmitted to the selected terminal device SP, TA by selecting (searching) from the correspondence of the notification destinations. This selection (search processing) is performed based on the sensor ID corresponding to the sensor device SU that transmitted the received first event notification communication signal. If the event information contained in the first event notification communication signal is the predetermined action (one or more of rising, leaving, falling and falling), the second event notification communication signal is The communication address corresponding to the sensor device SU having the sensor ID stored in the first event notification communication signal is stored as the download destination of the sensor ID stored in the 1 event notification communication signal, the event information and the target image, and the moving image. To be done. This communication address is selected (retrieved) from the communication address correspondence based on the sensor ID corresponding to the sensor device SU that transmitted the received first event notification communication signal.

Note that the management server device SV is further connected to the SV control processing unit 22 as necessary and is connected to the SV control processing unit 22, for example, a server side input unit (SV input unit) for inputting various commands and various data, as shown in FIG. ) 24, various commands and various data input by the SV input unit 24, a server side output unit (SV output unit) 25 that outputs monitoring information regarding monitoring of the monitored person Ob, and data between the external device and the external device. A server-side interface unit (SVIF unit) 26 for inputting and outputting the data may be provided.

Such a management server device SV can be configured by, for example, a computer with a communication function.

The fixed terminal device SP has a communication function of communicating with other devices SU, SV, TA via the network NW, a display function of displaying predetermined information, an input function of inputting predetermined instructions and data, and the like. The user interface (UI) of the monitored person monitoring system MS is input by inputting a predetermined instruction or data given to the management server apparatus SV or the mobile terminal apparatus TA or by displaying the monitoring information obtained by the sensor apparatus SU. ) Is a device that functions as. Such a fixed terminal device SP can be configured by, for example, a computer with a communication function. Although the fixed terminal device SP as an example of the terminal device operates in the same manner as the mobile terminal device TA, this specification describes a mobile terminal device TA as another example of the terminal device.

The mobile terminal device TA performs a communication function of communicating with other devices SV, SP, SU via the network NW, a display function of displaying predetermined information, an input function of inputting predetermined instructions and data, and a voice call. It is provided with a call function to perform, inputs a predetermined instruction or data to be given to the management server device SV or the sensor device SU, displays the monitoring information obtained by the sensor device SU by a notification from the management server device SV, It is a device for responding to a nurse call or calling out by voice communication with the sensor device SU. In the present embodiment, such a mobile terminal device TA includes a terminal side communication interface section (TA communication IF section) 31, a terminal side control processing section (TA control processing section) 32, as shown in FIG. 7, for example. , Terminal side storage section (TA storage section) 33, terminal side sound input/output section (TA sound input/output section) 34, terminal side input section (TA input section) 35, terminal side display section (TA display section) 36 and a terminal side interface unit (TAIF unit) 37.

Like the SU sound input/output unit 12, the TA sound input/output unit 34 is a circuit that is connected to the TA control processing unit 32, acquires external sound, and inputs the external sound to the mobile terminal device TA. It is a circuit for generating and outputting a sound according to an electric signal representing the sound under the control of the processing unit 32.

The TA input unit 35 is a circuit that is connected to the TA control processing unit 32, receives, for example, a predetermined operation and inputs the operation to the mobile terminal device TA, and is, for example, a plurality of input switches to which a predetermined function is assigned. .. The predetermined operation is related to, for example, an ID input operation for logging in, a voice call request operation and its end operation, a live video request operation and its end operation, and the notified event. Various operations necessary for monitoring, such as an input operation indicating that there is an intention to execute (correspondence), such as lifesaving, nursing, nursing care, and assistance to the monitored person Ob (“correspondence”) included. The TA display unit 36 is connected to the TA control processing unit 32, and under the control of the TA control processing unit 32, the predetermined operation content input from the TA input unit 35 and the monitored object monitored by the monitored person monitoring system MS. The monitoring information regarding the monitoring of the observer Ob (for example, the predetermined event (the type of predetermined action detected by the sensor device SU or the nurse call accepted by the sensor device SU), the image of the monitored subject Ob (still image and moving image) , And a circuit for displaying the time when the notification is received, and the like, and is a display device such as an LCD (liquid crystal display) and an organic EL display. Further, in the present embodiment, the touch panel is composed of the TA input unit 35 and the TA display unit 36. In this case, the TA input unit 35 is a position input device that detects and inputs an operation position, such as a resistance film type or an electrostatic capacitance type. In this touch panel, a position input device is provided on the display surface of the TA display unit 36, and one or more input content candidates that can be input are displayed on the TA display unit 36. For example, a user such as a nurse or a caregiver ( (Monitoring person) touches the display position where the input content desired to be input is touched, the position is detected by the position input device, and the display content displayed at the detected position is displayed on the mobile terminal device TA as the operation input content of the user. Is entered.

The TAIF unit 37 is a circuit that is connected to the TA control processing unit 32 and that inputs and outputs data to and from an external device under the control of the TA control processing unit 32. For example, the Bluetooth (registered trademark) standard is used. An interface circuit, an interface circuit for performing infrared communication such as IrDA standard, and an interface circuit using USB standard.

Like the SU communication IF unit 15, the TA communication IF unit 31 is a communication circuit that is connected to the TA control processing unit 32 and performs communication under the control of the TA control processing unit 32. The TA communication IF unit 31 includes, for example, a communication interface circuit conforming to the IEEE 802.11 standard or the like.

The TA storage unit 33 is a circuit which is connected to the TA control processing unit 32 and stores various predetermined programs and various predetermined data under the control of the TA control processing unit 32. The various predetermined programs include, for example, a TA control program that controls each unit of the mobile terminal device TA according to the function of each unit, and a TA monitoring process that executes predetermined information processing regarding monitoring of the monitored person Ob. A program, a call processing program for making a voice call with the sensor device SU by using the TA sound input/output unit 34, etc., and a distribution of a moving image from the sensor device SU, and a streaming reproduction of the received moving image. A control processing program such as a TA streaming processing program displayed on the TA display unit 36 is included. The various kinds of predetermined data are necessary for executing each program such as the terminal ID of the own device, the screen information displayed on the TA display unit 36, the monitoring information of the monitored person Ob, and the sensor information about the sensor device SU. Data and the like are included. The TA storage unit 33 includes, for example, a ROM and an EEPROM. The TA storage unit 33 includes a RAM serving as a working memory of a so-called TA control processing unit 32, which stores data and the like generated during execution of the predetermined program. The TA storage unit 33 functions as a terminal-side monitoring information storage unit (TA monitoring information storage unit) 331 and a terminal-side sensor information storage unit (TA sensor information storage unit) 332 in order to store each of these monitoring information and sensor information. Prepared for.

The TA monitoring information storage unit 331 stores the monitoring information. In the present embodiment, the TA monitoring information storage unit 331 uses, as the monitoring information, the sensor ID contained in the second event notification communication signal received from the management server SV, the event information (event information, wake-up in the present embodiment, Bed leaving, fall, fall, and nurse call), the communication address of the sensor device SU to which the image and the moving image are downloaded, the reception time of the second event notification communication signal, the presence or absence of coping, and the like are stored in association with each other. More specifically, as shown in FIG. 4, the TA monitoring information storage unit 331 stores the monitoring information in a terminal-side monitoring information table (TA monitoring information table) MT-TA similar to the SV monitoring information table MT-SV. Remember.

The TA sensor information storage unit 332 stores the sensor information. The TA sensor information storage unit 332 stores the sensor ID, the installation location, the monitored person name, and the remark in association with each other. More specifically, as shown in FIG. 6, the TA sensor information storage unit 332 stores the sensor information in a terminal-side sensor information table (TA sensor information table) ST-TA similar to the SV sensor information table ST-SV. Remember.

The TA control processing unit 32 controls each unit of the mobile terminal device TA according to the function of each unit, receives and displays the monitoring information of the monitored person Ob, and displays a response to a nurse call or a voice call circuit. Is. The TA control processing unit 32 includes, for example, a CPU and its peripheral circuits. The TA control processing unit 32 executes the control processing program, whereby the terminal side control unit (TA control unit) 321, the terminal side monitoring processing unit (TA monitoring processing unit) 322, the call processing unit 323, and the terminal side streaming process. The unit (TA streaming processing unit) 324 is functionally provided.

The TA control unit 321 controls each unit of the mobile terminal device TA according to the function of each unit, and controls the entire mobile terminal device TA.

The TA monitoring processing unit 322 executes predetermined information processing regarding monitoring of the monitored person Ob. More specifically, the TA monitoring processing unit 322 receives the second event notification communication signal transmitted by the management server device SV due to the first event notification communication signal transmitted by the sensor device SU. The monitoring information of the monitored person Ob is stored (recorded) in the TA monitoring information storage unit 331 based on each information (each data) contained in the received second event notification communication signal. The TA monitoring processing unit 322 displays a screen corresponding to each information contained in the received second event notification communication signal on the TA display unit 36. Then, when the TA monitoring processing unit 322 receives a predetermined input operation from the TA input unit 35, the TA monitoring processing unit 322 executes a predetermined process according to the input operation.

The call processing unit 323 performs a voice call with the sensor device SU by using the TA sound input/output unit 34 and the like. More specifically, for example, the call processing unit 323 uses the TA sound input/output unit 34 or the like to transmit the first event notification communication signal that has caused the transmission of the second event notification communication signal to the management server device SV. A voice call is made with the sensor device SU of the transmission source by using, for example, VoIP.

The TA streaming processing unit 324 receives a moving image from the sensor device SU and displays the received moving image on the TA display unit 36 by streaming reproduction.

Such a mobile terminal device TA can be configured by a portable communication terminal device such as a so-called tablet computer, smartphone, or mobile phone.

Next, the operation of this embodiment will be described. FIG. 8 is a flowchart showing the operation of the sensor device shown in FIG. FIG. 9 is a flowchart showing the operation of the management server device shown in FIG. FIG. 10 is a flowchart showing the operation of the mobile terminal device shown in FIG. FIG. 11 is a diagram showing an example of a standby screen displayed on the mobile terminal device shown in FIG. 7. FIG. 12 is a diagram showing an example of the monitoring information screen displayed on the mobile terminal device shown in FIG. 7. FIG. 13 is a diagram showing an example of a nurse call acceptance screen displayed on the mobile terminal device shown in FIG. 7.

In the monitored-person monitoring system MS having the above-described configuration, each device SU, SV, SP, TA, when the power is turned on, initializes each required part and starts its operation. In the sensor device SU, the SU control processing unit 14 is functionally configured with the SU control processing unit 141, the behavior detection processing unit 142, the nurse call processing unit 143, and the SU streaming processing unit 144 by executing the control processing program. .. In the management server device SV, the SV control processing unit 21 functionally includes the SV control unit 211 and the SV monitoring processing unit 222 by executing the control processing program. Then, in the mobile terminal device TA, the TA control processing unit 32 functionally configures the TA control unit 321, the TA monitoring processing unit 322, the call processing unit 323, and the TA streaming processing unit 324 by executing the control processing program. To be done.

First, the operation of the sensor device SU will be described. The sensor device SU detects a predetermined motion of the monitored person Ob by operating as follows in each frame or every few frames, and determines whether or not the nurse call is accepted. There is.

In FIG. 8, first, in the sensor device SU, the SU control unit 141 of the SU control processing unit 14 acquires an image (image data) for one frame from the imaging unit 11 as the target image (S11).

Next, in the sensor device SU, the behavior detection processing unit 142 of the SU control processing unit 14 executes the behavior detection processing for detecting a predetermined behavior of the monitored person Ob based on the target image acquired in the processing S11 ( S12). More specifically, the action detection processing unit 142 determines whether or not the user wakes up, determines whether or not the user leaves the bed, determines whether or not the fall has occurred, and then determines whether or not the fall has occurred.

Next, the sensor device SU determines whether or not the action detection processing unit 142 has detected a predetermined action on the monitored person Ob in the action detection process S12. As a result of this determination, when the predetermined action is not detected (No), the sensor device SU next executes the process S15, while when the predetermined action is detected (Yes). First, the sensor device SU executes the process S15 after executing the next process S14.

In this process S14, in order to notify the predetermined terminal device SP, TA of the predetermined action detected in the process S12 and the process S13 to the predetermined terminal device SP, TA via the management server device SV, the sensor device SU uses the action detection processing unit 142 to As a predetermined event, a first event notification communication signal regarding detection of the predetermined action is transmitted to the management server device SV. More specifically, the action detection processing unit 142 stores the sensor ID of the own device, the predetermined event (here, one or more of wake-up, leaving the bed, falling, and falling) and the first target image. The event notification communication signal is transmitted to the management server device SV via the SU communication IF unit 15.

In the process S15, the sensor device SU determines whether or not the nurse call is accepted by the nurse call processing unit 143. That is, the processes S11 to S16 shown in FIG. 8 are repeatedly executed for each frame or every few frames, but the nurse may be executed between the previous process S15 and the current process S15. It is determined whether the call acceptance operation unit 13 has been operated. As a result of this determination, when the nurse call acceptance operation unit 13 is not operated and the nurse call is not accepted (No), the sensor device SU ends the present processing of this time, while the nurse call acceptance operation unit 13 is terminated. Is operated and the nurse call is accepted (Yes), the sensor device SU terminates the present process after executing the next process S16.

In this process S16, in order to notify the predetermined terminal device SP, TA via the management server device SV of the nurse call whose acceptance was found in the process S15, the sensor device SU causes the nurse call processing unit 143 to perform the nurse call. And transmits a first event notification communication signal related to the management server device SV. More specifically, the nurse call processing unit 143 transmits the first event notification communication signal containing the sensor ID of the own device and the nurse call reception information to the management server device SV via the SU communication IF unit 15.

The sensor device SU operates as described above for each of detection of a predetermined action and reception of a nurse call in the monitored person Ob.

Next, the operation of the management server device SV will be described. On the other hand, in FIG. 9, the management server SV determines by the SV control unit 221 of the SV control processing unit 22 whether or not the communication signal is received by the SV communication IF unit 21 (S21). As a result of this determination, when the communication signal is not received (No), the management server device SV returns the process to S21, and when the result of the determination is that the communication signal is received (Yes), The management server device SV executes the following process S22. That is, the management server device SV waits for reception of a communication signal.

In process S22, the management server device SV determines the type of the received communication signal by the SV control unit 221. As a result of this determination, when the received communication signal is the first event notification communication signal (first event notification), the management server SV executes the processing S23 and then the processing S26, and When the received communication signal is not the first event notification communication signal (others), the process S26 is executed after the process S25.

In process S23, the management server device SV processes the first event notification communication signal received from the sensor device SU in process S21 by the SV monitoring processor 222 of the SV control processor 22. More specifically, first, the SV monitoring processing unit 222 stores the monitoring information regarding the monitoring of the person Ob to be monitored, which is contained in the first event notification communication signal received from the sensor device SU in the processing S21. 231 is stored (recorded). Then, the SV monitoring processing unit 222 selects a notification destination corresponding to the sensor device SU that has transmitted the first event notification communication signal received in process S21 from the notification destination correspondence relationship stored in the inter-device information storage unit 232. Search for. Next, the SV monitoring processing unit 222 transmits the second event notification communication signal to the selected notification destination terminal devices SP and TA. In the second event notification communication signal, as described above, when the event information contained in the first event notification communication signal received in the process S21 is the predetermined action, the event information is received in the process S21. The communication address corresponding to the sensor device SU having the sensor ID contained in the first event notification communication signal is the download destination of the sensor ID contained in the first event notification communication signal, the event information and the target image, and the moving image. Be accommodated. On the other hand, when the event information contained in the first event notification communication signal received in the process S21 is a nurse call, the sensor ID and the event information contained in the first event notification communication signal received in the process S21. Is housed.

In the process S25, the management server device SV causes the SV control processing unit 22 to execute an appropriate process according to the communication signal received in the process S21.

Then, in the processing S26 executed after each of these processing S23 to processing S25, the management server device SV determines by the SV control processing unit 22 whether or not its operation is completed (stopped). If the result of this determination is that operation has ended (stopped) (Yes), the management server device SV ends this processing, while if it has not ended (stopped) operation (No), management The server device SV returns the process to the process S21.

Regarding the first event notification communication signal received from the sensor device SU, the management server device SV operates as described above.

Next, the operation of the terminal devices SP and TA will be described. Here, the operation of the mobile terminal device TA will be representatively described. As described above, when the power is turned on and the operation is started, the mobile terminal device TA accepts a login operation by a monitor (user) such as a nurse or a caregiver, and the TA monitor processing unit 322 causes the mobile terminal device TA to execute a self-operation. A standby screen for waiting for a communication signal addressed to the machine is displayed on the TA display unit 36. This standby screen 51 is, for example, as shown in FIG. 11, a menu bar area 511 for displaying a menu bar, and a standby main area for displaying a message (for example, “no notification”) indicating that the terminal is waiting and an icon. 512, a time area 513 for displaying the current time, a year/month/day Sunday area 514 for displaying today's year/month/day, and a user name area 515 for displaying the name of a user who is currently logged in to the mobile terminal device TA. Equipped with.

10, in the mobile terminal device TA, the TA control unit 321 of the TA control processing unit 32 determines whether the TA communication IF unit 31 has received a communication signal (S31). As a result of this determination, when the communication signal is not received (No), the mobile terminal device TA returns the processing to S31, and when the result of the determination is that the communication signal is received (Yes), The mobile terminal device TA executes the next process S32. That is, the mobile terminal device TA waits for reception of a communication signal.

In process S32, the mobile terminal device TA determines the type of the received communication signal by the TA control unit 321. As a result of this determination, when the communication signal received in the process S31 is the second event notification communication signal (second event notification), the mobile terminal device TA executes the next process S33, and in the process S31. When the received communication signal is not the second event notification communication signal (others), this processing is terminated after performing processing S37 which performs appropriate processing according to the communication signal received in processing S31.

In process S33, the mobile terminal device TA monitors the monitored person Ob by the TA monitoring processing unit 322 of the TA control processing unit 32, which is contained in the second event notification communication signal received from the management server device SV in process S31. The monitoring information regarding the information is stored (recorded) in the TA monitoring information storage unit 331.

Next to this process S33, the TA monitoring processing unit 322 displays a screen corresponding to each information contained in the second event notification communication signal received in the process S31 on the TA display unit 36 (S34), and the next process Execute S35. More specifically, when the event information contained in the second event notification communication signal received in the processing S31 is the predetermined action, the TA monitoring processing unit 322 displays the monitoring information screen shown in FIG. 12, for example. When 52 is displayed on the TA display unit 36, while the event information contained in the second event notification communication signal received in step S31 is the nurse call, for example, a nurse call acceptance screen 53 shown in FIG. Is displayed on the TA display unit 36.

The monitoring information screen 52 is a screen for displaying the monitoring information regarding the monitoring of the monitored person Ob. For example, as shown in FIG. 12, the monitoring information screen 52 includes a menu bar area 511, a placement location of the sensor device SU having the sensor ID stored in the second event notification communication signal received in step S31, and A monitored person name area 521 that displays the name of the monitored person Ob monitored by the sensor device SU having the sensor ID, and the reception time of the second event notification communication signal received in step S31 (or the predetermined action (Detection time), and a detection information display area 522 that displays the event information (detection result of the predetermined action) contained in the second event notification communication signal received in step S31, and step S31. An image area 523 for displaying an image (that is, a target image captured by the sensor device SU having the sensor ID) (here, a still image) contained in the received second event notification communication signal, and “corresponding” A button 524, a “talk” button 525, and a “watch live” button 526 are provided.

In order to display the installation location of the sensor device SU and the name of the monitored person Ob in the monitored person name area 521, the sensor ID stored in the second event notification communication signal received in step S31 is used as a search key to detect the sensor. The location of the device SU and the name of the monitored person Ob are retrieved from the TA sensor information storage unit 332 and displayed. In the detection information display area 522, the detection result (in the present embodiment, the names of getting up, leaving the bed, falling, and falling) stored in the second event notification communication signal received in step S31 may be displayed as it is. However, in this embodiment, the detection result is displayed as an icon symbolically. In order to display with this icon, the TA storage unit 33 stores in advance each action and an icon that symbolically represents the action in association with each other. In the example shown in FIG. 12, the detection information display area 522 displays a wake-up icon that symbolically wakes up. The “correspondence” button 524 is used on the monitoring information screen 52 to indicate that the detection result displayed on the monitoring information screen 52 is to be subjected to a predetermined response (response, coping) such as lifesaving, nursing, care and assistance. It is a button for inputting into the portable terminal device TA the implementation intention information indicating that the user of the portable terminal device TA is present. The “speak” button 525 is a button for requesting a voice call, and is for inputting an instruction to connect the sensor device SU having the sensor ID and the mobile terminal device TA via the network NW in a callable manner. Button. The “view live” button 526 is a button for requesting a live moving image, and is a button for inputting an instruction to display a moving image captured by the sensor device SU with the sensor ID.

The nurse call reception screen 53 is a screen for displaying reception of a nurse call. This nurse call acceptance screen 53 is, for example, as shown in FIG. 13, a menu bar area 511, a monitored person name area 521, a detection information display area 522, and a message indicating that the nurse call has been accepted (for example, " A nurse call reception notification display area 531 for displaying "Nurse call"), a "corresponding" button 524, and a "speak" button 525 are provided. In the nurse call acceptance screen 53, only the elapsed time from the reception time (or the acceptance time at which the nurse call is accepted) of the second event notification communication signal received in step S31 is displayed in the detection information display area 522. ..

The nurse call reception screen 53 may further include a “view live” button 526.

In the process S35, the mobile terminal device TA determines by the TA control processing unit 32 whether or not an input operation is accepted by the touch panel including the TA input unit 35 and the TA display unit 36 (S35). If the result of this determination is that an input operation has not been received (No), the mobile terminal device TA returns the processing to step S35, while if the result of this determination is that an input operation has been received, the mobile terminal device TA The device TA executes the next process S36.

In this processing S36, the portable terminal device TA executes the appropriate processing according to the content of the input operation by the TA control processing unit 32, and ends this processing.

For example, in the mobile terminal device TA, when the TA control processing unit 32 receives an input operation of the “corresponding” button 524 from the TA input unit 35 forming the touch panel (that is, when the correspondence intention is received), first, At present, the monitoring information of the monitored person Ob displayed on the TA display unit 36 is stored in the TA monitoring information storage unit 331 with a message that "corresponding" has been accepted. More specifically, the TA control processing unit 32 monitors the monitored person Ob currently displayed on the TA display unit 36 in the TA monitoring information table MT-TA stored in the TA monitoring information storage unit 331. In the corresponding field 3316 of the record in which the information is registered (here, the record in which the monitoring information contained in the second event notification communication signal received in the processing S31 is registered) is a corresponding flag "1" indicating acceptance of the corresponding information. To register. Then, the TA control processing unit 32 accommodates the sensor ID corresponding to the monitoring information of the monitored person Ob displayed on the TA display unit 36 and the information indicating that “corresponding” has been received (corresponding reception information). A communication signal (correspondence acceptance notification communication signal) is transmitted to the management server device SV. The management server device SV that has received the correspondence reception notification communication signal uses the SV control processing unit 22 to communicate the sensor ID contained in the received correspondence reception notification communication signal and the communication signal containing the correspondence reception information (the correspondence reception notification communication Signal) to the terminal devices SP and TA by broadcast communication. As a result, the fact that “corresponding” has been accepted for the sensor ID corresponding to the monitoring information of the monitored person Ob displayed on the TA display unit 36 is synchronized between the terminal devices SP and TA.

Further, for example, when the TA control processing unit 32 accepts the input operation of the “talk” button 525, the mobile terminal device TA causes the call processing unit 323 to monitor the monitored person Ob displayed on the TA display unit 36. A communication signal (call request communication signal) containing information such as a request for a voice call is transmitted to the sensor device SU, and the corresponding sensor device SU is connected via the network NW so that a voice call is possible. This enables a voice call between the mobile terminal device TA and the sensor device SU. When the TA control processing unit 32 receives an input operation of an unillustrated “end” button, which is a button for inputting an instruction to end the voice call, the mobile terminal device TA causes the call processing unit 323 to perform TA A communication signal (call end communication signal) containing information such as a request for ending the voice call is transmitted to the sensor device SU that monitors the monitored person Ob displayed on the display unit 36. As a result, the voice call between the mobile terminal device TA and the sensor device SU is terminated.

Further, for example, when the mobile terminal device TA receives an input operation of the “view live” button 526 by the TA control processing unit 32, the TA streaming processing unit 324 causes the TA streaming processing unit 324 to display the monitored target currently displayed on the TA display unit 36. A communication signal (video distribution request communication signal) containing information such as a request for live video distribution is transmitted to the sensor device SU monitoring the person Ob, and the corresponding sensor device SU and network NW are transmitted. A moving image is downloadably connected via the sensor device SU, and a live moving image is received from the sensor device SU, and the received moving image is displayed on the TA display unit 36 by streaming reproduction. On the monitoring information screen 52 that displays the live moving image, the moving image is displayed in the image area 523, and a "live end" button (not shown) is displayed in place of the "view live" button 526. As a result, a live moving image is displayed on the mobile terminal device TA. The “live end” button (not shown) is a button for requesting the end of the moving image, and ends (stops) the distribution of the moving image captured by the sensor device SU with the sensor ID and ends the display (stop). ) Is a button for inputting an instruction. When the mobile terminal device TA accepts the input operation of the “live end” button by the TA control processing unit 32, the TA streaming processing unit 324 monitors the monitored person Ob currently displayed on the TA display unit 36. A communication signal (video communication end communication signal) containing information such as a request to end the video distribution is transmitted to the sensor device SU, and a still image is displayed on the TA display unit 36. As a result, the mobile terminal device TA ends the display of the live video.

Regarding the second event notification communication signal received from the management server device SV, the mobile terminal device TA operates as described above.

As described above, the monitored person monitoring system MS in the present embodiment, the management server device SV as an example of the central processing device, and the central processing method implemented therein detect the sensor device SU and the sensor device SU. Since the terminal devices SP and TA, which are the transmission destinations of the detected results, are associated with each other in a many-to-one manner, the user (monitor) who handles the terminal devices SP and TA is the monitored person Ob other than his/her own responsibility. It is possible to avoid notification of the detection result to. In addition, by setting the correspondence relationship such that a plurality of sensor devices SU spatially arranged within a certain range are associated with one terminal device SP, TA, the monitor person spatially self It is possible to avoid notification of the detection result to the monitored person Ob far from the position. Therefore, in the above-mentioned monitored person monitoring system MS, the management server device SV and the central processing method, even if the detection result is notified, the monitored person Ob in charge of himself or the monitored person Ob within a certain spatial range is observed. Since it is the detection result of the above, it is possible to respond smoothly, and in the above-mentioned case, it is possible to smoothly take the monitored person Ob who is ready to move, and thus the monitored person monitoring system MS, The management server device SV and the central processing method can further improve the work efficiency.

In addition, in the above-described embodiment, the correspondence may be dynamically changed according to the location of the mobile terminal device TA. Then, in such a case, preferably, the correspondence is dynamically changed according to the location of the mobile terminal device TA and then fixed for a predetermined time. For example, the location of the mobile terminal device TA can be detected by identifying the access point communicating with the mobile terminal device TA from the plurality of access points. Therefore, by associating one access point and a plurality of sensor devices SU arranged within a certain range from the access point with each other in advance, the correspondence relationship becomes the location of the mobile terminal device TA. It can be changed dynamically. More specifically, the management server device SV identifies the access point communicating with the mobile terminal device TA from among the plurality of access points, and the plurality of sensor devices SU associated with the identified access point. Is associated with the mobile terminal device TA as a correspondence relationship with the current location of the mobile terminal device TA.

In order to represent the present invention, the present invention has been described above appropriately and sufficiently through the embodiments with reference to the drawings, but those skilled in the art can easily modify and/or improve the embodiments. It should be recognized that this is possible. Therefore, unless a modification or improvement carried out by a person skilled in the art is at a level that deviates from the scope of rights of the claims recited in the claims, the modification or the improvement is covered by the scope of rights of the claims. Is understood to be included in.

MS monitored person monitoring system SU, SU-1 to SU-4 sensor device SV management server device SP fixed terminal device TA, TA-1, TA-2 portable terminal device FT-SV, FT-TA monitoring function operation status information table 11 image pickup unit 12 sensor side sound input/output unit (SU sound input/output unit)
13 Nurse call acceptance operation unit 14 Sensor-side control processing unit (SU control processing unit)
15 Sensor side communication interface section (SU communication IF section)
16 Sensor side storage unit (SU storage unit)
21 Server side communication interface section (SV communication IF section)
22 Server side control processing unit (SV control processing unit)
23 Server-side storage (SV storage)
31 Terminal side communication interface section (TA communication IF section)
32 Terminal side control processing unit (TA control processing unit)
33 Terminal side storage unit (TA storage unit)
34 Terminal side sound input/output section (TA sound input/output section)
35 Terminal side input section (TA input section)
36 Terminal side display (TA display)
37 Terminal side interface section (TAIF section)
141 Sensor side control unit (SU control unit)
142 Action detection processing unit 143 Nurse call processing unit 144 Sensor side streaming processing unit (SU streaming processing unit)
221 Server side control unit (SV control unit)
222 Server side monitoring processing unit (SV monitoring processing unit)
231 Server-side monitoring information storage unit (SV monitoring information storage unit)
232 Inter-device information storage unit 233 Server-side sensor information storage unit (SV sensor information storage unit)
321 Terminal side control unit (TA control unit)
322 Terminal side monitoring processing unit (TA monitoring processing unit)
323 Call processing unit 324 Terminal side streaming processing unit (TA streaming processing unit)
331 Terminal side monitoring information storage unit (TA monitoring information storage unit)
333 Terminal side sensor information storage unit (TA sensor information storage unit)

Claims (3)

A plurality of sensor devices provided corresponding to each of the monitored persons, which detect the monitored person, are connected to each of the plurality of sensor devices so as to be able to communicate with each other, and are received from each of the plurality of sensor devices. A central processing unit that manages each monitoring information related to each monitored person based on each detection result; and a plurality of terminal devices that are communicably connected to the central processing unit and that receive and display the monitoring information, The central processing unit in a monitored person monitoring system for monitoring each of a plurality of monitored persons,
A communication unit that performs communication,
A destination terminal information storage unit that stores a correspondence relationship between the sensor device and a terminal device that is a transmission destination that transmits monitoring information regarding the monitored person based on the detection result received from the sensor device;
When a detection result is received from the sensor device, a monitoring process of transmitting the received detection result to a terminal device corresponding to the sensor device based on the correspondence stored in the destination terminal information storage unit. Section and
The correspondence relation, for each space to a range state, and are related to a plurality of sensor devices for one terminal device is associated,
The central processing unit , wherein the correspondence is dynamically changed according to the location of the terminal device. A plurality of sensor devices provided corresponding to each of the monitored persons, which detect the monitored person, are connected to each of the plurality of sensor devices so as to be able to communicate with each other, and are received from each of the plurality of sensor devices. A central processing unit that manages each monitoring information related to each monitored person based on each detection result; and a plurality of terminal devices that are communicably connected to the central processing unit and that receive and display the monitoring information, A central processing method in a monitored person monitoring system for monitoring each of a plurality of monitored persons,
A storage step of storing a correspondence relationship between the sensor device and a terminal device that is a transmission destination to which the monitoring information regarding the monitored person based on the detection result received from the sensor device is stored in a transmission destination terminal information storage unit,
When a detection result is received from the sensor device, a monitoring process of transmitting the received detection result to a terminal device corresponding to the sensor device based on the correspondence stored in the destination terminal information storage unit. And a process
The correspondence relation, for each space to a range state, and are related to a plurality of sensor devices for one terminal device is associated,
The central processing method , wherein the correspondence is dynamically changed according to the location of the terminal device . A plurality of sensor devices provided corresponding to each of the monitored persons, which detect the monitored person, are connected to each of the plurality of sensor devices so as to be able to communicate with each other, and are received from each of the plurality of sensor devices. A central processing unit that manages each monitoring information related to each monitored person based on each detection result; and a plurality of terminal devices that are communicably connected to the central processing unit and that receive and display the monitoring information, A monitored person monitoring system for monitoring each of a plurality of monitored persons,
The monitored person monitoring system, wherein the central processing unit is the central processing unit according to claim 1.

Images