JP6686523B2 - Monitored person monitoring apparatus, method and system - Google Patents

Description

  The present invention relates to a monitored person monitoring device, a monitored person monitoring method, and a monitored person monitoring system for monitoring a monitored person who is a monitoring target to be monitored.

  Japan is aging society due to the improvement of living standards, the improvement of hygiene environment and the improvement of medical care, etc. accompanying the post-war high economic growth. Is over 21% in a super-aging society. In 2005, the total population was 127.65 million, but the number of elderly people aged 65 and over was 255.6 million. In 2020, the total population was 124.11 million. It is predicted that the elderly population will be about 3,456,000. In such an aging society, those requiring nursing care or those requiring nursing care (such as those requiring nursing care) due to illnesses, injuries, or the elderly are those who are in a normal society that is not an aging society. It is expected to increase more than the above. And Japan is also a declining birthrate society with a total fertility rate of 1.43 in 2013, for example. For this reason, elderly care is also occurring in which an elderly family member (spouse, child, brother) takes care of an elderly person requiring nursing care.

  Nursing-required persons enter a facility such as a hospital or a welfare facility for the aged (in accordance with Japanese law, a short-term facility for the aged, a nursing home for the elderly and a nursing home for the elderly, etc.) and receive their nursing and care. In such a facility, a situation may occur in which a nurse or the like suffers an injury, such as a fall from a bed or a fall while walking, or gets out of bed and wanders around. It is necessary to respond to such a situation as soon as possible. Moreover, if such a situation is left untreated, it may develop into a more serious situation. Therefore, in the above facility, a nurse, a caregiver or the like checks the safety and condition of the facility by regularly patrol.

  However, the increase in the number of nurses and the like cannot keep up with the increase in the number of nurses and the like, and there is a chronic shortage of manpower in the nursing industry and the nursing care industry. Further, the number of nurses, caregivers and the like is reduced in the semi-night shift and night shift hours compared to the day shift hours, so that the work load per person is increased. Therefore, it is required to reduce the work load. In addition, the situation of old-age care is not an exception even in the above-mentioned facilities, and elderly nurses and the like often take care of elderly care recipients and the like. In general, as older people lose their physical strength, even if they are healthy, the burden of nursing, etc. will be heavier than that of young nurses, and their movements and judgment will be slow.

  In order to reduce the labor shortage and the burden on nurses and the like, there is a demand for a technology that complements nursing work and nursing care work. For this reason, in recent years, a monitored person monitoring technique for monitoring (monitoring) a monitored person such as a nurse requiring monitoring is to be monitored and developed.

  As one of such techniques, there is a nurse call system disclosed in Patent Document 1, for example. The nurse call system disclosed in Patent Document 1 is installed in a bed to allow a patient to call a nurse, and a nurse call device installed in a nurse station to answer a call by the nurse call device. A nurse call system having a nurse call base unit, a camera for imaging a patient on a bed from above the bed, and a state in which the patient is upright and the patient is separated from the bed from the image captured by the camera. The nurse call master unit has a notification unit for receiving the caution state generation signal and performing a notification operation. Then, this nurse call system transmits a captured image of the camera to the mobile terminal in response to the mobile terminal carried by the nurse to respond to the call from the nurse call slave and the attention state generation signal. And a communication control means for performing.

  On the other hand, in terms of confirmation of safety, a single person living alone is the same as the person requiring care and is a monitored person.

JP, 2014-90913, A

  When the image of the camera is displayed on the terminal device as in the nurse call system disclosed in Patent Document 1, a supervisor such as a nurse can visually recognize the situation of a monitored person such as a nurse. Therefore, it is convenient. By the way, if the supervisor always provides care and assistance to the monitored person, the monitored person will rely on the monitored person, and the independence of the monitored person will be lost. For this reason, in the practice of nursing care and assistance, the observer encourages the monitored person to become independent, causes the monitored person to perform desired actions as much as possible, and when the monitored person determines that a dangerous situation is likely to occur. Nursing care and assistance are provided to avoid the above dangers. In such practice, the watcher must attend the watchee under the watchee from the start to the end of the desired action in the watchee. In the nurse call system disclosed in Patent Document 1, the monitor can observe the situation of the monitored person by the image of the camera, so that it is not always necessary to accompany the monitored person under the monitored person, The person must continue to watch the video from the beginning to the end of the desired action. For this reason, the supervisor needs to keep watching over the one monitored person from the start to the end of the desired operation in the one monitored person. It is difficult to improve efficiency.

  The present invention has been made in view of the above circumstances, and an object thereof is to provide a monitored person monitoring device, a monitored person monitoring method, and a monitored person monitoring system that can further improve work efficiency. .

  As a result of various studies, the present inventor has found that the above object can be achieved by the following invention. That is, the monitored person monitoring apparatus according to an aspect of the present invention stores an event notification communication signal for notifying the event, which stores event information indicating the content of a predetermined event related to the monitored person who is the monitoring target. A monitored person monitoring device for notifying a terminal device that is communicatively connected, a communication unit that performs communication, an image acquisition unit that acquires an image, and the monitored object based on the image acquired by the image acquisition unit. An independence determination processing unit that determines whether or not an observer can be independent, and if the independence determination processing unit determines that the monitored person cannot be independent, a warning notification communication signal containing warning information indicating a warning is transmitted. A warning notification processing unit for transmitting to the terminal device by the communication unit is provided. Preferably, in the above-mentioned monitored person monitoring device, the predetermined event is a predetermined action in the monitored person. Preferably, in the above-mentioned monitored person monitoring device, the predetermined event is a nurse call.

  Such a monitored person monitoring device includes the independence determination processing unit and the warning notification processing unit, and when the independence determination processing unit determines that the monitored person cannot stand on his / her own, sends a warning notification communication signal to the terminal device. Send to. Therefore, the terminal device that has received this warning notification communication signal can notify the person who handles the terminal device by a warning that it has been determined that the person being monitored cannot stand on its own. Therefore, since the monitoring person can receive the notification of the warning, it is not always necessary to keep watching over the one monitored person from the start to the end of the desired operation of the monitored person. During that time, you can do other tasks. Therefore, the monitored person monitoring device can further improve the work efficiency.

Then , in the above-mentioned monitored person monitoring device, the independence determination processing unit, a movement amount calculation unit that obtains a total movement amount of the monitored person within a predetermined time based on the image acquired by the image acquisition unit, and the obtained in-movement-distance calculation section on the basis of the total amount of movement of the monitored person the monitored person Ru and a moving amount autonomous determination unit that determines whether it is autonomously. Preferably, in the above-mentioned monitored person monitoring device, the movement amount independence determination unit, when the total movement amount of the monitored person obtained by the movement amount calculation unit is equal to or more than a preset first threshold value, It is determined that the monitored person cannot stand on his own.

  Accumulation of fatigue is considered to induce failure of the desired action when performing the desired action. Further, since it is considered that the more the moving amount is, the more the fatigue accumulates, and thus the degree of the accumulated fatigue can be evaluated by the total moving amount within the predetermined time. The monitored person monitoring device determines whether or not the monitored person can be self-supporting based on the total movement amount, so that it is possible to determine whether or not the monitored person can be self-supporting with the degree of accumulated fatigue. It is possible to more appropriately determine whether or not the person to be monitored is independent.

Then, a monitored person monitoring method according to another aspect of the present invention is an event notification communication for notifying the event, which stores event information indicating the content of a predetermined event related to the monitored person to be monitored. A monitored person monitoring method of notifying a signal to a terminal device connected in a communicable manner, wherein the monitored person can stand on the basis of an image acquisition step of acquiring an image and the image acquired in the image acquisition step. Independence determination processing step to determine whether or not, when it is determined that the monitored person in the independence determination processing step can not be independent, a warning notification communication signal containing warning information indicating a warning to the terminal device, and a warning notification process step of transmitting a communication unit for communicating, the autonomous determination processing step, the total amount of movement of the monitored person in a predetermined time period based on the image acquired by the image acquisition step A moving amount calculating step of obtaining, the Rukoto and a moving amount autonomous determination step of determining whether the monitored person can be self-supporting on the basis of the total amount of movement of the monitored person determined by the movement amount calculating step Characterize.

Such a monitored person monitoring method includes the independence determination processing step and the warning notification processing step, and when the monitored person is determined not to be independent in the independence determination processing step, a warning notification communication signal is sent to the terminal device. Send to. Therefore, the terminal device that has received this warning notification communication signal can notify the person who handles the terminal device by a warning that it has been determined that the person being monitored cannot stand on its own. Therefore, since the monitoring person can receive the notification of the warning, it is not always necessary to keep watching over the one monitored person from the start to the end of the desired operation of the monitored person. During that time, you can do other tasks. Therefore, the monitored person monitoring method can further improve the work efficiency. The monitored person monitoring method determines whether or not the monitored person can stand on the basis of the total movement amount, so that it is possible to determine whether or not the monitored person can stand by the degree of accumulated fatigue. It is possible to more appropriately determine whether or not the person to be monitored is independent .

Further, a monitored person monitoring system according to another aspect of the present invention is a terminal device and event information that is communicatively connected to the terminal device and that indicates the content of a predetermined event related to the monitored person who is the monitoring target. And a monitored person monitoring apparatus for notifying an event notification communication signal for notifying the event, the monitored person monitoring apparatus including: The apparatus is characterized in that it is the above-mentioned monitored person monitoring apparatus. Preferably, in the above-described monitored person monitoring system, the monitored person monitoring device includes a sensor device and a management server device communicatively connected to the sensor device, and the sensor device is a monitored target to be monitored. The predetermined event related to a person to the management server device, the management server device re-notifies the terminal device when the notification is received from the sensor device, and the terminal device is the sensor device. Can be called.

  Since such a person-to-be-monitored monitoring system includes any one of the above-mentioned person-to-be-monitored monitoring apparatuses, the work efficiency can be further improved.

  The monitored person monitoring apparatus, the monitored person monitoring method, and the monitored person monitoring system according to the present invention can further improve the work efficiency.

It is a figure which shows the structure of the to-be-monitored person monitoring system in embodiment. It is a figure which shows the structure of the sensor apparatus in the to-be-monitored person monitoring system of embodiment. It is a figure which shows the structure of the management server apparatus in the to-be-monitored person monitoring system of embodiment. It is a figure which shows the structure of the server side monitoring information table memorize | stored in the said management server apparatus shown in FIG. It is a figure which shows the structure of the apparatus information table memorize | stored in the said management server apparatus shown in FIG. It is a figure which shows the structure of the server side sensor information table memorize | stored in the said management server apparatus shown in FIG. It is a figure which shows the structure of the portable terminal device in the to-be-monitored person monitoring system of embodiment. 3 is a flowchart showing the operation of the sensor device shown in FIG. 2. 4 is a flowchart showing an operation of the management server device shown in FIG. 3. 8 is a flowchart showing an operation of the mobile terminal device shown in FIG. 7. FIG. 8 is a diagram showing an example of a standby screen displayed on the mobile terminal device shown in FIG. 7. It is a figure which shows an example of the monitoring information screen displayed on the portable terminal device shown in FIG. It is a figure which shows an example of the nurse call reception screen displayed on the portable terminal device shown in FIG.

  An embodiment of the present invention will be described below with reference to the drawings. In addition, in each of the drawings, the same reference numerals denote the same components, and the description thereof will be appropriately omitted. In the present specification, reference numerals without suffixes are used for generic names, and reference numerals with suffixes are used when referring to individual configurations.

  The person-to-be-monitored monitoring system according to the embodiment monitors a person to be monitored (person to be watched) Ob which is a target to be watched (to be watched) (to be watched), and communicates with a terminal device and the terminal device. And a monitored device that is connected to the monitored device. The monitored person monitoring device in the monitored person monitoring system includes event information indicating the content of a predetermined event (event) related to the monitored person Ob (for example, a predetermined event that needs to be dealt with), and a monitored person related to the event. An event notification communication signal for notifying the event, which contains the image of the observer Ob, is notified to the terminal device. More specifically, this monitored person monitoring device determines whether the monitored person can stand on the basis of a communication unit that performs communication, an image acquisition unit that acquires an image, and an image acquired by the image acquisition unit. If the independence determination processing unit for determining whether or not the monitored person cannot independence in the independence determination processing unit, an alarm notification communication signal containing warning information indicating a warning is sent to the terminal device to the communication unit. And a warning notification processing unit that is transmitted by. Such a monitored person monitoring device may be integrally configured by one device, but in the present embodiment, the monitored person monitoring device can communicate with the sensor device and each of the sensor device and the terminal device. And a management server device connected to the device, the two types of devices are separately configured. The sensor device detects the predetermined event related to the monitored person Ob and notifies (notifies and transmits) the management server device. When the management server device receives the notification from the sensor device, the management server device re-notifies (re-notifies or re-transmits) the notification to a predetermined terminal device associated with the sensor device. Moreover, the sensor device temporally continuously transmits the images generated by imaging the imaging target to the management server device. The management server device determines whether or not the monitored person can stand on the basis of the image acquired from the sensor device, and when it is determined that the monitored person cannot stand on its own, sends the warning notification communication signal Send to the terminal device. The terminal device may be one type of device, but in the present embodiment, the terminal device is two types of devices, a fixed terminal device and a mobile terminal device. The main difference between the fixed terminal device and the mobile terminal device is that the fixed terminal device is fixedly operated, while the mobile terminal device is operated while being carried by a supervisor (user) such as a nurse or a caregiver. Since the fixed terminal device and the mobile terminal device are substantially the same, the mobile terminal device will be mainly described in the following embodiments.

  FIG. 1 is a diagram showing a configuration of a monitored person monitoring system in the embodiment. FIG. 2 is a diagram showing the configuration of the sensor device in the monitored person monitoring system of the embodiment. FIG. 3 is a diagram showing the configuration of the management server device in the monitored person monitoring system of the embodiment. 3A shows the overall configuration, FIG. 3B shows the configuration of the independence determination processing unit 223a of the first aspect, and FIG. 3C shows the independence determination processing unit 223a of the second aspect. The configuration is shown. FIG. 4 is a diagram showing a configuration of a server-side monitoring information table stored in the management server device shown in FIG. FIG. 5 is a diagram showing a configuration of an inter-device information table stored in the management server device shown in FIG. 5A shows the configuration of the notification destination correspondence relationship information table of the inter-device information table, and FIG. 5B shows the configuration of the communication address correspondence relationship information table of the inter-device information table. FIG. 6 is a diagram showing a configuration of a server side sensor information table stored in the management server device shown in FIG. FIG. 7: is a figure which shows the structure of the portable terminal device in the to-be-monitored person monitoring system of embodiment.

  More specifically, the monitored person monitoring system MS in the embodiment, for example, as shown in FIG. 1, one or a plurality of sensor devices SU (SU-1 to SU-4), a management server device SV, A fixed terminal device SP, one or more mobile terminal devices TA (TA-1, TA-2), and a private branch exchange (PBX, Private branch exchange) CX are provided, and these are wired or wireless, and LAN (Local). A network (network, communication line) NW such as Area Network is communicably connected. The network NW may be provided with a repeater such as a repeater, a bridge, and a router that relays communication signals. In the example shown in FIG. 1, the plurality of sensor devices SU-1 to SU-4, the management server device SV, the fixed terminal device SP, the plurality of mobile terminal devices TA-1 and TA-2, and the private branch exchange CX are L2 switches. Line concentrators (hubs, HUBs) LS and access points AP, and both wired and wireless LANs (for example, LANs conforming to the IEEE 802.11 standard) NW are communicatively connected to each other. More specifically, the plurality of sensor devices SU-1 to SU-4, the management server device SV, the fixed terminal device SP and the private branch exchange CX are connected to the concentrator LS, and the plurality of mobile terminal devices TA-1 and TA-2. Is connected to the line concentrator LS via the access point AP. The network NW forms a so-called intranet by using Internet protocol groups such as TCP (Transmission control protocol) and IP (Internet protocol).

  The monitored person monitoring system MS is arranged at an appropriate place according to the monitored person Ob. The person to be monitored (person to be watched) Ob is, for example, a person who needs nursing due to illness or injury, a person who needs nursing care due to deterioration of physical ability, or a single person living alone. In particular, from the viewpoint of enabling early detection and early action, the monitored person Ob may be a person who needs to be detected when a predetermined inconvenient event such as an abnormal state occurs in the person. preferable. Therefore, the monitored person monitoring system MS is preferably installed in a building such as a hospital, a welfare facility for the aged, and a dwelling unit according to the type of the monitored person Ob. In the example illustrated in FIG. 1, the monitored-person monitoring system MS is installed in a building of a nursing care facility including a plurality of living rooms RM in which a plurality of monitored persons Ob live and a plurality of rooms such as a nurse station.

  The sensor device SU has a communication function for communicating with other devices SV, SP, TA via the network NW, and is a device for notifying the management server device SV of a predetermined event (event) related to the monitored person Ob. is there. The predetermined event (event) is preferably a predetermined event that needs to be dealt with, and in the present embodiment, for example, a predetermined action and a nurse call in the person Ob to be monitored. Therefore, in the present embodiment, the sensor device SU detects a predetermined action in the monitored person Ob, notifies (transmits) the detection result to the management server device SV as an example of the predetermined event, and accepts a nurse call. As another example of the predetermined event, the nurse call is notified (transmitted) to the management server device SV, a voice call is performed with the terminal devices SP and TA, and an image including a moving image is generated to generate the terminal. This is a device for delivering a moving image to the devices SP and TA. Such a sensor device SU is, for example, as shown in FIG. 2, an imaging unit 11, a sensor-side sound input / output unit (SU sound input / output unit) 12, a nurse call acceptance operation unit 13, and a sensor-side control process. A unit (SU control processing unit) 14, a sensor side communication interface unit (SU communication IF unit) 15, and a sensor side storage unit (SU storage unit) 16.

  The imaging unit 11 is a device that is connected to the SU control processing unit 14 and generates an image (image data) under the control of the SU control processing unit 14. The image includes a still image (still image data) and a moving image (moving image data). The imaging unit 11 is arranged so as to be able to monitor a space (location space, in the example shown in FIG. 1, a room (room) RM of the installation location) where the monitored person Ob who is a monitoring target is to be monitored. An image (image data) of a bird's eye view of the imaging target is generated from the upper side of the location space as an imaging target, and the image of the imaging target (target image) is output to the SU control processing unit 14. Preferably, since there is a high probability that the entire monitored person Ob to be monitored can be imaged, the imaging unit 11 determines that the head of the monitored person Ob is positioned in the bedding (such as a bed) on which the monitored person Ob lies down. It is arranged so that the imaging target can be imaged from immediately above a predetermined preset head position (usually the pillow disposition position). The sensor unit SU acquires an image of the monitored person Ob from above the monitored person Ob, preferably an image captured from directly above the planned head position, by the image capturing unit 11.

  The imaging unit 11 as described above may be a device that generates an image of visible light, but in the present embodiment, it is a device that generates an infrared image so that the monitored person Ob can be monitored even in a relatively dark place. . In the present embodiment, for example, such an image pickup unit 11 has an image forming optical system that forms an infrared optical image of an image pickup object on a predetermined image forming surface, and a light receiving surface is aligned with the image forming surface. And an area image sensor that is arranged and converts an infrared optical image of the imaging target into an electrical signal, and data representing an infrared image of the imaging target by image-processing the output of the area image sensor. The digital infrared camera includes an image processing unit that generates image data. In the present embodiment, the imaging optical system of the imaging unit 11 is preferably a wide-angle optical system (a so-called wide-angle lens (including a fisheye lens)) having an angle of view capable of imaging the entire living room RM in which the imaging unit 11 is arranged. .

  The SU sound input / output unit 12 is a circuit that inputs and outputs sounds. That is, the SU sound input / output unit 12 is a circuit that is connected to the SU control processing unit 14 and that generates and outputs a sound according to an electric signal representing the sound under the control of the SU control processing unit 14, It is a circuit for acquiring the sound of and inputting it to the sensor device SU. The SU sound input / output unit 12 includes, for example, a speaker that converts an electric signal of sound (sound data) into a mechanical vibration signal of sound (acoustic signal), and a microphone that converts a mechanical vibration signal of sound in the audible region into an electric signal. And so on. The SU sound input / output unit 12 outputs an electric signal representing an external sound to the SU control processing unit 14, and converts the electric signal input from the SU control processing unit 14 into a mechanical vibration signal of sound and outputs the mechanical vibration signal. .

  The nurse call acceptance operation unit 13 is a switch circuit such as a push-button switch that is connected to the SU control processing unit 14 and that inputs a nurse call to the sensor device SU. Note that the nurse call acceptance operation unit 13 may be connected to the SU control processing unit 14 by wire, or may be connected to the SU control processing unit 14 by short-range wireless communication such as Bluetooth (registered trademark) standard.

  The SU communication IF unit 15 is a communication circuit that is connected to the SU control processing unit 14 and performs communication under the control of the SU control processing unit 14. The SU communication IF unit 15 generates a communication signal containing data to be transferred, which is input from the SU control processing unit 14, according to a communication protocol used in the network NW of the monitored person monitoring system MS, and the generated communication. The signal is transmitted to the other devices SV, SP, TA via the network NW. The SU communication IF unit 15 receives communication signals from other devices SV, SP, TA via the network NW, extracts data from the received communication signals, and the SU control processing unit 14 can process the extracted data. The data is converted into data of any format and output to the SU control processing unit 14. The SU communication IF unit 15 includes, for example, a communication interface circuit according to the IEEE 802.11 standard or the like.

  The SU storage unit 16 is a circuit that is connected to the SU control processing unit 14 and stores various predetermined programs and various predetermined data under the control of the SU control processing unit 14. The various predetermined programs include, for example, a SU control program that controls each unit of the sensor device SU in accordance with the function of each unit, and a SU monitoring processing program that executes predetermined information processing for monitoring the monitored person Ob. Control processing programs such as The SU monitoring processing program detects a predetermined action in the monitored person Ob and notifies the predetermined result to the predetermined terminal devices SP and TA via the management server SV as an example of the predetermined event. When a nurse call is accepted by the action detection processing program or the nurse call accepting / operation unit 13, the fact is notified to the management server SV as another example of the predetermined event, and the SU sound input / output unit 12 or the like is used. A nurse call processing program for making a voice call with the terminal devices SP and TA, and an SU streaming processing program for streaming the moving image generated by the imaging unit 11 to the terminal devices SP and TA that requested the moving image. included. For each of the various types of predetermined data, each program such as a sensor device identifier (sensor ID) that is an identifier for identifying and identifying the sensor device SU of the device itself and a communication address of the management server device SV is executed. It includes the data necessary for doing so. The SU storage unit 16 includes, for example, a ROM (Read Only Memory) which is a non-volatile storage element, and an EEPROM (Electrically Erasable Programmable Read Only Memory) which is a rewritable non-volatile storage element. The SU storage unit 16 includes a RAM (Random Access Memory) or the like that serves as a working memory of the so-called SU control processing unit 14 that stores data and the like generated during execution of the predetermined program.

  The SU control processing unit 14 controls each unit of the sensor device SU in accordance with the function of each unit, and notifies the management server SV of a predetermined event (event) related to the monitored person Ob that needs to be dealt with. It is a circuit for. More specifically, in the present embodiment, the SU control processing unit 14 detects a predetermined action in the monitored person Ob and notifies the management server SV of the detection result as an example of the predetermined event (notification, (Transmitting), accepting the nurse call, notifying (notifying, transmitting) the nurse call to the management server SV as another example of the predetermined event, and making a voice call between the terminal devices SP and TA, and moving images. Is generated, the moving image is distributed to the terminal devices SP and TA, and the images are continuously transmitted to the management server device in time for determination of independence. The SU control processing unit 14 includes, for example, a CPU (Central Processing Unit) and its peripheral circuits. The SU control processing unit 14 executes the control processing program, whereby the sensor side control unit (SU control unit) 141, the behavior detection processing unit 142, the nurse call processing unit 143, and the sensor side streaming processing unit (SU streaming process). Part) 144 functionally.

  The SU control unit 141 controls each unit of the sensor device SU according to the function of each unit, and controls the entire control of the sensor device SU. Then, in the present embodiment, the SU control unit 141 transmits the images at the predetermined time intervals obtained by the imaging unit 11 to the management server device SV in order to determine the independence. The predetermined time interval is a sufficient time length for generating the movement trajectory of the monitored person Ob, and is, for example, 0.5 seconds, 1 second, and 2 seconds. The SU control unit 141 may collectively send a predetermined number of images generated at the predetermined time intervals to the management server device SV. Alternatively, the sensor device SU may transmit the moving image to the management server device SV.

  The behavior detection processing unit 142 detects a preset predetermined behavior of the monitored person Ob and notifies the management server SV of the detection result as an example of the predetermined event. More specifically, in the present embodiment, the predetermined action is, for example, a wake-up of the monitored person Ob, a wake-up of the monitored person Ob from the bedding, a fall of the monitored person Ob falling from the bedding, And, there are four actions of the fall of the monitored person Ob. Then, the behavior detection processing unit 142, for example, detects the head of the monitored person Ob based on the target image captured by the image capturing unit 11, and detects the temporal change in the size of the detected head of the monitored person Ob. Based on this, the waking up, leaving the bed, falling, and falling of the monitored person Ob are detected. More specifically, first, a location area of the bedclothes BD, a first threshold Th1 for identifying the size of the head in the recumbent posture and a size of the head in the sitting posture, and a location area of the bedclothes BD in the location area of the bedclothes BD. 2nd threshold value Th2 for identifying whether it is the size of the head in the standing posture in the living room RM other than, and the size of the head in the recumbent posture in the living room RM excluding the location area of the bedding BD. The third threshold value Th3 for identifying whether or not it is stored in advance in the SU storage unit 16 as one of the various kinds of predetermined data. Then, the action detection processing unit 142 extracts a moving body region as a region of the person of the monitored person Ob from the target image by, for example, the background difference method or the frame difference method, and extracts, for example, a circular or elliptical Hough from the extracted moving body region. The head region of the monitored person Ob is extracted by conversion, by pattern matching using a prepared head model, or by a neural network learned for head detection, and the extracted head region is extracted. Detects wake-up, leaving the bed, falls and falls from the position and size of. For example, the action detection processing unit determines that the position of the extracted head is within the location area of the bedding BD, and the size of the extracted head is calculated from the size of the recumbent posture by using the first threshold Th1. When the size of the sitting posture changes with time, it is determined that the user is awake and the awakening is detected. For example, when the position of the extracted head changes with time from inside the area where the bedclothes BD is located to outside the area where the bedclothes is located, the behavior detection processing unit 142 determines that the size of the extracted head is the second area. When the threshold value Th2 is used to change with time from a certain size to the size of the standing posture, it is determined that the user is out of bed and the above-mentioned leaving is detected. For example, when the action detection processing unit 142 changes the position of the extracted head with time from inside the area where the bedding BD is located to outside the area where the bedding BD is located, the size of the extracted head is the first area. When the size changes from a certain size to the size of the recumbent posture with time by using the three threshold value Th3, it is determined to fall and the fall is detected. For example, the behavior detection processing unit 142 uses the extracted head position in the living room RM excluding the area where the bedding BD is located, and the extracted head size uses the third threshold Th3. When the size changes from the size of the lying position to the size of the recumbent posture, it is determined to be a fall and the fall is detected.

  In this way, when the predetermined action is detected, the action detection processing unit 142 notifies the event that the event information (event information) indicating the content of the predetermined event (event) related to the monitored person Ob is stored. The SU communication IF unit 15 notifies the management server device SV of the first event notification communication signal. More specifically, the action detection processing unit 142 includes a communication signal (first event notification communication signal) containing the sensor ID of the own device, event information indicating the content of the event, and a target image used for detecting the predetermined action. ) Is transmitted to the management server device SV via the SU communication IF unit 15. In the present embodiment, the event information is one or more of wake-up, wake-up, fall, fall, and nurse call (NC). Here, the action detection processing unit 142 detects the wake-up, wake-up, fall, and fall. One or more of the falls are accommodated in the first event notification communication signal as the event information. The image may be at least one of a still image and a moving image, and in the present embodiment, as will be described later, the still image is first notified and the moving image is delivered in response to a user request. First, the moving image may be distributed, or the still image and the moving image may be transmitted, and the still image and the moving image may be displayed on the terminal devices SP and TA by screen division.

  When the nurse call reception operation unit 13 receives a nurse call, the nurse call processing unit 143 notifies the management server device SV of a first event notification communication signal accommodating that fact as another example of the predetermined event. By using the SU sound input / output unit 12 and the like, a voice call is made between the terminal devices SP and TA. More specifically, when the nurse call accepting operation unit 13 is input, the nurse call processing unit 143 performs SU communication of the sensor ID of the own device and the first event notification communication signal accommodating the nurse call as the event information. It is transmitted to the management server SV via the IF unit 15. Then, the nurse call processing unit 143 uses the SU sound input / output unit 12 and the like to make a voice call with the terminal devices SP and TA by, for example, VoIP (Voice over Internet Protocol).

  When there is a request for distribution of a moving image from the fixed terminal device SP or the mobile terminal device TA via the communication IF unit 3, the SU streaming processing unit 144 sends the request to the fixed terminal device SP or the mobile terminal device TA. The moving image (for example, a live moving image) generated by the image pickup unit 11 is distributed by streaming reproduction via the SU communication IF unit 15.

  In FIG. 1, as an example, four first to fourth sensor devices SU-1 to SU-4 are shown, and the first sensor device SU-1 is Mr. A who is one of the monitored persons Ob. The second sensor device SU-2 is arranged in a living room RM-1 (not shown) of Ob-1 and is arranged in a living room RM-2 (not shown) of Mr. B Ob-2 who is one of the monitored persons Ob. The third sensor device SU-3 is installed in the room RM-3 (not shown) of Mr. C. Ob-3, who is one of the monitored persons Ob, and the fourth sensor device SU-4, It is arranged in the room RM-4 (not shown) of Mr. D Ob-4 who is one of the monitored persons Ob.

  The management server device SV has a communication function of communicating with other devices SU, TA, and SP via the network NW, and when receiving the notification of the predetermined event from the sensor device SU, information regarding monitoring of the monitored person Ob ( Monitoring information (in the present embodiment, for example, the predetermined event (a predetermined action type detected by the sensor device SU or a nurse call accepted by the sensor device SU), an image (still image and moving image) of the monitored person Ob, and (The time when the notification is received, etc.)), and notifies (re-notification, re-notification, transmission) the predetermined event to the predetermined terminal devices SP and TA, and the client (in this embodiment, the terminal devices SP and TA, etc.). ) Is provided to the client to manage the entire monitored person monitoring system MS. Then, in the present embodiment, the management server device SV acquires an image from each of the plurality of sensor devices SU via the network NW, and determines whether or not the monitored person can be independent based on the acquired image. As a result, when it is determined that the independence cannot be achieved, the warning notification communication signal containing the warning information indicating the warning is transmitted to the predetermined terminal devices SP and TA. Such a management server device SV includes, for example, as shown in FIG. 3, a server-side communication interface unit (SV communication IF unit) 21, a server-side control processing unit (SV control processing unit) 22, and a server-side storage unit. (SV storage unit) 23.

  Like the SU communication IF unit 15, the SV communication IF unit 21 is a communication circuit that is connected to the SV control processing unit 22 and performs communication under the control of the SV control processing unit 22. The SV communication IF unit 21 includes, for example, a communication interface circuit conforming to the IEEE 802.11 standard or the like. In the present embodiment, as described above, the image used for determining the independence is generated by the image pickup unit 11 of the sensor device SU, and the management server device SV sends the image to the sensor device SU via the network NW. The SV communication IF unit 21 corresponds to an example of an image acquisition unit that acquires an image. In addition, when the sensor device SU and the management server device SV are integrally configured, the imaging unit 11 corresponds to an example of an image acquisition unit that acquires an image.

  The SV storage unit 23 is a circuit which is connected to the SV control processing unit 22 and stores various predetermined programs and various predetermined data under the control of the SV control processing unit 22. The various predetermined programs include, for example, an SV control program that controls each unit of the management server device SV according to the function of each unit, and an SV monitoring process that executes predetermined information processing regarding monitoring of the monitored person Ob. Based on the program and the image acquired by the SV communication IF unit 21, the independence determination processing program for determining whether or not the monitored person Ob can be independent, and the monitored person Ob cannot be independent by the independence determination processing program. When the determination is made, a control processing program such as a warning notification processing program for transmitting a warning notification communication signal accommodating warning information indicating a warning to the predetermined terminal devices SP and TA by the SV communication OF unit 21 is included. In the independence determination processing program, the total movement amount within a predetermined time is calculated based on the image acquired by the SV communication IF unit 21, and whether the monitored person Ob can stand on the basis of the calculated total movement amount. A first program and the like for determining It should be noted that, in the self-sustaining determination processing program, instead of or in addition to the first program, a moving speed is calculated based on an image acquired by the SV communication IF unit 21, and the target speed is calculated based on the calculated moving speed. A second program for determining whether or not the observer Ob can be independent may be included. The various predetermined data includes a server identifier (server ID) for identifying the management server device SV and identifying the management server device SV of the device itself, the monitoring information of the monitored person Ob, and the predetermined data. Data necessary for executing each program such as inter-device information indicating information among the devices SU, SP, TA such as event notification destinations, sensor information regarding the sensor device SU, movement information of the monitored person Ob, etc. Is included. In order to store these monitoring information, inter-device information, sensor information, and movement information, the SV storage unit 23 includes a server-side monitoring information storage unit (SV monitoring information storage unit) 231, an inter-device information storage unit 232, and a server side. A sensor information storage unit (SV sensor information storage unit) 233 and a movement information storage unit 234 are functionally provided.

  The SV monitoring information storage unit 231 stores the monitoring information of the monitored person Ob transmitted / received to / from each of the devices SU, SP, TA. More specifically, in the present embodiment, the SV monitoring information storage unit 231 stores, as the monitoring information, information contained in communication signals such as a first event notification communication signal and a response reception notification communication signal described later. Based on this, the sensor ID, event information (event information, waking up, leaving the bed, falling, falling and nurse call in the present embodiment), reception time, target image (still image and moving image), and presence / absence of coping are stored in association with each other. It

  In the present embodiment, this monitoring information is stored in the SV monitoring information storage unit 321 in a table format. The server-side monitoring information table (SV monitoring information table) MT-SV, which registers this monitoring information, stores the sensor IDs contained in the communication signals received from the respective devices SU, SP, TA, as shown in FIG. 4, for example. A sensor ID field 2311 to be registered, an event field (event field) 2312 for registering event information contained in the received communication signal, a reception time field 2313 for registering a reception time of the received communication signal, and the reception The still image field 2314 for registering the still image contained in the communication signal, and the communication address (for example, IP address) of the sensor device SU corresponding to the sensor ID contained in the received communication signal as the acquisition destination of the live video. Etc.) to be registered in the video field 2315 and the received communication signal. A corresponding field 2316 for registering the presence or absence of the corresponding reception to the event information comprises a record for each communication signal thus received (for each event). In the still image field 2314, for example, image data of a still image may be registered, and for example, a file name of image data of a still image may be registered. In the correspondence field 2316, as will be described later, the terminal devices SP and TA accept that the event information contained in the received communication signal has a willingness to deal with (correspondence, treatment, measures) (“corresponding”) A flag (corresponding flag) indicating whether or not it is registered. For example, in the present embodiment, the correspondence field 2316 indicates that there is an intention to deal with the event information (the event information registered in the event field 2312) contained in the received communication signal (“corresponding”). Correspondence flag “1” meaning that the device SP or TA has accepted it, or that the terminal device SP or TA has an intention to handle the event information contained in the received communication signal (“corresponding”) The corresponding flag “0”, which means not accepted, is registered. Note that, by default, the correspondence field 2316 is registered with the correspondence flag “0”, which means unaccepted. When the first event notification communication signal contains the detection time at which the predetermined action is detected or the nurse call reception time at which the nurse call is received, the detection time or the nurse instead of the reception time. The call reception time may be registered.

  In the present embodiment, the inter-device information storage unit 232 indicates, as the inter-device information, a notification destination (re-notification destination, re-notification destination, transmission destination) of the first event notification communication signal or the like transmitted from the sensor device SU. , The correspondence between the sensor ID that is the transmission source and the terminal ID that is the notification destination (re-notification destination) (correspondence of the notification destination), and the IDs (sensor ID, terminal ID) of each of the devices SU, SP, and TA and their The correspondence relationship with the communication address (communication address correspondence relationship) and the like are stored. The terminal ID is a terminal identifier for identifying the terminal devices SP and TA and identifying the terminal devices SP and TA.

  In the present embodiment, the notification destination correspondence relationship and the communication address correspondence relationship are respectively stored in the inter-device information storage unit 232 in a table format. For example, as shown in FIG. 5A, the notification destination correspondence relationship information table AT in which the notification destination correspondence relation is registered includes a transmission source field 2321 in which the sensor ID of the transmission source sensor device SU is registered, and a transmission source field. The sensor ID (sensor device SU) is provided with a notification destination field 2322 that registers the terminal ID of the transmission destination terminal device SP or TA that transmits the communication signal notified from the sensor device SU corresponding to the sensor ID registered in 2321. Each) has a record. The communication address correspondence information table DT for registering the communication address correspondence is, for example, as shown in FIG. 5B, a terminal ID field 2323 for registering the terminal IDs of the terminal devices SP and TA, and a terminal ID field 2323. The communication address field 2324 for registering the communication addresses of the terminal devices SP and TA corresponding to the terminal ID registered in 1. and a record for each terminal ID (terminal device SP, TA).

  Each of the sensor ID, the server ID, and the terminal ID may be, for example, a serial number or the like formed of a predetermined symbol string, or may be, for example, a communication address (in this case, the communication address correspondence can be omitted).

  The SV sensor information storage unit 233 stores the sensor information. In the present embodiment, the sensor information is information about the sensor device SU, and is information in which the sensor ID of the sensor device SU and the monitored person name of the monitored person Ob are associated with each other.

  In the present embodiment, such sensor information is stored in the SV sensor information storage unit 233 in a table format. More specifically, the sensor information table ST-SV for registering sensor information includes, for example, as shown in FIG. 6, a sensor ID field 2331 for registering a sensor ID and a sensor registered in the sensor ID field 2331. An installation location field 2332 for registering the installation location of the sensor device SU having the ID, and a monitored person Ob (that is, the sensor) monitored by the sensor device SU having the sensor ID registered in the sensor ID field 2331. The monitored person name field 2333 for registering the monitored person name of the monitored person Ob) who is at the installation location of the sensor device SU having the sensor ID registered in the ID field 2331 and the sensor ID field 2331 are registered. Sensor device SU having the existing sensor ID, its installation location and its monitored person And a remarks field 2334 for registering the remarks relating b, with a record for each sensor ID (i.e., sensor devices SU).

  The movement information storage unit 234 stores movement information relating to the movement of the monitored person Ob in association with the monitored person Ob in order to use it for determining the independence of the monitored person Ob. In the present embodiment, the movement information is, for example, the total movement amount of the monitored person Ob within a predetermined time. Further, for example, the movement information is the movement speed of the monitored person Ob. In the present embodiment, since the sensor device SU is provided in the room RM in which the monitored person Ob is present, the movement information is the sensor of the sensor device SU provided in the room RM in which the monitored person Ob is present. By being associated with the ID, it is associated with the monitored person Ob.

  In the present embodiment, such movement information is stored in the movement information storage unit 234 in a table format. The action information table for registering the movement information includes, for example, a sensor ID field (monitored person ID field) for registering a sensor ID of the sensor device SU arranged in the room RM in which the monitored person Ob is present, and a sensor ID. A movement information field for registering movement information of the monitored person Ob at the location of the sensor device SU having the sensor ID registered in the field is provided, and a record is provided for each sensor ID (observed person Ob).

  The SV control processing unit 22 controls each unit of the management server device SV according to the function of each unit, and when receiving the notification of the predetermined event from the sensor device SU, manages the monitoring information regarding the monitoring of the monitored person Ob. Then, the predetermined event is notified (re-notification, re-notification, transmission) to the predetermined terminal devices SP and TA, and a warning is issued according to the independence determination result of the monitored person Ob. Is a circuit for managing the entire monitored person monitoring system MS by transmitting the data to the client according to the request of the client. The SV control processing unit 22 includes, for example, a CPU and its peripheral circuits. The SV control processing unit 22 executes the control processing program, whereby the server side control unit (SV control unit) 221, the server side monitoring processing unit (SV monitoring processing unit) 222, the independence determination processing unit 223, and the warning. The notification processing unit 224 is functionally provided.

  The SV control unit 221 controls each unit of the management server device SV according to the function of each unit, and controls the entire management server device SV.

  When receiving the notification of the predetermined event from the sensor device SU, the SV monitoring processing unit 222 manages the monitoring information regarding the monitoring of the monitored person Ob, and notifies the predetermined terminal device SP, TA of the predetermined event. is there. More specifically, when the SV monitoring processing unit 222 receives the first event notification communication signal from the sensor device SU, the SV monitoring processing unit 222 monitors the monitored person Ob contained in the received first event notification communication signal. Information is stored (recorded) in the SV monitoring information storage unit 231. Then, the SV monitoring processing unit 222 stores the notification destination (re-notification destination, transfer destination, transmission destination) corresponding to the sensor device SU that has transmitted the received first event notification communication signal in the inter-device information storage unit 232. Further, the second event notification communication signal is selected (searched) from the notification destination correspondence relationship and transmitted to the selected terminal devices SP and TA. This selection (search process) is performed based on the sensor ID corresponding to the sensor device SU that transmitted the received first event notification communication signal. If the event information contained in the first event notification communication signal is the predetermined action (one or more of getting up, leaving the bed, falling, and falling), the second event notification communication signal The communication address corresponding to the sensor device SU having the sensor ID contained in the first event notification communication signal is contained as the download destination of the sensor ID contained in the 1 event notification communication signal, the event information and the target image, and the moving image. To be done. This communication address is selected (searched) from the communication address correspondence based on the sensor ID corresponding to the sensor device SU that transmitted the received first event notification communication signal.

  The independence determination processing unit 223 determines whether or not the monitored person Ob can stand on the basis of the image acquired by the SV communication IF unit 21. More specifically, the independence determination processing unit 223 acquires each image generated by each sensor device SU in the SV communication IF unit 21 from each sensor device SU via the network NW, and ( That is, for each monitored person Ob), it is determined whether or not the monitored person Ob can stand on the basis of the acquired image.

  As such an independence determination processing unit 223, for example, the independence determination processing unit 223a of the first mode shown in FIG. 3B or the independence determination processing unit 223b of the second mode shown in FIG. 3C is used.

  The independence determination processing unit 223a of the first aspect illustrated in FIG. 3B is within a predetermined time based on each image acquired by the SV communication IF unit 21 for each sensor device SU (for each monitored person Ob). Based on the total movement amount calculated by the movement amount calculation unit 2231a for each sensor device SU and the movement amount calculation unit 2231a for each sensor device SU, it is determined whether each monitored person Ob can stand by himself or herself. And a movement amount self-sustaining determination unit 2232a.

  The predetermined time is, for example, past 6 hours, past 1 day, past 1 week, or the like. In this case, in order to obtain the total exercise amount of each monitored person Ob, the movement amount calculation unit 2231a acquires each image from each sensor device SU at a predetermined time interval by the SV communication IF unit 21 via the network NW. To do. The predetermined time interval is a sufficient time length for generating the movement trajectory of the monitored person Ob, and is, for example, 0.5 seconds, 1 second, and 2 seconds. Note that the movement amount calculation unit 2231a may acquire a plurality of predetermined images generated at the predetermined time intervals from the sensor device SU. Alternatively, the moving amount calculation unit 2231a may acquire the moving image from the sensor device SU. Then, the movement amount calculation unit 2231a executes the following processes for each image acquired from each sensor device SU. In a certain monitored person ID (that is, a certain sensor ID), first, the movement amount calculation unit 2231a extracts a moving body region from the difference between the image acquired last time and the image acquired this time, and the center of gravity of this moving body region is extracted. Find the position. Then, the difference between the position of the center of gravity at the previous time (the position of the center of gravity at the previous time obtained based on the image acquired at the time before the last time and the image acquired at the time of the previous time) and the position of the center of gravity at this time is calculated, and movement from the time of the previous time to this time is performed. The amount of movement is calculated, and the calculated movement amount at this time is stored in the movement information storage unit 234 in association with the certain sensor ID. Then, the movement amount calculation unit 2231a retrieves the movement amount within a predetermined time past past the present time point (current time point), which is stored in the movement information storage unit 234 in association with the certain sensor ID. , The total sum of the extracted movement amounts is calculated. As a result, the total movement amount of the monitored person Ob within a predetermined time is obtained for the certain sensor ID. Then, for the certain sensor ID, the movement amount independence determination unit 2232a determines whether or not the monitored person Ob can stand on the basis of the total movement amount obtained by the movement amount calculation unit 2231a. More specifically, the movement amount independence determination unit 223a determines that the monitored person Ob cannot be independent when the total movement amount calculated by the movement amount calculation unit 2231a is equal to or more than a preset first threshold value. .

  Accumulation of fatigue is considered to induce failure of the desired action when performing the desired action. Further, since it is considered that the more the moving amount is, the more the fatigue accumulates, and thus the degree of the accumulated fatigue can be evaluated by the total moving amount within the predetermined time. In the first aspect, it is determined whether or not the monitored person Ob can stand on the basis of the total movement amount. Therefore, it is possible to determine whether or not the monitored person Ob can stand by the degree of accumulated fatigue. The management server device SV including the independence determination processing unit 233a of one aspect can more appropriately determine the independence of the monitored person.

  The independence determination processing unit 223b of the second mode shown in FIG. 3C moves for each sensor device SU (for each monitored person Ob) based on each image acquired by the SV communication IF unit 21. Based on the moving speed calculation unit 2231b for obtaining the speed and the moving speeds calculated by the moving speed calculation unit 2231b for each sensor device SU, the moving speed self-sustaining determination unit for judging whether or not each monitored person Ob can stand by himself / herself. 2232b. This moving speed is obtained by dividing the current moving amount obtained as described above by the predetermined time interval for acquiring an image from the sensor device SU. Then, for the certain sensor ID, the moving speed independence determination unit 2232b determines whether or not the monitored person Ob can stand on the basis of the moving speed of the monitored person Ob obtained by the moving speed calculation unit 2231b. . More specifically, the moving speed independence determination unit 2232b determines that the monitored person Ob is in a case where the moving speed of the monitored person Ob obtained by the moving speed calculation unit 2231b is equal to or less than a preset second threshold value. Judge that he cannot be independent.

  A slow moving speed is considered to be a result of accumulated fatigue in a relatively short period and a decrease in physical strength in a relatively long period. In the second aspect, it is determined whether or not the monitored person can stand on the basis of the moving speed. Therefore, it is possible to determine whether or not the monitored person can stand by the degree of accumulated fatigue. The management server device SV including the independence determination processing unit 233b can more appropriately determine the independence of the monitored person.

  When the independence determination processing unit 223 determines that the monitored person Ob cannot independence, the alert notification processing unit 224 transmits an alert notification communication signal containing warning information indicating a warning to the predetermined terminal devices SP and TA. To do. More specifically, the warning notification processing unit 224 includes the sensor device SU (the sensor device that has transmitted the image used for the determination of the independence) arranged in the room RM in which the monitored person Ob who has been determined to be unable to stand is present. The notification destination (re-notification destination, transfer destination, transmission destination) corresponding to the SU) is selected (retrieved) from the notification destination correspondence relationship stored in the inter-device information storage unit 232, and the selected terminal device SP, TA is selected. A warning notification communication signal is transmitted. In this warning notification communication signal, the warning information, the monitored person Ob who is determined to be unable to stand independently (in the present embodiment, the sensor device SU arranged in the room RM where the monitored person Ob who is determined to be unable to stand independently is present) Sensor ID) is stored.

  Note that the management server device SV is further connected to the SV control processing unit 22 as necessary and is connected to the SV control processing unit 22, for example, a server side input unit (SV input unit) for inputting various commands and various data, as shown in FIG. ) 24, various commands and various data input by the SV input unit 24, a server-side output unit (SV output unit) 25 that outputs monitoring information related to monitoring of the monitored person Ob, and data with external devices. The server-side interface unit (SVIF unit) 26 for inputting and outputting may be provided.

  Such a management server device SV can be configured by, for example, a computer with a communication function.

  The fixed terminal device SP has a communication function of communicating with other devices SU, SV, TA via the network NW, a display function of displaying predetermined information, an input function of inputting predetermined instructions and data, and the like. The user interface (UI) of the monitored person monitoring system MS is input by inputting a predetermined instruction or data given to the management server apparatus SV or the mobile terminal apparatus TA or by displaying the monitoring information obtained by the sensor apparatus SU. ) Is a device that functions as. Such a fixed terminal device SP can be configured by, for example, a computer with a communication function. Although the fixed terminal device SP as an example of the terminal device operates in the same manner as the mobile terminal device TA, this specification describes a mobile terminal device TA as another example of the terminal device.

  The mobile terminal device TA performs a communication function of communicating with other devices SV, SP, SU via the network NW, a display function of displaying predetermined information, an input function of inputting predetermined instructions and data, and a voice call. It is provided with a call function to perform, inputs a predetermined instruction or data to be given to the management server device SV or the sensor device SU, displays the monitoring information obtained by the sensor device SU by a notification from the management server device SV, It is a device for responding to a nurse call or making a voice call by a voice call with the sensor device SU. Then, in the present embodiment, when the warning notification communication signal is received from the management server device SV, the mobile terminal device TA issues a warning regarding independence. In the present embodiment, such a mobile terminal device TA includes a terminal side communication interface section (TA communication IF section) 31, a terminal side control processing section (TA control processing section) 32, as shown in FIG. 7, for example. , Terminal side storage unit (TA storage unit) 33, terminal side sound input / output unit (TA sound input / output unit) 34, terminal side input unit (TA input unit) 35, terminal side display unit (TA display unit) 36 and a terminal side interface unit (TAIF unit) 37.

  Like the SU sound input / output unit 12, the TA sound input / output unit 34 is a circuit that is connected to the TA control processing unit 32, acquires external sound, and inputs the external sound to the mobile terminal device TA. It is a circuit for generating and outputting a sound according to an electric signal representing the sound under the control of the processing unit 32.

  The TA input unit 35 is a circuit that is connected to the TA control processing unit 32, receives, for example, a predetermined operation and inputs the operation to the mobile terminal device TA, and is, for example, a plurality of input switches to which a predetermined function is assigned. . The predetermined operation is related to, for example, an ID input operation for logging in, a voice call request operation and its end operation, a live video request operation and its end operation, and the notified event. Various operations necessary for monitoring, such as input operation indicating that the monitored person Ob has an intention to execute life-saving, nursing, care, assistance, etc. (coping, reception), etc. included. The TA display unit 36 is connected to the TA control processing unit 32, and under the control of the TA control processing unit 32, the predetermined operation content input from the TA input unit 35 and the monitored object monitored by the monitored person monitoring system MS. The monitoring information relating to the monitoring of the observer Ob (for example, the predetermined event (the type of predetermined action detected by the sensor device SU or the nurse call accepted by the sensor device SU), the image of the monitored subject Ob (still image and moving image) , And a circuit for displaying the time when the notification is received, and the like, and is a display device such as an LCD (liquid crystal display) and an organic EL display. In the present embodiment, the touch panel is composed of the TA input section 35 and the TA display section 36. In this case, the TA input unit 35 is a position input device that detects and inputs an operation position, such as a resistance film type or an electrostatic capacitance type. In this touch panel, a position input device is provided on the display surface of the TA display unit 36, and one or more input content candidates that can be input are displayed on the TA display unit 36. For example, a user such as a nurse or a caregiver ( (Monitoring person) touches the display position at which the input content to be input is displayed, the position is detected by the position input device, and the display content displayed at the detected position is displayed on the mobile terminal device TA as the operation input content of the user. Is entered.

  The TAIF unit 37 is a circuit that is connected to the TA control processing unit 32 and that inputs and outputs data to and from an external device under the control of the TA control processing unit 32. For example, the Bluetooth (registered trademark) standard is used. An interface circuit, an interface circuit for performing infrared communication such as IrDA standard, and an interface circuit using USB standard.

  Like the SU communication IF unit 15, the TA communication IF unit 31 is a communication circuit that is connected to the TA control processing unit 32 and performs communication under the control of the TA control processing unit 32. The TA communication IF unit 31 includes, for example, a communication interface circuit conforming to the IEEE 802.11 standard or the like.

  The TA storage unit 33 is a circuit that is connected to the TA control processing unit 32 and stores various predetermined programs and various predetermined data under the control of the TA control processing unit 32. The various predetermined programs include, for example, a TA control program that controls each unit of the mobile terminal device TA according to the function of each unit, and a TA monitoring process that executes predetermined information processing for monitoring the monitored person Ob. A program, a call processing program for making a voice call with the sensor device SU by using the TA sound input / output unit 34, and a distribution of a moving image from the sensor device SU, and a streaming reproduction of the received moving image. A control processing program such as a TA streaming processing program displayed on the TA display unit 36 is included. The various kinds of predetermined data are necessary for executing each program such as the terminal ID of the own device, the screen information displayed on the TA display unit 36, the monitoring information of the monitored person Ob, and the sensor information about the sensor device SU. Data etc. are included. The TA storage unit 33 includes, for example, a ROM and an EEPROM. The TA storage unit 33 includes a RAM serving as a working memory of a so-called TA control processing unit 32 that stores data and the like generated during execution of the predetermined program. The TA storage unit 33 functions as a terminal-side monitoring information storage unit (TA monitoring information storage unit) 331 and a terminal-side sensor information storage unit (TA sensor information storage unit) 332 in order to store each of these monitoring information and sensor information. Prepared for.

  The TA monitoring information storage unit 331 stores the monitoring information. In the present embodiment, the TA monitoring information storage unit 331 uses, as the monitoring information, the sensor ID contained in the second event notification communication signal received from the management server SV, the event information (event information, wake-up in the present embodiment, (Exiting from bed, falling, falling and nurse call), the communication address of the sensor device SU to which the image and the moving image are downloaded, the reception time of the second event notification communication signal, the presence or absence of coping, and the like are stored in association with each other. More specifically, as shown in FIG. 4, the TA monitoring information storage unit 331 stores the monitoring information in a terminal-side monitoring information table (TA monitoring information table) MT-TA similar to the SV monitoring information table MT-SV. Remember.

  The TA sensor information storage unit 332 stores the sensor information. The TA sensor information storage unit 332 stores the sensor ID, the installation location, the monitored person name, and the remark in association with each other. More specifically, as shown in FIG. 6, the TA sensor information storage unit 332 stores the sensor information in a terminal-side sensor information table (TA sensor information table) ST-TA similar to the SV sensor information table ST-SV. Remember.

  The TA control processing unit 32 controls each unit of the mobile terminal device TA in accordance with the function of each unit, receives and displays the monitoring information of the monitored person Ob, and displays a response to a nurse call or a voice call circuit. Is. The TA control processing unit 32 includes, for example, a CPU and its peripheral circuits. The TA control processing unit 32 executes the control processing program, whereby the terminal side control unit (TA control unit) 321, the terminal side monitoring processing unit (TA monitoring processing unit) 322, the call processing unit 323, and the terminal side streaming process. The unit (TA streaming processing unit) 324 is functionally provided.

  The TA control unit 321 controls each unit of the mobile terminal device TA according to the function of each unit, and controls the entire mobile terminal device TA.

  The TA monitoring processing unit 322 executes predetermined information processing regarding monitoring of the monitored person Ob. More specifically, the TA monitoring processing unit 322 receives the second event notification communication signal transmitted by the management server device SV due to the first event notification communication signal transmitted by the sensor device SU. The monitoring information of the monitored person Ob is stored (recorded) in the TA monitoring information storage unit 331 based on each information (each data) contained in the received second event notification communication signal. The TA monitoring processing unit 322 displays on the TA display unit 36 a screen corresponding to each information contained in the received second event notification communication signal. Then, when the TA monitoring processing unit 322 receives a predetermined input operation from the TA input unit 35, the TA monitoring processing unit 322 executes a predetermined process according to the input operation.

  Then, in the present embodiment, when the TA monitoring processing unit 322 receives the warning notification communication signal from the management server device SV, the TA monitoring processing unit 322 issues a warning regarding independence. For example, by issuing a predetermined warning sound or warning message from the TA sound input / output unit 34, the TA monitoring processing unit 322 issues a warning regarding independence. The warning message may include the name of the monitored person Ob for the warning. Further, for example, by displaying a warning screen on the TA display unit 36, the TA monitoring processing unit 322 issues a warning regarding independence. The warning screen may include the name of the monitored person Ob for the warning.

  The call processing unit 323 performs a voice call with the sensor device SU by using the TA sound input / output unit 34 and the like. More specifically, for example, the call processing unit 323 uses the TA sound input / output unit 34 or the like to transmit the first event notification communication signal that is the cause of the transmission of the second event notification communication signal to the management server device SV. A voice call is made with the sensor device SU of the transmission source by using, for example, VoIP.

  The TA streaming processing unit 324 receives a moving image from the sensor device SU and displays the received moving image on the TA display unit 36 by streaming reproduction.

  Such a mobile terminal device TA can be configured by a portable communication terminal device such as a so-called tablet computer, smartphone, or mobile phone.

  Next, the operation of this embodiment will be described. FIG. 8 is a flowchart showing the operation of the sensor device shown in FIG. FIG. 9 is a flowchart showing the operation of the management server device shown in FIG. FIG. 10 is a flowchart showing the operation of the mobile terminal device shown in FIG. FIG. 11 is a diagram showing an example of a standby screen displayed on the mobile terminal device shown in FIG. 7. FIG. 12 is a diagram showing an example of the monitoring information screen displayed on the mobile terminal device shown in FIG. 7. FIG. 13 is a diagram showing an example of a nurse call acceptance screen displayed on the mobile terminal device shown in FIG. 7.

  In the monitored-person monitoring system MS having the above-described configuration, each device SU, SV, SP, TA, when the power is turned on, initializes each required part and starts its operation. In the sensor device SU, by executing the control processing program, the SU control processing unit 14 is functionally configured with the SU control unit 141, the behavior detection processing unit 142, the nurse call processing unit 143, and the SU streaming processing unit 144. .. In the management server device SV, the SV control processing unit 21 functionally includes the SV control unit 211, the SV monitoring processing unit 222, the independence determination processing unit 223, and the warning notification processing unit 224 by executing the control processing program. It Then, in the mobile terminal device TA, the TA control processing unit 32 is functionally configured with the TA control unit 321, the TA monitoring processing unit 322, the call processing unit 323, and the TA streaming processing unit 324 by executing the control processing program. To be done.

  First, the operation of the sensor device SU will be described. The sensor device SU detects a predetermined motion in the monitored person Ob by operating as follows in each frame or every few frames, and also determines whether or not the nurse call is accepted. There is.

  In FIG. 8, first, in the sensor device SU, the SU control unit 141 of the SU control processing unit 14 acquires an image (image data) of one frame from the imaging unit 11 as the target image (S11).

  Next, in the sensor device SU, the action detection processing unit 142 of the SU control processing unit 14 executes an action detection process of detecting a predetermined action in the monitored person Ob based on the target image acquired in the process S11 ( S12). More specifically, the behavior detection processing unit 142 determines whether or not the user wakes up, determines whether or not the user leaves the bed, determines whether or not the fall is successful, and then determines whether or not the fall is successful.

  Next, the sensor device SU determines whether or not the action detection processing unit 142 has detected a predetermined action on the monitored person Ob in the action detection process S12. As a result of this determination, when the predetermined action is not detected (No), the sensor device SU next executes the process S15, while when the predetermined action is detected (Yes). In addition, the sensor device SU executes the process S15 after executing the next process S14.

  In this process S14, in order to notify the predetermined terminal devices SP and TA of the predetermined action detected in the process S12 and the process S13 to the predetermined terminal devices SP and TA via the management server device SV, the sensor device SU uses the action detection processing unit 142 to As a predetermined event, a first event notification communication signal regarding detection of the predetermined action is transmitted to the management server device SV. More specifically, the action detection processing unit 142 stores the sensor ID of the own device, the predetermined event (here, one or more of wake-up, wake-up, fall and fall) and the first target image. The event notification communication signal is transmitted to the management server device SV via the SU communication IF unit 15.

  In the process S15, the sensor device SU determines whether or not the nurse call is accepted by the nurse call processing unit 143. That is, the processes S11 to S16 shown in FIG. 8 are repeatedly executed for each frame or every few frames. However, the process from the previous process S15 to the current process S15 is performed by the nurse. It is determined whether or not the call reception operation unit 13 has been operated. If the result of this determination is that the nurse call acceptance operation unit 13 has not been operated and no nurse call has been accepted (No), the sensor device SU ends this processing this time, while the nurse call acceptance operation unit 13 Is operated and the nurse call is accepted (Yes), the sensor device SU terminates the present process after executing the next process S16.

  In this process S16, the sensor device SU uses the nurse call processing unit 143 to notify the nurse call of which the acceptance is found in the process S15 to the predetermined terminal devices SP and TA via the management server device SV. And transmits a first event notification communication signal related to the management server device SV. More specifically, the nurse call processing unit 143 transmits the first event notification communication signal containing the sensor ID of the own device and the nurse call reception information to the management server device SV via the SU communication IF unit 15.

  The sensor device SU operates as described above for each of detection of a predetermined action and reception of a nurse call in the monitored person Ob.

  On the other hand, the sensor device SU stores a communication signal (a moving information image notification communication signal) containing the sensor ID of the own device and the image captured by the image capturing unit 11 for the management server device SV to use for generating the movement information. ) Is transmitted to the management server device SV.

  Next, the operation of the management server device SV will be described. On the other hand, in FIG. 9, in the management server SV, the SV control unit 221 of the SV control processing unit 22 determines whether the SV communication IF unit 21 has received a communication signal (S21). As a result of this determination, when the communication signal is not received (No), the management server device SV returns the process to S21, and when the result of the determination is that the communication signal is received (Yes), The management server device SV executes the following process S22. That is, the management server device SV waits for reception of a communication signal.

  In process S22, the management server device SV determines the type of the received communication signal by the SV control unit 221. As a result of this determination, when the received communication signal is the first event notification communication signal (first event notification), the management server device SV executes the processing S23 and then the processing S26 to receive the received signal. When the communication signal is the movement information image notification communication signal (movement information image notification), the processing S26 is executed after the processing S24, and the received communication signal is the first event notification communication signal. If it is not the moving information image notification communication signal (others), the process S26 is performed after the process S25.

  In processing S23, the management server device SV processes the first event notification communication signal received from the sensor device SU in processing S21 by the SV monitoring processing unit 222 of the SV control processing unit 22. More specifically, first, the SV monitoring processing unit 222 stores the monitoring information regarding the monitoring of the monitored person Ob contained in the first event notification communication signal received from the sensor device SU in the processing S21, in the SV monitoring information storage unit. 231 is stored (recorded). Then, the SV monitoring processing unit 222 selects a notification destination corresponding to the sensor device SU that has transmitted the first event notification communication signal received in process S21 from the notification destination correspondence relationship stored in the inter-device information storage unit 232. Search for. Next, the SV monitoring processing unit 222 transmits the second event notification communication signal to the selected notification destination terminal devices SP and TA. In the second event notification communication signal, as described above, when the event information contained in the first event notification communication signal received in the process S21 is the predetermined action, the event information is received in the process S21. The communication address corresponding to the sensor device SU having the sensor ID contained in the first event notification communication signal is the download destination of the sensor ID contained in the first event notification communication signal, the event information and the target image, and the moving image. Be accommodated. On the other hand, when the event information contained in the first event notification communication signal received in the process S21 is a nurse call, the sensor ID and the event information contained in the first event notification communication signal received in the process S21. Is housed.

  In process S24, the management server device SV causes the monitored person Ob to be self-supported by the independence determination processing unit 223 of the SV control processing unit 22 based on the image accommodated in the movement information image notification communication signal received in process S21. It is determined whether or not it is possible, and according to the result, the warning notification processing unit 224 of the SV control processing unit 22 transmits a warning notification communication signal to the predetermined terminal devices SP and TA.

  More specifically, when the independence determination processing unit 223 is the independence determination processing unit 223a of the first aspect, the movement amount calculation unit 2231a is included in the movement information image notification communication signal received in the process S21. The movement amount at this time is obtained based on the image, and the obtained movement amount at this time is associated with the sensor ID contained in the movement information image notification communication signal received in the process S21, and the movement information storage unit 234 is associated with the movement information storage unit 234. Remember. Then, the movement amount calculation unit 2231a is stored in the movement information storage unit 234 in association with the sensor ID stored in the movement information image notification communication signal received in the process S21. The movement amount within a predetermined time period earlier than the time point) is extracted, and the sum of the extracted movement amounts is calculated as the total movement amount within the predetermined time period for the sensor ID. Then, the movement amount independence determination unit 2232a determines whether or not the monitored person Ob can stand on the basis of the total movement amount obtained by the movement amount calculation unit 2231a. As a result of this determination, when the total movement amount obtained by the movement amount calculation unit 2231a is equal to or more than the first threshold value, the movement amount independence determination unit 2232a determines that the monitored person Ob cannot stand on his / her own, and calculates the movement amount. When the total movement amount obtained by the unit 2231a is less than the first threshold value, the movement amount independence determination unit 2232a determines that the monitored person Ob can be independent.

  On the other hand, when the independence determination processing unit 223 is the independence determination processing unit 223b of the second aspect, the moving speed calculation unit 2231b determines based on the image contained in the movement information image notification communication signal received in step S21. , Find the moving speed at this time. The amount of movement used when obtaining this moving speed is obtained as described above and stored in the movement information storage unit 234. Then, the moving speed self-sustaining determination unit 2232b determines whether or not the monitored person Ob can stand on the basis of the moving speed obtained by the moving speed calculation unit 2231b. As a result of this determination, when the moving speed calculated by the moving speed calculating unit 2231b is equal to or less than the second threshold value, the moving amount self-sustaining judging unit 2232a judges that the monitored person Ob cannot stand by himself, and the moving speed calculating unit When the moving speed obtained in 2231b exceeds the second threshold value, the moving speed self-sustainability determination unit 2232a determines that the monitored person Ob can stand on his / her own.

  When the independence determination processing unit 223 determines that the monitored person Ob cannot stand on his / her own, the warning notification processing unit 224 is provided with the sensor device SU arranged in the room RM in which the monitored person Ob who is determined to be unable to stand is in the room RM. (Sensor device SU that has transmitted the image used for the determination of independence, in this example, the sensor device SU that is the transmission source of the moving information image notification communication signal received in step S21) Destination, transmission destination) is selected (retrieved) from the notification destination correspondence stored in the inter-device information storage section 232, and a warning notification communication signal is transmitted to the selected terminal devices SP and TA. The warning notification communication signal contains the warning information and the sensor ID of the sensor device SU that is the transmission source of the movement information image notification communication signal received in step S21.

  In the process S25, the management server device SV causes the SV control processing unit 22 to execute an appropriate process according to the communication signal received in the process S21.

  Then, in the process S26 executed after each of these processes S23 to S25, the management server device SV determines by the SV control processing unit 22 whether or not its operation is completed (stopped). If the result of this determination is that operation has ended (stopped) (Yes), the management server device SV ends this processing, while if it has not ended (stopped) operation (No), management The server device SV returns the process to the process S21.

  Regarding each of the first event notification communication signal and the movement information image notification communication signal received from the sensor device SU, the management server device SV operates as described above.

  Next, the operation of the terminal devices SP and TA will be described. Here, the operation of the mobile terminal device TA will be representatively described. As described above, when the power is turned on and the operation of the mobile terminal device TA is started, a login operation by a monitor (user) such as a nurse or a caregiver is accepted, and the TA monitor processing unit 322 causes the mobile terminal device TA to execute the self-operation. A standby screen for waiting for a communication signal addressed to the machine is displayed on the TA display unit 36. This standby screen 51 is, for example, as shown in FIG. 11, a menu bar area 511 that displays a menu bar, and a standby main area that displays a message (for example, “no notification”) indicating that the terminal is in standby and an icon. 512, a time area 513 for displaying the current time, a year / month / day Sunday area 514 for displaying today's year / month / day, and a user name area 515 for displaying the name of the user who is currently logged in to the mobile terminal device TA. Equipped with.

  10, in the mobile terminal device TA, the TA control unit 321 of the TA control processing unit 32 determines whether the TA communication IF unit 31 has received a communication signal (S31). As a result of this determination, when the communication signal is not received (No), the mobile terminal device TA returns the processing to S31, and when the result of the determination is that the communication signal is received (Yes), The mobile terminal device TA executes the following process S32. That is, the mobile terminal device TA waits for reception of a communication signal.

  In step S32, the mobile terminal device TA determines the type of the received communication signal by the TA control unit 321. As a result of this determination, when the communication signal received in the process S31 is the second event notification communication signal (second event notification), the mobile terminal device TA executes the next process S33, and in the process S31. When the received communication signal is the warning notification communication signal (warning notification), the following process S38 is executed, and when the communication signal received in the process S31 is neither the second event notification communication signal nor the warning notification communication signal. In (Other), after performing the processing S37 which performs appropriate processing according to the communication signal received in the processing S31, this processing is ended.

  In process S33, the mobile terminal device TA monitors the monitored person Ob, which is contained in the second event notification communication signal received from the management server device SV in process S31, by the TA monitor processing unit 322 of the TA control processing unit 32. The monitoring information regarding the above is stored (recorded) in the TA monitoring information storage unit 331.

  After this processing S33, the TA monitoring processing unit 322 displays a screen corresponding to each information contained in the second event notification communication signal received in processing S31 on the TA display unit 36 (S34), and the next processing Execute S35. More specifically, when the event information contained in the second event notification communication signal received in the process S31 is the predetermined action, the TA monitoring processing unit 322 displays the monitoring information screen shown in FIG. 12, for example. 52 is displayed on the TA display unit 36, and when the event information contained in the second event notification communication signal received in step S31 is the nurse call, for example, a nurse call acceptance screen 53 shown in FIG. Is displayed on the TA display unit 36.

  The monitoring information screen 52 is a screen for displaying the monitoring information regarding the monitoring of the monitored person Ob. For example, as shown in FIG. 12, the monitoring information screen 52 includes a menu bar area 511, a placement location of the sensor device SU having the sensor ID contained in the second event notification communication signal received in step S31, and The monitored person name area 521 that displays the name of the monitored person Ob monitored by the sensor device SU having the sensor ID, and the reception time of the second event notification communication signal received in step S31 (or the predetermined action). (Detection time), and a detection information display area 522 that displays the event information (detection result of the predetermined action) contained in the second event notification communication signal received in step S31, and step S31. The image contained in the received second event notification communication signal (ie, the image captured by the sensor device SU having the sensor ID). Image) (here it includes an image area 523 for displaying a still image), "corresponding" button 524, a "talk" button 525, a "See LIVE" button 526.

  In order to display the installation location of the sensor device SU and the name of the monitored person Ob in the monitored person name area 521, the sensor ID stored in the second event notification communication signal received in step S31 is used as a search key to detect the sensor. The installation location of the device SU and the name of the monitored person Ob are retrieved from the TA sensor information storage unit 332 and displayed. In the detection information display area 522, the detection result (in the present embodiment, names of getting up, leaving the bed, falling, and falling) stored in the second event notification communication signal received in step S31 may be displayed as it is. However, in the present embodiment, the detection result is displayed as an icon symbolically. In order to display with this icon, each action and an icon symbolizing the action are associated with each other and stored in advance in the TA storage unit 33. In the example shown in FIG. 12, the detection information display area 522 displays a wake-up icon that symbolically wakes up. The “correspondence” button 524 is used on the monitor information screen 52 to indicate that the detection result displayed on the monitor information screen 52 is intended to perform a predetermined response (response, coping) such as lifesaving, nursing, care, and assistance. It is a button for inputting to the portable terminal device TA the intention to implement indicating that the user of the portable terminal device TA is present. The “speak” button 525 is a button for requesting a voice call, and is for inputting an instruction to connect the sensor device SU having the sensor ID and the mobile terminal device TA via the network NW in a callable manner. Button. The “view live” button 526 is a button for requesting a live moving image, and is a button for inputting an instruction to display a moving image captured by the sensor device SU with the sensor ID.

  The nurse call reception screen 53 is a screen for displaying reception of a nurse call. This nurse call acceptance screen 53 is, for example, as shown in FIG. 13, a menu bar area 511, a monitored person name area 521, a detection information display area 522, and a message indicating that the nurse call has been accepted (for example, " A nurse call reception notification display area 531 for displaying "A nurse call"), a "corresponding" button 524, and a "speak" button 525 are provided. In the nurse call acceptance screen 53, only the elapsed time from the reception time (or the acceptance time at which the nurse call is accepted) of the second event notification communication signal received in step S31 is displayed in the detection information display area 522. .

  The nurse call reception screen 53 may further include a “view live” button 526.

  In processing S38, the TA monitoring processing unit 322 warns that the monitored person Ob who is in the room RM where the sensor device SU having the sensor ID stored in the warning notification communication signal received in processing S31 is not self-sustainable. Is notified and the present process is terminated. More specifically, for example, by issuing a predetermined warning sound or warning message from the TA sound input / output unit 34, the TA monitoring processing unit 322 notifies the warning regarding the independence of the monitored person Ob. Further, for example, by displaying a warning screen on the TA display unit 36, the TA monitoring processing unit 322 issues a warning regarding the independence of the monitored person Ob. The warning screen may include the name of the monitored person Ob for the warning. Note that the TA monitoring processing unit 322 displays the monitoring information obtained by the sensor device SU having the sensor ID contained in the warning notification communication signal received in the process S31 without ending this process after the notification of the warning. The monitoring information screen 52 to be displayed may be displayed on the TA display unit 36, and the next process S35 may be executed.

  In the process S35, the mobile terminal device TA determines by the TA control processing unit 32 whether or not an input operation has been accepted by the touch panel including the TA input unit 35 and the TA display unit 36 (S35). If the result of this determination is that an input operation has not been received (No), the mobile terminal device TA returns the processing to step S35, while if the result of this determination is that an input operation has been received, the mobile terminal device TA The device TA executes the next process S36.

  In this process S36, the mobile terminal device TA causes the TA control processing unit 32 to execute an appropriate process according to the content of the input operation, and ends this process.

  For example, in the mobile terminal device TA, when the TA control processing unit 32 receives an input operation of the “corresponding” button 524 from the TA input unit 35 forming the touch panel (that is, when the correspondence intention is received), first, At present, the monitoring information of the monitored person Ob displayed on the TA display unit 36 is stored in the TA monitoring information storage unit 331 with the addition of "corresponding". More specifically, the TA control processing unit 32 monitors the monitored person Ob currently displayed on the TA display unit 36 in the TA monitoring information table MT-TA stored in the TA monitoring information storage unit 331. In the corresponding field 3316 of the record in which the information is registered (here, the record in which the monitoring information contained in the second event notification communication signal received in the process S31 is registered) is the corresponding flag "1" indicating acceptance of the corresponding information. To register. Then, the TA control processing unit 32 accommodates the sensor ID corresponding to the monitoring information of the monitored person Ob displayed on the TA display unit 36 and information indicating that “corresponding” has been received (corresponding reception information). A communication signal (correspondence acceptance notification communication signal) is transmitted to the management server device SV. The management server device SV that has received the correspondence reception notification communication signal uses the SV control processing unit 22 to communicate the sensor ID contained in the received correspondence reception notification communication signal and the communication signal containing the correspondence reception information (the correspondence reception notification communication Signal) to the terminal devices SP and TA by broadcast communication. As a result, the fact that “corresponding” has been accepted for the sensor ID corresponding to the monitoring information of the monitored person Ob displayed on the TA display unit 36 is synchronized between the terminal devices SP and TA.

  Further, for example, when the mobile terminal device TA accepts the input operation of the “talk” button 525 by the TA control processing unit 32, the call processing unit 323 monitors the monitored person Ob displayed on the TA display unit 36. A communication signal (call request communication signal) containing information such as a request for a voice call is transmitted to the sensor device SU, and the corresponding sensor device SU is connected for voice call via the network NW. This enables a voice call between the mobile terminal device TA and the sensor device SU. When the TA control processing unit 32 accepts an input operation of an unillustrated “end” button, which is a button for inputting an instruction to end the voice call, the mobile terminal device TA causes the call processing unit 323 to perform TA A communication signal (call end communication signal) containing information such as a request to end the voice call is transmitted to the sensor device SU that monitors the monitored person Ob displayed on the display unit 36. As a result, the voice call between the mobile terminal device TA and the sensor device SU is terminated.

  Further, for example, in the mobile terminal device TA, when the TA control processing unit 32 accepts the input operation of the “view live” button 526, the TA streaming processing unit 324 causes the TA monitored unit currently displayed on the TA display unit 36 to be monitored. A communication signal (video distribution request communication signal) containing information such as a request for live video distribution is transmitted to the sensor device SU monitoring the person Ob, and the corresponding sensor device SU and network NW are transmitted. A moving image is downloadably connected via the sensor device SU, and a live moving image is received from the sensor device SU, and the received moving image is displayed on the TA display unit 36 by streaming reproduction. On the surveillance information screen 52 that displays the live moving image, the moving image is displayed in the image area 523, and a "live end" button (not shown) is displayed in place of the "view live" button 526. As a result, a live moving image is displayed on the mobile terminal device TA. The “LIVE end” button (not shown) is a button for requesting the end of the moving image, and ends (stops) the distribution of the moving image captured by the sensor device SU with the sensor ID and ends (stops) the display. ) Is a button for inputting an instruction. When the mobile terminal device TA accepts the input operation of the “live end” button by the TA control processing unit 32, the TA streaming processing unit 324 monitors the monitored person Ob currently displayed on the TA display unit 36. A communication signal (video communication end communication signal) containing information such as a request to end the video distribution is transmitted to the sensor device SU, and a still image is displayed on the TA display unit 36. As a result, the mobile terminal device TA ends the display of the live video.

  Regarding the second event notification communication signal received from the management server device SV, the mobile terminal device TA operates as described above.

  As described above, the monitored person monitoring system MS, the sensor device SU and the management server device SV as an example of the monitored person monitoring device in the present embodiment, and the monitored person monitoring method installed therein are independent. The determination processing unit 223 and the warning notification processing unit 224 are provided, and when the independence determination processing unit 223 determines that the monitored person Ob cannot stand on his / her own, the warning notification communication signal is transmitted to the predetermined terminal devices SP and TA. Therefore, the terminal devices SP and TA that have received the warning notification communication signal can notify the person who handles the terminal devices SP and TA by a warning that it is determined that the monitored person Ob cannot stand on his / her own. Therefore, since the monitoring person can be notified of the warning, it is not always necessary to keep watching over the one monitored person Ob from the start to the end of the desired operation of the monitored person Ob. Because there is no, other work can be done in the meantime. Therefore, the monitored person monitoring system MS, the sensor apparatus SU and the management server apparatus SV as an example of the monitored person monitoring apparatus, and the monitored person monitoring method can further improve the work efficiency.

  Although the management server device SV includes the independence determination processing unit 223 (223a, 223b) in the above-described embodiment, the sensor device SU does not include the independence determination processing unit 223, but the sensor device SU does. The unit 223 may be provided. In this case, the sensor device SU transmits the result of the independence determination processing unit 223 to the management server device SV, and the management server device SV issues a warning by the warning notification processing unit 224 according to the independence determination result of the received content. Notify the devices SP and TA.

  Further, in the above-described embodiment, the management server device SV includes the independence determination processing unit 223 (223a, 223b) and the warning notification processing unit 224. However, the management server device SV includes the independence determination processing unit 223 and the warning notification processing unit 224. Instead of including the sensor device SU, the sensor device SU may include the independence determination processing unit 223 and the warning notification processing unit 224. In this case, as the event information transmitted by the sensor device SU notifies the first event notification communication signal of the nurse call to the predetermined terminal devices SP and TA again by the second event notification communication signal, the sensor device The management server device SV may re-notify the predetermined terminal devices SP and TA of the warning notification communication signal (first warning notification communication signal) transmitted by the SU with the second warning notification communication signal.

  Further, in the above-described embodiment, the warning notification processing unit 224 transmits a warning notification communication signal to the predetermined terminal devices SP and TA when the independence determination processing unit 223 determines that the monitored person Ob cannot stand on his / her own. However, the sensor having the sensor ID accommodated in the second event notification communication signal is transmitted only after the second event notification communication signal is transmitted and until the corresponding acceptance notification communication signal for the second event notification communication signal is received. A warning notification communication signal for the monitored person Ob at the installation location of the device SU may be transmitted to the predetermined terminal devices SP and TA.

  In order to represent the present invention, the present invention has been adequately and sufficiently described through the embodiments with reference to the drawings, but those skilled in the art can easily modify and / or improve the above embodiments. It should be recognized that this is possible. Therefore, unless a modification or improvement performed by a person skilled in the art is at a level that departs from the scope of rights of the claims recited in the claims, the modification or the improvement is covered by the scope of rights of the claims. Is understood to be included in.

MS monitored person monitoring system SU, SU-1 to SU-4 sensor device SV management server device SP fixed terminal device TA, TA-1, TA-2 portable terminal device FT-SV, FT-TA monitoring function operation status information table 11 image pickup unit 12 sensor side sound input / output unit (SU sound input / output unit)
13 Nurse call acceptance operation unit 14 Sensor-side control processing unit (SU control processing unit)
15 Sensor side communication interface section (SU communication IF section)
16 Sensor side storage unit (SU storage unit)
21 Server side communication interface section (SV communication IF section)
22 Server side control processing unit (SV control processing unit)
23 Server-side storage (SV storage)
31 Terminal side communication interface section (TA communication IF section)
32 Terminal side control processing unit (TA control processing unit)
33 Terminal side storage unit (TA storage unit)
34 Terminal side sound input / output section (TA sound input / output section)
35 Terminal side input section (TA input section)
36 Terminal display (TA display)
37 Terminal side interface section (TAIF section)
141 Sensor side control unit (SU control unit)
142 Behavior detection processing unit 143 Nurse call processing unit 144 Sensor side streaming processing unit (SU streaming processing unit)
221 Server side control unit (SV control unit)
222 Server side monitoring processor (SV monitoring processor)
223, 223a, 223b Independence determination processing unit 224 Warning notification processing unit 231 Server side monitoring information storage unit (SV monitoring information storage unit)
232 Inter-device information storage unit 233 Server-side sensor information storage unit (SV sensor information storage unit)
234 Movement information storage unit 321 Terminal side control unit (TA control unit)
322 Terminal side monitoring processing unit (TA monitoring processing unit)
323 Call processing unit 324 Terminal side streaming processing unit (TA streaming processing unit)
331 Terminal side monitoring information storage unit (TA monitoring information storage unit)
333 Terminal side sensor information storage unit (TA sensor information storage unit)
2231a moving amount calculating unit 2231b moving speed calculating unit 2232a moving amount self-sustaining judging unit 2232b moving speed self-sustaining judging unit

Claims (3)

Monitored person for notifying the terminal device connected communicatively of an event notification communication signal for notifying the event, which contains event information indicating the content of a predetermined event related to the monitored person A device,
A communication unit that performs communication,
An image acquisition unit that acquires images,
An independence determination processing unit that determines whether or not the monitored person can be independent based on the image acquired by the image acquisition unit,
And a warning notification processing unit that transmits a warning notification communication signal containing warning information indicating a warning to the terminal device in the communication unit when it is determined that the monitored person cannot stand on his / her own. ,
The independence determination processing unit is a movement amount calculation unit that obtains a total movement amount of the monitored person within a predetermined time based on the image acquired by the image acquisition unit, and the monitored person calculated by the movement amount calculation unit. the monitored person monitoring apparatus to the monitored person on the basis of the total amount of movement is characterized Rukoto and a moving amount autonomous determination unit that determines whether it independence. Monitored person for notifying the terminal device connected communicatively of an event notification communication signal for notifying the event, which contains event information indicating the content of a predetermined event related to the monitored person Method,
An image acquisition process for acquiring an image,
An independence determination processing step of determining whether or not the monitored person can be independent based on the image acquired in the image acquisition step,
When it is determined that the monitored person cannot stand on his / her own in the independence determination processing step, an alert notification processing signal for transmitting an alert notification communication signal accommodating warning information indicating a warning to the terminal device in a communication section that performs communication With and
The independence determination processing step includes a movement amount calculation step of obtaining a total movement amount of the monitored person within a predetermined time based on the image acquired in the image acquisition step, and the monitored person calculated in the movement amount calculation step. the monitored person monitoring method the person being monitored is characterized Rukoto a moving amount autonomous determination step of determining whether it is autonomously based on the total amount of movement. A terminal device is communicably connected to the terminal device, and communicates an event notification communication signal for notifying the event, which stores event information indicating the content of a predetermined event related to a monitored person who is a monitoring target. A monitored person monitoring system including a monitored person monitoring device that notifies a terminal device that is operably connected,
The monitored person monitoring apparatus is the monitored person monitoring apparatus according to claim 1, wherein the monitored person monitoring apparatus is a monitored person monitoring system.

Images