JP6226110B1 - Monitored person monitoring apparatus, method and system - Google Patents

Abstract

In the monitored person monitoring apparatus, the monitored person monitoring method, and the monitored person monitoring system according to the present invention, one or more for detecting the predetermined action for each action type in the predetermined action of the monitored person. A behavior detection algorithm is prepared in advance. When a certain behavior detection algorithm is detected, the detection result is first notified together with the image with the algorithm ID, and the type of behavior associated with the algorithm ID is notified by referring to the image. When one or more notifications are notified, the algorithm ID and the action type name are associated with each other, and then the detection result is notified by the action type name associated with the algorithm ID.

Description

  The present invention relates to a monitored person monitoring apparatus, a monitored person monitoring method, and a monitored person monitoring system for monitoring a monitored person to be monitored.

  Japan (Japan) is an aging society due to the improvement of living standards accompanying the post-war high economic growth, the improvement of sanitation environment and the improvement of medical standards, and more specifically, the ratio of population over 65 years to the total population It is a super-aging society with an aging rate exceeding 21%. In 2005, the elderly population over 65 years old was about 25.56 million people compared to the total population of 127.65 million people, while in 2020, the elderly population was about 124.11 million people The population is predicted to be about 34.56 million. In such an aging society, nurses who need nursing or nursing care due to illness, injury, elderly age, etc., or those who need nursing care (such as those who require nursing care) are those who need nursing in a normal society that is not an aging society. This is expected to increase more than Japan, for example, is a society with a declining birthrate with a total fertility rate of 1.43 in 2013. For this reason, elderly care has been taking place in which elderly nurses, etc., are cared for by an elderly family (spouse, child, brother).

  Nurses and the like enter a facility such as a hospital or a welfare facility for the elderly (such as a short-term welfare facility for the elderly, a nursing home for the elderly and a nursing home for the elderly in Japanese law) and receive nursing and care. In such a facility, a situation in which a nurse or the like needs to be injured or fallen out of the bed, for example, by falling from the bed or falling while walking can occur. It is necessary to respond to such a situation as quickly as possible. If such a situation is left unattended, it may develop into a more serious situation. For this reason, in the facility, nurses and caregivers regularly check their safety and state by patrol.

  However, the increase in the number of nurses and the like cannot keep up with the increase in the number of nurses and the like, and the nursing industry and the care industry are chronically short of manpower. Furthermore, since the number of nurses, caregivers and the like is reduced in the semi-night shift and night shift hours compared to the day shift hours, the work load per person increases, and thus the work load is required to be reduced. In addition, the situation of nursing care for the elderly is not an exception in the facility, and it is often seen that elderly nurses and the like care for elderly nurses and the like. In general, physical strength declines when older, so the burden of nursing etc. becomes heavier than young nurses etc. even if they are healthy, and their movements and judgments are also delayed.

  In order to reduce such a labor shortage and a burden on nurses, a technology that complements nursing work and care work is required. For this reason, in recent years, monitored person monitoring techniques for monitoring a monitored person to be monitored, such as a care recipient, have been researched and developed.

  As one of such techniques, Patent Document 1 discloses a medical motion detection apparatus. The medical motion detection apparatus disclosed in Patent Document 1 includes one or more imaging units (1) arranged at one or more different positions in order to image the movement of the care recipient G from one or more angles, An area setting section (3) capable of setting a plurality of arbitrary detection areas (A) for the image of the cared person G captured by the imaging section (1) and the area setting section (3) are set. A threshold value setting unit (4) for setting the threshold value of a change occurring in a part of the image to be adjustable as a reference for determining the occurrence of abnormality of the care receiver G in the plurality of detection areas (A); Based on the threshold value set by the threshold value setting unit (4), an abnormality detection unit (2) for detecting whether or not an abnormality has occurred in the plurality of detection regions (A) set by the region setting unit (3) ) And anomaly detection in the anomaly detection unit (2). Comprising a communication unit that notifies the occurrence and (16), the. And in this patent document 1, regarding the detection region A, for example, in the paragraph [0040], “the user uses a pointing device such as a mouse to form a part corresponding to the characteristics of the care receiver G from the screen in an arbitrary shape. "Specify as detection area A of" and, for example, in the paragraph [0046], the threshold value can be continuously adjusted by the slider 26, and the selected threshold value is adapted to the actual image. The preview can be displayed in the display area 27 ”.

  On the other hand, in terms of safety confirmation, a single person living alone is the same as the above-mentioned nurse requiring care, and becomes a monitored person to be monitored.

  By the way, when an abnormality is notified by the monitored person monitoring device, the supervisor takes measures such as going to the monitored person's site where the abnormality is notified. In the case of misreporting that has been determined to be abnormal and notified that the condition is not abnormal, the action taken by the supervisor is wasted and labor is lost. On the other hand, if an unreported state in which the monitored person monitoring device cannot detect an abnormal state and is not notified occurs, as described above, there is a possibility of developing into a more serious situation. Such errors such as false alarms and misreports often depend on the individuality (characteristics) of the monitored person, and it is desired that the monitored person monitoring device be customized by the individuality (characteristic) of the monitored person. .

  In the medical motion detection device disclosed in Patent Document 1, a detection region and a threshold can be set, and the medical motion detection device can be customized. However, in the medical motion detection apparatus disclosed in Patent Document 1, the user sets the detection region and the threshold value. For this reason, the user predicts the individuality (characteristics) of the cared person G and sets the detection area and threshold value, and the set detection area and threshold value are the actual personality of the cared person G ( (Characteristics) does not match, and an error occurs or it is necessary to reset it. In general, there are a plurality of monitored persons in a facility, and a device is provided for each of the plurality of monitored persons. Therefore, in the medical motion detection apparatus disclosed in Patent Document 1, the user sets the detection area and threshold value for each of a plurality of apparatuses, which is troublesome. Furthermore, if the person monitored by the apparatus is mistaken, the detection area and the threshold value are set to an incorrect value, and an error may occur instead.

JP-A-2015-128967

  The present invention has been made in view of the above-mentioned circumstances, and its object is to provide a monitored person monitoring apparatus and a monitored person monitoring method that can be automatically customized, and a monitored object using the monitored person monitoring apparatus. It is to provide a supervisor monitoring system.

  In the monitored person monitoring apparatus, the monitored person monitoring method, and the monitored person monitoring system according to the present invention, one or more for detecting the predetermined action for each action type in the predetermined action of the monitored person. A behavior detection algorithm is prepared in advance. When a certain behavior detection algorithm is detected, the detection result is first notified together with the image with the algorithm ID, and the type of behavior associated with the algorithm ID is notified by referring to the image. When one or more notifications are notified, the algorithm ID and the action type name are associated with each other, and then the detection result is notified by the action type name associated with the algorithm ID.

  The above and other objects, features and advantages of the present invention will become apparent from the following detailed description and the accompanying drawings.

It is a figure which shows the structure of the to-be-monitored person monitoring system in embodiment. It is a figure which shows the structure of the sensor apparatus in the said to-be-monitored person monitoring system. It is a figure which shows the structure of the management server apparatus in the said to-be-monitored person monitoring system. It is a figure which shows the structure of the reception number table memorize | stored in the said management server apparatus. It is a figure which shows the structure of the action kind name table memorize | stored in the said management server apparatus. It is a figure which shows the structure of the portable terminal device in the said to-be-monitored person monitoring system. It is a flowchart which shows operation | movement of the sensor apparatus in the said to-be-monitored person monitoring system. It is a flowchart which shows operation | movement of the management server apparatus in the said to-be-monitored person monitoring system. It is a flowchart which shows operation | movement of the 1st monitoring information processing in the flowchart shown in FIG. It is a flowchart which shows the operation | movement of the action kind name process in the flowchart shown in FIG. It is a flowchart which shows operation | movement of the portable terminal device in the said to-be-monitored person monitoring system. It is a figure which shows an example of the standby screen displayed on the portable terminal device in the to-be-monitored person monitoring system. It is a figure which shows an example of the 1st monitoring information screen according to algorithm ID displayed on the portable terminal device in the said to-be-monitored person monitoring system. It is a figure which shows an example of the 2nd monitoring information screen according to the action kind name displayed on the portable terminal device in the said to-be-monitored person monitoring system.

  Hereinafter, an embodiment according to the present invention will be described with reference to the drawings. In addition, the structure which attached | subjected the same code | symbol in each figure shows that it is the same structure, The description is abbreviate | omitted suitably. In this specification, when referring generically, it shows with the reference symbol which abbreviate | omitted the suffix, and when referring to an individual structure, it shows with the reference symbol which attached the suffix.

  FIG. 1 is a diagram illustrating a configuration of a monitored person monitoring system according to the embodiment. FIG. 2 is a diagram illustrating a configuration of a sensor device in the monitored person monitoring system according to the embodiment. FIG. 3 is a diagram illustrating a configuration of the management server device in the monitored person monitoring system according to the embodiment. FIG. 4 is a diagram showing a configuration of a reception number table stored in the management server device. FIG. 5 is a diagram showing a configuration of an action type name table stored in the management server device. FIG. 6 is a diagram illustrating a configuration of the mobile terminal device in the monitored person monitoring system according to the embodiment.

  The monitored person monitoring system in the embodiment monitors a monitored person (watched person) Ob that is a monitored object (watched object) to be monitored (watched), and communicates with the terminal device and the terminal device. And a monitored person monitoring device that detects a predetermined action in the monitored person Ob and notifies the terminal device of the predetermined action. The monitored person monitoring apparatus in this embodiment uses one or a plurality of action detection algorithms for executing a detection process for detecting a predetermined action in the monitored person Ob for each of a plurality of different action types in the predetermined action. A behavior detection algorithm information storage unit for storing, a behavior detection algorithm identifier information storage unit for storing a behavior detection algorithm identifier for identifying and identifying the behavior detection algorithm, and all stored in the behavior detection algorithm information storage unit A detection processing unit that executes the detection process using the behavior detection algorithm, and, for all the behavior detection algorithms, as a result of the detection process of the detection processing unit, when the predetermined behavior is detected by the behavior detection algorithm Stored in the action detection algorithm identifier information storage unit The, and a notification processing unit for notifying the detection of the predetermined behavior in behavior detection algorithm identifier corresponding to the behavior detection algorithm with images relating to the monitored person Ob to the terminal device. The notification processing unit receives the behavior type name associated with the behavior detection algorithm identifier and the behavior detection algorithm identifier from the terminal device, and then associates the behavior detection algorithm identifier with the received behavior detection algorithm identifier. Based on the behavior type name of the behavior type, the terminal device detects the predetermined behavior with the behavior type name instead of the behavior detection algorithm identifier or with the behavior type name in addition to the behavior detection algorithm identifier. Inform. The image related to the monitored person is preferably at least one of a still image and a moving image. In the embodiment, the terminal device includes a display unit that performs display, an input unit that performs input, and detection of the predetermined behavior by the behavior detection algorithm identifier together with the image related to the monitored subject Ob. When received from the input unit, the display processing unit that displays the received action detection algorithm identifier and the image related to the monitored person Ob on the display unit, and the action type name of the action type are input from the input unit The action type name of the input action type is associated with the action detection algorithm identifier displayed on the display unit, and the action detection algorithm identifier displayed on the display unit and the input action type input An action type name notification processing unit for returning the action type name to the monitored person monitoring apparatus. Such a monitored person monitoring apparatus may be integrally configured by a single apparatus. However, in the present embodiment, the monitored person monitoring apparatus detects a predetermined action in the monitored person Ob and performs monitoring. A sensor device that executes a first notification to be notified to a management server device to be described later together with the image related to the person Ob, and is connected to the sensor device in a communicable manner, and receives the first notification from the sensor device. By providing a management server device that executes a second notification that notifies the terminal device of the notification of 1, the two devices are configured separately. Although the terminal device may be one type of device, in the present embodiment, the terminal device is two types of devices, a fixed terminal device and a mobile terminal device. The main difference between these fixed terminal devices and portable terminal devices is that the fixed terminal device is fixedly operated, while the portable terminal device is operated by being carried by a supervisor (user) such as a nurse or a caregiver. Since the fixed terminal device and the mobile terminal device are substantially the same, in this embodiment, the mobile terminal device will be mainly described.

  More specifically, such a monitored person monitoring system MS includes, for example, as shown in FIG. 1, one or a plurality of sensor devices SU (SU-1 to SU-4), a management server device SV, A fixed terminal device SP and one or a plurality of portable terminal devices TA (TA-1, TA-2) are provided, which are wired or wireless, such as a LAN (Local Area Network), a telephone network, and a data communication network. Communication is established via a network (network, communication line) NW. The network NW may be provided with relays such as repeaters, bridges, routers, and cross-connects that relay communication signals. In the example illustrated in FIG. 1, the plurality of sensor devices SU-1 to SU-4, the management server device SV, the fixed terminal device SP, and the plurality of portable terminal devices TA-1 and TA-2 are wireless including an access point AP. A LAN (for example, a LAN according to the IEEE 802.11 standard) NW is connected to be communicable with each other.

  The monitored person monitoring system MS is arranged at an appropriate place according to the monitored person Ob. The monitored person (person to be watched) Ob is, for example, a person who needs nursing due to illness or injury, a person who needs care due to a decrease in physical ability, a single person living alone, or the like. In particular, from the viewpoint of enabling early detection and early action, the monitored person Ob may be a person who needs the detection when a predetermined inconvenient event such as an abnormal state occurs in the person. preferable. For this reason, the monitored person monitoring system MS is suitably arranged in a building such as a hospital, an elderly welfare facility, or a dwelling unit according to the type of the monitored person Ob. In the example illustrated in FIG. 1, the monitored person monitoring system MS is disposed in a building of a care facility that includes a plurality of rooms RM in which a plurality of monitored persons Ob live and a plurality of rooms such as a nurse station.

  The sensor device SU includes a communication function that communicates with other devices SV, SP, and TA via the network NW, detects a predetermined action in the monitored person Ob, and an image related to the monitored person Ob Together with the first notification to notify the management server device SV, accepts the nurse call, notifies the management server device SV to that effect, makes a voice call with the terminal devices SP and TA, and plays the video. It is an apparatus that generates an image including the image and distributes a moving image to the terminal apparatuses SP and TA. For example, as shown in FIG. 2, such a sensor device SU includes an imaging unit 11, a sensor side sound input / output unit (SU sound input / output unit) 12, a nurse call reception operation unit 13, and a sensor side control process. Unit (SU control processing unit) 14, sensor side communication interface unit (SU communication IF unit) 15, and sensor side storage unit (SU storage unit) 16.

  The imaging unit 11 is an apparatus that is connected to the SU control processing unit 14 and generates an image (image data) under the control of the SU control processing unit 14. The image includes a still image (still image data) and a moving image (moving image data). The imaging unit 11 is disposed so as to be able to monitor a space (location space, in the example shown in FIG. 1, where the monitored person Ob that is a monitoring target to be monitored) is located. The space is imaged as an imaging target from above, an image (image data) overlooking the imaging target is generated, and the imaging target image is output to the SU control processing unit 14. Preferably, since there is a high probability that the entire monitored person Ob can be imaged, the imaging unit 11 is expected to be located at the head of the monitored person Ob in the bedding on which the monitored person Ob is lying (for example, a bed). It is arranged so that the imaging target can be imaged from directly above the preset planned head position (usually the position where the pillow is disposed). The sensor device SU uses the imaging unit 11 to acquire an image of the monitored person Ob taken from above the monitored person Ob, preferably an image taken from directly above the planned head position.

  Such an imaging unit 11 may be a device that generates an image of visible light, but in the present embodiment, it is a device that generates an infrared image so that the monitored person Ob can be monitored even in a relatively dark place. . For example, in this embodiment, the imaging unit 11 has an imaging optical system that forms an infrared optical image of an imaging target on a predetermined imaging surface, and a light receiving surface that matches the imaging surface. An image sensor that is arranged and converts an infrared optical image in the imaging target into an electrical signal, and image data that represents an infrared image in the imaging target by performing image processing on the output of the image sensor It is a digital infrared camera provided with the image processing part etc. which produce | generate. In the present embodiment, the imaging optical system of the imaging unit 11 is preferably a wide-angle optical system (so-called wide-angle lens (including a fisheye lens)) having an angle of view that can image the entire living room RM in which the imaging unit 11 is disposed. .

  The SU sound input / output unit 12 is a circuit connected to the SU control processing unit 14 for acquiring external sound and inputting it to the sensor device SU. It is a circuit for generating and outputting a sound according to. The SU sound input / output unit 12 includes, for example, a microphone that converts sound acoustic vibrations into electrical signals, and a speaker that converts sound electrical signals into sound acoustic vibrations. The SU sound input / output unit 12 outputs an electric signal representing an external sound to the SU control processing unit 14, and converts the electric signal input from the SU control processing unit 14 into an acoustic vibration of the sound and outputs the sound.

  The nurse call reception operation unit 13 is connected to the SU control processing unit 14 and is a switch circuit such as a push button switch for inputting the nurse call to the sensor device SU. Note that the nurse call reception operation unit 13 may be connected to the SU control processing unit 14 by wire, or may be connected to the SU control processing unit 14 by short-range wireless communication such as Bluetooth (registered trademark) standard.

  The SU communication IF unit 15 is a communication circuit that is connected to the SU control processing unit 14 and performs communication according to the control of the SU control processing unit 14. The SU communication IF unit 15 generates a communication signal containing the data to be transferred input from the SU control processing unit 14 according to the communication protocol used in the network NW of the monitored person monitoring system MS, and the generated communication The signal is transmitted to other devices SV, SP, TA via the network NW. The SU communication IF unit 15 receives communication signals from other devices SV, SP, and TA via the network NW, extracts data from the received communication signals, and the SU control processing unit 14 can process the extracted data. The data is converted into data in a proper format and output to the SU control processing unit 14. The SU communication IF unit 15 includes, for example, a communication interface circuit that complies with the IEEE 802.11 standard or the like.

  The SU storage unit 16 is a circuit that is connected to the SU control processing unit 14 and stores various predetermined programs and various predetermined data under the control of the SU control processing unit 14. Examples of the various predetermined programs include a SU control program that controls each unit of the sensor device SU according to the function of each unit, and a SU monitoring processing program that executes predetermined information processing related to monitoring of the monitored person Ob. And the like. In the SU monitoring processing program, a behavior detection processing program for executing detection processing for detecting a predetermined behavior in the monitored person Ob using all the behavior detection algorithms stored in the algorithm information storage unit 161 described later, As execution of the first notification, when the predetermined behavior is detected by the behavior detection algorithm as a result of the detection processing of the behavior detection processing program for all the behavior detection algorithms, the algorithm information storage unit 161 stores An SU notification processing program for notifying the management server device SV of the detection of the predetermined action together with an image related to the monitored person Ob using the stored action detection algorithm identifier corresponding to the action detection algorithm, or the nurse call reception operation unit 13 When the nurse call is accepted at the management server device S The SU nurse call processing program for making a voice call with the terminal devices SP and TA by using the SU sound input / output unit 12 and the moving image generated by the imaging unit 11 are requested for the moving image. SU streaming processing programs that are distributed to terminal devices SP and TA by streaming are included. The various predetermined data includes the sensor device identifier (sensor ID) that is an identifier for identifying and identifying the sensor device SU of the own device, and the detection process for detecting a predetermined action in the monitored person Ob. Data required for executing each program such as a behavior detection algorithm to identify, a behavior detection algorithm identifier (algorithm ID) for identifying and identifying the behavior detection algorithm, and a communication address of the management server device SV, etc. . The SU storage unit 16 includes, for example, a ROM (Read Only Memory) that is a nonvolatile storage element, an EEPROM (Electrically Erasable Programmable Read Only Memory) that is a rewritable nonvolatile storage element, and the like. The SU storage unit 16 includes a RAM (Random Access Memory) serving as a working memory of the so-called SU control processing unit 14 that stores data generated during execution of the predetermined program.

  The SU storage unit 16 functionally includes an algorithm information storage unit 161 for storing the behavior detection algorithm and the algorithm ID. The algorithm information storage unit 161 stores the behavior detection algorithm in association with one or a plurality of algorithm IDs for each of a plurality of different behavior types in the predetermined behavior of the monitored person Ob. More specifically, in the present embodiment, the predetermined behavior in the monitored person Ob is, for example, wake-up when the monitored person Ob occurs, leaving the monitored person Ob away from the bedding, and the monitored person Ob bedding. A fall that falls from the top and a fall that the monitored person Ob falls. For this reason, as a plurality of behavior detection algorithms, a plurality of programs (behavior detection programs) for detecting the rising, leaving, falling and falling are prepared in advance, and the plurality of behavior detection programs are examples of the algorithm ID. Are stored in the algorithm information storage unit 161. More specifically, the wake-up detection program for detecting wake-up, which is an example of a behavior detection algorithm, includes, for example, three wake-up detection programs 1 to 3 in the present embodiment. The wake-up detection program 1 wakes up when, for example, the amount of protrusion of the human body region that hits the monitored person Ob from the bedding becomes equal to or more than a predetermined wake-up determination threshold based on the image generated by the imaging unit 11. This is a program to be determined, and “wake-up algorithm 1” is added as a file name and stored in the algorithm information storage unit 161. In the wake-up detection program 2, for example, based on the image generated by the imaging unit 11, the size of the head region corresponding to the head of the monitored subject Ob changes from the size of the lying posture to the size of the sitting posture. In this case, the program is determined to wake up, and “wake-up algorithm 2” is added as a file name and stored in the algorithm information storage unit 161. The wake-up detection program 3 is a program for determining wake-up when, for example, the head region of the monitored person Ob moves on the bedding based on the image generated by the imaging unit 11. 3 ”is added and stored in the algorithm information storage unit 161. The human body region is detected as a moving body region detected by, for example, a background difference method or a frame difference method. The head region is detected from, for example, the human body region detected as described above, by pattern matching using a head pattern model, or by a neural network learned for detecting the head region. Note that when bedding is used for detection of wake-up, an area (bedding area) in which the bedding is arranged is stored in the SU storage unit 16 in advance. In this embodiment, the bed detection program for detecting bed removal, which is another example of the behavior detection algorithm, includes, for example, two bed detection programs 1 and 2. The bed leaving detection program 1 is, for example, based on the image picked up by the image pickup unit 11, the overlapping amount where the human body region of the monitored person Ob overlaps the bedding is equal to or less than a first threshold (bed leaving determination threshold) set in advance. Is a program that determines that the user is getting out of bed, and “gets off bed algorithm 1” is added as a file name and stored in the algorithm information storage unit 161. The bed leaving detection program 2 is, for example, a program that determines that the user is getting out of bed when the human body region of the monitored person Ob is separated from the bedding based on the image captured by the imaging unit 11. Is attached and stored in the algorithm information storage unit 161. The fall detection program for detecting fall, which is another example of the behavior detection algorithm, includes, for example, one fall detection program 1 in this embodiment. The fall detection program 1 is, for example, based on the image captured by the imaging unit 11 and within the area (bedding area) within a predetermined distance from the bedding around the bedding. This is a program for determining a fall when the size of the area changes from a certain size to a size on the floor, and “falling algorithm 1” is attached as a file name and stored in the algorithm information storage unit 161. Is done. A fall detection program that detects a fall, which is another example of the behavior detection algorithm, includes, for example, two fall detection programs 1 and 2. For example, the fall detection program 1 is based on the image captured by the imaging unit 11 and the human body region of the monitored person Ob changes from a certain size to the size of the lying posture in a region excluding the bedding surrounding region. This is a program that determines a fall when the time changes and the completion time of the time change is within a preset second threshold value (falling judgment threshold value), and “falling algorithm 1” is added as a file name. And stored in the algorithm information storage unit 161. The fall detection program 2 is based on the image captured by the imaging unit 11, for example, in the region excluding the bedding surrounding region, and the size of the head region of the monitored person Ob from a certain size on the floor surface. This is a program for determining a fall when the time changes to the size, and “falling algorithm 2” is attached as a file name and stored in the algorithm information storage unit 161.

  The SU control processing unit 14 controls each part of the sensor device SU according to the function of each part, detects a predetermined action in the monitored person Ob, and displays the detection result together with an image related to the monitored person Ob. The first notification to be notified to the device SV is executed, the nurse call is accepted, the management server device SV is notified of that, a voice call is performed with the terminal devices SP and TA, and an image including a moving image is displayed. This is a circuit for generating and distributing a moving image to the terminal devices SP and TA. The SU control processing unit 14 includes, for example, a CPU (Central Processing Unit) and its peripheral circuits. The SU control processing unit 14 executes the control processing program, so that the sensor side control unit (SU control unit) 141, the behavior detection processing unit 142, the sensor side notification processing unit (SU notification processing unit) 143, the sensor side A nurse call processing unit (SU nurse call processing unit) 144 and a sensor side streaming processing unit (SU streaming processing unit) 145 are functionally provided.

  The SU control unit 141 controls each part of the sensor device SU according to the function of each part, and governs overall control of the sensor device SU.

  The behavior detection processing unit 142 executes the detection processing using all the behavior detection algorithms stored in the algorithm information storage unit 161. More specifically, in the present embodiment, as described above, the predetermined action is the rising, leaving, falling, and falling of the monitored person Ob. The behavior detection processing unit 142 has three wake-up detection programs 1 to 3, two get-off detection programs 1, 2, and one fall with respect to an image (for example, an image for one frame) generated by the imaging unit 11. The detection process is executed using the detection program and the two fall detection programs 1 and 2 respectively.

  As the execution of the first notification, the SU notification processing unit 143 performs the predetermined behavior using the behavior detection algorithm as a result of the detection processing of the behavior detection processing unit 142 for all the behavior detection algorithms (each behavior detection program). , The detection of the predetermined behavior is managed through the SU communication IF unit 15 together with the image related to the monitored person Ob using the algorithm ID corresponding to the behavior detection algorithm stored in the algorithm information storage unit 161. This is a notification to the server device SV. More specifically, the SU notification processing unit 143 includes a sensor ID of the own device, an algorithm ID corresponding to the behavior detection algorithm that has detected the predetermined behavior, and a communication that contains an image used to detect the predetermined behavior. A signal (first monitoring information communication signal) is transmitted to the management server device SV via the SU communication IF unit 15. The image may be at least one of a still image and a moving image. In the present embodiment, as will be described later, first, a still image is notified and a moving image is distributed in response to a user request. First, a moving image may be distributed, a still image and a moving image may be transmitted, and the still image and the moving image may be displayed on the terminal devices SP and TA by screen division.

  The SU nurse call processing unit 144 notifies the management server device SV when the nurse call reception operation unit 13 receives the nurse call, and uses the SU sound input / output unit 12 and the like to connect the terminal devices SP and TA. Voice calls between the two. More specifically, when the nurse call reception operation unit 13 is input, the SU nurse call processing unit 144 is a communication signal containing nurse call reception information indicating that the nurse call has been received and the sensor ID of the own device. (Nurse call notification communication signal) is transmitted to the management server device SV via the SU communication IF unit 15. The SU nurse call processing unit 144 uses the SU sound input / output unit 12 and the like to perform a voice call with the terminal devices SP and TA by, for example, VoIP (Voice over Internet Protocol).

  When there is a video distribution request from the fixed terminal device SP or the mobile terminal device TA via the communication IF unit 3, the SU streaming processing unit 145 sends the request to the fixed terminal device SP or the mobile terminal device TA that has made this request. The moving image generated by the imaging unit 11 (for example, a live moving image) is distributed via the SU communication IF unit 15 by streaming reproduction.

  FIG. 1 shows four first to fourth sensor devices SU-1 to SU-4 as an example, and the first sensor device SU-1 is one of the monitored persons Ob. The second sensor device SU-2 is arranged in a room RM-2 (not shown) of Mr. B Ob-2 who is one of the monitored persons Ob. The third sensor device SU-3 is arranged in a room RM-3 (not shown) of Mr. C Ob-3 who is one of the monitored subjects Ob, and the fourth sensor device SU-4 It is arranged in the room RM-4 (not shown) of Mr. D Ob-4, one of the monitored persons Ob.

  The algorithm information storage unit 161 stores one or a plurality of behavior detection algorithms for executing a detection process for detecting a predetermined behavior in the monitored person Ob for each of a plurality of different behavior types in the predetermined behavior. 3 is an example of a behavior detection algorithm information storage unit and a behavior detection algorithm identifier information storage unit that stores a behavior detection algorithm identifier for identifying and identifying the behavior detection algorithm. The imaging unit 11 and the behavior detection processing unit 142 are detection processing units that execute the detection process using all the behavior detection algorithms stored in the behavior detection algorithm information storage unit for the predetermined behavior in the monitored person Ob. It is an example. When the SU notification processing unit 143 detects the predetermined behavior by the behavior detection algorithm as a result of the detection processing of the detection processing unit for all the behavior detection algorithms as the execution of the first notification, A first notification for notifying the management server device of the detection of the predetermined behavior together with an image related to the monitored person with an action detection algorithm identifier corresponding to the action detection algorithm stored in the action detection algorithm identifier information storage unit. It is an example of a process part.

  The management server device SV has a communication function that communicates with other devices SU, SP, and TA via the network NW. When the first notification is received from the sensor device SU, information on monitoring of the monitored person Ob (monitoring) Information), and as the execution of the second notification (re-notification, transfer, notification, transmission), the first notification is notified to a predetermined terminal device SP, TA, and the client (terminal device in this embodiment) SP, TA, etc.) is a device that provides data to the client and manages the monitored person monitoring system MS as a whole. In the present embodiment, after the management server device SV receives from the terminal devices SP and TA the behavior detection algorithm identifier (algorithm ID) and the behavior type name of the behavior type associated with the behavior detection algorithm identifier. Based on the behavior type name of the behavior type associated with the received behavior detection algorithm identifier, the behavior type name is used instead of the behavior detection algorithm identifier or in addition to the behavior detection algorithm identifier. The detection of the predetermined action by name is notified to the predetermined terminal devices SP and TA. For example, as shown in FIG. 3, the management server device SV includes a server-side communication interface unit (SV communication IF unit) 21, a server-side control processing unit (SV control processing unit) 22, and a server-side storage unit. (SV storage unit) 23.

  Similar to the SU communication IF unit 15, the SV communication IF unit 21 is a communication circuit that is connected to the SV control processing unit 22 and performs communication according to the control of the SV control processing unit 22. The SV communication IF unit 21 includes, for example, a communication interface circuit that complies with the IEEE 802.11 standard or the like.

  The SV storage unit 23 is a circuit that is connected to the SV control processing unit 22 and stores various predetermined programs and various predetermined data under the control of the SV control processing unit 22. Examples of the various predetermined programs include an SV control program for controlling each part of the management server device SV according to the function of each part, and an SV monitoring process for executing predetermined information processing related to monitoring of the monitored person Ob. A control processing program such as a program is included. When the first notification is received from the sensor device SU, the SV monitoring processing program manages information (monitoring information) related to monitoring the monitored person Ob, and the sensor device SU performs the second notification as the execution of the second notification. When the first notification is received, the first notification is notified to the terminal devices SP and TA, and the behavior type name of the behavior type associated with the behavior detection algorithm identifier (algorithm ID) and the behavior detection algorithm identifier is obtained. After receiving from the terminal device SP, TA, based on the action type name of the action type associated with the received action detection algorithm identifier, the action type name instead of the action detection algorithm identifier, or the action SV that notifies the terminal device SP, TA of the detection of the predetermined action by the action type name in addition to the detection algorithm identifier The behavior detection algorithm identifier when the behavior type name of the behavior type associated with the visual notification processing program or the behavior detection algorithm identifier (algorithm ID) and the behavior detection algorithm identifier is received from the terminal device SP or TA. A counting processing program for counting the number of received behavior type names of the behavior types associated with each behavior detection algorithm identifier and each behavior type name is included. In addition, since each sensor apparatus SU includes the structure of an example of a detection process part, when monitoring each of the to-be-monitored persons Ob-1 to Ob-4 by each of the plurality of sensor apparatuses SU as in the present embodiment. The counting processing program further counts the number of receptions for each sensor device SU (for example, for each sensor ID). The various predetermined data include a server identifier (server ID) that is an identifier for identifying the management server device SV and identifying the management server device SV, monitoring information related to monitoring of the monitored person Ob, , The inter-device information indicating the information between the devices SU, SP, TA, such as the notification destination of the second notification, the number of received behavior type names associated with the behavior detection algorithm identifier, the behavior detection Receiving number information representing the counting result counted by algorithm identifier and by behavior type name, and each type of program such as behavior type name information representing the status of the correspondence between the behavior detection algorithm identifier and the behavior type name of the behavior type Data necessary for execution is included. In order to store these monitoring information, inter-device information, received number information, and action type name information, the SV storage unit 23 includes a server-side monitoring information storage unit (SV monitoring information storage unit) 231 and an inter-device information storage unit 232. The reception number information storage unit 233 and the action type name information storage unit 234 are functionally provided.

  In the present embodiment, the SV monitoring information storage unit 231 includes, as the monitoring information, the sensor ID, algorithm ID, and image accommodated in the first monitoring information communication signal received from the sensor device SU, and the first monitoring information communication. Signal reception times and the like are stored in association with each other. In this embodiment, the SV monitoring information storage unit 231 includes nurse call reception information, sensor ID, and reception time of the nurse call notification communication signal received in the nurse call notification communication signal received from the sensor device SU. Regarding monitoring of the monitored person Ob, monitoring information of the monitored person Ob transmitted / received to / from each device SU, SP, TA is stored.

    In the present embodiment, the inter-device information storage unit 232 stores a report destination correspondence relationship, a communication address correspondence relationship, and the like as the inter-device information. The notification destination correspondence relationship indicates a notification ID (re-notification destination, transfer destination, transmission destination) of a first monitoring information communication signal, a nurse call notification communication signal, etc. transmitted from the sensor device SU. And the terminal ID that is the notification destination. The communication address correspondence relationship is a correspondence relationship between IDs (sensor IDs and terminal IDs) of the devices SU, SP, and TA and their communication addresses. The terminal ID (terminal identifier) is an identifier for identifying the terminal devices SP and TA and identifying the terminal devices SP and TA. Note that each of the sensor ID, server ID, and terminal ID may be, for example, a serial number composed of a predetermined symbol string, or may be a communication address (in this case, communication address correspondence can be omitted).

  The reception number information storage unit 233 stores the reception number information. In the present embodiment, the sensor device SU includes four first to fourth sensor devices SU-1 to SU-4 in order to individually monitor the four monitored persons Ob-1 to Ob4. Since it is configured, the reception number information storage unit 233 further stores reception number information obtained by counting the reception number for each sensor device SU. That is, the reception number information storage unit 233 receives the action type name of the action type associated with the action detection algorithm identifier for each sensor ID of the first to fourth sensor devices SU-1 to SU-4. Received number information representing a counting result obtained by counting a number for each action detection algorithm identifier and for each action type name is stored. In the present embodiment, such received number information is stored in the received number information storage unit 233 in a table format using a table prepared for each sensor ID of the first to fourth sensor devices SU-1 to SU-4. Remembered. More specifically, for example, as shown in FIG. 4, the reception number table RT is a two-dimensional matrix in which each row 2331 arranged in the vertical direction is each algorithm ID, and each column 2332 arranged in the horizontal direction is each action type name. The number of receptions after counting is registered in each column of the two-dimensional matrix. More specifically, the reception number table RT includes four first to fourth reception number tables RT-1 to RT associated with each sensor ID of the first to fourth sensor devices SU-1 to SU-4. -4. These first to fourth reception number tables RT-1 to RT-4 have the same configuration, and in the vertical direction, “wakeup algorithm 1” 2331-1, “wakeup algorithm 2” 2331-2, “wakeup algorithm 3” are shown. ”2331-3,“ Leave algorithm 1 ”2331-4,“ Leave algorithm 2 ”2331-5,“ Fall algorithm 1 ”2331-6,“ Fall algorithm 1 ”2331-7 and“ Fall algorithm 2 ”2331-8 It consists of each row, and in the horizontal direction, it consists of the columns of “getting up” 2332-1, “getting out” 2332-2, “falling” 2333-3, “falling” 2332-4, and “others” 2332-5. For example, in FIG. 4, in the reception number table RT-1 associated with the first sensor device SU-1, “wake-up algorithm 2” 2331-2 in the second row and “wake-up” 2332-1 in the first column 5 is registered in the column where This indicates that in the first sensor device SU-1, the number of receptions of communication signals in which the wake-up algorithm 2 is associated with the wake-up is 5 times. Further, for example, in FIG. 4, in the reception number table RT-1 associated with the first sensor device SU-1, “wake-up algorithm 2” 2331-2 in the second row and “get-off” 2332-2 in the second column. 1 is registered in the column intersecting with. This indicates that in the first sensor device SU-1, the number of receptions of communication signals in which the wake-up algorithm 2 is associated with getting out is one. Further, for example, in FIG. 4, in the reception number table RT-1 associated with the first sensor device SU-1, "Wake-up algorithm 2" 2331-2 in the second row and "Others" 2332-5 in the fifth column 1 is registered in the column intersecting with. This indicates that in the first sensor device SU-1, the number of communication signals received by associating others with the wake-up algorithm 2 is one. Note that the initial value of each column in the reception number table RT is 0, and is registered as a default value.

  The action type name information storage unit 234 stores the action type name information. Similar to the received number information storage unit 233, the action type name information storage unit 234 further stores, for each sensor ID, action type name information indicating the status of the correspondence between the action detection algorithm identifier and the action type name of the action type. Remember. In this embodiment, such action type name information is stored in a table format using a table prepared for each sensor ID of the first to fourth sensor devices SU-1 to SU-4. 234. More specifically, the action type name table NT is, for example, as shown in FIG. 5, four fourth IDs associated with each sensor ID of the first to fourth sensor devices SU-1 to SU-4. The first to fourth action type name tables NT-1 to NT-4 are provided. These first to fourth action type name tables NT-1 to NT-4 have the same configuration, and are associated with the algorithm ID registered in the algorithm ID field 2341 and the algorithm ID field 2341 for registering the algorithm ID. An action type name field 2342 for registering an action type name, and a confirmation flag field 2343 for registering an association status as to whether or not an action type name is associated with an algorithm ID registered in the algorithm ID field 2341 Each field has a record for each algorithm ID. The initial value of the action type name field 2342 is a code (indicated by “-” in FIG. 5) or blank indicating that the action type name is not supported. The confirmation flag “0” indicates that the action type name is not associated with the algorithm ID registered in the algorithm ID field 2341, and the confirmation flag “1” is the algorithm ID registered in the algorithm ID field 2341. Indicates that an action type name is associated with. For example, in the example shown in FIG. 5, “wake-up algorithm 2” registered in the algorithm ID field 2341 in the second row has “1” registered in the confirmation flag field 2343, so that the association is confirmed. Since “wakeup” is registered in the action type name field 2342, “wakeup” is finally associated as the action type name. Further, for example, in the example illustrated in FIG. 5, “wake-up algorithm 3” registered in the algorithm ID field 2341 in the third row has “0” registered in the confirmation flag field 2343, and thus is not associated. It is definite. Further, for example, in the example illustrated in FIG. 5, “wake-up algorithm 1” registered in the algorithm ID field 2341 in the first row has “1” registered in the confirmation flag field 2343, and thus the association is confirmed. Since “other” is registered in the action type name field 2342, “other” is finally associated as the action type name.

  The SV control processing unit 22 controls each part of the management server device SV in accordance with the function of each part, and receives the first notification from the sensor device SU, information (monitoring information) related to monitoring the monitored person Ob. As the execution of the second notification, the first notification is notified to a predetermined terminal device SP, TA, and the data according to the request of the client (the terminal device SP, TA, etc. in the present embodiment) This is a circuit that is provided to the client and manages the entire monitored person monitoring system MS. The SV control processing unit 22 includes, for example, a CPU and its peripheral circuits. The SV control processing unit 22 functions as a server-side control unit (SV control unit) 221, a server-side monitoring notification processing unit (SV monitoring notification processing unit) 222, and a counting processing unit 223 by executing the control processing program. Be prepared.

  The SV control unit 221 controls each part of the management server apparatus SV according to the function of each part, and governs overall control of the management server apparatus SV.

  When the SV monitoring notification processing unit 222 receives the first notification from the sensor device SU, the SV monitoring notification processing unit 222 manages information (monitoring information) related to monitoring of the monitored person Ob. More specifically, when the SV monitoring notification processing unit 222 receives the first monitoring information communication signal as the first notification from the sensor device SU, the SV monitoring notification processing unit 222 is accommodated in the received first monitoring information communication signal. The monitoring information related to the monitoring of the person Ob is stored (recorded) in the SV monitoring information storage unit 231. The SV monitoring notification processing unit 222 notifies the terminal device SP, TA of the received first notification as execution of the second notification. More specifically, the SV monitoring notification processing unit 222 stores the notification destination (re-notification destination, transfer destination, transmission destination) corresponding to the sensor device SU that has transmitted the received first monitoring information communication signal between the devices. A selection (search) is performed from the report destination correspondence stored in the unit 232, and a second monitoring information communication signal is transmitted to the selected terminal devices SP and TA. This selection (search process) is performed based on the sensor ID corresponding to the sensor device SU that has transmitted the received first monitoring information communication signal. The second monitoring information communication signal includes a sensor ID accommodated in the first monitoring information communication signal, an algorithm ID corresponding to an action detection algorithm that detects the predetermined action, or an action type name corresponding to the algorithm ID, A communication address corresponding to the sensor device SU having the sensor ID accommodated in the first monitoring information communication signal is accommodated as an image and moving image download destination used for detecting the predetermined action. This communication address is selected (searched) from the communication address correspondence relationship based on the sensor ID corresponding to the sensor device SU that has transmitted the received first monitoring information communication signal.

  When the count processing unit 223 receives an algorithm ID and an action type name of the action type associated with the algorithm ID from the terminal device SP, TA, the action type of the action type associated with the algorithm ID. The number of names received is counted for each algorithm ID, for each action type name, and for each sensor ID in this embodiment. More specifically, the count processing unit 223 receives an algorithm ID and an action type name of the action type associated with the algorithm ID, and in this embodiment, a sensor ID from the terminal devices SP and TA. In addition, using the reception number table RT (RT-1 to RT-4) stored in the reception number information storage unit 233, the reception number of the action type name of the action type associated with the algorithm ID is determined as the algorithm. Count by ID, by action type name, and by sensor ID.

  In the present embodiment, the above-described SV monitoring notification processing unit 222 further receives the behavior detection algorithm identifier and the behavior type name of the behavior type associated with the behavior detection algorithm identifier from the terminal devices SP and TA. Based on the behavior type name of the behavior type associated with the received behavior detection algorithm identifier, the behavior type name is used instead of the behavior detection algorithm identifier or in addition to the behavior detection algorithm identifier. The detection of the predetermined action is notified to the terminal devices SP and TA by name. More specifically, the SV monitoring notification processing unit 222 performs the predetermined processing when the number of receptions counted by the algorithm processing unit 223, by algorithm ID, by action type name, and by sensor ID reaches a predetermined determination threshold. In the algorithm ID having the number of receptions that has reached the determination threshold, the action type name corresponding to the number of receptions that has reached the predetermined determination threshold instead of the algorithm ID, or in addition to the algorithm ID, the predetermined determination The detection of the predetermined behavior is notified to the terminal devices SP and TA by the behavior type name corresponding to the number of receptions that has reached the threshold. The predetermined determination threshold is set to an appropriate value with an integer value of 1 or more using a plurality of samples. Preferably, the predetermined determination threshold value may be the same value or a different value for a plurality of behavior detection algorithms (including a case where it is the same value for some behavior detection algorithms). . Preferably, the predetermined determination threshold value may be the same value or a different value for a plurality of sensor devices SU (sensor IDs, and consequently the monitored person Ob) (some sensor devices SU). For the same value). Therefore, when the number of receptions counted by the algorithm processing unit 223 by algorithm ID, by action type name, and by sensor ID does not reach a predetermined determination threshold, the algorithm ID is obtained by the sensor device SU having the sensor ID. When a predetermined action is detected by an action detection algorithm (behavior detection program), the sensor ID and the action type name corresponding to the algorithm ID are not supported. Therefore, the second monitoring information communication signal includes the predetermined action. The algorithm ID corresponding to the behavior detection algorithm that has detected the behavior is stored. On the other hand, when the number of receptions counted by the algorithm processing unit 223 for each algorithm ID, each action type name, and each sensor ID has reached a predetermined determination threshold, the algorithm ID is assigned to the sensor device SU having the sensor ID. When a predetermined action is detected by an action detection algorithm (behavior detection program), the sensor ID and the action type name corresponding to the algorithm ID have already been supported. Therefore, the second monitoring information communication signal includes the algorithm The action type name corresponding to the ID is accommodated.

  Further, in the present embodiment, the SV monitoring notification processing unit 222 reaches the predetermined determination threshold when the reception number counted by the algorithm ID, the action type name, and the sensor ID by the counting processing unit 223, and the predetermined When the behavior type name corresponding to the number of receptions that has reached the determination threshold is the other, in the sensor device SU having the sensor ID, the behavior type name has the number of receptions that has reached the predetermined determination threshold in the others Even if the predetermined behavior is detected by the behavior detection algorithm of the algorithm ID, the detection of the predetermined behavior is not notified to the terminal devices SP and TA.

  The management server device SV is connected to the SV control processing unit 22 as necessary, as shown by a broken line in FIG. 3, for example, a server side input unit (SV input unit) for inputting various commands, various data, and the like. 24) Server side output unit (SV output unit) 25 that outputs various commands and various data input by the SV input unit 24 and monitoring information related to monitoring of the monitored person Ob, and data between external devices A server-side interface unit (SVIF unit) 26 or the like for performing input / output may be provided.

  Such a management server device SV can be configured by, for example, a computer with a communication function.

  In addition, as the execution of the second notification, the SV monitoring notification processing unit 222 notifies the terminal device of the first notification when the first notification is received from the sensor device, and the behavior detection algorithm identifier After receiving the behavior type name of the behavior type associated with the behavior detection algorithm identifier from the terminal device, based on the behavior type name of the behavior type associated with the received behavior detection algorithm identifier, It is an example of the 2nd alerting | reporting process part which alert | reports the detection of the said predetermined | prescribed action to the said terminal device by action type name instead of the said action detection algorithm identifier, or in addition to the said action detection algorithm identifier. Therefore, the SV monitoring notification processing unit 222 is the SU notification processing unit 143 which is an example of the first notification processing unit, and the behavior detection as a result of the detection processing of the detection processing unit for all the behavior detection algorithms. When the predetermined behavior is detected by an algorithm, the detection of the predetermined behavior is related to the monitored person with the behavior detection algorithm identifier corresponding to the behavior detection algorithm stored in the behavior detection algorithm identifier information storage unit. After notifying the terminal device together with the image, and receiving the behavior detection algorithm identifier and the behavior type name of the behavior type associated with the behavior detection algorithm identifier from the terminal device, the received behavior detection algorithm identifier Based on the action type name of the associated action type, the action detection algorithm In action type name instead of beam identifiers, or constitute an example of a notification processing unit for notifying the detection of the predetermined action in action type name in addition to the behavior detection algorithm identifier to the terminal device.

  The fixed terminal device SP includes a communication function for communicating with other devices SU, SV, TA via the network NW, a display function for displaying predetermined information, an input function for inputting predetermined instructions and data, and the like. The user interface (UI) of the monitored person monitoring system MS is input by inputting predetermined instructions and data to be given to the management server device SV and the portable terminal device TA, or displaying the monitoring information obtained by the sensor device SU. ). Such a fixed terminal device SP can be configured by, for example, a computer with a communication function. The fixed terminal device SP as an example of the terminal device operates in the same manner as the mobile terminal device TA. However, in this specification, a mobile terminal device TA that is another example of the terminal device will be described.

  The mobile terminal device TA has a communication function for communicating with other devices SV, SP, SU via the network NW, a display function for displaying predetermined information, an input function for inputting predetermined instructions and data, and a voice call. A monitoring function (including moving images) obtained from the sensor device SU by inputting a predetermined instruction or data to be provided to the management server device SV or the sensor device SU, or by a report from the management server device SV. Display or make a call or answer a voice call with the sensor device SU, accept and display the monitoring information for the monitored person Ob, and input an association between an algorithm ID and an action type name This is a device for accepting and returning a response to the management server device SV. In the present embodiment, for example, as shown in FIG. 6, such a mobile terminal device TA includes a terminal-side communication interface unit (TA communication IF unit) 31, a terminal-side control processing unit (TA control processing unit) 32, and A terminal side storage unit (TA storage unit) 33, a terminal side sound input / output unit (TA sound input / output unit) 34, a terminal side input unit (TA input unit) 35, and a terminal side display unit (TA display unit). 36 and a terminal-side interface unit (TAIF unit) 37.

  The TA sound input / output unit 34 is connected to the TA control processing unit 32 and is a circuit for acquiring an external sound and inputting it to the portable terminal device TA. It is a circuit for generating and outputting sound corresponding to a signal. Similar to the SU sound input / output unit 12, the TA sound input / output unit 34 includes, for example, a microphone that converts acoustic vibration into an electric signal, and a speaker that converts an electric signal of sound into an acoustic vibration of sound. Composed. The TA sound input / output unit 34 outputs an electric signal representing an external sound to the TA control processing unit 32, and converts the electric signal input from the TA control processing unit 32 into sound acoustic vibration and outputs the sound.

  The TA input unit 35 is connected to the TA control processing unit 32 and is, for example, a circuit that accepts a predetermined operation and inputs it to the mobile terminal device TA, for example, a plurality of input switches assigned with a predetermined function. . Examples of the predetermined operation include an ID input operation for logging in, a voice call request operation and its end operation, a live video request operation and its end operation, and the informed monitored person. For example, various operations necessary for monitoring such as an input operation indicating that there is an intention (“corresponding”) to carry out a response (handling, response) such as lifesaving, nursing, care, and assistance to the Ob are included. The TA display unit 36 is connected to the TA control processing unit 32, and under the control of the TA control processing unit 32, the predetermined operation content input from the TA input unit 35 and the monitored target MS monitored by the monitored person monitoring system MS. It is a circuit that displays the monitoring information related to the monitoring of the monitoring person Ob (for example, the type of predetermined action detected by the sensor device SU, the image (still image and moving image) of the monitored person Ob), the reception of the nurse call, etc. For example, a display device such as an LCD (Liquid Crystal Display) and an organic EL display. In the present embodiment, the TA input unit 35 and the TA display unit 36 constitute a touch panel. In this case, the TA input unit 35 is a position input device that detects and inputs an operation position such as a resistance film method or a capacitance method. In this touch panel, a position input device is provided on the display surface of the TA display unit 36, and one or more input content candidates that can be input are displayed on the TA display unit 36. For example, a user such as a nurse or a caregiver ( When the monitor) touches the display position where the input content to be input is displayed, the position is detected by the position input device, and the display content displayed at the detected position is input to the portable terminal device TA as the operation input content of the user. Entered.

  The TAIF unit 37 is a circuit that is connected to the TA control processing unit 32 and inputs / outputs data to / from an external device under the control of the TA control processing unit 32. For example, the TAIF unit 37 uses the Bluetooth (registered trademark) standard. An interface circuit, an interface circuit that performs infrared communication such as the IrDA standard, and an interface circuit that uses the USB standard.

  Similar to the SU communication IF unit 15, the TA communication IF unit 31 is a communication circuit that is connected to the TA control processing unit 32 and performs communication according to the control of the TA control processing unit 32. The TA communication IF unit 31 generates a communication signal containing the data to be transferred input from the TA control processing unit 32 in accordance with the communication protocol used in the network NW of the monitored person monitoring system MS, and the generated communication The signal is transmitted to other devices SU, SV, SP via the network NW. The TA communication IF unit 31 receives a communication signal from another device SU, SV, SP via the network NW, extracts data from the received communication signal, and the TA control processing unit 32 can process the extracted data. The data is converted into data of a proper format and output to the TA control processing unit 32. The TA communication IF unit 31 includes, for example, a communication interface circuit that conforms to the IEEE 802.11 standard or the like.

  The TA storage unit 33 is a circuit that is connected to the TA control processing unit 32 and stores various predetermined programs and various predetermined data under the control of the TA control processing unit 32. Examples of the various predetermined programs include a TA control program for controlling each part of the mobile terminal device TA according to the function of each part, and a TA monitoring process for executing predetermined information processing related to monitoring of the monitored person Ob. A control processing program such as a program is included. When the second notification is received from the management server device SV, the TA monitoring processing program stores (records) information (monitoring information) relating to monitoring of the monitored person Ob, and detects the predetermined action with an algorithm ID. When received together with the image related to the monitored person Ob, the TA monitoring display processing program for displaying the received algorithm ID and the image related to the monitored person Ob on the TA display unit 36, and the action type name of the action type When input from the TA input unit 35, the action type name of the input action type is associated with the algorithm ID displayed on the TA display unit 36, and the algorithm ID displayed on the TA display unit 36 and the algorithm ID are displayed. Action type name notification processing program for returning the action type name of the inputted action type to the management server device SV, The TA nurse call processing program for making a voice call with the sensor device SU by using the force unit 12 or the like, or the distribution of the moving image from the sensor device SU, and the TA display unit 36 by streaming reproduction of the received moving image. A streaming processing program to be displayed on the screen. In the various kinds of predetermined data, data necessary for executing each program such as the terminal ID of the own device, the screen information displayed on the TA display unit 36, and the monitoring information related to monitoring of the monitored person Ob, etc. Is included. The TA storage unit 33 includes, for example, a ROM and an EEPROM. The TA storage unit 33 includes a RAM serving as a working memory for the so-called TA control processing unit 32 that stores data generated during execution of the predetermined program. The TA storage unit 33 functionally includes a terminal-side monitoring information storage unit (TA monitoring information storage unit) 331 for storing the monitoring information.

  In this embodiment, the TA monitoring information storage unit 331 downloads, as the monitoring information, a sensor ID, an algorithm ID or an action type name, an image, and a video stored in the second monitoring information communication signal received from the management server device SV. The communication address of the previous sensor device SU, the reception time of the second monitoring information communication signal, and the like are stored in association with each other. In the present embodiment, the TA monitoring information storage unit 331 includes the nurse call reception information, the sensor ID, and the nurse call notification communication received in the nurse call notification communication signal received from the sensor device SU via the management server device SV. Regarding monitoring of the monitored person Ob, such as a signal reception time, monitoring information of the monitored person Ob transmitted / received to / from each of the devices SU, SV, TA is stored.

  The TA control processing unit 32 controls each part of the mobile terminal device TA according to the function of each part, receives and displays the monitoring information for the monitored person Ob, and associates the algorithm ID with the action type name. It is a circuit for accepting an input and returning it to the management server device SV to answer or call a nurse call. The TA control processing unit 32 includes, for example, a CPU and its peripheral circuits. The TA control processing unit 32 executes a control processing program, whereby a terminal side control unit (TA control unit) 321, a terminal side monitoring display processing unit (TA monitoring display processing unit) 322, and an action type name notification processing unit 323. The terminal side nurse call processing unit (TA nurse call processing unit) 324 and the terminal side streaming processing unit (TA streaming processing unit) 325 are functionally provided.

  The TA control unit 321 controls each part of the mobile terminal apparatus TA according to the function of each part, and controls the entire mobile terminal apparatus TA.

  The TA monitoring display processing unit 322 executes predetermined information processing related to monitoring the monitored person Ob. More specifically, when the TA monitoring display processing unit 322 receives the second monitoring information communication signal from the management server device SV, each information (each data) accommodated in the received second monitoring information communication signal. Based on the above, monitoring information related to monitoring of the monitored person Ob is stored (recorded) in the TA monitoring information storage unit 331. The TA monitoring display processing unit 322 displays a screen corresponding to each piece of information contained in the received second monitoring information communication signal on the TA display unit 36. In one example, when the TA monitoring display processing unit 322 receives the detection of the predetermined behavior with the algorithm ID together with the image related to the monitored person Ob, the TA display the received algorithm ID and the image related to the monitored person Ob. This is displayed on the part 36. When receiving a predetermined input operation from the TA input unit 35, the TA monitoring display processing unit 322 executes a predetermined process corresponding to the input operation.

  The action type name notification processing unit 323 corresponds to the algorithm ID that displays the inputted action type name of the action type on the TA display unit when the action type name of the action type is input from the TA input unit 35. In addition, the algorithm ID displayed on the TA display section and the action type name of the input action type are returned to the management server device SV.

  The TA nurse call processing unit 324 performs a voice call with the sensor device SU by using the TA sound input / output unit 34 or the like. More specifically, the TA nurse call processing unit 324 uses the TA sound input / output unit 34 and the like, and, for example, by VoIP with the transmission source sensor device SU that transmits the nurse call notification communication signal to the management server device SV. Make a voice call.

  The TA streaming processing unit 325 receives distribution of a moving image from the sensor device SU, and displays the distributed moving image on the TA display unit 36 by streaming reproduction.

  Such a portable terminal device TA can be configured by a portable communication terminal device such as a so-called tablet computer, a smartphone, or a mobile phone.

  Next, the operation of this embodiment will be described. FIG. 7 is a flowchart illustrating the operation of the sensor device in the monitored person monitoring system according to the embodiment. FIG. 8 is a flowchart illustrating the operation of the management server device in the monitored person monitoring system according to the embodiment. FIG. 9 is a flowchart showing the operation of the first monitoring information processing in the flowchart shown in FIG. FIG. 10 is a flowchart showing the behavior type action processing in the flowchart shown in FIG. FIG. 11 is a flowchart illustrating the operation of the mobile terminal device in the monitored person monitoring system according to the embodiment. FIG. 12 is a diagram illustrating an example of a standby screen displayed on the mobile terminal device in the monitored person monitoring system according to the embodiment. FIG. 13 is a diagram illustrating an example of a first monitoring information screen corresponding to an algorithm ID displayed on the mobile terminal device in the monitored person monitoring system according to the embodiment. FIG. 14 is a diagram illustrating an example of a second monitoring information screen displayed on the mobile terminal device in the monitored person monitoring system according to the embodiment according to the action type name.

  In such a monitored person monitoring system MS, each of the devices SU, SV, SP, TA performs initialization of each necessary unit and starts its operation when the power is turned on. In the sensor device SU, execution of the control processing program causes the SU control processing unit 14 to include the SU control unit 141, the behavior detection processing unit 142, the SU notification processing unit 143, the SU nurse call processing unit 144, and the SU streaming processing unit 145. Is functionally configured. In the management server device SV, the SV control processing unit 22 is functionally configured with an SV control unit 221, an SV monitoring notification processing unit 222, and a count processing unit 223 by executing the control processing program. In the portable terminal device TA, by executing the control processing program, the TA control processing unit 32 includes a TA control unit 321, a TA monitoring display processing unit 322, an action type name notification processing unit 323, a TA nurse call processing unit 324, and a TA. A streaming processing unit 325 is functionally configured.

  In the monitored person monitoring system MS in the present embodiment, one or a plurality of action detection algorithms (behavior detection programs) are prepared in advance for each action type in the predetermined action of the monitored person Ob. For each of these behavior detection algorithms, the monitoring system MS automatically associates a behavior type name that can be actually detected for a specific monitored person Ob by the behavior detection algorithm with the behavior detection algorithm. Therefore, when the operation of the monitored person monitoring system MS is summarized, in the first stage, when the predetermined action is detected by a certain action detection algorithm, the detection result is an algorithm ID of the certain action detection algorithm. Along with the image, the sensor device SU is notified to the terminal devices SP and TA (here, typically the mobile terminal device TA as described above) via the management server device SV, and the supervisor refers to the image to perform the algorithm. The action type name is input to the mobile terminal device TA in the detection result notified by the ID, and the mobile terminal device TA notifies the management server device SV of the input action type name in association with the algorithm ID. When the management server device SV receives one or a plurality of such notifications, the management server device SV determines a final association between the algorithm ID and the action type name. Such final association is performed individually for each sensor device SU (sensor ID) (that is, for each monitored person Ob) and for each behavior detection algorithm (algorithm ID). Then, in the next second stage, when the detection result is notified by the algorithm ID from the sensor device SU sequentially from the algorithm ID for which the final association has been determined, The algorithm ID is converted into an action type name according to the association, and the converted action type name is notified to the terminal devices SP and TA. By such an operation, the monitored person monitoring system MS or the like in the present embodiment can be automatically customized according to the individuality (characteristic) of the monitored person Ob.

  More specifically, the sensor device SU, the management server device SV, and the terminal devices SP and TA (here, representatively the mobile terminal device TA) operate as follows.

  First, the operation of the sensor device SU will be described. The sensor device SU detects a predetermined operation in the monitored person Ob by performing the following operation every frame or every several frames.

  In FIG. 7, first, the sensor device SU acquires an image (image data) for one frame from the imaging unit 11 by the SU control unit 141 of the SU control processing unit 14 (S11).

  Next, the sensor device SU uses the behavior detection algorithm (behavior detection program) stored in the algorithm information storage unit 161 by the behavior detection processing unit 142 of the SU control processing unit 14, thereby determining the predetermined value in the monitored person Ob. Based on the acquired image, the detection process for detecting the action is performed (S12).

  Next, the sensor device SU determines whether or not the detection processing has been executed for all the behavior detection algorithms stored in the algorithm information storage unit 161 by the behavior detection processing unit 142 of the SU control processing unit 14. (S13). As a result of this determination, when the detection processing is not executed for all the behavior detection algorithms (No), the sensor device SU returns the processing to the processing S12 by the behavior detection processing unit 142, while on the other hand, When the detection process is being executed for the behavior detection algorithm (Yes), the sensor device SU executes the next process S14.

  By such processes S12 and S13, the detection process is executed using all the action detection algorithms (behavior detection programs) stored in the algorithm information storage unit 161. More specifically, in the present embodiment, the action detection processing unit 142 first executes the detection process using the wake-up detection program 1 and secondly detects the wake-up by the processes S12 and S13. The detection process is executed using the program 2, third, the detection process is executed using the wake-up detection program 3, and fourth, the detection process is executed using the bed leaving detection program 1, and the fifth Next, the detection process is executed using the bed leaving detection program 2, sixth, the detection process is executed using the fall detection program, and seventh, the detection process is executed using the fall detection program 1. And, eighthly, the detection process is executed using the fall detection program 2.

  In the process S14, the sensor device SU determines whether or not a predetermined action in the monitored person Ob is detected by the SU notification processing unit 143 of the SU control processing unit 14 through the S12 and the process S13. As a result of the determination, when the behavior is not detected (No), the sensor device SU ends the process, while when the behavior is detected (Yes), the sensor device SU After executing the next process S15, this process is terminated.

  In this process S15, the sensor apparatus SU uses the SU notification processing unit 143 to notify the terminal apparatus SP, TA of the detection result of the process S13 via the management server apparatus SV, and the S12 and the process of its own sensor ID. The SU monitoring IF communication unit 15 receives the first monitoring information communication signal containing the algorithm ID corresponding to the behavior detection algorithm that detected the predetermined behavior in S13, and the image used for the detection of the predetermined behavior in S12 and processing S13. To the management server device SV. More specifically, for example, when the predetermined action is detected by the wake-up detection algorithm 2 in S12 and processing S13, the SU notification processing unit 143 determines the sensor ID of the own device, the algorithm of the wake-up detection algorithm 2 A management server device generates a first monitoring information communication signal containing an ID (wake-up algorithm 2) and an image used by the wake-up detection algorithm 2, and sends the generated first monitoring information communication signal via the SU communication IF unit 15. Send to SV. Further, for example, when the predetermined action is detected by the wake-up detection algorithm 1 in S12 and the process S13, and further, when the predetermined action is detected by the bed leaving detection algorithm 1, the SU notification processing unit 143 Sensor ID, algorithm ID of the wake-up detection algorithm 1 (wake-up algorithm 1), algorithm ID of the wake-up detection algorithm 1 (get-off algorithm 1), and an image used by the wake-up detection algorithm 1 (that is, an image using the wake-up detection algorithm) ) Is generated, and the generated first monitoring information communication signal is transmitted to the management server device SV via the SU communication IF unit 15. In this case, the SU notification processing unit 143 generates the first monitoring information communication signal A containing the sensor ID of the own device, the algorithm ID of the wake-up detection algorithm 1, and the image used by the wake-up detection algorithm 1. The generated first monitoring information communication signal A is transmitted to the management server device SV via the SU communication IF unit 15, and the SU notification processing unit 143 includes the sensor ID of the own device, the algorithm ID of the bed detection algorithm 1, and The first monitoring information communication signal B containing the image used by the bed leaving detection algorithm 1 is generated, and the generated first monitoring information communication signal B is transmitted to the management server device SV via the SU communication IF unit 15. Also good. As described above, the sensor device SU may transmit the detection results to the management server device SV individually for each behavior detection algorithm by the SU notification processing unit 143, and collect the detection results of the plurality of behavior detection algorithms. You may transmit to management server apparatus SV.

  Regarding automatic customization according to the individuality (characteristics) of the monitored person Ob, the sensor device SU operates as described above.

  Next, the operation of the management server device SV will be described. On the other hand, in FIG. 8, the management server device SV determines whether or not the SV communication IF unit 21 has received a communication signal by the SV control unit 221 of the SV control processing unit 22 (S21). As a result of the determination, if the communication signal is not received (No), the management server device SV returns the process to S21. If the result of the determination is that the communication signal is received (Yes), The management server device SV executes the following process S22. That is, the management server device SV is waiting for reception of a communication signal.

  In the process S22, the management server apparatus SV determines the type of the received communication signal by the SV control unit 221. As a result of this determination, when the received communication signal is the first monitoring information communication signal (first monitoring information), the management server device SV executes the processing S26 after executing the processing S23, and receives the received When the communication signal is an action type name notification communication signal (action type name notification), the process S26 is executed after the process S24 is executed, and the received communication signal is the first monitoring information communication signal and the action. If it is not a type name notification communication signal (others), the process S26 is executed after the process S25. The transmission of the action type name notification communication signal by the mobile terminal device TA will be described later with reference to FIG.

  In process S23, management server apparatus SV performs the 1st monitoring information processing which processes the 1st monitoring information communication signal received from sensor apparatus SU by process S21 by SV monitoring alerting | reporting process part 222 of SV control process part 22. . More specifically, the first monitoring information processing includes the processes shown in FIG. In FIG. 9, first, the SV monitoring notification processing unit 222 displays monitoring information related to monitoring of the monitored person Ob stored in the first monitoring information communication signal received from the sensor device SU in step S <b> 21. Is stored (recorded) in S231.

  Next, the SV monitoring notification processing unit 222 determines whether or not the action type name corresponding to the algorithm ID accommodated in the first monitoring information communication signal received in step S21 is determined (S232). More specifically, the SV monitoring notification processing unit 222 receives the first monitoring information received in step S21 from all the action type name tables NT stored for each sensor ID in the action type name information storage unit 234. The action type name table NT corresponding to the sensor ID accommodated in the communication signal is selected, and the algorithm ID accommodated in the first monitoring information communication signal received in step S21 is selected from the selected action type name table NT. A corresponding record is selected, a confirmation flag registered in the confirmation flag field 2343 of the selected record is extracted, and it is determined whether the extracted determination flag is “0” or “1”. If the determination flag is “0” as a result of this determination, it is determined that the action type name corresponding to the algorithm ID accommodated in the first monitoring information communication signal received in step S21 is not fixed (No). The SV monitoring notification processing unit 222 ends the present process (process S23) after executing the next process S233. On the other hand, if the determination flag is “1” as a result of the determination, it is determined that the action type name corresponding to the algorithm ID accommodated in the first monitoring information communication signal received in step S21 is determined ( Yes), the SV monitoring notification processing unit 222 executes the next process S234.

  In this process S233, since the action type name corresponding to the algorithm ID is not fixed, the management server apparatus SV uses the SV monitoring notification processing unit 222 to transmit the detection result to the terminal apparatuses SP and TA using the algorithm ID. A second monitoring information communication signal is generated for the predetermined terminal devices SP and TA with the algorithm ID, and the generated second monitoring information communication signal is transmitted via the SV communication IF unit 21. More specifically, the SV monitoring notification processing unit 222 corresponds to the sensor device SU that transmitted the first monitoring information communication signal received in step S21 (that is, the sensor ID accommodated in the first monitoring information communication signal). A report destination (re-report destination, transfer destination, transmission destination) to be selected is selected (searched) from the report destination correspondence stored in the inter-device information storage unit 232, and the first terminal device SP, TA is addressed to the first As the download destination of the sensor ID, algorithm ID and image, and moving image stored in the monitoring information communication signal, the communication address corresponding to the sensor device SU having the sensor ID stored in the first monitoring information communication signal is stored. 2 The monitoring information communication signal is generated, and the generated second monitoring information communication signal is transmitted via the SV communication IF unit 21.

  On the other hand, in the process S234, the management server apparatus SV determines whether or not the action type name determined for the algorithm ID is “other” by the SV monitoring notification processing unit 222. More specifically, the SV monitoring notification processing unit 222 extracts the action type name registered in the action type name field 2342 of the record selected in the process S232, and whether the extracted action type name is “other”. Determine whether or not.

  If the extracted action type name is not “others” as a result of this determination (No), the management server apparatus SV sends an SV monitoring notification to transmit the detection result to the terminal apparatuses SP and TA with the action type name. The processing unit 222 generates a second monitoring information communication signal addressed to the predetermined terminal devices SP and TA with the action type name extracted in processing S232, and the generated second monitoring information communication signal is transmitted via the SV communication IF unit 21. (S235), and this process (process S23) is terminated. More specifically, the SV monitoring notification processing unit 222 corresponds to the sensor device SU that transmitted the first monitoring information communication signal received in step S21 (that is, the sensor ID accommodated in the first monitoring information communication signal). A report destination (re-report destination, transfer destination, transmission destination) to be selected is selected (searched) from the report destination correspondence stored in the inter-device information storage unit 232, and the first terminal device SP, TA is addressed to the first The sensor ID accommodated in the monitoring information communication signal, the action type name extracted in step S234 (that is, the action type name finally associated with the sensor ID and algorithm ID accommodated in the first monitoring information communication signal), The communication address corresponding to the sensor device SU having the sensor ID accommodated in the first monitoring information communication signal as the download destination of the image and moving image accommodated in the first monitoring information communication signal. The second generates monitoring information communication signals containing the less, the second monitoring information communication signals the generated transmitted through the SV communication IF unit 21, the process is terminated (process S23). In the above description, the action type name is accommodated in place of the algorithm ID in the second monitoring information communication signal. However, the action type name may be accommodated in addition to the algorithm ID.

  On the other hand, if the extracted action type name is “others” as a result of the determination in the process S234 (Yes), the SV monitoring notification processing unit 222 ends the process (process S23). That is, the SV monitoring notification processing unit 222 ends this processing (processing S23) without generating the above-described second monitoring information communication signal corresponding to the first monitoring information communication signal received in the processing S21. Therefore, the above-described second monitoring information communication signal corresponding to the first monitoring information communication signal received in the process S21 is not transmitted to the terminal devices SP and TA.

  As described above, the first monitoring information process of the process S23 is executed.

  On the other hand, in the process S24, the management server apparatus SV processes the action type name notification communication signal received from the mobile terminal apparatus TA in the process S21 by the count processing unit 223 and the SV monitoring notification processing unit 222 of the SV control processing unit 22. The action type name process to be executed is executed. More specifically, this action type name process includes the processes shown in FIG. In FIG. 10, first, the count processing unit 223 performs the sensor ID, and based on the sensor ID, algorithm ID, and action type name accommodated in the action type name notification communication signal received from the mobile terminal device TA in step S21. The number of received behavior type name notification communication signals is counted using the reception number table RT stored in the reception number information storage unit 233 for each algorithm ID and for each behavior type name (S241). More specifically, the count processing unit 223 is accommodated in the action type name notification communication signal received in step S21 from all the reception number tables RT stored for each sensor ID in the reception number information storage unit 233. A reception number table RT corresponding to the selected sensor ID is selected, and in the selected reception number table RT, a row 2331 corresponding to the algorithm ID accommodated in the action type name notification communication signal received in the process S21, and the process S21 1 is added to the column corresponding to the column 2332 corresponding to the action type name accommodated in the action type name notification communication signal received in step (incremented by numerical value 1, reception number ← reception number + 1).

  Next, the management server device SV determines whether or not the reception number in the addition result of the processing S241 by the counting processing unit 223 has reached the determination threshold by the SV monitoring notification processing unit 222 of the SV control processing unit 22 (S242). ). As a result of this determination, when the number of receptions has not reached the determination threshold value (No), the management server device SV ends this process (Process S24), while the number of receptions has reached the determination threshold value. In the case (Yes), the management server device SV ends the present process (process S24) after executing the next process S243.

  In this process S243, the management server apparatus SV uses the SV monitoring notification processing unit 222 to determine the action type name for the action type name whose reception count has reached the determination threshold value in the processes S241 and S242. More specifically, the SV monitoring / notification processing unit 222 receives all of the action type name tables NT stored in the action type name information storage unit 234 for each sensor ID in the processes S241 and S242. The action type name table NT corresponding to the sensor ID associated with the number table RT (in this embodiment, the sensor ID accommodated in the action type name notification communication signal received in step S21) is selected, and this selection is made. Corresponds to the algorithm ID (in this embodiment, the algorithm ID accommodated in the action type name notification communication signal received in step S21) in which the number of receptions reaches the determination threshold value in step S242 from the action type name table NT. A record is selected, and in the action type name field 2342 of the selected record, the received number reaches the determination threshold value in the process S242. The action type name (in this embodiment, the action type name accommodated in the action type name notification communication signal received in step S21) is registered, and the confirmation flag “1” is registered in the confirmation flag field 2343 of the selected record. To update the registration. As a result, the action type name whose reception count has reached the determination threshold in step S242 (in this embodiment, the action type name corresponding to the sensor ID and algorithm ID accommodated in the action type name notification communication signal received in step S21) ) Is confirmed.

  For example, in the three wake-up detection programs 1 to 3 and the two get-off detection programs 1 and 2, a numerical value 5 is set as the determination threshold, and one fall detection program and two fall detection programs 1 and 2 are set. When the numerical value 3 is set as the determination threshold, in the example shown in FIG. 4, the wake-up detection program 1 whose algorithm ID is the wake-up algorithm 1 reaches the determination threshold “5” as the action type name. For example, the fall detection program 1 whose algorithm ID is the fall algorithm 1 is associated with “getting out of bed” having reached the determination threshold “3” as the action type name.

  As described above, the action type name process of the process S24 is executed.

  In the process S25, the management server apparatus SV executes an appropriate process according to the communication signal received in the process S21 by the SV control processing unit 22.

  Then, in the process S26 executed after each of these processes S23 to S25, the management server apparatus SV determines whether or not its operation is ended (stopped) by the SV control processing unit 22. As a result of this determination, when the operation is finished (stopped) (Yes), the management server device SV finishes this process. On the other hand, when the operation is not finished (stopped) (No), the management server device SV The server device SV returns the process to step S21.

  Regarding the automatic customization according to the individuality (characteristics) of the monitored person Ob, the management server device SV operates as described above.

  Next, operations of the terminal devices SP and TA will be described. Here, as an example, the operation of the mobile terminal device TA will be described. As described above, when the operation is started when the power is turned on, in the portable terminal device TA, for example, a login operation by a monitor (user) such as a nurse or a caregiver is accepted, and the TA monitor display processing unit 322 is operated. As a result, a standby screen for waiting for a communication signal addressed to itself is displayed on the TA display unit 36. For example, as shown in FIG. 12, the standby screen 51 includes a menu bar area 511 for displaying a menu bar, and a standby main area for displaying a message indicating standby (for example, “no notification”) and an icon. 512, a time area 513 for displaying the current time, a year / month / sunday area 514 for displaying the current year / month / sunday, and a user name area 515 for displaying the name of the user who is currently logged in to the portable terminal device TA. Is provided.

  In FIG. 11, the portable terminal device TA determines whether or not the TA communication IF unit 31 has received a communication signal by the TA control unit 321 of the TA control processing unit 32 (S31). As a result of this determination, when the communication signal is not received (No), the mobile terminal device TA returns the process to S31, and as a result of the determination, when the communication signal is received (Yes), The portable terminal device TA executes the following process S32. That is, the mobile terminal device TA is waiting for reception of a communication signal.

  In the process S32, the portable terminal device TA determines the type of the received communication signal by the TA control unit 321. As a result of this determination, when the received communication signal is the second monitoring information communication signal (second monitoring information), the portable terminal device TA executes the next process S33, and the received communication signal is 2 If it is not a monitoring information communication signal (others), the process ends after executing a process S39 for performing an appropriate process according to the communication signal received in the process S31.

  In the process S33, the mobile terminal device TA is connected to the monitored person Ob stored in the second monitoring information communication signal received from the management server apparatus SV in the process S31 by the TA monitoring display processing unit 322 of the TA control processing unit 32. Monitoring information related to monitoring is stored (recorded) in the TA monitoring information storage unit 331.

  Next, the portable terminal device TA determines whether the detection result accommodated in the second monitoring information communication signal received in step S31 is the algorithm ID or the action type name by the TA monitoring display processing unit 322 (S34). As a result of this determination, when the algorithm ID is accommodated as the detection result in the second monitoring information communication signal received in step S31 (algorithm ID), the portable terminal device TA is processed by the TA monitoring display processing unit 322. If S35 is executed after S35, and the action type name is accommodated as the detection result in the second monitoring information communication signal received in process S31 (action type name), the portable terminal device TA The TA monitoring display processing unit 322 executes the process S37 after executing the process S36.

  In this process S35, the portable terminal apparatus TA displays the monitoring information in which the TA monitoring display processing unit 322 displays the detection result of the sensor apparatus SU using the algorithm ID. More specifically, the TA monitoring display processing unit 322 displays, for example, a monitoring information screen 52a shown in FIG. The information is displayed on the TA display unit 36.

  The monitoring information screen 52a is a screen for displaying the monitoring information related to the monitoring of the monitored person Ob and inputting the action type name of the action type. For example, as shown in FIG. 13, the monitoring information screen 52a includes a menu bar area 511, an arrangement location of the sensor device SU having the sensor ID accommodated in the second monitoring information communication signal received in step S31, and the The monitored person name area 521 for displaying the name of the monitored person Ob monitored by the sensor device SU having the sensor ID, and the reception time of the second monitoring information communication signal received in the process S31 (or the predetermined action) Detection time) and a detection action display area 522 for displaying a detection result for the predetermined action accommodated in the second monitoring information communication signal received in the process S31, and the second monitoring received in the process S31. An image contained in the information communication signal (that is, an image captured by the sensor device SU having the sensor ID) (here, a still image) is displayed. Includes an image area 523 that, "corresponding" button 524, the "speak" button 525, and "see the LIVE" button 526, and "action type name" button 527 (527-1～527-5).

  In order to generate such a monitoring information screen 52a, the TA storage unit 33 is monitored by the sensor ID, the location of the sensor device SU having the sensor ID, and the sensor device SU having the sensor ID. The names of the monitored persons Ob are stored in advance in association with each other. In the detection action display area 522, an algorithm ID accommodated as a detection result for the predetermined action is displayed in the second monitoring information communication signal received in step S31. In the example illustrated in FIG. 13, “wake-up algorithm 2” that is an algorithm ID of the wake-up detection algorithm 2 (wake-up detection program 2) is displayed in the detection action display area 522. The “corresponding” button 524 is an intention (response intention, response intention) to perform the above-described response (coping, response) such as lifesaving, nursing, care, and assistance to the monitored person Ob monitored by the sensor device SU of the sensor ID. This is a button for inputting to the mobile terminal device TA that the user (monitoring person) of the mobile terminal device TA has a coping intention and a willingness to respond. The “speak” button 525 is a button for requesting a voice call, and is used to input an instruction to connect the sensor device SU of the sensor ID and the mobile terminal device TA via the network NW. It is a button. The “LIVE” button 526 is a button for requesting a live video, and is a button for inputting an instruction to display a video captured by the sensor device SU of the sensor ID. The “action type name” button 527 is a button for inputting an action type name. In this embodiment, the action type names are wake-up, get-off, fall, fall, and others. “Wake up” button 527-1 for inputting a wake-up as a name, “Leave” button 527-2 for inputting a wake-up as an action type name, and “Fall” button 527- for inputting a fall as an action type name 3. A “fall” button 527-4 for inputting a fall as an action type name, and an “other” button 527-5 for inputting other as an action type name.

  On the other hand, in process S36, portable terminal device TA displays the monitoring information which displayed the detection result of sensor apparatus SU using the action kind name by TA monitor display processing part 322. More specifically, the TA monitoring display processing unit 322 displays, for example, the monitoring information screen 52b shown in FIG. 14 according to each information (each data) accommodated in the second monitoring information communication signal received in the process S31. The information is displayed on the TA display unit 36.

  The monitoring information screen 52b is a screen for displaying the monitoring information related to the monitoring of the monitored person Ob. For example, as shown in FIG. 14, the monitoring information screen 52b includes a menu bar area 511, a monitored person name area 521, a detection action display area 522, an image area 523, a “corresponding” button 524, A “speak” button 525 and a “watch live” button 526 are provided. That is, the monitoring information screen 52b shown in FIG. 14 is different from the monitoring information screen 52a shown in FIG. 13 in that “action type name” buttons 527 (527-1 to 527-5) are removed. In the detected action display area 522, the action type name accommodated in the second monitoring information communication signal received in step S31 as a detection result for the predetermined action is displayed as an icon representative of the action type name. Has been. In order to display the action type name as an icon, the TA storage unit 33 stores an action type name and an icon representative of the action type name in association with each other in advance. In the example illustrated in FIG. 14, a wake-up icon that symbolizes wake-up is displayed in the detection action display area 522.

  In step S <b> 37, the mobile terminal device TA determines whether or not the TA control processing unit 32 has accepted an input operation on the touch panel including the TA input unit 35 and the TA display unit 36. If the input operation is not accepted as a result of this determination (No), the mobile terminal device TA returns the process to step S37. On the other hand, if the input operation is accepted as a result of the determination, the mobile terminal TA The apparatus TA executes the next process S38.

  In this process S38, the portable terminal device TA performs an appropriate process according to the content of the input operation by the TA control processing unit 32, and ends the screen display operation.

  For example, when the mobile terminal device TA accepts an input operation of the “corresponding” button 524 by the TA control processing unit 32 (that is, when accepting the correspondence intention), the portable terminal device TA is currently displayed on the TA display unit 36. A sensor corresponding to the monitoring information of the monitored person Ob displayed on the TA display unit 36 with the fact that “corresponding” has been received is added to the monitoring information of the monitoring person Ob and stored in the TA monitoring information storage unit 331. A communication signal (correspondence acceptance notification communication signal) containing information indicating that the ID and “corresponding” are accepted (correspondence acceptance information) is transmitted to the management server device SV. The management server device that has received this correspondence reception notification communication signal uses the SV control processing unit 22 to transmit a communication signal containing the sensor ID and correspondence reception information contained in the received correspondence reception notification communication signal (corresponding reception well-known communication signal). ) To the terminal devices SP and TA by broadcast communication. As a result, regarding the sensor ID corresponding to the monitoring information of the monitored person Ob displayed on the TA display unit 36, the fact that “corresponding” has been received is synchronized between the terminal devices SP and TA.

  Further, for example, when the mobile terminal device TA receives an input operation of the “speak” button 525 by the TA control processing unit 32, the TA nurse call processing unit 324 displays the monitored subject Ob displayed on the TA display unit 36. A communication signal (call request communication signal) containing information such as requesting a voice call is transmitted to the monitoring sensor device SU, and the corresponding sensor device SU is connected to the sensor device SU via the network NW so as to be able to make a voice call. . As a result, a voice call can be made between the mobile terminal device TA and the sensor device SU. When the TA control processing unit 32 accepts an input operation of an “end” button (not shown) that is a button for inputting an instruction to end a voice call, the TA terminal processing unit 324 Then, a communication signal (call end communication signal) containing information such as a request to end the voice call is transmitted to the sensor device SU that monitors the monitored person Ob displayed on the TA display unit 36. Thereby, the voice call between the mobile terminal device TA and the sensor device SU is terminated.

  Further, for example, when the mobile terminal device TA receives an input operation of the “watch live” button 526 by the TA control processing unit 32, the TA streaming processing unit 325 displays the monitored object currently displayed on the TA display unit 36. A communication signal (video distribution request communication signal) containing information such as requesting live video distribution is transmitted to the sensor device SU that monitors the person Ob, and the sensor device SU and the network NW corresponding thereto are transmitted. The video is connected to be downloadable via the sensor device SU, receives live video distribution from the sensor device SU, and displays the distributed video on the TA display unit 36 by streaming playback. On the monitoring information screens 52 a and 52 b that display the live video, the video is displayed in the image area 523, and a “live end” button (not shown) is displayed instead of the “view live” button 526. As a result, live video is displayed on the mobile terminal device TA. The “live end” button (not shown) is a button for requesting the end of the moving image, and ends (stops) the distribution of the moving image picked up by the sensor device SU of the sensor ID and ends (stops) the display. This is a button for inputting an instruction to be performed. When the portable terminal device TA receives an input operation of the “live end” button by the TA control processing unit 32, the TA streaming processing unit 325 monitors the monitored person Ob currently displayed on the TA display unit 36. A communication signal (moving image distribution end communication signal) containing information such as requesting the end of moving image distribution is transmitted to the sensor device SU, and a still image is displayed on the TA display unit 36. Accordingly, the mobile terminal device TA ends the live video display.

  For example, when the mobile terminal device TA receives an input operation of the “action type name” button 527 by the TA control processing unit 32, the action type name notification processing unit 323 causes the action type name of the input action type to be input. Is associated with the algorithm ID displayed on the TA display unit 36, and the algorithm ID displayed on the TA display unit 36 and the action type name of the input action type are returned to the management server device SV. In this embodiment, since there are a plurality of sensor devices SU, the action type name of the action type is further associated with the sensor ID corresponding to the monitoring information screen 52a displayed on the TA display unit 36. The sensor ID is also returned to the management server device SV. More specifically, when an input operation of the “wake-up” button 527-1 is received, the action type name notification processing unit 323, the sensor ID corresponding to the monitoring information screen 52a displayed on the TA display unit 36, and The algorithm ID displayed in the detection behavior display area 522 of the monitoring information screen 52a (in this embodiment, the sensor ID and algorithm ID accommodated in the second monitoring information communication signal received in step S31), and the behavior An action type name notification communication signal containing “wake-up” as the type name is generated, and the generated action type name notification communication signal is transmitted to the management server device SV via the TA communication IF unit 31. When receiving the input operation of the “get out” button 527-2, the action type name notification processing unit 323 displays the sensor ID corresponding to the monitoring information screen 52a displayed on the TA display unit 36, and the monitoring information screen 52a. The algorithm ID displayed in the detection action display area 522 (in this embodiment, the sensor ID and algorithm ID accommodated in the second monitoring information communication signal received in step S31), and “being out of bed” as the action type name. Is sent to the management server device SV via the TA communication IF unit 31. In other words, upon receiving an input operation of the “get out” button 527-2, the action type name notification processing unit 323 receives the “wake up” in the above action type name notification communication signal containing “wake up” as the action type name. Instead, an action type name notification communication signal containing “getting out bed” is generated and transmitted to the management server device SV. Similarly, when an input operation of the “fall” button 527-3 is received, the action type name notification processing unit 323 receives the “wake-up” in the above-described action type name notification communication signal containing “wake-up” as the action type name. In place of “falling”, an action type name notification communication signal containing “falling” is generated and transmitted to the management server device SV. When receiving the input operation of the “falling” button 527-4, the action type name notification processing unit 323 replaces the “getting up” in the above action type name notification communication signal containing “getting up” as the action type name. An action type name notification communication signal containing “falling” is generated and transmitted to the management server device SV. When the input operation of the “other” button 527-5 is received, the action type name notification processing unit 323 receives the “wakeup” in the above action type name notification communication signal containing “wakeup” as the action type name. Instead, an action type name notification communication signal containing “others” is generated and transmitted to the management server device SV.

  Regarding the automatic customization according to the individuality (characteristics) of the monitored person Ob, the mobile terminal device TA operates as described above.

  As described above, the monitored person monitoring system MS, the sensor apparatus SU and the management server apparatus SV as an example of the monitored person monitoring apparatus, and the mounted monitored person monitoring method in the present embodiment For all the behavior detection algorithms (behavior detection programs), when the predetermined behavior is detected by the behavior detection algorithm as a result of the detection process, the predetermined behavior is detected by an algorithm ID corresponding to the behavior detection algorithm. Since the terminal device SP, TA is notified together with the image related to the monitored person Ob, the user (monitoring person) of the terminal device SP, TA refers to the image so that the action type name corresponding to the algorithm ID is obtained. A reply can be made by inputting to the terminal devices SP and TA. The monitored person monitoring system MS, the monitored person monitoring device (the sensor device SU and the management server device SV), and the monitored person monitoring method include the algorithm ID and the action type name associated with the algorithm ID. Since it is received from the terminal devices SP and TA, the monitored person monitoring system MS, the monitored person monitoring device (the sensor device SU and the management server device SV), and the monitored person monitoring method, the received algorithm ID On the basis of the action type name associated with the action type name, the action type name that can be detected according to the individuality (characteristic) of the monitored person Ob can be automatically associated with the action detection algorithm. Therefore, the monitored person monitoring system MS, the monitored person monitoring device (the sensor device SU and the management server device SV), and the monitored person monitoring method are automatically customized according to the individuality (characteristics) of the monitored person. it can.

  The monitored person monitoring system MS, the monitored person monitoring device (the sensor device SU and the management server device SV), and the monitored person monitoring method include the algorithm ID in the count processing unit 223 among all the action type names. The action type name associated with the algorithm ID can be determined based on the action type name for which the counted number of receptions has reached a predetermined determination threshold for each sensor action ID in this embodiment and for each action type name.

  The monitored person monitoring system MS, the monitored person monitoring device (the sensor device SU and the management server device SV), and the monitored person monitoring method are further classified according to the algorithm ID and the action type name by the counting processing unit 223. In this embodiment, for each sensor ID, when the counted number of receptions reaches a predetermined determination threshold and the action type name corresponding to the number of receptions that reaches the predetermined determination threshold is the other, the action type name Even if the predetermined action is detected by the action detection algorithm having the algorithm ID corresponding to the number of receptions that has reached the predetermined determination threshold in the others, the detection of the predetermined action is performed by the processing S234 in the terminal device. Since the SP and TA are not notified, false alarms can be reduced.

  In the present embodiment, as described above, the monitored person monitoring device includes the sensor device SU and the management server device SV. Therefore, only a plurality of sensor devices SU are prepared, and a plurality of monitored subjects Ob are individually monitored. In this case, the monitored person monitoring system MS can be applied (introduced).

  In the above-described embodiment, the final correspondence between the algorithm ID and the action type name is the algorithm ID and the action type name, and in this embodiment, the sensor ID is further counted. Is performed according to algorithm ID and action type name, and further here, for each sensor ID, after counting for a predetermined period, the action type name corresponding to the maximum number of receptions in the predetermined period. It may be executed with. More specifically, in this case, as in the above-described embodiment, the counting processing unit 223 further includes the algorithm ID and the action type name of the action type associated with the algorithm ID, and here the sensor ID and the sensor ID. When the action type name associated with the action type is received from the terminal devices SP and TA, the number of receptions of the action type name associated with the algorithm ID is further expressed here as a sensor ID. The associated action type names of the action types are counted for each algorithm ID and for each action type name, here, for each sensor ID. Then, the SV monitoring notification processing unit 222 performs counting for a predetermined period by the algorithm ID and the action type name, and further by sensor ID here, for each of the algorithm IDs. In place of the algorithm ID, the action type name corresponding to the maximum number of receptions in the predetermined period with the algorithm ID, or in addition to the algorithm ID, the maximum number of receptions in the predetermined period with the algorithm ID The terminal device SP or TA is notified of the detection of the predetermined behavior by the corresponding behavior type name. More specifically, after processing S241 similar to that described above shown in FIG. 10 is executed, the management server device SV replaces the determination with the determination threshold value in processing S242 shown in FIG. The monitoring notification processing unit 222 determines whether or not a counting period, which is a period for counting the number of receptions, has reached a predetermined period. This counting period is managed for each sensor ID (the management server device SV includes the counting period for each sensor ID). If the result of this determination is that the counting period has not reached the predetermined period (No), the management server device SV ends this processing (process S24), while the counting period is the predetermined period. If it has reached (Yes), the management server apparatus SV ends the present process (process S24) after executing the next process S243. The predetermined period is an arbitrary period, for example, 3 days, 5 days, 1 week, and 2 weeks. In step S243 in this case, the management server apparatus SV uses the SV monitoring notification processing unit 222 to determine the action type name with the action type name having the maximum number of receptions. More specifically, the SV monitoring notification processing unit 222 is stored for each sensor ID in all the reception number tables RT and the action type name information storage unit 234 stored in the reception number information storage unit 233 for each sensor ID. The reception number table RT and the action type name table NT corresponding to the sensor ID associated with the counting period that has reached the predetermined period are selected from all the action type name tables NT that are included. In the selected reception number table RT, for each record 2331 (each algorithm ID), an action type name field 2332 having the maximum reception number in the record 2331 (algorithm ID) is selected, and the selected action type name The action type name in field 2332 is extracted and the selected action type name table is selected. From the record NT, a record corresponding to the algorithm ID of the record 2331 is selected, the action type name taken out is registered in the action type name field 2342 of the selected record, and the confirmation flag of the selected record A confirmation flag “1” is registered in the field 2343. For example, when the reception number table RT-1 corresponding to the first sensor device SU-1 shown in FIG. 4 is a counting result after the predetermined period has elapsed, the wakeup detection program 1 whose algorithm ID is the wakeup algorithm 1 is used. Is associated with “other” having the maximum number of receptions “5” as the action type name, and for example, in the bed detection program 2 with the algorithm ID of the bed leaving algorithm 2, the maximum reception as the action type name is “Leave” with the number “3” is associated. Such monitored person monitoring system MS, monitored person monitoring apparatus (sensor apparatus SU and management server apparatus SV), and monitored person monitoring method, all the action detection algorithms (all algorithm IDs), Among the type names, the algorithm is used with the type of action type in which the counted number of receptions is maximized in a predetermined period for each algorithm ID and for each type of action type in the counting processing unit 223, and further for each sensor ID here. Since the action type name associated with the ID and the action type name associated with the sensor ID are determined here, the action type name can be determined with the most likely action type name.

  In this case, the SV monitoring notification processing unit 222 preferably counts the predetermined processing unit 223 after counting for a predetermined period for each algorithm ID and each action type name, here for each sensor ID. If the action type name corresponding to the maximum number of receptions in the period is the other, the action type name is detected by the action detection algorithm of the algorithm ID having the maximum other reception number. However, the detection of the predetermined action is not notified to the terminal devices SP and TA by the same processes as the processes shown in FIG. 9, in particular, the same process as the process S234 shown in FIG. Such monitored person monitoring system MS, monitored person monitoring apparatus (sensor apparatus SU and management server apparatus SV), and monitored person monitoring method are classified by algorithm number and action type name by the counting processor 223, respectively. Here, after counting for each sensor ID for a predetermined period, if the action type name corresponding to the maximum number of receptions in the predetermined period is the other, the action type name is set to the other maximum reception number. Even if the predetermined action is detected by the action detection algorithm having the corresponding algorithm ID, the detection of the predetermined action is not notified to the terminal devices SP and TA, so that false alarms can be reduced.

  The present specification discloses various aspects of the technology as described above, and the main technologies are summarized below.

  A monitored person monitoring apparatus according to an aspect is a monitored person monitoring apparatus that detects a predetermined behavior of a monitored person to be monitored and notifies a terminal device connected to be communicable, the monitored person A behavior detection algorithm information storage unit that stores one or more behavior detection algorithms for detecting a predetermined behavior in each of a plurality of different behavior types in the predetermined behavior, and the behavior detection algorithm. A detection process for performing the detection process using a behavior detection algorithm identifier information storage unit that stores a behavior detection algorithm identifier for identifying and identifying, and all the behavior detection algorithms stored in the behavior detection algorithm information storage unit And the detection processing result of the detection processing unit for all the behavior detection algorithms. When the predetermined behavior is detected by the behavior detection algorithm, the detection of the predetermined behavior is performed by the behavior detection algorithm identifier corresponding to the behavior detection algorithm stored in the behavior detection algorithm identifier information storage unit. A notification processing unit that notifies the terminal device together with an image related to a monitor, and the notification processing unit includes the behavior type name associated with the behavior detection algorithm identifier and the behavior detection algorithm identifier. After receiving from the terminal device, based on the action type name of the action type associated with the received action detection algorithm identifier, in place of the action detection algorithm identifier or with the action detection algorithm identifier In addition, the detection of the predetermined action is notified to the terminal device by the action type name. That.

  Such a monitored person monitoring device corresponds to the behavior detection algorithm when the behavior detection algorithm detects the predetermined behavior as a result of the detection processing of the detection processing unit for all the behavior detection algorithms. The detection of the predetermined action is notified to the terminal device together with the image related to the monitored person by the action detection algorithm identifier to be performed, so that the user (monitoring person) of the terminal device can refer to the action by referring to the image. An action type name of the action type corresponding to the detection algorithm identifier can be input to the terminal device and returned. The image related to the monitored person is preferably at least one of a still image and a moving image. The monitored person monitoring device receives the action type name of the action type associated with the action detection algorithm identifier and the action detection algorithm identifier from the terminal device. Based on the action type name of the action type associated with the received action detection algorithm identifier, an action type name that can be detected according to the individuality (characteristics) of the monitored person with the action detection algorithm and the action detection algorithm. It can be automatically associated. Therefore, the monitored person monitoring device can be automatically customized according to the individuality (characteristic) of the monitored person.

  In another aspect, in the above-described monitored person monitoring device, the notification processing unit receives from the terminal device the behavior type name of the behavior type associated with the behavior detection algorithm identifier and the behavior detection algorithm identifier. A count processing unit that counts the number of received behavior type names of the behavior types associated with the behavior detection algorithm identifier by the behavior detection algorithm identifier and the behavior type name, and the counting processing unit In the behavior detection algorithm identifier having the number of receptions that has reached the predetermined determination threshold when the number of receptions counted by behavior detection algorithm identifier and by the type of behavior reaches a predetermined determination threshold, the behavior detection algorithm identifier Instead of the action type name corresponding to the number of receptions that reached the predetermined determination threshold, or the action detection In addition to the algorithm identifier and a first notification unit which notifies a detection of the predetermined action in action type name corresponding to the number of reception reaches the predetermined determination threshold value to the terminal device. Preferably, when each of the plurality of monitored persons is monitored by each of the plurality of detection processing units, the counting processing unit further counts the number of receptions for each detection processing unit.

  Such a monitored person monitoring apparatus is an action in which the number of receptions counted for each action detection algorithm identifier and for each action type name by the counting processing unit among all action type names reaches a predetermined determination threshold. The action type name associated with the action detection algorithm identifier can be determined by the type name. The predetermined determination threshold is preferably an integer value of 1 or more.

  In another aspect, in the above-described monitored person monitoring device, the action type name includes a plurality of names corresponding to the plurality of action types, and “other” as a name not belonging to the plurality of action types. And the first notification unit receives the number of receptions counted by the behavior detection algorithm identifier and the behavior type name by the counting processing unit, and reaches the predetermined determination threshold. When the behavior type name corresponding to the number is the other, the predetermined behavior is detected by the behavior detection algorithm of the behavior detection algorithm identifier having the number of receptions where the behavior type name has reached the predetermined determination threshold in the other However, the detection of the predetermined action is not notified to the terminal device.

  In such a monitored person monitoring device, the number of receptions counted by the behavior detection algorithm identifier and the behavior type name by the counting processing unit has reached a predetermined determination threshold, and has reached the predetermined determination threshold When the behavior type name corresponding to the number of receptions is the other, the behavior type name is the others, and the predetermined behavior is detected by the behavior detection algorithm of the behavior detection algorithm identifier having the number of receptions that has reached the predetermined determination threshold. Even if it is detected, detection of the predetermined action is not notified to the terminal device, so that false alarms can be reduced.

  In another aspect, in the above-described monitored person monitoring device, the notification processing unit receives from the terminal device the behavior type name of the behavior type associated with the behavior detection algorithm identifier and the behavior detection algorithm identifier. A count processing unit that counts the number of received behavior type names of the behavior types associated with the behavior detection algorithm identifier by the behavior detection algorithm identifier and the behavior type name, and the counting processing unit After counting for a predetermined period for each action detection algorithm identifier and for each action type name, in each of all the action detection algorithm identifiers, the maximum reception in the predetermined period with the action detection algorithm identifier instead of the action detection algorithm identifier The action type name corresponding to the number or the action detection algorithm identifier And a second notification unit for notifying the detection of the predetermined action in action type name corresponding to the maximum number of received additional is made in a predetermined period in the behavior detection algorithm identifier to the terminal device.

  In such a monitored person monitoring device, the number of receptions counted by the behavior detection algorithm identifier and the behavior type name by the counting processing unit from among all the behavior type names in each of the behavior detection algorithms. Since the action type name associated with the action detection algorithm identifier is determined by the action type name that has become the maximum in the predetermined period, the action type name associated with the action detection algorithm identifier can be determined by the most probable action type name. The predetermined period is an arbitrary period, for example, 3 days, 5 days, 1 week, and 2 weeks.

  In another aspect, in the above-described monitored person monitoring device, the action type name includes a plurality of names corresponding to the plurality of action types, and “other” as a name not belonging to the plurality of action types. And the second notification unit counts the behavior detection algorithm identifier and the behavior type name for a predetermined period by the counting processing unit, and then the behavior type name corresponding to the maximum number of receptions in the predetermined period. If it is the other, the terminal device detects the predetermined action even if the action type name is detected by the action detection algorithm of the action detection algorithm identifier having the maximum number of receptions in the other type. Do not notify.

  The monitored person monitoring apparatus counts the action type corresponding to the maximum number of receptions in the predetermined period after counting for a predetermined period by the action detection algorithm identifier and the action type name by the counting processing unit. If the action type name is the other, the action type name of the action detection algorithm identifier of the action detection algorithm identifier having the largest number of receptions is detected by the action detection algorithm, even if the predetermined action is detected. Since no notification is given to the device, false alarms can be reduced.

  In another aspect, in the above-described monitored person monitoring apparatus, the number of received behavior type names of the behavior types associated with the behavior detection algorithm identifiers is counted for each behavior detection algorithm identifier and for each behavior type name. A reception number information storage unit for storing the reception number information indicating the counted result, and the counting processing unit displays the action type name of the action type associated with the action detection algorithm identifier and the action detection algorithm identifier. When received from the terminal device, using the received number information stored in the received number information storage unit, the received number of action type names of the action type associated with the action detection algorithm identifier is Count by detection algorithm identifier and by action type name.

  According to this, using the reception number information, the number of receptions of the behavior type name of the behavior type associated with the behavior detection algorithm identifier is counted by the behavior detection algorithm identifier and the behavior type name. Person monitoring device can be provided.

  A monitored person monitoring method according to another aspect is a monitored person monitoring method for detecting a predetermined action in a monitored person to be monitored and notifying a terminal device connected to be communicable, Action detection algorithm information that stores one or more action detection algorithms for executing a detection process for detecting a predetermined action in a monitor for each of a plurality of different action types in the predetermined action in the action detection algorithm information storage unit A storage step, a behavior detection algorithm identifier information storage step for storing the behavior detection algorithm identifier for identifying and identifying the behavior detection algorithm in the behavior detection algorithm identifier information storage unit, and a storage in the behavior detection algorithm information storage unit. Detection processing that executes the detection processing using all the behavior detection algorithms As a result of the detection process of the detection process step, when the predetermined action is detected by the action detection algorithm, all the action detection algorithms are stored in the action detection algorithm identifier information storage unit. A notification processing step of notifying the terminal device of the detection of the predetermined behavior together with an image related to the monitored person with a behavior detection algorithm identifier corresponding to the behavior detection algorithm, wherein the notification processing step includes the behavior detection algorithm Based on the behavior type name of the behavior type associated with the received behavior detection algorithm identifier after receiving the behavior type name of the behavior type associated with the identifier and the behavior detection algorithm identifier from the terminal device In place of the action detection algorithm identifier, the action type name or the line The detection of the predetermined action in action type name in addition to the detection algorithm identifier notifying to said terminal device.

  According to another aspect of the monitored person monitoring method, a behavior detection algorithm for executing a detection process for detecting a predetermined action in a monitored person to be monitored is set for each of a plurality of different action types in the predetermined action. A behavior detection algorithm information storage unit that stores one or a plurality of behavior detection algorithm information, and a behavior detection algorithm identifier information storage unit that stores a behavior detection algorithm identifier for identifying and identifying the behavior detection algorithm. The monitored person monitoring method of the monitored person monitoring device that detects the behavior and notifies the terminal device connected to be communicable, all the behavior detection algorithms stored in the behavior detection algorithm information storage unit About the detection process step to execute the detection process using and all the behavior detection algorithms The action detection algorithm identifier corresponding to the action detection algorithm stored in the action detection algorithm identifier information storage unit when the predetermined action is detected by the action detection algorithm as a result of the detection process of the detection process step A notification processing step of notifying the terminal device of the detection of the predetermined behavior together with an image related to the monitored person, wherein the notification processing step is associated with the behavior detection algorithm identifier and the behavior detection algorithm identifier. After receiving the behavior type name of the behavior type from the terminal device, based on the behavior type name of the behavior type associated with the received behavior detection algorithm identifier, the behavior type instead of the behavior detection algorithm identifier By name or by action type name in addition to the action detection algorithm identifier The serial detection of predetermined actions for informing to the terminal device.

  Such a monitored person monitoring method corresponds to the behavior detection algorithm when the behavior detection algorithm detects the predetermined behavior as a result of the detection processing of the detection processing step for all the behavior detection algorithms. The detection of the predetermined action is notified to the terminal device together with the image related to the monitored person by the action detection algorithm identifier to be performed, so that the user (monitoring person) of the terminal device can refer to the action by referring to the image. An action type name of the action type corresponding to the detection algorithm identifier can be input to the terminal device and returned. Since the monitored person monitoring method receives the action type name of the action type associated with the action detection algorithm identifier and the action detection algorithm identifier from the terminal device, the monitored person monitoring method includes: Based on the action type name of the action type associated with the received action detection algorithm identifier, an action type name that can be detected according to the individuality (characteristics) of the monitored person with the action detection algorithm and the action detection algorithm. It can be automatically associated. Therefore, the monitored person monitoring method can be automatically customized according to the individuality (characteristic) of the monitored person.

  A monitored person monitoring system according to another aspect is connected to a terminal device and the terminal device so as to be communicable, and detects a predetermined action in the monitored person to be monitored and notifies the terminal device A monitored person monitoring system comprising: a person monitoring device, wherein the person monitored device is any one of the above-mentioned monitored person monitoring devices.

  Since such a monitored person monitoring system includes any one of the above-described monitored person monitoring devices, it can be automatically customized according to the individuality (characteristic) of the monitored person.

  In another aspect, in the above-described monitored person monitoring system, the monitored person monitoring apparatus detects a predetermined action of the monitored person and notifies the management server apparatus described later together with an image related to the monitored person. A sensor device that executes a first notification and a second notification that is connected to the sensor device so as to be communicable and that receives the first notification from the sensor device, notifies the terminal device of the first notification. A management server device that executes the first notification, and the notification processing unit executes the first notification with respect to all of the behavior detection algorithms as a result of the detection processing of the detection processing unit. When the behavior detection algorithm identifier corresponding to the behavior detection algorithm stored in the behavior detection algorithm identifier information storage unit is detected, When the first notification is received from the sensor device as the first notification processing unit that notifies the management server device of the detection of the predetermined action together with the image related to the monitored person, and the execution of the second notification. The first notification is notified to the terminal device, and the behavior detection algorithm identifier and the behavior type name of the behavior type associated with the behavior detection algorithm identifier are received from the terminal device, and then the received behavior is received. Based on the behavior type name of the behavior type associated with the detection algorithm identifier, the predetermined behavior with the behavior type name instead of the behavior detection algorithm identifier or with the behavior type name in addition to the behavior detection algorithm identifier A second notification processing unit that notifies the terminal device of the detection of the detection, the sensor device, the behavior detection algorithm information storage unit, Serial behavior detection algorithm identifier information storage unit, and the detection processing unit and the first notification unit, the management server device includes a second notification unit.

  In such a monitored person monitoring system, since the monitored person monitoring device includes a sensor device and a management server device, when only a plurality of sensor devices are prepared and a plurality of monitored persons are individually monitored, the monitored person is monitored. A supervisor monitoring system can be applied (introduced).

  In another aspect, in the above-described monitored person monitoring system, the terminal device detects the predetermined behavior by the display unit that performs display, the input unit that performs input, and the behavior detection algorithm identifier. A display processing unit that displays the received action detection algorithm identifier and the image related to the monitored person on the display unit when received together with an image related to the monitor; and the action type name of the action type is the input unit When the action detection algorithm identifier displayed on the display unit is associated with the action detection algorithm identifier displayed on the display unit, the action detection algorithm identifier displayed on the display unit is input. And an action type name notification processing unit for returning the action type name of the action type.

  In such a monitored person monitoring system, when the terminal device receives the detection of the predetermined action together with the image related to the monitored person with the action detection algorithm identifier, the received action detection algorithm identifier and the received Since the image related to the monitored person is displayed on the display unit, the user (monitoring person) of the terminal device refers to the image, and selects the action type name of the action type corresponding to the action detection algorithm identifier. Input to the terminal device. Since the terminal device includes the action type name notification processing unit, when the action type name of the action type is input from the input unit, the action type name of the input action type is displayed on the display unit. The action detection algorithm identifier displayed on the display unit and the action type name of the input action type can be returned in association with the displayed action detection algorithm identifier.

  This application is based on Japanese Patent Application No. 2015-244214 filed on Dec. 15, 2015, the contents of which are included in the present application.

  In order to express the present invention, the present invention has been properly and fully described through the embodiments with reference to the drawings. However, those skilled in the art can easily change and / or improve the above-described embodiments. It should be recognized that this is possible. Therefore, unless the modifications or improvements implemented by those skilled in the art are at a level that departs from the scope of the claims recited in the claims, the modifications or improvements are not covered by the claims. To be construed as inclusive.

  According to the present invention, a monitored person monitoring device, a monitored person monitoring method, and a monitored person monitoring system can be provided.

Claims (11)

A monitored person monitoring device that detects a predetermined action in a monitored person and notifies a terminal device connected to be communicable,
An action detection algorithm information storage unit that stores one or more action detection algorithms for detecting a predetermined action in the monitored person for each of a plurality of different action types in the predetermined action;
A behavior detection algorithm identifier information storage unit for storing a behavior detection algorithm identifier for identifying and identifying the behavior detection algorithm;
A detection processing unit that executes the detection process using all the behavior detection algorithms stored in the behavior detection algorithm information storage unit;
For all the behavior detection algorithms, when the predetermined behavior is detected by the behavior detection algorithm as a result of the detection processing of the detection processing unit, the behavior detection stored in the behavior detection algorithm identifier information storage unit A notification processing unit that notifies the terminal device together with an image related to the monitored person of the detection of the predetermined action with an action detection algorithm identifier corresponding to the algorithm,
The notification processing unit receives the behavior type name of the behavior type associated with the behavior detection algorithm identifier and the behavior detection algorithm identifier from the terminal device, and then associates with the received behavior detection algorithm identifier. Based on the behavior type name of the behavior type, the terminal device detects the predetermined behavior with the behavior type name instead of the behavior detection algorithm identifier or with the behavior type name in addition to the behavior detection algorithm identifier. To inform,
Monitored person monitoring device. The notification processing unit
The behavior type name of the behavior type associated with the behavior detection algorithm identifier when the behavior detection algorithm identifier and the behavior type name of the behavior type associated with the behavior detection algorithm identifier are received from the terminal device A counting processing unit that counts the number of receptions for each action detection algorithm identifier and each action type name;
In the behavior detection algorithm identifier having the number of receptions that has reached the predetermined determination threshold when the number of receptions counted by the behavior detection algorithm identifier and the behavior type name in the counting processing unit has reached a predetermined determination threshold. The action type name corresponding to the number of receptions that has reached the predetermined determination threshold instead of the action detection algorithm identifier, or the number of receptions that have reached the predetermined determination threshold in addition to the action detection algorithm identifier A first notification unit that notifies the terminal device of the detection of the predetermined action by an action type name;
The monitored person monitoring apparatus according to claim 1. The action type name includes a plurality of names corresponding to each of the plurality of action types, and “others” as names that do not belong to the plurality of action types,
The first notification unit sets the number of receptions counted by the behavior detection algorithm identifier and the type of behavior name by the counting processing unit to a predetermined determination threshold, and to the number of receptions that has reached the predetermined determination threshold. If the corresponding action type name is the other, the action type name is detected by the action detection algorithm of the action detection algorithm identifier having the number of receptions that has reached the predetermined determination threshold in the other Does not notify the terminal device of the detection of the predetermined action,
The monitored person monitoring apparatus according to claim 2. The notification processing unit
The behavior type name of the behavior type associated with the behavior detection algorithm identifier when the behavior detection algorithm identifier and the behavior type name of the behavior type associated with the behavior detection algorithm identifier are received from the terminal device A counting processing unit that counts the number of receptions for each action detection algorithm identifier and each action type name;
After counting for a predetermined period by the action detection algorithm identifier and the action type name in the counting processing unit, the predetermined value in the action detection algorithm identifier is replaced with the action detection algorithm identifier in each of all the action detection algorithm identifiers. The action type name corresponding to the maximum number of receptions in the period of time, or the action type name corresponding to the maximum number of receptions in the predetermined period in the action detection algorithm identifier in addition to the action detection algorithm identifier A second notification unit that notifies the terminal device of detection of a predetermined action,
The monitored person monitoring apparatus according to claim 1. The action type name includes a plurality of names corresponding to each of the plurality of action types, and “others” as names that do not belong to the plurality of action types,
The second notification unit counts the behavior detection algorithm identifier and the behavior type name for a predetermined period by the counting processing unit, and then the behavior type name corresponding to the maximum number of receptions in the predetermined period is the other If the predetermined action is detected by the action detection algorithm of the action detection algorithm identifier having the largest number of receptions of the other action type name, the detection of the predetermined action is notified to the terminal device. do not do,
The monitored person monitoring apparatus according to claim 4. Received number information storage unit for storing received number information indicating a count result obtained by counting the number of received behavior type names of the behavior types associated with the behavior detection algorithm identifiers by the behavior detection algorithm identifiers and the behavior type names Further comprising
The counting processing unit stores the behavior detection algorithm identifier and the behavior type name of the behavior type associated with the behavior detection algorithm identifier from the terminal device when the behavior type name is received from the terminal device. The number of receptions of the action type name of the action type associated with the action detection algorithm identifier is counted for each action detection algorithm identifier and for each action type name using reception number information. A monitored person monitoring device given in any 1 paragraph. A monitored person monitoring method for detecting a predetermined action in a monitored person and notifying a terminal device connected to be communicable,
The behavior detection algorithm which performs the detection process which detects the predetermined | prescribed action in the said to-be-monitored person for each of several different action types in the said predetermined | prescribed action is memorize | stored in an action detection algorithm information storage part by 1 or more An algorithm information storage step;
A behavior detection algorithm identifier information storage step for storing a behavior detection algorithm identifier for identifying and identifying the behavior detection algorithm in a behavior detection algorithm identifier information storage unit;
A detection process step of executing the detection process using all the action detection algorithms stored in the action detection algorithm information storage unit;
For all the behavior detection algorithms, when the predetermined behavior is detected by the behavior detection algorithm as a result of the detection processing in the detection processing step, the behavior detection stored in the behavior detection algorithm identifier information storage unit A notification processing step of notifying the terminal device together with an image related to the monitored person, the detection of the predetermined action with an action detection algorithm identifier corresponding to the algorithm,
The notification processing step is associated with the received behavior detection algorithm identifier after receiving the behavior type name of the behavior type associated with the behavior detection algorithm identifier and the behavior detection algorithm identifier from the terminal device. Based on the behavior type name of the behavior type, the terminal device detects the predetermined behavior with the behavior type name instead of the behavior detection algorithm identifier or with the behavior type name in addition to the behavior detection algorithm identifier. A monitored person monitoring method. A behavior detection algorithm information storage unit that stores one or a plurality of behavior detection algorithms for performing a detection process for detecting a predetermined behavior in the monitored person for each of a plurality of different behavior types in the predetermined behavior; and A behavior detection algorithm identifier information storage unit for storing a behavior detection algorithm identifier for identifying and identifying the behavior detection algorithm is provided, and a predetermined behavior in the monitored person is detected and notified to a terminal device connected to be communicable. A monitored person monitoring method of a monitored person monitoring apparatus,
A detection process step of executing the detection process using all the action detection algorithms stored in the action detection algorithm information storage unit;
For all the behavior detection algorithms, when the predetermined behavior is detected by the behavior detection algorithm as a result of the detection processing in the detection processing step, the behavior detection stored in the behavior detection algorithm identifier information storage unit A notification processing step of notifying the terminal device together with an image related to the monitored person, the detection of the predetermined action with an action detection algorithm identifier corresponding to the algorithm,
The notification processing step is associated with the received behavior detection algorithm identifier after receiving the behavior type name of the behavior type associated with the behavior detection algorithm identifier and the behavior detection algorithm identifier from the terminal device. Based on the behavior type name of the behavior type, the terminal device detects the predetermined behavior with the behavior type name instead of the behavior detection algorithm identifier or with the behavior type name in addition to the behavior detection algorithm identifier. To inform,
Monitored person monitoring method. A monitored person monitoring system comprising: a terminal device; and a monitored person monitoring device that is connected to be communicable with the terminal device, detects a predetermined action in the monitored person, and notifies the terminal device,
The monitored person monitoring apparatus is the monitored person monitoring apparatus according to any one of claims 1 to 6. A monitored person monitoring system. The monitored person monitoring device detects a predetermined action in the monitored person, and performs a first notification that notifies the management server device with an image related to the monitored person, and the sensor device, A management server device that is connected to be communicable and that executes a second notification that notifies the terminal device of the first notification when the first notification is received from the sensor device;
The notification processing unit
As the execution of the first notification, the behavior detection algorithm identifier information is stored when the predetermined behavior is detected by the behavior detection algorithm as a result of the detection processing of the detection processing unit for all the behavior detection algorithms. A first notification processing unit that notifies the management server device of the detection of the predetermined behavior together with an image related to the monitored person, with an action detection algorithm identifier corresponding to the behavior detection algorithm stored in the unit;
As the execution of the second notification, when the first notification is received from the sensor device, the first notification is notified to the terminal device, and is associated with the behavior detection algorithm identifier and the behavior detection algorithm identifier. After receiving the behavior type name of the behavior type from the terminal device, based on the behavior type name of the behavior type associated with the received behavior detection algorithm identifier, the behavior type name instead of the behavior detection algorithm identifier Or a second notification processing unit that notifies the terminal device of the detection of the predetermined behavior by an action type name in addition to the action detection algorithm identifier,
The sensor device includes the behavior detection algorithm information storage unit, the behavior detection algorithm identifier information storage unit, the detection processing unit, and the first notification processing unit,
The management server device includes the second notification processing unit. The terminal device
A display unit for displaying, and
An input unit for input, and
Display that displays the received behavior detection algorithm identifier and the image related to the monitored person on the display unit when the detection of the predetermined action is received together with the image related to the monitored person by the behavior detection algorithm identifier A processing unit;
When the action type name of the action type is input from the input unit, the action type name of the input action type is associated with the action detection algorithm identifier displayed on the display unit, and is displayed on the display unit. An action type name notification processing unit that sends back the displayed action detection algorithm identifier and the action type name of the input action type;
The monitored person monitoring system according to claim 9 or 10.

Images