JP6880811B2 - Observed person monitoring device, the method and the system - Google Patents

Description

The present invention relates to a monitored person monitoring device for monitoring a monitored person to be monitored, a monitored person monitoring method, and a monitored person monitoring system.

Japan (Japan) is an aging society, more specifically, the ratio of the population aged 65 and over to the total population due to the improvement of living standards, the improvement of sanitary environment and the improvement of medical standards accompanying the high economic growth after the war. It is a super-aging society with an aging rate of over 21%. In 2005, the total population was about 127.65 million, while the number of elderly people aged 65 and over was about 25.56 million, while in 2020, the total population was about 124.11 million. The elderly population is estimated to be about 34.56 million. In such an aging society, the nurses and long-term care recipients who need nursing care or nursing care due to illness, injury, or aging are the nurses who need nursing care in a normal society that is not an aging society. It is expected to increase more than the above. Japan is also a society with a declining birthrate, for example, with a total fertility rate of 1.43 in 2013. For this reason, elderly care is also occurring in which elderly families (spouse, children, siblings) take care of elderly nurses requiring nursing care.

Nursing needs are admitted to hospitals and facilities such as welfare facilities for the elderly (short-term admission facilities for the elderly, nursing homes for the elderly, special elderly nursing homes, etc. under Japanese law), and receive their nursing and long-term care. In such a facility, a nurse or the like may be injured due to a fall from the bed, a fall while walking, or the like, or may get out of the bed and wander around. It is necessary to respond to such a situation as soon as possible. Moreover, if such a situation is left unattended, it may develop into a more serious situation. For this reason, at the facility, nurses, caregivers, etc. regularly patrol to confirm their safety and condition.

However, the increase in the number of nurses cannot keep up with the increase in the number of nurses required, and the nursing industry and the long-term care industry are chronically understaffed. Further, since the number of nurses, caregivers, etc. decreases in the semi-night shift and night shift hours as compared with the day shift hours, the work load per person increases, so that the work load is required to be reduced. In addition, the situation of elderly care is no exception in the facility, and it is often seen that elderly nurses and the like care for elderly nurses and the like. In general, as the elderly get older, their physical strength weakens, so even if they are healthy, the burden of nursing etc. becomes heavier than that of young nurses, and their movements and judgments become slower.

In order to reduce such labor shortages and the burden on nurses, there is a need for technology that complements nursing work and long-term care work. For this reason, in recent years, research and development of a monitored person monitoring technique for monitoring (monitoring) a monitored person, which is a monitoring target to be monitored, such as a nurse requiring nursing care.

As one of such techniques, for example, there is a nurse call system disclosed in Patent Document 1. The nurse call system disclosed in Patent Document 1 is installed in a bed for a patient to call a nurse, and is installed in a nurse station to answer a call by the nurse call slave unit. A nurse call system having a nurse call master unit, in which a camera that images a patient on the bed from above the bed and a state in which the patient is upright and the patient is away from the bed from the images captured by the camera. The nurse call master unit has a state determining means for determining the occurrence of at least one of them and outputting a caution state generating signal, and the nurse call master unit has a notification means for performing a notification operation in response to the caution state generating signal. Then, this nurse call system receives the mobile terminal carried by the nurse to answer the call from the nurse call slave unit and the caution state generation signal, and transmits the captured image of the camera to the mobile terminal. It has a communication control means to be used.

On the other hand, in terms of safety confirmation, a person living alone living alone is the same as the person requiring long-term care, and is a person to be monitored.

Japanese Unexamined Patent Publication No. 2014-90913

By the way, as in the nurse call system disclosed in Patent Document 1, when the image of the camera is displayed on the terminal device, the observer such as a nurse visually observes the situation of the monitored person such as a nurse required. It is convenient because it can be grasped. However, since the video is a video from the time when the caution state occurs, it may be difficult for the observer to accurately determine the event that has occurred to the monitored person from the video alone.

The present invention has been made in view of the above circumstances, and an object of the present invention is to provide a monitored person monitoring device, a monitored person monitoring method, and a monitored person monitoring system that can more accurately determine the situation of the monitored person. To provide.

As a result of various studies, the present inventor has found that the above object can be achieved by the following invention. That is, the monitored person monitoring device according to one aspect of the present invention accommodates event information representing the content of a predetermined event related to the monitored person to be monitored, and an image of the monitored person related to the event. , A monitored person monitoring device that notifies a terminal device connected so as to be able to communicate an event notification communication signal for notifying the event, a communication unit that performs communication, an image acquisition unit that acquires an image, and the like. Based on the image acquired by the image acquisition unit, the behavior information processing unit that requests behavior information regarding a predetermined action in the monitored person and the behavior information obtained by the behavior information processing unit are associated with the monitored person. The behavior information storage unit to be stored and the monitoring processing unit for transmitting the event notification communication signal to the terminal device by the communication unit are provided, and the monitoring processing unit transmits the event notification communication signal to the terminal device. When transmitting the event notification communication signal to the terminal device, the rank corresponding to the action information stored in the action information storage unit, which is obtained in the past from the time of transmission in which the communication unit transmits the event notification communication signal, is assigned. The event notification communication signal is further accommodated, and the action information includes the total movement amount within a predetermined time, the total number of outings within a predetermined time, the movement amount per predetermined unit time, the movement speed, and the movement per predetermined unit time. It is characterized by being at least one of changes in quantity over time. Preferably, in the above-mentioned monitored person monitoring device, the predetermined event is a predetermined specific action among the predetermined actions in the monitored person, and the action information is from the time of transmission. Is also a history of specific actions contained in event notifications sent within a predetermined time in the past. The specific behavior is, for example, getting up, getting out of bed, falling, falling, and the like. Preferably, in the above-mentioned monitored person monitoring device, the predetermined event is a nurse call.

Such a monitored person monitoring device accommodates not only the image of the monitored person but also the behavior information of the monitored person in the event notification communication signal and transmits it to the terminal device. Therefore, the terminal device that has received this event notification communication signal can display not only the image of the monitored person but also the behavior information of the monitored person, and the monitor who handles this terminal device is the monitored person. Since the behavior information of the monitored person can be taken into consideration in addition to the image of the above, the situation of the monitored person can be determined more accurately.

Further, in another aspect, in the above-mentioned monitored person monitoring device, a care information storage unit that stores care information representing the contents of the care that has been cared for by the monitored person in association with the monitored person, and the above-mentioned When the monitoring processing unit further receives the monitored person identification information for identifying and identifying the monitored person and the care information notification communication signal accommodating the care information of the monitored person, the monitoring processing unit receives the above-mentioned communication unit. The care information processing unit that stores the care information in the care information storage unit in association with the monitored person based on the monitored person identification information and the care information stored in the received care information notification communication signal. Further, when the monitoring processing unit transmits the event notification communication signal to the terminal device by the communication unit, the monitoring processing unit is in the past of the transmission time when the event notification communication signal is transmitted to the terminal device by the communication unit. The care information stored in the care information storage unit is further accommodated in the event notification communication signal.
In another aspect, in the above-mentioned monitored person monitoring device, the care information accommodated in the event notification communication signal can be set or changed for each monitored person.

Such a monitored person monitoring device accommodates the event notification communication signal and further includes the care information of the monitored person, and transmits the information to the terminal device. Therefore, the terminal device that has received this event notification communication signal can also display the care information of the monitored person, and the monitor who handles this terminal device can further take into consideration the care information of the monitored person. , The situation of the monitored person can be judged more accurately.

Then, the monitored person monitoring method according to another aspect of the present invention provides event information representing the content of a predetermined event related to the monitored person to be monitored and an image of the monitored person related to the event. This is a monitored person monitoring method for notifying a terminal device connected so as to be able to communicate an event notification communication signal for notifying the event, which is accommodated in the image acquisition step of acquiring an image and the image acquisition step. Based on the acquired image, the behavior information processing process for requesting the behavior information related to the predetermined behavior of the monitored person and the behavior information obtained in the behavior information processing process are associated with the monitored person and stored in the behavior information storage unit. It includes an action information storage step to be stored and a monitoring processing step of transmitting the event notification communication signal to the terminal device by a communication unit that communicates, and the monitoring processing step transmits the event notification communication signal to the terminal device. When transmitting by the communication unit, the event notification communication signal is transmitted to the terminal device according to the action information stored in the action information storage unit, which is obtained in the past from the time of transmission when the communication unit transmits the event notification communication signal . The rank is further accommodated in the event notification communication signal, and the action information includes the total movement amount within a predetermined time, the total number of outings within a predetermined time, the movement amount per predetermined unit time, the movement speed, and the predetermined unit time. It is characterized in that it is at least one of the changes over time in the amount of movement per hit.

In such a monitored person monitoring method, not only the image of the monitored person but also the behavior information of the monitored person is accommodated in the event notification communication signal and transmitted to the terminal device. Therefore, the terminal device that has received this event notification communication signal can display not only the image of the monitored person but also the behavior information of the monitored person, and the monitor who handles this terminal device is the monitored person. Since the behavior information of the monitored person can be taken into consideration in addition to the image of the above, the situation of the monitored person can be determined more accurately.

Further, the monitored person monitoring system according to another aspect of the present invention is communicably connected to the terminal device and the terminal device, and event information representing the content of a predetermined event related to the monitored person to be monitored. , And a monitored person monitoring system including a monitored person monitoring device that notifies the terminal device of an event notification communication signal for notifying the event, which accommodates an image of the monitored person related to the event. Therefore, the monitored person monitoring device is based on a communication unit that performs communication, an image acquisition unit that acquires an image, and an image acquired by the image acquisition unit, and behavioral information regarding a predetermined action of the monitored person. The behavior information processing unit that requests the behavior information processing unit, the behavior information storage unit that stores the behavior information obtained by the behavior information processing unit in association with the monitored person, and the event notification communication signal transmitted to the terminal device by the communication unit. The monitoring processing unit transmits the event notification communication signal to the terminal device by the communication unit when the event notification communication signal is transmitted to the terminal device by the communication unit. The action information stored in the action information storage unit, which is obtained in the past from the time of transmission, is further accommodated in the event notification communication signal, and the action information is the total movement amount within the predetermined time and within the predetermined time. At least one of the total number of outings, the amount of movement per predetermined unit time, the movement speed, and the change over time in the amount of movement per predetermined unit time, and the monitored person monitoring device has a rank according to the behavior information. Is selected, and the rank corresponding to the action information is further accommodated in the event notification communication signal, or the terminal device responds to the action information with respect to the action information accommodated in the event notification communication signal. It is characterized by selecting a rank.

Since such a monitored person monitoring system includes any of the above-mentioned monitored person monitoring devices, the monitor who handles the terminal device can use not only the image of the monitored person but also the behavior information of the monitored person. Because it can be taken into consideration, the situation of the monitored person can be judged more accurately.

The monitored person monitoring device, the monitored person monitoring method, and the monitored person monitoring system according to the present invention can more accurately determine the status of the monitored person.

It is a figure which shows the structure of the monitored person monitoring system in embodiment. It is a figure which shows the structure of the sensor device in the monitored person monitoring system of embodiment. It is a figure which shows the structure of the management server apparatus in the monitored person monitoring system of embodiment. It is a figure which shows the structure of the server-side monitoring information table stored in the management server apparatus shown in FIG. It is a figure which shows the structure of the inter-device information table stored in the management server device shown in FIG. It is a figure which shows the structure of the server-side sensor information table stored in the management server apparatus shown in FIG. It is a figure which shows the structure of the mobile terminal apparatus in the monitored person monitoring system of embodiment. It is a flowchart which shows the operation of the sensor device shown in FIG. It is a flowchart which shows the operation of the management server apparatus shown in FIG. It is a flowchart which shows the operation of the said portable terminal apparatus shown in FIG. It is a figure which shows an example of the standby screen displayed on the mobile terminal apparatus shown in FIG. 7. It is a figure which shows an example of the monitoring information screen displayed on the mobile terminal apparatus shown in FIG. 7. It is a figure which shows an example of the nurse call reception screen displayed on the mobile terminal apparatus shown in FIG. 7. It is a figure which shows the structure of the action information table stored in the management server apparatus shown in FIG. It is a figure which shows the structure of the care information table stored in the management server apparatus shown in FIG.

Hereinafter, an embodiment according to the present invention will be described with reference to the drawings. It should be noted that the configurations with the same reference numerals in the respective drawings indicate that they are the same configurations, and the description thereof will be omitted as appropriate. In the present specification, when they are generically referred to, they are indicated by reference numerals without subscripts, and when they refer to individual configurations, they are indicated by reference numerals with subscripts.

The monitored person monitoring system in the embodiment monitors the monitored person (watching target person) Ob, which is the monitoring target (watching target) to be monitored (watched), and communicates with the terminal device and the terminal device. It is equipped with a monitored person monitoring device that can be connected. The monitored person monitoring device in this monitored person monitoring system includes event information representing the contents of a predetermined event (event) related to the monitored person Ob (for example, a predetermined event that needs to be dealt with), and a subject related to the event. The event notification communication signal for notifying the event, which accommodates the image of the observer Ob, is notified to the terminal device. More specifically, the monitored person monitoring device is a predetermined action in the monitored person based on a communication unit that performs communication, an image acquisition unit that acquires an image, and an image acquired by the image acquisition unit. The behavior information processing unit that requests the behavior information related to the behavior information, the behavior information storage unit that stores the behavior information obtained by the behavior information processing unit in association with the monitored person, and the communication of the event notification communication signal to the terminal device. It is provided with a monitoring processing unit that transmits by the unit. Then, when the monitoring processing unit transmits the event notification communication signal to the terminal device by the communication unit, the monitoring processing unit obtains the event notification communication signal in the past before the transmission time when the event notification communication signal is transmitted to the terminal device by the communication unit. The action information stored in the action information storage unit is further accommodated in the event notification communication signal. Such a monitored person monitoring device may be integrally configured by one device, but in the present embodiment, the monitored person monitoring device can communicate with the sensor device, the sensor device, and the terminal device, respectively. By providing a management server device connected to the device, each of the two types of devices is configured as a separate body. This sensor device detects the predetermined event related to the monitored person Ob and notifies (notifies, transmits) the management server device. When the management server device receives the notification from the sensor device, the management server device re-notifies (re-notifies, retransmits) the notification to a predetermined terminal device associated with the sensor device. Then, in the present embodiment, when the management server device re-notifies the notification, the notification is re-notified together with the action information. The terminal device may be one type of device, but in the present embodiment, the terminal device is two types of devices, a fixed terminal device and a mobile terminal device. The main difference between these fixed terminal devices and mobile terminal devices is that while fixed terminal devices are operated in a fixed manner, mobile terminal devices are carried and operated by observers (users) such as nurses and caregivers, for example. Since these fixed terminal devices and mobile terminal devices are substantially the same, the mobile terminal device will be mainly described in the following embodiments.

FIG. 1 is a diagram showing a configuration of a monitored person monitoring system according to the embodiment. FIG. 2 is a diagram showing a configuration of a sensor device in the monitored person monitoring system of the embodiment. FIG. 3 is a diagram showing a configuration of a management server device in the monitored person monitoring system of the embodiment. FIG. 4 is a diagram showing a configuration of a server-side monitoring information table stored in the management server device shown in FIG. FIG. 5 is a diagram showing a configuration of an inter-device information table stored in the management server device shown in FIG. FIG. 5A shows the configuration of the notification destination correspondence information table in the inter-device information table, and FIG. 5B shows the configuration of the communication address correspondence information table in the inter-device information table. FIG. 6 is a diagram showing a configuration of a server-side sensor information table stored in the management server device shown in FIG. FIG. 7 is a diagram showing a configuration of a mobile terminal device in the monitored person monitoring system of the embodiment. FIG. 14 is a diagram showing a configuration of an action information table stored in the management server device shown in FIG. FIG. 15 is a diagram showing a configuration of a care information table stored in the management server device shown in FIG.

More specifically, as shown in FIG. 1, the monitored person monitoring system MS in the embodiment includes one or more sensor devices SU (SU-1 to SU-4), a management server device SV, and the like. It is equipped with a fixed terminal device SP, one or more portable terminal devices TA (TA-1, TA-2), and a private branch exchange (PBX, Private branch exchange) CX, which are wired or wireless and LAN (Local). It is connected so that it can communicate via a network (network, communication line) NW such as Area Network). The network NW may be provided with repeaters such as repeaters, bridges and routers that relay communication signals. In the example shown in FIG. 1, the plurality of sensor devices SU-1 to SU-4, the management server device SV, the fixed terminal device SP, the plurality of mobile terminal devices TA-1, TA-2, and the premises exchange CX are L2 switches. Concentrators (hubs, HUBs) LS and mixed wired and wireless LANs including access point APs (eg LANs according to the 802.11 standard) NWs are communicatively connected to each other. More specifically, the plurality of sensor devices SU-1 to SU-4, the management server device SV, the fixed terminal device SP, and the private branch exchange CX are connected to the line concentrator LS, and the plurality of portable terminal devices TA-1 and TA-2 are connected. Is connected to the concentrator LS via the access point AP. Then, the network NW constitutes a so-called intranet by using a group of Internet protocols such as TCP (Transmission Control Protocol) and IP (Internet Protocol).

The monitored person monitoring system MS is arranged at an appropriate place according to the monitored person Ob. The monitored person (person to be watched over) Ob is, for example, a person who needs nursing care due to illness or injury, a person who needs nursing care due to deterioration of physical ability, or a person living alone. In particular, from the viewpoint of enabling early detection and early response, the monitored person Ob may be a person who needs to detect a predetermined inconvenient event such as an abnormal state when the person occurs. preferable. Therefore, the monitored person monitoring system MS is suitably arranged in a building such as a hospital, a welfare facility for the elderly, and a dwelling unit according to the type of the monitored person Ob. In the example shown in FIG. 1, the monitored person monitoring system MS is arranged in a plurality of living room RMs in which a plurality of monitored person Obs move in, or in a building of a nursing care facility having a plurality of rooms such as a nurse station.

The sensor device SU is a device that has a communication function for communicating with other devices SV, SP, TA via the network NW, and notifies a predetermined event (event) related to the monitored person Ob to the management server device SV. is there. The predetermined event (event) is a predetermined event that needs to be dealt with preferably. For example, in the present embodiment, among the predetermined actions in the monitored person Ob, a preset specific specific action and a predetermined specific action and It is a nurse call. Therefore, in the present embodiment, the sensor device SU detects the specific action of the monitored person Ob, notifies (transmits) the detection result to the management server device SV as an example of the predetermined event, and accepts the nurse call. The nurse call is notified (transmitted) to the management server device SV as another example of the predetermined event, a voice call is made with the terminal devices SP and TA, and an image including a moving image is generated to generate the terminal device. It is a device that delivers moving images to SPs and TAs. For example, as shown in FIG. 2, such a sensor device SU includes an imaging unit 11, a sensor side sound input / output unit (SU sound input / output unit) 12, a nurse call reception operation unit 13, and a sensor side control process. A unit (SU control processing unit) 14, a sensor-side communication interface unit (SU communication IF unit) 15, and a sensor-side storage unit (SU storage unit) 16 are provided.

The imaging unit 11 is a device that is connected to the SU control processing unit 14 and generates an image (image data) under the control of the SU control processing unit 14. The image includes a still image (still image data) and a moving image (moving image data). The image pickup unit 11 is arranged so as to be able to monitor the space (location space, in the example shown in FIG. 1, the living room (room) RM of the arrangement location) where the monitored person Ob, which is the monitoring target to be monitored, is scheduled to be located. The location space is taken as an imaging target from above, an image (image data) that gives a bird's-eye view of the imaging target is generated, and the image of the imaging target (target image) is output to the SU control processing unit 14. Preferably, since it is highly probable that the entire monitored person Ob to be monitored can be imaged, the imaging unit 11 determines that the head of the monitored person Ob is located in the bedding (for example, a bed) on which the monitored person Ob lies. It is arranged so that the image pickup target can be imaged from directly above the scheduled preset head position (usually, the pillow arrangement position). The sensor device SU acquires an image of the monitored person Ob from above the monitored person Ob, preferably an image taken from directly above the planned head position, by the imaging unit 11.

Such an imaging unit 11 may be a device that generates an image of visible light, but in the present embodiment, it is a device that generates an infrared image so that the monitored person Ob can be monitored even in a relatively dark place. .. In the present embodiment, such an imaging unit 11 is, for example, an imaging optical system that forms an infrared optical image of an imaging target on a predetermined imaging surface, and the light receiving surface is made to coincide with the imaging surface. It is data representing the infrared image in the image pickup target by arranging the area image sensor that converts the infrared optical image in the image pickup target into an electrical signal and image processing the output of the area image sensor. It is a digital infrared camera provided with an image processing unit or the like that generates image data. In the present embodiment, the imaging optical system of the imaging unit 11 is preferably a wide-angle optical system (so-called wide-angle lens (including a fisheye lens)) having an angle of view capable of imaging the entire living room RM in which the imaging unit 11 is arranged. ..

The SU sound input / output unit 12 is a circuit for inputting / outputting sound. That is, the SU sound input / output unit 12 is a circuit that is connected to the SU control processing unit 14 and generates and outputs a sound corresponding to an electric signal representing the sound according to the control of the SU control processing unit 14, and is external. This is a circuit for acquiring the sound of the above and inputting it to the sensor device SU. The SU sound input / output unit 12 includes, for example, a speaker that converts an electric signal (sound data) of sound into a mechanical vibration signal (acoustic signal) of sound, and a microphone that converts a mechanical vibration signal of sound in an audible region into an electric signal. And so on. The SU sound input / output unit 12 outputs an electric signal representing an external sound to the SU control processing unit 14, and also converts the electric signal input from the SU control processing unit 14 into a mechanical vibration signal of the sound and outputs it. ..

The nurse call reception operation unit 13 is connected to the SU control processing unit 14, and is a switch circuit such as a push button type switch for inputting a nurse call to the sensor device SU. The nurse call reception operation unit 13 may be connected to the SU control processing unit 14 by wire, or may be connected to the SU control processing unit 14 by, for example, short-range wireless communication such as a Bluetooth (registered trademark) standard.

The SU communication IF unit 15 is a communication circuit connected to the SU control processing unit 14 and for performing communication under the control of the SU control processing unit 14. The SU communication IF unit 15 generates a communication signal containing data to be transferred input from the SU control processing unit 14 according to the communication protocol used in the network NW of the monitored person monitoring system MS, and this generated communication. The signal is transmitted to other devices SV, SP, and TA via the network NW. The SU communication IF unit 15 receives communication signals from other devices SV, SP, and TA via the network NW, extracts data from the received communication signals, and the SU control processing unit 14 can process the extracted data. It is converted into data in a different format and output to the SU control processing unit 14. The SU communication IF unit 15 is configured to include, for example, a communication interface circuit according to the IEEE802.11 standard or the like.

The SU storage unit 16 is a circuit that is connected to the SU control processing unit 14 and stores various predetermined programs and various predetermined data under the control of the SU control processing unit 14. The various predetermined programs include, for example, a SU control program that controls each part of the sensor device SU according to the function of each part, and a SU monitoring processing program that executes predetermined information processing related to monitoring of the monitored person Ob. Etc. are included in the control processing program. In the SU monitoring processing program, the action of detecting the specific action of the monitored person Ob and notifying the detection result to the predetermined terminal devices SP and TA via the management server device SV as an example of the predetermined event (event). When the detection processing program or the nurse call reception operation unit 13 receives the nurse call, the management server device SV is notified to that effect as another example of the predetermined event, and the SU sound input / output unit 12 or the like is used. Includes a nurse call processing program that makes a voice call with the terminal devices SP and TA, and a SU streaming processing program that delivers the moving image generated by the imaging unit 11 to the terminal device SP and TA that requested the moving image by streaming. Is done. In the various predetermined data, each program such as the sensor device identifier (sensor ID) which is an identifier for identifying and identifying the sensor device SU of the own machine and the communication address of the management server device SV is executed. It contains the data necessary for the program. The SU storage unit 16 includes, for example, a ROM (Read Only Memory) which is a non-volatile storage element, an EEPROM (Electrically Erasable Programmable Read Only Memory) which is a rewritable non-volatile storage element, and the like. The SU storage unit 16 includes a RAM (Random Access Memory) or the like that serves as a working memory of the so-called SU control processing unit 14 that stores data or the like generated during execution of the predetermined program.

The SU control processing unit 14 is a circuit for controlling each unit of the sensor device SU according to the function of each unit and notifying a predetermined event (event) related to the monitored person Ob to the management server device SV. .. More specifically, in the present embodiment, the SU control processing unit 14 detects the specific action of the monitored person Ob and notifies (notifies, transmits) the detection result to the management server device SV as an example of the predetermined event. ), Receiving the nurse call, notifying (notifying, transmitting) the nurse call to the management server device SV as another example of the predetermined event, making a voice call with the terminal devices SP and TA, and then An image including a moving image is generated and the moving image is distributed to the terminal devices SP and TA. The SU control processing unit 14 includes, for example, a CPU (Central Processing Unit) and peripheral circuits thereof. When the control processing program is executed, the SU control processing unit 14 has a sensor side control unit (SU control unit) 141, an action detection processing unit 142, a nurse call processing unit 143, and a sensor side streaming processing unit (SU streaming processing). Part) 144 is functionally provided.

The SU control unit 141 controls each unit of the sensor device SU according to the function of each unit, and controls the entire sensor device SU.

The action detection processing unit 142 detects a predetermined specific action among the predetermined actions in the monitored person Ob, and notifies the management server device SV of the detection result as an example of the predetermined event. is there. More specifically, in the present embodiment, the specific behavior includes, for example, waking up when the monitored person Ob wakes up, getting out of bed when the monitored person Ob leaves the bedding, falling when the monitored person Ob falls from the bedding, and , The four actions of the fall of the monitored person Ob. Then, the behavior detection processing unit 142 detects, for example, the head of the monitored person Ob based on the target image captured by the imaging unit 11, and changes the size of the detected head of the monitored person Ob over time. Based on this, the monitored person Ob is detected to get up, get out of bed, fall, and fall. More specifically, first, the location area of the bedding BD, the first threshold Th1 for distinguishing the size of the head in the lying posture and the size of the head in the sitting posture in the location region of the bedding BD, and the location region of the bedding BD. The second threshold Th2 for identifying whether or not it is the size of the head in the standing posture in the living room RM excluding the above, and the size of the head in the lying posture in the living room RM excluding the area where the bedding BD is located. A third threshold Th3 for identifying whether or not the data is the same is stored in the SU storage unit 16 in advance as one of the various predetermined data. Then, the behavior detection processing unit 142 extracts a moving object region from the target image as a region of the person of the monitored person Ob by, for example, the background subtraction method or the frame subtraction method, and from the extracted moving object region, for example, a circular or elliptical hough. The head region of the monitored person Ob is extracted by transformation, for example, by pattern matching using a prepared head model, or by, for example, a neural network trained for head detection, and the extracted head is extracted. Detects getting up, getting out of bed, falling and falling from the position and size of. For example, in the behavior detection processing unit, the position of the extracted head is within the location region of the bedding BD, and the size of the extracted head is determined from the size of the lying posture by using the first threshold Th1. When the size of the sitting posture changes with time, it is determined that the person has woken up, and the wake-up is detected. For example, in the behavior detection processing unit 142, the position of the extracted head changes with time from the inside of the bedding BD location area to the outside of the bedding location area, and the size of the extracted head is the second size. When the time changes from a certain size to the size of the standing posture by using the threshold value Th2, it is determined that the person has left the bed, and the person has left the bed. For example, in the behavior detection processing unit 142, when the position of the extracted head changes from the inside of the location area of the bedding BD to the outside of the location area of the bedding BD, the size of the extracted head is the first. When the time changes from a certain size to the size of the lying posture by using the three threshold value Th3, it is determined that the person has fallen, and the fall is detected. For example, in the behavior detection processing unit 142, the position of the extracted head is in the living room RM excluding the area where the bedding BD is located, and the size of the extracted head uses the third threshold value Th3. When the time changes from the size of the head to the size of the lying posture, it is determined that the person has fallen, and the fall is detected.

When the predetermined action is detected in this way, the action detection processing unit 142 notifies the event, which contains event information (event information) representing the content of the predetermined event (event) related to the monitored person Ob. The SU communication IF unit 15 notifies the management server device SV of the first event notification communication signal of. More specifically, the action detection processing unit 142 includes a sensor ID of the own machine, event information representing the content of the event, and a communication signal (first event notification communication signal) containing a target image used for detecting the predetermined action. ) Is transmitted to the management server device SV via the SU communication IF unit 15. The event information is one or more of wake-up, wake-up, fall, fall and nurse call (NC) in the present embodiment, where the behavior detection processing unit 142 has detected wake-up, wake-up, fall and One or more of the falls are accommodated in the first event notification communication signal as the event information. The image may be at least one of a still image and a moving image, and in the present embodiment, as will be described later, the still image is first notified and the moving image is distributed according to the user's request. First, the moving image may be delivered, or the still image and the moving image may be transmitted, and the still image and the moving image may be displayed on the terminal devices SP and TA by splitting the screen.

When the nurse call reception operation unit 13 receives the nurse call, the nurse call processing unit 143 notifies the management server device SV of the first event notification communication signal accommodating the fact as another example of the predetermined event. A voice call is made between the terminal devices SP and TA by using the SU sound input / output unit 12 and the like. More specifically, when the nurse call reception operation unit 13 is input-operated, the nurse call processing unit 143 performs SU communication with the sensor ID of the own machine and the first event notification communication signal accommodating the nurse call as the event information. It is transmitted to the management server device SV via the IF unit 15. Then, the nurse call processing unit 143 uses the SU sound input / output unit 12 and the like to make a voice call with the terminal devices SP and TA by, for example, VoIP (Voice over Internet Protocol).

When the SU streaming processing unit 144 receives a request for video distribution from the fixed terminal device SP or the mobile terminal device TA via the communication IF unit 3, the SU streaming processing unit 144 sends the request to the fixed terminal device SP or the mobile terminal device TA. , The moving image (for example, a live moving image) generated by the imaging unit 11 is distributed via the SU communication IF unit 15 by streaming reproduction.

In FIG. 1, four first to fourth sensor devices SU-1 to SU-4 are shown as an example, and the first sensor device SU-1 is Mr. A who is one of the monitored persons Ob. The second sensor device SU-2 is arranged in the living room RM-1 (not shown) of Ob-1, and is arranged in the living room RM-2 (not shown) of Mr. B Ob-2 who is one of the monitored persons Ob. The third sensor device SU-3 is installed in the living room RM-3 (not shown) of Mr. C Ob-3, who is one of the monitored persons Ob, and the fourth sensor device SU-4 is installed. It is arranged in the living room RM-4 (not shown) of Mr. D Ob-4, who is one of the monitored persons Ob.

The management server device SV has a communication function for communicating with other devices SU, TA, and SP via the network NW, and when the sensor device SU notifies the predetermined event, information regarding monitoring of the monitored person Ob ( Monitoring information (in the present embodiment, for example, the predetermined event (type of specific action detected by the sensor device SU or nurse call received by the sensor device SU), an image (still image and moving image) of the monitored person Ob, and the above. (Time when notification is received, etc.)) is managed, and the predetermined event is notified (re-notification, re-notification, transmission) to the predetermined terminal device SP, TA, and the client (terminal device SP, TA, etc. in the present embodiment). This is a device that provides the client with data according to the request of the above and manages the entire monitored person monitoring system MS. Then, in the present embodiment, the management server device SV acquires an image from each of the plurality of sensor devices SU via the network NW, and obtains action information regarding a predetermined action in the monitored person based on the acquired image. The monitored person (in the present embodiment, the sensor ID of the sensor device SU that monitors the sensor ID) is stored in association with the monitored person, and when the event notification communication signal is transmitted, the event notification communication signal is transmitted from the time of transmission. The event notification communication signal further accommodates the action information requested and stored in the past. Further, in the present embodiment, when the management server device SV receives the care information notification communication signal from the terminal devices SP and TA by the SV communication IF unit 21, the management server device SV is accommodated in the received care information notification communication signal. When the care information is stored in association with the monitored person Ob based on the monitor identification information (in the present embodiment, the monitored person identifier (in other words, the sensor ID)) and the care information, and the event notification communication signal is transmitted. In addition, the care information stored in the past from the time when the event notification communication signal is transmitted is further accommodated in the event notification communication signal. As shown in FIG. 3, such a management server device SV includes, for example, a server-side communication interface unit (SV communication IF unit) 21, a server-side control processing unit (SV control processing unit) 22, and a server-side storage unit. (SV storage unit) 23 is provided.

Similar to the SU communication IF unit 15, the SV communication IF unit 21 is a communication circuit connected to the SV control processing unit 22 and for performing communication under the control of the SV control processing unit 22. The SV communication IF unit 21 is configured to include, for example, a communication interface circuit according to the IEEE802.11 standard or the like. In the present embodiment, as described above, the image used for obtaining the behavior information is generated by the image pickup unit 11 of the sensor device SU, and the management server device SV transmits this image from the sensor device SU via the network NW. Since the image is acquired, the SV communication IF unit 21 corresponds to an example of an image acquisition unit that acquires an image. When the sensor device SU and the management server device SV are integrally configured, it corresponds to an example of an image acquisition unit in which the image pickup unit 11 acquires an image.

The SV storage unit 23 is a circuit that is connected to the SV control processing unit 22 and stores various predetermined programs and various predetermined data under the control of the SV control processing unit 22. The various predetermined programs include, for example, an SV control program that controls each part of the management server device SV according to the function of each part, and an SV monitoring process that executes predetermined information processing related to monitoring of the monitored person Ob. Based on the program and the image acquired by the SV communication IF unit 21, an action information processing program that requests action information regarding a predetermined action in the monitored person Ob, and monitored person identification information for identifying and identifying the monitored person Ob. (In the present embodiment, the sensor ID of the sensor device SU that monitors the monitored person Ob) and the care information notification communication signal accommodating the care information of the monitored person Ob are received by the SV communication IF unit 21. Based on the monitored person identification information (sensor ID) and the care information stored in the care information notification communication signal, the care information is associated with the monitored person Ob and stored in the care information storage unit 235 described later. A control processing program such as an information processing program is included. When the sensor device SU receives the notification of the predetermined event, the SV monitoring processing program manages the monitoring information of the monitored person Ob, and notifies (re-notifies) the predetermined event to the predetermined terminal devices SP and TA. , Re-notification, transmission) and when the second event notification communication signal is transmitted to the terminal devices SP and TA by the SV communication IF unit 21, the second event notification communication signal is sent to the terminal devices SP and TA by SV. A program for further accommodating the action information stored in the action information storage unit 234, which will be described later, in the second event notification communication signal, which is obtained in the past from the time of transmission transmitted by the communication IF unit 21, and the second event. When the notification communication signal is transmitted to the terminal devices SP and TA by the SV communication IF unit 21, the second event notification communication signal is transmitted to the terminal devices SP and TA by the SV communication IF unit 21 in the past. A program or the like that further accommodates the care information stored in the care information storage unit 235, which will be described later, in the second event notification communication signal is included. The various predetermined data include a server identifier (server ID) for identifying the management server device SV of the own machine and identifying the management server device SV, the monitoring information of the monitored person Ob, and the predetermined predetermined data. Each program such as device-to-device information representing information between devices SU, SP, and TA such as an event notification destination, sensor information related to the sensor device SU, behavior information of the monitored person Ob, and care information of the monitored person Ob. Contains data required for execution. In order to store each of these monitoring information, inter-device information, sensor information, behavior information, and care information, the SV storage unit 23 includes a server-side monitoring information storage unit (SV monitoring information storage unit) 231 and an inter-device information storage unit 232. , Server-side sensor information storage unit (SV sensor information storage unit) 234, behavior information storage unit 234, and care information storage unit 235 are functionally provided.

The SV monitoring information storage unit 231 stores the monitoring information of the monitored person Ob transmitted and received to and from each of the devices SU, SP, and TA. More specifically, in the present embodiment, the SV monitoring information storage unit 231 includes information contained in communication signals such as a first event notification communication signal and a correspondence reception notification communication signal described later as the monitoring information. Based on this, the sensor ID, event information (event information, getting up, getting out of bed, falling, falling and nurse call in this embodiment), reception time, target image (still image and moving image), and presence / absence of coping are stored in association with each other. To.

In this embodiment, this monitoring information is stored in the SV monitoring information storage unit 321 in a table format. The server-side monitoring information table (SV monitoring information table) MT-SV that registers this monitoring information has, for example, as shown in FIG. 4, a sensor ID housed in a communication signal received from each device SU, SP, and TA. The sensor ID field 2311 to be registered, the event field (event field) 2312 to register the event information accommodated in the received communication signal, the reception time field 2313 to register the reception time of the received communication signal, and the reception. The communication address (for example, IP address) of the still image field 2314 for registering the still image accommodated in the communication signal and the sensor device SU corresponding to the sensor ID accommodated in the received communication signal as the acquisition destination of the live moving image. The video field 2315 for registering the received communication signal, and the corresponding field 2316 for registering whether or not the response to the event information stored in the received communication signal is accepted, and records for each received communication signal (for each event). To be equipped. In the still image field 2314, for example, the image data of the still image may be registered, and for example, the file name of the image data of the still image may be registered. In the corresponding field 2316, as will be described later, the terminal devices SP and TA receive the intention (“correspondence”) to deal with (correspondence, measure, measure) the event information stored in the received communication signal. A flag (corresponding flag) indicating whether or not it is registered is registered. For example, in the present embodiment, the corresponding field 2316 indicates that it intends to deal with the event information (event information registered in the event field 2312) stored in the received communication signal (“corresponding”). The terminal device SP, TA indicates that the corresponding flag "1", which means that the device SP or TA has received the information, or that the terminal device SP, TA intends to deal with the event information contained in the received communication signal ("corresponding"). Correspondence flag "0" which means that it is not accepted is registered. By default, the correspondence flag "0" indicating unaccepted is registered in the correspondence field 2316. If the first event notification communication signal includes the detection time when the predetermined action is detected or the nurse call reception time when the nurse call is received, the detection time or the nurse call is replaced with the reception time. The call reception time may be registered.

In the present embodiment, the inter-device information storage unit 232 indicates the notification destination (re-notification destination, re-notification destination, transmission destination) of the first event notification communication signal or the like transmitted from the sensor device SU as the inter-device information. , The correspondence relationship between the sensor ID that is the transmission source and the terminal ID that is the notification destination (re-notification destination) (notification destination correspondence relationship), and the IDs (sensor ID, terminal ID) of each device SU, SP, TA and their. It stores the correspondence relationship with the communication address (communication address correspondence relationship) and the like. The terminal ID is a terminal identifier for identifying the terminal devices SP and TA and identifying the terminal devices SP and TA.

In the present embodiment, the notification destination correspondence relationship and the communication address correspondence relationship are stored in the inter-device information storage unit 232 in a table format, respectively. As shown in FIG. 5A, for example, the notification destination correspondence information table AT for registering the notification destination correspondence relationship includes a source field 2321 for registering the sensor ID of the sensor device SU of the transmission source and a source field. The sensor ID (sensor device SU) is provided with a transmission destination terminal device SP for transmitting a communication signal notified from the sensor device SU corresponding to the sensor ID registered in 2321 and a notification destination field 2322 for registering the terminal ID of the TA. ) Have a record. As shown in FIG. 5B, for example, the communication address correspondence information table DT for registering the communication address correspondence includes the terminal ID field 2323 for registering the terminal IDs of the terminal devices SP and TA and the terminal ID field 2323. The terminal device SP corresponding to the terminal ID registered in the above, the communication address field 2324 for registering the communication address of the TA, and the record are provided for each terminal ID (terminal device SP, TA).

Each of the sensor ID, the server ID, and the terminal ID may be, for example, a serial number consisting of a predetermined symbol string or the like, or may be, for example, a communication address (in this case, the communication address correspondence relationship can be omitted).

The SV sensor information storage unit 233 stores the sensor information. In the present embodiment, the sensor information is information about the sensor device SU, and is information in which the sensor ID of the sensor device SU and the monitored person name of the monitored person Ob are associated with each other.

In this embodiment, such sensor information is stored in the SV sensor information storage unit 233 in a table format. More specifically, the sensor information table ST-SV for registering sensor information includes, for example, as shown in FIG. 6, a sensor ID field 2331 for registering a sensor ID and a sensor registered in the sensor ID field 2331. The monitored person Ob (that is, the sensor) monitored by the placement location field 2332 for registering the placement location of the sensor device SU having an ID and the sensor device SU having the sensor ID registered in the sensor ID field 2331. The monitored person name field 2333 for registering the monitored person name of the monitored person Ob) at the location of the sensor device SU having the sensor ID registered in the ID field 2331 and the monitored person name field 2333 registered in the sensor ID field 2331. It is provided with a sensor device SU having a sensor ID, a remarks field 2334 for registering remarks regarding its arrangement location and its monitored person Ob, and has a record for each sensor ID (that is, the sensor device SU).

The behavior information storage unit 234 stores behavior information related to a predetermined action in the monitored person Ob in association with the monitored person Ob. In the present embodiment, since the sensor device SU is arranged in the room RM where the monitored person Ob is present, the sensor is used as a monitored person identifier (monitored person ID) for identifying and identifying the monitored person Ob. The ID is used.

In this embodiment, such behavior information is stored in the behavior information storage unit 234 in a table format. The behavior information table for registering this behavior information is, for example, a sensor ID field (monitored person ID field) for registering a sensor ID as a monitored person ID and a sensor device having a sensor ID registered in the sensor ID field. It is provided with an action information field for registering the action information of the monitored person Ob at the arrangement location of the SU, and a record is provided for each sensor ID (monitored person ID).

In the present embodiment, as will be described later, the action information is the total movement amount (total movement distance) and the total number of outings. Therefore, the action information table is more specifically configured as shown in FIG. Has been done. The behavior information table MT (MT-1, MT-2, MT-3, ...) Shown in FIG. 14 is associated with the monitored person Ob (monitored person ID, in this case, the sensor ID) and is monitored. It is prepared for each person Ob and stored in the action information storage unit 234. In the example shown in FIG. 14, the sensor ID of the sensor device SU-1; the action information table MT-1 associated with "SU-1", and the sensor ID of the sensor device SU-2; associated with "SU-2". The behavior information table MT-2 and the sensor ID of the sensor device SU-3; the behavior information table MT-3 associated with "SU-3", ..., Etc. are stored in the behavior information storage unit 234. ing.

The action information table MT (MT-1, MT-2, MT-3, ...) has a time field 2341 for registering the time of movement (year, month, day, hour, minute, second) described later, and the above-mentioned required as described later. A movement amount field 2342 for registering the movement amount of the movement and a presence / absence field 2343 for registering the presence / absence (information of presence / absence) of the monitored person Ob when calculating the movement amount of the movement are provided. Have a record for each move time. In the presence / absence field 2343, a flag (presence / absence flag) indicating the presence / absence of the monitored person Ob is registered. For example, in the present embodiment, the presence / absence flag “0” meaning that the monitored person Ob exists (exists) in the presence / absence field 2343, or the presence / absence flag “0” means that the monitored person Ob does not exist (does not exist). The existence flag "1" is registered. By default, the existence / nonexistence flag “0” indicating existence is registered in the existence / nonexistence field 2343.

The care information storage unit 235 stores the care information representing the content of the care taken care of by the monitored person Ob in association with the monitored person Ob. In the present embodiment, since the sensor device SU is arranged in the room RM where the monitored person Ob is present, the sensor is used as a monitored person identifier (monitored person ID) for identifying and identifying the monitored person Ob. The ID is used.

In this embodiment, such care information is stored in the care information storage unit 235 in a table format. The care information table for registering this care information is, for example, a sensor ID field (monitored person ID field) for registering a sensor ID as a monitored person ID and a sensor device having a sensor ID registered in the sensor ID field. It is provided with a care information field for registering care information of the monitored person Ob at the arrangement location of the SU, and a record is provided for each sensor ID (monitored person ID).

In this embodiment, more specifically, the care information table is configured, more specifically, as shown in FIG. The care information table CT (CT-1, CT-2, CT-3, ...) Shown in FIG. 15 is associated with the monitored person Ob (monitored person ID, in this case, the sensor ID) and is monitored. It is prepared for each person Ob and stored in the care information storage unit 235. In the example shown in FIG. 15, the sensor ID of the sensor device SU-1; the care information table CT-1 associated with "SU-1", and the sensor ID of the sensor device SU-2; associated with "SU-2". The care information table CT-2 and the sensor ID of the sensor device SU-3; the care information table CT-3 associated with "SU-3", ..., Etc. are stored in the care information storage unit 235. ing.

The care information table CT (CT-1, CT-2, CT-3, ...) has a time field 2351 for registering the time when the care was performed and a care content field for registering the content of the care as care information. It includes 2352 and a person in charge field 2353 for registering the name of the observer NS in charge of the care, and has a record for each care to be recorded. The implementation time registered in the time field 2351 does not have to be the exact time when the care was performed, but may be an approximate time such as a time stored in the person who records the care. In the care content field 2352, for example, a text (short information) indicating the content of care may be registered, and for example, a care name indicating the content of care may be used.

The SV control processing unit 22 controls each unit of the management server device SV according to the function of each unit, and when the sensor device SU notifies the predetermined event, it manages monitoring information regarding monitoring of the monitored person Ob. Then, the predetermined event is notified (re-notified, re-notified, transmitted) to the predetermined terminal devices SP and TA together with the behavior information and the care information of the monitored person Ob, and the data according to the client's request is sent to the client. It is a circuit for providing and managing the entire monitored person monitoring system MS. The SV control processing unit 22 includes, for example, a CPU and peripheral circuits thereof. When the control processing program is executed, the SV control processing unit 22 includes a server-side control unit (SV control unit) 221, a server-side monitoring processing unit (SV monitoring processing unit) 222, an action information processing unit 223, and care information. The processing unit 224 is functionally provided.

The SV control unit 221 controls each unit of the management server device SV according to the function of each unit, and controls the entire management server device SV.

The behavior information processing unit 223 requests behavior information regarding a predetermined behavior in the monitored person Ob based on the image acquired by the SV communication IF unit 21. More specifically, the behavior information processing unit 223 acquires each image generated by each sensor device SU by the SV communication IF unit 21 from each sensor device SU via the network NW, and for each sensor device SU ( That is, each monitored person Ob) obtains the behavior information of the monitored person Ob based on the acquired image, and stores the obtained behavior information in the behavior information storage unit 234 in association with the monitored person Ob. ..

The action information is, for example, the total amount of movement and the total number of outings within a predetermined time in the past from the time of transmission of the second event notification communication signal described later. The action information may be the total movement amount. The past predetermined time is, for example, the past 6 hours, the past 1 day, the past 1 week, or the like. In this case, in order to obtain the total momentum and the total number of outings of each monitored person Ob, the management server device SV sends each image from each sensor device SU at a predetermined time interval via the network NW to the SV communication IF unit. Get at 21. The predetermined time interval is a time length sufficient to generate a movement locus of the monitored person Ob, for example, 0.5 seconds, 1 second, 2 seconds, and the like. The management server device SV may acquire a plurality of images generated at the predetermined time intervals from the sensor device SU by collecting a predetermined number of images. Alternatively, the management server device SV may acquire the moving image from the sensor device SU. Then, the behavior information processing unit 223 executes each of the following processes for each image acquired from each sensor device SU. In a certain monitored person ID (that is, a certain sensor ID), the behavior information processing unit 223 first extracts a moving body region from the difference between the image acquired at the previous time and the image acquired at this time, and the center of gravity of the moving body region. Find the position. Then, the difference between the position of the center of gravity at the previous time (the position of the center of gravity at the previous time obtained based on the image acquired at the time before the previous time and the image acquired at the previous time) and the position of the center of gravity at this time is obtained, and the movement from the previous time to this time is performed. The amount is obtained, and the obtained movement amount at this time is stored in the SV storage unit 23 in association with the certain sensor ID. Here, the behavior information processing unit 223 sets the movement amount to 0 and determines that there is no monitored person Ob when the moving object region is not extracted from the image acquired at this time. Further, when the behavior information processing unit 223 extracts the moving object region from the image acquired at this time when it is determined that the monitored person Ob does not exist at the previous time, the movement amount is set to 0 and the monitored person Ob. The position of the center of gravity of the extracted moving body region is used as a starting point in the calculation of the movement amount at the next time, and is stored in the SV storage unit 23 in association with the certain sensor ID. More specifically, when the moving object region is extracted from the image acquired at this time and it is determined that the monitored person Ob is present at the previous time, the behavior information processing unit 223 may perform the above-mentioned certain monitored person. A new record is generated for the action information table MT corresponding to the ID (that is, a certain sensor ID), and in this generated new record, the time of movement is registered in the time field 2341 and obtained as described above. The movement amount is registered in the movement amount field 2342, and the existence / non-existence flag “0” is registered in the existence / non-existence field 2343. When the moving object region is not extracted from the image acquired at this time, the behavior information processing unit 223 creates a new record for the behavior information table MT corresponding to the certain monitored person ID (that is, a certain sensor ID). In the generated new record, the time of movement is registered in the time field 2341, the movement amount 0 is registered in the movement amount field 2342, and the existence / non-existence flag “1” is registered in the existence / non-existence field 2343. Then, when the moving object region is extracted from the image acquired at this time and it is determined that the monitored person Ob does not exist at the previous time, the behavior information processing unit 223 has a certain monitored person ID (that is, or A new record is generated for the action information table MT corresponding to the sensor ID), the time of movement is registered in the time field 2341, and the movement amount 0 is registered in the movement amount field 2342 in this generated new record. Then, the presence / absence flag “0” is registered in the presence / absence field 2343, and the position of the center of gravity of the extracted moving body region is stored in the SV storage unit 23 in association with the certain sensor ID as the starting point in the calculation of the movement amount at the next time. To do. The movement time may be, for example, an image generation time, an image reception time, or, for example, a movement amount calculation time. When a plurality of images are received together, the same time can be registered in the time field 2341 of a plurality of records when the movement time is the image reception time or the calculation time of the movement amount. However, even in such a case, there is no problem in calculating the total amount of movement and the total number of outings in the past from the time when the second event notification communication signal is transmitted.

Then, the behavior information processing unit 223 moves and goes out within a predetermined time past the time when the second event notification communication signal is transmitted, which is stored in the SV storage unit 23 in association with the certain sensor ID. The number of times is acquired, and the total sum of the acquired movement amounts (total movement amount) and the total number of outings (total number of outings) are obtained. Here, as for the number of outings, the number of outings is calculated as one outing when the existence / nonexistence flag “1” is continuously registered in the existence / nonexistence field 2343 of each record that is continuous in time. That is, in each record that is continuous in time, the presence / absence flag registered in the presence / absence field 2343 is switched from the presence / absence flag “0” to “1”, and then the presence / absence flag is switched from the presence / absence flag “1” to “0”. Is counted as one outing. As a result, for the certain sensor ID, the total amount of movement and the total number of outings within a predetermined time in the past from the time when the second event notification communication signal is transmitted can be obtained.

Further, for example, the action information is a movement amount per predetermined unit time. The amount of movement per predetermined unit time is obtained by dividing the total amount of movement obtained as described above by the unit time. The predetermined unit time is, for example, half a day, one day, one week, or the like.

Further, for example, the action information is a moving speed. This movement speed is obtained by dividing the current movement amount obtained as described above at the predetermined time interval for acquiring an image from the sensor device SU.

Further, for example, the behavior information is a change over time in the amount of movement per predetermined unit time. The change with time of the movement amount per unit time is obtained as the time change by obtaining the movement amount per unit time as described above.

When the care information processing unit 224 receives the care information notification communication signal in the SV communication IF unit 21, the monitored person identification information (sensor ID in the present embodiment) accommodated in the received care information notification communication signal. The care information is stored in the care information storage unit 235 in association with the monitored person Ob based on the care information. The care information is information representing various cares required for long-term care and assistance, such as blood sampling, intravenous drip, wake-up assistance, meal assistance, and toilet assistance. More specifically, in the present embodiment, the care information notification communication signal includes the care implementation time, the content of the care, the name of the person in charge of performing the care, and the like.

When the SV monitoring processing unit 222 receives the notification of the predetermined event from the sensor device SU, it manages the monitoring information regarding the monitoring of the monitored person Ob, and notifies the predetermined event to the predetermined terminal devices SP and TA. is there. More specifically, when the SV monitoring processing unit 222 receives the first event notification communication signal from the sensor device SU, the SV monitoring processing unit 222 monitors the monitored person Ob contained in the received first event notification communication signal. Information is stored (recorded) in the SV monitoring information storage unit 231. Then, the SV monitoring processing unit 222 stores the report destinations (re-report destination, transfer destination, transmission destination) corresponding to the sensor device SU that transmitted the received first event notification communication signal in the inter-device information storage unit 232. The second event notification communication signal is transmitted to the selected terminal devices SP and TA by selecting (searching) from the notification destination correspondence relationship. This selection (search process) is performed based on the sensor ID corresponding to the sensor device SU that has transmitted the received first event notification communication signal. In the second event notification communication signal, when the event information contained in the first event notification communication signal is the specific action (one or more of getting up, getting out of bed, falling and falling), the first The sensor ID accommodated in the event notification communication signal, the event information and the target image, and the communication address corresponding to the sensor device SU having the sensor ID accommodated in the first event notification communication signal are accommodated as the download destination of the moving image. To. This communication address is selected (searched) from the communication address correspondence relationship based on the sensor ID corresponding to the sensor device SU that transmitted the received first event notification communication signal. Then, in the present embodiment, when the SV monitoring processing unit 222 transmits the second event notification communication signal to the predetermined terminal device SP and TA, the SV monitoring processing unit 222 transmits the second event notification communication signal to the predetermined terminal device SP. , It is the action information obtained in the past from the time of transmission to be transmitted to the TA, and is associated with the sensor ID stored in the action information storage unit 234 and stored in the received first event notification communication signal. The action information is further accommodated in the second event notification communication signal. Further, in the present embodiment, when the SV monitoring processing unit 222 transmits the second event notification communication signal to the predetermined terminal device SP and TA, the SV monitoring processing unit 222 transmits the second event notification communication signal to the predetermined terminal device SP. , The care information stored in the care information storage unit 235 (for example, the most recently stored care information) before the time of transmission to be transmitted to the TA, and is accommodated in the received first event notification communication signal. The care information associated with the sensor ID is further accommodated in the second event notification communication signal. On the other hand, when the event information accommodated in the first event notification communication signal is a nurse call, the second event notification communication signal includes the sensor ID and event information (accommodated in the first event notification communication signal). NC) is housed. The second event notification communication signal transmitted when this event information is a nurse call also includes the behavior information and care information corresponding to the sensor ID accommodated in the received first event notification communication signal. At least one may be accommodated.

As shown by the broken line in FIG. 3, the management server device SV is further connected to the SV control processing unit 22 as needed, and for example, a server-side input unit (SV input unit) for inputting various commands and various data. ) 24, data between the server-side output unit (SV output unit) 25 that outputs various commands and data input by the SV input unit 24 and monitoring information related to monitoring of the monitored person Ob, and the external device. A server-side interface unit (SVIF unit) 26 or the like that performs input / output of the above may be provided.

Such a management server device SV can be configured by, for example, a computer having a communication function.

The fixed terminal device SP includes a communication function for communicating with other devices SU, SV, and TA via a network NW, a display function for displaying predetermined information, an input function for inputting predetermined instructions and data, and the like. The user interface (UI) of the monitored person monitoring system MS by inputting predetermined instructions and data given to the management server device SV and the mobile terminal device TA, displaying the monitoring information obtained by the sensor device SU, and the like. ) Is a device that functions as. Such a fixed terminal device SP can be configured by, for example, a computer having a communication function. The fixed terminal device SP as an example of the terminal device operates in the same manner as the mobile terminal device TA, but in this specification, the mobile terminal device TA which is another example of the terminal device will be described.

The mobile terminal device TA has a communication function for communicating with other devices SV, SP, and SU via a network NW, a display function for displaying predetermined information, an input function for inputting predetermined instructions and data, and a voice call. It is equipped with a call function to perform, inputting predetermined instructions and data given to the management server device SV and the sensor device SU, displaying the monitoring information obtained by the sensor device SU by notification from the management server device SV, and displaying the monitoring information. It is a device for answering and calling a nurse call by voice call with the sensor device SU. In this embodiment, such a portable terminal device TA includes, for example, a terminal-side communication interface unit (TA communication IF unit) 31 and a terminal-side control processing unit (TA control processing unit) 32, as shown in FIG. , Terminal side storage unit (TA storage unit) 33, terminal side sound input / output unit (TA sound input / output unit) 34, terminal side input unit (TA input unit) 35, and terminal side display unit (TA display unit). 36 and a terminal side interface unit (TAIF unit) 37 are provided.

Like the SU sound input / output unit 12, the TA sound input / output unit 34 is a circuit connected to the TA control processing unit 32 to acquire an external sound and input it to the portable terminal device TA, and is a TA control. This is a circuit for generating and outputting a sound corresponding to an electric signal representing the sound according to the control of the processing unit 32.

The TA input unit 35 is a circuit connected to the TA control processing unit 32, accepting a predetermined operation and inputting it to the mobile terminal device TA, for example, a plurality of input switches to which a predetermined function is assigned. .. The predetermined operation is related to, for example, an ID input operation for logging in, a voice call request operation and its termination operation, a live video request operation and its termination operation, and the notified event. In monitoring, for example, input operations to the effect (“correspondence”) that there is an intention (“correspondence”) to perform responses (coping, response) such as lifesaving, nursing, nursing care, and assistance to the monitored person Ob, and care information input operations. Various necessary operations are included. The TA display unit 36 is connected to the TA control processing unit 32, and according to the control of the TA control processing unit 32, a predetermined operation content input from the TA input unit 35 and a subject monitored by the monitored person monitoring system MS. The monitoring information regarding the monitoring of the observer Ob (for example, the predetermined event (type of specific action detected by the sensor device SU or the nurse call received by the sensor device SU), an image (still image and moving image) of the monitored person Ob, It is a circuit that displays the time when the notification is received, etc.), and is, for example, a display device such as an LCD (liquid crystal display) or an organic EL display. In the present embodiment, the touch panel is composed of the TA input unit 35 and the TA display unit 36. In this case, the TA input unit 35 is a position input device that detects and inputs an operation position such as a resistance film method or a capacitance method. In this touch panel, a position input device is provided on the display surface of the TA display unit 36, and one or a plurality of input content candidates that can be input to the TA display unit 36 are displayed. When the observer) touches the display position displaying the input content to be input, the position input device detects the position, and the display content displayed at the detected position is displayed on the mobile terminal device TA as the user's operation input content. Entered.

The TAIF unit 37 is a circuit that is connected to the TA control processing unit 32 and inputs / outputs data to / from an external device according to the control of the TA control processing unit 32. For example, the Bluetooth (registered trademark) standard is used. An interface circuit, an interface circuit that performs infrared communication such as the IrDA standard, and an interface circuit that uses the USB standard.

The TA communication IF unit 31 is a communication circuit that is connected to the TA control processing unit 32 and performs communication under the control of the TA control processing unit 32, similarly to the SU communication IF unit 15. The TA communication IF unit 31 is configured to include, for example, a communication interface circuit according to the IEEE802.11 standard or the like.

The TA storage unit 33 is a circuit that is connected to the TA control processing unit 32 and stores various predetermined programs and various predetermined data under the control of the TA control processing unit 32. The various predetermined programs include, for example, a TA control program that controls each part of the mobile terminal device TA according to the function of each part, and a TA monitoring process that executes predetermined information processing related to monitoring of the monitored person Ob. A call processing program that makes a voice call with the sensor device SU by using a program, a TA sound input / output unit 34, or the like, or a video is delivered from the sensor device SU, and the delivered video is played back by streaming. A control processing program such as a TA streaming processing program displayed on the TA display unit 36 is included. The various predetermined data are necessary for executing each program such as the terminal ID of the own machine, the screen information displayed on the TA display unit 36, the monitoring information of the monitored person Ob, and the sensor information related to the sensor device SU. Data etc. are included. The TA storage unit 33 includes, for example, a ROM, an EEPROM, or the like. The TA storage unit 33 includes a RAM or the like that serves as a working memory of the so-called TA control processing unit 32 that stores data or the like generated during execution of the predetermined program. In order to store each of these monitoring information and sensor information, the TA storage unit 33 functions as a terminal side monitoring information storage unit (TA monitoring information storage unit) 331 and a terminal side sensor information storage unit (TA sensor information storage unit) 332. Prepare for the purpose.

The TA monitoring information storage unit 331 stores the monitoring information. In the present embodiment, the TA monitoring information storage unit 331 uses the sensor ID and event information (event information, wake-up in the present embodiment) stored in the second event notification communication signal received from the management server device SV as the monitoring information. (Getting out of bed, falling, falling and nurse call), the communication address of the sensor device SU to which the image and the moving image are downloaded, the reception time of the second event notification communication signal, and the presence or absence of countermeasures are stored in association with each other. More specifically, as shown in FIG. 4, the TA monitoring information storage unit 331 stores the monitoring information in the terminal-side monitoring information table (TA monitoring information table) MT-TA similar to the SV monitoring information table MT-SV. Remember.

The TA sensor information storage unit 332 stores the sensor information. The TA sensor information storage unit 332 stores the sensor ID, the arrangement location, the name of the person to be monitored, and the remarks in association with each other. More specifically, as shown in FIG. 6, the TA sensor information storage unit 332 stores the sensor information in the terminal side sensor information table (TA sensor information table) ST-TA similar to the SV sensor information table ST-SV. Remember.

The TA control processing unit 32 controls each unit of the mobile terminal device TA according to the function of each unit, receives and displays the monitoring information of the monitored person Ob, and is a circuit for answering a nurse call or calling out. Is. The TA control processing unit 32 includes, for example, a CPU and peripheral circuits thereof. When the control processing program is executed, the TA control processing unit 32 includes the terminal side control unit (TA control unit) 321 and the terminal side monitoring processing unit (TA monitoring processing unit) 322, the call processing unit 323, and the terminal side streaming processing. A unit (TA streaming processing unit) 324 is functionally provided.

The TA control unit 321 controls each part of the mobile terminal device TA according to the function of each part, and controls the entire control of the mobile terminal device TA.

The TA monitoring processing unit 322 executes predetermined information processing regarding monitoring of the monitored person Ob. More specifically, when the TA monitoring processing unit 322 receives the second event notification communication signal transmitted by the management server device SV due to the first event notification communication signal transmitted by the sensor device SU. Based on each information (each data) stored in the received second event notification communication signal, the monitoring information of the monitored person Ob is stored (recorded) in the TA monitoring information storage unit 331. The TA monitoring processing unit 322 displays a screen corresponding to each information accommodated in the received second event notification communication signal on the TA display unit 36. Then, when the TA monitoring processing unit 322 receives a predetermined input operation from the TA input unit 35, the TA monitoring processing unit 322 executes a predetermined processing according to the input operation.

The call processing unit 323 makes a voice call with the sensor device SU by using the TA sound input / output unit 34 and the like. More specifically, for example, the call processing unit 323 uses the TA sound input / output unit 34 or the like to transmit the first event notification communication signal that caused the transmission of the second event notification communication signal to the management server device SV. A voice call is made with, for example, VoIP with the sensor device SU of the transmission source.

The TA streaming processing unit 324 receives the distribution of the moving image from the sensor device SU, and displays the distributed moving image on the TA display unit 36 by streaming reproduction.

Such a mobile terminal device TA can be configured by a portable communication terminal device such as a so-called tablet computer, a smartphone, or a mobile phone.

Next, the operation of this embodiment will be described. FIG. 8 is a flowchart showing the operation of the sensor device shown in FIG. FIG. 9 is a flowchart showing the operation of the management server device shown in FIG. FIG. 10 is a flowchart showing the operation of the mobile terminal device shown in FIG. 7. FIG. 11 is a diagram showing an example of a standby screen displayed on the mobile terminal device shown in FIG. 7. FIG. 12 is a diagram showing an example of a monitoring information screen displayed on the mobile terminal device shown in FIG. 7. FIG. 13 is a diagram showing an example of a nurse call reception screen displayed on the mobile terminal device shown in FIG. 7.

In the monitored person monitoring system MS having the above configuration, when the power is turned on, each device SU, SV, SP, and TA executes necessary initialization of each part and starts its operation. In the sensor device SU, by executing the control processing program, the SU control processing unit 14 is functionally configured with the SU control unit 141, the action detection processing unit 142, the nurse call processing unit 143, and the SU streaming processing unit 144. .. In the management server device SV, the SV control processing unit 21 is functionally configured with the SV control unit 211, the SV monitoring processing unit 222, the behavior information processing unit 223, and the care information processing unit 224 by executing the control processing program. To. Then, in the mobile terminal device TA, by executing the control processing program, the TA control processing unit 32 is functionally configured with the TA control unit 321 and the TA monitoring processing unit 322, the call processing unit 323, and the TA streaming processing unit 324. Will be done.

First, the operation of the sensor device SU will be described. The sensor device SU detects a predetermined operation of the monitored person Ob by operating as follows for each frame or every few frames, and determines whether or not a nurse call is accepted. There is.

In FIG. 8, first, the sensor device SU acquires an image (image data) for one frame from the imaging unit 11 as the target image by the SU control unit 141 of the SU control processing unit 14 (S11).

Next, the sensor device SU executes the action detection process for detecting the specific action of the monitored person Ob by the action detection processing unit 142 of the SU control processing unit 14 based on the target image acquired in the process S11 (S12). ). More specifically, the behavior detection processing unit 142 determines the success or failure of getting up, determines the success or failure of getting out of bed, determines the success or failure of the fall, and determines the success or failure of the fall.

Next, the sensor device SU determines whether or not a predetermined action in the monitored person Ob is detected by the action detection process S12 by the action detection processing unit 142. As a result of this determination, when the specific action is not detected (No), the sensor device SU then executes the process S15, while when the specific action is detected (Yes), the sensor device SU executes the process S15. , The sensor device SU executes the process S15 after executing the next process S14.

In this process S14, in order to notify the predetermined terminal devices SP and TA of the specific actions detected in the processes S12 and S13 via the management server device SV, the sensor device SU is subjected to the predetermined action by the action detection processing unit 142. The first event notification communication signal related to the detection of the specific action is transmitted to the management server device SV as the event of. More specifically, the behavior detection processing unit 142 contains the sensor ID of the own machine, the predetermined event (here, one or more of getting up, getting out of bed, falling and falling), and the target image. The event notification communication signal is transmitted to the management server device SV via the SU communication IF unit 15.

In the process S15, the sensor device SU determines whether or not the nurse call is accepted by the nurse call processing unit 143. That is, the processes S11 to S16 shown in FIG. 8 are repeatedly executed every frame or every few frames, but the nurse is executed between the previous execution of the process S15 and the current execution of the process S15. It is determined whether or not the call reception operation unit 13 has been operated. As a result of this determination, if the nurse call reception operation unit 13 is not operated and the nurse call is not accepted (No), the sensor device SU ends the current processing, while the nurse call reception operation unit 13 Is operated and the nurse call is accepted (Yes), the sensor device SU ends the current process after executing the next process S16.

In this process S16, in order to notify the predetermined terminal devices SP and TA via the management server device SV of the nurse call whose reception is found in the process S15, the sensor device SU is subjected to the nurse call by the nurse call processing unit 143. The first event notification communication signal related to the above is transmitted to the management server device SV. More specifically, the nurse call processing unit 143 transmits the first event notification communication signal including the sensor ID of the own device and the nurse call reception information to the management server device SV via the SU communication IF unit 15.

The sensor device SU operates as described above with respect to the detection of the specific behavior of the monitored person Ob and the reception of the nurse call.

On the other hand, the sensor device SU manages a communication signal (image notification communication signal) accommodating the sensor ID of the own device and the image captured by the imaging unit 11 for use by the management server device SV to generate action information. It is transmitting to the server device SV.

Next, the operation of the management server device SV will be described. On the other hand, in FIG. 9, the management server device SV determines whether or not the SV communication IF unit 21 has received the communication signal by the SV control unit 221 of the SV control processing unit 22 (S21). As a result of this determination, if the communication signal is not received (No), the management server device SV returns the process to S21, and if the result of the determination is that the communication signal is received (Yes), the management server device SV returns the process to S21. The management server device SV executes the next process S22. That is, the management server device SV is waiting for the reception of the communication signal.

In the process S22, the management server device SV determines the type of the received communication signal by the SV control unit 221. As a result of this determination, when the received communication signal is the first event notification communication signal (first event notification), the management server device SV executes the process S26 after executing the process S23, and receives the received communication signal. When the communication signal is a care information notification communication signal (care information notification), the process S24 is executed after the process S24 is executed, and the received communication signal is the first event notification communication signal and the care information notification. If it is not a communication signal (other), the process S26 is executed after the process S25 is executed.

In the process S23, the management server device SV processes the first event notification communication signal received from the sensor device SU in the process S21 by the SV monitoring process unit 222 of the SV control process unit 22. More specifically, first, the SV monitoring processing unit 222 stores the monitoring information regarding the monitoring of the monitored person Ob contained in the first event notification communication signal received from the sensor device SU in the processing S21 as the SV monitoring information storage unit. Store (record) in 231. Then, the SV monitoring processing unit 222 selects the notification destination corresponding to the sensor device SU that transmitted the first event notification communication signal received in the processing S21 from the notification destination correspondence relationship stored in the inter-device information storage unit 232 ( Search for. Next, the SV monitoring processing unit 222 transmits the second event notification communication signal to the terminal devices SP and TA of the selected notification destination. In the second event notification communication signal, as described above, when the event information contained in the first event notification communication signal received in the process S21 is a specific action, the first event received in the process S21. The sensor ID, event information and target image stored in the event notification communication signal, and the communication address and action information corresponding to the sensor device SU having the sensor ID stored in the first event notification communication signal as the download destination of the moving image. And care information is stored. On the other hand, when the event information contained in the first event notification communication signal received in the process S21 is a nurse call, the second event notification communication signal includes the first event notification communication received in the process S21. The sensor ID and event information contained in the signal are stored. In this case, the second event notification communication signal may further include behavioral information and care information.

In the process S24, the management server device SV is based on the sensor ID and the care information accommodated in the care information notification communication signal received from the terminal device SP and TA in the process S21 by the care information processing unit 224 of the SV control processing unit 22. The care information is stored in the care information storage unit 235 in association with the sensor ID. As a result, care information is memorized. More specifically, in the present embodiment, the care information processing unit 224 uses the sensor ID, the care implementation time, the care content, and the care information notification communication signal received from the terminal devices SP and TA in the process S21. The name of the person in charge of care and the like are taken out, the care information table CT corresponding to the taken out sensor ID is searched from the care information storage unit 235, a new record is generated in the searched care information table CT, and this is generated. Each of the extracted execution time, care content and person in charge name is registered in the time field 2351, the care content field 2352 and the person in charge field 2353 of the record, and is stored in the care information storage unit 235.

In the process S25, the management server device SV executes an appropriate process according to the communication signal received in the process S21 by the SV control processing unit 22. For example, when the communication signal received in the process S21 is an image notification communication signal, the management server device SV is accommodated in the received image notification communication signal by the action information processing unit 223 of the SV control processing unit 22. Action information (movement amount and presence / absence of the monitored person Ob in this embodiment) is obtained for the monitored person Ob at the location where the sensor device having the sensor ID is arranged, and the obtained action information is transmitted to the received image notification. It is stored in the action information storage unit 234 in association with the sensor ID (monitored person Ob) accommodated in the communication signal. As a result, the action information is updated and stored.

Then, in the process S26 executed after each of the processes S23 to S25, the management server device SV determines whether or not its operation is terminated (stopped) by the SV control processing unit 22. As a result of this determination, if the operation is terminated (stopped) (Yes), the management server device SV ends this process, while if the operation is not terminated (stopped) (No), the management server device SV manages the process. The server device SV returns the process to the process S21.

The management server device SV operates as described above with respect to the first event notification communication signal received from the sensor device SU and the care information notification communication signal received from the terminal device SP and TA.

Next, the operations of the terminal devices SP and TA will be described. Here, the operation of the mobile terminal device TA will be typically described. As described above, when the power is turned on and the operation is started, the mobile terminal device TA accepts a login operation by a monitor (user) such as a nurse or a caregiver, and the TA monitoring processing unit 322 receives the login operation. The standby screen for waiting for the communication signal addressed to the machine is displayed on the TA display unit 36. As shown in FIG. 11, the standby screen 51 has, for example, a menu bar area 511 for displaying a menu bar, and a standby main area for displaying a message (for example, "no notification") and an icon indicating that the user is in standby. 512, a time area 513 that displays the current time, a date area 514 that displays today's date, and a user name area 515 that displays the user name that is currently logged in to the mobile terminal device TA. To be equipped with.

Then, in FIG. 10, the mobile terminal device TA determines whether or not the TA communication IF unit 31 has received the communication signal by the TA control unit 321 of the TA control processing unit 32 (S31). As a result of this determination, if the communication signal is not received (No), the mobile terminal device TA returns the process to S31, and if the result of the determination is that the communication signal is received (Yes), the mobile terminal device TA returns the process to S31. The mobile terminal device TA executes the following process S32. That is, the mobile terminal device TA is waiting for the reception of the communication signal.

In the process S32, the mobile terminal device TA determines the type of the received communication signal by the TA control unit 321. As a result of this determination, when the communication signal received in the process S31 is the second event notification communication signal (second event notification), the mobile terminal device TA executes the next process S33, and in the process S31. If the received communication signal is not the second event notification communication signal (other), this process ends after executing process S37 that performs appropriate processing according to the communication signal received in process S31.

In the process S33, the mobile terminal device TA is monitored by the TA monitoring process unit 322 of the TA control process unit 32 for the monitored person Ob, which is accommodated in the second event notification communication signal received from the management server device SV in the process S31. The monitoring information related to the above is stored (recorded) in the TA monitoring information storage unit 331.

Next to this process S33, the TA monitoring processing unit 322 displays on the TA display unit 36 a screen corresponding to each information accommodated in the second event notification communication signal received in the processing S31 (S34). More specifically, when the event information accommodated in the second event notification communication signal received in the process S31 is the specific action, the TA monitoring processing unit 322 has, for example, the monitoring information screen 52 shown in FIG. Is displayed on the TA display unit 36, while the event information stored in the second event notification communication signal received in the process S31 is the nurse call, for example, the nurse call reception screen 53 shown in FIG. 13 is displayed. It is displayed on the TA display unit 36.

The monitoring information screen 52 is a screen for displaying the monitoring information regarding the monitoring of the monitored person Ob. As shown in FIG. 12, for example, the monitoring information screen 52 includes a menu bar area 511, a location where the sensor device SU having a sensor ID accommodated in the second event notification communication signal received in the process S31 is arranged, and the above. The monitored person name area 521 displaying the name of the monitored person Ob monitored by the sensor device SU having the sensor ID, and the reception time of the second event notification communication signal received in the process S31 (or the predetermined action). The detection information display area 522 that displays the elapsed time from the detection time) and the event information (detection result of the predetermined action) accommodated in the second event notification communication signal received in the process S31, and the process S31. Received in the image area 523 that displays the image (that is, the target image captured by the sensor device SU having the sensor ID) (here, the still image) accommodated in the received second event notification communication signal, and in the process S31. An action information display area 528 that displays the action information accommodated in the second event notification communication signal, and a care information display area 529 that displays the care report accommodated in the second event notification communication signal received in the process S31. It includes a "corresponding" button 524, a "speaking" button 525, and a "view LIVE" button 526.

In order to display the location of the sensor device SU and the name of the monitored person Ob in the monitored person name area 521, the sensor ID stored in the second event notification communication signal received in the process S31 is used as a search key, and the sensor is used. The location of the device SU and the name of the monitored person Ob are searched from the TA sensor information storage unit 332 and displayed. In the detection information display area 522, the detection result (in the present embodiment, each name of getting up, getting out of bed, falling, and falling) stored in the second event notification communication signal received in the process S31 may be displayed as it is. However, in the present embodiment, it is displayed by an icon symbolically representing the detection result. In order to display with this icon, each action and an icon symbolically representing the action are associated with each other and stored in advance in the TA storage unit 33. In the example shown in FIG. 12, a wake-up icon symbolically representing wake-up is displayed in the detection information display area 522. It should be noted that the history of unsupported specific actions within a predetermined time in the past may be displayed. On the monitoring information screen 52, the "correspondence" button 524 intends to take a predetermined response (response, response) such as lifesaving, nursing, nursing care, and assistance to the detection result displayed on the monitoring information screen 52. This is a button for inputting implementation intention information indicating that the user of the mobile terminal device TA exists into the mobile terminal device TA. The "speak" button 525 is a button for requesting a voice call, and is for inputting an instruction for connecting the sensor device SU of the sensor ID and the mobile terminal device TA so as to be able to make a call via a network NW. Button. The "view LIVE" button 526 is a button for requesting a live moving image, and is a button for inputting an instruction to display a moving image captured by the sensor device SU of the sensor ID. In the action information display area 528, in the example shown in FIG. 12, "the total amount of movement is αm. The total number of outings is β times." Is displayed as the action information. In the care information display area 529, "care information; toilet assistance, 9:40" is displayed as the care information.

The nurse call reception screen 53 is a screen for displaying the reception of the nurse call. As shown in FIG. 13, for example, the nurse call reception screen 53 includes a menu bar area 511, a monitored person name area 521, a detection information display area 522, and a message indicating that the nurse call has been received (for example, "" It is provided with a nurse call reception notification display area 531 for displaying "Nurse call"), a "corresponding" button 524, and a "speaking" button 525. On the nurse call reception screen 53, only the elapsed time from the reception time of the second event notification communication signal received in the process S31 (or the reception time when the nurse call is received) is displayed in the detection information display area 522. ..

The nurse call reception screen 53 may further include a "view LIVE" button 526.

Then, next to the process S34, the mobile terminal device TA determines whether or not the TA control processing unit 32 has accepted the input operation on the touch panel including the TA input unit 35 and the TA display unit 36 (S35). As a result of this determination, if the input operation is not accepted (No), the mobile terminal device TA returns the process to the process S35, while if the result of the determination is that the input operation is accepted, the mobile terminal device TA returns the process to the process S35. The device TA executes the next process S36.

In this process S36, the mobile terminal device TA executes an appropriate process according to the content of the input operation by the TA control processing unit 32, and ends this process.

For example, when the TA control processing unit 32 receives an input operation of the "corresponding" button 524 from the TA input unit 35 constituting the touch panel (that is, when the corresponding intention is received), the mobile terminal device TA first receives the corresponding intention. Currently, the monitoring information of the monitored person Ob displayed on the TA display unit 36 is stored in the TA monitoring information storage unit 331 with the fact that "correspondence" has been accepted. More specifically, the TA control processing unit 32 monitors the monitored person Ob currently displayed on the TA display unit 36 in the TA monitoring information table MT-TA stored in the TA monitoring information storage unit 331. In the corresponding field 3316 of the record in which the information is registered (here, the record in which the monitoring information stored in the second event notification communication signal received in the process S31 is registered), the corresponding flag "1" indicating the reception of the correspondence is set. To register. Then, the TA control processing unit 32 accommodates the sensor ID corresponding to the monitoring information of the monitored person Ob displayed on the TA display unit 36 and the information indicating that "corresponding" has been accepted (correspondence reception information). The communication signal (correspondence reception notification communication signal) is transmitted to the management server device SV. The management server device SV that has received the correspondence reception notification communication signal has a communication signal (correspondence reception well-known communication) that includes the sensor ID and the correspondence reception information contained in the received correspondence reception notification communication signal by the SV control processing unit 22. The signal) is transmitted to the terminal devices SP and TA by broadcast communication. As a result, regarding the sensor ID corresponding to the monitoring information of the monitored person Ob displayed on the TA display unit 36, the fact that "corresponding" is accepted is synchronized between the terminal devices SP and TA.

Further, for example, when the TA control processing unit 32 receives the input operation of the "speaking" button 525, the mobile terminal device TA monitors the monitored person Ob displayed on the TA display unit 36 by the call processing unit 323. A communication signal (call request communication signal) containing information such as requesting a voice call is transmitted to the sensor device SU, and the sensor device SU corresponding to the communication signal is connected to the sensor device SU via the network NW so that the voice call can be made. As a result, a voice call can be made between the mobile terminal device TA and the sensor device SU. When the TA control processing unit 32 receives an input operation of the "end" button shown in the figure, which is a button for inputting an instruction to end the voice call, the mobile terminal device TA receives the TA by the call processing unit 323. A communication signal (call end communication signal) containing information such as requesting the end of the voice call is transmitted to the sensor device SU that monitors the monitored person Ob displayed on the display unit 36. As a result, the voice call between the mobile terminal device TA and the sensor device SU is terminated.

Further, for example, when the TA control processing unit 32 receives the input operation of the "view LIVE" button 526, the mobile terminal device TA is monitored by the TA streaming processing unit 324 and is currently displayed on the TA display unit 36. A communication signal (video distribution request communication signal) containing information such as requesting live video distribution is transmitted to the sensor device SU that monitors the person Ob, and the sensor device SU and network NW corresponding to the communication signal are transmitted. It is connected so that the moving image can be downloaded via the sensor device SU, and the moving image is delivered live from the sensor device SU, and the delivered moving image is displayed on the TA display unit 36 by streaming reproduction. In the monitoring information screen 52 for displaying the live moving image, the moving image is displayed in the image area 523, and the "Live end" button is displayed instead of the "Watch LIVE" button 526. As a result, a live moving image is displayed on the mobile terminal device TA. The "Live end" button in the illustration is a button for requesting the end of the moving image, and ends (stops) the distribution of the moving image captured by the sensor device SU of the sensor ID and ends (stops) the display. ) Is a button for inputting instructions to be made. When the TA control processing unit 32 receives the input operation of the "Live end" button, the mobile terminal device TA monitors the monitored person Ob currently displayed on the TA display unit 36 by the TA streaming processing unit 324. A communication signal (video distribution end communication signal) containing information such as requesting the end of video distribution is transmitted to the sensor device SU, and a still image is displayed on the TA display unit 36. As a result, the mobile terminal device TA ends the display of the live moving image.

Regarding the second event notification communication signal received from the management server device SV, the mobile terminal device TA operates as described above.

On the other hand, the mobile terminal device TA accepts a predetermined input operation and displays a care information input screen for inputting care information on the TA display unit 36. For example, when the input operation of the above-mentioned "corresponding" button 524 is received, the mobile terminal device TA displays the care information input screen on the TA display unit 36 in addition to each of the above-mentioned processes. The user (monitorer) of the mobile terminal device TA uses the care information input screen to perform care information from the TA input unit 35 (in the present embodiment, the care implementation time, the content of the care, and the name of the person in charge of the care). Etc.). When the care information is received from the TA input unit 35, the mobile terminal device TA receives the sensor device SU corresponding to the monitored person Ob on the care information screen currently displayed on the TA display unit 36 by the TA control processing unit 32. (In the above example, the sensor ID accommodated in the second event notification communication signal received in the process S31) and the care information notification communication signal accommodating the care information are transmitted to the management server device SV.

As described above, the monitored person monitoring system MS in the present embodiment, the sensor device SU and the management server device SV as an example of the monitored person monitoring device, and the implemented monitored person monitoring method are the first. 2 The event notification communication signal includes not only the image of the monitored person Ob but also the behavior information of the monitored person Ob and transmits it to the terminal devices SP and TA. Therefore, the terminal devices SP and TA that have received the second event notification communication signal can display not only the image of the monitored person Ob but also the behavior information of the monitored person Ob, and the terminal devices SP and TA can display the behavior information of the monitored person Ob. Since the observer who handles the above can take into consideration not only the image of the monitored person Ob but also the behavior information of the monitored person Ob, it is more accurate to comprehensively judge the image of the monitored person Ob and the behavior information. The situation of the monitored person can be judged.

Further, the monitored person monitoring system MS, the sensor device SU and the management server device SV as an example of the monitored person monitoring device, and the monitored person monitoring method are added to the second event notification communication signal, and further, the monitored person is monitored. The care information of the person Ob is also stored and transmitted to the terminal devices SP and TA. Therefore, the terminal devices SP and TA that have received the second event notification communication signal can also display the care information of the monitored person Ob, and the monitor who handles the terminal device SP and TA can further display the monitored person Ob. Since the care information of the observer Ob can be taken into consideration, the situation of the monitored person can be determined more accurately by comprehensively judging these.

In the above-described embodiment, the movement amount is obtained from the image, but the movement amount is not limited to this, and can be changed as appropriate. For example, the amount of movement may be determined from the number of steps measured by a pedometer that measures the number of steps, for example, a pedometer (registered trademark). More specifically, the pedometer includes a communication interface unit that communicates with the sensor device SU and a pedometer measurement unit that measures the number of steps, and the number of steps measured between the steps (accommodating the number of steps) at predetermined intervals. Communication signal) is transmitted to the sensor device SU. When the sensor device SU receives a step count (a communication signal accommodating the step count) from the pedometer, the sensor device SU transfers the received step count to the management server device SV in association with the monitored person Ob (sensor ID). The management server device SV associates the stride length of the monitored person Ob with the monitored person Ob (sensor ID) and stores it in the SV storage unit 23 in advance, and when the number of steps is received from the sensor device SU, the stride is multiplied by the number of steps. The amount of movement is calculated by doing so. For communication between the sensor device SU and the pedometer, a communication method of a short-range wireless communication standard such as a communication method of the Bluetooth (Bluetooth, registered trademark) standard is preferably used. In this case, the conversion of the movement amount is executed by the sensor device SU instead of the management server device SV, and the sensor device SU may transmit the movement amount converted by the number of steps to the management server device. Further, the movement amount may be the number of steps itself measured by the pedometer.

Further, in the above-described embodiment, all the care information stored in the care information storage unit 235 in the past before the time of transmission of transmitting the second event notification communication signal to the terminal device SP and TA is transmitted from the management server device SV to the terminal device SP. , TA, but a part of the care information may be transmitted to the terminal device SP, TA. For example, out of all the care information, only the care information of a specific care type set in advance may be transmitted from the management server device SV to the terminal devices SP and TA. The specific care type is a care type in which care is performed relatively regularly and attention is required at intervals, such as toilet assistance for assisting excretion and water intake care for ingesting water. In this case, it is preferable that the care information is the latest care information (the latest care information of the specific care type) with respect to the transmission time point at which the care information is transmitted. As a result, when the monitoring information screen 52 is displayed by receiving the second event notification communication signal, the current status of the monitored person Ob can be grasped more accurately. In this case, it is preferable that the specific care type can be set or changed for each monitored person Ob from the terminal devices SP and TA.

Further, in the above-described embodiment, in the action information display area 528, in the example shown in FIG. 12, as the action information, "the total movement amount is αm. The total number of outings is β times." Although it is displayed, the behavior information is not limited to this, and the behavior information may be displayed in other modes. For example, the behavior information may be displayed abstractly at a rank selected from a plurality of ranks based on the total movement amount and the total number of outings. More specifically, the correspondence relationship in which the total movement amount and the total number of outings are associated with each of the plurality of ranks is stored in advance in the SV storage unit 23 of the management server device SV. A rank corresponding to the action information is selected, and the selected rank is accommodated as the action information in the second event notification communication signal and transmitted to the terminal devices SP and TA. Then, the terminal devices SP and TA display the rank as the action information accommodated in the second event notification communication signal in the action information display area 528. Alternatively, the correspondence relationship in which the total movement amount and the total number of outings are associated with each of the plurality of ranks is stored in advance in the terminal devices SP and TA, and the terminal devices SP and TA are used as the second event notification communication signal from the plurality of ranks. A rank corresponding to the accommodated action information is selected, and the selected rank is displayed in the action information display area 528 as action information. The correspondence is divided into three first to third ranks, for example, an activity amount of "large", an activity amount of "medium", and an activity amount of "small". "When the total movement amount is 50 m or more and the total number of outings is 5 or more" is associated, and "when the total movement amount is 10 m or less and the total number of outings is 1 or less" is associated with the activity amount "small" of the third rank. It is associated, and the case between these is associated with the activity amount "medium" of the second rank. Then, in the action information display area 528, one of the activity amount "large", the activity amount "medium", and the activity amount "small" selected based on the total movement amount and the total number of outings is displayed. It should be noted that one of the correspondence relationships is prepared for the entire monitored person Ob, which may be applied to the entire monitored person Ob, and is prepared for each monitored person Ob, and these are prepared for each monitored person Ob. It may be applied on a case-by-case basis.

In order to express the present invention, the present invention has been appropriately and sufficiently described through the embodiments with reference to the drawings above, but those skilled in the art can easily change and / or improve the above embodiments. It should be recognized that it can be done. Therefore, unless the modified or improved form implemented by a person skilled in the art is at a level that deviates from the scope of rights of the claims stated in the claims, the modified form or the improved form is the scope of rights of the claims. It is interpreted as being comprehensively included in.

MS Monitored person monitoring system SU, SU-1 to SU-4 Sensor device SV Management server device SP Fixed terminal device TA, TA-1, TA-2 Mobile terminal device FT-SV, FT-TA Monitoring function operation status information table 11 Imaging unit 12 Sensor side sound input / output unit (SU sound input / output unit)
13 Nurse call reception operation unit 14 Sensor side control processing unit (SU control processing unit)
15 Sensor side communication interface unit (SU communication IF unit)
16 Sensor side storage unit (SU storage unit)
21 Server-side communication interface section (SV communication IF section)
22 Server-side control processing unit (SV control processing unit)
23 Server-side storage unit (SV storage unit)
31 Terminal-side communication interface section (TA communication IF section)
32 Terminal side control processing unit (TA control processing unit)
33 Terminal side storage unit (TA storage unit)
34 Terminal side sound input / output unit (TA sound input / output unit)
35 Terminal side input section (TA input section)
36 Terminal side display (TA display)
37 Terminal side interface section (TAIF section)
141 Sensor side control unit (SU control unit)
142 Behavior detection processing unit 143 Nurse call processing unit 144 Sensor side streaming processing unit (SU streaming processing unit)
221 Server-side control unit (SV control unit)
222 Server-side monitoring processing unit (SV monitoring processing unit)
223 Behavior information processing unit 224 Care information processing department 231 Server-side monitoring information storage unit (SV monitoring information storage unit)
232 Inter-device information storage unit 233 Server-side sensor information storage unit (SV sensor information storage unit)
234 Behavior information storage unit 235 Care information storage unit 321 Terminal side control unit (TA control unit)
322 Terminal side monitoring processing unit (TA monitoring processing unit)
323 Call processing unit 324 Terminal side streaming processing unit (TA streaming processing unit)
331 Terminal side monitoring information storage unit (TA monitoring information storage unit)
333 Terminal side sensor information storage unit (TA sensor information storage unit)

Claims (5)

It is possible to communicate event information representing the content of a predetermined event related to the monitored person to be monitored, and an event notification communication signal for notifying the event, which contains an image of the monitored person related to the event. It is a monitored person monitoring device that notifies the terminal device connected to
With the communication unit that communicates
The image acquisition unit that acquires images and
Based on the image acquired by the image acquisition unit, the behavior information processing unit that obtains behavior information regarding a predetermined behavior of the monitored person, and the behavior information processing unit.
The behavior information storage unit that stores the behavior information obtained by the behavior information processing unit in association with the monitored person, and the behavior information storage unit.
It is provided with a monitoring processing unit that transmits the event notification communication signal to the terminal device by the communication unit.
When the event notification communication signal is transmitted to the terminal device by the communication unit, the monitoring processing unit is obtained in the past before the transmission time when the event notification communication signal is transmitted to the terminal device by the communication unit. , The rank corresponding to the action information stored in the action information storage unit is further accommodated in the event notification communication signal.
The behavior information is at least one of the total amount of movement within a predetermined time, the total number of outings within a predetermined time, the amount of movement per predetermined unit time, the movement speed, and the change over time in the amount of movement per predetermined unit time. This is a monitored person monitoring device. A care information storage unit that stores care information representing the content of the care that has been cared for by the monitored person in association with the monitored person.
When the communication unit receives the monitored person identification information for identifying and identifying the monitored person and the care information notification communication signal accommodating the care information of the monitored person, the received care information notification communication signal. Further provided with a care information processing unit that stores the care information in the care information storage unit in association with the monitored person based on the monitored person identification information and the care information accommodated in the monitored person.
When the monitoring processing unit transmits the event notification communication signal to the terminal device by the communication unit, the care information is prior to the transmission time when the event notification communication signal is transmitted to the terminal device by the communication unit. The monitored person monitoring device according to claim 1, wherein the care information stored in the storage unit is further stored in the event notification communication signal. The monitored person monitoring device according to claim 2, wherein the care information contained in the event notification communication signal can be set or changed for each monitored person. It is possible to communicate event information representing the content of a predetermined event related to the monitored person to be monitored, and an event notification communication signal for notifying the event, which contains an image of the monitored person related to the event. It is a monitored person monitoring method that notifies the terminal device connected to
Image acquisition process to acquire images and
Based on the image acquired in the image acquisition step, a behavior information processing process for obtaining behavior information regarding a predetermined behavior in the monitored person, and a behavior information processing step.
A behavior information storage process in which the behavior information obtained in the behavior information processing process is associated with the monitored person and stored in the behavior information storage unit, and
The event notification communication signal is provided with a monitoring process step of transmitting the event notification communication signal to the terminal device by a communication unit that performs communication.
The monitoring processing step was obtained in the past when the event notification communication signal was transmitted to the terminal device by the communication unit, before the transmission time when the event notification communication signal was transmitted to the terminal device by the communication unit. , The rank corresponding to the action information stored in the action information storage unit is further accommodated in the event notification communication signal.
The behavior information is at least one of the total amount of movement within a predetermined time, the total number of outings within a predetermined time, the amount of movement per predetermined unit time, the movement speed, and the change over time in the amount of movement per predetermined unit time. A method of monitoring a person to be monitored. The terminal device is communicably connected to the terminal device, and includes event information representing the content of a predetermined event related to the monitored person to be monitored, and an image of the monitored person related to the event. A monitored person monitoring system including a monitored person monitoring device that notifies the terminal device of an event notification communication signal for notifying an event.
The monitored person monitoring device is
With the communication unit that communicates
The image acquisition unit that acquires images and
Based on the image acquired by the image acquisition unit, the behavior information processing unit that obtains behavior information regarding a predetermined behavior of the monitored person, and the behavior information processing unit.
The behavior information storage unit that stores the behavior information obtained by the behavior information processing unit in association with the monitored person, and the behavior information storage unit.
It has a monitoring processing unit that transmits the event notification communication signal to the terminal device by the communication unit.
When the event notification communication signal is transmitted to the terminal device by the communication unit, the monitoring processing unit is obtained in the past before the transmission time when the event notification communication signal is transmitted to the terminal device by the communication unit. , The action information stored in the action information storage unit is further accommodated in the event notification communication signal.
The behavior information is at least one of the total amount of movement within a predetermined time, the total number of outings within a predetermined time, the amount of movement per predetermined unit time, the movement speed, and the change over time in the amount of movement per predetermined unit time. ,
The monitored person monitoring device selects a rank according to the action information, and further accommodates the rank according to the action information in the event notification communication signal, or the terminal device is included in the event notification communication signal. A monitored person monitoring system characterized in that a rank corresponding to the behavior information is selected for the stored behavior information.

Images