JP2018041366A - Monitored person monitoring system and monitored person monitoring method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To notify a portable terminal device that a sensor device detects a predetermined action of a monitored person in an abnormal state such as power interruption and system down of a server device.SOLUTION: A sensor device SU can communicate with a management server device SV by a first communication system and can communicate with a portable terminal device TA by a second communication system. The sensor device SU transmits detection information to the portable terminal device TA via the management server device SV when it detects a predetermined action of a monitored person Ob and determines that a predetermined abnormal state does not occur. The sensor device SU transmits detection information to the portable terminal device TA by wireless communication when it detects the action of the monitored person Ob and determines that it is the abnormal state.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a technique for monitoring, for example, a person who needs nursing or a person who needs care (hereinafter referred to as a nurse who needs nursing).

  In an aging society such as Japan (Japan) in recent years, an increase in the number of nurses requiring medical attention due to illness, injury, aging, etc. is expected in the future.

  Such nurses need to enter a hospital or a facility such as a welfare facility for the elderly and receive nursing and care. In facilities such as hospitals and welfare facilities for the elderly, those who need nursing care such as nurses (hereinafter referred to as nurses) regularly check their safety. However, since the number of nurses and the like are reduced and the work load per person is increased in the semi-night work and night work hours compared to the day work hours, reduction of the work load is required. For this reason, in recent years, a monitored person monitoring system for monitoring (monitoring) a patient who needs nursing is monitored and developed.

  As a monitored person monitoring system, for example, there is a nurse call system disclosed in Patent Document 1. This is a nurse call system having a nurse call slave set installed in a bed for a patient to call a nurse and a nurse call master set installed in a nurse station and responding to a call by the nurse call slave set. A camera that images the patient on the bed from above the bed, and from the captured image of the camera, the occurrence of at least one of a state in which the patient wakes up and a state in which the patient leaves the bed is determined. State determination means for outputting a caution state generation signal, and the nurse call master device has notification means for performing a notification operation upon receiving the caution state generation signal.

  This nurse call system includes a controller (for example, a server device), and it is necessary to protect the system of the server device when a power failure occurs. As a power failure countermeasure, for example, an uninterruptible power supply that supplies power to the server device in the event of a power failure is conceivable.

  As a technology related to power failure countermeasures, for example, there is an image forming apparatus disclosed in Patent Document 2. The image forming apparatus includes a wired communication unit that transmits and receives data via a wired communication network, a wireless communication unit that transmits and receives data via a wireless communication network, and wireless communication if commercial power is not supplied. Power supply means for supplying power to the means, and operation means for accepting an instruction to transmit data to an external device. The wireless communication means functions as an access point and is supplied with commercial power. When the operation unit receives an instruction to transmit data, the wired communication unit transmits the data. When the operation unit receives an instruction to transmit data in a state where commercial power is not supplied, the wireless communication unit Data is transmitted to an image forming apparatus other than the own apparatus functioning as an access point.

JP 2014-90913 A JP2015-154282A

  When the server device system goes down, the server device cannot communicate with the sensor device. For this reason, since a sensor apparatus cannot transmit detection information to a server apparatus, a portable terminal device cannot receive detection information. There is a need for countermeasures against server system down.

  An object of the present invention is to monitor a mobile terminal device when the sensor device detects a predetermined action of the monitored person in an abnormal state such as a power failure or a system failure of the server device. It is to provide a person monitoring system and a person monitoring method.

  A monitored person monitoring system according to a first aspect of the present invention is a monitored person monitoring system including a sensor device, a server device, and a mobile terminal device, wherein the sensor device captures an image of the monitored person, A detection unit that performs predetermined image processing on the image of the monitored person captured by the imaging unit and detects that the monitored person performs a predetermined action, and a first communication method. A first communication unit capable of communicating with the server device; a second communication unit capable of communicating with the portable terminal device by a second communication method of a wireless method; A detection unit that detects the behavior when the detection unit detects the behavior and the determination unit determines that the behavior is not in the abnormal state, and the image includes a first Send information to the first communication unit When the detection unit detects the action and the determination unit determines that the abnormal state, the second communication unit includes second information including at least the detection information among the detection information and the image. And the server device receives the first information transmitted by the first communication unit, transmits the first information to the portable terminal device, and the portable terminal device. Is capable of communicating with the sensor device by the third communication unit that receives the first information transmitted by the server device and the second communication method of the wireless method, and the second communication unit transmits the first information. 4th communication part which receives 2 information.

  In the monitored person monitoring system according to the first aspect of the present invention, when the sensor device detects a predetermined action of the monitored person and determines a predetermined abnormal state related to communication, the detection information is detected. Then, it transmits to the mobile terminal device wirelessly without going through the server device. Therefore, according to the monitored person monitoring system according to the first aspect of the present invention, when the sensor device detects a predetermined action of the monitored person even in an abnormal state such as a power failure or a system failure of the server device. This can be notified to the mobile terminal device.

  The first communication method is, for example, a wired LAN, a wireless LAN, or a combination thereof. The second communication method is, for example, Bluetooth (registered trademark) or wireless LAN.

  The second information includes an aspect including both detection information and an image (that is, the second information is the same as the first information) and an aspect including detection information but no image. The latter mode is effective during a power failure. When power is being supplied from the emergency power supply to the sensor device due to a power failure, it is necessary to reduce the power consumption of the sensor device as much as possible. In the case of the latter mode (a mode in which the second information includes detection information but does not include an image), the information amount of the second information can be reduced, so that the amount of power necessary to transmit the second information is reduced. Can do.

  The images included in the first aspect of the first information and the second information are images captured by the imaging unit when the predetermined behavior of the monitored person is detected by the detection unit, that is, the imaging unit. Is an image when the monitored person is performing a predetermined action among the images of the imaging target including the monitored person captured. For example, the image is picked up by the image pickup unit when the wake-up is detected (the image of the person being watched is shown in this image).

  In the above configuration, the second information does not include the image, and the sensor device detects the image when the detection unit detects the action and the determination unit determines the abnormal state. A recording unit for recording is further provided.

  When the second information is in the latter mode, the image (the image when the monitored person performs a predetermined action) is not transmitted to the server device, and thus is not transmitted to the mobile terminal device. In this configuration, the image is recorded in the sensor device, so that the supervisor can confirm the image later.

  In the above-described configuration, the monitored person monitoring system further includes a nurse call slave device that transmits a nurse call to the sensor device by the wireless second communication method, and the control unit includes the second communication unit. When the nurse call is received and the determination unit determines that the abnormal state is not present, the nurse call is transmitted to the first communication unit, the second communication unit receives the nurse call, and When the determination unit determines that the abnormal state, the nurse call is transmitted to the second communication unit, the server device receives the nurse call transmitted by the first communication unit, the nurse call to the nurse call The third communication unit receives the nurse call transmitted by the server device, and the fourth communication unit transmits the nurse transmitted by the second communication unit. To receive Lumpur.

  When the sensor device receives the nurse call from the nurse call slave unit and determines that the abnormal state is determined in advance, the sensor device wirelessly transmits the nurse call to the portable terminal device without passing through the server device. Therefore, according to this configuration, even in an abnormal state such as a power failure or a system failure of the server device, when the sensor device receives a nurse call from the nurse call slave device, it can notify the portable terminal device.

  The said structure WHEREIN: The said determination part determines with the said abnormal state, when the said 1st communication part and the said server apparatus cannot communicate by a said 1st communication system.

  In this configuration, when the sensor device and the server device cannot communicate with each other by the first communication method, the abnormal state is determined. For example, the determination unit determines that the sensor device and the server device cannot communicate with each other using the first communication method when the first communication unit attempts communication with the server device using the first communication method and there is no response from the server device. . One of the reasons why the first communication unit and the server device cannot communicate with each other by the first communication method is a system failure of the server device.

  In the above configuration, the sensor device further includes a power source that supplies power to the sensor device in the event of a power failure, and the determination unit detects the abnormal state when power is being supplied from the power source to the sensor device. judge.

  In the event of a power failure, power is supplied to the sensor device from the power source (emergency power source). This configuration is determined as an abnormal state when power is supplied from the power source to the sensor device.

  In the above configuration, when the determination unit determines that the abnormal state is detected while the detection unit is not detecting the action, the control unit displays the third information indicating the abnormal state as the second communication unit. And the fourth communication unit receives the third information transmitted by the second communication unit.

  According to this configuration, the abnormal state can be notified to the mobile terminal device before the behavior of the monitored person is detected.

  A monitored person monitoring method according to a second aspect of the present invention is a method of monitoring a monitored person using a sensor device, a server device, and a mobile terminal device, and is a step executed by the sensor device. An imaging step for imaging a monitor and a step executed by the sensor device, and performing predetermined image processing on the image of the monitored person imaged in the imaging step, A detection step for detecting that a predetermined action has been performed; a step executed by the sensor device; a determination step for determining whether or not a predetermined abnormal state related to communication; and a step executed by the sensor device Detection information indicating that the action has been detected when the action is detected in the detection step and the determination step determines that the action is not in the abnormal state; A first transmission step of transmitting first information including the image to the server device by a first communication method, and a step executed by the sensor device, wherein the action is detected in the detection step, and When it is determined in the determination step that the abnormal state, second information including at least the detection information among the detection information and the image is transmitted to the portable terminal device by a second wireless communication method. A transmission step; a step executed by the server device; the transmission / reception step of receiving the first information transmitted in the first transmission step and transmitting the first information to the portable terminal device; and the portable terminal A first reception step of receiving the first information transmitted in the transmission / reception step; and a step of executing by the mobile terminal device A step, and a second receiving step of receiving the second information transmitted by said second transmission step.

  The monitored person monitoring method according to the second aspect of the present invention defines the monitored person monitoring apparatus according to the first aspect of the present invention from the viewpoint of the method, and the monitored person monitoring according to the first aspect of the present invention. It has the same effect as the device.

  According to the present invention, when the sensor device detects a predetermined action of the monitored person in an abnormal state such as a power failure or a system failure of the server device, the mobile terminal device can be notified of it.

It is explanatory drawing explaining the structure of the to-be-monitored person monitoring system which concerns on embodiment. It is a block diagram which shows the structure of the sensor apparatus with which the to-be-monitored person monitoring system which concerns on embodiment is equipped. It is a block diagram which shows the structure of the nurse call subunit | mobile_unit with which the to-be-monitored person monitoring system which concerns on embodiment is equipped. It is a block diagram which shows the structure of the portable terminal device with which the to-be-monitored person monitoring system which concerns on embodiment is equipped. It is the first half of the flowchart explaining the action detection performed by the to-be-monitored person monitoring system which concerns on embodiment, and the notification of the detected action. It is the latter half of the flowchart. It is the first half of the flowchart explaining the notification of the nurse call performed by the monitored person monitoring system according to the embodiment. It is the latter half of the flowchart.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In each figure, the structure which attached | subjected the same code | symbol shows that it is the same structure, The description is abbreviate | omitted about the content which has already demonstrated the structure. In this specification, when referring generically, it shows with the reference symbol which abbreviate | omitted the suffix, and when referring to an individual structure, it shows with the reference symbol which attached the suffix.

  The monitored person monitoring system according to the embodiment is a system that monitors a monitored person to be monitored (in other words, a watching target person to be watched over) using a plurality of devices, and a terminal device And a monitored person monitoring device that is connected to the terminal device so as to be communicable, detects a predetermined event (event) related to the monitored person, and notifies the terminal device of the event. The monitored person monitoring device may be integrally configured by a single device. However, in this specification, the monitored person monitoring device is connected to the sensor device and the sensor device and the terminal device so as to communicate with each other. By providing the management server device, the two types of devices are configured separately. The sensor device detects the predetermined event related to the monitored person and notifies (reports or transmits) the management server device. Upon receiving the notification from the sensor device, the management server device manages the event that has received the notification, and re-notifies the event to a predetermined terminal device associated with the sensor device. Send. Although the terminal device may be one type of device, in the present specification, the terminal device is two types of devices, a fixed terminal device and a mobile terminal device. The main difference between these fixed terminal devices and portable terminal devices is that the fixed terminal device is fixedly operated, and the portable terminal device is operated by being carried by a supervisor NS (user) such as a nurse or a caregiver. Is a point. Since the fixed terminal device and the mobile terminal device are substantially the same, the mobile terminal device will be mainly described below.

  FIG. 1 is an explanatory diagram illustrating a configuration of a monitored person monitoring system MS according to the embodiment. More specifically, the monitored person monitoring system MS includes, for example, one or a plurality of sensor devices SU (SU-1, SU-2), a management server device SV, a fixed terminal device SP, and one or a plurality of ones. A portable terminal device TA (TA-1, TA-2) and a private branch exchange (PBX) CX are provided. These are wired or wireless, and are a network (network, communication) such as a LAN (Local Area Network). Line) Connected to be communicable via NW. The network NW may be provided with repeaters such as repeaters, bridges, and routers that relay communication signals. In the example shown in FIG. 1, the plurality of sensor devices SU-1, SU-2, the management server device SV, the fixed terminal device SP, the plurality of portable terminal devices TA-1, TA-2, and the private branch exchange CX are L2 switches. Are connected to each other by a wired LAN and a wireless LAN (for example, a LAN conforming to the IEEE 802.11 standard) including a line concentrator (HUB, HUB) LS and an access point AP. More specifically, the plurality of sensor devices SU-1, SU-2, the management server device SV, the fixed terminal device SP, and the private branch exchange CX are connected to the line concentrator LS, and the plurality of portable terminal devices TA-1, TA-2. Is connected to the line concentrator LS via the access point AP. The network NW configures a so-called intranet by using Internet protocol groups such as TCP (Transmission Control Protocol) and IP (Internet Protocol). The private branch exchange CX is connected to the telephone TL via the public telephone network PN.

  The monitored person monitoring system MS is arranged at an appropriate place according to the monitored person Ob. The monitored person Ob is, for example, a person who needs nursing due to illness or injury, a person who needs care due to a decrease in physical ability, or a single person living alone. In particular, from the viewpoint of enabling early detection and early action, the monitored person Ob may be a person who needs the detection when a predetermined unfavorable event such as an abnormal state occurs in the person. preferable. For this reason, the monitored person monitoring system MS is suitably arranged in a building such as a hospital, a welfare facility for the elderly, and a dwelling unit according to the type of the monitored person Ob. In the example illustrated in FIG. 1, the monitored person monitoring system MS is disposed in a building of a care facility that includes a plurality of rooms RM in which a plurality of monitored persons Ob live and a plurality of rooms such as a nurse station.

  The sensor device SU has a communication function that communicates with other devices SV, SP, TA via the network NW, detects a predetermined event related to the monitored person Ob, and sends the detected event to the management server device SV. To the management server device SV, make a voice call with the terminal devices SP and TA, and generate an image including a moving image to the terminal. It is a device that distributes moving images to the devices SP and TA. The predetermined event preferably includes an event that needs to be dealt with.

  FIG. 1 shows two sensor devices SU (first sensor device SU-1 and second sensor device SU-2) as an example, and the first sensor device SU-1 is a monitored person Ob. The second sensor device SU-2 is arranged in the room RM-1 (not shown) of Mr. A Ob-1 who is one of the persons, and the room RM-2 of Mr. B Ob-2 who is one of the monitored persons Ob. (Not shown).

  The nurse call child machine NC is arranged in each room RM. The nurse call slave NC is a device used when the monitored person Ob wants to call the supervisor NS. The nurse call slave NC communicates with the sensor device SU by wireless communication. When the nurse call button of the nurse call slave unit NC is pressed, the nurse call is sent to the fixed terminal device SP and each portable terminal device TA via the sensor device SU and the management server device SV. The fixed terminal device SP and each portable terminal device TA function as a nurse call parent device.

  The management server device SV has a communication function that communicates with other devices SU, SP, TA via the network NW, and receives a notification of a predetermined event related to the monitored person Ob from the sensor device SU. It is a device that manages information related to monitoring Ob (monitoring information). When the management server device SV receives the first event notification communication signal from the sensor device SU as the event notification, the management server device SV relates to the monitoring of the monitored person Ob based on each information accommodated in the first event notification communication signal. A predetermined terminal device that stores (records) monitoring information and associates a communication signal (second event notification communication signal) containing the monitoring information related to monitoring of the monitored person Ob in advance with the sensor device SU. Send to SP, TA. For this purpose, the management server device SV indicates the notification destination (re-notification destination, re-notification destination, transmission destination) such as the first event notification communication signal transmitted from the sensor device SU and the notification of the sensor ID that is the transmission source. A correspondence relationship (notification destination correspondence relationship) with a terminal (re-notification destination) terminal ID and a communication address thereof are stored. The terminal ID (terminal device identifier) is an identifier for identifying and identifying the terminal devices SP and TA. Then, the management server device SV provides the client with data corresponding to the request of the client (in this embodiment, the fixed terminal device SP and the portable terminal device TA). Such a management server device SV can be configured by, for example, a computer with a communication function.

  The fixed terminal device SP is a device that functions as a user interface (UI) of the monitored person monitoring system MS. In order to achieve this function, the fixed terminal device SP transmits a communication function for communicating with other devices SU, SV, TA via the network NW, a display function for displaying predetermined information, and predetermined instructions and data. An input function or the like is provided, and predetermined instructions and data to be given to the management server device SV and the portable terminal device TA are input, or monitoring information obtained by the sensor device SU is displayed. Such a fixed terminal device SP can be configured by, for example, a computer with a communication function.

  In the embodiment, the fixed terminal device SP, the sensor device SU, and the management server device SV are each connected to the line concentrator LS via a wired LAN, but a wireless LAN may be used instead of the wired LAN.

  The portable terminal device TA is carried by the supervisor NS. The mobile terminal device TA communicates with other devices SV, SP, SU via the network NW, a display function for displaying predetermined information, an input function for inputting predetermined instructions and data, and a voice call. A monitoring function (including a moving image) obtained by the sensor device SU by inputting a predetermined instruction and data to be provided to the management server device SV and the sensor device SU or by notification from the management server device SV. This is a device for displaying or making a nurse call response or calling by voice call with the sensor device SU.

  The sensor device SU will be described in detail. In addition to the above-described functions (for example, a function for generating a moving image of the monitored person Ob and a function for performing a voice call with the terminal apparatuses SP and TA), the sensor device SU is predetermined for the monitored person Ob. It has a function of detecting a behavior and a function of dealing with a predetermined abnormal state (for example, power failure, system down of the management server device SV). The sensor device SU will be described in detail from the viewpoint of these functions.

  FIG. 2 is a block diagram illustrating a configuration of the sensor device SU provided in the monitored person monitoring system MS according to the embodiment. The sensor device SU includes a sensor side control processing unit (SU control processing unit) 10, a sensor side communication interface unit (SU communication IF unit) 11, a SU communication IF unit 12, an emergency power supply 13, an imaging unit 14, and an action detection unit 15. , An abnormal state determination unit 16 and an image recording unit 17 are provided.

  The SU control processing unit 10 controls the entire sensor device SU, and in accordance with the control of the SU control processing unit 10, each unit of the sensor device SU (SU communication IF unit 11, SU communication IF unit 12, emergency power supply 13, imaging unit) 14, the behavior detection unit 15, the abnormal state determination unit 16, and the image recording unit 17) each execute a function. The SU control processing unit 10 and functional blocks (behavior detection unit 15, abnormal state determination unit 16, storage processing unit 172), which will be described later, include hardware (CPU (Central Processing Unit), RAM (Random Access Memory), ROM (Read Only Memory, etc.), software, etc.

  The SU communication IF unit 11 (first communication unit) communicates with the management server device SV, fixed terminal device SP, and portable terminal device TA via the network NW under the control of the SU control processing unit 10. It is. Since the SU communication IF unit 11 is connected to the line concentrator LS (FIG. 1) by a wired LAN (first communication method), the SU communication IF unit 11 is a communication interface of the wired LAN.

  The SU communication IF unit 12 (second communication unit) is a communication interface for performing wireless communication with the nurse call slave unit NC according to the control of the SU control processing unit 10. As a wireless communication method (second communication method), for example, Bluetooth (registered trademark) or a wireless LAN is available. The embodiment will be described using Bluetooth (registered trademark) as an example.

  The emergency power source 13 (power source) serves as a power source for the sensor device SU when a power failure occurs. Electric power is supplied to the sensor device SU from the line concentrator LS (FIG. 1). When a power failure occurs, power cannot be supplied from the line concentrator LS to the sensor device SU, so the emergency power supply 13 is used. The emergency power supply 13 includes a storage battery (for example, a lithium ion battery), a switch that switches the power supply of the sensor device SU from the concentrator LS to the storage battery, and a voltage that measures the voltage of power supplied from the concentrator LS to the sensor device SU. And a switch controller that controls the switch to switch the power supply of the sensor device SU from the concentrator LS to the storage battery when the voltage drops below a predetermined value. The emergency power supply 13 is normally supplied with power from the line concentrator LS, thereby charging the storage battery.

  The imaging unit 14 is an apparatus that captures an imaging target and generates an image of the imaging target. The image includes a still image and a moving image. The imaging unit 14 is arranged so as to be able to monitor a space (location space, in the example shown in FIG. 1, where the monitored person Ob is scheduled), and the location space is taken as an imaging target from above. An image is taken and an image overlooking the imaging target is generated. Preferably, since there is a high probability that the entire monitored person Ob can be imaged, the imaging unit 14 is expected to be located at the head of the monitored person Ob in the bedding on which the monitored person Ob is lying (for example, a bed). It is arranged so that the imaging target can be imaged from directly above the preset planned head position (usually the position where the pillow is disposed). The sensor device SU uses the imaging unit 14 to acquire an image of the monitored person Ob taken from above the monitored person Ob, preferably an image taken from directly above the planned head position.

  Such an imaging unit 14 may be a device that generates an image of visible light. However, in the embodiment, the imaging unit 14 is a device that generates an infrared image so that the monitored person Ob can be monitored even in a relatively dark place. Such an imaging unit 14 is, for example, in the embodiment, an imaging optical system that forms an infrared optical image of an imaging target on a predetermined imaging surface, and a light receiving surface that is aligned with the imaging surface. An image sensor that converts an infrared optical image in the imaging target into an electrical signal, and image data that is data representing an infrared image in the imaging target by performing image processing on the output of the image sensor A digital infrared camera including an image processing unit to be generated. In the embodiment, the imaging optical system of the imaging unit 14 is preferably a wide-angle optical system (so-called wide-angle lens (including a fisheye lens)) having an angle of view capable of imaging the entire living room RM in which the imaging unit 14 is disposed.

  The behavior detection unit 15 (detection unit) detects a predetermined behavior in the monitored person Ob, and uses detection information (in other words, information indicating a detection result) indicating detection as an example of the predetermined event. Notify the management server device SV. More specifically, in the embodiment, the predetermined action includes, for example, wake-up when the monitored person Ob occurred, leaving the monitored person Ob away from the bed, falling down when the monitored person Ob fell from the bed, and These are four actions of the fall of the monitored person Ob. And the action detection part 15 detects the head of the monitoring subject Ob based on the image imaged by the imaging part 14, for example, and based on the time change of the magnitude | size in this detected head of the monitoring person Ob. Detecting the monitored person Ob's getting up, getting out of bed, falling and falling.

  More specifically, the bed area of the living room RM, the first threshold value Th1 for identifying the size of the head in the lying position and the size of the head in the sitting position in the bed area, excluding the bed area The second threshold Th2 for identifying whether or not the head is in the standing posture in the living room RM, and the size of the head in the lying posture in the living room RM excluding the bed area. A third threshold Th3 for identifying whether or not the action is detected is stored in advance in the behavior detection unit 15. Then, the behavior detection unit 15 extracts a moving body region as a person's region of the monitored person Ob from the image captured by the imaging unit 14 by, for example, the background difference method or the frame difference method, and from the extracted moving body region, for example, The head region of the monitored subject Ob is extracted by elliptical Hough transformation, for example, by pattern matching using a head model prepared in advance, or by a neural network that has been learned for head detection, for example. From the position and size of the extracted head, wake-up, get-off, fall and fall are detected.

  For example, the behavior detection unit 15 is in a sitting position from the size of the lying posture by using the first threshold value Th1 when the extracted head position is in the bed area and the extracted head size is the first threshold Th1. When the time changes to the size of the posture, it is determined that the user has woken up and the wake-up is detected. For example, the behavior detection unit 15 is a case where the position of the extracted head has changed over time from within the sleeping area to the outside of the sleeping area, and the size of the extracted head is the second threshold Th2. When the time changes from a certain size to the size of the standing posture by using, it is determined that the user has left the bed and the bed is detected. For example, the behavior detection unit 15 is a case where the position of the extracted head has changed over time from within the sleeping area to the outside of the sleeping area, and the size of the extracted head is the third threshold Th3. If the time changes from a certain size to the size of the recumbent posture by using, a fall is determined and the fall is detected. For example, the action detecting unit 15 has the extracted head position in the living room RM excluding the bed area, and the extracted head size is a certain size by using the third threshold Th3. If the time changes from the current position to the size of the recumbent posture, it is determined that the vehicle has fallen, and the fall is detected. Note that the lying posture is not limited to a lying posture, but includes a supine posture and a prone posture.

  The abnormal state determination unit 16 (determination unit) determines whether or not there is a predetermined abnormal state. The abnormal state is, for example, a power failure or a system down of the management server device SV. In the event of a power failure, power is supplied from the emergency power supply 13 to the sensor device SU. At this time, the abnormal state determination unit 16 determines that the state is abnormal.

  When the management server device SV goes down, communication cannot be performed between the sensor device SU and the management server device SV by a wired LAN (first communication method). That communication is not possible is, for example, that there is no response from the management server device SV (for example, the SU communication IF unit 11 cannot receive an ACK (acknowledgement) packet from the management server device SV). The abnormal state determination unit 16 determines an abnormal state when communication is not possible between the sensor device SU and the management server device SV.

  The SU control processing unit 10 (control unit) detects the above behavior (getting up, getting out of bed, falling, falling) and the abnormal state determining unit 16 determines that the abnormal state is not in an abnormal state. The information is transmitted to the SU communication IF unit 11 (first communication unit). The first information is information including detection information and a detection image. The detection information is information indicating a detection result, and is, for example, an event indicating the wake-up when the wake-up is detected. The detected image includes an image captured by the imaging unit 14 when the predetermined behavior of the monitored person Ob is detected by the behavior detection unit 15, that is, a photograph including the monitored person Ob captured by the imaging unit 14. It is an image when the monitored person Ob performs a predetermined action among the target images. For example, it is an image captured by the imaging unit 14 when the wake-up is detected (this image shows the monitored person Ob who is getting up).

  The SU control processing unit 10 sends the second information to the SU communication IF unit 12 (second communication unit) when the behavior detection unit 15 detects the behavior and the abnormal state determination unit 16 determines the abnormal state. Send it. The second information is information including at least detection information among the detection information and the detection image constituting the first information. The second information includes an aspect that includes both the detection information and the detection image, and an aspect that includes the detection information but does not include the detection image. The embodiment will be described in the latter aspect.

  The latter mode is effective during a power failure. When power is being supplied from the emergency power supply 13 to the sensor device SU due to a power failure, it is necessary to reduce the power consumption of the sensor device SU as much as possible. In the case of the latter target (a mode in which the second information includes detection information but does not include an image), the information amount of the second information can be reduced, so that the amount of power required to transmit the second information is reduced. Can do.

  When the SU communication IF unit 12 (second communication unit) receives a nurse call from the nurse call slave unit NC and the abnormal state determination unit 16 determines that the abnormal state is not abnormal, the SU control processing unit 10 Is transmitted to the SU communication IF unit 11 (first communication unit). The SU control processing unit 10 receives the nurse call when the SU communication IF unit 12 (second communication unit) receives the nurse call from the nurse call slave unit NC and the abnormal state determination unit 16 determines that the abnormal state has occurred. The data is transmitted to the SU communication IF unit 12 (second communication unit).

  The image recording unit 17 (recording unit) records the detected image when the behavior detecting unit 15 detects the behavior and the abnormal state determining unit 16 determines that the abnormal state has occurred. When the second information is in the latter mode, the detected image (the image when the monitored person performs a predetermined action) is not transmitted to the server device SV, and thus is not transmitted to the mobile terminal device TA. According to the embodiment, since the detected image is recorded in the sensor device SU, the supervisor NS can confirm the detected image later.

  The image recording unit 17 includes a nonvolatile storage unit 171 and a storage processing unit 172. The non-volatile storage unit 171 has a function (that is, non-volatile) that retains stored information (data) even when the sensor device SU is turned off, and is realized by a hard disk drive, a flash memory, or the like. .

  When the behavior detection unit 15 detects the behavior in the abnormal state, the storage processing unit 172 stores the detected image in the nonvolatile storage unit 171. When not in the abnormal state, the SU communication IF unit 11 transmits the detected image together with the detection information to the management server device SV. However, in the abnormal state, the image recording unit 17 stores the detected image.

  The nurse call child machine NC will be described in detail. FIG. 3 is a block diagram illustrating a configuration of the nurse call slave unit NC provided in the monitored person monitoring system MS according to the embodiment. The nurse call slave NC includes a nurse call button 20, a wireless module 21, and a battery 22.

  The nurse call button 20 is a switch circuit for inputting a nurse call to the nurse call slave unit NC. The nurse call button 20 is, for example, a push button type switch.

  The wireless module 21 is a device that is connected to the nurse call button 20 and transmits a wireless signal indicating the nurse call when the nurse call button 20 is pressed. Since the wireless module 21 communicates with the SU communication IF unit 12 (FIG. 2), it is a Bluetooth (registered trademark) communication module. The nurse call slave unit NC and the sensor device SU are paired. The sensor device SU is set as a master, and the nurse call slave unit NC is set as a slave.

  The battery 22 is a power source for the nurse call slave unit NC.

  The mobile terminal device TA will be described in detail. FIG. 4 is a block diagram illustrating a configuration of the mobile terminal device TA provided in the monitored person monitoring system MS according to the embodiment. The portable terminal device TA includes a terminal side control processing unit (TA control processing unit) 30, a terminal side communication interface unit (TA communication IF unit) 31, a TA communication IF unit 32, a display unit 33, a display control unit 34, and an operation. The unit 35 is provided.

  The TA control processing unit 30 controls the entire mobile terminal device TA, and in accordance with the control of the TA control processing unit 30, each unit of the mobile terminal device TA (TA communication IF unit 31, TA communication IF unit 32, display unit 33, display The control unit 34 and the operation unit 35) each execute a function. The TA control processing unit 30 and the display control unit are realized by hardware (CPU (Central Processing Unit), RAM (Random Access Memory), ROM (Read Only Memory, etc.)), software, and the like.

  The TA communication IF unit 31 (third communication unit) is a communication interface for communicating with the sensor device SU, the management server device SV, and the fixed terminal device SP via the network NW according to the control of the TA control processing unit 30. is there. Since the TA communication IF unit 31 is connected to the access point AP (FIG. 1) via a wireless LAN, the TA communication IF unit 31 is a wireless LAN communication interface.

  The TA communication IF unit 32 (fourth communication unit) is a communication interface for performing wireless communication according to the control of the TA control processing unit 30. Since the TA communication IF unit 32 communicates with the SU communication IF unit 12 of the sensor device SU, it is a Bluetooth (registered trademark) communication module.

  One sensor device SU is paired with a plurality of portable terminal devices TA. In the embodiment, one sensor device SU is paired with two portable terminal devices TA-1 and TA-2. The sensor device SU is set as a master, and the mobile terminal devices TA-1 and TA-2 are set as slaves.

  The display unit 33 is realized by a liquid crystal display or the like. The display control unit 34 controls the display unit 33 to display an image (for example, a moving image). The operation unit 35 is a device for inputting a command or the like for operating the mobile terminal device TA. The operation unit 35 is realized by a touch panel or the like.

  Action detection executed by the monitored person monitoring system MS according to the embodiment and notification of the detected action will be described. 5 and 6 are flowcharts for explaining this. As the sensor device SU and the monitored person Ob, the sensor apparatus SU-1 and the monitored person Ob-1 shown in FIG. 1 will be described as examples.

  With reference to FIG.2 and FIG.5, the action detection part 15 judges whether the to-be-monitored person Ob-1 performed predetermined action (getting up, getting out of bed, falling, falling) (step S1). When the behavior detection unit 15 determines that the monitored person Ob-1 is not performing a predetermined behavior (No in step S1), the behavior detection unit 15 repeats the process of step S1.

  When the behavior detection unit 15 determines that the monitored person Ob-1 has made a predetermined action (Yes in step S1), that is, it has detected that the monitored person Ob-1 has made a predetermined action. At this time, the behavior detection unit 15 generates detection information indicating this behavior (step S2). For example, when waking up is detected, detection information indicating waking up is generated.

  The abnormal state determination unit 16 determines whether or not power is being supplied from the emergency power supply 13 to the sensor device SU-1 (step S3). When the abnormal state determination unit 16 determines that power is not supplied from the emergency power supply 13 to the sensor device SU-1 (No in step S3), a power failure has occurred, and the SU control processing unit 10 The process of step S4 is performed.

  The SU control processing unit 10 attempts to communicate with the management server device SV using the SU communication IF unit 11, and determines whether or not there is a response from the management server device SV (step S4). When the SU control processing unit 10 determines that there is a response from the management server device SV (Yes in step S4), the management server device SV is not down.

  The SU control processing unit 10 receives the detection information generated in step S2 and the detection image (the image captured by the imaging unit 14 when the action is detected in step S1) with the management server device SV as the destination. Then, the data is transmitted to the SU communication IF unit 11 (step S5). The detection information and the detection image are the first information (monitoring information of the monitored person Ob-1).

  The management server device SV receives the detection information and the detection image transmitted in step S5 (step T1). The management server device SV transmits the detection information and the detection image received in step T1 to the fixed terminal device SP and all the mobile terminal devices TA (step T2).

  With reference to FIG.4 and FIG.5, each TA communication IF part 31 of portable terminal device TA-1 and TA-2 receives the detection information and detection image which were transmitted by step T2 (step U1). Each of the mobile terminal devices TA-1 and TA-2 sounds an alarm indicating that the detection information has been notified, and each display control unit 34 of the mobile terminal devices TA-1 and TA-2 detects the detected action. Is displayed on the display unit 33. For example, when the wakeup of the monitored person Ob-1 is detected in step S1, a character image or an icon indicating the wakeup of the monitored person Ob-1 is displayed on the display unit 33.

  When the monitor NS operates the operation unit 35 and inputs a display command for the detected image received in step U1 to the operation unit 35, the display control unit 34 displays the detected image received in step U1 on the display unit 33. Is displayed. Thus, in step S1, when the behavior of the monitored person Ob-1 is detected, the image (detected image) of the monitored person Ob-1 imaged by the imaging unit 14 is displayed on the display unit 33. For example, when the wakeup of the monitored person Ob-1 is detected in step S1, an image in a state where the monitored person Ob-1 is getting up is displayed on the display unit 33.

  2 and 5, when power is supplied from emergency power supply 13 to sensor device SU-1 (Yes in step S3), or when there is no response from management server device SV (in step S4). No), the abnormal state determination unit 16 determines that an abnormal state has occurred. Thereby, the SU control processing unit 10 selects the SU communication IF unit 12.

  With reference to FIG.2 and FIG.6, sensor apparatus SU-1 first tries radio | wireless communication with portable terminal device TA-1, and judges whether there is a response from portable terminal device TA-1 (step). S6). Whether there is a response from the portable terminal device TA-1 is determined, for example, as follows. When the SU communication IF unit 12 attempts to communicate with the mobile terminal device TA-1, and the SU communication IF unit 12 receives an ACK packet from the TA communication IF unit 32 of the mobile terminal device TA-1, from the mobile terminal device TA-1 It is determined that there is a response. When the SU communication IF unit 12 does not receive an ACK packet from the TA communication IF unit 32 of the portable terminal device TA-1, it is determined that there is no response from the portable terminal device TA-1.

  If there is a response from the portable terminal device TA-1 (Yes in Step S6), the SU control processing unit 10 causes the SU communication IF unit 12 to transmit the detection information generated in Step S2 (Step S7). The image recording unit 17 records the detected image (step S8).

  With reference to FIG.4 and FIG.6, TA communication IF part 32 of portable terminal device TA-1 receives the detection information transmitted by step S7 (step U2). The mobile terminal device TA-1 sounds an alarm indicating that the detection information has been notified, and the display control unit 34 of the mobile terminal device TA-1 displays a character image or icon indicating the detected action on the display unit 33. Let

  With reference to FIG.2 and FIG.6, if there is no response from portable terminal device TA-1 (it is No at step S6), sensor device SU-1 will try wireless communication with portable terminal device TA-2, and portable terminal It is determined whether or not there is a response from the device TA-2 (step S9). If there is a response from the portable terminal device TA-2, the SU control processing unit 10 causes the SU communication IF unit 12 to transmit the detection information generated in step S2 (step S10). The image recording unit 17 records the detected image (step S11).

  With reference to FIG.4 and FIG.6, TA communication IF part 32 of portable terminal device TA-2 receives the detection information transmitted by step S10 (step U3). The mobile terminal device TA-2 sounds an alarm indicating that the detection information has been notified, and the display control unit 34 of the mobile terminal device TA-2 displays a character image or icon indicating the detected action on the display unit 33. Let

  If there is no response from the portable terminal device TA-2 (No in step S9), the sensor device SU-1 stops transmitting the detection information. If there is no response from the portable terminal device TA-2, the sensor device SU-1 may return to step S6 and perform the processing of step S6 to step S11 again.

  Although not shown in the flow of FIG. 5 and FIG. 6, the abnormal state determination is performed in a state where the behavior detection unit 15 has not detected the predetermined behavior of the monitored person Ob-1 (No in step S1). When the unit 16 determines that the state is abnormal (Yes in step S3 or No in step S4), the following process is executed.

  2 and 4, the SU control processing unit 10 generates third information indicating an abnormal state. The SU control processing unit 10 performs the same processing as Step S6, Step S7, Step U2, Step S9, Step S10, and Step U3 of FIG. 6, and transmits the third information to the SU communication IF unit 12 (second communication unit). To send to. The TA communication IF unit 32 (fourth communication unit) of the mobile terminal device TA receives the third information transmitted by the SU communication IF unit 12. The mobile terminal device TA sounds an alarm, and the display control unit 34 of the mobile terminal device TA causes the display unit 33 to display a character image or an icon indicating an abnormal state.

  The notification of the nurse call executed by the monitored person monitoring system MS according to the embodiment will be described. 7 and 8 are flowcharts for explaining it. As the sensor device SU, the monitored person Ob, and the nurse call slave unit NC, the sensor device SU-1, the monitored person Ob-1, and the nurse call slave unit NC-1 shown in FIG. 1 will be described as examples.

  Referring to FIG. 3 and FIG. 7, nurse call slave unit NC-1 waits for pressing of nurse call button 20 (step R1). When the nurse call button 20 is pressed (Yes in step R1), the wireless module 21 detects this and transmits a signal indicating a nurse call (hereinafter referred to as a nurse call) (step R2). When the nurse call button 20 is not pressed (No in Step R1), the nurse call handset NC-1 waits for the nurse call button 20 to be pressed (Step R1).

  2 and 7, the SU communication IF unit 12 of the sensor device SU-1 receives the nurse call transmitted in step R2 (step S21).

  The abnormal state determination unit 16 determines whether or not power is being supplied from the emergency power supply 13 to the sensor device SU-1 (step S22). When the abnormal state determination unit 16 determines that power is not supplied from the emergency power supply 13 to the sensor device SU-1 (No in step S22), a power failure has occurred, and the SU control processing unit 10 Step S23 is processed.

  The SU control processing unit 10 attempts to communicate with the management server device SV using the SU communication IF unit 11, and determines whether there is a response from the management server device SV (step S23). When the SU control processing unit 10 determines that there is a response from the management server device SV (Yes in step S23), the management server device SV is not down.

  The SU control processing unit 10 transmits the nurse call received in step S21 to the SU communication IF unit 11 with the management server device SV as the destination (step S24).

  The management server device SV receives the nurse call transmitted in step S24 (step T21). The management server device SV transmits the nurse call received in step T21 to the fixed terminal device SP and all the mobile terminal devices TA (step T22).

  With reference to FIG.4 and FIG.7, each TA communication IF part 31 of portable terminal device TA-1 and TA-2 receives the nurse call transmitted by step T22 (step U21). Each of the portable terminal devices TA-1 and TA-2 sounds an alarm indicating that the nurse call has been notified, and each display control unit 34 of the portable terminal devices TA-1 and TA-2 makes a nurse call. The number of the living room RM is displayed on the display unit 33.

  Referring to FIGS. 2 and 7, when power is supplied from emergency power supply 13 to sensor device SU-1 (Yes in step S22), or when there is no response from management server device SV (in step S23) No), the abnormal state determination unit 16 determines that an abnormal state has occurred. Thereby, the SU control processing unit 10 selects the SU communication IF unit 12.

  With reference to FIG.2 and FIG.8, sensor apparatus SU-1 first tries radio | wireless communication with portable terminal device TA-1, and judges whether there is a response from portable terminal device TA-1 (step). S25).

  If there is a response from the portable terminal device TA-1 (Yes in Step S25), the SU control processing unit 10 causes the SU communication IF unit 12 to transmit the nurse call received in Step S21 (Step S26).

  4 and 8, the TA communication IF unit 32 of the portable terminal device TA-1 receives the nurse call transmitted in step S26 (step U22). The portable terminal device TA-1 sounds an alarm indicating that the nurse call has been notified, and the display control unit 34 of the portable terminal device TA-1 causes the display unit 33 to display the number of the room RM where the nurse call is made. .

  With reference to FIG.2 and FIG.8, if there is no response from portable terminal device TA-1 (it is No at step S25), sensor device SU-1 will try wireless communication with portable terminal device TA-2, and a portable terminal will be carried out. It is determined whether or not there is a response from the device TA-2 (step S27). If there is a response from the portable terminal device TA-2 (Yes in step S27), the SU control processing unit 10 causes the SU communication IF unit 12 to transmit the nurse call received in step S21 (step S28).

  4 and 8, the TA communication IF unit 32 of the portable terminal device TA-2 receives the nurse call transmitted in step S28 (step U23). The portable terminal device TA-2 sounds an alarm indicating that the nurse call has been notified, and the display control unit 34 of the portable terminal device TA-2 causes the display unit 33 to display the number of the room RM where the nurse call is made. .

  If there is no response from portable terminal device TA-2 (No in step S27), sensor device SU-1 stops sending the nurse call. If there is no response from the portable terminal device TA-2, the sensor device SU-1 may return to step S25 and perform the processing of steps S25 to S28 again.

  The main effects of the embodiment will be described. Referring to FIGS. 1, 5, and 6, when sensor device SU detects a predetermined action of monitored person Ob (Yes in step S <b> 1), and determines a predetermined abnormal state (Yes in Step S3 or No in Step S4), the detection information is wirelessly transmitted to the mobile terminal device TA without going through the management server device SV (Step S7, Step S10). Therefore, according to the embodiment, when the sensor device SU detects a predetermined action of the monitored person Ob even in an abnormal state such as a power failure or a system down of the management server device SV, the detected behavior is detected by the mobile terminal device TA. Can be notified.

  Referring to FIG. 1, FIG. 7 and FIG. 8, sensor device SU receives a nurse call from nurse call slave unit NC (step S21) and determines that it is in a predetermined abnormal state (in step S22). Yes or No in step S23), the nurse call is transmitted wirelessly to the portable terminal device TA without going through the management server device SV (step S26, step S28). Therefore, according to the embodiment, when the sensor device SU receives a nurse call from the nurse call slave unit NC even in an abnormal state such as a power failure or a system down of the management server device SV, it notifies the portable terminal device TA of the nurse call. can do.

Ob Observer NS Monitor (User)
MS Monitored Person Monitoring System SU Sensor Device SV Management Server Device SP Fixed Terminal Device TA Mobile Terminal Device NC Nurse Call Slave Unit 10 SU Control Processing Unit (Control Unit)
11 SU communication IF unit (first communication unit)
12 SU communication IF unit (second communication unit)
13 Emergency power supply
14 Imaging unit 15 Behavior detection unit (detection unit)
16 Abnormal state determination unit (determination unit)
17 Image recording unit (recording unit)
31 TA communication IF unit (third communication unit)
32 TA communication IF unit (4th communication unit)

Claims (7)

A monitored person monitoring system comprising a sensor device, a server device and a mobile terminal device,
The sensor device includes:
An imaging unit for imaging the monitored person;
A detection unit that performs predetermined image processing on the image of the monitored person captured by the imaging unit and detects that the monitored person has performed a predetermined action;
A first communication unit capable of communicating with the server device by a first communication method;
A second communication unit capable of communicating with the mobile terminal device by a wireless second communication method;
A determination unit that determines whether or not a predetermined abnormal state related to communication;
When the detection unit detects the action and the determination unit determines that it is not in the abnormal state, the first information including detection information indicating that the action has been detected and the image is included in the first information. When the detection unit detects the action and the determination unit determines the abnormal state, the second information including at least the detection information is included in the detection information and the image. A control unit for transmitting to the second communication unit,
The server device receives the first information transmitted by the first communication unit, transmits the first information to the mobile terminal device,
The portable terminal device
A third communication unit that receives the first information transmitted by the server device;
A monitored person monitoring system comprising: a fourth communication unit capable of communicating with the sensor device and receiving the second information transmitted by the second communication unit by the wireless second communication method. The second information does not include the image,
2. The monitored person monitoring system according to claim 1, wherein the sensor device further includes a recording unit that records the image when the detection unit detects the action and the determination unit determines the abnormal state. . The monitored person monitoring system further includes a nurse call slave that transmits a nurse call to the sensor device by the wireless second communication method,
The control unit causes the second communication unit to transmit the nurse call to the first communication unit when the second communication unit receives the nurse call and the determination unit determines that the abnormal state is not present. When the unit receives the nurse call and the determination unit determines that the abnormal state, the nurse call is transmitted to the second communication unit,
The server device receives the nurse call transmitted by the first communication unit, transmits the nurse call to the mobile terminal device,
The third communication unit receives the nurse call transmitted by the server device,
The monitored person monitoring system according to claim 1 or 2, wherein the fourth communication unit receives the nurse call transmitted by the second communication unit.   The monitored person according to any one of claims 1 to 3, wherein the determination unit determines the abnormal state when the first communication unit and the server device cannot communicate with each other by the first communication method. Monitoring system. The sensor device further includes a power source for supplying power to the sensor device during a power failure,
The monitored person monitoring system according to any one of claims 1 to 4, wherein the determination unit determines that the abnormal state occurs when electric power is supplied from the power source to the sensor device. When the detection unit determines that the behavior is not detected and the determination unit determines the abnormal state, the control unit causes the second communication unit to transmit third information indicating the abnormal state,
The monitored person monitoring system according to claim 1, wherein the fourth communication unit receives the third information transmitted by the second communication unit. A method for monitoring a monitored person using a sensor device, a server device, and a mobile terminal device,
An image capturing step for capturing an image of a monitored person, the step executed by the sensor device;
A step executed by the sensor device, wherein the image of the monitored person imaged in the imaging step is subjected to predetermined image processing, and the monitored person performs a predetermined action. A detection step to detect;
A determination step of determining whether or not a predetermined abnormal state relating to communication is a step executed by the sensor device;
Detection information indicating that the action is detected when the action is detected in the detection step and is determined not to be in the abnormal state in the determination step; And a first transmission step of transmitting first information including: to the server device by a first communication method;
A step executed by the sensor device, wherein when the action is detected in the detection step and the abnormal state is determined in the determination step, at least the detection information is included among the detection information and the image. A second transmission step of transmitting the second information to the mobile terminal device by a wireless second communication method;
A transmission / reception step of receiving the first information transmitted in the first transmission step and transmitting the first information to the portable terminal device, the step executed by the server device;
A step of executing by the mobile terminal device, a first receiving step of receiving the first information transmitted in the transmitting and receiving step;
A monitored person monitoring method comprising: a second reception step of receiving the second information transmitted in the second transmission step, the step being executed by the portable terminal device.

Images