JP6504255B2 - Care support system and care support method - Google Patents

Description

The present invention, when used in long-term care facilities, etc. about the suitable care support system and nursing care how.

  In Japan, the declining birthrate and aging population are rapidly advancing due to the increase in the average life span of the people and the decline in the birth rate. Along with this, the number of hospitals and nursing homes for housing persons in need of nursing care (carers requiring care) is increasing, but nurses and carers' hands are chronically insufficient for reasons such as severe work conditions. It is causing a serious situation that there is no In particular, at night, etc., a small number of people have to watch over a large number of carers requiring care, and the burden on carers etc. is increased, which contributes to a further labor shortage.

  In order to reduce the burden on such caregivers, there is a need for a technology that supports care services. As an example, in order to cause a machine to perform a part of the work of a caregiver or the like, various techniques have been developed for monitoring a nurse who needs a care.

  According to Patent Document 1, when the abnormality detection device detects an abnormality of a monitoring target such as a care recipient, the image of the monitoring target is captured, and the image data of the monitoring target is transmitted to an external terminal through a net or the like. Discloses a technique for making an outsider aware of the current state of a monitored object by transmitting

JP 2005-253025 A

  By the way, since there is a risk of injury or the like when the care recipient who is alone in the living room falls from the bed, for example, when he falls and falls, it is necessary for the caretaker etc. to cope as soon as possible. On the other hand, when the care recipient just gets up from the bed, there is no immediate danger of injury, etc., so immediate care by carers etc. is often unnecessary. Also, the condition that needs to be dealt with as quickly as possible differs depending on the care recipient.

  However, according to the technology disclosed in Patent Document 1, when the sensor senses the motion of the care recipient, the care worker or the like has to confirm all the images in order to immediately transmit the image to the outside. When a single care worker is in charge of a large number of care recipients, for example, if confirmation is performed in the order in which the image data is received, there is a risk that the care recipient who should be dealt with as soon as possible may be delayed. is there.

  In addition, the transmission of a large amount of image data through the Internet increases the amount of data communication, causing congestion in the Internet, which may further delay the treatment of the care recipient who should be dealt with as soon as possible. is there. In addition, in order to respect the privacy of the care recipient, there is also a demand that transmission of image data of the care recipient should be minimized unless necessary.

The present invention has been made in view of the above circumstances, and an object thereof to provide e.g. while reducing the burden of caregivers such as also the care support system and nursing care how it is possible to watch the proper subject .

A care support system reflecting one aspect of the present invention in order to realize at least one of the above-mentioned objects is a sensor device for acquiring image data of a subject, and information for specifying the subject A sensor device that transmits a notification signal including
A storage device for storing image data of the subject;
A management server connected communicably to the sensor device and receiving the notification signal transmitted from the sensor device;
A terminal communicably connected to the management server;
The management server receives and receives, from the sensor device, information on the condition of the subject indicating one of a plurality of types of the condition of the subject determined by the sensor device based on the image data. Based on the information on the state of the subject, the subject is identified when the subject's state corresponds to a predetermined state set in advance in association with the information for identifying the subject. An event signal indicating the predetermined state in association with the information for specifying the target person, to the terminal set in advance in association with the information for the purpose;
The terminal acquires, from the storage device, image data of the subject associated with the received event signal.

  According to the present invention, it is possible to provide a care support system capable of appropriately watching a target person while reducing the burden of, for example, a caregiver.

BRIEF DESCRIPTION OF THE DRAWINGS It is a figure which shows the whole structure of the care support system in this embodiment. It is a figure showing composition of a sensor box in a care support system of this embodiment. It is a figure which shows the structure of the management server in the care support system of this embodiment. It is a figure which shows the structure of the portable terminal in the care support system of this embodiment. It is a figure which shows the structure of the transmission destination information table in the care support system of this embodiment. It is a forceps chart figure showing operation in a care support system of this embodiment. It is a ladder chart figure which shows another operation | movement in the care support system of this embodiment. It is a figure which shows the example of the display screen of the portable terminal of this embodiment. It is a figure which shows the example of the display screen of the portable terminal concerning a modification. It is a figure which shows the example of the display screen of the portable terminal concerning another modification.

  Hereinafter, embodiments according to the present invention will be described based on the drawings. FIG. 1 is a diagram showing an entire configuration of a care support system in the present embodiment. FIG. 2 is a diagram showing a configuration of a sensor box in the care support system of the present embodiment. FIG. 3 is a diagram showing a configuration of a management server in the care support system of the present embodiment. FIG. 4 is a diagram showing the configuration of the portable terminal in the care support system of the present embodiment. FIG. 5 is a diagram showing the configuration of a transmission destination information table in the care support system of the present embodiment. In the present specification, “care” is a concept including “nursing”.

  The care support system according to the present embodiment supports care by monitoring the target person Ob by detecting the state of the monitored person (hereinafter referred to as the target person) Ob who is the target of watching using the corresponding sensor box SB. It has a function.

  Such a care support system MS is, for example, as shown in FIG. 1, a sensor box SB (SB-1 to SB-4) respectively provided in a room of a target person, a management server SV, and a fixed terminal apparatus SP. And mobile terminals TA (TA-1 and TA-2) managed by carers, respectively, which are wired or wireless, and networks such as LAN (Local Area Network), telephone network and data communication network ( It is communicably connected via a network (communication line) NW. The network NW may be equipped with relays such as repeaters, bridges, routers, and cross connects that relay communication signals. In the example shown in FIG. 1, the plurality of sensor boxes SB-1 to SB-4, the management server SV, the fixed terminal apparatus SP, and the plurality of portable terminals TA-1 and TA-2 are wireless LANs including the access point AP ( For example, they are communicably connected to each other by a LAN or the like according to the IEEE 802.11 standard. The sensor box SB corresponds to an example of a sensor device, and each of the fixed terminal device SP and the portable terminal TA corresponds to an example of a terminal.

  The target person Ob is, for example, a person who needs nursing due to illness or injury, a person who needs care due to a decrease in physical ability or the like, or a single person living alone. In particular, from the viewpoint of enabling early detection and coping, it is preferable that the subject Ob be a person who needs the detection when a predetermined adverse event such as an abnormal condition occurs in the person. . For this reason, the care support system MS is suitably disposed in a building such as a hospital, a welfare institution for the elderly, and a dwelling unit, according to the type of the target person Ob. In the example illustrated in FIG. 1, the care support system MS is disposed in a building of a care facility including a plurality of rooms RM including a plurality of target persons Ob and a plurality of rooms such as a nurse station ST.

  First, the sensor box SB will be described. The sensor box SB is disposed on the ceiling or wall of the room RM of the target person Ob and has a communication function of communicating with the management server SV or the like via the network NW. More specifically, as shown in FIG. 2, the sensor box SB includes a sensor unit 11, an SB sound input / output unit 12, a nurse call input unit 13, an SB control processing unit 14, and an SB communication IF unit 15. , SB storage unit 16.

  The sensor unit 11 is a device that is connected to the SB control processing unit 14 and detects the state of the target person Ob according to the control of the SB control processing unit 14 and outputs corresponding state data. In the present embodiment, the state of the object person Ob includes getting up, leaving, falling, falling, falling, and movement abnormality of the object person Ob, and the sensor unit 11 detects, for example, the Doppler sensor 111 and the like. , Camera 112.

  The Doppler sensor 111 is a body movement sensor that transmits a transmission wave, receives a reflection wave of the transmission wave reflected by an object, and outputs a Doppler signal of a Doppler frequency component based on the transmission wave and the reflection wave. . When the object is moving, the frequency of the reflected wave is shifted in proportion to the moving velocity of the object by the so-called Doppler effect, so the difference between the frequency of the transmission wave and the frequency of the reflected wave (Doppler frequency component) It occurs. The Doppler sensor 111 generates a signal of the Doppler frequency component as a Doppler signal and outputs the signal to the SB control processing unit 14. The transmission wave may be an ultrasonic wave, a microwave or the like, but in the present embodiment, it is a microwave. The microwave can be transmitted through the clothes and reflected by the body surface of the subject Ob, so that the movement of the body surface can be detected even if the subject Ob wears clothes, which is preferable.

  The camera 112 is a device that is connected to the SB control processing unit 14 and generates an image (image data) under the control of the SB control processing unit 14. The camera 112 is arranged to be able to monitor a space where the target person Ob to be monitored is planning to be located (a space in the room RM in the example shown in FIG. 1), and images the space as an imaging target from above An image (image data) obtained by looking over the imaging target is generated, and the image of the imaging target is output to the SB control processing unit 14. Preferably, the camera 112 is set in advance so that the head of the subject Ob will be located in the bedding (for example, bed etc.) on which the subject Ob lays, since it is highly probable that the entire subject Ob can be imaged. It arrange | positions so that an imaging target can be imaged from the just overhead of the head predetermined position (usually the arrangement | positioning position of a pillow). The sensor box SB acquires an image of the subject Ob captured from above the subject Ob, preferably an image captured from directly above the planned head position, by the camera 112 of the sensor unit 11.

  Such a camera 112 may be a device that generates an image of visible light, but has a function of generating an infrared image in this embodiment so that the subject Ob can be monitored even in relatively dark conditions. Such a camera 112 is disposed, for example, in the present embodiment, an imaging optical system for forming an infrared optical image of an imaging object on a predetermined imaging surface, and a light receiving surface is made to coincide with the imaging surface. An image sensor that converts an infrared optical image of the imaging target into an electrical signal, and image data processing representing an infrared image of the imaging target by performing image processing on an output of the image sensor It is a digital infrared camera provided with an image processing unit and the like to be generated. In the present embodiment, the imaging optical system of the camera 112 is preferably a wide-angle optical system (a so-called wide-angle lens (including a fisheye lens)) having an angle of view capable of imaging the entire living room RM of the object person Ob. In addition, an infrared illumination device may be further provided to illuminate the space with infrared radiation.

  The SB sound input / output unit 12 is a circuit connected to the SB control processing unit 14 for acquiring an external sound and inputting it to the sensor box SB, and an electric signal representing the sound according to the control of the SB control processing unit 14 It generates and outputs sounds according to. The SB sound input / output unit 12 includes, for example, a microphone that converts acoustic vibration of sound into an electrical signal, and a speaker that converts the electrical signal of sound into acoustic vibration of sound. The SB sound input / output unit 12 outputs an electrical signal representing an external sound to the SB control processing unit 14, and converts the electrical signal input from the SB control processing unit 14 into acoustic vibration of sound and outputs it. Preferably, the SB sound input / output unit 12 can be separated from the sensor box SB main body, connected to the SB control processing unit 14 wirelessly or by wire, and placed at an arbitrary place in the living room. Furthermore, when the SB sound input / output unit 12 is wirelessly connected to the SB control processing unit 14, it is preferable to provide a device for monitoring the remaining amount of battery in the SB sound input / output unit 12 and notifying the operator or the like. When the SB sound input / output unit 12 is connected to the SB control processing unit 14 by wire, it is preferable to provide a device for informing the operator whether or not an appropriate connection is made.

  The nurse call input unit 13 is a push button switch or the like connected to the SB control processing unit 14. When the resident wants to make a nurse call, when the nurse call input unit 13 is operated, an electric signal indicating that the nurse call has been received is output from the nurse call input unit 13 to the SB control processing unit 14, thereby performing care A signal is transmitted to a mobile terminal TA of an officer or the like. At this time, it is preferable that the lamp attached to the nurse call input unit 13 is turned on to know that the signal is being transmitted.

  The SB communication IF unit 15 is a communication circuit that is connected to the SB control processing unit 14 and performs communication in accordance with the control of the SB control processing unit 14. The SB communication IF unit 15 generates a communication signal containing the data to be transferred input from the SB control processing unit 14 according to the communication protocol used in the network NW of the care support system MS, and generates the generated communication signal. It transmits to the management server SV etc via the network NW. Also, the SB communication IF unit 15 receives a communication signal from the management server SV or the like via the network NW, extracts data from the received communication signal, and the format in which the SB control processing unit 14 can process the extracted data Data to the SB control processing unit 14. The SB communication IF unit 15 further uses, for example, a standard such as a cellular phone communication network, WiFi standard, Bluetooth (registered trademark) standard, IrDA (Infrared Data Association) standard, USB (Universal Serial Bus) standard, etc. An interface circuit may be provided to input and output data with the device.

  The SB storage unit 16 is a circuit that is connected to the SB control processing unit 14 and stores various programs and various data under the control of the SB control processing unit 14. The various programs include, for example, a control processing program such as a monitoring processing program that executes information processing related to monitoring of the target person Ob. The monitoring processing program includes a notification processing program for notifying the outside when a predetermined event (event) occurs, an image (moving image) captured by the camera 112, the fixed terminal apparatus SP or the portable terminal TA that has requested the image. And a nurse call processing program for voice communication with the fixed terminal apparatus SP or the portable terminal TA by using the SB sound input / output unit 12 or the like. The various types of data include data of moving images captured by the camera 112, status data such as micromotion data acquired by the Doppler sensor 111, data necessary for executing each program, and the target person Ob. It includes data necessary for monitoring. The SB storage unit 16 includes, for example, a ROM (Read Only Memory), which is a nonvolatile storage element, and an EEPROM (Electrically Erasable Programmable Read Only Memory), which is a rewritable nonvolatile storage element. The SB storage unit 16 includes, for example, a random access memory (RAM) serving as a working memory of a so-called SB control processing unit 14 which stores data and the like generated during the execution of the program.

  The SB control processing unit 14 is a circuit for receiving a nurse call, generating a moving image, and detecting a predetermined action set in the object person Ob. The SB control processing unit 14 includes, for example, a central processing unit (CPU) and peripheral circuits thereof. The SB control processing unit 14 executes the control processing program to execute a sensor control unit (SB control unit) 141, an action detection processing unit 142, a notification processing unit 143, a streaming processing unit 144, and a nurse call processing unit 145. Functionally equipped.

  The SB control unit 141 is responsible for overall control of the sensor box SB.

  The action detection processing unit 142 detects a predetermined event set in advance in the target person Ob based on the output of the sensor unit 11. In the present embodiment, as described above, the predetermined event is getting up, leaving, falling, falling, falling, or body movement abnormality of the subject Ob, and the action detection processing unit 142 determines whether or not the action detection processing unit 142 outputs an error. The wake-up, bed-fall, fall, fall, fall and micro-kinetic abnormalities in the subject Ob are detected as events, and notified to the notification processing unit 143. The action detection processing unit 142 can separately detect the rising, leaving, falling, falling, and movement abnormality of the subject Ob based on the output of the sensor unit 11. For example, the action detection processing unit 142 extracts a moving body area as a human body area of the object person Ob from the image acquired by the camera 112 of the sensor unit 11, and the posture of the object person Ob (for example, standing) from the aspect ratio of the extracted moving body area. Position, sitting position, lying position, etc.), detect the position of the detected moving body area, and judge the distinction between the rising, leaving, falling and falling based on the judgment and the posture and position of the detected subject Ob. . When the behavior detection processing unit 142 detects the transition from the lying posture to the sitting posture in the bed area, the behavior detection processing unit 142 determines that the user is getting up and determines that a rising event (upset event) has occurred. Furthermore, when detecting a shift from a sitting posture to a standing posture from inside the bed area to outside the bed area, the behavior detection processing unit 142 determines that the bed has left, and determines that an event of bed departure (land leaving event) has occurred. In addition, when the behavior detection processing unit 142 detects a lying posture outside the bed area, which is a transition from inside the bed area to outside the bed area, the action detection processing unit 142 determines that a fall has occurred and that a fall event (fall event) occurs. to decide. Further, for example, when detecting a shift from the sitting posture or the standing posture to the lying posture outside the bed area, the behavior detection processing unit 142 determines that a fall occurs, and determines that a fall event (fall event) has occurred. In addition, the behavior detection processing unit 142 detects body movement of the chest (up and down movement of the chest) accompanying the breathing operation of the subject Ob by the Doppler sensor 111 of the sensor unit 11, and the disturbance of the cycle in the body movement of the chest or When the amplitude in the body motion of the chest which is equal to or less than the set threshold is detected, it is determined that the micro movement is abnormal, and it is determined that an event of micro movement abnormality (micro movement abnormality event) occurs. The action detection processing unit 142 has a function of making a determination based on the stored daily activities of the subject, and when taking an action different from the stored normal action, or taking an action due to the stored dementia or the like For example, it may be determined that an abnormal event has occurred, for example, and may be notified to the portable terminal TA as described later. In addition, it is preferable that the judgment criteria (judgment algorithm) of the action detection processing unit 142 be unified in all the sensor boxes SB. As a result, even if the resident changes, there is no need to change the judgment criteria, and it takes less time. However, the judgment criteria of the behavior detection processing unit 142 may be customized for each sensor box SB.

  When the nurse call input unit 13 receives an input operation, the nurse call processing unit 145 notifies the notification processing unit 143 of an event, more specifically, an operation of a nurse call (nurse call event). The nurse call processing unit 145 enables voice communication with the fixed terminal apparatus SP or the portable terminal TA via the SB communication IF unit 15 and the network NW.

  The notification processing unit 143 detects a nurse call event by the nurse call input unit 13 and a predetermined event in which the sensor unit 11 detects a predetermined action on the target person Ob (in the present embodiment, each event of getting up, leaving, falling, falling) ) Is notified to the outside when it occurs in the sensor box SB. More specifically, the notification processing unit 143 identifies information indicating the type of event that has occurred (in this embodiment, a nurse call event, or a predetermined detection event (rising, leaving, falling, falling, falling body movement abnormality, A notification signal including information, that is, information which classifies a predetermined state and indicates the type thereof, and identifier information for specifying and identifying the sensor box SB detecting the target person Ob is generated, and SB communication is performed. Transmitted from the IF unit 15 to the management server SV via the network NW If there is a request from outside (transmission of a status data request signal), the notification processing unit 143 is a communication signal containing status data such as image data. Are generated and transmitted from the SB communication IF unit 15 to the management server SV via the network NW.

  Although not used in the operation of the ladder chart described later, the streaming processing unit 144 requests distribution of a streaming moving image from the fixed terminal apparatus SP or the portable terminal TA via the network NW and the SB communication IF unit 15. Distributing a moving image (for example, a live moving image) generated by the camera 112 of the sensor unit 11 to the fixed terminal apparatus SP or the portable terminal TA which has made the request via the SB communication IF unit 15 and the network NW by streaming reproduction It is.

  In FIG. 1, four first to fourth sensor boxes SB-1 to SB-4 are shown as an example, and the first sensor box SB-1 is a Mr. Ob who is one of the subjects Ob. The second sensor box SB-2 is disposed in the living room RM-1 of -1 and the second sensor box SB-2 is disposed in the living room RM-2 of Mr. B's Ob-2, who is one of the target persons Ob, and the third sensor box SB-3. Is disposed in the room RM-3 of Mr. C Ob-3, who is one of the subject Ob, and the fourth sensor box SB-4 is a room RM of Mr. Ob-4, who is one of the subject Ob. -4 are arranged.

  In such a sensor box SB, when its operation is started, the sensor unit 11 outputs an image and a Doppler signal generated by imaging the location space from above at a predetermined frame rate to the SB control processing unit 14. The action detection processing unit 142 of the SB control processing unit 14 detects the presence or absence of a predetermined action in the subject Ob based on the image and the Doppler signal at predetermined time intervals and detects the predetermined action as a detection event. The notification processing unit 143 is notified of the detection event including the type of the detection event. When the notification processing unit 143 receives the notification of the detection event, the notification processing unit 143 transmits a notification signal from the SB communication IF unit 15 to the management server SV.

  Although not used in the operation of the ladder chart described later, when the nurse call input unit 13 receives an input operation, the nurse call processing unit 145 notifies the notification processing unit 143 of a nurse call acceptance event. When receiving the notification of the acceptance event, the notification processing unit 143 transmits a notification signal from the SB communication IF unit 15 to the management server SV. The management server SV notifies the portable terminal TA of the caretaker in charge of the room where the nurse call has occurred that the nurse call has occurred.

  Next, the management server SV will be described. In FIG. 1, the management server SV has a communication function of communicating independently with other sensor boxes SB, fixed terminals SP, and portable terminals TA via the network NW. The management server SV has a function of receiving information from the sensor box SB and providing information to the portable terminal TA and / or the fixed terminal SP held by a carer in charge of the room where the event has occurred. Such a management server SV includes, for example, an SV control processing unit 21, an SV storage unit 22, and an SV communication IF unit 23, as shown in FIG.

  The SV communication IF unit 23 is a communication device that is connected to the SV control processing unit 21 and performs communication according to the control of the SV control processing unit 21 as the SB communication IF unit 15 does. The SV communication IF unit 23 generates a communication signal containing the data to be transferred input from the SV control processing unit 21 according to the communication protocol used in the network NW of the care support system MS, and generates the generated communication signal. It transmits to sensor box SB etc. via the network NW. The SV communication IF unit 23 receives a communication signal from the sensor box SB or the like via the network NW, extracts data from the received communication signal, and data in a format that can be processed by the SV control processing unit 21. To the SV control processing unit 21.

  The SV storage unit 22 is a circuit that is connected to the SV control processing unit 21 and stores various programs and various data under the control of the SV control processing unit 21. The various programs include, for example, a control processing program such as a server program which provides data to the client according to the request of the client (in the present embodiment, the fixed terminal SP and the portable terminal TA and the like). The various types of data are necessary for monitoring data required to execute each program described above, such as monitoring information on monitoring of the target person Ob and notification destination information on the notification destination of the event, and the target person Ob. Data etc. are included. Similar to the SB storage unit 16, the SV storage unit 22 includes, for example, a ROM, an EEPROM, or the like. The SV storage unit 22 includes, for example, a RAM serving as a working memory of a so-called SV control processing unit 21 which stores data and the like generated during execution of the predetermined program.

  The SV storage unit 22 includes a notification destination information storage unit 221 that stores notification destination information. The notification destination information storage unit 221 stores notification destination information on a notification destination of an event. The notification destination information is information representing a notification destination that notifies an event contained in the received notification signal when the notification signal is received from the sensor box SB. The notification destination information is, for example, information representing the correspondence between the sensor box SB of the transmission source that has transmitted the notification signal and the portable terminal TA that transmits the notification signal received from the sensor box SB, in the present embodiment, For example, as shown in FIG. 5, it is stored in the notification destination information storage unit 221 in a table format. The notification destination information table 41 shown in FIG. 5 includes the notification source address field 411 for registering the communication address of the sensor box SB which is the transmission source of the notification signal, and the notification event information when the target person is in this state. The event contained in the notification signal received from the sensor box SB having the communication address associated with the communication address of the sensor box SB registered in the notification event field 412 to notify and the notification source address field 411 is notified And a notification destination address field 413 for registering the communication address of the portable terminal TA, and each sensor box SB has a record. The communication address of the sensor box SB may be the sensor ID, and the notification source address field 411 does not have to be necessarily provided, but if provided, the room number in which the sensor box SB is provided is registered. Also good. In addition, the communication address of the portable terminal TA may be a terminal identifier (terminal ID) for identifying and identifying the portable terminal TA, and the notification destination address field 413 may have, for example, a carer name having the portable terminal TA. The names of observers such as may be registered. The item (notification event information) of the notification event in the notification event field 412 can be set from the management server SV side according to the target person OB of the room where the sensor box SB is installed. In the example of FIG. 5, in the case of Mr. A and Mr. B, it should be notified when a fall or fall event occurs, and in the case of Mr. C, it should be notified when a fall, fall, or wake event occurs. In the case of Mr. D, it means that notification should be given when falling, falling, getting up, leaving the bed occur. For example, the condition of the target person (there is almost no problem after getting up, there are people who can decide that the response is unnecessary, there are those who do not), past correspondence information (the bed break and enter the bed several times in the past) Therefore, it is desirable to divide the notification event according to the target person, for example, because there is a person who can determine that the action is not necessary after leaving the bed once.

  The SV control processing unit 21 is a circuit that receives a notification from the sensor box SB and transfers the received notification to each of the fixed terminal device SP and the corresponding portable terminal TA. The SV control processing unit 21 includes, for example, a CPU (Central Processing Unit) and its peripheral circuits.

  The SV control unit 211 of the SV control processing unit 21 is responsible for overall control of the management server SV.

  The management server SV is further connected to the SV control processing unit 21 as required, as shown by a broken line in FIG. 3, and is, for example, a server input unit (SV input unit) 24 for inputting various commands and data. A server output unit (SV output unit) 25 that outputs various commands and various data input from the SV input unit 24 and information related to monitoring of the target person Ob, and a server that inputs / outputs data to / from external devices An interface unit (SVIF unit) 26 or the like may be provided. Such a management server SV can be configured, for example, by a computer with a communication function.

  The fixed terminal device SP is installed at the nurse station ST, and has a communication function for communicating with the management server SV or the like via the network NW, a display function for displaying predetermined information, and an input for inputting predetermined instructions and data. The user interface of the care support system MS by providing functions and the like, inputting predetermined instructions and data to be given to the management server SV and the portable terminal TA, and displaying detection results and images obtained by the sensor box SB. It is a device that functions as (UI). Such fixed terminal apparatus SP can be configured, for example, by a computer with a communication function. It is preferable that the fixed terminal apparatus SP can grasp the state of the living room through the function of the sensor box SB in all the living rooms in which the sensor box SB is installed.

  Next, the mobile terminal TA will be described. The portable terminal TA has a communication function of communicating with the management server SV etc. via the network NW, a display function of displaying predetermined information, an input function of inputting predetermined instructions and data, and a call function of performing voice communication. And inputs predetermined instructions and data to be given to the management server SV and the sensor box SB, receives notification of the predetermined event when the predetermined event occurs in the sensor box SB, and makes a call with the sensor box SB And a device for displaying a moving image generated by the sensor box SB.

  In the present embodiment, for example, as shown in FIG. 4, such a portable terminal TA includes a TA control processing unit 31, a TA storage unit 32, a TA communication IF unit 33, and a TA sound input / output unit 34. A TA input unit 35, a TA display unit 36, and a TAIF unit 37 are provided.

  The TA sound input / output unit 34 is a device connected to the TA control processing unit 31 for acquiring an external sound and inputting it to the portable terminal TA, and an electric signal representing the sound according to the control of the TA control processing unit 31 It generates and outputs sounds according to. Similar to the SB sound input / output unit 12, the TA sound input / output unit 34 includes, for example, a microphone that converts acoustic vibration into an electrical signal, and a speaker that converts an electrical signal of sound into acoustic vibration of sound. Configured The TA sound input / output unit 34 outputs an electric signal representing an external sound to the TA control processing unit 31, and converts the electric signal input from the TA control processing unit 31 into acoustic vibration of sound and outputs it.

  The TA input unit 35 is a device connected to the TA control processing unit 31, for example, a device that receives a predetermined operation and inputs the operation to the portable terminal TA, and is a plurality of input switches or the like to which predetermined functions are assigned. For the predetermined operation, for example, an input operation of an ID for logging in, a response operation corresponding to a notified nurse call, a request operation of a moving image, for example, life saving, nursing, care for the notified subject Ob. And various operations necessary for monitoring, such as an input operation indicating that there is an intention to execute a response such as assistance (restoration). The TA display unit 36, which is an information presentation unit, is connected to the TA control processing unit 31, and according to the control of the TA control processing unit 31, the predetermined operation content input from the TA input unit 35 and the care support system MS. It is a device that displays the monitoring information (for example, an event generated by the sensor box SB, an image of the target person Ob, etc.) related to monitoring of the target person Ob being monitored, and a display device such as an LCD and an organic EL display, for example. . And in this embodiment, TA input part 35 and TA display part 36 are constituted from a touch panel. In this case, the TA input unit 35 is a position input device for detecting and inputting an operation position of, for example, a resistance film method or a capacitance method. In this touch panel, a position input device is provided on the display surface of the TA display unit 36, and one or more input content candidates that can be input are displayed on the TA display unit 36. For example, a user (supervisor) such as a carer However, when the user touches the display position where the input content to be input is displayed, the position is detected by the position input device, and the display content displayed at the detected position is input to the portable terminal TA as the user's operation input content.

  The TAIF unit 37 is a device connected to the TA control processing unit 31 and performing data input / output with an external device according to the control of the TA control processing unit 31. For example, a cellular phone communication network, WiFi standard, Bluetooth An interface circuit using (registered trademark) standards, an interface circuit performing infrared communication such as IrDA standards, an interface circuit using USB standards, and the like.

  The TA communication IF unit 33 is a communication device that is connected to the TA control processing unit 31 and performs communication according to the control of the TA control processing unit 31 as the SB communication IF unit 15 does. The TA communication IF unit 33 generates a communication signal containing the data to be transferred input from the TA control processing unit 31 according to the communication protocol used in the network NW of the care support system MS, and generates the generated communication signal. It transmits to the management server SV etc via the network NW. The TA communication IF unit 33 receives a communication signal from the management server SV or the like via the network NW, extracts data from the received communication signal, and data in a format that can be processed by the TA control processing unit 31. And output to the TA control processing unit 31.

  The TA storage unit 32 is a circuit that is connected to the TA control processing unit 31 and stores various programs and various data according to the control of the TA control processing unit 31 like the SB storage unit 16. The various programs include a display processing program that processes an operation related to display. The various data include each data such as screen information displayed on the TA display unit 36. The TA storage unit 32 includes, for example, a ROM, an EEPROM, and the like. The TA storage unit 32 includes, for example, a RAM serving as a working memory of a so-called TA control processing unit 31 which stores data and the like generated during execution of the predetermined program. The TA storage unit 32 functionally includes a display screen storage unit 321 in order to store the above-described pieces of information.

  The display screen storage unit 321 stores screen information to be displayed on the TA display unit 36 under the control of the display processing unit 3121 described later in the TA control processing unit 31.

  The TA control processing unit 31 is a circuit for processing information. Similar to the SB control processing unit 14, the TA control processing unit 31 is configured to include, for example, a CPU and its peripheral circuits. The TA control processing unit 31 functionally includes a TA control unit 311 and a TA processing unit 312 by executing a control processing program, and the TA processing unit 312 functionally includes a display processing unit 3121.

  The TA control unit 311 is responsible for overall control of the mobile terminal TA.

  The display processing unit 3121 processes an operation related to the display of the TA display unit 36. More specifically, the display processing unit 3121 displays a moving image on the TA display unit 36 as needed.

  Such a portable terminal TA can be configured by, for example, a portable communication terminal device such as a so-called tablet computer, a smartphone, a portable telephone, or the like.

  Next, the operation of the care support system in the embodiment will be described. 6A and 6B are forceps chart diagrams showing the operation in the care support system of the present embodiment. FIG. 7 is a diagram showing an example of a display screen of the portable terminal of the present embodiment.

  In the care support system MS having such a configuration, when activated, the sensor box SB executes the control processing program to cause the SB control processing unit 14 to execute the SB control unit 141, the action detection processing unit 142, and notification processing. Unit 143, streaming processing unit 144 and nurse call processing unit 145 are functionally configured, and in the management server SV, SV control processing unit 21 is functionally configured in SV control processing unit 21 by execution of the control processing program. In the portable terminal TA, the TA control processing unit 31 functionally includes a TA processing unit 312 functionally including a TA control unit 311 and a display processing unit 3121 by execution of the control processing program. .

  Although the operation of the care support system MS will be described, the nurse call event will be omitted. In the mobile terminal TA, for example, when a login operation by a caregiver or the like is received, the mobile terminal TA causes the TA processing unit 312 to display on the TA display unit 36 a standby screen for waiting for a communication signal addressed thereto. For example, as shown in FIG. 7A, this standby screen has a menu bar area 611 for displaying a menu bar, a message indicating that it is in a standby state (for example, “not available notification”), date, and current And a standby main area 612 for displaying a user name (caregiver) who has logged in to the portable terminal TA at time. When such a standby screen is displayed, the portable terminal TA causes the TA control unit 311 to wait for the TA communication IF unit 33 to receive a communication signal.

  In step S101 of FIG. 6A, the sensor box SB samples the output data of the Doppler sensor 111 of the sensor unit 11 at a sampling cycle corresponding to a predetermined frame rate by the SB control unit 141 and acquires image data with the camera 112. The behavior detection processing unit 142 analyzes the sampled and acquired output data of the Doppler sensor 111 and the image data of the camera 112 while storing in a ring buffer (not shown). If it is determined in step S102 that the SB control unit 141 does not detect a predetermined event (wake up, bed fall, fall, fall, body movement abnormality) as a result of this analysis, the flow is returned to step S101 and the detection operation is continued. Do. On the other hand, when the SB control unit 141 detects a predetermined event, the image data and / or micro-motion data before and after the event are extracted from the ring buffer and stored in the SB storage unit 16 in step S103. Note that, for example, the detection operation of the sensor box SB can be interrupted only in the time zone set via the fixed terminal SP. Also, for example, the program in the sensor box SB can be changed via the fixed terminal SP.

  Furthermore, the sensor box SB causes the notification processing unit 143 to transmit, to the management server SV via the network NW, event information indicating which type of notification event has occurred and a communication address (C11). Such a notification signal has a small amount of information because it does not include the image data of the subject.

  When such a notification signal is transmitted from the sensor box SB, the management server SV notifies the information contained in the notification signal in step S104 to the notification destination information table 41 stored in the notification destination information storage unit 221. Then, the resident determines who the resident is (here, Mr. B) from the communication address of the transmission destination corresponding to the sender's communication address, and further to the resident (M) from the event information of the notification signal It is determined whether it corresponds to the type of the corresponding notification event (here, falling or falling). Then, when the event information of the received notification signal indicates a notification event, it is determined to notify the terminal. On the other hand, when the event information of the received notification signal does not indicate the notification event (in the case of Mr. B, getting up or leaving), it is decided not to notify the terminal and the next notification signal is awaited.

  When the management server SV determines notification to the terminal, it collates with the notification destination information table 41 stored in the notification destination information storage unit 221, and from the communication address of the transmission destination corresponding to the communication address of the transmission source, The destination mobile terminal TA is selected. More specifically, in the notification destination information table 41 stored in the notification destination information storage unit 221, notification in a record in which the communication address of the transmission source of the received notification signal is registered in the notification source address field 411. The communication address of the notification destination registered in the destination address field 413 is taken out. For example, when the notification signal from the sensor box SB-2 having the communication address "192.168.10.121" disposed in the room RM-2 is received, the communication address "SEND" of the transmission source of the notification signal is received. Three communication addresses “192.168.10.25”, “192. 192.10.10.121” registered in the notification destination address field 413 in the record in the second line in which “192.168.10.121” is registered. "168.10.26" and "192.168.10.27" are retrieved. In this example, the communication address "192.168.10.25" is a communication address assigned to the portable terminal TA-1 possessed by the caregiver NA, and the communication address "192.168.10.26". Is the communication address assigned to the portable terminal TA-2 possessed by the care giver NB, and the communication address "192.168.10.27" is the portable terminal TA possessed by the care giver NC of the illustration. This is a communication address assigned to 3.

  Then, the management server SV transmits a notification signal (event signal) including information that a fall or fall has occurred in the room RM-2 to the selected portable terminals TA-1 to TA-3 and the fixed terminal SP (C12). .

  When such a notification signal is transmitted from the management server SV, the portable terminal TA causes the TA processing unit 312 to switch the screen display of the TA display unit 36 to that shown in FIG. 7B, for example. At this time, an output such as sound or voice (for example, a voice message such as “fall in the room RM-2”) is performed via the TA sound input / output unit 34 as a presentation unit, or a care Notification of notification signal may be notified.

  In the example shown in FIG. 7B, in the main area 612, the name of the room where the event occurred (room RM-2, that is, information on the sensor box that sent the notification), and the name of the resident of the room (like B) The icon IC1 indicating falling or falling (that is, information indicating that the event signal (notice) has been received) and the time difference (0 minute) between the notification time and the current time are displayed (step S105). At the same time, in the main area 612, buttons B1 (corresponding), B2 (speaking), B3 (view stored video) and B4 (view live video) are displayed.

  Here, when the carer touches the button B3 or B4, the TA input unit 35 of the portable terminal TA responds, and in step S106, the TA control unit 311 determines that an image request has been made, and the TA communication IF unit A request signal (status data request signal) is transmitted to the management server SV via the network NW (C13). Here, the request signal includes a request type (stored video or live video). The management server SV relays the request signal and transmits it to the target sensor box SB. The request signal may be sent directly to the sensor box SB.

  In step S107, the sensor box SB having received the request signal determines the type of request in the request signal. When the carer touches the button B3, a request signal for requesting a stored image is output from the portable terminal TA, so that the sensor box SB that has received the request via the management server SV is requested for a stored image. In step S109, the image data is read from the SB storage unit 16 and transmitted from the SB communication IF unit 15 to the management server SV via the network NW (C14). Alternatively, when the carer touches the button B4, a request signal for requesting a live image is output from the portable terminal TA, so the sensor box SB that has received the request via the management server SV is requested for a live image. In step S108, the live video captured by the camera 112 is encoded and transmitted from the SB communication IF unit 15 to the management server SV via the network NW (C14). Live video may be clipped out of the ring buffer. The management server SV relays the image data and transmits it to the portable terminal TA which has transmitted the request signal. The image data may be sent directly to the mobile terminal TA.

  The portable terminal TA having received the image data switches the screen display of the TA display unit 36 by the TA processing unit 312 to, for example, the one shown in FIG. 7C. In the example shown in FIG. 7 (c) requesting the stored image, the main area 612 displays the image (video) IMG of Mr. B before and after the fall in the room RM-2. The officer can immediately determine whether or not to respond. Also, if it can not be determined just by looking at the image IMG, by touching the button B2, the caregiver can directly talk with Mr. B and the caregiver via the SB sound input / output unit 12 of the sensor box SB, The situation can be accurately determined. Also, when a live video is requested, the image displayed on the mobile terminal TA is the current streaming image. In the above example, the notification signal is transmitted to the portable terminal TA, and / or the notification signal may be transmitted to the fixed terminal SP. Note that the image request can be made arbitrarily regardless of the notification signal.

  In addition, when the carer who saw the icon IC1 displayed in step S105 is in a place near the room RM-2 where the event has occurred, it can rush immediately without looking at the image. Therefore, in such a case, by touching the button B1, information to the effect that the caretaker directly copes with is transmitted to the fixed terminal SP. By touching the button B1, in the other portable terminals TA and / or fixed terminals SP to which the notification signal has been transmitted, the display according to the notification signal is canceled and the display returns to the display of FIG. It is preferable that the caretaker in charge is on display.

  On the other hand, the operation shown in FIG. 6B is preferably performed in parallel with the operation shown in FIG. 6A. Image data stored in the SB storage unit 16 of the sensor box SB should be transferred to the large-capacity SV storage unit 22 of the management server SV before the storage capacity is exceeded. It is desirable to transfer at a time when net traffic is available. More specifically, in step S201 of FIG. 6B, while the management server SV monitors the current traffic volume, it waits until it is determined that the traffic volume is small, for example, at night, and when it is determined that the traffic volume is small (ie, predetermined timing (C21), each sensor box SB is notified of a transfer request (transfer request signal) of the image data. If the remaining capacity of the SB storage unit 16 of the sensor box SB is less than the allowable value, a transfer request signal of image data may be transmitted to the management server SV. When the management server SV responds to this, transfer of image data is immediately performed.

  The sensor box SB receiving the transfer request of the image data from the management server SV reads the image data from the SB storage unit 16 in step S202 and transfers the image data to the management server SV (C22). At the same time, the image data is erased from the SB storage unit 16. In step S203, the management server SV stores the communication record and image data transmitted from the sensor box SB in the SV storage unit 22 as a log file, together with the received date and time. It is preferable that the items recorded as the log file can be set from the fixed terminal SP as needed, and the stored log file can be read from the fixed terminal SP as needed.

  Furthermore, at any timing, the portable terminal TA can access the management server SV to read out the image data of the stored log file. For example, when a caregiver designates Mr. B on the screen shown in FIG. 7B and touches the button B3, the TA input unit 35 of the portable terminal TA responds in step S204, and the network NW is made from the TA communication IF unit. A request signal (status data request signal) including information on Mr. B is transmitted to the management server SV via the management server SV (C23). Then, in step S205. The management server SV searches the log file in the SV storage unit 22 from the information of Mr. B contained in the request signal, reads the image data of Mr. B captured in the past, and transmits it to the portable terminal TA (C24) . The portable terminal TA having received the image data switches the screen display of the TA display unit 36 to, for example, one shown in FIG. 7C by the TA processing unit 312 in step S206. This allows the caregiver to confirm Mr. B's past image.

  According to the present embodiment, the sensor box SB determines that the target person is in the predetermined state based on the image data corresponding to the state of the target person, and transmits the notification signal. Therefore, a large amount of image data is transferred each time You can reduce the amount of communication and avoid network congestion. Furthermore, when the management server SV receives the notification signal from the sensor box SB, it determines whether or not it is a notification event for the target person, and if it is a notification event, it selects the corresponding portable terminal TA to be relevant. A notification signal can be sent. As a result, unnecessary notification signals are prevented from being transmitted to the portable terminal TA, and the burden on the caregiver decreases, and only the portable terminal TA that has received the notification signal generates an event in response to the notification signal. Since not the image of the target person but the room where the event occurred and the resident name and the icon IC1 indicating falling or falling are displayed, the amount of communication is small and the carer does not cause traffic congestion in the net, and the carer can It is possible to know that a notification event has occurred and to take appropriate measures immediately. In addition, when the caretaker is far from the living room, by requesting from the portable terminal TA, it is possible to see the image IMG in the living room when the event occurs, and to grasp the situation of the event quickly and accurately, You can also talk to the subject if necessary. Furthermore, the privacy protection of the subject is achieved by limiting the transfer of the image IMG.

  FIG. 8 is a diagram showing an example of a display screen of a portable terminal according to a modification. In the above embodiment, the sensor box SB determines from the acquired image data that the object person has fallen or fallen, and transmits a notification signal to the management server SV. It is also possible to transmit a notification signal to the management server SV. In such a case, as in the above-described embodiment, the management server SV transmits a notification signal indicating that the micro movement abnormality is present to the selected mobile terminal TA, and the mobile terminal TA that has received the micro movement abnormality You may make it display icon IC2 which shows that there exists. In such a case, the caregiver can request image transfer (or transfer of micromotion data) in the living room by touching the button B3, and the sensor box SB can be requested by the caregiver touching the button B2. The subject and the caregiver can directly communicate with each other through the SB sound input / output unit 12, and the situation can be accurately determined. The analysis of the image taken by the camera and the state of the movement of the body detected by the Doppler sensor may be integrated and used for event judgment.

  FIG. 9 is a view showing an example of a display screen of a portable terminal according to another modification. When the behavior detection processing unit 142 detects that the resident (here, Mr. D) has got up, the management server SV determines that it is a notification event, and transmits a notification signal to the selected portable terminal TA. The icon IC3 is displayed on the TA display unit 36. In addition, when the action detection processing unit 142 detects that the resident (here, Mr. D) has left the floor, the management server SV determines that it is a notification event, and transmits a notification signal to the selected portable terminal TA. Therefore, the icon IC4 is displayed on the TA display unit 36. As a result, the condition of the resident can be monitored without looking at the image in the room, so that traffic congestion on the net can be avoided and privacy can be protected. Also, a carer in charge of Mr. D can view Mr. D's image as needed.

  In addition, for example, when the sensor box SB incorporates a battery and is connected to the network NW via a wireless LAN or the like, each sensor box SB has a function of monitoring the internal battery residual amount and reporting it to the management server SV. It is desirable to have. In such a case, it is desirable that an alarm be issued from the management server SV to the fixed terminal SP or the like when the internal battery residual amount falls below the allowable value.

  The present invention is not limited to the embodiments and modifications described in the specification, and it is understood from the embodiments and technical ideas described in the present specification that including other embodiments and modifications are included. It will be clear to the person skilled in the art. The description and the embodiments of the specification are for the purpose of illustration only, and the scope of the present invention is indicated by the following claims.

11 sensor unit 12 SB sound input / output unit 13 nurse call input unit 14 SB control processing unit 15 SB communication IF unit 16 SB storage unit 21 SV control processing unit 22 SV storage unit 23 SVIF unit 24 SV input unit 31 TA control processing unit 32 TA storage unit 33 TA communication IF unit 34 TA sound input / output unit 35 TA input unit 36 TA display unit 37 TAIF unit 41 notification destination information table 111 Doppler sensor 112 camera 141 SB control unit 142 behavior detection processing unit 143 notification processing unit 144 streaming Processing unit 145 Nurse call processing unit 211 SV control unit 221 Notification destination information storage unit 311 TA control unit 312 TA processing unit 321 Display screen storage unit 411 Notification source address field 412 Notification event field 413 Notification destination address field 611 Menu bar area 612 Main Territory 613 Time area 614 the user name area 3121 display processor AP Access Point B1~B4 button IC1~IC4 icon MS care support system NW network Ob subject RM room SB sensor box SP fixed terminal ST nurse station SV management server TA the mobile terminal

Claims (10)

A sensor device for acquiring image data of a subject, the sensor device transmitting a notification signal including information for specifying the subject,
A storage device for storing image data of the subject;
A management server connected communicably to the sensor device and receiving the notification signal transmitted from the sensor device;
A terminal communicably connected to the management server;
The management server receives and receives, from the sensor device, information on the condition of the subject indicating one of a plurality of types of the condition of the subject determined by the sensor device based on the image data. Based on the information on the state of the subject, the subject is identified when the subject's state corresponds to a predetermined state set in advance in association with the information for identifying the subject. An event signal indicating the predetermined state in association with the information for specifying the target person, to the terminal set in advance in association with the information for the purpose;
The terminal acquires, from the storage device, image data of the subject associated with the received event signal.
Care support system characterized by   The care support system according to claim 1, wherein the information for identifying the subject is identification information for identifying the sensor device.   The management server determines whether or not the state of the subject corresponds to the predetermined state for transmitting an event signal to the terminal among the plurality of states, and corresponds to the predetermined state The care support system according to claim 1 or 2 which transmits said event signal to said terminal, when it judges.   The care support system according to any one of claims 1 to 3, wherein the management server has information on the predetermined state changeable.   The care support system according to any one of claims 1 to 4, wherein the management server is capable of changing information on the terminal associated with the information for specifying the object person.   The care support system according to any one of claims 1 to 5, wherein the storage device is provided in the sensor device. It said storage device, care support system according to claim 1 is provided to the management server.   The sensor device and the management server include the storage device, and in response to the management server transmitting a transfer request signal to the sensor device at a predetermined timing, the sensor device transmits itself to the management server. 6. The image data stored in the storage device of claim 4 is transmitted, and the management server associates the transmitted image data with the information on the sensor device and stores the image data in its own storage device. The care support system described in any of the above.   The sensor device and the terminal have a sound input / output device, and the subject and the operator of the terminal can talk with each other through the sound input / output device. The care support system described in any one. A care support method in a system including a sensor device, a management server, a terminal, and a storage device storing image data,
Acquiring image data of a subject by the sensor device;
Transmitting, from the sensor device, information for specifying the target person to the management server;
Information regarding the condition of the subject, which indicates any of a plurality of types of conditions of the subject determined by the sensor device based on the image data, is received from the sensor device, In the case where the state of the subject corresponds to a predetermined state set in advance in association with the information for specifying the subject based on the information on the state, the information for specifying the subject is Transmitting an event signal indicating the predetermined state from the management server to the terminal in association with information set for specifying the target person to the terminal set in advance;
Acquiring at the terminal the image data of the subject person associated with the transmitted event signal from the storage device;
Care support method characterized by having.

Images