JPWO2017026309A1 - Sensor device and care support system - Google Patents

Abstract

By reducing the amount of network traffic and providing quick notifications regarding events such as care recipients, it is possible to ensure the appropriate response of caregivers, thereby reducing the burden on caregivers, etc. Provide a care support system that can quickly secure Since the sensor box SB itself determines that the subject has fallen or fallen based on the image data according to the state of the subject, for example, compared to the case where the management server SV judges to have fallen or fallen, a large amount of image data is stored. There is no need to transfer, and traffic can be reduced and traffic congestion can be avoided. Further, the ring buffer 16 stores the image data acquired by the camera 112 for a certain period while overwriting, and the SB control processing unit 14 generates a specific event (falling or falling) in the subject Ob based on the image data. If it is determined that a part of the image data stored in the ring buffer 16 is cut out and stored in the temporary save buffer 17, the image data saved in the temporary save buffer 17 can be viewed after the event. It is possible to accurately determine whether a specific event has occurred under circumstances, and to take appropriate measures and prevent recurrence.

Description

  The present invention relates to a sensor device and a care support system suitable for use in a care facility.

  In Japan, the aging population is declining rapidly due to the increase in the average life expectancy of the people and the decline in the birth rate. Along with this, hospitals and welfare facilities for the elderly that accommodate those who need care (care recipients) are increasing, but the labor of nurses and caregivers is chronically sufficient due to harsh working conditions. This is a serious situation. Especially at night and so on, a small number of people need to watch over a large number of care recipients, which increases the burden on the caregiver and the like, which causes further labor shortages.

  In order to reduce the burden on such care workers, there is a need for technology that supports care work. For example, in order to cause a machine to perform a part of work of a caregiver or the like, various techniques for monitoring a nurse who needs care have been developed.

  Patent Document 1 discloses a configuration in which a camera is combined with a nurse call system so that when the patient turns on the nurse call, the patient's image captured by the corresponding camera is displayed on a monitor disposed in the service center. Has been. According to the technique of Patent Document 1, there is convenience in displaying the patient's image on the monitor of the service center, but if the caregiver or the like does not stay in the service center, the image cannot be seen. There is a problem that it is not possible to quickly and appropriately cope with the behavior of the person.

  Patent Document 2 discloses that an image processing technique for discriminating a person's action from an image is applied to, for example, a nurse call system for watching a patient's action. Specifically, this nurse call system can detect a state where the patient has raised his / her upper body and getting out of bed based on an image captured by a camera that has imaged the patient, and can inform a caregiver or the like of this. Is done. However, in the configuration disclosed in Patent Document 2, each camera that captures a patient is connected to a network via a LAN via a HUB. Therefore, if a large amount of image data is transferred via such a network, network congestion will occur. Therefore, it may take time to judge the patient, and the patient's condition may not be judged in real time.

Japanese Patent No. 4989172 JP 2014-90913 A

  Furthermore, for example, when a sudden event such as a fall occurs in the person being watched over, it may be difficult to analyze what caused the fall after the event. On the other hand, like a surveillance camera, it is possible to always record a patient's video on a videotape, but in that case it is necessary to store a large amount of videotape, most of which is unnecessary for event analysis. Therefore, there is a problem in that it is inefficient and wasteful.

  The present invention has been made in view of the above circumstances, and by appropriately notifying caregivers and other events while reducing the amount of network communication, appropriate measures such as caregivers can be secured, thereby An object of the present invention is to provide a sensor device and a care support system that can appropriately watch over a target person and reduce waste while reducing the burden on a mentor or the like.

In order to achieve at least one of the above-described objects, a sensor device reflecting one aspect of the present invention is:
A sensor unit including a data acquisition unit for acquiring state data according to the state of the subject continuously or at predetermined intervals;
A ring buffer unit for storing the state data acquired by the sensor unit for a certain period while overwriting;
A determination unit that determines that the target person is in a predetermined state based on the state data acquired by the sensor unit;
Temporary save buffer unit that cuts out and saves part of the state data stored in the ring buffer unit when the determination unit determines that the target person has entered a specific state of the predetermined state When,
And a communication unit that transmits a notification signal to the outside when the determination unit determines that the subject has entered the predetermined state.

  According to the present invention, by appropriately notifying caregivers and other events by reducing the amount of network traffic, the caregiver and the like can be appropriately handled, thereby reducing the burden on the caregivers and the like. Thus, it is possible to provide a sensor device and a care support system that can appropriately watch the subject and reduce waste.

It is a figure which shows the whole structure of the care support system using the sensor apparatus in this embodiment. It is a figure which shows the structure of the sensor box which is a sensor apparatus of this embodiment. It is a figure which shows the structure of the management server in the care support system of this embodiment. It is a figure which shows the structure of the portable terminal in the care support system of this embodiment. It is a figure which shows the structure of the transmission destination information table in the care support system of this embodiment. It is a ladder chart figure which shows the operation | movement in the care support system of this embodiment. It is a figure which shows the example of the display screen of the portable terminal of this embodiment. It is a schematic diagram of the image data memorize | stored in time series in the ring buffer. It is a figure which shows the structure of the sensor box concerning a modification. It is a figure which shows the structure of the sensor box concerning another modification. It is a figure which shows the structure of the sensor box concerning another modification.

  Hereinafter, embodiments according to the present invention will be described with reference to the drawings. FIG. 1 is a diagram illustrating an overall configuration of a care support system using a sensor device according to the present embodiment. FIG. 2 is a diagram illustrating a configuration of a sensor box that is a sensor device according to the present embodiment. FIG. 3 is a diagram showing the configuration of the management server in the care support system of the present embodiment. FIG. 4 is a diagram illustrating a configuration of the mobile terminal in the care support system of the present embodiment. FIG. 5 is a diagram illustrating a configuration of a transmission destination information table in the care support system of the present embodiment. In this specification, “care” is a concept including “nursing”.

  The care support system according to the present embodiment supports the care by watching the target person Ob by detecting the state of the monitored person (hereinafter referred to as the target person) Ob that is the object of monitoring by the corresponding sensor box SB. It has a function.

  For example, as shown in FIG. 1, such a care support system MS includes a sensor box SB (SB-1 to SB-4), a management server SV, and a fixed terminal device SP that are respectively provided in the subject person's room. And mobile terminals TA (TA-1, TA-2) each possessed by a caregiver, which are wired or wireless, such as a local area network (LAN), a telephone network and a data communication network ( Network, communication line) are communicably connected via NW. The network NW may be provided with relays such as repeaters, bridges, routers, and cross-connects that relay communication signals. In the example illustrated in FIG. 1, the plurality of sensor boxes SB-1 to SB-4, the management server SV, the fixed terminal device SP, and the plurality of portable terminals TA-1 and TA-2 include a wireless LAN ( For example, a LAN conforming to the IEEE 802.11 standard) is connected to be communicable with each other via an NW. The sensor box SB corresponds to an example of a sensor device, and each of the fixed terminal device SP and the mobile terminal TA corresponds to an example of a terminal.

  The target person Ob is, for example, a person who needs nursing due to illness or injury, a person who needs care due to a decrease in physical ability, or a single person living alone. In particular, from the viewpoint of enabling early detection and early action, it is preferable that the subject Ob is a person who needs the detection when some inconvenient event such as an abnormal state occurs in the person. For this reason, the care support system MS is suitably arranged in a building such as a hospital, a welfare facility for the elderly, and a dwelling unit according to the type of the subject Ob. In the example illustrated in FIG. 1, the care support system MS is disposed in a building of a care facility including a plurality of rooms RM in which a plurality of target persons Ob move, and a plurality of rooms such as a nurse station ST.

  First, the sensor box SB will be described. The sensor box SB is disposed on the ceiling or wall of the living room RM of the subject Ob, and has a communication function for communicating with the management server SV or the like via the network NW. More specifically, as shown in FIG. 2, the sensor box SB includes a sensor unit 11, an SB sound input / output unit 12, a nurse call input unit 13, an SB control processing unit (CPU) 14, and an SB communication IF. Unit 15, ring buffer 16, and temporary save buffer 17.

  The sensor unit 11 as a data acquisition unit is a device that is connected to the SB control processing unit 14, detects the state of the subject Ob under the control of the SB control processing unit 14, and outputs corresponding state data. In the present embodiment, the state of the subject Ob is wake-up, getting out of bed, falling, falling, and abnormal movement of the subject Ob, and in order to detect these, the sensor unit 11 is, for example, as a data acquisition unit A Doppler sensor 111 and a camera 112 are provided.

  The Doppler sensor 111 is a body motion sensor that transmits a transmission wave, receives a reflection wave of the transmission wave reflected by an object, and outputs a Doppler frequency component Doppler signal based on the transmission wave and the reflection wave. . When the object is moving, the frequency of the reflected wave shifts in proportion to the moving speed of the object due to the so-called Doppler effect, so there is a difference (Doppler frequency component) between the frequency of the transmitted wave and the frequency of the reflected wave. Arise. The Doppler sensor 111 generates a signal of the Doppler frequency component as a Doppler signal and outputs it to the SB control processing unit 14. The transmission wave may be an ultrasonic wave, a microwave, or the like, but is a microwave in the present embodiment. Since the microwave can be transmitted through the clothing and reflected from the body surface of the subject Ob, it is preferable because the motion of the body surface can be detected even if the subject Ob is wearing clothes.

  The camera 112 is an apparatus that is connected to the SB control processing unit 14 and generates an image (image data) under the control of the SB control processing unit 14. The camera 112 is arranged so as to be able to monitor a space where the subject Ob to be monitored is located (in the example shown in FIG. 1, a space in the room RM), and images the space as an imaging target from above, An image (image data) overlooking the imaging target is generated, and the image of the imaging target is output to the SB control processing unit 14. Preferably, since there is a high probability that the entire subject Ob can be imaged, the camera 112 is set in advance so that the head of the subject Ob is located in the bedding on which the subject Ob is lying (for example, a bed). It is arranged so that the imaging object can be imaged from directly above the planned head position (usually the pillow arrangement position). The sensor box SB uses the camera 112 of the sensor unit 11 to acquire an image of the subject Ob taken from above the subject Ob, preferably an image taken from directly above the planned head position.

  Such a camera 112 may be a device that generates an image of visible light, but has a function of generating an infrared image in the present embodiment so that the subject Ob can be monitored even in a relatively dark place. Such a camera 112 is, for example, in this embodiment, an imaging optical system that forms an infrared optical image of an imaging target on a predetermined imaging surface, and a light receiving surface that is aligned with the imaging surface. An image sensor that converts an infrared optical image in the imaging target into an electrical signal, and image data that is data representing an infrared image in the imaging target by performing image processing on the output of the image sensor. A digital infrared camera including an image processing unit to be generated. In this embodiment, the imaging optical system of the camera 112 is preferably a wide-angle optical system (so-called wide-angle lens (including a fisheye lens)) having an angle of view that can capture the entire room RM of the subject Ob. In addition, an infrared illumination device that illuminates the space with infrared light may be further provided. A three-dimensional sensor such as a TOF sensor or an infrared dot projection method may be used as a data acquisition unit other than the Doppler sensor and camera.

  The SB sound input / output unit 12 is a circuit that is connected to the SB control processing unit 14 to acquire an external sound and input it to the sensor box SB, and represents an electric signal representing the sound according to the control of the SB control processing unit 14 This generates and outputs sound according to the sound. The SB sound input / output unit 12 includes a microphone 121 as a sound collecting unit that converts sound acoustic vibrations into electrical signals, and a speaker 122 as a sound output unit that converts electrical sound signals into sound acoustic vibrations. Composed. The SB sound input / output unit 12 outputs an electric signal representing an external sound collected by the microphone 121 to the SB control processing unit 14, and the electric signal input from the SB control processing unit 14 is output by the speaker 122. Convert to acoustic vibration and output. The SB sound input / output unit 12 can be separated from the sensor box SB main body, and is preferably connected to the SB control processing unit 14 wirelessly or by wire and placed in an arbitrary place in the living room. Furthermore, when the SB sound input / output unit 12 is connected to the SB control processing unit 14 wirelessly, it is preferable to provide a device that monitors the remaining battery capacity in the SB sound input / output unit 12 and notifies the operator or the like. When the SB sound input / output unit 12 is connected to the SB control processing unit 14 by wire, it is preferable to provide a device for notifying an operator or the like whether or not an appropriate connection has been made. In such a case, it is preferable that the number of wirings is one including the power supply.

  The nurse call input unit 13 is a push button switch or the like connected to the SB control processing unit 14. When the resident wants to make a nurse call, when the nurse call input unit 13 is input, an electrical signal indicating that the nurse call has been accepted is output from the nurse call input unit 13 to the SB control processing unit 14, thereby A signal is transmitted to the portable terminal TA such as a craftsman. At this time, it is preferable to know that a signal is being transmitted, for example, by lighting a lamp associated with the nurse call input unit 13. The nurse call input unit 13 is separated from the main body of the sensor box SB and is connected to the SB control processing unit 14 via wireless, but may be wired connection.

  The SB communication IF unit 15 is a communication circuit that is connected to the SB control processing unit 14 and performs communication according to the control of the SB control processing unit 14. The SB communication IF unit 15 generates a communication signal containing the data to be transferred input from the SB control processing unit 14 according to the communication protocol used in the network NW of the care support system MS, and generates the generated communication signal. It is transmitted to the management server SV etc. via the network NW. The SB communication IF unit 15 receives a communication signal from the management server SV or the like via the network NW, extracts data from the received communication signal, and can process the extracted data by the SB control processing unit 14. And output to the SB control processing unit 14. The SB communication IF unit 15 further uses a standard such as a mobile phone communication network, WiFi standard, Bluetooth (registered trademark) standard, IrDA (Infrared Data Association) standard, USB (Universal Serial Bus) standard, etc. An interface circuit for inputting / outputting data to / from the device may be provided.

  The SB control processing unit 14 has a function of receiving a nurse call, generating a moving image, and detecting a predetermined action set in advance in the subject Ob. The SB control processing unit 14 includes, for example, a CPU (Central Processing Unit) and its peripheral circuits.

  The SB control processing unit 14 has an internal memory, and stores various programs and various data in the internal memory. The various programs include, for example, a control processing program such as a monitoring processing program that executes information processing related to monitoring of the subject Ob. The monitoring processing program includes a notification processing program for notifying the outside when a predetermined event (event) occurs, an image (moving image) captured by the camera 112, and the fixed terminal device SP or mobile terminal TA that requested the image. And a nurse call processing program for making a voice call with the fixed terminal device SP and the portable terminal TA by using the SB sound input / output unit 12 and the like. The various data includes data necessary for executing each program, data necessary for monitoring the subject Ob, and the like. The internal memory is, for example, a ROM (Read Only Memory) that is a nonvolatile storage element, an EEPROM (Electrically Erasable Programmable Read Only Memory) that is a rewritable nonvolatile storage element, data generated during the execution of the program, or the like. RAM (Random Access Memory) or the like serving as a working memory of the so-called SB control processing unit 14 for storing the.

  The SB control processing unit 14 can execute sensor control, action detection processing, notification processing, streaming processing, and nurse call processing by executing the control processing program. As a means for realizing the SB control processing unit 14, a dedicated LSI such as FPGA / ASIC may be used in addition to the CPU.

  As the behavior detection process, the SB control processing unit 14 can detect a predetermined event set in advance in the target person Ob based on the output of the sensor unit 11. In the present embodiment, as described above, the predetermined event is the wake-up, getting-off, falling, falling, and abnormal movement of the subject Ob, and the SB control processing unit 14 is based on the output of the sensor unit 11. Detecting a specific event for a subject who needs to be promptly dealt with (such as falling or falling) that detects wake-up, getting-off, falling, falling, falling and abnormal movement of the subject as an event. Is determined to have occurred. It is assumed that a predetermined event is set as a default setting, and a specific event can be set according to the target person Ob from a setting unit (not shown). Based on the output of the sensor unit 11, the SB control processing unit 14 can detect and wake up, leave, fall, fall, and abnormal micromotion of the subject Ob. For example, the SB control processing unit 14 extracts a moving body region as a human body region of the subject Ob from the image acquired by the camera 112 of the sensor unit 11, and the posture (for example, standing) of the subject Ob from the aspect ratio of the extracted moving body region. Position, sitting position, lying position, etc.), and detecting the position of the detected moving body region, and determining whether to wake up, get out of bed, fall, and fall based on these determinations and the detected posture and position of the subject Ob. . Further, the SB control processing unit 14 determines that a wake-up event (wake-up event) has occurred when a transition from a lying position to a sitting position is detected in the bed area. Further, when detecting the transition from the sitting position to the standing position from the bed area to the outside of the bed area, the SB control processing unit 14 determines that the person is getting out of bed and determines that an event of getting out of bed (leaving event) has occurred. In addition, when the SB control processing unit 14 detects a recumbent posture outside the bed area from the inside of the bed area, the SB control processing unit 14 determines that it has fallen, and that a fall event (falling event) has occurred. to decide. In addition, for example, when detecting the transition from the sitting posture or the standing posture to the lying posture outside the bed area, the SB control processing unit 14 determines that the vehicle has fallen and determines that a fall event (fall event) has occurred. In addition, the SB control processing unit 14 detects chest movements (up and down movements of the chest) accompanying the breathing motion of the subject Ob by the Doppler sensor 111 of the sensor unit 11, and the period fluctuations in the body movements of the chests or in advance When the amplitude in the body movement of the chest that is equal to or less than a set threshold is detected, it is determined that the minute movement abnormality is present, and it is determined that a minute movement abnormality event (fine movement abnormality event) has occurred. In addition, it is preferable that the judgment standard (judgment algorithm) of the SB control processing unit 14 is unified in all the sensor boxes SB. Thereby, even if a resident changes, it becomes unnecessary to change a judgment standard, and it does not take time and effort. However, the determination criteria of the SB control processing unit 14 may be customized for each sensor box SB.

  The SB control processing unit 14 has a function of determining that an event, more specifically, a nurse call operation (nurse call event) has occurred when an input operation is received by the nurse call input unit 13 as nurse call processing. . The SB control processing unit 14 can make a voice call with the fixed terminal device SP or the portable terminal TA via the SB communication IF unit 15 and the network NW.

  As the notification process, the SB control processing unit 14 detects a detection event (in this embodiment, each event of getting up, getting out of bed, falling down, falling down, abnormal movement of the minute body) when the sensor unit 11 detects a predetermined action in the target person Ob. When it occurs in the sensor box SB, it notifies the outside. More specifically, the SB control processing unit 14 stores information indicating the type of event that has occurred (in this embodiment, a detection event as a wake-up, a get-off, a fall, a fall, a minute movement abnormality) and the target object Ob. A notification signal including identifier information for identifying and identifying the detected sensor box SB is generated and transmitted from the SB communication IF unit 15 to the management server SV via the network NW. If there is a request from the outside, the notification processing unit 143 generates a communication signal containing image data and the like, and transmits the communication signal from the SB communication IF unit 15 to the management server SV via the network NW.

  Although not used in the operation of a ladder chart described later, the SB control processing unit 14 requests streaming video distribution from the fixed terminal device SP or the portable terminal TA via the network NW and the SB communication IF unit 15 as streaming processing. In the case where the SB communication IF unit 15 and the network NW are generated by streaming reproduction of a moving image (for example, a live moving image) generated by the camera 112 of the sensor unit 11 to the fixed terminal device SP or the portable terminal TA that has requested this. Can be delivered via.

  The ring buffer 16 has a function of storing state data acquired continuously or at predetermined intervals, such as image data captured by the camera 112 and microscopic motion data acquired by the Doppler sensor 111, over a predetermined period. The temporary save buffer 17 has a function of cutting out and saving a part of the state data stored in the ring buffer 16.

  In FIG. 1, four first to fourth sensor boxes SB-1 to SB-4 are shown as an example, and the first sensor box SB-1 is one of the subjects Ob, Mr. Ob. The second sensor box SB-2 is arranged in the room RM-2 of Mr. Ob-2 who is one of the subject Ob and the third sensor box SB-3. Is arranged in the room RM-3 of Mr. C Ob-3 who is one of the subject Ob, and the fourth sensor box SB-4 is the room RM of Mr. D Ob-4 who is one of the subject Ob. -4.

  In such a sensor box SB, when the operation starts, the sensor unit 11 outputs an image generated by imaging the location space from above at a predetermined frame rate and a Doppler signal to the SB control processing unit 14. The SB control processing unit 14 detects the presence / absence of a predetermined action in the subject Ob based on these images and Doppler signals at predetermined time intervals. When the predetermined action is detected as a detection event, the type of the detection event The notification signal corresponding to the detection event is created, and the notification signal is transmitted from the SB communication IF unit 15 to the management server SV.

  Although not used in the operation of a ladder chart, which will be described later, when the SB control processing unit 14 receives an input operation at the nurse call input unit 13, the SB control processing unit 14 creates a notification signal corresponding to the reception event of the nurse call. It is transmitted from the SB communication IF unit 15 to the management server SV. The management server SV notifies the mobile terminal TA of the caregiver in charge of the room where the nurse call has occurred that the nurse call has occurred.

  Next, the management server SV will be described. In FIG. 1, the management server SV has a communication function for communicating independently with another sensor box SB, a fixed terminal SP, and a mobile terminal TA via a network NW. The management server SV has a function of receiving information from the sensor box SB and providing information to the mobile terminal TA and / or the fixed terminal device SP of the caregiver in charge of the room where the event has occurred. Such a management server SV includes, for example, an SV control processing unit 21, an SV storage unit 22, and an SV communication IF unit 23 as shown in FIG.

  Similarly to the SB communication IF unit 15, the SV communication IF unit 23 is a communication device that is connected to the SV control processing unit 21 and performs communication according to the control of the SV control processing unit 21. The SV communication IF unit 23 generates a communication signal containing the data to be transferred input from the SV control processing unit 21 according to the communication protocol used in the network NW of the care support system MS, and generates the generated communication signal. It transmits to the sensor box SB etc. via the network NW. The SV communication IF unit 23 receives a communication signal from the sensor box SB or the like via the network NW, extracts data from the received communication signal, and has a format in which the SV control processing unit 21 can process the extracted data. And output to the SV control processing unit 21.

  The SV storage unit 22 is a circuit that is connected to the SV control processing unit 21 and stores various programs and various data according to the control of the SV control processing unit 21. The various programs include, for example, a control processing program such as a server program that provides data to the client in response to a request from a client (in this embodiment, the fixed terminal device SP and the portable terminal TA). The various types of data include data necessary for executing each program described above, such as monitoring information related to monitoring of the target person Ob and notification destination information related to the event notification destination, and necessary for monitoring the target person Ob. Data. Similar to the SB storage unit 16, the SV storage unit 22 includes, for example, a ROM, an EEPROM, and the like. The SV storage unit 22 includes a RAM serving as a working memory for the so-called SV control processing unit 21 that stores data generated during execution of the predetermined program.

  The SV storage unit 22 includes a notification destination information storage unit 221 that stores notification destination information. The notification destination information storage unit 221 stores notification destination information related to an event notification destination. When the notification signal is received from the sensor box SB, the notification destination information is information representing a notification destination that notifies the event accommodated in the received notification signal. In the present embodiment, for example, the notification destination information is information indicating a correspondence relationship between the sensor box SB that has transmitted the notification signal and the mobile terminal TA that transmits the notification signal received from the sensor box SB. For example, as shown in FIG. 5, it is stored in the notification destination information storage unit 221 in a table format. The notification destination information table 41 shown in FIG. 5 includes a notification source address field 411 for registering the communication address of the sensor box SB that is the transmission source of the notification signal, and the communication of the sensor box SB registered in the notification source address field 411. A notification destination address field 412 for registering the communication address of the portable terminal TA that notifies the event contained in the notification signal received from the sensor box SB having the communication address associated with the address, and for each sensor box SB Have a record. The communication address of the sensor box SB may be the sensor ID, and the notification source address field 411 may register a room number in which the sensor box SB is disposed. The communication address of the mobile terminal TA may be a terminal identifier (terminal ID) for identifying and identifying the mobile terminal TA, and the notification destination address field 412 has, for example, the name of a caregiver who has the mobile terminal TA. The name of a monitor such as may be registered.

  The SV control processing unit 21 is a circuit that receives a notification from the sensor box SB and transfers the received notification to the fixed terminal device SP and the corresponding mobile terminal TA. The SV control processing unit 21 includes, for example, a CPU (Central Processing Unit) and its peripheral circuits.

  The SV control unit 211 of the SV control processing unit 21 is responsible for overall control of the management server SV.

  The management server SV is connected to the SV control processing unit 21 as necessary, as indicated by a broken line in FIG. 3, for example, a server input unit (SV input unit) 24 for inputting various commands, various data, and the like. A server output unit (SV output unit) 25 for outputting various commands and various data input by the SV input unit 24 and information related to monitoring of the subject Ob, and a server for inputting / outputting data to / from an external device An interface unit (SVIF unit) 26 and the like may be provided. Such a management server SV can be configured by a computer with a communication function, for example.

  The fixed terminal device SP is installed in the nurse station ST and has a communication function for communicating with the management server SV and the like via the network NW, a display function for displaying predetermined information, and an input for inputting predetermined instructions and data. The user interface of the care support system MS is provided with functions and the like, by inputting predetermined instructions and data to be given to the management server SV and the portable terminal TA, and displaying detection results and images obtained by the sensor box SB. It is a device that functions as (UI). Such a fixed terminal device SP can be configured by, for example, a computer with a communication function. It is preferable that the fixed terminal device SP can grasp the state of the room through the function of the sensor box SB in all the rooms in which the sensor box SB is installed.

  Next, the mobile terminal TA will be described. The portable terminal TA has a communication function for communicating with the management server SV and the like via the network NW, a display function for displaying predetermined information, an input function for inputting predetermined instructions and data, a call function for performing a voice call, and the like. A predetermined instruction or data to be given to the management server SV or the sensor box SB is input, and when the predetermined event occurs in the sensor box SB, the notification of the predetermined event is received and a call is made with the sensor box SB. And a device for displaying a moving image generated by the sensor box SB.

  In the present embodiment, for example, as shown in FIG. 4, such a portable terminal TA includes a TA control processing unit 31, a TA storage unit 32, a TA communication IF unit 33, a TA sound input / output unit 34, A TA input unit 35, a TA display unit 36, and a TAIF unit 37 are provided.

  The TA sound input / output unit 34 is a device connected to the TA control processing unit 31 for acquiring external sound and inputting it to the mobile terminal TA. The TA sound input / output unit 34 represents an electric signal representing the sound according to the control of the TA control processing unit 31. This generates and outputs sound according to the sound. Similar to the SB sound input / output unit 12, the TA sound input / output unit 34 includes, for example, a microphone or the like that converts acoustic vibration into an electric signal, and a speaker or the like that converts an electric signal of sound into an acoustic vibration of sound. Composed. The TA sound input / output unit 34 outputs an electrical signal representing an external sound to the TA control processing unit 31, and converts the electrical signal input from the TA control processing unit 31 into sound acoustic vibration and outputs the sound.

  The TA input unit 35 is connected to the TA control processing unit 31, and is a device that accepts a predetermined operation and inputs it to the mobile terminal TA, and includes a plurality of input switches assigned a predetermined function. Examples of the predetermined operation include an ID input operation for logging in, a response operation corresponding to the notified nurse call, a request operation for a moving image, and a life-saving, nursing, and care for the notified subject Ob, for example. And various operations necessary for monitoring, such as an input operation indicating that there is an intention to execute a response such as assistance (restoration). The TA display unit 36 is connected to the TA control processing unit 31, and under the control of the TA control processing unit 31, a predetermined operation content input from the TA input unit 35 and a subject monitored by the care support system MS It is a device that displays the monitoring information related to monitoring of Ob (for example, an event that occurred in the sensor box SB, an image of the subject Ob, etc.), and is a display device such as an LCD or an organic EL display. In this embodiment, the TA input unit 35 and the TA display unit 36 are configured by a touch panel. In this case, the TA input unit 35 is a position input device that detects and inputs an operation position such as a resistance film method or a capacitance method. In this touch panel, a position input device is provided on the display surface of the TA display unit 36, and one or more input content candidates that can be input are displayed on the TA display unit 36. For example, a user such as a caregiver (monitor) However, when the display position where the input content to be input is displayed is touched, the position is detected by the position input device, and the display content displayed at the detected position is input to the portable terminal TA as the operation input content of the user.

  The TAIF unit 37 is a device that is connected to the TA control processing unit 31 and performs data input / output with an external device under the control of the TA control processing unit 31. For example, the TAIF unit 37 is a mobile phone communication network, WiFi standard, Bluetooth, and the like. An interface circuit using the (registered trademark) standard, an interface circuit performing infrared communication such as the IrDA standard, and an interface circuit using the USB standard.

  Similar to the SB communication IF unit 15, the TA communication IF unit 33 is a communication device that is connected to the TA control processing unit 31 and performs communication according to the control of the TA control processing unit 31. The TA communication IF unit 33 generates a communication signal containing the data to be transferred input from the TA control processing unit 31 according to the communication protocol used in the network NW of the care support system MS, and generates the generated communication signal. It is transmitted to the management server SV etc. via the network NW. The TA communication IF unit 33 receives a communication signal from the management server SV or the like via the network NW, extracts data from the received communication signal, and has a format in which the TA control processing unit 31 can process the extracted data. And output to the TA control processing unit 31.

  Similar to the SB storage unit 16, the TA storage unit 32 is a circuit that is connected to the TA control processing unit 31 and stores various programs and various data according to the control of the TA control processing unit 31. The various programs include a display processing program for processing operations related to display. The various data includes data such as screen information displayed on the TA display unit 36. The TA storage unit 32 includes, for example, a ROM and an EEPROM. The TA storage unit 32 includes a RAM that serves as a working memory of a so-called TA control processing unit 31 that stores data generated during execution of the predetermined program. The TA storage unit 32 functionally includes a display screen storage unit 321 in order to store the above-described information.

  The display screen storage unit 321 stores screen information to be displayed on the TA display unit 36 in accordance with the control of the display processing unit 3121 described later in the TA control processing unit 31.

  The TA control processing unit 31 is a circuit for processing information. Similar to the SB control processing unit 14, the TA control processing unit 31 includes, for example, a CPU and its peripheral circuits. The TA control processing unit 31 functionally includes a TA control unit 311 and a TA processing unit 312 by executing a control processing program, and the TA processing unit 312 functionally includes a display processing unit 3121.

  The TA control unit 311 controls the entire mobile terminal TA.

  The display processing unit 3121 processes an operation related to the display of the TA display unit 36. More specifically, the display processing unit 3121 displays a moving image on the TA display unit 36 as necessary.

  Such a portable terminal TA can be configured by a portable communication terminal device such as a so-called tablet computer, a smartphone, or a mobile phone.

  Next, the operation of the care support system in the embodiment will be described. FIG. 6 is a ladder chart showing the operation in the care support system of the present embodiment. FIG. 7 is a diagram illustrating an example of a display screen of the mobile terminal according to the present embodiment. FIG. 8 is a schematic diagram of image data stored in time series in the ring buffer.

  The operation of the care support system MS will be described, but the nurse call event will be omitted. When the portable terminal TA accepts a login operation such as a caregiver, for example, the portable terminal TA causes the TA processing unit 312 to display a standby screen waiting for a communication signal addressed to itself on the TA display unit 36. For example, as shown in FIG. 7A, the standby screen includes a menu bar area 611 for displaying a menu bar, a message indicating that the standby is in progress (for example, “no unsupported notification”), date and current A standby main area 612 for displaying a time, a user name (caregiver) logged in to the portable terminal TA, and the like. When such a standby screen is displayed, the portable terminal TA waits for the TA communication IF unit 33 to receive a communication signal by the TA control unit 311.

  In step S101 of FIG. 6, the sensor box SB samples output data of the Doppler sensor 111 of the sensor unit 11 at a sampling period corresponding to a predetermined frame rate by the SB control processing unit 14 and acquires image data by the camera 112. Then, the behavior detection processing unit 142 analyzes the sampled and acquired output data of the Doppler sensor 111 and the image data of the camera 112. Based on this analysis, in step S102, it is determined whether or not a predetermined event (in this embodiment, any of falling, falling, getting up, getting out of bed, abnormal movement of the minute body) has occurred in the subject Ob. Return to step S101. In parallel with this analysis, image data is stored in the ring buffer 16 (see FIG. 8). At this time, it is assumed that the image data (video signal) stored in the ring buffer 16 for a predetermined time (about 5 minutes) is overwritten and deleted in the oldest order. As a result, an increase in the capacity of the ring buffer 16 can be suppressed, which contributes to cost reduction of the sensor box SB. Note that the sound signal acquired from the microphone 121 may be stored simultaneously with the image data. In such a case, the outputs of the camera 112 and the microphone 121 can be synchronized, for example, by aggregating them into a single sensor box SB. If the SB control processing unit 14 determines in step S102 that a predetermined event has occurred, a notification signal including event information indicating that the predetermined event has occurred and a communication address is transmitted to the management server SV via the network NW. (C11). The reason why the image data is not attached to the notification signal is to avoid network congestion. However, when the communication allowable amount is large, the SB control processing unit 14 may transmit the image data together with the notification signal.

  Furthermore, in subsequent step S103, if the SB control processing unit 14 determines that the predetermined event that has occurred is not a specific event (falling or falling), the flow returns to step S101 to continue the processing.

  Here, it is assumed that a specific event (falling or falling) occurs at time t1 shown in FIG. In such a case, in step S103, the SB control processing unit 14 determines that a specific event (falling or falling) has occurred in the subject Ob by analyzing the image data, and in step S104, as shown in FIG. Image data from time t1 when a specific event occurs to time t3 after 60 seconds from time t2 retroactive to the past for 30 seconds is cut out and stored in the temporary save buffer 17. The storage time (60 seconds) from time t2 to time t3 can be arbitrarily set.

  On the other hand, when the notification signal is transmitted from the sensor box SB (C11), the management server SV, based on the information included in the notification signal, in step S105, the communication of the transmission destination corresponding to the communication address of the transmission source. The address is read from the notification destination information storage unit 221 of the SV storage unit 22, and the transmission destination mobile terminal TA is selected. More specifically, in the notification destination information table 41 stored in the notification destination information storage unit 221, the notification in the record in which the communication address of the transmission source of the received notification signal is registered in the notification source address field 411. The communication address of the notification destination registered in the destination address field 412 is extracted. For example, when a notification signal is received from the sensor box SB-2 having the communication address “192.168.10.121” disposed in the RM-2 room, the communication address “ Three communication addresses “192.168.10.25” and “192.192.1” registered in the notification destination address field 412 in the record in the second row in which “192.168.10.121” is registered. 168.10.26 "and" 192.168.10.27 "are retrieved. In this example, the communication address “192.168.10.25” is a communication address assigned to the mobile terminal TA-1 owned by the caregiver NA, and the communication address “192.168.10.26”. Is the communication address assigned to the mobile terminal TA-2 owned by the caregiver NB, and the communication address “192.168.10.27” is the mobile terminal TA- 3 is a communication address assigned to the network.

  Then, the management server SV uses the portable terminals TA-1 to TA- selected in step S105 for notification signals (including unique identification information: event # 102) including information that the RM-2 room has fallen or fallen. 3 and the fixed terminal SP (C12). In parallel with this, the management server SV transmits a request signal for image data to the sensor box SB that has transmitted the notification signal. In response to this, the SB control processing unit 14 of the sensor box SB transfers the image data stored from the temporary save buffer 17 to the management server SV (C14). Thereafter, the image data in the temporary save buffer 17 is erased, and the image data from the ring buffer 16 is awaited for preparation in preparation for the next specific event.

  The management server SV stores the communication record and image data transmitted from the sensor box SB as a log file together with unique identification information (event # 102), the terminal identifier of the sensor box SB, the received date, time, etc. 22 is automatically stored (step S108). The items recorded as the log file can be set from the fixed terminal SP as needed, and the stored log file is preferably readable from the fixed terminal SP as needed.

  On the other hand, when the notification signal transmitted from the management server SV is received by the portable terminal TA, the portable terminal TA changes the screen display of the TA display unit 36 to the one shown in FIG. Switch. At this time, the TA sound input / output unit 34 serving as a presentation unit outputs a sound or a voice (for example, a voice message such as “falling in RM-2”) or is given to a caregiver by vibration or the like. The reception of the notification signal may be notified.

  In the example shown in FIG. 7B, in the main area 612, the name of the room where the event occurred (RM-2 room, that is, information on the sensor box that sent the notification) and the name of the resident in the room (B) Here, an icon IC1 indicating a fall or a fall (which takes a different form depending on the event) and a time difference (0 minutes) between the notification time and the current time are displayed (step S106). At the same time, buttons B1 (corresponding), B2 (speak), B3 (view stored video), and B4 (view live video) are displayed in the main area 612.

  Here, when the caregiver touches the button B3, the TA input unit 35 of the portable terminal TA reacts, and in step S107, the TA control unit 311 determines that an image request has been made, and the TA communication IF unit transmits the network NW. A request signal (unique identification information: including event # 102) is transmitted to the management server SV (C15). The management server SV reads the image data corresponding to the unique identification information (event # 102) from the log file in the SV storage unit 22, and transmits it to the portable terminal TA via the network NW (C16).

  The portable terminal TA that has received the image data switches the screen display of the TA display unit 36 to, for example, the one shown in FIG. In the example shown in FIG. 7C, since the image (video) IMG of Mr. B before and after falling down in the RM-2 room is displayed in the main area 612 (step S109), the caregiver who viewed the image IMG Can quickly determine how to deal with it. In addition, if it cannot be determined by just looking at the image IMG, the caregiver can touch the button B2 so that Mr. B and the caregiver can directly talk via the SB sound input / output unit 12 of the sensor box SB. The situation can be judged accurately. The caregiver can touch the button B4 to view the streaming image of the current room RM-2. When the sensor box SB receives a signal from the nurse call input unit 13 and transmits a notification signal to the portable terminal TA via the management server SV, a screen display as shown in FIG. Can also be done. In such a case, the caregiver can touch the button B4 to view the streaming image of the current room RM-2. In the above example, the notification signal is transmitted to the portable terminal TA, and / or the notification signal may be transmitted to the fixed terminal SP. If there is no request for image data from the portable terminal TA, the flow does not pass through step S109, and no image is displayed on the portable terminal TA.

  Further, when the caregiver who sees the icon IC1 displayed in step S106 is near the RM-2 room where the event has occurred, the caregiver can rush immediately without looking at the image. Therefore, in such a case, by touching the button B1, information indicating that the caregiver responds directly is transmitted to the fixed terminal SP. By touching the button B1, the display corresponding to the notification signal is canceled in the other portable terminal TA and / or fixed terminal SP to which the notification signal has been transmitted, or the display “Carekeeper in charge, currently responding” is displayed. Is preferable. When a notification signal indicating a predetermined event (for example, wake-up) other than a specific event is transmitted from the sensor box SB and a notification signal is transmitted to the portable terminal TA via the management server SV, FIG. A screen display as shown can also be performed. At this time, since the icon IC2 indicating wake-up is displayed in the main area 612, the caregiver who sees this icon knows that the subject (Mr. B) has woken up. However, since the stored image corresponding to this event is not stored in the management server SV, the button B3 is not displayed.

  According to the present embodiment, the sensor box SB itself determines that the subject has fallen or fallen based on the image data in accordance with the state of the subject. For example, when the management server SV judges to have fallen or fallen. Compared to this, it is not necessary to transfer a large amount of image data, and it is possible to reduce traffic and avoid network congestion. Further, the ring buffer 16 stores the image data acquired by the camera 112 for a certain period while overwriting, and the SB control processing unit 14 generates a specific event (falling or falling) in the subject Ob based on the image data. If it is determined that a part of the image data stored in the ring buffer 16 is cut out and stored in the temporary save buffer 17, any image data stored in the temporary save buffer 17 can be extracted and viewed after the event. Under such circumstances, it can be accurately determined whether a specific event has occurred, and appropriate measures and prevention of recurrence can be achieved. In addition, when a specific event occurs, a notification signal that does not include image data is transmitted from the sensor box SB to the mobile terminal TA via the management server SV, so that it is possible to suppress traffic and avoid network congestion. It is possible to respond to the caregiver who responds in almost real time, so that a quick response can be realized.

  In the above embodiment, the image data ring buffer 16 acquired by the camera 112 is overwritten and stored, and it is detected that the subject has fallen or dropped, and the image data before and after that is cut out from the ring buffer 16 and temporarily stored. Although the data is stored in the save buffer 17, for example, minute movement data (and / or audio data) as state data acquired by the Doppler sensor 111 is stored in the ring buffer 16 while being overwritten, and is stored as a specific event. When an abnormality in fine movement is detected, the fine movement data before and after that may be cut out from the ring buffer 16 and stored in the temporary save buffer 17. In such a case, since the SB control processing unit 14 detects an abnormality in microscopic movement and transmits a notification signal to the management server SV, it is detected that there is a microscopic movement abnormality to the mobile terminal TA selected from the management server SV. An icon indicating that the micromotion is abnormal can be displayed on the received portable terminal TA. The analysis of the image captured by the camera and the state of minute movement detected by the Doppler sensor may be combined and used for event determination.

  Furthermore, according to the mobile phone of this embodiment, a plurality of sensing means (data acquisition units) and communication means are interspersed, and the functions of the conventional system constructed by combining these are integrated into one sensor box SB, Further, by providing a determination function, it is possible to provide a sensor device that can minimize the arrangement restriction of scattered means and that can perform information processing of a plurality of sensing means with high real-time characteristics. Further, by consolidating the functions in one sensor box SB, it is possible to synchronize a plurality of sensing means without taking any special means (such as adding a time stamp to scattered sensing information).

  FIG. 9 is a diagram illustrating a configuration of a sensor box according to a modification. The example shown in FIG. 9 is different from the above-described embodiment in that a ring buffer 16 and a temporary save buffer 17 are provided in the CPU constituting the SB control processing unit 14. Thereby, the processing speed can be improved. Other configurations are the same as those in the above-described embodiment.

  FIG. 10 is a diagram illustrating a configuration of a sensor box according to another modification. In the example shown in FIG. 10, the sensor information processing unit 113 is provided between the sensor unit 11 and the SB control processing unit 14 in the embodiment described above, and data output from the Doppler sensor 111 and the camera 112 is displayed. I am trying to process it independently. Also, an audio processing unit 123 is provided between the SB sound input / output unit 12 and the SB control processing unit 14 so that the audio signals of the microphone 121 and the speaker 122 are processed independently. Further, a wireless communication processing unit 131 is provided between the nurse call input unit 13 and the SB control processing unit 14 so as to independently process a radio signal output from the nurse call input unit 13. As a result, the processing speed can be increased. Other configurations are the same as those in the above-described embodiment.

  FIG. 11 is a diagram illustrating a configuration of a sensor box according to another modification. The example shown in FIG. 11 is different from the above-described embodiment in that an emergency notification device 18 as an emergency notification unit is connected to the SB control processing unit 14. For example, when an emergency such as an earthquake or fire occurs, when the emergency signal is transmitted from the fixed terminal SP or the portable terminal TA to the management server SV, the management server SV transmits the emergency signal to each sensor box SB via the network NW. To do. In response to this, the SB control processing unit 14 can notify the resident of the emergency situation via the emergency call device 18. In particular, in the case of elderly people, visual acuity and hearing ability may be reduced, so it is preferable to notify emergency calls using flashing lights, sirens, etc., as well as using vibrations and smells. The length of time recorded in the ring buffer is determined by taking into account its storage capacity, video quality (determined by resolution, bit rate, frame rate, etc.), and the storage capacity of the temporary save buffer unit. It can be set freely. What is necessary is just to set suitable time suitably according to the convenience of a care staff etc., and a management form, for example, 1 minute-10 minutes may be sufficient.

  The present invention is not limited to the embodiments and modifications described in the specification, and includes other embodiments and modifications based on the embodiments and technical ideas described in the present specification. It will be apparent to those skilled in the art. The description and the embodiments are for illustrative purposes only, and the scope of the present invention is indicated by the following claims.

11 Sensor unit 12 SB sound input / output unit 13 Nurse call input unit 14 SB control processing unit 15 SB communication IF unit 16 Ring buffer 17 Temporary save buffer 18 Emergency call device 21 SV control processing unit 22 SV storage unit 23 SVIF unit 24 SV input Unit 31 TA control processing unit 32 TA storage unit 33 TA communication IF unit 34 TA sound input / output unit 35 TA input unit 36 TA display unit 37 TAIF unit 41 notification destination information table 61 TA display screen 111 Doppler sensor 112 camera 211 SV control unit 221 Notification destination information storage unit 311 TA control unit 312 TA processing unit 321 Display screen storage unit 411 Notification source address field 412 Notification destination address field 611 Menu bar area 612 Main area 3121 Display processing unit AP Access points B1 to B3 Buttons IC1 to IC3 Eye Down MS care support system NW network Ob subjects RM room SB sensor box SP fixed terminal ST nurse station SV management server TA mobile terminal

Claims (12)

A sensor unit including a data acquisition unit for acquiring state data according to the state of the subject continuously or at predetermined intervals;
A ring buffer unit for storing the state data acquired by the sensor unit for a certain period while overwriting;
A determination unit that determines that the target person is in a predetermined state based on the state data acquired by the sensor unit;
Temporary save buffer unit that cuts out and saves part of the state data stored in the ring buffer unit when the determination unit determines that the target person has entered a specific state of the predetermined state When,
And a communication unit that transmits a notification signal to the outside when the determination unit determines that the subject has entered the predetermined state.   The sensor device according to claim 1, wherein the data acquisition unit includes a camera that images the subject, and the state data is image data acquired by imaging by the camera.   The sensor device according to claim 1, wherein the sensor unit includes a plurality of the data acquisition units that acquire different types of state data.   The data acquisition unit includes a camera and a Doppler sensor that images the subject, and the state data includes image data acquired by the camera and image of the subject acquired by the Doppler sensor. The sensor device according to claim 3, which is data.   The sensor device has a nurse call input unit that is connected to the communication unit by wire or wirelessly and can be operated by the subject, and when the subject operates the nurse call input unit, the communication unit is The sensor device according to any one of claims 1 to 4, wherein a nurse call signal is transmitted to the outside.   The sensor device has a sound collection unit that is connected to the communication unit by wire or wirelessly, acquires a surrounding sound and converts it into a sound signal, and transmits the sound signal to the outside via the communication unit. Item 6. The sensor device according to any one of Items 1 to 5.   The sensor device includes a sound output unit connected to the communication unit by wire or wirelessly. When a sound signal is transmitted from the outside through the communication unit, the sound output unit converts the sound into a sound. The sensor device according to claim 1, which outputs the sensor device.   The sensor device includes an emergency notification unit that is wired or wirelessly connected to the communication unit. When an emergency signal is transmitted from the outside via the communication unit, the emergency notification unit notifies the target person. The sensor device according to claim 1. A care support system comprising the sensor device according to claim 1, a management server communicably connected to the sensor device, and a terminal communicably connected to the management server,
The sensor device is a care support system that transmits the notification signal to the management server via the communication unit when the determination unit determines that the subject is in a predetermined state.   The care device according to claim 9, wherein the sensor device transmits the state data stored in the temporary save buffer unit to the management server via the communication unit simultaneously with or after transmission of the notification signal. Support system.   The management server has a storage unit, and when the sensor device transmits the status data stored in the temporary save buffer unit to the management server via the communication unit, the status data is stored in the management server. The care support system of Claim 10 memorize | stored in a part.   The care support system according to claim 11, wherein, when a request signal is transmitted from the terminal to the management server, the management server transmits the state data stored in the storage unit to the terminal.

Images