JP7137154B2 - Behavior detection device and method, and monitored person monitoring support system - Google Patents

Description

The present invention relates to a behavior detection device and a behavior detection method for detecting a predetermined behavior of a monitored person who is a monitored object to be monitored. The present invention also relates to a monitored person monitoring support system using this behavior detection device.

Japan (Japan) is an aging society, more specifically, a super-aging society with an aging rate exceeding 26.7% (as of October 1, 2015, Cabinet Office). In such an aging society, people who need nursing care or nursing care due to illness, injury, old age, etc. (care-requiring caregivers) need nursing care that occurs in a normal society that is not an aging society. The number is expected to increase more than that of people with disabilities and those requiring nursing care. Generally, these people requiring nursing care enter facilities such as hospitals and welfare facilities for the elderly (under Japanese law, short-term nursing homes for the elderly, nursing homes for the elderly, and special nursing homes for the elderly, etc.), and receive nursing and nursing care. receive. In such facilities, nurses, caregivers, and the like (nursing caregivers) regularly make patrols to check on the safety and condition of the facilities.

However, the number of nursing care workers cannot keep up with the increase in the number of nursing care workers requiring nursing care, and the nursing industry and the nursing care industry are suffering from a chronic labor shortage. Furthermore, compared to the day shift, the number of caregivers decreases and the work load per person increases during the quasi-night shift and the night shift. In order to reduce the labor shortage and the burden on caregivers, there is a need for technology that complements nursing and care work. For this reason, in recent years, a monitored person monitoring technique for monitoring a person to be monitored by a caregiver requiring nursing care has been researched and developed.

As one of such monitored person monitoring techniques, there is a state detection device disclosed in Patent Document 1. The state detection device disclosed in Patent Document 1 includes an image processing unit that detects the moving direction of the subject by analyzing an image of the subject on the bed, and the direction detected by the image processing unit. A determining unit that determines the current state of the subject based on the direction of movement and the past state of the subject, and an output that outputs information indicating the current state of the subject obtained by the determining unit. and The past state and the present state are a laying state in which the subject is lying on the bed, a waking state in which the subject is sitting upright on the bed, and a state in which the subject is lying on the bed. and an absence state in which the subject is away from the bed, and the determination unit uses different criteria for each of the plurality of types of past states to determine the subject's Determine the current state of More specifically, the determination unit determines the state from the past position of the image of the subject with respect to the detection area and the current position of the image of the subject with respect to the detection area ( For example, paragraphs [0022] to [0031]).

On the other hand, in terms of safety confirmation, a solitary person living alone is also a person to be monitored, which is the same as the person requiring nursing care.

By the way, since the state detection device disclosed in Patent Document 1 determines the state as described above, there is a risk of erroneous determination due to movement of the attendant near the bed, turning over of the subject, or the like. There is In a system where the determination result is reported (notified, notified) to a monitor such as a nurse or a caregiver, if an erroneous report occurs due to erroneous determination, useless notifications to the monitor will increase. As a result, For example, by going to the site or checking with an image, for example, the work load of checking the safety of a person to be monitored, such as a person requiring nursing care or care, will increase due to false alarms. In particular, the occurrence of erroneous alarms due to erroneous discrimination is a serious problem during semi-night shifts and night shifts when the number of supervisors is usually reduced.

JP 2012-170483 A

The present invention is an invention made in view of the above circumstances, and its object is to further reduce misjudgment (misjudgment, misdetection), an action detection device and a behavior detection method, and use of this action detection device. It is an object of the present invention to provide a monitored person monitoring support system.

In order to achieve the above object, a behavior detection device, a behavior detection method, and a monitored person monitoring support system reflecting one aspect of the present invention measure a monitored person with first and second sensors, respectively, and Determining the sleep state of the monitored person based on the first measurement result of the first sensor, determining the predetermined behavior of the monitored person based on the second measurement result of the second sensor, and depending on the sleep determination result to control the action determination process.

The advantages and features provided by one or more embodiments of the invention will be fully appreciated from the detailed description and accompanying drawings provided below. These detailed descriptions and accompanying drawings are given by way of example only and are not intended as a definition of the limits of the invention.

It is a figure which shows the structure of the monitored person monitoring assistance system in embodiment. 2 is a diagram showing the configuration of a sensor device in which the behavior detection device of the embodiment is incorporated in the monitored person monitoring support system; FIG. 4 is a flowchart showing the operation of the sensor device in service mode; 4 is a flow chart showing the operation of the sensor device in the action determination process according to the sleep determination result shown in FIG. 3; 5 is a flowchart showing the operation of the sensor device in the fall determination process shown in FIG. 4; 5 is a flow chart showing the operation of the sensor device in the overturn determination process shown in FIG. 4; 5 is a flow chart showing the operation of the sensor device in the bed entry determination process shown in FIG. 4; 5 is a flowchart showing the operation of the sensor device in the wake-up determination process shown in FIG. 4; 5 is a flowchart showing the operation of the sensor device in the bed leaving determination process shown in FIG. 4; FIG. 5 is a flow chart showing the operation of the sensor device in the micro-motion abnormality determination process shown in FIG. 4; FIG. It is a figure which shows an example of the main screen displayed on the said terminal device. It is a figure which shows an example of the 1st setting screen displayed on the said terminal device. It is a figure which shows an example of the 2nd setting screen displayed on the said terminal device. It is a figure which shows an example of the monitoring information screen displayed on the said terminal device.

BEST MODE FOR CARRYING OUT THE INVENTION An embodiment according to the present invention will be described below with reference to the drawings. However, the scope of the invention is not limited to the disclosed embodiments. It should be noted that the configurations denoted by the same reference numerals in each figure indicate the same configurations, and the description thereof will be omitted as appropriate. In the present specification, reference numerals with suffixes omitted are used when referring to generically, and reference numerals with suffixes are used when referring to individual configurations.

A monitored person monitoring support system according to an embodiment includes a sensor device that is provided corresponding to a monitored person Ob, detects a predetermined action of the monitored person Ob, and a sensor device that is communicably connected to the sensor device. a central processing unit that manages received detection results; and a terminal device that is communicably connected to the central processing unit and receives and displays the detection results via the central processing unit, It is a system for supporting surveillance. This sensor device includes the behavior detection device in this embodiment. The behavior detection device in this embodiment includes first and second sensors that measure the monitored person Ob, and sleep state determination that determines the sleep state of the monitored person Ob based on the first measurement result of the first sensor. a behavior determination unit that determines a predetermined behavior of the monitored person Ob based on the second measurement result of the second sensor; and a control of the behavior determination unit according to the sleep determination result of the sleep state determination unit. and a processing control unit for processing. Since this behavior detection device controls the behavior determination unit according to the sleep determination result of the sleep state determination unit, erroneous determination can be further reduced. In this behavior detection device, in this embodiment, the second sensor includes first and second sub-sensors for measuring the person to be monitored Ob, and the behavior determination section includes the first sub-sensor for measuring the first sub-sensor. a first sub-behavior determination unit for executing a first sub-behavior determination process for determining a first behavior belonging to a first group among predetermined behaviors of the monitored person Ob based on a result; Second sub-behavior determination for executing a second sub-behavior determination process for determining a second behavior belonging to a second group different from the first group among the predetermined behaviors of the monitored person Ob based on the second sub-measurement result. and the processing control unit controls at least one of the first and second sub-behavior determination units according to the sleep determination result of the sleep state determination unit. According to this, it is possible to divide the predetermined behavior into a first behavior belonging to the first group that cannot occur in the sleeping state and a second behavior belonging to the second group that can occur in the sleeping state. Such an action detection device can more appropriately control the action determination unit according to the sleep determination result of the sleep state determination unit, and can further reduce erroneous determinations. More specific description will be given below.

The terminal device may be one type of device, but in the present embodiment, the terminal device is two types of devices, a fixed terminal device and a mobile terminal device. The main difference between these fixed terminal devices and mobile terminal devices is that while fixed terminal devices are used in a fixed manner, mobile terminal devices are carried and operated by supervisors (users) such as nurses and caregivers. In that respect, the fixed terminal device and the mobile terminal device are substantially the same.

FIG. 1 is a diagram showing the configuration of a monitored person monitoring support system according to an embodiment. FIG. 2 is a diagram showing the configuration of a sensor device in which the behavior detection device of the embodiment is incorporated in the monitored person monitoring support system.

More specifically, the monitored person monitoring support system MS includes, for example, one or more sensor devices SU (SU-1 to SU-4), a management server device SV, a fixed terminal, A device SP, one or a plurality of portable terminal devices TA (TA-1, TA-2), and a private branch exchange (PBX, Private branch exchange) CX, which are wired or wirelessly connected to a LAN (Local Area Network). ), etc., are communicably connected via a network (network, communication line) NW. The network NW may be provided with repeaters such as repeaters, bridges and routers for relaying communication signals. In the example shown in FIG. 1, the plurality of sensor devices SU-1 to SU-4, the management server device SV, the fixed terminal device SP, the plurality of mobile terminal devices TA-1 and TA-2, and the private branch exchange CX are L2 switches. are communicably connected to each other by a mixed wired and wireless LAN (for example, a LAN conforming to the IEEE 802.11 standard) NW including a line concentrator (hub, HUB) LS and an access point AP. More specifically, a plurality of sensor devices SU-1 to SU-4, a management server device SV, a fixed terminal device SP and a private branch exchange CX are connected to a line concentrator LS, and connected to a plurality of mobile terminal devices TA-1 and TA-2. is connected to the concentrator LS via an access point AP. The network NW constitutes a so-called intranet by using Internet protocols such as TCP (Transmission control protocol) and IP (Internet protocol).

The private branch exchange (circuit switch) CX is connected to the network NW, controls extension calls such as outgoing calls, incoming calls, and conversations between the mobile terminal devices TA, implements extension calls between the mobile terminal devices TA, and , for example, is connected to an outside line telephone TL such as a fixed telephone or a mobile telephone via a public telephone network PN such as a fixed telephone network or a mobile telephone network, and originating, receiving and calling between the outside telephone TL and the mobile terminal device TA. It is a device that performs outside line telephone calls between the outside line telephone TL and the mobile terminal device TA by controlling outside line telephones such as the mobile terminal device TA. The private branch exchange CX is, for example, a digital exchange, an IP-PBX (Internet Protocol Private Branch Exchange), or the like.

The monitored person monitoring support system MS is arranged at an appropriate place according to the monitored person Ob. The monitored person (person to be watched over) Ob is, for example, a person who needs nursing care due to illness or injury, a person who needs nursing care due to a decline in physical ability, a solitary person living alone, or the like. In particular, from the viewpoint of enabling early detection and early countermeasures, the monitored person Ob should be a person who needs to be found when a predetermined inconvenient event, such as an abnormal condition, occurs to him or her. preferable. Therefore, the monitored person monitoring support system MS is preferably installed in buildings such as hospitals, welfare facilities for the elderly, and dwelling units according to the type of the monitored person Ob. In the example shown in FIG. 1, the monitored person monitoring support system MS is installed in a building of a nursing care facility having a plurality of rooms RM in which a plurality of monitored persons Ob reside and a plurality of rooms such as a nurse station. .

The sensor device SU has a communication function or the like to communicate with other devices SV, SP, and TA via the network NW, detects a predetermined event related to the person to be monitored Ob, and reports the detected event to the management server device SV. , performs voice communication with the terminal devices SP and TA, generates images including moving images, and distributes the moving images to the terminal devices SP and TA. The predetermined event (phenomenon) preferably includes an event requiring a countermeasure (response). In this embodiment, the predetermined event includes a preset predetermined action of the monitored person Ob, including a nurse call. For example, as shown in FIG. 2, such a sensor device SU includes a sensor unit 11, a sensor-side sound input/output unit (SU sound input/output unit) 12, a nurse call reception operation unit 13, and a sensor-side control processing unit. section (SU control processing section) 14 , sensor side communication interface section (SU communication IF section) 15 , and sensor side storage section (SU storage section) 16 .

The sensor unit 11 is a device that is connected to the SU control processing unit 14 and measures various preset values of the monitored person Ob under the control of the SU control processing unit 14 . In this embodiment, the sensor unit 11 includes a first sensor to determine the sleep state of the monitored person Ob, and a second sensor to determine the predetermined behavior of the monitored person Ob.

Since the first sensor determines the sleep state of the monitored person Ob based on the respiratory state in this embodiment, any type of device that can measure the breathing of the monitored person Ob as one of the predetermined quantities. can be The first sensor may be, for example, a pulse meter or the like that is worn on the wrist or the like to measure the pulse. configured with.

The second sensor includes a first sub-sensor for determining a first action belonging to a first group among the predetermined actions, and belonging to a second group different from the first group among the predetermined actions. A second sub-sensor is provided to determine a second behavior. For example, in the present embodiment, the predetermined actions include going to bed when the monitored person Ob enters the bedding BD, getting up when the monitored person Ob wakes up, leaving the bed when the monitored person Ob leaves the bedding BD, This includes a fall in which Ob falls from the bedding BD, a fall in which the monitored person Ob falls outside the bedding BD, and an abnormality in micromotion caused by breathing of the monitored person. In this embodiment, these predetermined actions are divided into a first group that cannot occur in the sleep state and a second group that can occur in the sleep state. The first behavior belonging to the first group that cannot occur in this sleep state includes getting into bed, getting up, getting out of bed, falling, and falling. Includes movement disorders. The first sub-sensor may be any device capable of determining such first behavior. The first sub-sensor may be, for example, a thermography device capable of extracting a human area from a temperature distribution, a distance image sensor capable of extracting a human area from a distance distribution, or the like. Since action is determined, it comprises a camera 111 that produces an image as one of said predetermined quantities. The second sub-sensor may be any device capable of determining such a second behavior. In the present embodiment, the second behavior is an abnormality in microbody movement due to breathing of the monitored person, so the apparatus can measure the breathing of the monitored person Ob as one of the predetermined quantities. and is configured with a Doppler sensor 112, for example. That is, in this embodiment, the Doppler sensor 112 is used both as the first sensor and the second sub-sensor.

Thus, in this embodiment, the sensor unit 11 includes the camera 111 and the Doppler sensor 112 .

The camera 111 is a device that is connected to the SU control processing unit 14 and generates an image (image data) under the control of the SU control processing unit 14 . The images include still images (still image data) and moving images (moving image data). The camera 111 is arranged so as to be able to monitor the space where the person to be monitored Ob is supposed to be located (located space, in the example shown in FIG. 1, the living room RM of the installation location). An image is captured, a bird's-eye view image (image data) of the imaging target is generated, and the image of the imaging target (target image) is output to the SU control processing unit 14 . Preferably, since there is a high probability that the entire monitored person Ob can be imaged, the imaging unit 111 should be arranged so that the head of the monitored person Ob is positioned in the bedding (for example, a bed) BD on which the monitored person Ob lies. It is arranged so that the imaging target can be imaged from right above a predetermined head position (usually, the position where a pillow is arranged). The sensor unit SU acquires an image of the monitored person Ob from above the monitored person Ob, preferably from right above the expected head position, using the camera 111 .

Such a camera 111 may be a device that generates a visible light image, but in this embodiment, a digital infrared camera that generates an infrared image is used so that the monitored person Ob can be monitored even in relatively dark conditions. be. For example, in this embodiment, the digital infrared camera 111 includes an imaging optical system that forms an infrared optical image of an object to be imaged on a predetermined imaging plane, and a light receiving surface that matches the imaging plane. and an image sensor that converts an infrared optical image of the imaging target into an electrical signal, and an image that is data representing the infrared image of the imaging target by image processing the output of the image sensor. It is configured by including an image processing unit for generating data and the like. In this embodiment, the imaging optical system of the camera 111 is preferably a wide-angle optical system (a so-called wide-angle lens (including a fisheye lens)) capable of imaging the entire room RM in which it is installed.

The Doppler sensor 112 is a device that is connected to the SU control processing unit 14 and measures movement of the body surface of the chest associated with respiration in the monitored person Ob according to the control of the SU control processing unit 14 . The Doppler sensor 112 is a body motion sensor that transmits a transmitted wave, receives a reflected wave of the transmitted wave reflected by an object, and outputs a Doppler signal of a Doppler frequency component based on the transmitted wave and the reflected wave. . When the object is in motion, the frequency of the reflected wave shifts in proportion to the speed at which the object is moving due to the so-called Doppler effect. occur. The Doppler sensor 112 generates a signal of this Doppler frequency component as a Doppler signal at a predetermined sampling rate and outputs it to the SU control processing unit 14 . Upon receiving the Doppler signal from the Doppler sensor 112, the SU control processing unit 14 stores the received Doppler signal in the SU storage unit 16 in chronological order. The transmission waves may be ultrasonic waves, microwaves, or the like, but in this embodiment, they are microwaves. Microwaves can be transmitted through clothes and reflected by the body surface of the monitored person Ob, so even if the monitored person Ob is wearing clothes, the movement of the body surface can be detected, which is preferable.

The SU sound input/output unit 12 is a circuit connected to the SU control processing unit 14 for acquiring external sounds and inputting them to the sensor unit SU. It is a circuit for generating and outputting a sound according to the The SU sound input/output unit 12 includes, for example, a microphone or the like that converts acoustic vibration of sound into an electric signal, and a speaker or the like that converts the electric signal of sound into acoustic vibration of sound. The SU sound input/output unit 12 outputs an electrical signal representing an external sound to the SU control processing unit 14, converts the electrical signal input from the SU control processing unit 14 into an acoustic vibration of sound, and outputs the acoustic vibration.

The nurse call reception operation unit 13 is connected to the SU control processing unit 14 and is a switch circuit such as a push-button switch for inputting a nurse call to the sensor unit SU. The nurse call reception operation unit 13 may be connected to the SU control processing unit 14 by wire, or may be connected to the SU control processing unit 14 by short-range wireless communication such as the Bluetooth (registered trademark) standard.

The SU communication IF unit 15 is a communication circuit that is connected to the SU control processing unit 14 and performs communication under the control of the SU control processing unit 14 . SU communication IF unit 15 generates a communication signal containing data to be transferred input from SU control processing unit 14 according to a communication protocol used in network NW of monitored person monitoring support system MS, and generates a It transmits communication signals to other devices SV, SP, TA via the network NW. The SU communication IF unit 15 receives communication signals from other devices SV, SP, and TA via the network NW, extracts data from the received communication signals, and the SU control processing unit 14 can process the extracted data. format data and output to the SU control processing unit 14 . The SU communication IF unit 15 includes, for example, a communication interface circuit complying with the IEEE802.11 standard.

The SU storage unit 16 is a circuit that is connected to the SU control processing unit 14 and stores various prescribed programs and various prescribed data under the control of the SU control processing unit 14 . The various predetermined programs include, for example, an SU control program for controlling the respective units 11 to 13, 15, and 16 of the sensor unit SU according to the functions of the respective units; A sleep state determination program for determining the sleep state of Ob, an action determination program for determining a predetermined action of the monitored person Ob based on the output of the sensor unit 11 and notifying it to the management server device SV, and the sleep state determination program A processing control program for controlling the action determination program according to the result of sleep determination, and when a nurse call reception operation unit 13 receives a nurse call, notifies the management server device SV to that effect, and the SU sound input/output unit 12 A nurse call processing program for performing a voice call between the terminal devices SP and TA by using, etc., and a streaming processing program for distributing the video generated by the camera 111 to the terminal device SP and TA that requested the video by streaming. and other control processing programs. The various predetermined data include a sensor device identifier (sensor ID), which is an identifier for specifying and identifying the sensor device SU of the device itself, and a communication address of the management server device SV. It contains the data necessary for the above. The SU storage unit 16 includes, for example, a ROM (Read Only Memory) that is a non-volatile storage element, an EEPROM (Electrically Erasable Programmable Read Only Memory) that is a rewritable non-volatile storage element, and the like. The SU storage unit 16 includes a RAM (Random Access Memory) or the like that serves as a so-called working memory of the SU control processing unit 14 that stores data generated during execution of the predetermined program.

The SU control processing unit 14 controls each unit of the sensor unit SU according to the function of each unit, detects a predetermined event related to the monitored person Ob, and notifies the management server unit SV of the detected event. , terminal devices SP and TA, generates an image including a moving image, and distributes the moving image to the terminal devices SP and TA. The SU control processing unit 14 is composed of, for example, a CPU (Central Processing Unit) and its peripheral circuits. By executing the control processing program, the SU control processing unit 14 includes a sensor-side control unit (SU control unit) 141, a sleep state determination unit 142, an action determination unit 143, a processing control unit 144, and a nurse call processing unit 145. and a streaming processing unit 146 functionally.

The SU control section 141 controls the respective sections 11 to 13, 15, and 16 of the sensor device SU according to the functions of the respective sections, and governs the overall control of the sensor device SU.

The sleep state determination section 142 determines the sleep state of the monitored person Ob based on the output of the sensor section 11, that is, the first measurement result of the first sensor. More specifically, based on the first measurement result of the first sensor, the sleep state determination unit 142 determines the degree of sleep representing the depth of sleep of the monitored person Ob, and the reliability of the degree of sleep. Reliability, which represents the degree of In this embodiment, the sleep state determination unit 142 determines the sleep state based on the Doppler signal from the Doppler sensor 112, which is an example of the first sensor. More specifically, the sleep state determination unit 142 performs, for example, a fast Fourier transform (FFT) on the Doppler signals measured within a predetermined time (for example, 1 minute or 2 minutes) from the time of measurement to the past, and with this FFT From the obtained spectrum, the average value of the amplitude in the frequency band corresponding to the general respiration frequency is obtained, and the obtained average value is compared with the threshold for determining the degree of sleep (sleep degree classification threshold) to determine sleep. Ask for degrees. Then, the sleep state determination unit 142 obtains the duration of the obtained sleep degree, and compares the obtained duration of the sleep degree with a threshold (reliability classification threshold) for determining the reliability to determine the reliability. Ask. For example, the sleep level classification threshold is appropriately set to 1 or more using a plurality of samples. In the present embodiment, the action determination unit 143 is controlled as described later depending on whether the state is awake or sleep, so the sleep degree classification threshold is a single value that distinguishes between wakefulness and sleep. Alternatively, further, to divide sleep into three levels: low sleep with light sleep, medium sleep with moderate sleep, and high sleep with deep sleep, all three can be a value. Also, for example, the reliability classification threshold is appropriately set to 1 or more using a plurality of samples, for example. In the present embodiment, the behavior determining unit 143 is controlled as described later depending on whether the reliability is relatively high high reliability or relatively low reliability. The confidence tier threshold can be a single value that distinguishes between high confidence and low confidence, or can be defined as high confidence with relatively high confidence and moderate confidence with relatively high confidence. , and low confidence, which is relatively low. The sleep state determination unit 142 outputs (notifies) the sleep determination result, in this embodiment, the degree of sleep and the degree of reliability obtained as described above to the processing control unit 144 .

Based on the output of the sensor unit 11, that is, the second measurement result of the second sensor, the behavior determination unit 143 determines a predetermined behavior of the monitored person Ob, and notifies the management server device SV of the predetermined behavior. It is something to do. In the present embodiment, the predetermined actions are getting into bed, getting up, getting out of bed, falling, falling, and abnormal microtremors, as described above. Getting into bed, getting up, getting out of bed, falling, and falling are the first behaviors belonging to the first group, and are determined based on the output (target image) of camera 111. It is the second behavior that belongs to and is detected based on the output (Doppler signal) of the Doppler sensor 112 . Therefore, the action determination unit 143 functionally determines the first action belonging to the first group among the predetermined actions of the monitored person Ob based on the first sub-measurement result of the first sub-sensor. A first sub-behavior determination unit 1431 that executes sub-behavior determination processing; and a second sub-behavior determination unit 1432 that executes a second sub-behavior determination process for determining a second behavior belonging to. More specifically, in this embodiment, the first sub-behavior determining unit 1431 determines the first behavior (getting into bed, getting up, getting out of bed, falling, and falling) based on the target image of the camera 111, and The second sub-behavior determining unit 1432 determines the second behavior (abnormal body movement) based on the Doppler signal from the Doppler sensor 112 and notifies the management server device SV of the second behavior.

More specifically, getting into bed, getting up, getting out of bed, falling, falling, and micromotor abnormalities are determined as follows. Note that the area where the bedding BD is arranged in the target image (area where the bedding BD is located) is stored in advance in the storage unit 16 as one of the various data, and various thresholds and continuation determination times in the following description are stored. is appropriately set from a plurality of samples and stored in advance in the storage unit 16 as one of the various data.

In determining whether to enter the bed, the first sub-behavior determination unit 1431 determines that the previous state variable (variable for storing the result of behavior determination) was “getting out of bed”, and the target image acquired from the camera 111 this time is determined by, for example, the background subtraction method. When the person area extracted by completely overlaps the location area of the bedding BD (when the person area is completely within the location area of the bedding BD), it is tentatively determined to be in bed, and the duration of the completely superimposed state continues beyond the admission continuation determination time, it is finally determined that there is admission, and the admission is detected. Then, the first sub-behavior determination unit 1431 updates the state variable with "going to bed". The in-bed continuation determination time is a threshold value for finally determining in-bed as in-bed tentatively determined based on the complete overlap of the extracted person area and the location area of the bedding BD.

In the wake-up determination, the first sub-behavior determination unit 1431 detects that the previous state variable was "getting into bed" and the human area extracted from the target image acquired from the camera 111 this time protrudes from the location area of the bedding BD. If the protruding area is greater than or equal to the wake-up determination threshold and less than the leaving the bed determination threshold, it is tentatively determined to be awake. When the determination time is exceeded, it is finally determined that there is a wake-up, and the wake-up is detected. Then, the first sub-behavior determination unit 1431 updates the state variable to "wake up". The wake-up determination threshold is a threshold for determining whether or not to get up based on the size of the protruding region, and the bed leaving determination threshold determines whether or not to get out of bed based on the size of the protruding region. The threshold for determination of getting out of bed is set to a value larger than the threshold for determination of getting up. The wake-up continuation determination time is a threshold value for finally determining that the wake-up provisionally determined by comparing the protruding area and the wake-up determination threshold value is the wake-up.

In the determination of getting out of bed, the first sub-behavior determination unit 1431 determines whether the previous state variable was either “entering bed” or “getting up”, and the human region extracted from the target image acquired from the camera 111 this time. When the protruding region protruding from the location region of the bedding BD is equal to or greater than the bed leaving determination threshold, it is provisionally determined to be leaving the bed, and the duration of the protruding region in the state of being equal to or greater than the bed leaving determination threshold exceeds the bed leaving continuation determination time. If so, it is finally determined that the person has left the bed, and the person has left the bed. Then, the first sub-behavior determination unit 1431 updates the state variable with "getting out of bed". The bed-leaving continuation determination time is a threshold value for finally determining bed-leaving tentatively determined by comparing the protruding area and the bed-leaving determination threshold.

In the fall determination, the first sub-behavior determination unit 1431 determines that the size of the head region of the human region extracted from the target image acquired from the camera 111 this time is equal to or smaller than the lying posture determination threshold, and that the size of the head region When the size change speed is equal to or greater than the fall determination speed threshold and the person area is within the fall determination area set around the location area of the bedding BD, it is determined that there is a fall, and the fall is detected. detect. The lying posture determination threshold value is a threshold value for determining whether or not it is the size of the head region in the lying posture. The fall determination speed threshold is a threshold for determining whether or not a fall has occurred based on the change speed of the size of the head region.

In the fall determination, the first sub-behavior determination unit 1431 determines that the size of the head region of the human region extracted from the target image acquired from the camera 111 this time is equal to or smaller than the lying posture determination threshold, and that the size of the head region When the change speed of the size is equal to or higher than the fall determination speed threshold and the person area is in the area excluding the location area of the bedding BD and the fall determination area, it is determined that there is a fall, and the fall is detected. . The fall determination speed threshold is a threshold for determining whether or not a fall has occurred based on the change speed of the size of the head region.

As for the abnormality of slight body movement, the second sub-behavior determination unit 1432 determines abnormality of the body movement based on the Doppler signal of the Doppler sensor 112, which is an example of the second sub-sensor. More specifically, like the sleep state determination unit 141, the second sub-behavior determination unit 1432 performs, for example, a fast Fourier transform (FFT) on the Doppler signals measured within a predetermined time from the time of measurement to the past, From the spectrum obtained by FFT, the average value of the amplitude in the frequency band corresponding to the general respiratory frequency is obtained, and the obtained average value and the threshold value for determining whether or not there is an abnormal micromotion ( If the obtained average value is less than or equal to the threshold value for determining abnormality in minute body movement, it is tentatively determined to be abnormal in minute body movement, and the average value is equal to the threshold value for determining abnormality in minute body movement. When the duration of the following state continues beyond the abnormality continuation determination time of micro-motion, it is finally determined that there is an abnormality of micro-motion, and the abnormality of micro-motion is detected. Then, the second sub-behavior determination unit 1432 updates the state variable with "abnormal body movement". The micro-motion abnormality continuation determination time is set so that the micro-motion abnormality temporarily determined by comparing the calculated average value and the micro-motion abnormality determination threshold value is finally determined to be the micro-motion abnormality. is the threshold of

When the predetermined action is detected in this way, the action determination unit 143 generates an event information containing event information (event information) representing the content of a predetermined event (phenomenon) related to the monitored person Ob, for notifying the event. The SU communication IF unit 15 notifies the management server device SV of the first event notification communication signal. More specifically, the action determination unit 143 receives the sensor ID of its own device, the event information representing the content of the event, and the target image used when detecting the entry, the rise, the exit, the fall, and the fall. A signal (first event notification communication signal) is transmitted to the management server device SV via the SU communication IF section 15 . In the present embodiment, the event information is one or more of entering bed, getting up, getting out of bed, falling, falling, abnormal micromotion, and nurse call (NC). The first event notification communication signal contains one or more of the above-described event information, such as entering the bed, getting up, leaving the bed, falling, falling, and abnormal micromotion. The image may be at least one of a still image and a moving image. In the present embodiment, as will be described later, the still image is first notified, and the moving image is distributed according to the user's request. First, a moving image may be distributed, or a still image and a moving image may be transmitted, and the still image and the moving image may be displayed on the terminal devices SP and TA by splitting the screen.

The processing control unit 144 controls the action determination unit 143 according to the sleep determination result of the sleep state determination unit 142 . In this embodiment, the processing control unit 144 controls at least one of the first and second sub action determination units 1431 and 1432 according to the sleep determination result of the sleep state determination unit 142 . More specifically, in the present embodiment, the processing control unit 144 determines whether or not to execute the first sub-action determination process in the first sub-action determination unit 1431 according to the sleep determination result of the sleep state determination unit 142. and whether or not to execute the second sub-behavior determination processing in the second sub-behavior determination unit 1432 . More specifically, for example, when the sleep determination result of the sleep state determination unit 142 indicates that either the degree of sleep or the degree of reliability is high, the processing control unit 144 instructs the first sub-behavior determination unit 1431 to The first sub-action determination process is not executed, and the second sub-action determination unit 1432 is caused to execute the second sub-action determination process. The case where the sleep determination result of the sleep state determination unit 142 is higher than the sleep level or the reliability level means that the sleep level is equal to or greater than a predetermined sleep determination threshold set in advance, or This is the case where the reliability is greater than or equal to a predetermined reliability determination threshold set in advance. Further, for example, when the sleep determination result of the sleep state determination unit 142 indicates that both the degree of sleep and the degree of reliability are low, the processing control unit 144 causes the first sub-action determination unit 1431 to perform the first sub-action determination process. Then, the second sub-behavior determination unit 1432 is not caused to execute the second sub-behavior determination processing. When the sleep determination result of the sleep state determination unit 142 indicates that both the sleep level and the reliability level are low, the sleep level is less than a predetermined sleep determination threshold value set in advance, and the reliability level is set in advance. is less than a predetermined confidence decision threshold.

When the nurse call reception operation unit 13 receives a nurse call, the nurse call processing unit 145 notifies the management server device SV of a first event notification communication signal containing the fact as another example of the predetermined event, By using the SU sound input/output unit 12 and the like, voice communication is performed between the terminal devices SP and TA. More specifically, when the nurse call reception operation unit 13 is operated for input, the nurse call processing unit 145 transmits the first event notification communication signal containing the nurse call as the sensor ID of the device itself and the event information by SU communication. It is transmitted to the management server device SV via the IF section 15 . Then, the nurse call processing unit 145 uses the SU sound input/output unit 12 and the like to perform voice communication with the terminal devices SP and TA by, for example, VoIP (Voice over Internet Protocol).

When a video distribution request is received from the fixed terminal SP or the mobile terminal TA via the communication IF section 3, the SU streaming processing section 146 sends a stream to the requesting fixed terminal SP or mobile terminal TA. , a moving image (for example, a live moving image) generated by the camera 11 is distributed via the SU communication IF unit 15 by streaming reproduction.

FIG. 1 shows, as an example, four first to fourth sensor units SU-1 to SU-4 provided corresponding to the monitored person Ob. is installed in a living room RM-1 (not shown) of Mr. A Ob-1 who is one of the monitored persons Ob, and the second sensor unit SU-2 is installed in Mr. B Ob- who is one of the monitored persons Ob. 2, and the third sensor unit SU-3 is installed in the living room RM-3 (not shown) of Mr. C Ob-3, who is one of the monitored persons Ob. , and the fourth sensor unit SU-4 is installed in a living room RM-4 (not shown) of Mr. D Ob-4 who is one of the monitored persons Ob.

In the sensor device SU configured as described above, the sensor unit 11, the sleep state determination unit 142, the behavior determination unit 143, and the processing control unit 144 constitute an example of a behavior detection device.

The management server device SV has a communication function for communicating with the other devices SU, TA, and SP via the network NW, and upon receiving notification of the predetermined event by the first event notification communication signal from the sensor device SU, Information (monitoring information) related to monitoring of the observer Ob is managed, the predetermined event is notified (re-notified, notified, transmitted) to the predetermined terminal devices SP and TA by the second event notification communication signal, and the client (this implementation It is a device that provides the client with data according to a request from a terminal device (SP, TA, etc.) and manages the entire monitored person monitoring support system MS. In the present embodiment, the monitoring information includes, for example, the sensor ID of the sensor device SU which is the transmission source of the first event notification communication signal, the predetermined event (type of predetermined action detected by the sensor device SU, sensor device nurse call received by the SU), the image of the monitored person Ob, the time when the notification was received (notification time), etc. These are stored (recorded and managed) in association with each other. The monitoring information is contained in the second event notification communication signal. Said second event notification communication signal may be transmitted, for example, by broadcast communication (broadcast or multicast), and for example, one or more sensors associated with the sensor device SU from which said first event notification communication signal was transmitted. may be transmitted to the terminals SP, TA of the. Such management server device SV can be configured by, for example, a computer with a communication function.

The fixed terminal device SP has a communication function to communicate with other devices SU, SV, and TA via the network NW, a display function to display predetermined information, and an input function to input predetermined instructions and data. By inputting predetermined instructions and data given to the management server device SV and the portable terminal device TA, and displaying the monitoring information obtained by the sensor device SU in response to a notification from the management server device SV, It is a device that functions as a user interface (UI) of the person monitoring support system MS. Such a fixed terminal device SP can be composed of, for example, a computer with a communication function.

The mobile terminal device TA has a communication function of communicating with other devices SV, SP, and SU via the network NW, a display function of displaying predetermined information, an input function of inputting predetermined instructions and data, and a voice call. inputting predetermined instructions and data given to the management server device SV and the sensor device SU, displaying the monitoring information obtained by the sensor device SU in response to a notification from the management server device SV, It is a device for responding to a nurse call or calling out to the sensor unit SU through voice communication. Such a mobile terminal device TA can be configured by a portable communication terminal device such as a so-called tablet computer, a smart phone, or a mobile phone, for example.

Next, the operation of this embodiment will be described. FIG. 3 is a flow chart showing the operation of the sensor device in service mode. FIG. 4 is a flow chart showing the operation of the sensor device in the action determination process according to the sleep determination result shown in FIG. FIG. 5 is a flow chart showing the operation of the sensor device in the fall determination process shown in FIG. FIG. 6 is a flow chart showing the operation of the sensor device in the overturn determination process shown in FIG. FIG. 7 is a flow chart showing the operation of the sensor device in the bed entry determination process shown in FIG. FIG. 8 is a flow chart showing the operation of the sensor device in the wake-up determination process shown in FIG. FIG. 9 is a flow chart showing the operation of the sensor device in the bed leaving determination process shown in FIG. FIG. 10 is a flow chart showing the operation of the sensor device in the micro-motion abnormality determination process shown in FIG. FIG. 11 is a diagram showing an example of a main screen displayed on the terminal device. FIG. 12 is a diagram showing an example of a first setting screen displayed on the terminal device. FIG. 13 is a diagram showing an example of a second setting screen displayed on the terminal device. FIG. 14 is a diagram showing an example of a monitor information screen displayed on the terminal device.

In the monitored person monitoring support system MS configured as described above, each device SU, SV, SP, and TA initializes each necessary part when the power is turned on, and starts its operation. In the sensor device SU, by executing the control processing program, the SU control processing unit 14 includes an SU control unit 141, a sleep state determination unit 142, an action determination unit 143, a processing control unit 144, a nurse call processing unit 145, and streaming processing. The unit 146 is functionally configured, and the behavior determination unit 143 is functionally configured with a first sub-behavior determination unit 1431 and a second sub-behavior determination unit 1432 .

When the power is turned on and the operation starts, the terminal devices SP and TA, for example, the fixed terminal device SP, accept login operations by supervisors (users) such as nurses and caregivers. In the login operation, an ID such as a user name of the supervisor (user) is input and stored in the storage unit. When the fixed terminal device SP logs into the monitored person monitoring support system MS by a login operation, the fixed terminal device SP displays a main screen on its display unit.

The main screen is a screen for accepting the operation mode of the fixed terminal SP. The main screen 21 includes, for example, a "service mode" button 211 and a "setting mode" button 212, as shown in FIG. The "service mode" button 211 is a button for requesting a service mode for monitoring the monitored person Ob as the operation mode of the fixed terminal SP, and is an instruction (command, command) to operate the fixed terminal SP in the service mode. ) is a button for entering The "setting mode" button 212 is a button for requesting a setting mode for setting predetermined parameters as the operation mode of the fixed terminal SP, and is used to issue an instruction to operate the fixed terminal SP in the setting mode. It is a button for input.

When an input operation is received from the input unit of the fixed terminal device SP while the main screen 21 is being displayed, the fixed terminal device SP causes the control processing unit of the fixed terminal device SP to change the received input operation to "service mode." ” button 211 or the “setting mode” button 212 .

As a result of this determination, if the accepted input operation is the input operation of the "service mode" button 211, the fixed terminal device SP starts operating in the service mode so as to monitor the monitored person Ob. The input operation is, for example, an operation of moving the mouse to move the cursor onto the "service mode" button 211 and left-clicking the mouse.

On the other hand, as a result of the determination, if the accepted input operation is the input operation of the "setting mode" button 212, the fixed terminal SP starts operating in the setting mode so as to set the predetermined parameters. .

In the setting mode, as described above, when the input operation of the "setting mode" button 212 is accepted, the fixed terminal device SP displays the setting screen on its display unit. In this embodiment, authentication is performed using an ID such as a user name, and only authorized users (configurers) can enter the setting mode.

The setting screen is a screen for inputting and setting the predetermined parameters. In the present embodiment, the predetermined parameter is a set value used to appropriately determine the predetermined event. , and the like (determination threshold). More specifically, in this embodiment, the predetermined parameters are the frame rate, brightness level, ceiling height, and the area where the bedding BD is located. The setting screen includes two first and second setting screens in this embodiment. The first setting screen is used to input (determine) the monitored person Ob (sensor device SU) for which parameters are to be set. , brightness level and ceiling height). The second setting screen is a screen for inputting and setting parameters other than numerical parameters (the location area of the bedding BD in this embodiment) among the predetermined parameters.

More specifically, when the input operation of the "setting mode" button 212 is received from the input unit, the fixed terminal device SP displays the first setting screen on the display unit 4 by the control processing unit.

For example, as shown in FIG. 12, the first setting screen 22 includes a monitored person name input setting area 221 for inputting and setting the name of the monitored person Ob, and an area 221 for inputting and setting the frame rate. A frame rate input setting area 222, a brightness level input setting area 223 for inputting and setting the brightness level, a ceiling height input setting area 224 for inputting and setting the ceiling height, and " It has an area setting button 225 and a return to main screen button 226 . Each of the input setting areas 221 to 224 has an input field for parameter values and an "update" button for storing and setting the parameters with the parameter values input in the input fields. The "area setting" button 225 is a button for requesting the second setting screen, and is a button for inputting an instruction to display the second setting screen on the fixed terminal device SP. The "return to main screen" button 226 is a button for requesting the main screen 21, and is a button for inputting an instruction to display the main screen 21 on the fixed terminal device SP. The "return to main screen" button 226 is also a button for setting each parameter value stored as a parameter in the storage section to the sensor device SU via the management server device SV.

In the example shown in FIG. 12, "Mr. A", "15 fps", "5" and "2.4 m" are entered in the input fields in the input setting areas 221 to 224, respectively. When the "Update" button in the monitored person name input setting area 221 is operated, the control processing section of the fixed terminal SP sets the parameter setting target to "Mr. A", and the storage section of the fixed terminal SP stored in It should be noted that the sensor device SU monitoring "Mr. A" or its sensor ID may be input and set as a parameter setting target. When the "Update" button in the frame rate input setting area 222 is operated, the frame rate is set to "15 fps" by the control processing section of the fixed terminal device SP, and stored in the storage section of the fixed terminal device SP. In this embodiment, the sensor unit SU executes the event detection operation for each frame or every several frames, so setting the frame rate defines the execution interval of the event detection operation. When the "update" button in the brightness level input setting area 223 is operated, the brightness level is set to "5" by the control processing section of the fixed terminal SP and stored in the storage section of the fixed terminal SP. be. If the target image captured by the sensor unit SU is too dark or too bright, it becomes difficult to extract the person area of the monitored person Ob from the target image, and it becomes difficult to identify the person. By setting the brightness level, the target image can be generated with appropriate exposure, the person area can be extracted more appropriately, and the person can be identified more appropriately. When the "update" button in the ceiling height input setting area 224 is operated, the ceiling height is set to "2.4 m" by the control processing section of the fixed terminal device SP, and is stored in the storage section of the fixed terminal device SP. remembered. The lying posture determination threshold values and the like for when the sensor device SU is installed on a ceiling with a reference ceiling height (for example, 2.4 m) are pre-stored in the sensor device SU as default values. By setting the ceiling height, the default lying posture determination threshold value is corrected, and the corrected lying posture determination threshold value is used to detect the predetermined behavior described above. By setting the ceiling height, the lying posture determination threshold value can be adjusted according to the situation of the actually installed sensor device SU.

When the input operation of the "area setting" button 225 is accepted, the fixed terminal device SP displays the second setting screen on its display unit.

The second setting screen 23 includes, for example, a target image display area 231 for displaying a target image, an "update" button 232, and a "return" button 233, as shown in FIG. In the target image display area 231, the camera 111 of the sensor unit SU that monitors the monitored person Ob having the name of the monitored person Ob input in the monitored person name input setting area 221 of the first setting screen 22 is displayed. The generated target image is displayed. The “update” button 232 is a button for requesting parameter setting in the area input from the input unit while referring to the target image displayed in the target image display area 231 . The "return" button 233 is a button for requesting the first setting screen 22, and is a button for inputting an instruction to display the first setting screen 22 on the fixed terminal device SP.

In such a second setting screen 23, when the second setting screen 23 is displayed, the fixed terminal device SP waits for input of the location area of the bedding BD. When the user inputs the four vertices of the location area of the bedding BD from the input unit and operates the "update" button 232, the control processing unit of the fixed terminal device SP controls each of the four vertices of the location area of the bedding BD. A pixel position is input and stored in the storage unit, and the location area of the bedding BD is set. FIG. 13 shows how the user has input the four vertices of the location area of the bedding BD.

Then, when the “return” button 233 is operated for input, the first setting screen 22 is displayed on the display section 4 . Further, when the "return to main screen" button 226 is operated to input, the main screen 21 is displayed. SV to the sensor device SU, and the sensor device SU stores and sets the received parameter values in the SU storage unit 16 of its own device SU. Thereby, each value of the predetermined parameter is set in the sensor device SU.

On the other hand, when the input operation of the "service mode" button 211 is accepted on the main screen 21 described above, the fixed terminal device SP operates in the service mode, and the monitored person monitoring support system MS operates as follows. monitors the monitored person Ob.

In monitoring the person to be monitored Ob, the sensor unit SU operates as follows for each frame or every few frames, thereby detecting a predetermined action of the person to be monitored Ob and making a nurse call. The presence or absence of reception is determined.

In FIG. 3, first, the sensor unit SU causes the sleep state determination unit 142 of the SU control processing unit 14 to perform sleep state determination processing for the monitored person Ob based on the Doppler signal of the Doppler sensor 112 in the sensor unit 11 (S1 ). More specifically, the sleep state determination unit 142 acquires from the SU storage unit 16 Doppler signals measured within a predetermined period of time, for example, within one minute from the current time to the past. Subsequently, the sleep state determination unit 142 performs, for example, a fast Fourier transform (FFT) on the acquired 1-minute Doppler signal. Subsequently, the sleep state determination unit 142 obtains the average value of the amplitude in the frequency band corresponding to the general respiration frequency from the spectrum obtained by this FFT. Subsequently, the sleep state determination unit 142 compares the obtained average value with the sleep degree classification threshold value to obtain a sleep degree, and stores the obtained sleep degree in the SU storage unit 16 in chronological order. Subsequently, the sleep state determination unit 142 obtains the duration of the obtained degree of sleep by referring to the SU storage unit 16 . Subsequently, the sleep state determining unit 142 compares the duration of the obtained degree of sleep with the reliability classification threshold to obtain the degree of reliability. For example, in the present embodiment, the sleep degree classification threshold is one value that distinguishes between wakefulness and sleep, and the reliability classification threshold is one value that distinguishes between high confidence and low confidence. . Then, the sleep state determination unit 142 outputs (notifies) the sleep determination result, in this embodiment, the degree of sleep and the degree of reliability obtained as described above to the processing control unit 144 .

Next, the sensor unit SU is operated by the action determination unit 143 of the SU control processing unit 14, based on the target image of the camera 111 in the sensor unit 11 according to the sleep determination result determined by the sleep state determination unit 142 in the process S1. Action determination processing is executed for the monitored person Ob (S2). More specifically, in this embodiment, the processing control unit 144 causes the first sub-behavior determination unit 1431 of the behavior determination unit 143 to perform the first sub-behavior determination process according to the sleep determination result of the sleep state determination unit 142. and whether or not to execute the second sub-behavior determination processing in the second sub-behavior determination unit 1432 of the behavior determination unit 143 . More specifically, in the present embodiment, the processing control unit 144, if the sleep determination result of the sleep state determination unit 142 is higher than the sleep degree or the reliability, the first sub-behavior determination unit 1431 , and the second sub-behavior determination processing in the second sub-behavior determination unit 1432 is executed. That is, processing S21 to processing S27 for determining a first action (in this embodiment, getting into bed, getting up, getting out of bed, falling, and falling) by the first sub-behavior determination unit 1431 are not executed, and the second sub-behavior determination unit 1431 Only the process S28 for determining a second action (abnormal body movement in this embodiment) by the action determination unit 1432 is executed. On the other hand, when the sleep determination result of the sleep state determination unit 142 indicates that both the degree of sleep and the degree of reliability are low, the processing control unit 144 executes the first sub-action determination process in the first sub-action determination unit 1431. , and the second sub-behavior determination processing in the second sub-behavior determination unit 1432 is not executed. That is, the processes S21 to S27 for determining the first action described below by the first sub-behavior determination unit 1431 are executed, and the process S28 for determining the second action described below by the second sub-behavior determination unit 1432 is executed. only does not run.

That is, in this process S2, the process control unit 144 first compares the sleep level and reliability determined by the sleep state determination unit 142 in process S1 with the sleep determination threshold and the reliability determination threshold. As a result of this comparison, if the degree of sleep is equal to or greater than the sleep determination threshold, or if the reliability is equal to or greater than the reliability determination threshold, the processing control unit 144 causes the first sub-behavior determination unit 1431 to The second sub-behavior determination unit 1432 is caused to perform only the process S28 for determining the second action without executing the processes S21 to S27 for determining the first action. On the other hand, as a result of the comparison, if the degree of sleep is less than the sleep determination threshold and the reliability is less than the reliability determination threshold, the processing control unit 144 determines that the first sub-behavior determination unit 1431 Then, the processing S21 to S27 for determining the first action are executed, and the second sub-behavior determining unit 1432 is not made to execute only the processing S28 for determining the second action.

Next, processing S21 to processing S28, in which the processing control unit 144 controls execution or non-execution according to the sleep determination result determined by the sleep state determination unit 142 in the processing S1, will be described.

In FIG. 4 , in process S21, the sensor device SU acquires one frame of image as a target image from the camera 111 of the sensor unit 11 by the action determination unit 143 of the SU control processing unit 14 .

Subsequently, in process S22, the first sub action determination unit 1431 of the action determination unit 143 of the sensor device SU extracts a person area from the target image acquired in process S21 by, for example, a background subtraction method. Note that the first sub-behavior determination unit 1431 may extract the moving body region as the person region from the target image acquired in the process S21 by, for example, the frame subtraction method.

Subsequently, in process S23, the sensor unit SU causes the first sub-behavior determination unit 1431 to execute the fall determination process based on the extracted person area.

More specifically, in this fall determination process, first, in FIG. 5, the first sub-behavior determination unit 1431 determines whether or not a fall determination condition is satisfied based on the human region extracted in step S22 ( S231). More specifically, the first sub-behavior determination unit 142 determines that the size of the head region of the human region extracted from the target image in the process S22 is equal to or smaller than the lying posture determination threshold value, and that the size of the head region When the change speed is equal to or greater than the fall determination speed threshold and the person area is within the fall determination area set around the location area of the bedding BD, it is determined that there is a fall (Yes), and then, Processing S232 is executed, and in other cases than this, it is determined that there is no fall (No), and this fall determination processing is terminated. Here, the head region is extracted from the human region by, for example, circular or elliptical Hough transform, pattern matching using a head model (template) prepared in advance, or head extraction. extracted by a neural network trained for In the processing S232, the first sub-behavior determination unit 1431 determines the occurrence of a fall and outputs information indicating that there is a fall (for example, the fall flag indicating whether or not a fall has occurred is changed from "0" to "1"). The data is stored in the SU storage unit 16, and the fall determination process ends.

Returning to FIG. 4, in the process S24 following the process S23, the first sub-behavior determination unit 1431 of the sensor device SU executes the fall determination process based on the extracted person area.

More specifically, in this fall determination process, first, in FIG. 6, the first sub-behavior determination unit 1431 determines whether or not a fall determination condition is satisfied based on the human region extracted in the process S22 ( S241). More specifically, the first sub-behavior determination unit 142 determines that the size of the head region of the human region extracted from the target image in the process S22 is equal to or smaller than the lying posture determination threshold value, and that the size of the head region If the change speed is equal to or greater than the overturn determination speed threshold and the person area is in the area excluding the location area of the bedding BD and the fall determination area, it is determined that there is overturn (Yes), and then processing S242. is executed, and in other cases, it is determined that there is no overturn (No), and the overturn determination process is terminated. In the process S242, the first sub-behavior determination unit 1431 determines that a fall has occurred and outputs information indicating that a fall has occurred (for example, a fall flag indicating whether or not a fall has occurred is changed from "0" to "1"). The data is stored in the SU storage unit 16, and the turnover determination process ends.

Returning to FIG. 4, in the process S25 following the process S24, the first sub-behavior determination unit 1431 of the sensor device SU executes the bed-going determination process based on the extracted person area.

More specifically, in this bed entry determination process, first, in FIG. 7, the first sub-behavior determination unit 1431 determines whether or not the state variable (previous state variable) is (S251). If the result of this determination is that the state variable is not "getting out of bed" (No), the first sub-behavior determination unit 1431 terminates the actual bed-in determination process. On the other hand, if the result of the determination is that the state variable is "getting out of bed" (Yes), the first sub-behavior determination unit 1431 next executes processing S252. In this process S252, the first sub-behavior determination unit 1431 determines whether or not the determination condition for going to bed is satisfied based on the human region extracted in process S22. More specifically, the first sub-behavior determining unit 1431 determines whether the person area extracted from the target image in the process S22 this time completely overlaps the location area of the bedding BD (the person area completely overlaps the location area of the bedding BD). If it is within), it is tentatively determined to be in bed, and if the duration of the completely superimposed state continues beyond the determination time for continuation of in bed, it is finally determined to be in bed (Yes), and then Then, the process S253 is executed, and in other cases, it is determined that there is no bed admission (No), and the regular bed admission determination process is terminated. In the processing S253, the first sub-behavior determination unit 1431 determines the occurrence of bed admission and determines whether bed admission is present (for example, the bed admission flag indicating presence/absence of bed admission is changed from "0" to "1"). changed) is stored in the SU storage unit 16 . Subsequently, the first sub-behavior determination unit 1431 updates the state variable with “entering bed” (state variable←“entering bed”) (S254), and ends the main entering bed determination process.

Returning to FIG. 4, in the process S26 following the process S25, the first sub-behavior determination unit 1431 of the sensor device SU executes the wake-up determination process based on the extracted person area.

More specifically, in this wake-up determination process, in FIG. 8, first, the first sub-behavior determination unit 1431 determines whether or not the state variable (previous state variable) is (S261). If the result of this determination is that the state variable is not "going to bed" (No), the first sub-behavior determination unit 1431 terminates this wake-up determination process. On the other hand, if the result of the determination is that the state variable is "entering bed" (Yes), the first sub-behavior determination unit 1431 next executes processing S262. In this process S262, the first sub-behavior determination unit 1431 determines whether or not the wake-up determination condition is satisfied based on the human region extracted in process S22. More specifically, the first sub-behavior determination unit 1431 determines that the protruding region in which the person region extracted from the target image in the process S22 this time protrudes from the location region of the bedding BD is equal to or more than the wake-up determination threshold and less than the bed leaving determination threshold. , it is tentatively determined to be awake, and when the duration of the protruding region in the state of being equal to or more than the wakeup determination threshold and less than the leaving the bed determination threshold exceeds the wakeup continuation determination time, it is finally determined that there is a wakeup. Then (Yes), the process S263 is executed, and in other cases, it is determined that there is no wake-up (No), and the wake-up determination process is terminated. In the process S263, the first sub-behavior determination unit 1431 determines the occurrence of wake-up and outputs wake-up presence information indicating the presence of wake-up (for example, the wake-up flag indicating the presence or absence of wake-up is changed from "0" to "1"). Stored in the SU storage unit 16 . Subsequently, the first sub-behavior determination unit 1431 updates the state variable with "wake up" (state variable←"wake up") (S264), and ends the turnover determination process.

Returning to FIG. 4, in the process S27 following the process S26, the first sub-behavior determination unit 1431 of the sensor device SU executes the bed leaving determination process based on the extracted person area.

More specifically, in this bed leaving determination process, first, in FIG. 9, the first sub-behavior determination unit 1431 determines whether or not the state variable (previous state variable) is (S271). As a result of this determination, if the state variable is neither "entering bed" nor "getting up" (No), the first sub-behavior determination unit 1431 terminates this bed leaving determination processing. On the other hand, if the result of the determination is that the state variable is either "going to bed" or "getting up" (Yes), the first sub-behavior determination unit 1431 next executes processing S272. In this process S272, the first sub-behavior determination unit 1431 determines whether or not the condition for determining leaving the bed is satisfied based on the human region extracted in process S22. More specifically, the first sub-behavior determination unit 1431 determines that the human area extracted from the target image in the process S22 this time is out of the location area of the bedding BD, and if the protruding area is equal to or larger than the bed-leaving determination threshold, If the duration of the protruding region that is equal to or greater than the bed leaving determination threshold exceeds the bed leaving continuation determination time, it is finally determined that there is leaving the bed (Yes), and then processing S273 is executed, Otherwise, it is determined that there is no getting out of bed (No), and the process of determining getting out of bed is terminated. In the process S273, the first sub-behavior determination unit 1431 determines the occurrence of leaving the bed and outputs information indicating whether or not leaving the bed is present (for example, the bed leaving flag indicating presence or absence of leaving the bed is changed from "0" to "1"). Stored in the SU storage unit 16 . Subsequently, the first sub-behavior determination unit 1431 updates the state variable with "getting out of bed" (state variable←"getting out of bed") (S274), and ends the turnover determination process.

Returning to FIG. 4, in process S28 following process S27, the second sub-behavior determination unit 1432 of the behavior determination unit 143 of the sensor unit SU determines whether there is a micro-motion abnormality based on the Doppler signal of the Doppler sensor 112 in the sensor unit 11. Execute the judgment process.

More specifically, in this micro-motion abnormality determination process, first, in FIG. (S281). More specifically, the second sub-behavior determination unit 142 first acquires from the SU storage unit 16 Doppler signals measured within a predetermined period of time, for example, within one minute from the current time to the past. Subsequently, the sleep state determination unit 142 performs, for example, a fast Fourier transform (FFT) on the acquired 1-minute Doppler signal. Subsequently, the second sub-behavior determination unit 142 obtains the average amplitude value in the frequency band corresponding to the general respiration frequency from the spectrum obtained by this FFT. Subsequently, the second sub-behavior determining unit 142 compares the obtained average value with the micro-movement abnormality determination threshold, and if the obtained average value is equal to or less than the micro-movement abnormality determination threshold, the micro-body It is tentatively determined that there is an abnormality in motion, and when the duration of the state in which the average value is equal to or less than the threshold value for determining an abnormality in subtle motion continues beyond the determination time for an abnormality in fine motion, it is finally determined that there is an abnormality in fine motion. Otherwise, it is determined that there is no micro-motion abnormality (No), and the micro-motion abnormality determination process ends. In the process S282, the second sub-behavior determination unit 1432 determines occurrence of anomaly in minute body movement and determines the occurrence of anomaly in minute body movement (for example, information indicating the presence of anomaly in minute body movement). flag is changed from "0" to "1") is stored in the SU storage unit 16, and the microbody movement abnormality determination process is terminated.

Whether or not each of the processes S21 through S28 as described above is executed or not is determined by the process control unit 144 according to the sleep determination result determined by the sleep state determination unit 142 in the process S1, as described above. controlled.

Returning to FIG. 3, next, the sensor device SU determines whether or not notification of a predetermined event is required by the SU control processing unit 14 (S3). More specifically, the sensor unit SU causes the action determination unit 143 of the SU control processing unit 14 to store the result of determination of a predetermined action, such as the fall information or the fall information, in the SU storage unit 16. It is determined whether or not it is stored, and if the result of determining the predetermined action is stored in the SU storage unit 16, the action determination unit 143 determines that notification is necessary (Yes), and then , After executing the process S4, the present process is terminated, and on the other hand, if the result of determining the predetermined action is not stored in the SU storage unit 16, the action determination unit 143 determines that notification is unnecessary. Make a decision (No), and end this processing.

In this process S4, the sensor device SU stores the determined predetermined behavior as the event information in order to notify the determined predetermined behavior to the predetermined terminal devices SP and TA by the behavior determination unit 143. A first event notification communication signal related to detection of the predetermined action is transmitted to the management server device SV. In one specific example, when wakeup presence information is stored in the SU storage unit 16, the action determination unit 143 uses the sensor ID of the device itself, “wakeup” as event information, and A first event notification communication signal containing the received target image is transmitted to the management server device SV via the SU communication IF section 15 .

Then, while the processes S1 to S4 are being executed as described above, the sensor unit SU determines whether or not a nurse call is received by the nurse call processing unit 145 of the SU control processing unit 14. Then, when the nurse call is received, the sensor device SU receives the received nurse call as the event information in order to notify the predetermined terminal devices SP and TA of the reception of the nurse call. to the management server device SV.

When the management server device SV receives the first event notification communication signal from the sensor device SU via the network NW, the management server device SV converts each information such as the sensor ID and the event information contained in the first event notification communication signal to the sensor ID. is stored (recorded) as monitoring information of the monitored person Ob who is monitored by the sensor device SU. That is, the management server device SV stores each information such as the sensor ID and the event information contained in the first event notification communication signal in association with each other. Then, the management server device SV transmits the second event notification communication signal to the terminal devices SP and TA of the notification destination corresponding to the sensor device SU that is the transmission source (notification source) in the received first event notification communication signal.

When the fixed terminal device SP and the mobile terminal device TA receive the second event notification communication signal from the management server device SV via the network NW, the fixed terminal device SP and the mobile terminal device TA receive the sensor ID and the event information contained in the second event notification communication signal. Each piece of information is stored (recorded) as monitoring information of the monitored person Ob monitored by the sensor device SU having this sensor ID, and the monitoring information is displayed. For example, when the sensor device SU repeatedly executes the detection operation of a predetermined event but does not detect the predetermined event, the terminal devices SP and TA, for example, the fixed terminal device SP, have the When the monitoring information screen 31a is displayed, the sensor device SU detects a predetermined event, and the detected predetermined event is notified by the second event notification communication signal, the fixed terminal device SP receives the monitoring information shown in FIG. 14B. An information screen 31b is displayed. A monitoring information screen 31a shown in FIG. 14A includes a monitoring image display area 311 that displays an image captured by the sensor device SU. The monitoring information screen 31b shown in FIG. 14B further includes an event display area 312 that displays the type of event detected by the sensor device SU. In the example shown in FIG. 14B , an event display area 312 is shown in which a message “detection of getting out of bed” is superimposed on the monitoring image display area 311 .

For example, if the monitored person is in a sleeping state, actions such as getting into bed, getting out of bed, and falling cannot occur. There is a high probability that it is an erroneous judgment. The monitored person monitoring support system MS and the behavior detection device and behavior detection method incorporated in the sensor device SU in this embodiment control the behavior determination unit 143 according to the sleep determination result of the sleep state determination unit 142. , erroneous determination can be further reduced.

The monitored person monitoring support system MS, the behavior detection device, and the behavior detection method detect the predetermined behavior as a first behavior belonging to a first group that cannot occur in a sleeping state (in this embodiment, going to bed, waking up, etc.). , getting out of bed, falling and falling) and the second behavior belonging to the second group that can occur in the sleep state (abnormal micromotion in this embodiment). The action determination unit 143 can be controlled more appropriately according to the result, and erroneous determination can be further reduced.

The monitored person monitoring support system MS, the behavior detection device, and the behavior detection method, for example, execute only a sub-action determination process that determines behavior that cannot occur in a sleeping state, or conversely, can occur in a sleeping state. By controlling the behavior determination unit 143 according to the sleep determination result of the sleep state determination unit 142, such as executing only the sub-action determination process for determining behavior, erroneous determination can be further reduced.

In the above-described embodiment, the processing control unit 144 causes the first sub-behavior determination unit 1431 to The first sub-behavior determination process is not executed, the second sub-behavior determination unit 1432 is caused to execute the second sub-behavior determination process, and the sleep determination result of the sleep state determination unit 142 indicates that both the degree of sleep and the degree of reliability are When it is low, the first sub-behavior determination unit 1431 is caused to execute the first sub-behavior determination process, and the second sub-behavior determination unit 1432 is caused to execute the second sub-behavior determination process. As described above, the processing control unit 144 may control the action determination unit 143 according to the sleep determination result of the sleep state determination unit 142 .

In the first modification, regardless of whether or not the first sub-behavior determination process is executed in the first sub-behavior determination unit 1431, the processing control unit 144 determines whether the sleep determination result of the sleep state determination unit 142 is the sleep degree and the confidence level. If any of the degrees is high, only the second sub-behavior determination unit 1432 is set as the control target, and the second sub-behavior determination unit 1432 is caused to execute the second sub-behavior determination process. Regardless of whether or not the first sub-behavior determination process is executed in the first sub-behavior determination unit 1431, the processing control unit 144 determines whether the sleep determination result of the sleep state determination unit 142 is low when both the degree of sleep and the degree of reliability are low. , controls only the second sub-behavior determination unit 1432 and does not cause the second sub-behavior determination unit 1432 to execute the second sub-behavior determination process. In one example, the process control unit 144 determines whether or not to execute the process S28 without controlling whether to execute each of the processes S21 to S27 described using FIG. Control is performed according to the sleep determination result of the unit 142 . Accordingly, the behavior determination unit 143 is controlled so as to determine only behaviors that can occur in the sleep state, and the monitored person monitoring support system MS, the behavior detection device, and the behavior detection method can further reduce erroneous determinations.

In the second modification, the processing control unit 144 determines whether or not to output the first sub-behavior determination result in the first sub-behavior determination unit 1431 according to the sleep determination result of the sleep state determination unit 142, It controls whether or not to output the second sub-behavior determination result in the second sub-behavior determination unit 1432 . In the second modification, although the first and second sub-behavior determination processes are executed, by controlling the output of the results, an effect equivalent to that obtained by controlling the execution can be obtained. More specifically, when the sleep determination result of the sleep state determination unit 142 indicates that either the degree of sleep or the degree of reliability is high, the processing control unit 144 instructs the first sub-behavior determination unit 1431 to The first sub-behavior determination result is not output, and the second sub-behavior determination unit is caused to output the second sub-behavior determination result. In one example, the process control unit 144, in each of the processes S21 to S27 described above with reference to FIG. The determination unit 1431 does not store in the SU storage unit 16 the result of determining the predetermined action, such as the fall information or the fall information, and in the above-described processing S28 described with reference to FIG. When the second sub-behavior determining unit 1432 determines the predetermined behavior, the second sub-behavior determining unit 1432 stores the result of determining the predetermined behavior, for example, the information indicating that there is an abnormality in slight body movement, in the SU storage unit 16. Memorize. When the sleep determination result of the sleep state determination unit 142 indicates that both the degree of sleep and the degree of reliability are low, the processing control unit 144 causes the first sub-action determination unit 1431 to output the first sub-action determination result, Then, the second sub-behavior determination unit 1432 is caused to output the second sub-behavior determination result. In one example, the processing control unit 144 performs the first sub-behavior determination when the first sub-behavior determining unit 1431 determines the predetermined behavior in each of the above-described processing S21 to processing S27 described using FIG. The unit 1431 causes the SU storage unit 16 to store the result of determining the predetermined action, such as the falling information or the falling information, and in the above-described processing S28 described using FIG. Even if the behavior determining unit 1432 determines the predetermined behavior, the second sub-behavior determining unit 1432 does not store in the SU storage unit 16 the result of determining the predetermined behavior, for example, the information indicating that there is an abnormality in slight body movement. .

Alternatively, in the second modification, regardless of whether or not the first sub-behavior determination result of the first sub-behavior determination unit 1431 is output, the processing control unit 144 determines whether the sleep determination result of the sleep state determination unit 142 is the sleep degree. and when either one of the reliability is high, only the second sub-behavior determination unit 1432 is set as the control target, and the second sub-behavior determination unit 1432 is caused to output the second sub-behavior determination result. When the sleep determination result of the sleep state determination unit 142 indicates that both the degree of sleep and the degree of reliability are low, the processing control unit 144 sets only the second sub-action determination unit 1432 as the control target, and the second sub-action determination unit 1432 The output of the second sub-behavior determination result in is not performed. In one example, the process control unit 144 does not control whether or not to output the first sub-behavior determination result in each of the processes S21 to S27 described with reference to FIG. Whether or not to output the sub-action determination result is controlled according to the sleep determination result of the sleep state determination unit 142 .

According to this, the monitored person monitoring support system MS, the behavior detection device, and the behavior detection method output only the sub-action determination result of the sub-action determination process that determines behavior that cannot occur in a sleeping state, for example. Or conversely, the action determination unit 143 is activated according to the sleep determination result of the sleep state determination unit 142 so as to output only the sub-behavior determination result of the sub-behavior determination process for determining the behavior that can occur in the sleep state. By controlling, erroneous determination can be further reduced.

In the third modification, the processing control unit 144 converts the first sub-behavior determination result of the first sub-behavior determination unit 1431 into the second sub-behavior determination result of the second sub-behavior determination unit 1432 according to the sleep determination result of the sleep state determination unit 142 . Control whether or not to assist with the action determination result. More specifically, for example, when the sleep determination result of the sleep state determination unit 142 indicates that either the degree of sleep or the degree of reliability is high, the processing control unit 144 causes the first sub-behavior determination unit 1431 to The first sub-behavior determination result is assisted by the second sub-behavior determination result of the second sub-behavior determination unit 1432, and when the sleep determination result of the sleep state determination unit 142 is low in both the degree of sleep and the degree of reliability, the second The first sub-behavior determination result in the first sub-behavior determination unit 1431 is not assisted by the second sub-behavior determination result in the second sub-behavior determination unit 1432 . More specifically, when the sleep determination result of the sleep state determination unit 142 indicates that either the degree of sleep or the degree of reliability is high, the processing control unit 144 determines whether the first sub-behavior of the first sub-behavior determination unit 1431 The determination result is rewritten as the second sub-behavior determination result in the second sub-behavior determination unit 1432 . That is, regardless of the first sub-behavior determination result, only the second sub-behavior determination result is valid. Alternatively, when the sleep determination result of the sleep state determination unit 142 indicates that either the degree of sleep or the degree of reliability is high, the processing control unit 144 , the second sub-behavior determination result in the second sub-behavior determination unit 1432 is added. That is, the second sub-behavior determination result is attached to the first sub-behavior determination result, and the first event notification communication signal contains the determined first and second behaviors as the event information.

According to this, the supervised person monitoring support system MS, the behavior detection device, and the behavior detection method, for example, in the case of a sleeping state, sub-behavior determination processing of sub-behavior determination processing that determines behavior that cannot occur in a sleeping state. Since it is possible to assist the determination result with the sub-behavior determination result of the sub-behavior determination process for determining the behavior that can occur in the sleeping state, it is possible to further reduce erroneous determination.

In a fourth modification, the first sub-behavior determination process compares a first sub-measurement result of the first sub-sensor with a preset first behavior determination threshold associated with the first behavior. The processing control unit 144 executes the above-described control by the first sub-action determination unit 1431 according to the sleep determination result of the sleep state determination unit 142. Change the first action determination threshold in the first sub-behavior determination process. More specifically, the processing control unit 144, as the control, if the sleep determination result of the sleep state determination unit 142 is high either of the sleep level and the reliability, the sleep state determination unit 142 The first action determination threshold value is changed to a value that makes it difficult to determine that the first action is the first action compared to when both the degree of sleep and the degree of reliability of the sleep determination result are low. As the control, when the sleep determination result of the sleep state determination unit 142 is low in both the sleep degree and the reliability, the processing control unit 144 determines that the sleep determination result of the sleep state determination unit 142 is the sleep degree and the reliability. The first action determination threshold value is changed to a value at which the first action is likely to be determined as compared with the case where one of the degrees is high. In the above-described embodiment, the wakeup determination threshold, the bed leaving determination threshold, the lying posture determination threshold, the fall determination speed threshold, and the fall determination speed threshold each correspond to an example of the first action determination threshold. One or more of the wake-up determination threshold, the bed leaving determination threshold, the lying posture determination threshold, the fall determination speed threshold, and the fall determination speed threshold is determined by the processing control unit 144 as the sleep determination result of the sleep state determination unit 142. changed according to

According to this, the monitored person monitoring support system MS, the behavior detection device, and the behavior detection method, for example, in the case of a sleep state, perform behavior determination in a sub-action determination process that determines behavior that cannot occur in the sleep state. Since it is possible to change the threshold value to a value at which it is not possible to substantially determine that the action is the action, erroneous determination can be further reduced.

In a fifth modification, the second sub-behavior determination process compares a second sub-measurement result of the second sub-sensor with a preset second behavior determination threshold associated with the second behavior. The processing control unit 144 executes the above-described control by the second sub-action determination unit 1432 according to the sleep determination result of the sleep state determination unit 142. Change the second action determination threshold in the second sub action determination process. More specifically, when the sleep determination result of the sleep state determination unit 142 is low in both the sleep degree and the reliability, the processing control unit 144 controls the sleep determination result of the sleep state determination unit 142 as the control. The second behavior determination threshold value is changed to a value that makes it difficult to determine that the second behavior is the second behavior compared to when either the degree of sleep or the degree of reliability is high. As the control, the processing control unit 144 determines that the sleep determination result of the sleep state determination unit 142 is higher than the sleep degree or the reliability when the sleep determination result of the sleep state determination unit 142 is higher than the sleep state. The second action determination threshold is changed to a value at which the second action is likely to be determined as compared to when both the degree and the reliability are low. In the above-described embodiment, the threshold for determining abnormality in minute body movement corresponds to an example of the threshold for determining the second action. It is changed according to the judgment result.

According to this, the monitored person monitoring support system MS, the behavior detection device, and the behavior detection method, for example, in the case of a sleeping state, the behavior determination threshold value of the sub-behavior determination processing that determines behavior that can occur in the sleep state. can be changed to a value that is likely to be determined as the action, so that erroneous determination can be further reduced.

In the sixth modification, the first sub-behavior determination process includes a preset sub-measurement result of the first sub-sensor and a preset sub-measurement associated with the first behavior at predetermined time intervals. provisionally determining whether or not it is the first action by comparing with a first action determination threshold value, and determining whether the tentatively determined result of the provisional determination is the first action, a preset first continuation determination This is the process of finally determining that it is the first behavior if it continues for a period of time. The first continuation determination time in the first sub-behavior determination process executed by the behavior determination unit 1431 is changed. As the control, the processing control unit 144 determines that the sleep determination result of the sleep state determination unit 142 is higher than the sleep degree or the reliability when the sleep determination result of the sleep state determination unit 142 is higher than the sleep state. The first continuation determination time is changed to a value that is less likely to be determined to be the first action than when both the degree and the reliability are low. As the control, when the sleep determination result of the sleep state determination unit 142 is low in both the sleep degree and the reliability, the processing control unit 144 determines that the sleep determination result of the sleep state determination unit 142 is the sleep degree and the reliability. The first continuation determination time is changed to a value that is more likely to be determined as the first action than when one of the degrees is high. In the above-described embodiment, the bed continuation determination time, the wake-up continuation determination time, and the bed leaving continuation determination time each correspond to an example of the first continuation determination time. One or more of the continuation determination time and the out-of-bed continuation determination time are changed by the process control unit 144 according to the sleep determination result of the sleep state determination unit 142 .

According to this, the supervised person monitoring support system MS, the behavior detection device, and the behavior detection method, for example, in the case of a sleeping state, continue determination of sub-behavior determination processing that determines behavior that cannot occur in a sleeping state. Since it is possible to change the time to a value at which it is not possible to substantially determine that the action is the action, erroneous determination can be further reduced.

In the seventh modification, the second sub-behavior determination process includes a preset sub-measurement result of the second sub-sensor and a preset sub-measurement associated with the second behavior at preset predetermined time intervals. provisionally determining whether or not the second behavior is the second behavior by comparing with a second behavior determination threshold, and determining that the provisionally determined result of the tentative determination is the second behavior, a preset second continuation determination; It is a process of finally determining that it is the second behavior when it continues for a time. The second continuation determination time in the second sub-behavior determination process executed by the sub-behavior determination unit is changed. As the control, the processing control unit 144 determines that the sleep determination result of the sleep state determination unit 142 is higher than the sleep degree or the reliability when the sleep determination result of the sleep state determination unit 142 is higher than the sleep state. The second continuation determination time is changed to a value that is more likely to be determined to be the second action than when both the degree and the reliability are low. As the control, when the sleep determination result of the sleep state determination unit 142 is low in both the sleep degree and the reliability, the processing control unit 144 determines that the sleep determination result of the sleep state determination unit 142 is the sleep degree and the reliability. The second continuation determination time is changed to a value that is less likely to be determined to be the second action than when one of the degrees is high. In the above-described embodiment, the abnormal minute body movement continuation determination time corresponds to an example of the second continuation determination time. is changed according to the sleep determination result.

According to this, the monitored person monitoring support system MS, the behavior detection device, and the behavior detection method, for example, in the case of a sleeping state, determine the duration of the sub-behavior determination process that determines behavior that can occur in the sleeping state. can be changed to a value that is likely to be determined as the action, so that erroneous determination can be further reduced.

In the eighth modification, the processing control unit 144 determines whether or not to cause the first sub-behavior determination unit 1431 to use the first sub-measurement result of the first sub-sensor according to the sleep determination result of the sleep state determination unit 142. Also, it controls whether or not the second sub-behavior determination unit 1432 is caused to use the second sub-measurement result of the second sub-sensor. In the above-described embodiment and the first modification, the execution of the behavior determination process in the behavior determination unit 143 is controlled, and in the second modification, the output of the behavior determination result in the behavior determination unit 143 is controlled. In the modified form, by controlling the input of the action determination unit 143, an effect equivalent to that obtained by controlling the execution and controlling the output can be obtained. More specifically, when the sleep determination result of the sleep state determination unit 142 indicates that either the degree of sleep or the degree of reliability is high, the processing control unit 144 instructs the first sub-behavior determination unit 1431 to The first sub-measurement result of one sub-sensor (in the above embodiment, the target image generated by the camera 111 of the sensor unit 11) is used, and the second sub-behavior determination unit 1432 is made to use the second sub-measurement of the second sub-sensor. The result (the Doppler signal generated by the Doppler sensor 112 of the sensor unit 11 and stored in the SU storage unit 16 in the above embodiment) is used. In one example, the process control unit 144 causes the first sub-behavior determination unit 1431 to use the target image generated by the camera 111 in each of the processes S21 to S27 described above with reference to FIG. , the second sub action determination unit 1432 is made to use the Doppler signal generated by the Doppler sensor 112 and stored in the SU storage unit 16 . When the sleep determination result of the sleep state determination unit 142 indicates that both the degree of sleep and the degree of reliability are low, the processing control unit 144 sends the first sub-measurement result of the first sub-sensor (described above) to the first sub-behavior determination unit 1431 . Then, the second sub-behavior determination unit 1432 is made not to use the second sub-measurement result (the Doppler signal in the above description) of the second sub-sensor. In one example, the process control unit 144 causes the first sub-behavior determination unit 1431 to use the target image generated by the camera 111 in each of the processes S21 to S27 described above with reference to FIG. , the Doppler signal generated by the Doppler sensor 112 and stored in the SU storage unit 16 is not used by the second sub action determination unit 1432 . That is, process S28 is not executed. When the sleep determination result of the sleep state determination unit 142 indicates that either the degree of sleep or the degree of reliability is high, the processing control unit 144 instructs the first sub-behavior determination unit 1431 to select the first sub-sensor of the first sub-sensor. The measurement result (the target image in the above description) is not used, and the second sub-behavior determining unit 1432 is made to use the second sub-measurement result (the Doppler signal in the above description) of the second sub-sensor. In one example, the processing control unit 144 does not allow the first sub-behavior determining unit 1431 to use the target image generated by the camera 111 in each of the processes S21 to S27 described using FIG. In S 28 , the second sub action determination unit 1432 is made to use the Doppler signal generated by the Doppler sensor 112 and stored in the SU storage unit 16 . That is, each process of process S21 to process S27 is not executed.

According to this, the monitored person monitoring support system MS, the behavior detection device, and the behavior detection method prevent the sub-measurement results from being used by the sub-behavior determination unit that determines behavior that cannot occur in a sleeping state, for example. Conversely, control the behavior determination unit 143 according to the sleep determination result of the sleep state determination unit 142 so that the sub-measurement result is used by the sub-behavior determination unit that determines behavior that may occur in the sleep state. , the erroneous determination can be further reduced.

In the ninth modification, the first sub-behavior determination process determines whether or not the current behavior is the first behavior based on the first sub-measurement result of the first sub-sensor and the past first sub-behavior determination result. The processing control unit 144 forcibly changes the current first sub-behavior determination result to a preset specified value according to the sleep determination result of the sleep state determination unit 142 . In the above-described embodiment, the state variable corresponds to an example of the past first sub-behavior determination result. For example, the processing control unit 144 forcibly updates the state variable with "going to bed" when the sleep determination result of the sleep state determination unit 142 indicates that either the degree of sleep or the degree of reliability is high. . Therefore, even if the wake-up is erroneously determined, the wake-up can be determined again, and the erroneous determination can be further reduced.

According to this, in the monitored person monitoring support system MS, the behavior detection device, and the behavior detection method, the current first sub behavior determination result is set in advance according to the sleep determination result of the sleep state determination unit 142. Since the value is forcibly changed to the specified value, the next first sub-behavior determination process can be performed more appropriately, and erroneous determination can be further reduced.

In the tenth modification, as indicated by the dashed line in FIG. 2, the sensor device SU functionally further includes a clock unit 147 for clocking the year, month, day, hour, and minute in the SU control processing unit 14, and determines at least the time zone of sleep. The SU storage unit 16 further includes a schedule information storage unit 161 that stores schedule information representing the schedule of the monitored person Ob, including the schedule of the monitored person Ob, in association with the monitored person Ob. , extracts the schedule of the monitored person Ob corresponding to the acquired current time from the schedule information storage unit 161, and extracts the schedule of the monitored person Ob and the sleep determination result of the sleep state determination unit 142 , the action determination unit 143 is controlled accordingly. For example, if the schedule of the monitored person Ob corresponding to the current time is a sleep time zone, the processing control unit 144, for example, determines that the sleep determination result of the sleep state determination unit 142 has both the sleep degree and the reliability. The first action determination threshold is changed to a value that is less likely to be determined to be the first action than when it is low, or, for example, if the sleep determination result of the sleep state determination unit 142 is the sleep degree and the reliability The second action determination threshold is changed to a value that is more likely to be determined as the second action than when both are low, or for example, the sleep determination result of the sleep state determination unit 142 is the sleep degree and the reliability The first continuation determination time is changed to a value that is less likely to be determined to be the first action compared to the case where both are low. The second continuation determination time is changed to a value that is more likely to be determined to be the second action than when both degrees are low.

According to this, the monitored person monitoring support system MS, the behavior detection device, and the behavior detection method control the behavior determination unit 143 according to the schedule of the monitored person Ob and the sleep determination result of the sleep state determination unit 142. Therefore, the schedule of the monitored person Ob can be taken into consideration, and erroneous determination can be further reduced.

Although this specification discloses various aspects of the technology as described above, the main technologies thereof are summarized below.

A behavior detection device according to one aspect includes first and second sensors that measure a monitored person, and a sleep state determining unit that determines the sleep state of the monitored person based on a first measurement result of the first sensor. a behavior determination unit that determines a predetermined behavior of the monitored person based on a second measurement result of the second sensor; and processing control that controls the behavior determination unit according to the sleep determination result of the sleep state determination unit. and a part.

For example, if the monitored person is in a sleeping state, behaviors such as getting into bed, getting out of bed, and falling cannot occur. There is a high probability that it will be a judgment. Since the behavior detection device controls the behavior determination unit according to the sleep determination result of the sleep state determination unit, erroneous determination can be further reduced.

In another aspect, in the behavior detection device described above, the second sensor includes first and second sub-sensors that measure the monitored person, and the behavior determination unit determines the first sub-measurement result of the first sub-sensor. a first sub-behavior determination unit that determines a first sub-behavior determination process that determines a first behavior belonging to a first group among predetermined behaviors of the monitored person based on a second sub-behavior determining unit that determines a second behavior belonging to a second group different from the first group among predetermined behaviors of the monitored person based on the measurement result; and the processing control unit controls at least one of the first and second sub-behavior determination units according to the sleep determination result of the sleep state determination unit. Preferably, in the above-described behavior detection device, the first behavior includes going into bed by the monitored person getting into the bedding, getting up by the monitored person getting up, getting out of bed by the monitored person leaving the bedding, and moving the monitored person into the bedding. Includes falls from the bed and falls where the supervised person falls outside the bedding. Preferably, in the above-described behavior detection device, the second behavior includes abnormal micro-movement, which is abnormal micro-movement due to breathing of the monitored person. Preferably, in the behavior detection device described above, the first sensor and the second sub-sensor are a single Doppler sensor, and the sleep state determination unit detects the monitored person based on the Doppler signal of the Doppler sensor. A sleep state determination process for determining a sleep state is executed, and the second sub-behavior determination unit selects a predetermined behavior of the monitored person based on the Doppler signal of the Doppler sensor for a second group different from the first group. A second sub action determination process for determining a second action belonging to a group is executed.

Such a behavior detection device can classify the predetermined behavior into a first behavior belonging to a first group that cannot occur in a sleeping state and a second behavior belonging to a second group that can occur in a sleeping state. Therefore, the action determination unit can be controlled more appropriately according to the sleep determination result of the sleep state determination unit, and erroneous determination can be further reduced.

In another aspect, in the behavior detection device described above, the processing control unit executes the first sub-behavior determination process in the first sub-behavior determination unit according to the sleep determination result of the sleep state determination unit. and whether or not to execute the second sub-behavior determination processing in the second sub-behavior determination unit. Preferably, in the behavior detection device described above, the sleep state determination unit determines a degree of sleep representing the degree of depth of sleep of the monitored person based on a first measurement result of the first sensor, and a reliability of the degree of sleep. Calculate the reliability that expresses the degree of sexuality. Preferably, in the behavior detection device described above, the processing control unit performs the first sub-behavior determination when the sleep determination result of the sleep state determination unit is high either of the degree of sleep and the degree of reliability. section does not execute the first sub-behavior determination process, and the second sub-behavior determination section is caused to execute the second sub-behavior determination process. The case where the sleep determination result of the sleep state determination unit is high either of the sleep level and the reliability means that the sleep level is equal to or higher than a predetermined sleep determination threshold set in advance, or the reliability degree is greater than or equal to a predetermined reliability determination threshold set in advance. Preferably, in the behavior detection device described above, when the sleep determination result of the sleep state determination unit is low in both the degree of sleep and the reliability, the processing control unit instructs the first sub behavior determination unit to 1 sub-behavior determination processing is executed, and the second sub-behavior determination unit is not caused to execute the second sub-behavior determination processing. When the sleep determination result of the sleep state determination unit indicates that both the sleep level and the reliability level are low, the sleep level is less than a predetermined sleep determination threshold value set in advance, and the reliability level is set in advance. is less than a predetermined confidence decision threshold. Preferably, in the behavior detection device described above, the processing control unit performs the second sub-behavior determination when either the sleep level or the reliability is high in the sleep determination result of the sleep state determination unit. Only the sub-behavior determination unit is set as a control target, and the second sub-behavior determination unit is caused to execute the second sub-behavior determination process. Preferably, in the behavior detection device described above, the processing control unit controls only the second sub-behavior determination unit when both the sleep degree and the reliability of the sleep determination result of the sleep state determination unit are low. target, and the second sub-behavior determination unit is not caused to execute the second sub-behavior determination processing.

Such a behavior detection device, for example, executes only sub-action determination processing for determining behavior that cannot occur in a sleeping state, or conversely, performs only sub-action determination processing for determining behavior that can occur in a sleep state. By controlling the behavior determination unit according to the sleep determination result of the sleep state determination unit so that the behavior is determined by the sleep state determination unit, erroneous determination can be further reduced.

In another aspect, in the behavior detection device described above, the processing control unit outputs the first sub-behavior determination result of the first sub-behavior determination unit according to the sleep determination result of the sleep state determination unit. and whether or not to output the second sub-behavior determination result in the second sub-behavior determination unit. Preferably, in the behavior detection device described above, the processing control unit performs the first sub-behavior determination when the sleep determination result of the sleep state determination unit is high either of the degree of sleep and the degree of reliability. section does not output the first sub-behavior determination result, and the second sub-behavior determination section is made to output the second sub-behavior determination result. Preferably, in the behavior detection device described above, when the sleep determination result of the sleep state determination unit is low in both the degree of sleep and the reliability, the processing control unit instructs the first sub behavior determination unit to The first sub-behavior determination result is output, and the second sub-behavior determination unit is prevented from outputting the second sub-behavior determination result. Preferably, in the behavior detection device described above, the processing control unit performs the second sub-behavior determination when either the sleep level or the reliability is high in the sleep determination result of the sleep state determination unit. Only the sub-behavior determination unit is set as a control target, and the second sub-behavior determination unit is caused to output the second sub-behavior determination result. Preferably, in the behavior detection device described above, the processing control unit controls only the second sub-behavior determination unit when both the sleep degree and the reliability of the sleep determination result of the sleep state determination unit are low. target, and the second sub-behavior determination unit is not made to output the second sub-behavior determination result.

Such a behavior detection device outputs, for example, only a sub-behavior determination result of a sub-behavior determination process that determines behavior that cannot occur in a sleeping state. By controlling the action determination unit according to the sleep determination result of the sleep state determination unit, such as outputting only the sub-action determination result of the process, erroneous determination can be further reduced.

In another aspect, in the behavior detection device described above, the processing control unit converts the first sub-behavior determination result of the first sub-behavior determination unit to the second sub-behavior determination unit according to the sleep determination result of the sleep state determination unit. It controls whether or not to assist with the result of the second sub-behavior determination in the behavior determination unit. Preferably, in the behavior detection device described above, the processing control unit performs the first sub-behavior determination when the sleep determination result of the sleep state determination unit is high either of the degree of sleep and the degree of reliability. The first sub-behavior determination result in the unit is assisted by the second sub-behavior determination result in the second sub-behavior determination unit, and when the sleep determination result of the sleep state determination unit is low in both the sleep degree and the reliability , the first sub-behavior determination result of the first sub-behavior determination unit is not assisted by the second sub-behavior determination result of the second sub-behavior determination unit. Preferably, in the behavior detection device described above, the processing control unit performs the first sub-behavior determination when the sleep determination result of the sleep state determination unit is high either of the degree of sleep and the degree of reliability. The first sub-behavior determination result in the section is rewritten to the second sub-behavior determination result in the second sub-behavior determination section. Preferably, in the behavior detection device described above, the processing control unit performs the first sub-behavior determination when the sleep determination result of the sleep state determination unit is high either of the degree of sleep and the degree of reliability. The second sub-behavior determination result of the second sub-behavior determination unit is added to the first sub-behavior determination result of the unit.

For example, in the case of a sleep state, such a behavior detection device uses a sub-action determination result of a sub-action determination process that determines behavior that cannot occur in a sleep state as a sub-action determination process that determines behavior that can occur in a sleep state. Since it is possible to assist with the sub-behavior determination result of , erroneous determination can be further reduced.

In another aspect, in the behavior detection device described above, the first sub-behavior determination process includes a first sub-measurement result of the first sub-sensor and a preset first sub-behavior associated with the first behavior. It is a process of determining whether or not it is the first action by comparing with an action determination threshold, and the processing control unit performs the control according to the sleep determination result of the sleep state determination unit. The first action determination threshold in the first sub-action determination process executed by the sub-action determination unit is changed. Preferably, in the above-described behavior detection device, the processing control unit performs the control, if the sleep determination result of the sleep state determination unit is high either of the degree of sleep and the degree of reliability, the sleep The first action determination threshold value is changed to a value that makes it difficult to determine that the sleep determination result of the state determination unit is the first action compared to when both the sleep level and the reliability level are low. Preferably, in the behavior detection device described above, the processing control unit controls the sleep state determination unit when both the sleep degree and the reliability of the sleep determination result of the sleep state determination unit are low. The first action determination threshold value is changed to a value at which the sleep determination result is more likely to be determined to be the first action than when either the sleep level or the reliability level is high.

Such an action detection device, for example, in the case of a sleep state, changes the action determination threshold value of the sub-action determination process that determines an action that cannot occur in the sleep state to a value that cannot be substantially determined to be the action. , etc., so that erroneous determinations can be further reduced.

In another aspect, in the behavior detection device described above, the second sub-behavior determination process includes a second sub-measurement result of the second sub-sensor and a preset second behavior associated with the second behavior. It is a process of determining whether or not it is the second action by comparing with an action determination threshold, and the processing control unit performs the control according to the sleep determination result of the sleep state determination unit. The second action determination threshold in the second sub-action determination process executed by the sub-action determination unit is changed. Preferably, in the behavior detection device described above, the processing control unit controls the sleep state determination unit when both the sleep degree and the reliability of the sleep determination result of the sleep state determination unit are low. The second action determination threshold is changed to a value that makes it more difficult to determine that the second action is the second action compared to when either the sleep degree or the reliability is high in the sleep determination result. Preferably, in the above-described behavior detection device, the processing control unit performs the control, if the sleep determination result of the sleep state determination unit is high either of the degree of sleep and the degree of reliability, the sleep The second action determination threshold value is changed to a value at which the sleep determination result of the state determination unit is more likely to be determined to be the second action than when both the sleep degree and the reliability are low.

For example, in the case of a sleep state, such a behavior detection device can change the behavior determination threshold value of the sub-action determination process that determines behavior that can occur in the sleep state to a value that is likely to be determined to be the behavior. Since this becomes possible, erroneous determination can be further reduced.

In another aspect, in the behavior detection device described above, the first sub-behavior determination process corresponds to the first sub-measurement result of the first sub-sensor and the first behavior at predetermined time intervals set in advance. Temporarily determining whether or not it is the first action by comparing it with a preset first action determination threshold attached, and preliminarily determining that the provisionally determined result of the tentative determination is the first action If it continues for the set first continuation determination time, it is a process to finally determine that it is the first action, and the processing control unit performs the sleep determination of the sleep state determination unit as the control. According to the result, the first continuation determination time in the first sub-behavior determination process executed by the first sub-behavior determination unit is changed. Preferably, in the above-described behavior detection device, the processing control unit performs the control, if the sleep determination result of the sleep state determination unit is high either of the degree of sleep and the degree of reliability, the sleep The first continuation determination time is changed to a value that is less likely to be determined to be the first action than when the sleep determination result of the state determination unit is low in both the sleep degree and the reliability. Preferably, in the behavior detection device described above, the processing control unit controls the sleep state determination unit when both the sleep degree and the reliability of the sleep determination result of the sleep state determination unit are low. The first continuation determination time is changed to a value at which the sleep determination result is likely to be determined to be the first action compared to when either the sleep level or the reliability level is high.

For example, in the case of a sleep state, such a behavior detection device changes the continuation determination time of the sub-behavior determination process that determines behavior that cannot occur in the sleep state to a value that cannot be substantially determined to be the behavior. , etc., so that erroneous determinations can be further reduced.

In another aspect, in the behavior detection device described above, the second sub-behavior determination process corresponds to the second sub-measurement result of the second sub-sensor and the second behavior at predetermined time intervals set in advance. Temporarily determining whether or not the second action is the second action by comparing it with a preset second action determination threshold attached, and determining in advance that the provisionally determined provisional determination result is the second action If it continues for the set second continuation determination time, it is a process to finally determine that it is the second action, and the processing control unit performs the control of sleep determination by the sleep state determination unit The second continuation determination time in the second sub-behavior determination process executed by the second sub-behavior determination unit is changed according to the result. Preferably, in the above-described behavior detection device, the processing control unit performs the control, if the sleep determination result of the sleep state determination unit is high either of the degree of sleep and the degree of reliability, the sleep The second continuation determination time is changed to a value at which the sleep determination result of the state determination unit is likely to be determined to be the second behavior compared to when both the sleep level and the reliability level are low. Preferably, in the behavior detection device described above, the processing control unit controls the sleep state determination unit when both the sleep degree and the reliability of the sleep determination result of the sleep state determination unit are low. The second continuation determination time is changed to a value that is less likely to be determined to be the second behavior than when either the degree of sleep or the degree of reliability in the sleep determination result is high.

For example, in the case of a sleep state, such a behavior detection device can change the continuation determination time of the sub-behavior determination process that determines behavior that can occur in the sleep state to a value that is likely to be determined to be the behavior. Since this becomes possible, erroneous determination can be further reduced.

In another aspect, in the behavior detection device described above, the processing control unit sends the first sub measurement result of the first sub sensor to the first sub behavior determination unit according to the sleep determination result of the sleep state determination unit. and whether or not the second sub-behavior determination unit is allowed to use the second sub-measurement result of the second sub-sensor. Preferably, in the behavior detection device described above, the processing control unit performs the first sub-behavior determination when the sleep determination result of the sleep state determination unit is high either of the degree of sleep and the degree of reliability. section uses the first sub-measurement result of the first sub-sensor, and causes the second behavior-determining section to use the second sub-measurement result of the second sub-sensor. Preferably, in the behavior detection device described above, when the sleep determination result of the sleep state determination unit is low in both the degree of sleep and the reliability, the processing control unit instructs the first sub behavior determination unit to The first sub-measurement result of one sub-sensor is used, and the second sub-behavior determining unit is not made to use the second sub-measurement result of the second sub-sensor. Preferably, in the behavior detection device described above, the processing control unit performs the first sub-behavior determination when the sleep determination result of the sleep state determination unit is high either of the degree of sleep and the degree of reliability. section does not use the first sub-measurement result of the first sub-sensor, and causes the second behavior-determining section to use the second sub-measurement result of the second sub-sensor.

For example, such a behavior detection device does not allow the sub-measurement result to be used by the sub-behavior determination unit that determines behavior that cannot occur in the sleep state, or conversely, the sub-behavior determination unit that determines behavior that can occur in the sleep state. By controlling the behavior determination unit according to the sleep determination result of the sleep state determination unit such that the sub-measurement result is used in the sleep state determination unit, erroneous determination can be further reduced.

In another aspect, in the above-described behavior detection device, the first sub-behavior determination processing is based on the first sub-measurement result of the first sub-sensor and the past first sub-behavior determination result, and the current first behavior The processing control unit forcibly changes the current first sub-behavior determination result to a preset specified value according to the sleep determination result of the sleep state determination unit. do.

Since such an action detection device forcibly changes the current first sub-behavior determination result to a preset specified value according to the sleep determination result of the sleep state determination unit, the next first sub-behavior determination Processing can be performed more appropriately, and erroneous determination can be further reduced.

In another aspect, in the above-described behavior detection device, schedule information representing a schedule of the monitored person including at least a sleeping time zone and a clock unit that counts the date and time corresponds to the monitored person. and a schedule information storage unit for storing the schedule information, wherein the processing control unit acquires the current time from the clock unit and stores the schedule of the monitored person corresponding to the acquired current time in the schedule information storage unit. and controls the action determination unit according to the extracted schedule of the monitored person and the sleep determination result of the sleep state determination unit.

Since such an action detection device controls the action determination unit according to the monitored person's schedule and the sleep determination result of the sleep state determination unit, it is possible to take the monitored person's schedule into consideration, thereby further reducing erroneous determinations. can.

A behavior detection method according to another aspect includes a measurement step of measuring a monitored person with first and second sensors, and determining a sleep state of the monitored person based on a first measurement result of the first sensor. a behavior determination step of determining a predetermined behavior of the monitored person based on the second measurement result of the second sensor; and the behavior determination according to the sleep determination result of the sleep state determination step and a process control step for controlling the process.

Since such an action detection method controls the action determination process according to the sleep determination result of the sleep state determination process, erroneous determination can be further reduced.

A monitored person monitoring support system according to another aspect includes a sensor device that is provided corresponding to a monitored person and detects a predetermined behavior of the monitored person, and the sensor device that is communicably connected to the sensor device. and a terminal device that is communicatively connected to the central processing unit and receives and displays the detection results via the central processing unit, A monitored person monitoring support system for supporting monitoring, wherein the sensor device includes any one of the behavior detection devices described above.

According to this, it is possible to provide a monitored person monitoring support system using any of the behavior detection devices described above. Since such a monitored person monitoring support system uses any of the behavior detection devices described above, erroneous determination can be further reduced.

This application is based on Japanese Patent Application No. 2017-155073 filed on August 10, 2017, the content of which is included in the present application.

While embodiments of the present invention have been illustrated and described in detail, this is done by way of illustration and example only, and not limitation. The scope of the invention should be construed by the language of the appended claims.

Although the present invention has been adequately and fully described above through embodiments with reference to the drawings in order to express the present invention, modifications and/or improvements to the above-described embodiments can easily be made by those skilled in the art. It should be recognized that it is possible. Therefore, to the extent that modifications or improvements made by those skilled in the art do not depart from the scope of the claims set forth in the claims, such modifications or improvements do not fall within the scope of the claims. is interpreted to be subsumed by

According to the present invention, it is possible to provide a behavior detection device and behavior detection method for detecting a predetermined behavior of a monitored person who is a monitoring target, and a monitored person monitoring support system using this behavior detection device.

Claims (9)

first and second sensors for measuring the monitored person;
a sleep state determination unit that determines the sleep state of the monitored person based on the first measurement result of the first sensor;
a behavior determination unit that determines a predetermined behavior of the monitored person based on a second measurement result of the second sensor;
a processing control unit that controls the behavior determination unit according to the sleep determination result of the sleep state determination unit;
the second sensor includes first and second sub-sensors that measure the monitored person ;
The behavior determination unit executes first sub-behavior determination processing for determining a first behavior belonging to a first group among predetermined behaviors of the monitored person based on a first sub-measurement result of the first sub-sensor. a first sub-behavior determination unit for determining a second behavior belonging to a second group different from the first group among predetermined behaviors of the monitored person based on a second sub-measurement result of the second sub-sensor; a second sub-behavior determination unit that executes a second sub-behavior determination process ;
The processing control unit controls at least one of the first and second sub-behavior determination units according to the sleep determination result of the sleep state determination unit ,
The processing control unit assists the first sub-behavior determination result of the first sub-behavior determination unit with the second sub-behavior determination result of the second sub-behavior determination unit according to the sleep determination result of the sleep state determination unit. controls whether
motion detector. The first sub-behavior determination process compares a first sub-measurement result of the first sub-sensor with a preset first behavior determination threshold associated with the first behavior, thereby determining the first behavior. is a process for determining whether or not
As the control, the processing control unit changes the first action determination threshold in the first sub-action determination process executed by the first sub-action determination unit according to the sleep determination result of the sleep state determination unit.
The action detection device according to claim 1 . The second sub-behavior determination process compares a second sub-measurement result of the second sub-sensor with a preset second behavior determination threshold value associated with the second behavior, thereby determining the second behavior. is a process for determining whether or not
As the control, the processing control unit changes a second action determination threshold in the second sub-action determination process executed by the second sub-action determination unit according to the sleep determination result of the sleep state determination unit.
The action detection device according to claim 1 . In the first sub-behavior determination process, a first sub-measurement result of the first sub-sensor and a preset first behavior determination threshold associated with the first behavior are performed at predetermined time intervals. It is temporarily determined whether or not it is the first action by comparing with, and if the provisionally determined result of the tentative determination is the first action, it continues for a first continuation determination time set in advance. In the case, it is a process to finally determine that it is the first action,
As the control, the processing control unit changes the first continuation determination time in the first sub-behavior determination process executed by the first sub-behavior determination unit according to the sleep determination result of the sleep state determination unit.
The action detection device according to claim 1 . In the second sub-behavior determination process, a second sub-measurement result of the second sub-sensor and a preset second behavior determination threshold associated with the second behavior are performed at predetermined time intervals. It is provisionally determined whether or not the behavior is the second behavior by comparing with, and if the provisionally determined result of the provisional determination is the second behavior, the behavior continues for a preset second continuation determination time. In the case, it is a process to finally determine that it is the second action,
As the control, the processing control unit changes a second continuation determination time in the second sub-behavior determination process executed by the second sub-behavior determination unit according to the sleep determination result of the sleep state determination unit.
The action detection device according to claim 1. The first sub-behavior determination process is a process of determining whether or not the current behavior is the first behavior based on the first sub-measurement result of the first sub-sensor and the past first sub-behavior determination result,
The processing control unit forcibly changes the current first sub-behavior determination result to a preset specified value according to the sleep determination result of the sleep state determination unit.
The action detection device according to claim 1 . a clock unit that measures the date, time, and minute;
a schedule information storage unit that stores schedule information representing the monitored person's schedule including at least sleeping time slots in association with the monitored person,
The processing control unit acquires the current time from the clock unit, extracts the monitored person's schedule corresponding to the acquired current time from the schedule information storage unit, and extracts the monitored person's schedule corresponding to the acquired current time. controlling the behavior determination unit according to the schedule and the sleep determination result of the sleep state determination unit;
The behavior detection device according to any one of claims 1 to 6 . a measuring step of measuring the monitored person with each of the first and second sensors;
a sleep state determination step of determining a sleep state of the monitored person based on a first measurement result of the first sensor;
a behavior determination step of determining a predetermined behavior of the monitored person based on a second measurement result of the second sensor;
A behavior detection method executed by a computer, comprising a processing control step of controlling the behavior determination step according to the sleep determination result of the sleep state determination step,
the second sensor includes first and second sub-sensors that measure the monitored person ;
The behavior determination step executes a first sub-behavior determination process for determining a first behavior belonging to a first group among predetermined behaviors of the monitored person based on a first sub-measurement result of the first sub-sensor. a first sub-behavior determination step of determining a second behavior belonging to a second group different from the first group among predetermined behaviors of the monitored person based on a second sub-measurement result of the second sub-sensor; a second sub-behavior determination step of executing the second sub-behavior determination process ;
The processing control step controls at least one of the first and second sub-behavior determination steps according to the sleep determination result of the sleep state determination step ,
The processing control step assists the first sub-behavior determination result in the first sub-behavior determination step with the second sub-behavior determination result in the second sub-behavior determination step according to the sleep determination result of the sleep state determination step. controls whether
Action detection method. a sensor device provided corresponding to a person to be monitored and detecting a predetermined action of the person to be monitored; a central processing unit communicatively connected to the sensor device and managing detection results received from the sensor device; A monitored person monitoring support system for supporting monitoring of said monitored person, comprising a terminal device that is communicably connected to said central processing unit and receives and displays said detection result via said central processing unit. hand,
The sensor device includes the behavior detection device according to any one of claims 1 to 7 ,
Monitored person monitoring support system.

Images