JP7268604B2 - Monitored Person Monitoring Support Device, Monitored Person Monitoring Support System, Monitored Person Monitoring Support Method, and Monitored Person Monitoring Support Program - Google Patents

Description

The present invention relates to technology for supporting monitoring of a monitored person.

In recent years, along with the rush of a super-aged society, research and development of techniques for complementing the work of the nursing industry, the nursing care industry, etc. are being advanced. Examples of such techniques include Patent Document 1 and Patent Document 2. Patent Document 1 discloses a position information acquisition unit that acquires position information from a communication device owned by a person being watched over, a movement distance calculation unit that calculates the distance traveled from the home of the person being watched over based on the position information, and a person being watched over. An estimated abnormal state value that indicates the degree of abnormality in the state of the person being watched over is calculated according to the degree of risk of going out that is set according to the type of going out that has been selected in advance as an attribute related to the person's ability to go out, and the calculated moving distance. and an abnormal state estimating unit that determines whether the calculated estimated abnormal state value exceeds a predetermined value, and if it is determined that the calculated estimated abnormal state value exceeds the predetermined value, the monitoring target person and an anomaly detection notification unit that sends an anomaly detection notification to a predetermined notification destination to notify that an anomaly state has been detected.

The monitoring system disclosed in Patent Literature 2 includes a plurality of slave units installed in a residence and a master unit. Each child device sends a notification signal to the parent device when it senses a target person. Based on the time data of the notification signal from the child device and the time data of the notification signal from the child device, the parent device calculates the travel time from the bedroom to the toilet of the person being watched over, and monitors based on the travel time. Calculate the walking speed of the subject.

Consider care recipients living in nursing homes and caregivers working there as supervisors and monitored persons. A caregiver provides care to a care recipient as needed. For example, for a care recipient who cannot go to the bathroom by himself, the caregiver takes the care recipient to the bathroom. Excessive care (for example, the caregiver always takes the caregiver to the toilet when the caregiver can go to the bathroom by himself/herself) is a burden on the caregiver and promotes the independence of the caregiver. (Let them do what they can do by themselves).

However, it is difficult for individual caregivers to decide when a care recipient needs care or not, because it depends on the care recipient. Thus, caregivers tend to over-care to avoid under-care.

Care may be required when the cared person shows an unusual behavior pattern. For example, if a care-receiver who always brushes his teeth after meals does not brush his teeth after meals and sleeps in bed after meals, the caregiver needs to take care of the care-receiver to brush his teeth. .

JP 2017-37385 A JP 2017-117423 A

SUMMARY OF THE INVENTION It is an object of the present invention to provide a monitored person monitoring support device, a monitored person monitoring support system, and a monitored person monitoring support method that can support monitoring of whether or not a monitored person's behavior pattern differs from the usual behavior pattern. and to provide a monitored person monitoring support program.

In order to achieve the above-described object, a monitored person monitoring support device that reflects one aspect of the present invention includes a storage unit, a detection unit, an estimation unit, a determination unit, a determination unit, and a notification unit. Prepare. The storage unit pre-stores position information of an area in which the monitored person acts in the room. The detection unit detects the position of the monitored person in the room. The estimation unit estimates behavior of the monitored person using the position information and the location of the monitored person detected by the detection unit. The identification unit identifies a behavior pattern of the monitored person using the behavior of the monitored person estimated by the estimation unit. The determination unit determines whether the behavior pattern of the monitored person identified by the identification unit is different from a predetermined reference behavior pattern. The notification unit notifies a predetermined terminal device when the determination unit determines that the behavior pattern of the monitored person is different from the reference behavior pattern.

The advantages and features provided by one or more embodiments of the invention will be fully appreciated from the detailed description provided below and the accompanying drawings. These detailed descriptions and accompanying drawings are given by way of example only and are not intended as a definition of the limits of the invention.

1 is an explanatory diagram illustrating the configuration of a monitored person monitoring support system according to an embodiment; FIG. It is a block diagram which shows the structure of a sensor apparatus. FIG. 10 is a schematic diagram showing a state in which a still image showing the monitored person's living room is set as a region in which the monitored person acts. It is a block diagram which shows the structure of a management server apparatus. 1 is a block diagram showing the configuration of a fixed terminal device; FIG. It is a schematic diagram which shows an example of the still image of the living room imaged by the imaging part. 4 is a flowchart for explaining the operation of the sensor device among the operations of the monitored person monitoring support system according to the embodiment. 4 is a flowchart for explaining the operation of the management server device among the operations of the monitored person monitoring support system according to the embodiment; 4 is a flowchart for explaining the operation of the fixed terminal device among the operations of the monitored person monitoring support system according to the embodiment. It is an explanatory view explaining an example of a notice picture. It is a block diagram which shows the structure of the management server apparatus with which a modification is provided. It is explanatory drawing explaining a part of example of a care record. It is a flow chart explaining operation of a monitored person monitoring support system concerning a modification.

One or more embodiments of the invention are described below with reference to the drawings. However, the scope of the invention is not limited to the disclosed embodiments.

In each figure, the configurations denoted by the same reference numerals indicate the same configuration, and the description of the content of the configuration that has already been described will be omitted. In the present specification, reference numerals with suffixes omitted are used when referring to generically, and reference numerals with suffixes are used when referring to individual configurations.

A monitored person monitoring support system according to an embodiment is a system for monitoring a monitored person who is a monitoring target to be monitored (in other words, a watching target person who is a watching target to be watched over) using a plurality of devices. and a monitored person monitoring support device that is communicably connected to the terminal device, detects a predetermined event related to the monitored person, and notifies the terminal device of the event. The monitored person monitoring support device may be integrally configured as a single device, but in this specification, the monitored person monitoring support device can communicate with the sensor device, the sensor device, and the terminal device. By providing a management server device connected to the two types of devices, the two types of devices are configured separately. The sensor device detects the predetermined event related to the monitored person and notifies (reports, transmits) the management server device. When the management server device receives the notification from the sensor device, the management server device manages the event for which the notification has been received and re-notifies (re-notifies, re-notifies) the event to a predetermined terminal device associated with the sensor device. Send. The terminal device may be one type of device, but in this specification, the terminal device is two types of devices, a fixed terminal device and a mobile terminal device. The main difference between these fixed terminal devices and mobile terminal devices is that the fixed terminal device is operated in a fixed manner, and the mobile terminal device is carried and operated by a supervisor (user) such as a nurse or a caregiver. is. Since the fixed terminal device and the mobile terminal device are substantially the same, the fixed terminal device will be mainly described below.

FIG. 1 is an explanatory diagram illustrating the configuration of a monitored person monitoring support system MS according to an embodiment. More specifically, the monitored person monitoring support system MS includes, for example, one or more sensor devices SU (SU-1 to SU-4), a management server device SV, a fixed terminal device SP, and one or more and a private branch exchange (PBX, Private Branch Exchange) CX. communication line) NW is communicably connected. The network NW may be provided with repeaters such as repeaters, bridges and routers for relaying communication signals. In the example shown in FIG. 1, the plurality of sensor devices SU-1 to SU-4, the management server device SV, the fixed terminal device SP, the plurality of mobile terminal devices TA-1 and TA-2, and the private branch exchange CX are L2 switches. are communicably connected to each other by a wired and wireless mixed LAN (for example, a LAN conforming to the IEEE802.11 standard) NW including a line concentrator (hub, HUB) LS and an access point AP. More specifically, a plurality of sensor devices SU-1 to SU-4, a management server device SV, a fixed terminal device SP and a private branch exchange CX are connected to a line concentrator LS, and connected to a plurality of mobile terminal devices TA-1 and TA-2. is connected to the concentrator LS via an access point AP. The network NW constitutes a so-called intranet by using Internet protocols such as TCP (Transmission Control Protocol) and IP (Internet Protocol). The private branch exchange CX is connected to the telephone TL by the public telephone network PN.

The monitored person monitoring support system MS is arranged at an appropriate place according to the monitored person Ob. The monitored person Ob is, for example, a person who needs nursing care due to illness or injury, a person who needs nursing care due to a decline in physical ability, a solitary person living alone, or the like. In particular, from the viewpoint of enabling early detection and early countermeasures, the monitored person Ob should be a person who needs to be found when a predetermined inconvenient event, such as an abnormal condition, occurs to him or her. preferable. Therefore, the monitored person monitoring support system MS is preferably installed in buildings such as hospitals, welfare facilities for the elderly, and dwelling units according to the type of the monitored person Ob. In the example shown in FIG. 1, the monitored person monitoring support system MS is installed in a building of a nursing care facility having a plurality of rooms RM in which a plurality of monitored persons Ob reside and a plurality of rooms such as a nurse station. .

The sensor device SU has a communication function or the like to communicate with other devices SV, SP, and TA via the network NW, detects a predetermined event related to the person to be monitored Ob, and reports the detected event to the management server device SV. , performs voice communication with the terminal devices SP and TA, generates images including moving images, and distributes the moving images to the terminal devices SP and TA. The predetermined events preferably include events requiring action.

As an example, FIG. 1 shows four first to fourth sensor units SU-1 to SU-4. The second sensor unit SU-2 is arranged in the room RM-1 (not shown) of Ob-1, and the second sensor unit SU-2 is arranged in the room RM-2 (not shown) of Mr. B Ob-2, who is one of the monitored persons Ob. The third sensor unit SU-3 is installed in the living room RM-3 (not shown) of Mr. C Ob-3 who is one of the monitored persons Ob, and the fourth sensor unit SU-4 is It is installed in the living room RM-4 (not shown) of Mr. D Ob-4 who is one of the monitored persons Ob.

The management server device SV has a communication function or the like to communicate with other devices SU, SP, and TA via the network NW. It is a device that manages information (monitoring information) regarding monitoring of Ob. When the management server device SV receives the first event notification communication signal as notification of the event from the sensor device SU, the management server device SV, based on each piece of information contained in the first event notification communication signal, determines the above information about the monitoring of the monitored person Ob. A predetermined terminal device that stores (records) monitoring information and transmits a communication signal (second event notification communication signal) containing the monitoring information relating to the monitoring of the monitored person Ob to the sensor device SU in advance. Send to SP, TA. For this reason, the management server device SV uses the sensor ID that is the transmission source and the notification A correspondence relationship (notification destination correspondence relationship) with a terminal ID that is a destination (re-notification destination) and its communication address are stored. A terminal ID (terminal device identifier) is an identifier for specifying and identifying the terminal devices SP and TA. The management server device SV then provides the clients (in this embodiment, the fixed terminal device SP, the portable terminal device TA, etc.) with data according to the request from the client. Such a management server device SV can be configured by, for example, a computer with a communication function.

The fixed terminal device SP is a device that functions as a user interface (UI) of the monitored person monitoring support system MS. In order to achieve this function, the fixed terminal device SP has a communication function to communicate with other devices SU, SV, TA via the network NW, a display function to display predetermined information, and predetermined instructions and data. It has an input function, etc., for inputting predetermined instructions and data to be given to the management server device SV and the portable terminal device TA, and displaying monitoring information obtained by the sensor device SU. Such a fixed terminal device SP can be composed of, for example, a computer with a communication function.

The mobile terminal device TA is carried by the supervisor NS. The mobile terminal device TA has a communication function of communicating with other devices SV, SP, and SU via the network NW, a display function of displaying predetermined information, an input function of inputting predetermined instructions and data, and a voice call. It is equipped with a call function, etc., to input predetermined instructions and data given to the management server device SV and the sensor device SU, and to receive monitoring information (including moving images) obtained by the sensor device SU in response to a notification from the management server device SV. It is a device for displaying, responding to a nurse call, speaking to a nurse call, etc. by voice communication with the sensor unit SU.

The sensor unit SU is attached to the ceiling of the living room RM. In addition to the functions described above (for example, the function of capturing moving images of the monitored person Ob and the function of making voice calls with the terminal devices SP and TA), the sensor unit SU estimates the behavior of the monitored person Ob. , has a function of determining whether or not the estimated behavior pattern differs from a predetermined reference behavior pattern. From the point of view of this function, the sensor unit SU will be described in detail.

FIG. 2 is a block diagram showing the configuration of the sensor device SU. The sensor device SU includes a sensor-side control processing unit (SU control processing unit) 10, a sensor-side communication interface unit (SU communication IF unit) 11, an imaging unit 12, a storage unit 13, a detection unit 14, and an estimation unit. 15 , an identifying unit 16 , and a determining unit 17 .

The SU control processing unit 10 controls each unit (the SU communication IF unit 11, the imaging unit 12, the storage unit 13, the detection unit 14, the estimation unit 15, the identification unit 16, the determination unit 17) of the sensor device SU according to the function of each unit. detect a predetermined event related to the person to be monitored Ob, notify the management server device SV of the detected event, perform a voice call with the terminal devices SP and TA, and then transmit a moving image. It is a device for distributing moving images containing images to terminal devices SP and TA.

The SU control processing unit 10 includes hardware such as a CPU (Central Processing Unit), RAM (Random Access Memory), ROM (Read Only Memory), and HDD (Hard Disk Drive), and the SU control processing unit 10 It is realized by programs, data, etc. for executing the functions of Some or all of the functions of the SU control processing unit 10 may be realized by processing by a DSP (Digital Signal Processor) in place of or together with processing by the CPU. Also, some or all of the functions of the SU control processing unit 10 may be realized by processing by a dedicated hardware circuit instead of or together with processing by software. What has been described above is the detection unit 14, the estimation unit 15, the identification unit 16, the determination unit 17, the SV control processing unit 30 that will be described later with reference to FIG. 4, and the SP control processing unit that will be described later with reference to FIG. 20, the position information generation unit 24, the SV control processing unit 30 and the nursing care recording unit 32, which will be described later with reference to FIG. It can also be said that these functional blocks (SU control processing unit 10, etc.) can be realized by a hardware processor.

The HDD stores a program for realizing the SU control processing unit 10, the detection unit 14, the estimation unit 15, the identification unit 16, and the determination unit 17 among the elements constituting the sensor unit SU. These programs are expressed as an SU control processing program, a detection program, an estimation program, a specific program, and a judgment program.

These programs are expressed using the definitions of the above elements. The detection unit 14 and the detection program will be described as an example. The detection unit 14 detects the position of the monitored person Ob in the living room RM. The detection program is a program for detecting the position of the monitored person Ob in the living room RM.

A flowchart of these programs (SU control processing program, detection program, estimation program, specific program, determination program) executed by the CPU is shown in FIG. 7, which will be described later.

Although these programs are stored in advance in the HDD, the present invention is not limited to this. For example, a recording medium recording these programs (for example, an external recording medium such as a magnetic disk or an optical disk) is prepared, and even if the programs stored in this recording medium are stored in the HDD, good. Further, these programs may be stored in the management server apparatus SV network-connected to the sensor apparatus SU, sent to the HDD via the network, and stored in the HDD. These programs may be stored in the ROM instead of the HDD. The sensor unit SU may have a flash memory instead of the HDD, and these programs may be stored in the flash memory.

The program described above and the storage unit (HDD, etc.) that stores it are represented by the SV control processing unit 30, which will be described later using FIG. 4, the SP control processing unit 20, which will be described later using FIG. The same can be said for the information generation unit 24, the SV control processing unit 30 and the nursing care recording unit 32, which will be described later with reference to FIG.

The SU communication IF unit 11 is a communication circuit that is connected to the SU control processing unit 10 and performs communication under the control of the SU control processing unit 10 . The SU communication IF unit 11 generates a communication signal containing data to be transferred input from the SU control processing unit 10 according to the communication protocol used in the network NW of this monitored person monitoring support system MS. Communication signals are sent to other devices SV, SP, TA via the network NW. The SU communication IF unit 11 receives communication signals from other devices SV, SP, and TA via the network NW, extracts data from the received communication signals, and the SU control processing unit 10 can process the extracted data. format data and output to the SU control processing unit 10 . The SU communication IF unit 11 includes, for example, a communication interface circuit complying with the IEEE802.11 standard.

The imaging unit 12 is a device that captures an image of an imaging target and generates an image of the imaging target. Images include still images and moving images. The imaging unit 12 is arranged so as to be able to monitor the space where the person to be monitored Ob is supposed to be located (located space, in the example shown in FIG. 1, the living room RM of the installation location). An image is captured to generate a bird's-eye view image of the imaging target. Preferably, since there is a high probability that the entire monitored person Ob can be imaged, the imaging unit 12 should be arranged so that the head of the monitored person Ob is positioned on the bedding (for example, a bed) on which the monitored person Ob lies. It is arranged so that an image of the object to be imaged can be imaged from directly above a predetermined head position (usually, the position where a pillow is arranged). The sensor unit SU acquires an image of the monitored person Ob from above the monitored person Ob, preferably from right above the expected head position, using the imaging unit 12 .

Such imaging unit 12 may be a device (visible camera) that generates a visible light image, but in the embodiment, an infrared image is generated so that the monitored person Ob can be monitored even in relatively dark conditions. It is a device. For example, in the embodiment, such an imaging unit 12 is an imaging optical system that forms an infrared optical image of an object to be imaged on a predetermined imaging plane, and is arranged with a light receiving surface aligned with the imaging plane. an image sensor that converts an infrared optical image of the object to be imaged into an electrical signal; and image data representing an infrared image of the object to be imaged by image processing the output of the image sensor. It is a digital infrared camera equipped with an image processing unit and the like for generating. In the embodiment, the imaging optical system of the imaging unit 12 is preferably a wide-angle optical system (a so-called wide-angle lens (including a fisheye lens)) capable of imaging the entire living room RM in which it is installed.

The storage unit 13 stores the moving image in the living room RM captured by the imaging unit 12 . Further, the storage unit 13 stores in advance the position information PI of the area where the monitored person Ob acts in the living room RM. The storage unit 13 is implemented by, for example, an HDD, flash memory, or the like. The behavior of the monitored person Ob is the behavior that the monitored person Ob does in the living room RM, such as washing hands, eating, and brushing teeth. Actions include, for example, living actions such as eating, dressing, moving, excreting, etc. performed in the living room RM.

In the living room RM, the area (place) where the monitored person Ob acts is, for example, in the case of a private room in a nursing care facility, the area where the bed is located, the area where the desk and chair for eating are located, and the washroom is located. areas where toilets are located, etc.

The position information PI is generated in advance for each living room RM. The location information PI will be described using the living room RM of the monitored person Ob-1 as an example. FIG. 3 is a schematic diagram showing a state in which the area R in which the monitored person Ob-1 acts is set in a still image 50 showing the living room RM of the monitored person Ob-1. The still image 50 includes a bed area R-1 where a bed 51 is located, a desk and chair area R-2 where a desk/chair 52 for eating is located, and an area R where a washroom 53 is located. and a toilet area R-4, which is an area R in which the toilet 54 is located. The position information PI includes coordinates indicating the position of the area R in the still image 50 and character data indicating what the object located in this area R is (for example, a bed).

1 and 2, detection unit 14 detects the position of monitored person Ob in living room RM. For example, the detection unit 14 detects the position of the monitored person Ob in the living room RM using a moving image of the monitored person Ob captured in the living room RM. More specifically, the storage unit 13 stores 24-hour moving images captured by the imaging unit 12 in the living room RM. Since the 24-hour moving image and the still image 50 shown in FIG. is the same as the position of Therefore, the position information PI can also be applied to each frame (image) that constitutes a 24-hour moving image.

The SU control processing unit 10 stores in advance information of a time period (for example, a lunch time period) for which the behavior pattern of the monitored person Ob is to be specified. A moving image of a time period for which the behavior pattern of the person Ob is to be specified is taken out from the storage unit 13 and sent to the detection unit 14 . The detection unit 14 extracts a moving object region from each frame (image) constituting the moving image using, for example, background subtraction or optical flow, regards the extracted moving object region as a human region, and calculates the center of gravity of the human region. Calculate the coordinates of These coordinates are the position of the monitored person Ob in the living room RM.

The estimation unit 15 estimates the behavior of the monitored person Ob based on the position of the monitored person Ob detected by the detection unit 14 and the position information PI prestored in the storage unit 13 . This will be explained in detail. 2 and 3, monitored person Ob has lunch during a predetermined lunch time period (for example, from 12:00 to 13:00). The lunch period includes a time for washing hands before lunch and a time for brushing teeth after lunch. The estimating unit 15 estimates that the monitored person Ob has eaten when the position of the monitored person Ob exists in the desk and chair area R-2 for a predetermined period of time T1 (for example, 10 minutes) or longer during the lunch time period. . The estimating unit 15 regards the period in which the monitored person Ob is in the desk and chair region R-2 (for example, the period from 12:05 to 12:25), including the predetermined period T1, as the meal time. presume. The estimating unit 15 determines that the monitored person Ob has washed his or her hands when the position of the monitored person Ob has been present in the washroom area R-3 for a predetermined period of time T2 (for example, one minute) before the meal time. presume. The estimation unit 15 estimates that the monitored person Ob has brushed his/her teeth when the position of the monitored person Ob has been present in the washroom area R-3 for a predetermined period of time T3 (for example, 3 minutes) after the meal time. do.

As described above, after estimating a meal, the estimation unit 15 estimates two behaviors before and after the meal (washing hands before eating, brushing teeth after eating). All the actions performed in the area R in the band may be estimated in chronological order. That is, the estimating unit 15 estimates the first action performed by the monitored person Ob in the area R during the lunch hour, the second action, the second action, and so on. Estimate the last action taken. Out of these estimated behaviors, the estimation of meal and the behavior estimated before and after this are used to specify the behavior pattern.

The estimation unit 15 determines that the monitored person Ob is asleep (sleeping on the bed 51) when the position of the monitored person Ob exists in the bed region R-1 for a predetermined period of time T4 (for example, 5 minutes) or longer. presume. Further, the estimation unit 15 estimates that the monitored person Ob has excreted when the position of the monitored person Ob is present in the toilet region R-4 for a predetermined period of time T5 (for example, two minutes) or longer.

The identifying unit 16 identifies the behavior pattern of the monitored person Ob based on the behavior of the monitored person Ob estimated by the estimating unit 15 . The action pattern is the action pattern of the monitored person Ob in the living room RM, and the following three examples are given.

(1) Order of performing multiple actions (2) Length of time for a certain action (3) Length of time to move from one action area to the next action area

(1) will be specifically described. When the estimation unit 15 estimates that the monitored person Ob washed their hands before eating, estimated that they ate, and brushed their teeth after eating, the identification unit 16 performs washing of hands, eating, and brushing of teeth in this order. Actions are identified as behavior patterns.

(2) will be specifically described. As described above, the estimation unit 15 estimates the meal time of the monitored person Ob. The identifying unit 16 identifies this estimated length of meal time (for example, 20 minutes) as a behavior pattern.

(3) will be specifically described. When the position of the monitored person Ob changes from the first state of being in the washroom region R-3 to the second state of being in the desk and chair region R-2, the estimating unit 15 changes the position of the monitored person Ob from the first state to the second state. The time required for the state to change is estimated as the movement time for the monitored person Ob to move from the washroom 53 to the desk/chair 52 for eating. The identifying unit 16 identifies the estimated travel time length as a behavior pattern.

The estimating unit 15 estimates that the monitored person Ob is acting in the region R when the position of the monitored person Ob exists in the region R for a predetermined period of time or longer. This predetermined period may be the same for all actions, or may be determined according to the type of action (eating, washing hands, brushing teeth, sleeping, excreting) as described above.

The determination unit 17 determines whether the behavior pattern of the monitored person Ob identified by the identification unit 16 is different from a predetermined reference behavior pattern. For example, the reference behavior pattern is a behavior pattern of washing hands, eating, and brushing teeth in this order. The determination unit 17 determines that the behavior pattern of the monitored person Ob identified by the identification unit 16 is different from the reference behavior pattern when the behavior pattern includes washing hands, eating, and sleeping in this order. On the other hand, when the behavior pattern of the monitored person Ob identified by the identification unit 16 is the behavior pattern of washing hands, eating, and brushing teeth in this order, the determination unit 17 determines that it is the same as the reference behavior pattern. .

A configuration of the management server device SV will be described. FIG. 4 is a block diagram showing the configuration of the management server device SV. The management server device SV includes a management server side control processing section (SV control processing section) 30 and a management server side communication interface section (SV communication IF section) 31 .

The SV control processing section 30 is a device for controlling each section of the management server device SV according to the function of each section. In FIG. 4, an SV communication IF section 31 is shown as each section of the management server device SV. Since the components other than the SV communication IF unit 31 are not used in the description of the embodiment, they are omitted in FIG.

The SV communication IF unit 31 is a communication circuit that is connected to the SV control processing unit 30 and performs communication under the control of the SV control processing unit 30 . SV communication IF unit 31 generates a communication signal containing data to be transferred input from SV control processing unit 30 according to a communication protocol used in network NW of monitored person monitoring support system MS, and generates a Communication signals are sent to other units SU, SP, TA via the network NW. The SV communication IF unit 31 receives communication signals from other devices SU, SP, and TA via the network NW, extracts data from the received communication signals, and allows the SV control processing unit 30 to process the extracted data. format data and output to the SV control processing unit 30 . The SV communication IF unit 31 includes, for example, a communication interface circuit complying with the IEEE802.11 standard.

2 and 4, when determination unit 17 determines that the behavior pattern of monitored person Ob is different from the reference behavior pattern, SU control processing unit 10 directs management server device SV to the SU The communication IF unit 11 is made to notify that the above determination has been made. The management server device SV makes the SV communication IF unit 31 transfer this notification to a predetermined terminal device as a destination. The predetermined terminal device may be the fixed terminal device SP, the mobile terminal device TA, or both of these terminal devices. Thus, the SU control processing unit 10, the SU communication IF unit 11, the SV control processing unit 30, and the SV communication IF unit 31 constitute a notification unit. When the determination unit 17 determines that the behavior pattern of the monitored person Ob is different from the reference behavior pattern, the notification unit notifies a predetermined terminal device.

A configuration of the fixed terminal device SP will be described. FIG. 5 is a block diagram showing the configuration of the fixed terminal device SP. The fixed terminal device SP includes a fixed terminal side control processing section (SP control processing section) 20, a fixed terminal side communication interface section (SP communication IF section) 21, a fixed terminal side input section (SP input section) 22, a fixed A terminal-side output unit (SP output unit) 23 and a position information generation unit 24 are provided.

The SP control processing unit 20 is a device for controlling each unit (SP communication IF unit 21, SP input unit 22, SP output unit 23, position information generation unit 24) of the fixed terminal device SP according to the function of each unit. is.

The SP communication IF unit 21 is a communication circuit that is connected to the SP control processing unit 20 and performs communication under the control of the SP control processing unit 20 . The SP communication IF unit 21 generates a communication signal containing data to be transferred input from the SP control processing unit 20 according to the communication protocol used in the network NW of this monitored person monitoring support system MS. Communication signals are sent to other units SU, SV, TA via the network NW. The SP communication IF unit 21 receives communication signals from other devices SU, SV, and TA via the network NW, extracts data from the received communication signals, and allows the SP control processing unit 20 to process the extracted data. format data and output to the SP control processing unit 20 . The SP communication IF unit 21 includes, for example, a communication interface circuit complying with the IEEE802.11 standard.

The SP input unit 22 is a device for various inputs. Various inputs are to input commands (instructions), data, etc. from the outside of the fixed terminal device SP. The SP input unit 22 is implemented by a touch panel, keyboard, mouse, or the like.

The SP output unit 23 is a device for various outputs. Various outputs include, for example, output of commands and data input from the SP input unit 22, output of images (moving images and still images) captured in each living room RM, and output of care records. For example, the SP output unit 23 is implemented by a display device (liquid crystal display, organic EL display, etc.) and a printing device (printer, etc.).

The position information generator 24 generates position information PI of the area R where the monitored person Ob acts. The generation of the position information PI will be described using the living room RM of the monitored person Ob-1 as an example. 2 and 5, the user of the monitored person monitoring support system MS operates the SP input unit 22 so that the imaging unit 12 arranged in the living room RM of the monitored person Ob-1 displays the image of the living room. Input a command to capture a still image of RM. The SP control processing unit 20 causes the SP communication IF unit 21 to transmit this command to the first sensor unit SU-1 as the destination. In the first sensor device SU-1, the SU communication IF section 11 receives this command, and the SU control processing section 10 causes the imaging section 12 to capture a still image. The SU control processing unit 10 causes the SU communication IF unit 11 to transmit the captured still image to the fixed terminal device SP as a destination. The SP communication IF unit 21 receives the transmitted still image, and the SP control processing unit 20 causes the display constituting the SP output unit 23 to display the still image. FIG. 6 is a schematic diagram showing an example of this still image 50. As shown in FIG. A still image 50 includes a bed 51, a desk/chair 52 for eating, a washroom 53, and a toilet 54. FIG. The washroom 53 and toilet 54 are not private rooms, and the walls and doors forming these spaces are absent.

A user of the monitored person monitoring support system MS sets a still image 50 as a region R in which the monitored person Ob acts. FIG. 3 is a diagram showing a state in which the area R is set. More specifically, referring to FIGS. 3 and 6, the user of the monitored person monitoring support system MS operates the SP input unit 22 to operate the bed 51 shown in the still image 50, the table for eating, The four corners of each of the chair 52, washroom 53, and toilet 54 are input. As a result, the position information generator 24 sets the bed region R-1, the desk and chair region R-2, the washroom region R-3, and the toilet region R-4 in the still image 50. FIG.

The user of the monitored person monitoring support system MS operates the SP input unit 22, selects the bed area R-1, and inputs the characters "bed". As a result, the position information generation unit 24 generates the position information PI that associates the coordinates defining the bed region R-1 in the still image 50 (coordinates of the four corners of the bed 51) with the characters "bed". Generate. This is the position information PI of the bed area R-1. Similarly, the position information PI of the desk and chair region R-2, the position information PI of the washroom region R-3, and the position information PI of the toilet region R-4 are generated.

A user of the monitored person monitoring support system MS operates the SP input unit 22 to input a command to register the position information PI in the first sensor device SU-1. The SP control processing unit 20 causes the SP communication IF unit 21 to transmit this command and position information PI (here, four pieces of position information PI) to the first sensor device SU-1 as a destination. The SU communication IF unit 11 of the first sensor device SU-1 receives this command and the position information PI, and the SU control processing unit 10 stores the position information PI received by the SU communication IF unit 11 in the storage unit 13. Memorize.

The operation of the monitored person monitoring support system MS according to the embodiment will be described using the monitored person Ob-1 as an example. FIG. 7 is a flowchart for explaining the operation of the sensor unit SU among these operations. FIG. 8 is a flowchart for explaining the operation of the management server device SV among these operations. FIG. 9 is a flow chart for explaining the operation of the fixed terminal device SP among these operations. Since the monitored person Ob-1 is taken as an example, the sensor device SU is the first sensor device SU-1. The monitored person monitoring support system MS monitors whether or not the behavior pattern of the monitored person Ob-1 differs from the standard behavior pattern, and when the behavior pattern of the monitored person Ob-1 differs from the standard behavior pattern, Notice. The action pattern is the action pattern of (1) above. The standard behavior pattern is to wash hands, eat, and brush teeth in this order.

2 and 7, SU control processing unit 10 stores in advance information on the lunchtime period (for example, 12:00 to 13:00) of monitored person Ob-1. The imaging unit 12 captures moving images in the living room RM of the person to be monitored Ob-1 for 24 hours and stores them in the storage unit 13 (step S1). The SU control processing unit 10 copies the video of the monitored person Ob's lunchtime period from the 24-hour video stored in the storage unit 13 and sends it to the detection unit 14 .

The detection unit 14 performs processing for detecting the position of the monitored person Ob-1 in each frame (each image) that constitutes this moving image (step S2).

Based on the position of the monitored person Ob-1 during the lunch time period detected in step S2 and the position information PI pre-stored in the storage unit 13, the estimation unit 15 determines the position of the monitored person Ob-1. is continuously present in the desk and chair area R-2 (FIG. 3) for a predetermined period of time T1 (for example, 10 minutes) or longer (step S3).

When the estimating unit 15 determines that the position of the monitored person Ob-1 does not exist continuously in the desk and chair area R-2 for the predetermined period of time T1 or longer (No in step S3), the determining unit 17 determines that the monitored person Ob-1 Ob-1 is assumed not to have eaten during the lunch hour, and the behavior pattern of the monitored person Ob-1 is determined to be different from the standard behavior pattern (step S4).

When the estimating unit 15 determines that the position of the monitored person Ob-1 has continuously existed in the desk and chair area R-2 for a predetermined period of time or longer (Yes in step S3), the monitored person Ob-1 eats. It is estimated that it did (step S5). Then, the estimation unit 15 estimates the meal time of the monitored person Ob-1 (step S6). A period (for example, a period from 12:05 to 12:25) in which the monitored person Ob is in the desk and chair area R-2, including the predetermined period T1, is presumed to be the meal time.

The estimating unit 15 estimates the meal plan in step S6 based on the position of the monitored person Ob-1 during the lunch time period detected in step S2 and the position information PI pre-stored in the storage unit 13. The action taken by the monitored person Ob-1 is estimated before the time (step S7). For example, before the meal estimated in step S5, the estimation unit 15 determines that the position of the monitored person Ob-1 is continuously in the washroom area R-3 (FIG. 3) for a predetermined period of time T2 (for example, 1 minute). When there are above, it is estimated that the monitored person Ob-1 has washed his/her hands.

The estimating unit 15 estimates the meal plan in step S6 based on the position of the monitored person Ob-1 during the lunch time period detected in step S2 and the position information PI pre-stored in the storage unit 13. After the time, the behavior of the monitored person Ob-1 is estimated (step S8). For example, after the meal time estimated in step S6, the estimating unit 15 detects that the position of the monitored person Ob has continuously existed in the washroom area R-3 for a predetermined period of time T3 (for example, 3 minutes) or longer. Assume that the observer Ob brushed his teeth.

The identification unit 16 uses the meal estimated in step S5, the behavior (behavior before meal) estimated in step S7, and the behavior (behavior after meal) estimated in step S8 to identify the monitored object. The behavior pattern of the person Ob-1 is identified (step S9). For example, the behavior estimated in step S7 is washing hands, and the behavior estimated in step S8 is toothbrushing. In this case, the identifying unit 16 identifies washing hands, eating, and brushing teeth in this order as the behavior pattern of the monitored person Ob-1. For example, assume that the behavior estimated in step S7 is washing hands, and the behavior estimated in step S8 is sleeping (sleeping in bed). In this case, the identifying unit 16 identifies washing hands, eating, and sleeping in this order as the behavior pattern of the monitored person Ob-1.

The determination unit 17 determines whether or not the behavior pattern specified in step S9 is different from the reference behavior pattern (step S10). When the determination unit 17 determines that the behavior pattern specified in step S9 is the same as the reference behavior pattern (No in step S10), the SU control processing unit 10 determines whether the behavior of the monitored person Ob-1 during the lunch hour End pattern monitoring.

When the determination unit 17 determines that the behavior pattern specified in step S9 is different from the reference behavior pattern (Yes in step S10, or step S4), the SU control processing unit 10 sets the management server device SV as the destination. , to transmit a predetermined notification to the SU communication IF unit 11 (step S11). The predetermined notification includes the content of the reference behavior pattern (hand washing→eating→brushing teeth) and the content of the behavior pattern specified in step S9 (for example, hand washing→eating→sleep). Upon receiving the predetermined notification, the SU control processing unit 10 terminates monitoring the action pattern of the monitored person Ob-1 during the lunch hour.

4 and 8, in management server device SV, SV control processing unit 30 determines whether SV communication IF unit 31 has received the predetermined notification transmitted in step S11 (step S21). ). When the SV control processing unit 30 determines that the SV communication IF unit 31 has not received the predetermined notification (No in step S21), the SV control processing unit 30 repeats the process of step S21.

When the SV control processing unit 30 determines that the SV communication IF unit 31 has received a predetermined notification (Yes in step S21), the SV control processing unit 30 transmits this predetermined notification to the SV communication IF unit 31 with the fixed terminal device SP as the destination. (step S22).

5 and 9, in fixed terminal device SP, SP control processing unit 20 determines whether SP communication IF unit 21 has received the predetermined notification transmitted in step S22 (step S31). ). When the SP control processing unit 20 determines that the SP communication IF unit 21 has not received the predetermined notification (No in step S31), the SP control processing unit 20 repeats the process of step S31.

When the SP control processing unit 20 determines that the SP communication IF unit 21 has received a predetermined notification (Yes in step S31), the SP control processing unit 20 generates a notification image showing the content of the predetermined notification. FIG. 10 is an explanatory diagram for explaining an example of the notification image 60. As shown in FIG. The notification image 60 includes the room number, the name of the monitored person Ob, the reference behavior pattern during the lunch hour, and the specified behavior pattern. The SP control processing unit 20 causes the display constituting the SP output unit 23 (informing unit) to display the notification image 60 (step S32). This allows the user of the monitored person monitoring support system MS to know that the behavior pattern of the monitored person Ob-1 is different from the usual behavior pattern during the lunch hour. In the embodiment, the notification image 60 is used for notification, but the notification may be performed using voice.

The identification of the action pattern shown in (2) above will be briefly described using three specific examples. Referring to FIGS. 2 and 7, the length of time for washing hands before eating is set to 1 to 2 minutes as a standard behavior pattern. The estimating unit 15 estimates the meal plan in step S6 based on the position of the monitored person Ob-1 during the lunch time period detected in step S2 and the position information PI pre-stored in the storage unit 13. Before the time, the time during which the position of the monitored person Ob-1 was in the washroom area R-3 is measured. The specifying unit 16 specifies the length of time measured by the estimating unit 15 as a behavior pattern related to the length of time for the monitored person Ob-1 to wash their hands.

A standard behavior pattern is defined as a length of meal time of 30 minutes or less. The specifying unit 16 specifies the length of the meal time estimated by the estimation unit 15 in step S6 as the behavior pattern regarding the length of the meal time of the monitored person Ob-1.

As the length of time for brushing teeth, 5 to 10 minutes is taken as a standard behavior pattern. The estimating unit 15 estimates the meal plan in step S6 based on the position of the monitored person Ob-1 during the lunch time period detected in step S2 and the position information PI pre-stored in the storage unit 13. After the time, the time during which the position of the monitored person Ob-1 was in the washroom region R-3 is measured. The identifying unit 16 identifies the length of time measured by the estimating unit 15 as an action pattern related to the length of time the monitored person Ob-1 brushes his teeth.

The identification of the action pattern shown in (3) above will be briefly described using two specific examples. With reference to FIGS. 2, 3 and 7, the length of time required to move from the washroom 53 to the desk/chair 52 for eating before eating (in other words, the length of time from the end of hand washing to the start of eating) length), within 1 minute is taken as a reference behavior pattern. The estimation unit 15 determines that the position of the monitored person Ob-1 exists in the desk and chair area R-2 after the period in which the monitored person Ob-1 has existed in the washroom area R-3 ends before the meal time estimated in step S6. Measure the time until the period starts. The estimating unit 15 makes this measurement based on the position of the monitored person Ob-1 during the lunch time period detected in step S2 and the position information PI pre-stored in the storage unit 13 . The identifying unit 16 determines the length of time measured by the estimating unit 15 as behavior related to the length of time that the monitored person Ob-1 moves from the washroom 53 to the desk/chair 52 to eat before eating. Identify as a pattern.

After a meal, the length of time to move from the table/chair 52 for eating to the washroom 53 (in other words, the length of time from the end of the meal to the start of brushing teeth) is within 1 minute, which is the standard behavior pattern. . After the meal time estimated in step S6, the estimating unit 15 determines the period in which the position of the monitored person Ob-1 exists in the washroom area R-3 after the period in which the person to be monitored Ob-1 exists in the desk and chair area R-2 ends. Measure the time until the start of The estimating unit 15 makes this measurement based on the position of the monitored person Ob-1 during the lunch time period detected in step S2 and the position information PI pre-stored in the storage unit 13 . The identifying unit 16 determines the length of time measured by the estimating unit 15 as a behavior pattern related to the length of time the monitored person Ob-1 moves from the desk/chair 52 where he/she eats to the washroom 53 after eating. Identify as

Note that the standard behavior pattern may be the same for all monitored persons Ob, or may be determined for each monitored person Ob. The latter will be explained using an example of behavior patterns during the lunch hour. The specifying unit 16 specifies behavior patterns during the lunch hour every day, and causes the storage unit 13 to store it. When the number of behavioral patterns stored in the storage unit 13 exceeds a predetermined threshold value (for example, the same behavioral pattern exists for 20 days or more in 30 days), the SU control processing unit 10 uses that behavioral pattern as a reference. The behavior pattern is stored in the storage unit 13 . Three specific examples will be described.

The storage unit 13 provided in the first sensor unit SU-1 stores a behavior pattern in which the monitored person Ob-1 performs lunch, brushes teeth, and leaves the living room RM in this order during the lunch hour. Out of 30 days, this behavior pattern occurs for 26 days. The SU control processing unit 10 provided in the first sensor device SU-1 stores this action pattern in the storage unit 13 provided in the first sensor device SU-1 as the reference action pattern of the monitored person Ob-1. .

A storage unit provided in the first sensor device SU-1, in which the length of lunch time (30 minutes) of the monitored person Ob-1 estimated by the estimation unit 15 provided in the first sensor device SU-1 is used as an action pattern. 13 is stored. This behavior pattern occurs for 30 days out of 30 days. The SU control processing unit 10 provided in the first sensor device SU-1 stores this action pattern in the storage unit 13 provided in the first sensor device SU-1 as the reference action pattern of the monitored person Ob-1. .

The storage unit 13 provided in the second sensor unit SU-2 stores an action pattern in which the person to be monitored Ob-2 performs lunch, brushes his teeth, and sleeps in this order during the lunch time period. Out of 30 days, this behavior pattern occurs for 24 days. The SU control processing unit 10 provided in the second sensor unit SU-2 stores this behavior pattern in the storage unit 13 provided in the second sensor unit SU-2 as the reference behavior pattern of the monitored person Ob-2. .

A modified example of the monitored person monitoring support system MS according to the embodiment will be described mainly about differences from the monitored person monitoring support system MS according to the embodiment. FIG. 11 is a block diagram showing the configuration of the management server device SV provided in the modification.

Referring to FIG. 11 , management server device SV according to the modification further includes nursing care recording unit 32 in addition to SV control processing unit 30 and SV communication IF unit 31 .

The nursing care recording unit 32 stores nursing care records of the monitored person Ob. FIG. 12 is an explanatory diagram illustrating a part of an example of care records. In the care record, the contents of care are recorded in chronological order. The care record includes the date and time when care was given, the number of the living room RM where care was given, the name of the monitored person who received care, the name of the supervisor who provided care, and the content of care. The monitor NS creates a care record when caring for the monitored person Ob.

Nursing care records are created using the mobile terminal device TA. Specifically, referring to FIG. 1, the monitor NS creates a care record by inputting the care record on a care record input screen (not shown) displayed on the mobile terminal device TA. The mobile terminal device TA transmits this nursing care record to the management server device SV, and the management server device SV causes the nursing care recording unit 32 to record this nursing care record. Note that the care record may be created using the fixed terminal device SP. In this case, the supervisor NS creates a care record by entering the care record on a care record input screen (not shown) displayed on the fixed terminal device SP. The fixed terminal device SP transmits this care record to the management server device SV, and the management server device SV causes the care record unit 32 to record this care record. In this way, the nursing care record is not created by using the monitored person monitoring support device composed of the sensor device SU and the management server device SV, but by using this device and another device (portable terminal device TA, fixed It is created using the terminal device SP).

Referring to FIG. 11, nursing care recording unit 32 stores in advance a table showing the relationship between the content of care and the corresponding behavior of monitored person Ob. For example, when the content of care is "helping with lunch", the behavior of the monitored person Ob corresponding to this is "eating", and when the content of care is "helping with washing hands", the behavior of the monitored person Ob corresponding to this is The action is "washing hands", and when the content of care is "tooth brushing assistance", the corresponding action of the monitored person Ob is "tooth brushing".

When recording the content of care, the nursing care recording unit 32 records the behavior of the monitored person Ob corresponding to the content of the care in association with the content of the care. For example, when recording "lunch assistance", the nursing care recording unit 32 records "meals" in association with "lunch assistance". Therefore, the care record includes the first action information. The first behavior information is information indicating the behavior of the monitored person Ob and the time when the behavior was performed, which is created using a device different from the monitored person monitoring support device.

The configuration of the sensor device SU according to the modification is the same as the configuration of the sensor device SU shown in FIG. In the sensor device SU according to the modification, the SU control processing unit 10 and the SU communication IF unit 11 constitute an acquisition unit. The acquisition unit acquires the first behavior information from the nursing care recording unit 32 .

The operation of the monitored person monitoring support system MS according to the modified example will be described using the monitored person Ob-1 as an example. FIG. 13 is a flow chart explaining this operation. Since the monitored person Ob-1 is taken as an example, the sensor device SU is the first sensor device SU-1.

Referring to FIGS. 2, 11 and 13, SU control processing unit 10, after the lunch time slot of monitored person Ob-1 has passed, determines the lunch time of this day (for example, March 23, 2017). For the belt, it causes the SU communication IF unit 11 to transmit a request signal requesting the first behavior information of the monitored person Ob-1 (step S41). The destination of the request signal is the management server device SV. The request signal includes the address of the sensor unit SU that transmitted this request signal (here, the address of the first sensor unit SU-1), the room number (here, number 101) where this sensor unit SU is located, and the like. is included.

SV communication IF unit 31 receives the transmitted request signal (step S42), and SV control processing unit 30 generates first action information corresponding to the room number included in the request signal in nursing care recording unit 32. (step S43). Here, it is the first behavior information of the monitored person Ob-1 during the lunch time period on March 23, 2017. As shown in FIG. 12, at 12:25 on March 23, 2017, the content of care for the monitored person Ob-1 (Mr. A) is "hand washing assistance", and at 12:31 on March 23, 2017. 20, the content of care for the monitored person Ob-1 (Mr. A) is "lunch assistance". The nursing care recording unit 32 generates the first action information composed of "March 23, 2017, 12:25: Washing hands" and "March 23, 2017, 12:31: Eating".

The SV control processing unit 30 causes the SV communication IF unit 31 to transmit a response signal including the first action information generated in step S43 to the address included in the request signal received in step S42 (step S44). ).

The SU communication IF unit 11 receives the transmitted response signal (step S45), and the SU control processing unit 10 sends the first action information included in the response signal to the identification unit 16. The estimation unit 15 generates second behavior information regarding the monitored person Ob-1 (step S46). For example, during the lunchtime period (12:00 to 13:00) on March 23, 2017, after 12:31 (for example, 12:50), the position of the monitored person Ob-1 is 3 exists in the bed region R-1 for a predetermined period of time T4 (for example, 5 minutes) or more. In this case, the estimation unit 15 estimates that the monitored person Ob slept, and generates the second behavior information (“12:50 on March 23, 2017: sleep”).

The identifying unit 16 identifies the behavior pattern of the monitored person Ob-1 based on the first behavior information and the second behavior information (step S47). Here, the identifying unit 16 identifies an action pattern in which washing hands, eating, and sleeping are performed in order. Then, the first sensor device SU-1 performs the processing of step S10 shown in FIG. The subsequent processing is the same as that of the monitored person monitoring support device MS according to the embodiment.

The modified example assumes that the action pattern is the order of performing a plurality of actions. The first behavior information in which all of the plurality of behaviors are not behaviors estimated by the estimating unit 15, and some behaviors among the plurality of behaviors are created using a device different from the monitored person monitoring support device. include. The first action information is, for example, care records. The monitored person Ob may receive care from the observer NS for some of the various daily activities. For example, the monitor NS assists the monitored person Ob who needs meal assistance with eating. At this time, the supervisor NS records the assistance with meals, the time at which the assistance was provided, and the like, as care records. This record is used to identify behavioral patterns.

In the embodiment and modifications, the sensor device SU includes the storage unit 13, the detection unit 14, the estimation unit 15, the identification unit 16, and the determination unit 17, but the present invention is not limited to this, and the management The server device SV may have these. When the management server device SV is equipped with these, the SV control processing unit 30 and the SV communication IF unit 31 constitute a notification unit. When the determination unit 17 determines that the behavior pattern of the monitored person Ob is different from the reference behavior pattern, the notification unit notifies a predetermined terminal device.

In the embodiment and the modified example, one imaging unit 12 is provided in the sensor device SU, but the present invention is not limited to this, and a plurality of imaging units 12 may be provided. In other words, when only one imaging unit 12 cannot capture the image of the monitored person Ob, another imaging unit 12 covers the situation. For example, multiple visible cameras are used when it is desired to cover blind spots. For example, if it is desired to cover both daytime and nighttime, a visible camera and an infrared camera are used. For example, when it is desired to cover a region R that can be visualized with visible light and a region R that cannot be visualized with visible light but can be visualized with temperature, a visible camera and infrared thermography are used.

Although the embodiments and modifications have been described using a client-server system, the present invention is not limited to this, and can be applied to, for example, stand-alone and cloud systems.

(Summary of embodiments)
A monitored person monitoring support apparatus according to a first aspect of an embodiment includes a storage unit that stores in advance position information of an area where a monitored person acts in a room, and a position information of the monitored person in the room. a detection unit for detecting; an estimation unit for estimating the behavior of the monitored person using the position information and the position of the monitored person detected by the detection unit; and the monitored person estimated by the estimation unit. an identifying unit that identifies the behavior pattern of the monitored person using the behavior of the monitored person, and whether or not the behavior pattern of the monitored person identified by the identifying unit is different from a predetermined reference behavior pattern and a notification unit that notifies a predetermined terminal device when the determination unit determines that the behavior pattern of the monitored person is different from the reference behavior pattern.

In the room, the area (place) where the monitored person acts is, for example, in the case of a private room in a nursing care facility, the area where the bed is located, the area where the desk and chair for eating are located, the area where the washroom is located, For example, the area where the toilet is located.

The behavior of the monitored person is the behavior that the monitored person does indoors, such as washing hands, eating, and brushing teeth. Actions include, for example, daily activities such as eating, dressing, moving, and excreting indoors.

The estimation unit estimates the behavior of the monitored person based on the position information of the area and the position of the monitored person detected by the detection unit. For example, when the position of the monitored person exists in the area where the bed is located for a predetermined period or longer, it is estimated that the monitored person is asleep (sleeping on the bed).

The action pattern is a pattern of actions that the monitored person takes in the room, and the following three examples are given.

(1) Order of performing multiple actions (2) Length of time for a certain action (3) Length of time to move from one action area to the next action area

For example, when the estimation unit estimates that the monitored person washed his/her hands, then ate, and then brushed his/her teeth, the identification unit performs the following steps: washing hands, eating, and brushing teeth. , the action of the monitored person is specified as the action pattern.

When it is determined that the behavior pattern of the monitored person identified by the identification unit is different from the reference behavior pattern (for example, he usually brushes his teeth after eating but sleeps in bed), the notification unit terminal device (in the embodiment, the SU control processing unit, SU communication IF unit, SV control processing unit, and SV communication IF unit constitute a notification unit). Therefore, according to the monitored person monitoring support device according to the first aspect of the embodiment, it is possible to support monitoring of whether or not the behavior pattern of the monitored person is different from the usual behavior pattern.

In the above configuration, the detection unit detects the position of the monitored person in the room using time-series images captured by the imaging unit, and the position information is , indicates the position of the region on each image that constitutes the time-series images.

This configuration is an example of a detection unit. The imaging unit may be a visible camera, an infrared camera, or an infrared thermography. In the case of a visible camera, each image that makes up the time series of images is a visible image. In the case of an infrared camera, each image that makes up the time series of images is an infrared image. A time-series image has a configuration in which images captured by an imaging unit are arranged in time-series. Time-series images include moving images with arbitrary frame rates (for example, 24 fps, 15 fps, 10 fps, and 1 fps). In the case of moving images, frames are images.

The above configuration further includes an acquisition unit that acquires first behavior information indicating the behavior of the monitored person and the time at which the behavior was performed, which is created using a device different from the monitored person monitoring support device, Based on second behavior information indicating the behavior of the monitored person estimated by the estimation unit and the time when the behavior was performed, and the first behavior information obtained by the obtaining unit, the identifying unit performs: The order in which a plurality of actions are performed is specified as the action pattern. Specifically, the identification unit stores second behavior information indicating the behavior of the monitored person estimated by the estimation unit and the time when the behavior was performed, and the first behavior information acquired by the acquisition unit. Based on this, the order in which the plurality of actions were performed is determined, and the plurality of actions performed in the order are specified as the behavior pattern.

This configuration is based on the premise that the behavior pattern is the order of performing a plurality of behaviors. All of the plurality of behaviors are not behaviors estimated by the estimating unit, and some behaviors among the plurality of behaviors are included in the first behavior information created using a device different from the monitored person monitoring support device. included. The first action information is, for example, care records. A cared person (an example of a person to be monitored) may be cared for by a caregiver (an example of a monitor) with respect to some actions among various daily actions. For example, a caregiver assists a caregiver who needs assistance with eating. At this time, the caregiver records the meal assistance and the time at which the assistance was provided as a care record. This record is used to identify behavioral patterns.

The first behavior information may be stored in advance in a storage device provided in the monitored person monitoring support device, or may be stored in advance in a device (for example, a server) external to the monitored person monitoring support device. good. In the embodiment, the acquisition unit is configured by the SU control processing unit and the SU communication IF unit.

A monitored person monitoring support system according to a second aspect of the embodiment is a monitored person monitoring support system comprising a monitored person monitoring support device and a terminal device, wherein the monitored person monitoring support device is installed indoors. a storage unit for pre-storing position information of an area where a monitored person acts; a detection unit for detecting the position of the monitored person in the room; and the position information and the monitored object detected by the detection unit. an estimating unit for estimating the monitored person's behavior using the location of the monitored person; and an identifying unit for identifying the monitored person's behavior pattern using the monitored person's behavior estimated by the estimating unit. a determining unit that determines whether the behavior pattern of the monitored person identified by the identifying unit is different from a predetermined reference behavior pattern; a notification unit that notifies the terminal device when a pattern is determined to be different from the reference behavior pattern, and the terminal device includes a notification unit that notifies when the notification is made.

In the embodiment, the SP output section constitutes the notification section. A monitored person monitoring support system according to a second aspect of the embodiment defines the monitored person monitoring support device according to the first aspect of the embodiment from the viewpoint of the system. It has the same effects as the monitored person monitoring support device.

A monitored person monitoring support method according to a third aspect of an embodiment includes a detection step of detecting a position of a monitored person in a room; an estimating step of reading out the position information from a storage unit, and estimating the behavior of the monitored person using the position information and the position of the monitored person detected by the detecting step; and the estimating step. a identifying step of identifying a behavioral pattern of the monitored person using the behavior of the monitored person estimated by the identifying step, wherein the behavioral pattern of the monitored person identified by the identifying step is determined according to a predetermined standard; a determination step of determining whether or not the behavior pattern is different from the behavior pattern; and a notification step of notifying a predetermined terminal device when the behavior pattern of the monitored person is determined to be different from the reference behavior pattern by the determination step. And prepare.

A monitored person monitoring support method according to a third aspect of the embodiment defines the monitored person monitoring support device according to the first aspect of the embodiment from the viewpoint of the method, and the first aspect of the embodiment includes: It has the same effects as the monitored person monitoring support device.

A monitored person monitoring support program according to a fourth aspect of an embodiment includes a detection step of detecting a position of a monitored person in a room; an estimating step of reading out the position information from a storage unit and estimating the behavior of the monitored person using the position information and the position of the monitored person detected by the detecting step; and the estimating step. a identifying step of identifying a behavioral pattern of the monitored person using the behavior of the monitored person estimated by a method, wherein the behavioral pattern of the monitored person identified by the identifying step is determined according to a predetermined standard; a determination step of determining whether or not the behavior pattern is different from the behavior pattern; and a notification step of notifying a predetermined terminal device when the behavior pattern of the monitored person is determined to be different from the reference behavior pattern by the determination step. and cause the computer to execute

A monitored person monitoring support program according to a fourth aspect of the embodiment defines the monitored person monitoring support device according to the first aspect of the embodiment from a program point of view. It has the same effects as the monitored person monitoring support device.

While embodiments of the present invention have been illustrated and described in detail, this is done by way of illustration and example only, and not limitation. The scope of the invention should be construed by the language of the appended claims.

The entire disclosure of Japanese Patent Application No. 2017-247401 filed on December 25, 2017 is incorporated herein by reference in its entirety.

According to the present invention, it is possible to provide a monitored person monitoring support device, a monitored person monitoring support system, a monitored person monitoring support method, and a monitored person monitoring support program.

Claims (5)

a storage unit for pre-storing position information of an area in which the monitored person acts in the room;
a detection unit that detects the position of the monitored person in the room;
an estimation unit for estimating the behavior of the monitored person using the location information and the location of the monitored person detected by the detection unit;
an identifying unit that identifies a behavior pattern of the monitored person using the behavior of the monitored person estimated by the estimating unit;
a determination unit that determines whether the behavior pattern of the monitored person identified by the identification unit is different from a predetermined reference behavior pattern;
A monitored person monitoring support apparatus comprising: a notification unit that notifies a predetermined terminal device when the determination unit determines that the behavior pattern of the monitored person is different from the reference behavior pattern ,
further comprising an acquisition unit that acquires first behavior information indicating the behavior of the monitored person and the time at which the behavior was performed, which is created using a device different from the monitored person monitoring support device;
The specifying unit based on the second behavior information indicating the behavior of the monitored person estimated by the estimation unit and the time when the behavior was performed, and the first behavior information obtained by the obtaining unit. 1. A monitored person monitoring support device, which identifies an order in which a plurality of actions are performed as the action pattern . The detecting unit detects the position of the monitored person in the room using the time-series images captured by the imaging unit, and
2. The monitored person monitoring support device according to claim 1, wherein said position information indicates the position of said region on each image constituting said time-series images. A monitored person monitoring support system comprising a monitored person monitoring support device and a terminal device,
The monitored person monitoring support device includes:
a storage unit for pre-storing position information of an area in which the monitored person acts in the room;
a detection unit that detects the position of the monitored person in the room;
an estimation unit for estimating the behavior of the monitored person using the location information and the location of the monitored person detected by the detection unit;
an identifying unit that identifies a behavior pattern of the monitored person using the behavior of the monitored person estimated by the estimating unit;
a determination unit that determines whether the behavior pattern of the monitored person identified by the identification unit is different from a predetermined reference behavior pattern;
a notification unit that notifies the terminal device when the determination unit determines that the behavior pattern of the monitored person is different from the reference behavior pattern;
an acquisition unit that acquires first behavior information indicating the behavior of the monitored person and the time at which the behavior was performed, which is created using a device different from the monitored person monitoring support device;
The specifying unit based on the second behavior information indicating the behavior of the monitored person estimated by the estimation unit and the time when the behavior was performed, and the first behavior information obtained by the obtaining unit. , identifying the order in which a plurality of actions are performed as the action pattern ,
The monitored person monitoring support system, wherein the terminal device includes a notification unit that notifies when the notification is given. a detection step of detecting the position of the monitored person in the room;
In the room, the location information is read from a storage unit that stores in advance the location information of the area where the monitored person acts, and the location information and the location of the monitored person detected by the detection step are used. an estimation step of estimating the behavior of the monitored person;
a identifying step of identifying a behavior pattern of the monitored person using the behavior of the monitored person estimated by the estimating step;
a determination step of determining whether the behavior pattern of the monitored person identified by the identification step is different from a predetermined reference behavior pattern;
a notification step of notifying a predetermined terminal device when the behavior pattern of the monitored person is determined to be different from the reference behavior pattern in the determination step, wherein
further comprising an obtaining step of obtaining first behavior information indicating the behavior of the monitored person and the time at which the behavior was performed, created using a method different from the monitored person monitoring support method;
The specifying step is based on second behavior information indicating the behavior of the monitored person estimated by the estimation step and the time when the behavior was performed, and the first behavior information obtained by the obtaining step. 2. A method for supporting monitoring of a monitored person, wherein an order in which a plurality of actions are performed is specified as the action pattern . a detection step of detecting the position of the monitored person in the room;
In the room, the location information is read from a storage unit that stores in advance the location information of the area where the monitored person acts, and the location information and the location of the monitored person detected by the detection step are used. an estimation step of estimating the behavior of the monitored person;
a identifying step of identifying a behavior pattern of the monitored person using the behavior of the monitored person estimated by the estimating step;
a determination step of determining whether the behavior pattern of the monitored person identified by the identification step is different from a predetermined reference behavior pattern;
a monitored person monitoring support program for causing a computer to execute a notification step of notifying a predetermined terminal device when the behavior pattern of the monitored person is determined to be different from the reference behavior pattern by the determination step; There is
further comprising an obtaining step of obtaining first behavior information indicating the behavior of the monitored person and the time at which the behavior was performed, created using a program different from the monitored person monitoring support program;
The specifying step is based on second behavior information indicating the behavior of the monitored person estimated by the estimation step and the time when the behavior was performed, and the first behavior information obtained by the obtaining step. and a monitored person monitoring support program that identifies an order in which a plurality of actions are performed as the action pattern .

Images