JP6870514B2 - Watching support system and its control method - Google Patents

Description

The present invention relates to a technique for assisting in watching over a subject on a bed.

In order to prevent accidents such as falling from the bed, a system that supports watching over patients in hospitals and long-term care facilities is known. Patent Document 1 proposes a system that detects a patient from an image (photographed image) taken by a camera, determines the movement of the patient based on the detection result, and gives a notification according to the determination result.

Japanese Unexamined Patent Publication No. 2012-071003

As described above, attempts have been made in the past to detect a target person from a captured image, monitor the detection result, and use it for support. However, although the notification is unnecessary when the subject is directly watched by another person, such a notification is unnecessary in the method of notifying according to a predetermined operation as in Patent Document 1. Notification may be given. Then, the occurrence of unnecessary notifications leads to an increase in the burden on the system user who confirms the notifications. Further, in the method of notifying the photographed image according to a predetermined operation, unnecessary notification may infringe the privacy of another person appearing in the photographed image.

The present invention has been made in view of the above circumstances, and an object of the present invention is to provide a technique capable of suppressing unnecessary notifications, reducing the burden on system users, and obtaining effects such as privacy protection. To do.

In order to achieve the above object, in the present invention, based on the determination area of the image (photographed image) captured by the imaging device, it is determined whether or not the subject is being watched by another person, and the subject is another person. A method is adopted in which the notification is omitted when it is determined that the person is watching over.

Specifically, the first aspect of the present invention is a watching support system that supports watching over a subject on a bed, an image acquisition unit that acquires an image taken by an imaging device, and the captured image. Based on the image of the determination area which is a part of the area and includes the bed, the monitoring determination unit for determining whether or not the subject is being watched by another person, and the image taken. It has a state determination unit that determines the state of the target person based on an image, and an output unit that gives a notification according to the determination result of the state determination unit. Provided is a watching support system characterized by omitting the notification when the watching determination unit determines that a person is watching.

According to this configuration, it is determined whether or not the subject is being watched by another person from the images of the bed area and the surrounding area. Here, consider a case where another person such as a nurse or a caregiver watches over a target person such as a patient or a person requiring long-term care. In this case, the subject is likely to be in bed and others are likely to be around the bed. Therefore, according to the above configuration, it is possible to determine with high accuracy whether or not the target person is being watched by another person. The notification is necessary to indirectly watch over the subject who is not directly watched, and is not necessary when the subject is directly watched by another person. According to the above configuration, when it is determined that the target person is being watched by another person, the notification is omitted. As a result, unnecessary notifications can be suppressed, and effects such as reducing the burden on system users and protecting privacy can be obtained. For example, it is possible to save the trouble of the system user confirming unnecessary notifications. In addition, it is possible to prevent unnecessary notification of images of others who are not involved in the use of the system such as visitors, and it is possible to protect the privacy of others.

When there are two or more persons in the determination area, the watching determination unit may determine that the target person is being watched by the other person. This is because there is a high possibility that the target person and another person watching over the target person are included in the two or more persons.

In the watching determination unit, when a first person existing in the bed and a second person facing the first person are present in the determination area, the target person is the other person. It may be determined that the person is being watched over. The first person in the bed is likely to be the subject, and the second person facing the subject (first person) is likely to be the person watching over the subject. is there.

The watching determination unit determines a person whose angle between the face-facing vector and the vector toward the first person is equal to or less than a threshold value as the second person facing the first person. It is good to do it. This is because a person whose angle between the face-facing vector and the vector toward the first person is equal to or less than the threshold value is likely to face the first person.

The watching determination unit determines that the target person is being watched by the other person when the person performing the watching action and the person performing the watching action are present in the determination area. May be good. A person who is watching over is likely to be a target person who is being watched over by another person, and a person who is performing a watching action is likely to be another person who is watching over the target person. Is.

The present invention can be regarded as a watching support system having at least a part of the above-mentioned configuration or function. Further, the present invention provides a monitoring support method or a control method of a watching support system including at least a part of the above processing, a program for causing a computer to execute these methods, or a program such as such program non-temporarily. It can also be regarded as a recorded computer-readable recording medium. Each of the above configurations and processes can be combined with each other to construct the present invention as long as there is no technical contradiction.

According to the present invention, unnecessary notifications can be suppressed, and effects such as reduction of burden on system users and protection of privacy can be obtained.

FIG. 1 is a block diagram schematically showing a hardware configuration and a functional configuration of a monitoring support system. FIG. 2 is a diagram showing an installation example of an imaging device. FIG. 3A is an example of a photographed image, FIGS. 3B and 3D are examples of a watching determination area, and FIG. 3C is an example of an action determination area. FIG. 4 is a flowchart of the state monitoring process. FIG. 5 is a flowchart of the watching determination process. 6A and 6B are examples of captured images. FIG. 7 is a flowchart of the watching determination process (first modification). 8A and 8B are examples of captured images. FIG. 9 is a flowchart of the watching determination process (second modification).

The present invention relates to a technique for assisting in watching over a subject on a bed. This technology can be applied to a system in hospitals, long-term care facilities, etc. that automatically detects the behavior of patients and long-term care recipients getting out of bed and getting up, and gives necessary notifications when a dangerous situation occurs. This system can be preferably used, for example, to support watching over elderly people, dementia patients, children and the like.

Hereinafter, an example of a preferred embodiment for carrying out the present invention will be described with reference to the drawings. However, the configurations and operations of the devices described in the following embodiments are examples, and the scope of the present invention is not limited to them.

(System configuration)
The configuration of the monitoring support system according to the embodiment of the present invention will be described with reference to FIGS. 1 and 2. FIG. 1 is a block diagram schematically showing a hardware configuration and a functional configuration of the monitoring support system 1, and FIG. 2 is a diagram showing an installation example of an imaging device.

The monitoring support system 1 has an image pickup device 10 and an information processing device 11 as a main hardware configuration. The image pickup device 10 and the information processing device 11 are connected by wire or wirelessly. Although only one image pickup device 10 is shown in FIG. 1, a plurality of image pickup devices 10 may be connected to the information processing device 11.

The image pickup device 10 is a device for photographing a subject on a bed and capturing image data. As the image pickup apparatus 10, a monochrome or color visible light camera, an infrared camera, a three-dimensional camera, or the like can be used. In the present embodiment, an image pickup device 10 composed of an infrared LED illumination 100 and a near-infrared camera 101 is adopted in order to enable watching over the subject even at night (even when the room is dark). As shown in FIG. 2, the image pickup apparatus 10 is installed so as to give a bird's-eye view of the entire bed 20 from above the head side to the foot side of the bed 20. The image pickup apparatus 10 takes pictures at predetermined time intervals (for example, 30 fps), and the image data is sequentially taken into the information processing apparatus 11. The orientation of the imaging device 10 is not particularly limited. The image pickup device 10 may be installed in the direction from the foot side of the bed 20, or the image pickup device 10 may be installed in the direction from the side surface side of the bed 20.

The information processing device 11 has a function of analyzing image data captured from the image pickup device 10 in real time, automatically detecting the wake-up state and the wake-up state of the subject 21 on the bed 20, and notifying the subject 21 when necessary. Is. The information processing device 11 has an image acquisition unit 110, a detection unit 111, a watching determination unit 112, an action determination unit 113, an output unit 114, an area setting unit 115, and a storage unit 116 as specific functions. The information processing device 11 of the present embodiment includes a CPU (processor), memory, storage (HDD, SSD, etc.), an input device (keyboard, mouse, touch panel, etc.), an output device (display, speaker, etc.), a communication interface, and the like. Each function of the information processing apparatus 11 described above is realized by the CPU executing a program stored in the storage or the memory. However, the configuration of the information processing device 11 is not limited to this example. For example, distributed computing may be performed by a plurality of computers, a part of the above functions may be executed by a cloud server, or a part of the above functions may be executed by a circuit such as an ASIC or FPGA. May be good.

The image acquisition unit 110 is a function of acquiring an image (photographed image) captured by the image pickup apparatus 10. The image data input from the image acquisition unit 110 is temporarily recorded in the memory or the storage, and is used for processing by the detection unit 111, the watching determination unit 112, the action determination unit 113, and the like.

The detection unit 111 analyzes the captured image acquired by the image acquisition unit 110, and detects the monitoring target person 21 and others (nurse, caregiver, etc.) from the captured image. For example, the detection unit 111 detects a human body or a part thereof (head, face, upper body, etc.) of a person. Any method may be used as a method for detecting the human body or a part thereof from the captured image. For example, an object detection algorithm using a classical Haar-like feature or HoG feature-based discriminator method or a recent Faster R-CNN method can be preferably used. The detection unit 111 of the present embodiment detects the head (the part above the neck; for example, the head 22 of the subject 21) by a discriminator using the Haar-like feature amount, and as a result of the detection, the position of the head. (X, y) and size (number of vertical and horizontal pixels) are output. The position of the head (x, y) is represented by, for example, the image coordinates of the center point of the rectangular frame surrounding the head. The detection unit 111 of the present embodiment outputs the detection result in the position and size of the image coordinate system, but the detection unit 111 converts the image coordinate system into the spatial coordinate system and determines the three-dimensional position of the person in the spatial coordinate system. You may output a three-dimensional size.

The watching determination unit 112 is a part of the captured image acquired by the image acquisition unit 110, and the subject 21 watches over another person based on the image of the watching determination area which is an area including the bed 20. It is a function to judge whether or not it is done. In the present embodiment, the watching determination unit 112 determines whether or not the target person 21 is being watched by another person based on the detection result of the detection unit 111 for the watching determination area. The processing of the watching determination unit 112 (watching determination processing) will be described later.

The action determination unit 113 is a function of determining the state and behavior of the target person 21 based on the captured image acquired by the image acquisition unit 110. In the present embodiment, the action determination unit 113 makes a wake-up determination, a bed-leaving determination, and the like based on the detection result of the detection unit 111 for the entire captured image.

The output unit 114 is a function of giving a notification according to the determination result of the action determination unit 113. In the present embodiment, the output unit 114 gives necessary notification when the behavior determination unit 113 detects the wake-up motion or the bed-leaving motion of the subject 21. The output unit 114 determines the necessity of notification (for example, notifying only in the case of a dangerous state), the content of the notification (for example, the content of the message), and the notification means (for example, voice) according to the degree of danger of the operation of the target person 21. , E-mail, buzzer, warning light), notification destination (for example, nurse, doctor), notification frequency, etc. can be switched. In the present embodiment, the output unit 114 omits the notification when the monitoring determination unit 112 determines that the target person 21 is being watched by another person.

The area setting unit 115 is a function of setting a determination area (watching determination area or action determination area) for a captured image captured by the imaging device 10. Since the monitoring support system 1 aims to monitor the state of the subject 21 on the bed 20, a determination area is set based on the area of the bed 20 in the captured image. The determination area may be set manually or automatically. In the case of manual setting, the area setting unit 115 may provide a user interface for allowing the user to input the bed area or the determination area itself in the captured image. In the case of automatic setting, the area setting unit 115 may detect the bed area from the captured image by the object recognition process.

FIG. 3A is an example of a photographed image, and FIG. 3B is an example of a watching determination area set for the photographed image of FIG. 3A. FIG. 3C is an example of an action determination region set for the captured image of FIG. 3A. In the present embodiment, the area setting unit 115 sets the watching determination area A0 and the action determination areas A1 to A3 with the bed area 30 as a reference. The watching determination area A0 is an area including the bed area 30 and its surroundings, and corresponds to a range in which the target person 21 and the other person can exist when the target person 21 is being watched by another person. The behavior determination area A1 is an area set on the head side of the bed 20, and corresponds to a range in which the head 22 of the subject 21 can exist at bedtime (when the subject 21 is sleeping on the bed 20). (Hereafter referred to as bed area A1). The behavior determination area A2 is an area set on the foot side of the bed 20, and corresponds to a range in which the head 22 of the subject 21 can exist when the subject 21 wakes up (when the subject 21 is in a posture in which the upper body is raised). (Hereafter referred to as wake-up area A2). In the present embodiment, the relative positions and sizes of the determination areas A0 to A2 with respect to the bed area 30 are predetermined, and if the bed area 30 is specified, the range of the determination areas A0 to A2 is determined by calculation. And. The action determination area A3 is an area other than the action determination areas A1 and A2. At the time of getting out of bed (when the subject 21 is away from the bed 20), the head 22 of the subject 21 exists in the behavior determination area A3 (hereinafter, referred to as the bed leaving area A3).

In the present embodiment, the watching determination unit 112 determines whether or not two or more head detection positions belong to the watching determination area A0. Then, the watching determination unit 112 determines that the target person 21 is being watched by another person when the detection positions of two or more heads belong to the watching determination area A0, and if not, the target person 21 Is not being watched by others.

Further, in the present embodiment, the behavior determination unit 113 determines which of the behavior determination areas A1 to A3 the detection position of the head belongs to, and classifies the state of the subject 21. Here, the case where the head is detected in the bed area A1 is the "bed state", the case where the head is detected in the bed area A2 is the "wake state", and the case where the head is detected in the bed area A3 is the "wake state". Called "state". Then, the behavior determination unit 113 detects the state change from the “sleeping state” to the “wake-up state” as the wake-up action, and detects the state change from the “wake-up state” to the “get-away state” as the wake-up action.

The storage unit 116 is a function of storing various data used for processing by the monitoring support system 1. At least, various parameters (thresholds, etc.) used for wake-up determination, bed-leaving determination, etc., determination area setting information, image data of a plurality of past frames or detection results (for calculation of movement speed and movement direction) are stored in the storage unit 116. A storage area is provided for storage.

(Status monitoring process)
An example of the status monitoring process of this system will be described with reference to FIG. The processing flow of FIG. 4 is executed every time one frame of an image is captured from the image pickup apparatus 10.

First, in step S40, the image acquisition unit 110 captures one frame of captured images from the image pickup apparatus 10. The acquired captured image is temporarily recorded in the storage unit 116.

Next, in step S41, the detection unit 111 detects the head from the captured image acquired in step S40. The detected head position (xy coordinates) information is recorded in the storage unit 116 in association with the shooting time information of the captured image acquired in step S40 or the frame number of the captured image.

Then, in step S42, the watching determination unit 112 performs the watching determination process using the detection result of step S41.

Next, in step S43, the process is switched according to the determination result of step S42. When it is determined that the target person 21 is being watched by another person, the process proceeds to step S44. If it is not determined that the target person 21 is being watched by another person, the processes of steps S44 and S45 are omitted, and this flowchart ends.

In step S44, the action determination unit 113 determines the state and action of the target person 21 by using the detection result of step S41. In step S45, the output unit 114 gives a notification according to the determination result in step S44.

(Watching judgment processing)
An example of the watching determination process in step S42 will be described with reference to FIGS. 5, 6A, and 6B. FIG. 5 is a flowchart of the watching determination process executed by the watching determination unit 112, and FIGS. 6A and 6B are examples of captured images acquired by the image acquisition unit 110.

First, in step S50, the watching determination unit 112 determines whether or not two or more heads are detected in the watching determination area A0. If two or more heads are detected in the watching judgment area A0, the process proceeds to step S51, and if only one head is detected in the watching judgment area A0, the process proceeds to step S52. Processing proceeds.

In step S51, the watching determination unit 112 determines that the target person 21 is being watched by another person (determination with watching).

In step S52, the watching determination unit 112 determines that the target person 21 is not being watched by another person (determination without watching).

Here, consider the case where the captured image 60 of FIG. 6A is acquired in step S40. In this case, in step S41, only the head 61 of the subject 21 is detected as the head in the watching determination area A0. Therefore, it is determined that the target person 21 is not being watched by another person (step S52), and notification is given according to the state and action of the target person 21 (steps S44 and S45).

Next, consider the case where the captured image 62 of FIG. 6B is acquired in step S40. In this case, in step S41, the head 61 of the target person 21 and the head 63 of another person watching over the target person 21 are detected as the heads in the watching determination area A0. Therefore, it is determined that the target person 21 is being watched by another person (step S51), and the notification in step S45 is omitted.

As described above, according to the present embodiment, it is determined whether or not the subject is being watched by another person from the images of the bed area and the surrounding area. Here, consider a case where another person such as a nurse or a caregiver watches over a target person such as a patient or a person requiring long-term care. In this case, the subject is likely to be in bed and others are likely to be around the bed. Therefore, according to the above configuration, it is possible to determine with high accuracy whether or not the target person is being watched by another person.

Specifically, it is determined that the target person is being watched by another person only when there are two or more persons in the watching determination area. Since there is a high possibility that the target person and the other person watching over the target person are included in the two or more persons, according to this configuration, it is highly accurate that the target person is being watched over by the other person. Can be detected. Further, when two or more people are shown in the captured image, the state of the other person may be erroneously detected as the state of the target person, but in the present embodiment, such erroneous detection is suppressed. You can also do it.

The notification is necessary to indirectly watch over the subject who is not directly watched, and is not necessary when the subject is directly watched by another person. According to the present embodiment, when it is determined that the target person is being watched over by another person, the notification is omitted. As a result, unnecessary notifications can be suppressed, and effects such as reducing the burden on system users and protecting privacy can be obtained. For example, it is possible to save the trouble of the system user confirming unnecessary notifications. In addition, it is possible to suppress unnecessary notification of the image of another person, and it is possible to protect the privacy of the other person.

<Others>
The above description of the embodiments is merely an exemplary description of the present invention. The present invention is not limited to the above-mentioned specific form, and various modifications can be made within the scope of its technical idea. For example, in the above embodiment, an example in which the trapezoidal monitoring determination area A0 (FIG. 3B) is set has been described, but the shape and size of the trapezoidal monitoring determination area A0 are not particularly limited. For example, as shown in FIG. 3D, a hexagonal watching determination area A0 may be set.

Further, the flowchart of the watching determination process is not limited to the flowchart of FIG. A modified example of the watching determination process will be described below.

(First modification)
A first modification of the watching determination process will be described with reference to FIGS. 7, 8A, and 8B. FIG. 7 is a flowchart of the watching determination process executed by the watching determination unit 112, and FIGS. 8A and 8B are examples of captured images acquired by the image acquisition unit 110.

First, in step S70, the watching determination unit 112 determines whether or not two or more heads are detected in the watching determination area A0. If two or more heads are detected in the watching judgment area A0, the process proceeds to step S71, and if only one head is detected in the watching judgment area A0, the process proceeds to step S75. Processing proceeds.

In step S71, the watching determination unit 112 detects a face from the monitoring determination area A0 of the captured image by using the captured image acquired by the image acquisition unit 110. Basically, the face is detected in the area where the head is detected. However, in the area such as the back of the head, since the face is not shown, the head is detected, but the face is not detected.

Next, in step S72, the watching determination unit 112 determines whether or not one or more faces are detected in step S71. If one or more faces are detected, the process proceeds to step S73, and if no face is detected, the process proceeds to step S75.

In step S73, the watching determination unit 112 watches over the first person existing in the bed 20 and the second person facing the first person based on the detection results of steps S41 and S72. It is determined whether or not it exists in the determination area A0. Here, since it is considered that the first person is being watched over by the second person, the first person will be referred to as a "watcher" and the second person will be referred to as a "watcher" thereafter. .. If there are a watcher and a watcher, the process proceeds to step S74, and if not, the process proceeds to step S75.

In step S74, the watching determination unit 112 determines that the target person 21 is being watched by another person (determination with watching).

In step S75, the watching determination unit 112 determines that the target person 21 is not being watched by another person (determination without watching).

Here, consider the case where the captured image 80 of FIG. 8A is acquired in step S40. In this case, in step S41, the head 81 of the target person 21 and the head 82 of another person who does not watch over the target person 21 are detected as the heads in the watching determination area A0. Then, in step S71, the face 83 of another person is detected.

After that, in step S73, the following processing is performed. First, watching judgment unit 112
Determines the head 81 detected in the bed 20 as the head of the watcher. Next, the watching determination unit 112 calculates a vector 84 for the direction of the face 83 and a vector 85 for the direction from the face 83 (head 82) to the head 81. Then, the watching determination unit 112 determines whether or not the angle θ1 (≦ 180 degrees) formed by the vector 84 and the vector 85 is equal to or less than the threshold value. The threshold value is an angle for determining whether or not the person is facing the watcher, for example, 45 degrees.

Since the angle θ1 is larger than the threshold value (45 degrees), the watching determination unit 112 determines the person with the face 83 as a person who is not facing the watching person, not the watching person. That is, the watching determination unit 112 determines that there is a watched person in the watching determination area A0, but there is no watching person in the watching determination area A0. Therefore, it is determined that the target person 21 is not being watched by another person (step S75), and notification is given according to the state and action of the target person 21 (steps S44 and S45).

Next, consider the case where the captured image 86 of FIG. 8B is acquired in step S40. In this case, in step S41, the head 81 of the target person 21 and the head 87 of another person watching over the target person 21 are detected as the heads in the watching determination area A0. Then, in step S71, the face 88 of another person is detected.

After that, in step S73, the following processing is performed. First, the watching determination unit 112 determines the head 81 detected in the bed 20 as the head of the watched person. Next, the watching determination unit 112 calculates a vector 89 for the direction of the face 88 and a vector 90 for the direction from the face 88 (head 87) to the head 81. Then, the watching determination unit 112 determines whether or not the angle θ2 (≦ 180 degrees) formed by the vector 89 and the vector 90 is equal to or less than the threshold value.

Since the angle θ2 is equal to or less than the threshold value (45 degrees), the watching determination unit 112 determines the person with the face 88 as the watching person. That is, the watching determination unit 112 determines that the watching person and the watching person exist in the watching determination area A0. Therefore, it is determined that the target person 21 is being watched over by another person (step S74), and the notification in step S45 is omitted.

As described above, according to the first modification, the watcher (first person) existing in the bed and the watcher (second person) facing the watcher are watching. Only when it exists in the determination area, it is determined that the target person is being watched by another person. The watcher present in the bed is likely to be the target person, and the watcher facing the target person (watcher) is likely to be the person watching over the target person. And even if another person is near the target person, it is difficult to say that the other person is watching over the target person if the other person is not facing the target person. Therefore, according to this configuration, it is possible to determine with higher accuracy whether or not the subject is being watched by another person.

Further, according to the first modification, a person whose angle between the face-facing vector and the vector toward the watcher is equal to or less than the threshold value is determined as the watcher. A person whose angle between the face-facing vector and the vector toward the watcher is less than or equal to the threshold value is likely to face the watcher. Therefore, according to this configuration, the watcher can be detected with high accuracy.

(Second modification)
A second modification of the watching determination process will be described with reference to FIG. FIG. 9 is a flowchart of the watching determination process executed by the watching determination unit 112.

First, in step S90, the watching determination unit 112 determines whether or not two or more heads are detected in the watching determination area A0. If two or more heads are detected in the watching judgment area A0, the process proceeds to step S91, and if only one head is detected in the watching judgment area A0, the process proceeds to step S94. Processing proceeds.

In step S91, the watching determination unit 112 uses the captured image acquired by the image acquisition unit 110 to perform an operation of watching over from the monitoring determination area A0 of the captured image with the watching operator. Detects the watching operator who is performing. The movements to be watched are movements such as getting up and sleeping, assisting with eating, and assisting with changing clothes, and the movements to be watched are movements such as assisting with getting up and going to bed, assisting with eating, and assisting with changing clothes. The watching operator and the watching operator are detected by, for example, an object detection algorithm using a method using a classifier using HoG features or a method using Faster R-CNN.

Next, in step S92, the watching determination unit 112 determines whether or not both the watching operator and the watching operator are detected in step S91. If both the watch-over operator and the watch-over operator are detected, the process proceeds to step S93, and if not, the process proceeds to step S94.

In step S93, the watching determination unit 112 determines that the target person 21 is being watched by another person (determination with watching).

In step S94, the watching determination unit 112 determines that the target person 21 is not being watched by another person (determination without watching).

As described above, according to the second modification, the target person is another person only when the person performing the watching action and the person performing the watching action are present in the watching determination area. It is judged that it is being watched over by. The person performing the action of being watched is likely to be the target person being watched by another person, and the person performing the action of watching is likely to be the other person watching over the subject. And, even if another person is near the target person, it is difficult to say that the other person is watching over the target person if the other person does not perform the action of watching over the target person. Therefore, according to this configuration, it is possible to determine with higher accuracy whether or not the subject is being watched by another person.

1: Watching support system 10: Imaging device 11: Information processing device 110: Image acquisition unit 111: Detection unit 112: Watching determination unit 113: Behavior determination unit 114: Output unit 115: Area setting unit 116: Storage unit 100: Infrared LED Lighting 101: Near-infrared camera 20: Bed 21: Subject 22: Head 30: Bed area A0: Watching judgment area A1: Bedtime area (behavior judgment area) A2: Waking up area (behavior judgment area) A3: Bed leaving area ( Action judgment area)
60: Photographed image 61: Head 62: Photographed image 63: Head 80: Photographed image 81: Head 82: Head 83: Face 84: Vector 85: Vector 86: Photographed image 87: Head 88: Face 89: Vector 90: Vector θ1: Angle θ2: Angle

Claims (4)

It is a watching support system that supports watching the target person on the bed.
An image acquisition unit that acquires images taken by an image pickup device, and
A monitoring determination unit that determines whether or not the target person is being watched by another person based on an image of a determination area that is a part of the captured image and is an area including the bed. ,
A state determination unit that determines the state of the target person based on the captured image, and a state determination unit.
An output unit that gives notification according to the determination result of the status determination unit, and
Have,
In the watching determination unit, when a first person existing in the bed and a second person facing the first person are present in the determination area, the target person is the other person. Judging that it is being watched over by
The output unit is a monitoring support system characterized in that when the monitoring determination unit determines that the target person is being watched by another person, the notification is omitted. The watching determination unit determines a person whose angle between the face-facing vector and the vector toward the first person is equal to or less than a threshold value as the second person facing the first person. The monitoring support system according to claim 1 , wherein the monitoring support system is characterized. It is a control method of a watching support system that supports watching over the subject on the bed.
The step of acquiring the image taken by the image pickup device and
A step of determining whether or not the subject is being watched by another person based on an image of a determination area which is a part of the captured image and is an area including the bed.
A step of determining the state of the subject based on the captured image, and
A step of notifying according to the determination result of the state of the target person, and
Have,
When the first person present in the bed and the second person facing the first person are present in the determination area, the subject is being watched by the other person. Judged,
A control method of a watching support system, characterized in that the notification is omitted when it is determined that the target person is being watched by the other person. A program for causing a computer to execute each step of the control method of the monitoring support system according to claim 3.

Images