JP7080071B2 - Behavior monitoring system and behavior monitoring method - Google Patents

Description

The present invention relates to a behavior monitoring system and a behavior monitoring method.

In a care support system such as a nurse call system, a system having a function of detecting a specific behavior such as a fall of a care recipient and notifying the terminal device of the caregiver (supervisor) to that effect is known.

Patent Document 1 describes a camera that captures a patient (monitored person) on the bed, and a caution state generation signal when a state in which the patient is upright or a state in which the patient is away from the bed is detected from the image captured by the camera. A nurse call system including a state determination unit for output and a nurse call master unit for displaying a patient image on a display unit in response to a caution state generation signal and performing a notification operation is disclosed.

Japanese Unexamined Patent Publication No. 2014-90913

By the way, it is desired that notification of specific actions such as raising the upper body is performed more appropriately. For example, when it is not necessary to detect a specific action, it may be desired that the notification of the specific action is not performed.

Therefore, the present invention provides a behavior monitoring system and a behavior monitoring method that can more appropriately notify a specific behavior.

In order to achieve the above object, the behavior monitoring system according to one aspect of the present invention is a behavior monitoring system that transmits the detection result of the specific behavior to the terminal device when the specific behavior of the monitored person is detected. A sensor installed in the living room and sensing the monitored person associated with the living room and a detection result of the specific behavior of the monitored person acquired from the sensing result of the sensor are transmitted to the terminal device. The control device includes a control device for controlling, and when a specific action in the monitored person associated with the living room is detected from the sensing result, the control device outputs the detection result of the specific action to the terminal device. When the monitored person associated with the living room and a person other than the monitored person are detected from the sensing result, the detection result of the specific action is transmitted to the terminal device. restrict.

Further, in order to achieve the above object, the behavior monitoring method according to one aspect of the present invention is a behavior monitoring method for transmitting the detection result of the specific behavior to the terminal device when the specific behavior of the monitored person is detected. When the specific behavior of the monitored person associated with the living room is detected from the sensing result obtained from the sensor installed in the living room and sensing the monitored person associated with the living room. When the detection result of the specific action is transmitted to the terminal device and the monitored person associated with the living room and a person other than the monitored person are detected from the sensing result, the specific action is performed. Transmission of the detection result to the terminal device is prohibited.

According to the behavior monitoring system and the behavior monitoring method according to one aspect of the present invention, it is possible to more appropriately notify the specific behavior.

It is a schematic block diagram of the behavior monitoring system which concerns on Embodiment 1. FIG. It is a block diagram which shows the functional structure of the behavior monitoring system which concerns on Embodiment 1. FIG. This is an example of a table held by the photographing apparatus according to the first embodiment. This is an example of a table held by the control device according to the first embodiment. It is a flowchart which shows the operation which outputs the result of the number of people and personal authentication in the photographing apparatus which concerns on Embodiment 1. FIG. It is a flowchart which shows the operation in the control apparatus which concerns on Embodiment 1. FIG. It is a flowchart which shows the operation which outputs the detection result of a specific action in the photographing apparatus which concerns on Embodiment 2. It is a flowchart which shows the operation which stops the detection of a specific action in the photographing apparatus which concerns on Embodiment 2. FIG.

Hereinafter, embodiments of the present invention will be described with reference to the drawings. Each of the embodiments described below shows a specific example of the present invention. Therefore, the numerical values, shapes, materials, components, arrangement of components, connection forms of components, steps, order of steps, etc. shown in the following embodiments are examples, and the gist of limiting the present invention. is not. Therefore, among the components in the following embodiments, the components not described in the independent claims indicating the highest level concept of the present invention will be described as arbitrary components.

Further, each figure is a schematic view and is not necessarily exactly illustrated. Further, in each figure, the same reference numerals are given to substantially the same configurations, and duplicate explanations may be omitted or simplified.

(Embodiment 1)
Hereinafter, the behavior monitoring system 10 according to the present embodiment will be described with reference to FIGS. 1 to 5.

[1. Configuration of behavior monitoring system]
First, the configuration of the behavior monitoring system 10 according to the present embodiment will be described with reference to FIGS. 1 to 3B.

FIG. 1 is a schematic configuration diagram of the behavior monitoring system 10 according to the present embodiment. FIG. 2 is a block diagram showing a functional configuration of the behavior monitoring system 10 according to the present embodiment.

As shown in FIGS. 1 and 2, the behavior monitoring system 10 according to the present embodiment includes a photographing device 20, a control device 30, a notification device 40, and a terminal device 60. The behavior monitoring system 10 according to the present embodiment is a long-term care support system that transmits information about the specific behavior of the care recipient to the terminal device 60 when the specific behavior of the care recipient is detected. The care recipient is an example of a monitored person whose behavior is monitored by the behavior monitoring system 10.

In the present embodiment, the photographing device 20 is arranged for each living room 100a in the nursing care facility 100, and the control device 30 and the notification device 40 are arranged in the office 100b (for example, a nurse center). The number of the photographing device 20, the notification device 40, and the terminal device 60 included in the behavior monitoring system 10 is not particularly limited.

The photographing apparatus 20 is installed in each of the living rooms 100a, and photographs the inside of the installed living room 100a. Specifically, the photographing device 20 photographs a care recipient who is a monitored person associated with the installed living room 100a.

As shown in FIG. 2, the photographing apparatus 20 includes an photographing unit 21, a control unit 22, a storage unit 23, and a communication unit 24.

The photographing unit 21 photographs the inside of the installed living room 100a. The photographing unit 21 is composed of, for example, an optical system, an image pickup device, an A / D conversion circuit, and the like.

The control unit 22 controls each component constituting the photographing apparatus 20. The control unit 22 is also a processing unit that performs predetermined processing on the image captured by the photographing unit 21. For example, the control unit 22 detects the number of people in the living room 100a by analyzing the image taken by the photographing unit 21, and the care recipient associated with the living room 100a can detect the number of people. It is determined whether or not the room is in the living room 100a. For the detection of the number of people, for example, the number of moving objects in the living room 100a may be detected, and the detected number may be determined to be the number of people in the living room 100a. For example, it can be realized by the background subtraction method or the interframe subtraction method. Further, the determination as to whether or not the care recipient is in the living room 100a is performed by, for example, personal authentication. The method of personal authentication is not particularly limited, but is performed by, for example, image authentication (for example, face authentication). The method of image authentication is not particularly limited, but for example, the feature amount of the face of a person is extracted from the image, and the feature amount of the face of the care recipient associated with the feature amount and the living room 100a is used as a cover. It may be determined whether or not the caregiver is in the living room 100a, or another method may be used. Information necessary for image authentication (for example, facial features of the care recipient) may be stored in the storage unit 23, for example.

The method of detecting the number of people and the method of personal authentication are not particularly limited. Further, the detection of the number of people and the detection of the care recipient are performed at predetermined time intervals, and the result is output to the control device 30 via the communication unit 24.

Further, the control unit 22 determines whether or not the care recipient has performed a predetermined specific action from the image taken by the photographing unit 21. Specifically, when the control unit 22 determines from the analysis of the image captured by the imaging unit 21 that a predetermined specific action has been performed, the control unit 22 outputs the determination result to the control device 30. It should be noted that the determination of whether or not a specific action has been performed can be realized by using, for example, the posture and position of the care recipient detected by the background subtraction method, the inter-frame difference method, or the like.

The control unit 22 determines whether or not a specific action has been performed using the two-dimensional image captured by the photographing unit 21, but is not limited to this. Instead of the photographing unit 21, the control unit 22 determines whether or not a specific action has been performed from the three-dimensional distance information acquired by a sensor (for example, a distance image sensor) using a TOF (Time Of Flight) method. May be good.

The storage unit 23 stores a table for determining whether or not the control unit 22 detects a specific action. The table stored in the storage unit 23 will be described with reference to FIG. 3A.

FIG. 3A is an example of the table T1 held by the photographing apparatus 20 according to the present embodiment.

As shown in FIG. 3A, the storage unit 23 stores the table T1 including the room number of the living room 100a, the number of living rooms set for each living room 100a, and the detection target person. The number of people in the living room is used to determine whether or not to send the detection result to the control device 30 when the control unit 22 detects a specific action. The detection target person is a target for detecting a specific behavior, and in the present embodiment, is a care recipient associated with the living room 100a. In FIG. 3A, in room number 101, the number of people in the living room is one, and the detection target person is “Mr. A”. That is, "Mr. A" is associated with the living room 100a of the room number 101 as a detection target person. In addition, a plurality of detection target persons may be set in one living room 100a. For example, as shown in the room number 103, the number of people in the living room at the time of notification is described as "1 person, 2 people". In this case, two detection target persons (Mr. C and Mr. D) are associated with the room number 103, and one person (one of Mr. C and Mr. D) or two persons (Mr. C) in the living room 100a. In the case of both Mr. and Mr. D), it is shown that the control device 30 is notified when a specific action is detected. Further, the detection result is a type of specific action (for example, a type of specific action such as “getting up” or “crouching” shown in FIG. 3B described later. For example, the detection result includes a specific action. Images taken of the care recipient may be included.

The storage unit 23 is realized by a semiconductor memory or the like.

The storage unit 23 may store information other than the table T1. Further, the storage unit 23 may store the image captured by the photographing unit 21.

The communication unit 24 is a communication module for communicating with the control device 30. The communication between the communication unit 24 and the communication unit 33 may be either wired communication or wireless communication. In the present embodiment, the communication between the communication unit 24 and the communication unit 33 is performed by wired communication.

The photographing device 20 is realized by, for example, a camera or the like. As described above, the photographing device 20 is communicably connected to the control device 30, and outputs the photographed image, the detection result of the specific action, and the like to the control device 30.

The photographing device 20 is an example of a sensor for detecting a specific behavior of a care recipient. Further, it is an example of sensing that the photographing unit 21 of the photographing apparatus 20 captures an image of the care recipient. In the present embodiment, an example in which the sensor has the photographing unit 21 will be described, but instead of the photographing unit 21, a distance image sensor or a radio wave sensor may be provided, or a plurality of combinations thereof may be provided. May have.

The control device 30 controls to transmit information on the specific behavior to the terminal device 60 according to the presence or absence of the specific behavior of the care recipient acquired from the imaging result of the imaging device 20. Specifically, whether or not the control device 30 transmits information on the specific behavior to the terminal device 60 according to the presence or absence of the specific behavior of the care recipient obtained from the analysis result of the image taken by the photographing device 20. To judge. The control performed by the control device 30 will be described later.

The control device 30 has a control unit 31, a storage unit 32, and a communication unit 33.

The control unit 31 controls each component constituting the control device 30. Further, the control unit 31 obtains the number of people in the living room 100a, the result of personal authentication, and the detection result of the specific action, which is obtained from the photographing device 20, the detection result of the specific action, and the image. It is determined whether or not at least one of them is transmitted to the terminal device 60. Further, the control unit 31 stores at least one of the number of people in the living room 100a, the result of personal authentication, the detection result of the specific action, and the image acquired from the photographing device 20 in the storage unit 32. Control to memorize. In addition, control is performed to output a detection result of a specific action or the like to the notification device 40.

The storage unit 32 stores a table for determining whether or not the control unit 31 transmits the detection of a specific action. The table stored in the storage unit 32 will be described with reference to FIG. 3B.

FIG. 3B is an example of the table T2 held by the control device 30 according to the present embodiment.

As shown in FIG. 3B, the storage unit 32 stores a table T2 including a room number, a detection target person, and a specific action to be notified to a caregiver (an example of a monitor). In the table T2, the detection target person and the specific action to be notified to the caregiver are stored in association with each other. The specific action to be notified is set for each of a plurality of detection target persons (care recipients). That is, the specific action is an action set corresponding to each of the plurality of detection target persons.

The storage unit 32 is realized by a semiconductor memory or the like.

The storage unit 32 may store information other than the table T2. The storage unit 32 may store, for example, the number of people in the living room 100a, the result of personal authentication, the detection result of a specific action, and at least one of images. Further, the information of the terminal device 60 for transmitting the detection result of the specific action may be stored.

In the above description, an example in which the photographing device 20 stores the table T1 and the control device 30 stores the table T2 has been described, but the present invention is not limited thereto. It suffices that at least one of the photographing apparatus 20 and the control apparatus 30 stores each of the tables T1 and T2. It should be noted that storing each of the tables T1 and T2 by at least one of the photographing device 20 and the control device 30 is included in the behavior monitoring system 10 having the tables T1 and T2.

The communication unit 33 is a communication module for communicating with the photographing device 20, the notification device 40, and the terminal device 60. The communication between the communication unit 33 and the notification device 40 is performed by, for example, wired communication, and the communication between the communication unit 33 and the terminal device 60 is performed by wireless communication via the network 50 (for example, the Internet).

The control device 30 may have a display unit (not shown), an input unit (not shown), and the like. The display unit is realized by a display device such as a liquid crystal display. The input unit is realized by a push button, a keyboard, or the like. That is, the control device 30 may be realized by a personal computer or the like.

The control device 30 is not limited to being arranged in the office 100b. The control device 30 may be arranged outside the nursing care facility 100, for example, as long as it can communicate with the photographing device 20, the notification device 40, and the terminal device 60. Further, the control device 30 is an example of a behavior monitoring device that monitors the care recipient.

In addition, a call button (not shown) or the like for the care recipient to call a care worker or the like may be installed in each of the living rooms 100a. The control device 30 is communicably connected to the call button, and for example, when it detects that the push button is pressed, the detection may be output to the notification device 40. Further, the control device 30 may transmit the detection to the terminal device 60.

The notification device 40 is a device for notifying the care staff and the like of the detection result of the specific behavior of the care recipient. The notification device 40 is, for example, a display device such as a liquid crystal display installed in the office 100b. The notification device 40 displays, for example, the detection result of the specific information of the care recipient acquired from the control device 30.

The notification device 40 is not limited to the display device, and may be a device that notifies the detection result of a specific action by sound, light, or the like, or may be configured by a combination thereof.

The terminal device 60 is a device that acquires the detection result of the specific behavior of the care recipient by wireless communication. The terminal device 60 is a mobile terminal owned by, for example, a caregiver or a staff member of a care facility 100, and may be a smartphone or a tablet.

The tables T1 and T2 may be set in advance in the terminal device 60 and transmitted to the control device 30 via the network 50. The control device 30 stores at least one of the acquired tables T1 and T2 in the storage unit 32. Further, the control device 30 outputs the table T1 to the photographing device 20, and the photographing device 20 stores the acquired table T1 in the storage unit 23. The same applies when the contents of the tables T1 and T2 are changed. The tables T1 and T2 may be input by an input unit (not shown) possessed by at least one of the photographing device 20 and the control device 30. The input unit is, for example, a push button or the like.

[2. Behavior monitoring system operation]
The operation of the behavior monitoring system 10 according to the present embodiment will be described with reference to FIGS. 4 and 5.

[2-1. Operation of the photographing device]
First, the operation of the photographing apparatus 20 will be described with reference to FIG.

FIG. 4 is a flowchart showing an operation of outputting the number of people and the result of personal authentication in the photographing apparatus 20 according to the present embodiment. In the following description, an example in which the photographing apparatus 20 is installed in the living room 100a of the room number 101 will be described.

As shown in FIG. 4, the photographing apparatus 20 acquires the number of people in the living room 100a and the result of personal authentication (that is, whether or not the detection target person is in the living room 100a) (S10). Specifically, first, the photographing unit 21 photographs the inside of the living room 100a. The photographing in the living room 100a of the photographing unit 21 is performed continuously, for example. The photographing unit 21 continuously performs imaging until, for example, an instruction to stop imaging is obtained from the control device 30. The control unit 22 detects the number of people in the living room 100a by analyzing the image taken by the photographing unit 21, and whether or not the detection target person is in the living room 100a. Judgment is made. The method of image analysis is not particularly limited.

Then, the control unit 22 outputs the living room information including the number of people in the living room 100a and the presence / absence of the detection target person to the control device 30 via the communication unit 24 (S11). The control unit 22 outputs the living room information to the control device 30 at predetermined intervals. The control unit 22 may output the living room information to the control device 30 every minute, for example, or the control unit 22 outputs the living room information to the control device 30 every time the number of people in the living room 100a or the presence or absence of the detection target person changes. It may be output.

The control unit 22 may individually transmit the number of people in the living room 100a and the result of personal authentication to the control device 30. For example, the control unit 22 may make the number of people in the living room 100a and the time interval for outputting one of the results of personal authentication shorter than the time interval for transmitting the other. For example, the control unit 22 may make the time interval for outputting the result of personal authentication shorter than the time interval for outputting the number of people.

As shown in FIG. 3A, the photographing device 20 also remembers the person to be detected in the living room other than the installed living room 100a. When the photographing device 20 detects a detection target person associated with another living room in a situation where there is no detection target person associated with the living room 100a, the photographing apparatus 20 uses information indicating that as the living room information. It may be included and output to the control device 30. As a result, it is possible to detect that the detection target person has mistakenly entered a room 100a different from his / her own room 100a. When the control device 30 acquires the room information, the control device 30 may output the room information only to the notification device 40 among the notification device 40 and the terminal device 60.

The control unit 22 may store the living room information in the storage unit 23.

Further, the control unit 22 detects the specific behavior of the detection target person “Mr. A” from the analysis of the image taken by the photographing unit 21. The detection of a specific action may be performed in real time or at predetermined time intervals. When the control unit 22 detects the specific action of the detection target person “Mr. A”, the control unit 22 outputs the detection result to the control device 30. Here, the specific action is not set exclusively for "Mr. A", but is an action that includes the specific action in all the detection target persons. In FIG. 3B, only "getting up" is set as a specific action for "Mr. A", but the control unit 22 has a specific action for each of "Mr. A to Mr. D" in "Mr. A". When either "getting up" or "squatting" is detected, the detection result of the specific action is output to the control device 30.

[2-2. Operation of control device]
Next, the operation of the control device 30 will be described with reference to FIG.

FIG. 5 is a flowchart showing the operation of the control device 30 according to the present embodiment. In the following description, an example in which the control device 30 acquires the detection of a specific action from the photographing device 20 installed in the living room 100a of the room number 101 will be described.

As shown in FIG. 5, when the control device 30 acquires the detection of a specific action for the detection target person from the photographing device 20 (Yes in S20), the control device 30 stores the detection result in the storage unit 32 (S21). The control device 30 acquires that a specific action for "Mr. A" has been detected from the photographing device 20. The specific action to be acquired is not a specific action unique to "Mr. A" but includes a specific action unique to a plurality of detection target persons.

If the control device 30 has not acquired the detection of the specific action from the photographing device 20 (No in S20), the control device 30 returns to step S20 and continues to acquire the detection of the specific action from the photographing device 20.

Next, the control device 30 confirms whether or not the acquired specific action is a specific action that requires notification to the terminal device 60 (S22). The control device 30 determines whether or not the acquired specific action is a specific action that needs to be notified to the terminal device 60 from the table T2 stored in the storage unit 32 and the acquired specific action.

For example, when the control unit 31 acquires information indicating that "getting up" is detected as a specific action of "Mr. A" from the photographing device 20, "getting up" is set to "Mr. A" from the table T2. Since it is a specific action to notify a person, it is determined that the notification is necessary (Yes in S22). Then, the process proceeds to step S23. On the other hand, when the control unit 31 acquires, for example, information indicating that "squatting" has been detected as a specific action of "Mr. A" from the photographing device 20, "squatting" is set to "Mr. A" from the table T2. Since it is not a specific action to notify the caregiver, it is determined that the notification is not necessary (No in S22), and the process is terminated.

When a plurality of specific actions to be notified to the caregiver are set for the detection target person, the control unit 31 may include the specific actions acquired from the photographing device 20 in the plurality of specific actions to be notified to the caregiver. If so, it may be determined that notification is necessary.

If Yes in step S22, the control unit 31 then determines from the living room information whether or not the caregiver needs to be notified (S23 to S24). The control unit 31 determines whether or not the detection target person associated with the living room 100a is present in the living room 100a (S23), and whether or not a person other than the detection target person is present in the living room 100a. Judgment is made. Specifically, the control unit 31 determines steps S23 and S24 from the living room information stored in the storage unit 32.

When the detection target person is in the living room 100a (Yes in S23) and there is no person other than the detection target person (No in S24), the control unit 31 outputs the detection result of the specific action to the terminal device 60. Send (S25). As a result, when the detection target person associated with the living room 100a is present in the living room 100a and there is no person who cares for the detection target person nearby, the caregiver or the like has a specific action on the terminal device 60. Detection can be sent. The detection result transmitted to the terminal device 60 includes information indicating a specific action such as "getting up" and at least one of an image when the specific action is detected. Further, if No in step S24, the control unit 31 may also output the detection result to the notification device 40.

When a plurality of detection target persons are associated with the living room 100a, the control unit 31 may indicate that at least one of the plurality of detection target persons is present in the living room 100a. If it is included in the living room information, it may be determined that the detection target person is in the living room 100a.

Further, when there is no detection target person in the living room 100a (No in S23), the detection result is not transmitted to the terminal device 60. As a result, it is possible to suppress erroneous transmission such as transmission of the detection result of a person different from the detection target person associated with the living room 100a to the caregiver. Further, when the detection target person is present in the living room 100a and a person other than the detection target person is present in the living room 100a (Yes in S23 and S24), the control unit 31 is the detection target person. Since a caregiver is present nearby, transmission of the detection result of the specific action to the terminal device 60 is prohibited (S26). That is, the control unit 31 does not transmit the detection result of the specific action acquired from the photographing device 20 to the terminal device 60.

When the control device 30 detects at least one of the plurality of care recipients and a person other than the care recipient when there are a plurality of care recipients associated with the living room 100a, the detection result of the specific action is obtained. Transmission to the terminal device 60 may be prohibited. The control unit 31 may further add information indicating that the detection result is not transmitted to the terminal device 60 to the detection result stored in step S21.

As described above, in the behavior monitoring system 10 according to the present embodiment, the care recipient (detection target person) corresponding to the room 100a is present in the room 100a, and a person other than the care recipient is present. When the care recipient performs a specific action while in the living room 100a, the control device 30 for prohibiting transmission of the detection result of the specific action to the terminal device 60 is provided. The control device 30 is a case where a specific behavior in the care recipient associated with the living room 100a is detected from the image taken by the photographing device 20, and the care recipient and the subject associated with the living room 100a. When a person other than the caregiver is detected, transmission of the detection result of the specific action to the terminal device 60 is prohibited.

[3. Effects, etc.]
As described above, the behavior monitoring system 10 according to the present embodiment is a behavior monitoring system 10 that transmits the detection result of the specific behavior to the terminal device 60 when the specific behavior of the care recipient is detected. The terminal device is installed in the living room 100a and captures the image of the care recipient associated with the living room 100a, and the detection result of the specific behavior of the care recipient acquired from the image captured by the photographing device 20. It is provided with a control device 30 that controls transmission to 60. Then, when the specific action in the care recipient associated with the living room 100a is detected from the image taken by the photographing device 20, the control device 30 transmits the detection result of the specific action to the terminal device 60. When a care recipient associated with the living room 100a and a person other than the care recipient are detected from the image taken by the photographing device 20, transmission of the detection result of the specific action to the terminal device 60 is prohibited. ..

As a result, even when the care recipient performs a specific action, when there is a person other than the care recipient in the vicinity of the care recipient, the information regarding the specific action is not transmitted to the terminal device 60. In other words, the control device 30 deals with the specific behavior of the care recipient (or informs the employee of the care facility 100 that the specific behavior has been performed) even when the care recipient performs the specific behavior. When a person (which can be notified) is nearby, the detection result of the specific action is not transmitted to the terminal device 60. As a result, the behavior monitoring system 10 does not transmit the detection result every time it detects a specific behavior, but when there is no person who detects the specific behavior and deals with the specific behavior, the behavior monitoring system 10 does not transmit the detection result. Since the notification can be given, the notification of the specific action can be made more appropriately.

Further, in the behavior monitoring system 10, since the control device 30 automatically determines whether to transmit (notify) the detection result of the specific action to the terminal device 60 or to prohibit it, the transmission is manually started and stopped. Compared to the case, it is possible to suppress the omission of notification due to forgetting to set the start and stop of transmission.

Further, when a plurality of care recipients are associated with the living room 100a, the control device 30 includes at least one of the plurality of care recipients and a plurality of persons other than the care recipient associated with the living room 100a. Is detected, transmission of the detection result of the specific action to the terminal device 60 is prohibited.

As a result, even when there are a plurality of care recipients associated with the living room 100a, it is possible to more appropriately notify the specific action.

In addition, the specific behavior is set for each of the plurality of care recipients.

As a result, since the specific behavior is set for each of the plurality of care recipients, it is possible to more appropriately detect the specific behavior notified to the caregiver. For example, the control unit 31 determines the specific behavior detected from the specific behavior of the care recipient (see, for example, table T2) for which the caregiver has preset notification and the specific behavior detected by the photographing device 20. By determining whether or not the care recipient who has performed a specific action needs to be notified, it is possible to more appropriately notify the specific action.

Further, as described above, the behavior monitoring method according to the present embodiment is a behavior monitoring method for transmitting the detection result of the specific behavior to the terminal device 60 when the specific behavior of the care recipient is detected. Specified when a specific behavior in the care recipient associated with the living room 100a is detected from the image acquired from the photographing device 20 installed in the living room 100a and photographing the care recipient associated with the living room 100a. When the action detection result is transmitted to the terminal device 60 and the care recipient associated with 100a in the living room and a person other than the care recipient are detected from the image acquired from the photographing device 20, the specific action is performed. Transmission of the detection result to the terminal device 60 is prohibited.

As a result, the same effect as that of the behavior monitoring system 10 is obtained.

(Embodiment 2)
Hereinafter, the behavior monitoring system 10 according to the present embodiment will be described with reference to FIGS. 6A and 6B. The configuration of the behavior monitoring system 10 is the same as that of the first embodiment, and the description thereof will be omitted. Further, the description of the same operation as that of the first embodiment will be omitted or simplified.

Since the present embodiment is characterized by the operation of the photographing apparatus 20, the operation of the photographing apparatus 20 will be mainly described. In addition to the operation shown in FIG. 4, the photographing apparatus 20 performs the operations shown in FIGS. 6A and 6B.

FIG. 6A is a flowchart showing an operation of outputting a detection result of a specific action in the photographing apparatus 20 according to the present embodiment. In the following description, an example in which the photographing apparatus 20 is installed in the living room 100a of the room number 101 will be described.

As shown in FIG. 6A, first, it is determined whether or not the detection target person (care recipient) who is the target for detecting the specific behavior is in the living room 100a (S30). Specifically, the control unit 22 determines whether or not the detection target person is in the living room 100a from the result of the personal authentication acquired in step S10 shown in FIG. For example, it is determined whether or not "Mr. A", who is the detection target, is present in the living room 100a.

Then, when the detection target person is present in the living room 100a (Yes in S30), the control unit 22 determines whether or not a person other than the detection target person is present in the living room 100a (S31). ). Specifically, the control unit 22 compares the number of people in the living room 100a acquired in step S10 shown in FIG. 4 with the number of people in the living room for notification included in the table T1 to detect the person to be detected. It may be determined whether or not a person other than the person is present in the living room 100a. At this point, the photographing unit 21 photographs the inside of the living room 100a, but the control unit 22 does not detect a specific action for the detection target person (for example, "Mr. A").

When the detection target person is present in the room 100a and no person other than the detection target person is present in the control unit 22 (No in S31), the control unit 22 does not have a person who cares for the detection target person nearby. Therefore, the detection of the specific behavior for the person to be detected is started (S32). As a result, the control unit 22 can appropriately start the detection of the specific action for the detection target person.

If "Mr. B" associated with another room 100a is present in the room 100a as a person other than "Mr. A", it is not included in the fact that there is a person other than the person to be detected. You may. When "Mr. A" and "Mr. B" are in the room 100a of the room number 101, the control unit 22 may determine No in step S31. Then, the control unit 22 may start detecting the specific action of "Mr. B" in addition to "Mr. A" associated with the room number 101, for example. Further, the control unit 22 may output information indicating that the detection of the specific action has started to the control device 30. When the control device 30 acquires the information, the notification device 40 may be made to notify that the detection of the specific action is started, or the terminal device 60 may be notified that the detection of the specific action is started. You may send it.

Further, in the control unit 22, when the detection target person is in the living room 100a and a person other than the detection target person is in the room (Yes in S31), the person who cares for the detection target person is nearby. Since we are in, we return to step S30. That is, in the case of Yes in step S31, the control unit 22 does not start the detection of the specific action. Even when the detection target person is not present in the room (No in S30), the process returns to step S30. Then, the steps after step S30 are repeated.

When the control unit 22 detects a specific action of "Mr. A" who is the detection target person (Yes in S33), the detection result is output to the control device 30 (S34). Here, the specific action is not set exclusively for "Mr. A", but is an action that includes the specific action in all the detection target persons. In FIG. 3B, only "getting up" is set as a dedicated specific action for "Mr. A", but the control unit 22 is set for each of "Mr. A to Mr. D" in step S33. When either "getting up" or "squatting", which is a special action, is detected, the process proceeds to step S34. On the other hand, when the control unit 22 does not detect the specific action (No in S33), the control unit 22 returns to step S33 and continues the detection of the specific action.

Next, the operation of stopping the detection of the specific action will be described with reference to FIG. 6B.

FIG. 6B is a flowchart showing an operation of stopping the detection of a specific action in the photographing apparatus 20 according to the present embodiment.

As described above, the control unit 22 determines, for example, whether or not the detection target person is present in the living room 100a at predetermined time intervals. For example, the control unit 22 performs detection of the specific behavior of the detection target person and determination of whether or not the detection target person is present in the living room 100a in parallel.

When the control unit 22 continues to detect the specific behavior (S40), the detection target person is present in the living room 100a (Yes in S41), and a person other than the detection target person is present in the room. (For example, a person other than the detection target person has entered the room) (Yes in S42), the detection of the specific action is stopped (S43). Further, the control unit 22 also stops the detection of the specific action when the detection target person leaves the room 100a and the detection target person disappears (No in S41). As a result, the control unit 22 can appropriately stop the detection of the specific behavior of the detection target person. When the control unit 22 becomes Yes in step S30 and No in step S31 shown in FIG. 6A, the control unit 22 starts detecting the specific action again.

Further, in the control unit 22, when the detection target person is present in the living room 100a and no person other than the detection target person is present in the room (No in S42), the person who cares for the detection target person is nearby. Since it is not, the process returns to step S40 and continues the detection of the specific action for the detection target person.

If "Mr. B" associated with another room 100a is present in the room 100a as a person other than "Mr. A", a person other than the person to be detected in step S42 is present in the room. It does not have to be included in being. For example, when "Mr. A" and "Mr. B" are in the room 100a of the room number 101, the control unit 22 may determine No in step S42. That is, when "Mr. A" associated with the room number 101 is in the room 100a and "Mr. B" enters the room 100a of the room number 101, the control unit 22 continues to detect the specific action. You may. Further, the control unit 22 may further start detecting the specific action of "Mr. B".

The photographing device 20 outputs the captured image to the control device 30 regardless of whether or not the detection of the specific action is started. The control device 30 stores the image acquired from the photographing device 20 in the storage unit 32.

When the control device 30 acquires the information indicating that the specific action has been detected from the photographing device 20, it determines whether or not the specific action is a specific action that requires notification (for example, corresponding to S22 shown in FIG. 5). ), When the specific action requires notification, information indicating that the specific action has been detected is transmitted to the terminal device 60.

As described above, the behavior monitoring system 10 according to the present embodiment includes a photographing device 20 and a control device 30. The photographing device 20 corresponds to the case where the care recipient (detection target person) corresponding to the room 100a is present in the room 100a and a person other than the care recipient is present in the room 100a. Stop detecting specific behaviors for the care recipient. Therefore, in the control device 30, when the care recipient corresponding to the room 100a is present in the living room 100a and a person other than the care recipient is present in the living room 100a, the care recipient is present. Does not acquire the detection result of the specific action from the photographing device 20 even if the specific action is performed. Therefore, the control device 30 can prohibit the transmission of the detection result of the specific action to the terminal device 60 by not acquiring the detection result of the specific action from the photographing device 20.

As described above, when the photographing device 20 of the behavior monitoring system 10 according to the present embodiment detects the care recipient associated with the living room 100a and a person other than the care recipient, the care recipient Stop detecting specific actions.

As a result, even when the care recipient performs a specific action, when there is a person other than the care recipient near the care recipient, the information regarding the specific action is not output from the photographing device 20 to the control device 30. .. That is, the information regarding the specific action is not transmitted to the terminal device 60. As a result, the behavior monitoring system 10 does not transmit the detection result every time it detects a specific behavior, but when there is no person who detects the specific behavior and deals with the specific behavior, the behavior monitoring system 10 does not transmit the detection result. Since the notification can be performed, the notification of the specific action can be performed more appropriately, and further, the amount of processing for the detection of the specific action in the control unit 22 can be reduced.

Further, in the action monitoring system 10, since the photographing device 20 automatically determines the start and stop of the detection of the specific action, the detection due to forgetting to set the start and stop of the detection is compared with the case where the detection is started and stopped manually. It is possible to suppress the occurrence of leakage and the like.

Further, when the photographing device 20 detects the care recipient associated with the living room 100a and a person other than the care recipient, the photographing device 20 continues to output the photographed image to the control device 30.

As a result, even when the photographing device 20 does not detect a specific action, the photographed image is output to the control device 30, so that the state in the living room 100a can be recorded. Therefore, the caregiver or the like can confirm the image taken when the specific behavior is not detected.

(Other embodiments)
Although the behavior monitoring system and the behavior monitoring method have been described above based on the embodiments, the present invention is not limited to the embodiments. As long as it does not deviate from the gist of the present invention, the present invention also includes a form in which various modifications conceived by those skilled in the art are applied to the present embodiment and a form constructed by combining components in different embodiments is also included in the scope of the present invention.

For example, in the above embodiment, an example in which the photographing device identifies the number of people in the living room and performs personal authentication has been described, but the present invention is not limited thereto. The behavior monitoring system is provided with a determination device for identifying the number of people in the living room and performing personal authentication outside the imaging device, and even if the determination device outputs the determination result to at least one of the imaging device and the control device. good. Further, the control device may specify the number of people in the living room and perform personal authentication from the image acquired from the photographing device. Then, the control device outputs the identification of the number of people in the living room and the result of personal authentication to the photographing device, specifies the number of people in the living room acquired from the control device, and detects the specific action from the result of personal authentication. May be started or stopped.

Further, in the above embodiment, the control unit of the photographing apparatus detects a specific action, but the present invention is not limited to this. For example, the control unit of the control device may detect a specific action.

Further, in the above embodiment, the photographing device has shown an example of detecting a specific action not set for the detection target person in the installed living room, but the present invention is not limited to this. When the photographing device refers to the table T2 and detects a specific action set for the detection target person associated with the installed living room, the photographing device outputs information indicating that the specific action has been detected to the control device. You may.

Further, in the above embodiment, an example in which the monitored person is a care recipient of a long-term care facility is shown, but the present invention is not limited to this. The monitored person may be a person who needs nursing care due to illness or injury, or a person living alone (for example, an elderly person).

Further, each control unit and the like included in the behavior monitoring system according to the above embodiment is typically realized as an LSI which is an integrated circuit. These may be individually integrated into one chip, or may be integrated into one chip so as to include a part or all of them.

Further, the integrated circuit is not limited to the LSI, and may be realized by a dedicated circuit or a general-purpose processor. An FPGA (Field Programmable Gate Array) that can be programmed after the LSI is manufactured, or a reconfigurable processor that can reconfigure the connection and settings of the circuit cells inside the LSI may be used.

Further, in each of the above-described embodiments, each component may be configured by dedicated hardware or may be realized by executing a software program suitable for each component. Each component may be realized by a program execution unit such as a CPU or a processor reading and executing a software program recorded on a recording medium such as a hard disk or a semiconductor memory.

Further, the order in which each step in the flowchart is executed is for exemplifying the present invention in detail, and may be an order other than the above. Further, a part of the above steps may be executed simultaneously with other steps (parallel).

In addition, general or specific embodiments of the present invention may be realized in a system, an apparatus, a method, an integrated circuit, a computer program, a computer-readable CD-ROM, a non-temporary recording medium such as an optical disk, or the like. .. The program may be stored in the storage medium in advance, or may be supplied to the storage medium via a wide area communication network including the Internet or the like.

10 Behavior monitoring system 20 Imaging device (sensor)
30 Control device 60 Terminal device 100a Living room T1, T2 Table

Claims (6)

It is a behavior monitoring system that sends the detection result of the specific behavior to the terminal device when the specific behavior of the monitored person is detected.
A sensor installed in the living room and sensing the monitored person associated with the living room,
It is provided with a control device that controls to transmit the detection result of the specific behavior of the monitored person acquired from the sensing result of the sensor to the terminal device.
The control device is
From the sensing result, when only the monitored person associated with the living room is detected, and the monitored person associated with the living room and a person other than the monitored person are detected and , When a person other than the monitored person is a monitored person associated with another living room and a specific behavior in the monitored person associated with the living room is detected , the specific behavior is detected. The result is transmitted to the terminal device,
From the sensing result, the person to be monitored and the person other than the person to be monitored are detected in the room, and the person other than the person to be monitored is not associated with the other room. In this case, a behavior monitoring system that prohibits transmission of the detection result of the specific behavior to the terminal device. The behavior monitoring according to claim 1, wherein the sensor stops the detection of the specific behavior of the monitored person when the monitored person and a person other than the monitored person associated with the living room are detected. system. The first or second claim, wherein the sensor continues to output the sensing result to the control device when it detects the monitored person associated with the living room and a person other than the monitored person. Behavior monitoring system. When a plurality of the monitored persons are associated with the living room, the control device detects at least one of the plurality of the monitored persons and a plurality of persons other than the monitored person. The behavior monitoring system according to any one of claims 1 to 3, which prohibits transmission of the detection result of a specific action to the terminal device. The behavior monitoring system according to claim 4, wherein the specific behavior is set for each of the plurality of monitored persons. It is a behavior monitoring method that sends the detection result of the specific behavior to the terminal device when the specific behavior of the monitored person is detected.
When only the monitored person associated with the living room is detected from the sensing result obtained from the sensor installed in the living room and sensing the monitored person associated with the living room, and in the living room. When the associated person to be monitored and a person other than the person to be monitored are detected, and the person other than the person to be monitored is a person to be monitored associated with another room, the room is occupied . When the associated specific action in the monitored person is detected, the detection result of the specific action is transmitted to the terminal device.
From the sensing result, the person to be monitored and the person other than the person to be monitored are detected in the room, and the person other than the person to be monitored is not associated with the other room. In this case, a behavior monitoring method for prohibiting transmission of the detection result of the specific behavior to the terminal device.

Images