JP2013180046A - Hand washing monitor, hand washing monitoring method, and hand washing monitoring program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a hand washing monitor capable of urging a user to appropriately wash hands depending on the situation in which the user washes hands, a hand washing monitoring method, and a hand washing monitoring program.SOLUTION: A hand washing monitor 101 includes: an imaging unit 11; a body part detecting unit 12 for detecting an object part G, that is a part or all of a hand washing part of a user in an image taken by the imaging unit 11, from the image; a motion recognition unit 14 for recognizing the motion of the object part G detected by the body part detecting unit 12; a hand washing motion defining unit 16 for acquiring hand washing information relating to the hand washing motion that the user should do, and defining the hand washing motion that the user should do based on the acquired hand washing information; and a motion determining unit 18 for determining whether the user performs the hand washing motion defined by the hand washing motion defining unit 16 based on the motion of the object part G recognized by the motion recognition unit 14.

Description

  The present invention relates to a hand-washing monitor, a hand-washing monitoring method, and a hand-washing monitor program, and more particularly to a hand-washing monitor, a hand-washing monitoring method, and a hand-washing monitor program for determining human hand-washing operation.

  In places where hygiene management is required such as canteens and hospitals, contaminated areas and non-contaminated areas are distinguished, and when workers enter the non-contaminated areas from the contaminated areas, it is necessary to perform hand washing according to the rules ( For example, Non-Patent Document 1 ("Hand-washing manual in school lunch kitchens", [online], [Search February 10, 2011], Internet <URL: http://www.mext.go.jp/a_menu/ sports / syokuiku / 08040316.htm>))).

  As an example of a method for monitoring hand washing, for example, Patent Document 1 (Japanese Patent Laid-Open No. 2001-292918) discloses the following method. That is, a warning device is attached to a hand-washing facility composed of a soap applicator, a water tap, an air towel, and a sterilizer. When the hand washing sequence is violated, or when the actual application time, actual water supply time, or actual drying time is shorter than the reference time, a warning is issued by a warning device and a redo is instructed. Record the order of handwashing and the actual time of each handwashing, use it to guide the correct handwashing work, and prove that the correct handwashing work was done.

  Patent Document 2 (Japanese Patent Application Laid-Open No. 2011-034458) discloses the following technique. That is, the monitoring system includes an imaging unit that captures an image of the monitoring area, a setting unit that sets an area of interest in the monitoring area, and a moving body that moves within the monitoring area based on the video imaged by the imaging unit. First detection means for detecting a movement locus of the mobile body, second detection means for detecting a staying time of the moving body in the area of interest based on an image captured by the imaging means, and the movement locus Determination means for determining whether or not the moving body has performed a hand washing operation based on the staying time.

“Hand washing manual at school lunch kitchen”, [online], [Search February 10, 2011], Internet <URL: http://www.mext.go.jp/a_menu/sports/syokuiku/08040316.htm >

JP 2001-292918 A JP 2011-034458 A

  By the way, when a user performs hand washing, the degree of hand washing required differs depending on the situation of hand washing. For example, in cafeterias and hospitals where hygiene management by hand washing is necessary, the order of hand washing and the time of each hand washing operation are defined as rules, and hand washing is required according to these rules. On the other hand, it is not required to follow such rules especially when washing hands at home. Even in the home, it is required to perform sufficient hand-washing when compared to hand-washing in other situations when returning home or after using the toilet.

  However, in the method described in Patent Document 1, the user is required to perform hand washing according to uniformly defined rules regardless of the situation in which hand washing is performed. For this reason, the hand washing operation specified in the rule may be different from the actually required hand washing operation, and there is a problem that it is not possible to prompt the user to perform an appropriate hand washing operation according to the situation of hand washing.

  Further, in the technique described in Patent Document 2, since the user is required to stay before the sink for a predetermined time regardless of the situation in which the hand is washed, as in the case where the method described in Patent Document 1 is used. However, there is still a problem that it is not possible to prompt the user to perform an appropriate hand-washing operation according to the situation of hand-washing.

  SUMMARY OF THE INVENTION The present invention has been made to solve the above-described problems, and an object of the present invention is to provide a hand-washing monitor, a hand-washing monitoring method, and a hand-washing monitor that can prompt the user to perform an appropriate hand-washing operation according to the situation in which the user performs hand-washing. Is to provide a program.

  In order to solve the above-described problems, a hand-washing monitor according to an aspect of the present invention detects, from the image, an imaging unit and a target portion that is a part or all of a user's hand-washing portion in an image captured by the imaging unit. A body part detection unit for performing, a motion recognition unit for recognizing the motion of the target part detected by the body part detection unit, and hand-washing information regarding the hand-washing operation to be performed by the user. Based on hand-washing information, a hand-washing operation defining unit for prescribing a hand-washing operation to be performed by the user, and a user-defining by the hand-washing operation defining unit based on the operation of the target part recognized by the operation recognition unit An operation determining unit for determining whether or not the hand washing operation is performed.

  Here, the hand-washing information is information that serves as a reference for determining a hand-washing operation requested of the user, such as information on an action before hand-washing or information input by the user. With such a configuration, the hand washing operation to be performed by the user is appropriately defined based on the hand washing information. Therefore, it is possible to prompt the user to perform an appropriate hand washing operation according to the situation in which the user performs hand washing.

  Preferably, the hand-washing monitor further includes a behavior information acquisition unit for acquiring behavior information related to behavior before the user starts hand-washing, and the hand-washing operation defining unit is acquired by the behavior information acquisition unit. The behavior information is acquired as the hand washing information.

  With such a configuration, since the hand washing operation to be performed by the user is automatically defined based on the behavior before the user starts hand washing, it is possible to prompt the user to perform a more appropriate hand washing operation.

  More preferably, the hand-washing monitor is connected to a home network in the user's home, and the behavior information acquisition unit acquires an operation state of a home device connected to the home network as the behavior information.

  With such a configuration, for example, when the user performs hand washing after using the toilet, it is possible to accurately grasp the behavior before the user starts hand washing.

  Preferably, the hand-washing monitor further includes a determination unit for predicting or determining that the user performs a hand-washing operation, and the hand-washing operation defining unit includes the time when the determination unit predicts or determines the hand-washing information. Get as.

  With such a configuration, for example, when the user performs hand washing after returning home or when performing hand washing before lunch, the user can grasp the situation of hand washing with a simple configuration and prompt the user to perform an appropriate hand washing operation. .

  Preferably, the hand-washing monitor further includes a personal authentication unit for acquiring blood vessel pattern information related to the blood vessel pattern of the user from the image and performing personal authentication for the user based on the acquired blood vessel pattern information, The hand washing operation defining unit acquires the result of the personal authentication by the personal authentication unit as the hand washing information.

  With such a configuration, for example, it is possible to distinguish whether the user is a child or an adult, and appropriate hand-washing according to the user's characteristics, such as prescribing hand-washing operations taking into account the difference in hand size You can encourage action.

  Preferably, the hand-washing monitor further includes a presentation control unit for performing control for presenting a determination result by the motion determination unit to the user.

  In this way, by presenting the determination result indicating whether or not an appropriate hand washing operation has been performed to the user, for example, in comparison with an indirect method of continuing water discharge from the faucet until an appropriate hand washing operation is performed, for example. Thus, it is possible to prompt the user to perform appropriate hand washing directly.

  Preferably, the imaging unit is installed near the faucet outlet.

  With such a configuration, it is possible to accurately image the target portion that is a part or all of the user's hand-washing portion.

  In order to solve the above-described problems, a hand-washing monitoring method according to an aspect of the present invention acquires hand-washing information related to a hand-washing operation to be performed by a user, and performs the hand-washing operation to be performed by the user based on the acquired hand-washing information. A step of detecting from the image a target portion that is a part of or all of the user's hand-washing portion in the captured image, and the target portion recognized by recognizing an operation of the detected target portion And determining whether or not the user has performed the prescribed hand-washing operation based on the above operation.

  With such a configuration, the hand washing operation to be performed by the user is appropriately defined based on the hand washing information. Therefore, it is possible to prompt the user to perform an appropriate hand washing operation according to the situation in which the user performs hand washing.

  In order to solve the above problems, a hand washing monitor program according to an aspect of the present invention obtains hand washing information related to a hand washing operation to be performed by a user in a computer, and the user should perform based on the obtained hand washing information. The step of detecting a target portion that defines a hand-washing operation and that is a part or all of the user's hand-washing portion of the captured image from the image, and recognizes and recognizes the detected operation of the target portion. Determining whether or not the user has performed the specified hand-washing operation based on the operation of the target portion.

  With such a configuration, the hand washing operation to be performed by the user is appropriately defined based on the hand washing information. Therefore, it is possible to prompt the user to perform an appropriate hand washing operation according to the situation in which the user performs hand washing.

  According to the present invention, it is possible to prompt the user to perform an appropriate hand-washing operation according to a situation where the user performs hand-washing.

It is a figure which shows the structure of the home network to which the hand-washing monitor which concerns on Embodiment 1 of this invention is connected. It is a block diagram which shows the structure of the hand-washing monitor which concerns on Embodiment 1 of this invention. It is a figure which shows the installation position of the imaging part of the hand-washing monitor which concerns on Embodiment 1 of this invention. It is a figure which shows the operation | movement in which the body part detection part of the hand-washing monitor which concerns on Embodiment 1 of this invention detects a user's target part. It is the flowchart which defined the operation | movement procedure at the time of the hand-washing monitor which concerns on Embodiment 1 of this invention performing determination of hand-washing operation | movement. It is the flowchart which defined the operation | movement procedure of the hand-washing prediction judgment process shown in FIG. It is a block diagram which shows the structure of the hand-washing monitor which concerns on Embodiment 2 of this invention. It is a block diagram which shows the structure of the hand-washing monitor which concerns on Embodiment 3 of this invention.

(Embodiment 1)
Hereinafter, Embodiment 1 of the present invention will be described with reference to the drawings. In the drawings, the same or corresponding parts are denoted by the same reference numerals and description thereof will not be repeated.

[Configuration and basic operation]
FIG. 1 is a diagram showing a configuration of a home network to which a hand washing monitor 101 according to Embodiment 1 of the present invention is connected, and FIG. 2 shows a configuration of the hand washing monitor 101 according to Embodiment 1 of the present invention. FIG. 3 is a diagram showing an installation position of the imaging unit 11 of the hand-washing monitor 101 according to Embodiment 1 of the present invention, and FIG. 4 is a hand-washing monitor according to Embodiment 1 of the present invention. It is a figure which shows the operation | movement in which the body part detection part 12 of 101 detects the target part G of the user A. FIG.

  Referring to FIG. 1, a home network in a user's home 10 includes a hand-washing monitor 101 according to Embodiment 1 of the present invention installed in a washroom, and an entrance device 102 (for home use installed in a keyhole of an entrance). Equipment), toilet equipment 103 (household equipment) installed in a toilet seat, etc., toilet server 1, entrance server 2, toilet server 3, and home server 4.

  The home server 4 can communicate with the hand-washing monitor 101, the entrance device 102, and the toilet device 103 via the washroom server 1, the entrance server 2, and the toilet server 3 by wire or wireless, respectively. Thereby, a home network in the home 10 is constructed. The home network may be constructed such that the home server 4 can further communicate with other household devices such as bathroom devices or kitchen devices.

  With reference to FIG. 2, the hand-washing monitor 101 includes an imaging unit 11, a body part detection unit 12, a determination unit 13, a motion recognition unit 14, a behavior information acquisition unit 15, a hand-washing operation defining unit 16, and a memory. 17, an operation determination unit 18, and a presentation control unit 19. In addition to the washroom server 1, the hand-washing monitor 101 is further connected to a presentation unit 20.

  With reference to FIG. 3, the imaging part 11 is installed in the vicinity of the spout 32 of the faucet 31 provided in the washroom. The imaging unit 11 images the hand-washing sink 33 continuously or at regular intervals, and outputs the captured image to the body part detection unit 12.

  Referring to FIG. 4, for example, when user A moves his / her hand into hand-washing sink 33 in order to perform hand-washing, target portion G, which is a part or all of user A's hand-washing portion, appears in the image. This image may be a still image or a moving image. The lens of the imaging unit 11 is an omnidirectional lens or a fisheye lens, and is further coated to repel water.

  The body part detection unit 12 detects the target portion G of the user A in the image captured by the imaging unit 11 from the image. The target portion G is, for example, the entire hand, and may include a wrist and an arm in addition to the entire hand, or may be a part of the hand, for example, a finger or the back of the hand. When the body part detection unit 12 detects the target portion G of the user A from the image, the body part detection unit 12 outputs a detection signal indicating the detection to the determination unit 13.

  When the determination unit 13 receives the detection signal from the body part detection unit 12, the determination unit 13 predicts that the user A performs hand washing, or determines that the user A performs hand washing, and makes a prediction or determination. A prediction determination signal indicating this is output to the behavior information acquisition unit 14.

  When the entrance device 102 or the toilet device 103 is activated, the home server 4 communicates with the entrance device 102 or the toilet device 103 via the entrance server 2 or the toilet server 3, and activation information indicating that these have been activated. To get.

  For example, when the user A opens the entrance key and returns home, the home server 4 acquires the operation information of the entrance device 102 installed in the keyhole of the entrance. Further, for example, when the user A is seated on the toilet seat, the home server 4 acquires operation information of the toilet device 103 installed on the toilet seat. And the home server 4 outputs the operation information of the front door apparatus 102 or the toilet apparatus 103 to the action information acquisition part 15 as action information regarding the action before the user A starts hand-washing via the washroom server 1. .

  When the behavior information acquisition unit 15 receives the prediction determination signal from the determination unit 13, the behavior information acquisition unit 15 outputs the behavior information acquired from the home server 4 to the hand washing operation defining unit 16 as hand washing information regarding the hand washing operation that the user A should perform.

  On the other hand, when the behavior information acquisition unit 15 does not receive the prediction determination signal from the determination unit 13 even though the behavior information is acquired from the home server 4, the behavior information acquisition unit 15 acquires only the behavior information from the home server 4. The signal shown is output to the presentation control unit 19.

  The memory 17 stores various actions before hand washing and hand washing operations in association with each other. Specifically, the memory 17 stores a hand washing operation when hand washing is performed after returning home, a hand washing operation when hand washing is performed after using the toilet, and the like. Here, the hand-washing operation includes a hand-washing order and a hand-washing operation time of each part such as a fingertip or a wrist.

  The hand-washing operation defining unit 16 stores the hand-washing operation corresponding to the behavior before the user A starts hand-washing based on the hand-washing information acquired from the behavior information acquiring unit 15, that is, the operation information of the entrance device 102 or the toilet device 103. 17 is read out. Then, the hand washing operation defining unit 16 defines the read hand washing operation as a hand washing operation to be performed by the user A.

  The motion recognition unit 14 recognizes the motion of the target portion G of the user A detected by the body part detection unit 12.

  The motion determination unit 18 determines whether or not the user A is performing the hand washing operation defined by the hand washing operation defining unit 16 based on the motion of the target portion G of the user A recognized by the motion recognition unit 14. That is, the motion determination unit 18 obtains recognition results recognized by the motion recognition unit 14 such as the hand washing sequence performed by the user A and the actual hand washing time, and the hand washing operation defined by the motion defining unit 16. The degree of matching is determined.

  The presentation control unit 19 presents the determination result by the operation determination unit 18 to the user A by controlling the presentation unit 20. The presentation unit 20 includes, for example, a display unit on which a plurality of scales are written, and an instruction unit that indicates a part of the scales. In accordance with the degree of coincidence between the hand-washing action specified by the action-defining part 16 and the hand-washing action actually performed by the user A, the presentation control unit 19 presents the instruction unit to indicate a scale indicating the degree. The unit 20 is controlled.

  As another presentation method, for example, the presentation unit 20 includes a lighting unit that lights red, yellow, and blue lamps, and the presentation control unit 19 uses the hand washing operation defined by the operation defining unit 16 and the user A. The presentation unit 20 is controlled so that lamps of different colors are lit according to the degree of coincidence with the actually performed hand washing operation.

  As another presentation method, for example, the presentation unit 20 includes a warning sound generation unit that generates a warning sound, and the presentation control unit 19 uses the hand washing operation defined by the operation definition unit 16 and the user A actually In accordance with the degree of coincidence with the hand washing operation performed in step 1, the presenting unit 20 is controlled so that the warning sound generating unit generates a different warning sound.

  The presentation control unit 19 should wash hands when receiving a signal from the behavior information acquisition unit 15 indicating that the behavior information acquisition unit 15 has acquired only the behavior information from the home server 4. In order to notify the user A that hand washing is not performed in a certain situation, the presentation by the presentation unit 20 is controlled using various methods as described above.

[Operation]
Next, an operation when the hand-washing monitor 101 according to Embodiment 1 of the present invention determines a hand-washing operation will be described.

  The hand-washing monitor 101 reads out and executes each step of each flowchart shown below from a memory (not shown). This program can be installed externally. The installed program is distributed in a state stored in a recording medium, for example.

  FIG. 5 is a flowchart that defines an operation procedure when the hand-washing monitor 101 according to Embodiment 1 of the present invention determines a hand-washing operation. FIG. 6 illustrates an operation procedure of the hand-washing prediction determination process shown in FIG. It is a defined flowchart.

  Referring to FIG. 5, when user A uses a toilet, toilet device 103 is activated (step S1).

  Next, the toilet device 103 outputs the operation information of the toilet device 103 to the home server 4 via the toilet server 3. Furthermore, the home server 4 outputs the operation information of the toilet device 103 as behavior information to the behavior information acquisition unit 15 of the hand-washing monitor 101 via the washroom server 1 (step S2).

  Next, the imaging unit 11, the body part detection unit 12, and the determination unit 13 perform hand washing prediction determination processing (step S3). Specifically, referring to FIG. 6, imaging unit 11 captures images in hand-washing sink 33 continuously or at regular intervals (step S31).

  Next, the body part detection unit 12 detects the target part G that is a part or all of the hand-washing part of the user A from the image captured by the imaging unit 11, and if detected, the detection signal is determined by the determination unit 13. (Step S32).

  Next, the determination unit 13 determines whether or not the target part G is detected by the body part detection unit 12 (step S33). When the determination unit 13 receives the detection signal from the body part detection unit 12 (“YES” in step S33), the prediction determination signal is output to the behavior information acquisition unit 14 (step S34).

  On the other hand, when the determination unit 13 does not receive the detection signal from the body part detection unit 12 (“NO” in step S33), the prediction determination process (step S3) is terminated without outputting the prediction determination signal.

  Referring to FIG. 5 again, next, the behavior information processing unit 15 determines whether or not a prediction determination signal is output from the determination unit 13 in the hand-washing prediction determination process (step S3) (step S4).

  When the behavior information processing unit 15 receives the prediction determination signal from the determination unit 13 (“YES” in step S4), the behavior information received from the home server 4, that is, the operation information of the toilet device 103 is handwash information. Is output to the hand-washing operation defining unit 16 (step S5).

  Next, the hand-washing operation defining unit 16 receives the hand-washing information from the behavior information acquiring unit 15 and corresponds to the pre-hand-washing behavior indicated in the behavior information, that is, the hand-washing operation when performing hand washing after using the toilet Are read from the memory 17 and the read hand-washing action is defined as the hand-washing action to be performed by the user A (step S6).

  Next, the motion recognition unit 14 recognizes the motion of the target part G detected by the body part detection unit 12, and outputs the recognition result to the motion determination unit 18 (step S7).

  Next, based on the motion of the target portion G of the user A recognized by the motion recognition unit 14, the motion determination unit 18 determines whether the user A has performed the hand washing operation defined by the hand washing operation defining unit 16. (Step S8).

  Next, the presentation control unit 19 presents the determination result by the operation determination unit 18 to the user A by controlling the presentation unit 20 (step S9).

  On the other hand, when the behavior information processing unit 15 does not receive the prediction determination signal from the determination unit 13 (“NO” in step S4), the presentation control unit 19 should wash hands after using the toilet. In order to notify that hand washing has not been performed, presentation by the presentation unit 20 is controlled (step S10).

  By the way, according to the method described in Patent Document 1, the user is required to perform hand washing according to uniformly defined rules regardless of the situation in which hand washing is performed. For this reason, the hand washing operation specified in the rule may be different from the actually required hand washing operation, and it is not possible to prompt the user to perform an appropriate hand washing operation in accordance with the situation of hand washing.

  Further, in the technique described in Patent Document 2, since the user is required to stay before the sink for a predetermined time regardless of the situation in which the hand is washed, as in the case where the method described in Patent Document 1 is used. Therefore, it is impossible to prompt the user to perform an appropriate hand-washing operation according to the situation of hand-washing.

  On the other hand, the hand-washing monitor 101 according to Embodiment 1 of the present invention captures from the image the imaging unit 11 and the target portion G that is a part or all of the user's hand-washing portion in the image captured by the imaging unit 11. A body part detection unit 12 for detection and an operation recognition unit 14 for recognizing the operation of the target part G detected by the body part detection unit 12 are provided. The hand-washing monitor 101 acquires hand-washing information related to the hand-washing operation to be performed by the user, and the hand-washing operation defining unit 16 and the operation recognition unit 14 for prescribing the hand-washing operation to be performed by the user based on the acquired hand-washing information. An operation determining unit 18 for determining whether or not the user has performed the hand washing operation defined by the hand washing operation defining unit 16 based on the recognized operation of the target portion G.

  With such a configuration, the hand washing operation to be performed by the user is appropriately defined based on the hand washing information. Therefore, it is possible to prompt the user to perform an appropriate hand washing operation according to the situation in which the user performs hand washing.

  Moreover, the hand-washing monitor 101 according to Embodiment 1 of the present invention further includes a behavior information acquisition unit 15 for acquiring behavior information related to behavior before the user starts hand-washing, and the hand-washing operation defining unit 16 includes: The action information acquired by the action information acquisition unit 15 is acquired as hand washing information.

  With such a configuration, since the hand washing operation to be performed by the user is automatically defined based on the behavior before the user starts hand washing, it is possible to prompt the user to perform a more appropriate hand washing operation.

  The hand-washing monitor 101 according to the first embodiment of the present invention is connected to a home network in the user's home 10, and the behavior information acquisition unit 15 is a home device connected to the home network, that is, the front door device 102 or the toilet. The operating status of the device 103 is acquired as behavior information.

  With such a configuration, for example, when the user performs hand washing after using the toilet, it is possible to accurately grasp the behavior before the user starts hand washing.

  In addition, the hand-washing monitor 101 according to Embodiment 1 of the present invention further includes a presentation control unit 19 for performing control for presenting the determination result by the operation determination unit 18 to the user.

  In this way, by presenting the determination result indicating whether or not an appropriate hand washing operation has been performed to the user, for example, in comparison with an indirect method of continuing water discharge from the faucet until an appropriate hand washing operation is performed, for example. Thus, it is possible to prompt the user to perform appropriate hand washing directly.

  In the hand-washing monitor 101 according to Embodiment 1 of the present invention, the imaging unit 11 is installed near the water outlet 32 of the faucet 31.

  With such a configuration, it is possible to accurately image the target portion G that is a part or all of the user's hand-washing portion.

  Note that the hand-washing monitor 101 according to Embodiment 1 described above defines the hand-washing operation to be performed by the user based on the operation status of the entrance device 102 or the toilet device 103 connected to the home network. However, the present invention is not limited to such an embodiment, and for example, the hand washing monitor 101 may be configured to define a hand washing operation according to the installation location of the faucet 31.

  According to such a configuration, for example, when the faucet 31 is installed in the bathroom, the faucet 31 is often used when the user returns home, and therefore the faucet 31 is installed in the kitchen. Compared to the case, it is possible to prompt the user to perform an appropriate hand-washing operation according to the situation of use, such as requiring the user to have a longer hand-washing time.

  In addition, for example, the hand-washing monitor 101 according to the first embodiment includes a water discharge control unit that controls water discharge from the faucet 31, and the operation determination unit 18 uses the hand-washing operation specified by the operation specifying unit 16 and the user A actually When it is determined that the hand washing operation performed in step S1 is coincident, the water discharge control unit may be configured to control to stop water discharge.

  According to such a configuration, a water-saving effect can be obtained because an appropriate amount of water according to the situation of hand washing is used.

  In addition, the hand-washing monitor 101 according to the first embodiment described above detects a target portion G that is a part or all of the hand-washing portion of the user in the captured image from the image (step S32 shown in FIG. 6), the user A step of acquiring hand-washing information relating to a hand-washing operation to be performed (step S5 shown in FIG. 5), a step of defining a hand-washing operation to be performed by the user based on the acquired hand-washing information (step S6 shown in FIG. 5), and A step of recognizing the operation of the target portion G (step S7 shown in FIG. 5) and a step of determining whether or not the user has performed the specified hand-washing operation based on the recognized operation of the target portion G (FIG. 5). A case has been described in which the operations are performed in the order of the step S8).

  However, the operation by the hand-washing monitor 101 is not necessarily limited to such an order. For example, the hand-washing monitor 101 detects a target portion G that is a part or all of the user's hand-washing portion in the captured image from the image, recognizes the operation of the detected target portion G, and the user should The step of acquiring hand-washing information related to the hand-washing operation, the step of specifying the hand-washing operation to be performed by the user based on the acquired hand-washing information, and the user performing the hand-washing operation specified based on the recognized operation of the target portion G You may operate | move in order of the step which determines whether or not.

(Embodiment 2)
The second embodiment of the present invention will be described below with reference to the drawings. In the drawings, the same or corresponding parts are denoted by the same reference numerals and description thereof will not be repeated.

  In the hand-washing monitor 201 according to Embodiment 2 of the present invention, the hand-washing operation defining unit 16 acquires time as hand-washing information, and specifies the hand-washing operation to be performed by the user based on the acquired time. FIG. 7 is a block diagram showing a configuration of the hand-washing monitor 201 according to Embodiment 2 of the present invention.

  Referring to FIG. 7, hand wash monitor 201 according to Embodiment 2 of the present invention is connected to washroom server 1 and home server 4 as compared with hand wash monitor 101 according to Embodiment 1 shown in FIG. 2. The point that the clock 21 is not connected, the function of the behavior information acquisition unit 15 and the hand-washing operation defining unit 16, and the content stored in the memory 17 are different.

  The behavior information acquisition unit 15 acquires time from the clock 21 as behavior information. When the prediction determination signal is output from the determination unit 13, the behavior information acquisition unit 15 outputs the behavior information that is the time when the determination unit 13 predicted or determined as handwash information to the hand-washing operation defining unit 16.

  The memory 17 stores time and hand washing operation in association with each other. Specifically, the memory 17 stores a time when the user returns home, a hand washing operation when performing hand washing after returning home, a hand washing operation when performing hand washing before eating, and the like.

  For example, when the time acquired from the behavior information acquisition unit 15 is within 30 minutes before and after the time stored as the time to go home, the hand washing operation definition unit 16 performs the hand washing operation corresponding to the time to go home from the memory 17. The hand washing action that has been read out and read out is defined as a hand washing action to be performed by the user.

  Thus, the hand-washing monitor 201 according to the second embodiment of the present invention further includes the determination unit 13, and the determination unit 13 predicts or determines that the user performs a hand-washing operation. In addition, the hand washing operation defining unit 16 acquires the time predicted or determined by the determination unit 13 as hand washing information.

  With such a configuration, for example, when the user performs hand washing after returning home or when performing hand washing before lunch, the user can grasp the situation of hand washing with a simple configuration and prompt the user to perform an appropriate hand washing operation. .

  Since other configurations and operations are the same as those of the hand-washing monitor 101 according to Embodiment 1, detailed description thereof will not be repeated here.

[Combination of home network and time]
Note that the home network described in the first embodiment can be employed in the hand-washing monitor 201 according to the second embodiment.

  For example, when the user returns home and the entrance device 102 installed in the keyhole of the entrance is activated, the operation information of the entrance device 102 is output to the behavior information acquisition unit 15 of the hand-washing monitor 201. On the other hand, when the entrance device 102 does not operate, the operation information of the entrance device 102 is not output to the behavior information acquisition unit 15.

  Further, when the user moves his / her hand into the hand-washing sink 33 in order to perform hand-washing, the body part detection unit 12 detects the target part G for hand-washing from the image captured by the imaging unit 11, and the detection signal is determined by the determination unit. 13 is output. Then, the determination unit 13 outputs a prediction determination signal to the behavior information acquisition unit 15. In addition, the behavior information acquisition unit 15 outputs the behavior information that is the time when the determination unit 13 predicts or determines to the hand washing operation defining unit 16 as hand washing information.

  Further, when the behavior information acquisition unit 15 acquires the operation information of the front door device 102, the operation information is output to the hand washing operation defining unit 16 as hand washing information. Then, the hand-washing operation defining unit 16 defines the hand-washing operation to be performed by the user based on the operation information of the entrance device and the time when the determination unit 13 predicts or determines.

  Here, the time when the determination unit 13 predicts or makes a determination is within 30 minutes before and after the time stored in the memory 17 as the time when the user returns, and the operation information of the front door device 102 is stored in the hand-washing operation defining unit 16. If it is output, the user who performs hand washing is the user who performs hand washing after returning home. In this case, the hand washing operation defining unit 16 defines the hand washing operation after returning home stored in the memory 17 as the hand washing operation to be performed by the user.

  On the other hand, the operation information of the front door device 102 is output to the hand-washing operation defining unit 16 although the time when the determination unit 13 predicts or determines is within 30 minutes before and after the time stored in the memory 17 as the time when the user returns home. If not, the user performing hand washing is not a human after returning home. In this case, for example, a normal hand washing operation is stored in the memory 17 separately from the hand washing operation associated with the action before hand washing, and the hand washing operation defining unit 16 performs the normal hand washing operation. It is defined as a hand-washing operation. In this way, it is possible to acquire more accurately the situation in which the user performs hand washing.

(Embodiment 3)
The third embodiment of the present invention will be described below with reference to the drawings. In the drawings, the same or corresponding parts are denoted by the same reference numerals and description thereof will not be repeated.

  In the hand-washing monitor 301 according to the third embodiment of the present invention, the hand-washing operation defining unit 16 acquires the result of personal authentication based on the blood vessel pattern of the user as hand-washing information, and the user should perform based on the acquired result of personal authentication. It defines the hand washing operation. FIG. 8 is a block diagram showing a configuration of the hand-washing monitor 301 according to Embodiment 3 of the present invention.

  Referring to FIG. 8, hand wash monitor 301 according to Embodiment 3 of the present invention is connected to washroom server 1 and home server 4 as compared with hand wash monitor 101 according to Embodiment 1 shown in FIG. 2. The point which is not performed, the point of the function of the judgment part 13, the action information acquisition part 15, and the hand-washing action prescription | regulation part 16, the point of the content memorize | stored in the memory 17, and the point provided with the personal authentication part 22 differ.

  When the determination unit 13 predicts that the user A performs hand washing or determines that the user A performs hand washing, the determination unit 13 outputs a prediction determination signal indicating the prediction or determination to the personal authentication unit 22.

  When receiving the prediction determination signal from the determination unit 13, the personal authentication unit 22 acquires the image captured by the image capturing unit 11. The personal authentication unit 22 acquires blood vessel pattern information related to the user's blood vessel pattern from the image, performs personal authentication for the user, and outputs the result of personal authentication to the behavior information acquisition unit 15 as behavior information.

  The behavior information acquisition unit 15 outputs the behavior information received from the personal authentication unit 22, that is, the result of personal authentication to the hand washing operation defining unit 16 as hand washing information.

  The memory 17 stores a hand washing operation for each user. Specifically, a hand washing operation when the user A performs hand washing, a hand washing operation when the user B performs hand washing, a hand washing operation when the user C performs hand washing, and the like are stored.

  Here, for example, when the user is a child, the hand washing operation time is set shorter than that for an adult in consideration of the difference in hand size from an adult. For example, when the hand-washing monitor 301 is used in a cafeteria, if the user is a cook, it is required to perform hand-washing sufficiently compared to a person who eats in the cafeteria. Is set.

  Such a setting can be stored in the memory 17 in advance by the user in accordance with the individual action pattern of the user performing hand washing.

  When receiving the result of personal authentication that the person performing the hand washing is the user A from the behavior information acquisition unit 15, the hand washing operation defining unit 16 reads out the hand washing operation to be performed by the user A from the memory 17. The hand washing action is defined as a hand washing action that the user A should perform.

  As described above, the hand-washing monitor 301 according to Embodiment 3 of the present invention further includes the personal authentication unit 22, which acquires blood vessel pattern information related to the user's blood vessel pattern from the image, and acquires the acquired blood vessel. Personal authentication is performed for the user based on the pattern information. In addition, the hand washing operation defining unit 16 acquires the result of personal authentication by the personal authentication unit 22 as hand washing information.

  With such a configuration, for example, it is possible to distinguish whether the user is a child or an adult, and appropriate hand-washing according to the user's characteristics, such as prescribing hand-washing operations taking into account the difference in hand size You can encourage action.

  Since other configurations and operations are the same as those of the hand-washing monitor 101 according to Embodiment 1, detailed description thereof will not be repeated here.

[Combination of home network and personal authentication]
Note that the home network described in Embodiment 1 can also be employed in the hand-washing monitor 301 according to Embodiment 3.

  For example, when the user uses a toilet, the toilet device 103 installed in the toilet is activated. At this time, a personal authentication unit is provided in the toilet, and personal authentication of a user who uses the toilet is performed. Then, the operation information of the toilet device 103 and the result of personal authentication of the user who uses the toilet are output to the behavior information acquisition unit 15 of the hand-washing monitor 301.

  Further, when the user moves his / her hand into the hand-washing sink 33 in order to perform hand-washing, the body part detection unit 12 detects the target part G for hand-washing from the image captured by the imaging unit 11, and the detection signal is determined by the determination unit. 13 is output. Then, the determination unit 13 outputs a prediction determination signal to the personal authentication unit 22, and the personal authentication unit 22 outputs the result of personal authentication to the behavior information acquisition unit 15. In addition, the behavior information acquisition 15 outputs the result of personal authentication to the hand washing operation defining unit 16 as hand washing information.

  Furthermore, when the behavior information acquisition unit 15 acquires the operation information of the toilet device 103 and the result of personal authentication of the user who uses the toilet, the operation information and the result of personal authentication are used as hand-washing information, and the hand-washing operation defining unit 16 is output. Then, the hand washing operation defining unit 16 performs the hand washing that the user should perform based on the operation information of the toilet device 103, the result of personal authentication of the user who uses the toilet, and the result of personal authentication output from the personal authentication unit 22. Define the behavior.

  In addition to the hand washing operation for each user, the memory 17 further stores, for each user, various actions before hand washing and the hand washing operation in association with each other. Here, when the result of the personal authentication of the user who uses the toilet matches the result of the personal authentication output from the personal authentication unit 22, the user who performs hand-washing performs hand-washing after using the toilet. It is a user who performs. In this case, the hand washing operation defining unit 16 reads out the hand washing operation of the user after using the toilet corresponding to the result of personal authentication from the memory 17 and defines the hand washing operation as the hand washing operation to be performed by the user.

  On the other hand, if the result of personal authentication of the user using the toilet and the result of personal authentication output from the personal authentication unit 22 do not match, the user performing hand washing is not a human after using the toilet . In this case, the hand-washing operation defining unit 16 reads out the hand-washing operation from the memory 17 for the user corresponding to the result of the personal authentication acquired from the personal authentication unit 22, and defines this hand-washing operation as the hand-washing operation to be performed by the user.

  With such a configuration, for example, in a situation where user B uses a toilet and user A simply performs hand washing, the user A is prevented from inconvenience of requesting a hand washing operation when performing hand washing after using the toilet. It is possible to acquire the situation of hand washing more accurately.

[Combination of time and personal authentication]
In addition, the configuration for acquiring the time described in the second embodiment as hand-washing information can be employed in the hand-washing monitor 301 according to the third embodiment.

  For example, the behavior information acquisition unit 15 acquires time from a clock (not shown), and when a prediction determination signal is output from the determination unit 13, the behavior information that is the time when the determination unit 13 predicted or determined is handwashed. The information is output to the hand-washing operation defining unit 16 as information. In addition, the behavior information acquisition unit 15 outputs the behavior information received from the personal authentication unit 22, that is, the behavior information that is the result of personal authentication, to the hand washing operation defining unit 16 as hand washing information. Then, the hand washing operation defining unit 16 defines the hand washing operation to be performed by the user based on the time when the determination unit 13 predicts or determines and the result of personal authentication.

  The memory 17 stores a time and a hand washing operation in association with each user. For example, when the time predicted or determined by the determination unit 13 is within 30 minutes before or after the time stored in the memory 17 as the user's return home time, the hand washing operation defining unit 16 responds to the result of personal authentication. The hand washing operation when the user performs hand washing after returning home is read from the memory 17, and this hand washing operation is defined as the hand washing operation to be performed by the user. Thereby, the hand-washing operation | movement according to a more specific condition can be prescribed | regulated.

[Combination of home network, time and personal authentication]
Further, the home network described in the first embodiment and the configuration for acquiring the time described in the second embodiment as hand-washing information can be employed in the hand-washing monitor 301 according to the third embodiment.

  For example, when the user comes home, the entrance device 102 installed at the entrance is activated. At this time, a personal authentication unit is provided at the entrance, and personal authentication of the user who uses the entrance is performed. Then, the operation information of the entrance device 103 and the result of personal authentication of the user using the entrance are output to the behavior information acquisition unit 15 of the hand-washing monitor 301.

  Further, when the user moves his / her hand into the hand-washing sink 33 in order to perform hand-washing, the body part detection unit 12 detects the target part G for hand-washing from the image captured by the imaging unit 11, and the detection signal is determined by the determination unit. 13 is output. Then, the determination unit 13 outputs a prediction determination signal to the personal authentication unit 22, and the personal authentication unit 22 outputs the result of personal authentication to the behavior information acquisition unit 15.

  The behavior information acquisition unit 15 matches the behavior information received from the personal authentication unit 22 of the hand-washing monitor 301, that is, the result of personal authentication matches the result of personal authentication of the user who uses the entrance. The result of personal authentication is output to the hand-washing operation defining unit 16 as hand-washing information. On the other hand, when the personal authentication results do not match, the behavior information acquisition unit 15 outputs the personal authentication result received from the personal authentication unit 22 of the hand-washing monitor 301 to the hand-washing operation defining unit 16. In addition, the behavior information acquisition 15 outputs the result of personal authentication to the hand washing operation defining unit 16 as hand washing information.

  Furthermore, when the behavior information acquisition unit 15 acquires the operation information of the entrance device 102 and the result of personal authentication of the user using the entrance, the operation information and the result of personal authentication are used as hand-washing information as a hand-washing operation defining unit. 16 is output.

  In addition, the behavior information acquisition unit 15 acquires time from a clock (not shown), and outputs the behavior information that is the time predicted or determined by the determination unit 13 to the hand washing operation defining unit 16 as hand washing information. Then, the hand washing operation defining unit 16 operates the entrance device 102, the result of personal authentication of the user using the entrance, the result of personal authentication output from the personal authentication unit 22, and the determination unit 13 predicts or makes a determination. The hand washing operation to be performed by the user is defined based on the determined time.

  The memory 17 stores, for each user, time, various actions before hand washing, and hand washing operations in association with each other. For example, the result of the personal authentication of the user who uses the entrance and the result of the personal authentication output from the personal authentication unit 22 are the same, and the time when the determination unit 13 predicts or determines the time the user returns. If it is within 30 minutes before and after the time stored in the memory 17 as the time to be performed, the hand-washing operation defining unit 16 performs a hand-washing operation when the user corresponding to the result of personal authentication performs hand-washing after returning home from the memory 17. read out. Then, the hand washing operation defining unit 16 defines the read hand washing operation as a hand washing operation to be performed by the user. Thereby, the hand-washing operation | movement according to a more specific condition can be prescribed | regulated.

  The above embodiment should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

DESCRIPTION OF SYMBOLS 1 Washroom server 2 Entrance server 3 Toilet server 4 Home server 10 In-home 11 Imaging part 12 Body part detection part 13 Judgment part 14 Motion recognition part 15 Behavior information acquisition part 16 Hand washing action prescription part 17 Memory 18 Action determination part 19 Presentation control part 20 Presentation Unit 21 Clock 22 Personal Authentication Unit 31 Faucet 32 Water Spout 33 Hand Wash Sink 101 Hand Wash Monitor 102 Entrance Device (Home Appliance)
103 Toilet equipment (household equipment)
201 Hand wash monitor 301 Hand wash monitor A User G Target part

Claims (9)

An imaging unit;
A body part detection unit for detecting from the image a target part that is a part or all of a user's hand-washing part in the image captured by the imaging unit;
An action recognition unit for recognizing the action of the target portion detected by the body part detection unit;
Hand washing information relating to the hand washing operation to be performed by the user, and a hand washing operation defining unit for defining the hand washing operation to be performed by the user based on the obtained hand washing information;
An operation determining unit for determining whether or not the user has performed the hand washing operation defined by the hand washing operation defining unit based on the operation of the target part recognized by the operation recognizing unit; Hand wash monitor. The hand washing monitor further includes:
A behavior information acquisition unit for acquiring behavior information related to the behavior before the user starts hand washing,
The hand-washing monitor according to claim 1, wherein the hand-washing operation defining unit acquires the behavior information acquired by the behavior information acquisition unit as the hand-washing information. The hand washing monitor is connected to a home network in the user's home,
The hand washing monitor according to claim 2, wherein the behavior information acquisition unit acquires an operation state of a home device connected to the home network as the behavior information. The hand washing monitor further includes:
A determination unit for predicting or determining that the user performs a hand washing operation;
The hand-washing monitor according to any one of claims 1 to 3, wherein the hand-washing operation defining unit acquires, as the hand-washing information, a time predicted or determined by the determination unit. The hand washing monitor further includes:
Obtaining blood vessel pattern information related to the blood vessel pattern of the user from the image, and comprising a personal authentication unit for performing personal authentication for the user based on the acquired blood vessel pattern information,
The hand-washing monitor according to any one of claims 1 to 4, wherein the hand-washing operation defining unit acquires a result of the personal authentication by the personal authentication unit as the hand-washing information. The hand washing monitor further includes:
The hand-washing monitor according to any one of claims 1 to 5, further comprising a presentation control unit configured to perform control for presenting a determination result by the operation determination unit to the user.   The hand washing monitor according to any one of claims 1 to 6, wherein the imaging unit is installed in the vicinity of a faucet outlet. Acquiring hand-washing information related to the hand-washing operation to be performed by the user, prescribing the hand-washing operation to be performed by the user based on the acquired hand-washing information, and a part or all of the user's hand-washing portion in the captured image Detecting a target portion that is from the image;
Recognizing the detected movement of the target portion and determining whether the user has performed the specified hand washing operation based on the recognized movement of the target portion. On the computer,
Acquiring hand-washing information related to the hand-washing operation to be performed by the user, prescribing the hand-washing operation to be performed by the user based on the acquired hand-washing information, and a part or all of the user's hand-washing portion in the captured image Detecting a target portion that is from the image;
Recognizing the detected movement of the target part and determining whether or not the user has performed the specified hand washing action based on the recognized movement of the target part. program.

Images