JP2021140053A - Hand-wash state visualization determination device and hand-wash state visualization determination method - Google Patents

Abstract

To provide a device which can train and educate each person to be conscious of the importance of hand-wash and have an interest in the hand-wash by motivating each person to wash hands.SOLUTION: In a hand-wash state visualization determination device 1, an opening 16 to/from which the hands of a subject can be put is formed in a device body 10. The hand-wash state visualization determination device comprises: an illumination device 20 which emits light for illuminating fluorescence substances to the inside of the device body 10; an irradiation area 30 which is formed for emitting the light of the illumination device 20 to the hands of the subject inserted into the device body 10 after the subject washes the hands applied with the fluorescence substances; a first imaging device 40 which images the fluorescent state of the hands of the subject located in the irradiation area 30; an image processing device 60 which digitizes the unwashed state of the hands of the subject from the image captured by the first imaging device 40; a comparison determination device 71 which determines acceptance by comparing the data digitized by the image processing device 60 with a preset acceptance determination reference value; and a display device 80 which displays the acceptance determination determined by the comparison determination device 71.SELECTED DRAWING: Figure 1

Description

The present invention provides a technique for quantifying and visualizing the hand-washing state of a subject's hand-washing in order to train and educate how to wash the hand, a hand-washing state determination device for determining pass / fail, and a method for visualizing the hand-washing state. Regarding.

Ensuring food safety and security for workers in restaurants, food processing factories, food-related industries such as fresh food and fruit and vegetable industries, medical-related industries such as hospitals, health centers and pharmaceutical factories, and service-related industries such as convenience stores and supermarkets. That is an important issue.
As a specific trend, the revision of the Food Sanitation Law from June 2020 has made the so-called HACCP hygiene management method obligatory for food business operators. HACCP is required to provide hygiene education to workers in the food business, and it is important to keep a record of the implementation of such education and to confirm the educational effect.

In light of these trends, it should be noted that the Law Concerning the Residence of Foreigners was revised in April 2019 to allow foreign workers to be accepted. Including the foreign technical intern trainees so far, hundreds of thousands of foreigners will work at food-related manufacturing sites. Under these circumstances, many foreign workers come from Southeast Asian countries, and many of these countries have poor sanitary conditions, such as not being able to drink tap water. For this reason, people in these countries have a problem that they are extremely poor in awareness of food hygiene, especially the importance of hand washing. How to wash your hands is an important and extremely basic matter for hygiene management.

Conventionally, various methods have been proposed to establish an appropriate hand-washing method. For example, each facility as mentioned above has prepared a manual for proper hand washing and has been educated based on it. However, it is unclear whether proper hand washing was actually performed, because it is left to the subjectivity of each worker whether or not to carry out according to the manual.

Since the required hygiene management conditions are different between hand-washing in a cafeteria or hospital and hand-washing in a home, the hand-washing action that a person should perform differs depending on the situation in which each individual is placed.
Therefore, Patent Document 1 discloses an invention of a hand-washing monitor that enables a person to be encouraged to perform an appropriate hand-washing operation depending on the situation in which the hand-washing is performed. This hand-washing monitor recognizes the hand-washing motion in the image of the person's hand-washing motion, and whether the recognized hand-washing motion performs the specified hand-washing motion based on the hand-washing information regarding the hand-washing motion to be performed by the person. By determining whether or not it is present, a person is encouraged to perform an appropriate hand-washing operation.

Further, the invention relating to the hygiene guidance device described in Patent Document 2 includes a display unit for explaining the hand-washing order using a plurality of figures, a timer unit for notifying the user of the hand-washing time in each process of the hand-washing order, and the like. It has. The user is configured to wash their hands according to the hand-washing sequence displayed on the display of this hygiene guidance device and the guidance of the hand-washing time in each process of the hand-washing sequence, so that everyone is equally hygienic. It is said that it will be possible to wash hands reliably.

Japanese Unexamined Patent Publication No. 2013-180046 Utility Model Registration No. 3133257

However, the invention described in Patent Document 1 attempts to establish an appropriate hand-washing method by training and educating the hand-washing operation. Cannot be visually recognized. Therefore, it is difficult to motivate users to wash their hands.

Further, the invention described in Patent Document 2 encourages the user to wash his / her hand according to the guide of the hand-washing order and the hand-washing time in each process of the hand-washing order. It is not possible to visually recognize how effective the hand-washing operation is in removing dirt. Therefore, it is difficult to motivate users to wash their hands.

It is certainly necessary to educate and train hand-washing procedures and hand-washing operations, but that is not enough. Since it is the user who actually does the hand washing, it is important for the user to be aware of the importance of hand washing and to have the motivation to wash the hand, which is an important key for establishing an appropriate hand washing method.
Further, even if the user can actually wash his / her hands and visually check whether or not the stains have been removed, the user will make a subjective judgment. At that time, since the judgment differs depending on the physical condition and mood of the user, it is difficult to judge whether or not the dirt is properly removed. For this reason, in the conventional inventions described in Patent Documents 1 and 2, there is a problem in giving the user an motivated motivation to properly wash his / her hands for training / education.

The present invention has been made in view of such circumstances, and is trained and educated so that each person is aware of the importance of hand-washing and motivates them to wash their hands so that they will be motivated to wash their hands. It is an object of the present invention to provide a hand-washing state visualization determination device and a hand-washing state visualization determination method.

The invention according to claim 1 is a hand-washing state visualization determination device in which an opening through which a subject's hand can enter and exit is formed inside the main body of the device.
That is, the lighting device that irradiates the inside of the main body of the device with light that emits a fluorescent substance, and the lighting device that is inserted into the main body of the device after the subject has washed the hands coated with the fluorescent substance. The irradiation area formed to irradiate the light, the first imaging device that captures the fluorescence state of the subject's hand in the irradiation area, and the unwashed state of the subject's hand from the image captured by the first imaging device. The image processing device that digitizes the light, the comparison judgment device that compares the data quantified by the image processing device with the preset pass / fail judgment reference value, and the pass / fail judgment that is judged by the comparison judgment device are displayed. It is characterized by being equipped with a display device.

According to the second aspect of the present invention, the image processing apparatus includes an unwashed area extraction unit that extracts an unwashed area from the image, a hand area extraction unit that extracts a hand area from the image, and the washing of the hand area. The unwashed area ratio calculation unit that calculates the area ratio of the unwashed area and the fluorescence brightness value for each unit area that divides the unwashed area into a large number are calculated, and the average value of these brightness values is calculated as the unwashed amount. The comparison determination device is provided with an unwashed amount calculation unit, and uses both or either of the unwashed area ratio and the unwashed amount as data, and compares the result with the pass / fail determination reference value to make a pass / fail determination. It is a feature.

The invention according to claim 3 is characterized in that the device main body is formed so as to be foldable.

According to the fourth aspect of the present invention, the main body of the device includes a second imaging device that images the face of a subject.
The display device is characterized by including a face recognition display unit that displays the face of the subject imaged by the second imaging device.

The invention according to claim 5 is characterized by comprising a storage device for storing pass / fail determination data determined by the comparison determination device and face data of a subject imaged by the second imaging device.

The invention according to claim 6 is characterized in that the irradiation area includes a hand holding portion for holding the subject's hand so that the distance from the lighting device to the subject's hand is set to a predetermined length. do.

The invention according to claim 7 is a method for determining visualization of a hand-washing state using the visualization-determining device for a hand-washing state according to claim 1.
That is, the process of applying the fluorescent substance and washing the hand after applying the fluorescent substance to the subject's hand, and inserting the subject's hand into the irradiation area inside the main body of the device in the hand-washing state visualization determination device to apply the fluorescent substance. An unwashed image acquisition step of irradiating light to emit light to image the fluorescence state of the subject's hand, an unwashed area extraction step of extracting the unwashed area from the image, and a hand area extraction of extracting the hand area from the image. A step, a step of calculating the area ratio of the unwashed area to the hand area, a step of calculating the unwashed area ratio, and a fluorescence brightness value calculated for each unit area obtained by dividing the unwashed area into a large number, and measuring these. The process of calculating the unwashed amount, which calculates the average value of the brightness values as the unwashed amount, and the unwashed area ratio and / or the unwashed amount are used as data, and this data is used as a preset pass / fail judgment reference value. It is characterized by including a pass / fail judgment step of an unwashed state for making a pass / fail judgment by comparison.

In the invention according to claim 8, in the pass / fail determination step of the unwashed state, a comprehensive evaluation value of the unwashed area ratio and the unwashed amount is calculated, and this comprehensive evaluation value is compared with the pass / fail judgment reference value. It is characterized in that it is provided with a pass / fail judgment.

According to the hand-washing state visualization determination device of the present invention, each subject quantifies the unwashed state after washing the hand coated with the fluorescent substance and determines pass / fail, so that the subject displays it on the screen of the display device. The judgment result can be confirmed. By confirming their own judgment results, the subjects are encouraged to devise a method of hand-washing in order to reduce the amount of unwashed residue. As a result, the subject is aware of the importance of hand-washing and is motivated to wash the hand, so that the subject is trained and educated to enthusiastically learn how to wash the hand. The instructor can easily and effectively provide the subject with hand-washing training and instruction.

Further, in the image processing device, the hand area and the unwashed area can be calculated from the image, and the unwashed area ratio can be calculated as the ratio of the unwashed area to the hand area. Furthermore, the amount of unwashed residue from the image can be quantified by the brightness of fluorescence. Therefore, in the comparison determination device, it is possible to accurately determine the pass / fail by comparing the unwashed area ratio and the unwashed amount as data with the pass / fail judgment reference value.

Further, since the main body of the device is formed so as to be foldable, it can be compactly stored in a storage box such as a trunk and easily transported to various parts of the country and foreign countries. As a result, hand-washing training and guidance can be easily and effectively carried out for the subjects in various places.

In addition to the display content of the pass / fail judgment of the unwashed state, the display device displays the date of measurement, the subject name, and the face photograph of the subject on the face recognition display unit, so that the subject himself is enthusiastic. You can train and educate yourself to learn how to wash your hands.

In addition, since various data are stored in the storage device, it is possible to accumulate an education implementation record of the history of hand-washing training / education, and it is possible to use it for future hand-washing training / education. Furthermore, it is possible to accurately respond to instructions for keeping educational implementation records by HACCP and confirming educational effects.

Further, since the hand holding portion for holding the subject's hand stabilizes the distance from the lighting device to the subject's hand by a predetermined length, a stable image can be acquired and a pass / fail judgment can be made more accurately. Can be done.

According to the method for determining the visualization of the hand-washing state of the present invention, since the method is performed using the above-mentioned visualization determination device for the hand-washing state, the same actions and effects as described above can be obtained. That is, since each subject quantifies the state of unwashed hands after washing the hands coated with the fluorescent substance and makes a pass / fail judgment, the subject can confirm the judgment result displayed on the screen of the display device. By confirming the result of their judgment, the subject is urged to devise a method of hand washing to reduce the amount of unwashed residue. As a result, the subject is aware of the importance of hand-washing and is motivated to wash the hand, so that the subject is trained and educated to enthusiastically learn how to wash the hand. The instructor can easily and effectively provide the subject with hand-washing training and instruction.

In addition, the hand area and the unwashed area can be calculated from the image, and the unwashed area ratio can be calculated as the ratio of the unwashed area to the hand area. Furthermore, the amount of unwashed residue from the image can be quantified by the brightness of fluorescence. Therefore, it is possible to accurately determine the pass / fail by comparing the data with the unwashed area ratio and / or the unwashed amount as the data and comparing with the pass / fail judgment reference value.

It is a perspective view which shows a part of the visualization determination apparatus of the hand-washing state which concerns on this invention. FIG. 1 is a schematic front view of the hand-washing state visualization determination device of FIG. 1, and a block diagram showing a circuit configuration. 3 (a) to 3 (e) are perspective views showing a folded state and an assembled state of the apparatus main body. It is a flowchart which shows the image processing in the visualization determination apparatus of the hand-washing state. 5 (a) to 5 (e) are explanatory views showing steps S1, S2, S4 to S8 of FIG. 6 (a) to 6 (e) are explanatory views showing steps S9, S10, and S11 of FIG. It is explanatory drawing which shows step S12 of FIG. It is a schematic diagram which shows the pass / fail judgment display part and face recognition display part displayed on the screen of a display device. FIG. 9A is a schematic diagram showing a state of unhand-washing and a comprehensive evaluation point, and FIG. 9B is a schematic diagram showing a state of the first hand-washing and a comprehensive evaluation point. FIG. 10 (a) is a schematic diagram showing the state of the second hand washing and the overall evaluation points, and FIG. 10 (b) is a schematic diagram showing the state of the third hand washing and the overall evaluation points. It is the schematic which shows the other Example of the pass / fail judgment display part of a display device.

Hereinafter, the hand-washing state visualization determination device according to the embodiment of the present invention will be described with reference to the drawings.
As shown in FIGS. 1 and 2, the hand-washed state visualization determination device 1 mainly includes a device main body 10, a lighting device 20, an irradiation area 30, a first camera 40 (first image pickup device), and a second camera 50 (a second camera 50 (first image pickup device). A second imaging device), an image processing device 60, a control device 70 including a comparison judgment device 71 and a storage device 72, and a display device 80 having a pass / fail judgment display unit 81 and a face recognition display unit 82.

The apparatus main body 10 has a box shape, and an opening 16 is formed in the lower part of the front surface on the diagonally lower right side in FIG. The opening 16 has a size that allows the subject to put in and take out with both hands open. Further, the apparatus main body 10 has a front side plate 11 formed on the upper portion of the front surface. Further, the apparatus main body 10 is closed by the left side plate 12, the right side plate 13, the rear side plate 14, and the bottom plate 15. A ceiling opening 17 is formed on the upper surface of the apparatus main body 10, and the ceiling opening 17 is covered with a ceiling lid 18.

In the present embodiment, the device main body 10 is configured to be foldable as shown in FIGS. 3A to 3E, and can be stored in a storage box such as a trunk that can be freely carried. For example, the front side plate 11, the left side plate 12, the right side plate 13, the rear side plate 14, and the bottom plate 15 are foldably connected to each other via hinge portions 19, ..., 19, and the left side plate 12 and the right side plate 12 and the right side plate. 13 can be folded so as to face each other at substantially the center in the front-rear direction. The bottom plate 15 is foldably connected via a hinge portion 19 at the lower end edge of the rear side plate 14. The ceiling lid portion 18 has a box shape with an open lower surface.

In FIG. 3A, the ceiling lid portion 18 is in a state where the opening is facing upward. The front side plate 11, the left side plate 12, the right side plate 13, the rear side plate 14, and the bottom plate 15 are housed inside through the opening of the ceiling lid portion 18 in a folded state.

In FIGS. 3 (b) to 3 (d), when the front side plate 11 is pulled up, a state is formed in which the left side plate 12 and the right side plate 13 are unfolded and erected so as to face each other. ..
In the left side plate 12, two divided left side plates 12a and a divided left side plate 12b are foldably connected via a hinge portion 19 at substantially the center in the front-rear direction. On the other hand, in the right side plate 13, two divided right side plates 13a and a divided right side plate 13b are foldably connected via a hinge portion 19 at substantially the center in the front-rear direction.

As shown in FIG. 3D, when the front side plate 11 is further pulled up, the bottom plate 15 is spread out from the opening of the ceiling lid portion 18 through the hinge portion 19 at the lower end edge of the rear side plate 14. Rotate to.

In FIG. 3E, the left side plate 12 and the right side plate 13 are rotated with the bottom plate 15 facing down, and fixed in a state of being placed on the bottom plate 15. The ceiling opening 17 is formed on the upper surfaces of the front side plate 11, the left side plate 12, the right side plate 13, and the rear side plate 14. The ceiling lid portion 18 is covered so as to close the ceiling opening 17 with its opening facing downward, so that the apparatus main body 10 is formed in a box shape as shown in FIG.

As described above, since the device main body 10 is formed to be foldable, the hand-washing state visualization determination device 1 of the present embodiment also includes the device main body 10 and other accessories together, for example, a storage box such as a trunk. It can be stored compactly and easily transported all over the country and abroad. As a result, hand-washing training and guidance can be easily and effectively carried out for the subjects in various places.

The lighting device 20 shown in FIGS. 1 and 2 is for irradiating light that causes a fluorescent substance to emit light, and in the present embodiment, four black lights 22, ..., 22 are used as shown in FIG. I'm using it. Each of the black lights 22, ..., 22 is a UV light that emits ultraviolet rays (wavelength is 395-400 nm).

More specifically, as shown in FIGS. 1 and 2, the lighting device 20 is attached to the lower inside of the rectangular parallelepiped lighting main body 21, and is attached to and detached from the upper side with respect to the ceiling opening 17 of the device main body 10. It is a configuration that can be installed as possible. On the lower surface of the main body 21 for lighting, four black lights 22, ..., 22 are mounted in parallel in the front-rear direction so as to be in the horizontal direction and the longitudinal direction, and the black lights 22, ..., 22 are mounted in parallel. The structure is such that the ultraviolet light of the subject is irradiated to both hands of the subject below. When exposed to the ultraviolet light of the black lights 22, ..., 22, the light blue of the fluorescent substance contained in the lotion pre-applied to both hands of the subject is emitted.

In the irradiation area 30, as shown in FIGS. 1 and 2, a two-handed mounting table 31 is detachably arranged on the bottom plate 15 of the apparatus main body 10, and both hands of the subject are placed on the hand holding portion 32 on the upper surface of the two-handed mounting table 31. This is an area formed for irradiating both hands of the subject with ultraviolet light of black light 22, ..., 22 while spreading the area. Therefore, the height position of the two-hand mounting table 31 is set in advance so that the hand holding portion 32 appropriately holds the distance from the four black lights 22, ..., 22 to both hands at a predetermined length. As a result, a stable image can be acquired, and a pass / fail judgment can be made more accurately. Further, the irradiation area 30 faces the opening 16 on the front surface of the apparatus main body 10 in order to put both hands of the subject in and out.

After applying a lotion containing a fluorescent substance to both hands, the subject considers this lotion to be so-called "dirt" and wash the hands so as to remove the lotion from both hands. After that, both hands are spread out and placed on the hand holding portion 32 on the upper surface of the two-hand resting table 31. When the ultraviolet light of the black lights 22, ..., 22 is applied to both hands of the subject, the fluorescent substance remaining in both hands emits light if there is any unwashed residue.

As shown in FIG. 1, the first camera 40 is a first imaging device that captures a fluorescent state in which fluorescent substances remaining in both hands emit light when both hands of a subject in the irradiation area 30 are irradiated with ultraviolet light. be.
The first camera 40 is detachably arranged at a substantially central position of the ceiling lid portion 18 that covers the ceiling opening 17 of the apparatus main body 10, and the lens portion 41 at the lower end of the first camera 40 is for lighting. The configuration is such that both hands placed on the hand holding portion 32 of the irradiation area 30 can be imaged by being exposed downward from between the two black lights 22 and 22 in the center of the main body 21.

The second camera 50 is a second imaging device that images the face of the subject, and in the present embodiment, as shown in FIG. 1, for example, the second camera 50 is detachably installed on the ceiling lid portion 18 of the device main body 10. .. Moreover, a commercially available camera capable of adjusting the direction of the lens of the second camera 50 so that the face of the subject can be imaged is used, and the present invention is not particularly limited. In some cases, the second camera may be omitted and replaced with another device for identifying the subject, for example, an identification device such as a bar code reader.

The image processing device 60 shown in FIG. 2 is a device that quantifies the unwashed state of both hands of the subject from the image captured by the first camera 40. The image processing device 60 includes an unwashed area extraction unit 61, a hand area extraction unit 62, an unwashed area ratio calculation unit 63, and an unwashed amount calculation unit 64.

Explaining an example of the image processing method, as shown in FIG. 5 (e), the hand area extraction unit 62 calculates the hand area Aa of the total area of both hands from the image. Further, the unwashed area extraction unit 61 calculates the unwashed area Au of both hands as shown in FIG. 5 (c). Next, the unwashed area ratio calculation unit 63 calculates the ratio of the unwashed area Au to the hand area Aa. In the present embodiment, this ratio is referred to as "unwashed area ratio".

Further, the unwashed amount calculation unit 64 quantifies the unwashed amount (remaining amount of the fluorescent substance) from the image of the unwashed area Au of both hands by the brightness (density) of the fluorescence. That is, since the fluorescence brightness (density) increases as the amount of unwashed portion increases, the fluorescence brightness value can be set for each measurement unit area by dividing the unwashed area Au into a large number of measurement unit areas. taking measurement. The average value of these measured luminance values is defined as the "unwashed amount (darkness)" in the unwashed area Au.

As shown in FIG. 2, the comparison judgment device 71 is built in or connected to the control device 70, and is a device that compares the data quantified by the image processing device 60 with a preset pass / fail judgment reference value to make a pass / fail judgment. be.
As described above, the comprehensive evaluation value is calculated from the “unwashed area ratio” and the “unwashed amount (darkness)” quantified by the image processing apparatus 60. In the present embodiment, the importance of the "unwashed area ratio" is increased when comprehensively evaluating the unwashed state. For example, by setting the evaluation value of "unwashed area ratio" to 80% and the evaluation value of "unwashed amount (thickness)" to 20%, the total evaluation value can be expressed as a score of 0 to 100 points. can. The ratio of this importance is not particularly limited.
On the other hand, as the pass / fail judgment reference value, for example, the comprehensive evaluation value can be divided into five stages and used as the judgment reference values for A judgment to E judgment. The setting of this determination reference value is not particularly limited.

In the comparison determination device 71, it is desirable to use both the unwashed area ratio and the unwashed amount as described above, but either one can be used as data.

As shown in FIG. 2, the storage device 72 is built in or connected to the control device 70, and the pass / fail judgment data judged by the comparison judgment device 71 and the subject imaged by the second camera 50 (second imaging device). It is a device that stores the data of the face and other data.

The display device 80 shown in FIG. 2 is a device that displays on a screen such as a monitor, and has a pass / fail judgment display unit 81 that displays the pass / fail judgment determined by the comparison judgment device 71, and a second camera 50 (second imaging). It has a face recognition display unit 82 that displays the face of the subject imaged by the device).
As shown in FIG. 8, the pass / fail judgment display unit 81 includes, for example, the subject name and employee number, the date of measurement, the evaluation points on the palm (front) and the judgment result column, and the evaluation points on the back (back) and the judgment thereof. The result column, the total evaluation points on the front and back of the hand, and the comprehensive judgment column for comprehensively judging the total evaluation points are displayed. The face recognition display unit 82 displays, for example, a photograph of the subject's face.
In the present embodiment, the first and second cameras 40 and 50 are provided, but as described above, the second camera 50 is not provided and the barcode reader is used to identify and associate the subject information. It is also possible to configure using other identification means. Alternatively, it can be a pure pass / fail judgment device that visualizes the state of hand washing without providing such an identification means, and can be configured according to the application.

Next, the method for determining the visualization of the hand-washing state of the present embodiment will be described using the above-mentioned visualization determination device 1 for the hand-washing state.
The method for determining the visualization of the hand-washing state is to train and educate each subject to be aware of the importance of hand-washing and to motivate them to wash their hands. It is not intended to monitor or inspect the actual condition of hand washing.
The lotion containing the fluorescent substance is regarded as so-called "dirt", and after each person removes the lotion of both hands by washing with water, each person can visually confirm how much the so-called "dirt" of the remaining fluorescent substance has been removed. To do so. Moreover, each person does not simply visually judge the pass / fail by personal judgment, but quantifies the unwashed state and gives a pass / fail judgment to a preset judgment reference value. From the pass / fail judgment result, each person learns how to wash their hands by thinking about how to remove "dirt".

[Fluorescent material application and hand washing process]
First, the subject applies a lotion containing a fluorescent substance evenly to both hands. After that, the lotion is regarded as so-called "dirt" and the hands are washed so as to remove the lotion from both hands. At this time, even if there is unwashed residue (adhesion of fluorescent substance), the subject cannot visually recognize it.

[Image acquisition process left unwashed]
Next, as shown in FIG. 1, the subject spreads both hands and places them on the hand holding portion 32 on the upper surface of the two-hand resting table 31 in the irradiation area 30 from the opening 16 of the apparatus main body 10. When the subject's hands are irradiated with the ultraviolet light of the black light 22 (wavelength: 395-400 nm), as shown in FIG. 5 (a), if there is any unwashed residue, the fluorescent substance remaining on both hands is light blue. It emits light.
The fluorescence state of both hands is captured by the first camera 40 to acquire an image (step S1 in FIG. 4). This image is an RGB color system. The RGB color system is a system in which three monochromatic lights of red, green, and blue (RGB) are used as three primary colors. That is, red (R) has a wavelength of 70.0 nm, green (G) has a wavelength of 546.1 nm, and blue (B) has a wavelength of 435.5 nm.

[Unwashed area extraction process]
In the image processing apparatus 60, as shown in FIG. 5A, the RGB color system is converted to the HSV (hue / saturation / brightness) color system (step S2 in FIG. 4). Although the RGB color system is used for images, it is not effective for recognition. On the other hand, the HSV color system, which is closer to the human sense, is suitable for recognition.
Further, in the image processing apparatus 60, as shown in FIG. 5B, the unwashed area Au is extracted by setting a threshold value so as to extract a region near light blue in hue with respect to the acquired image. (Steps S3 and S4 in FIG. 4). As an example, the unwashed area Au became 57933 pixels as shown in FIG. 5 (c) (step S5 in FIG. 4).

[Hand area extraction process]
Further, in order to obtain the ratio of the unwashed area Au in the hand area Aa, a color different from the light blue of the fluorescent substance of the lotion is developed in the irradiation area 30 on the inner surface of the apparatus main body 10 as shown in FIG. 5 (a). The hand area Aa is extracted by using a fluorescent material. In this embodiment, as shown in FIG. 5D, a fluorescent substance that develops a purple color was used. The hand area Aa extracts the area of the hand area Aa by setting a threshold value so as to extract a region other than the vicinity of purple in the hue (steps S3 and S6 in FIG. 4). As an example, the hand area Aa became 87093 pixels as shown in FIG. 5 (e) (step S7 in FIG. 4).
The fluorescent substance that develops a color for extracting the hand area Aa may be any color other than the vicinity of light blue, and may be, for example, red or black that does not return any color at all.

[Calculation process of unwashed area ratio]
For the unwashed area ratio, the ratio of the unwashed area Au to the hand area Aa is calculated. That is, as an example, the unwashed area ratio is calculated by the number of pixels of the unwashed area Au and the number of pixels of the hand area Aa described above as shown in FIG. That is, the unwashed area ratio (%) = (the number of pixels in the unwashed area Au ÷ the number of pixels in the hand area Aa) × 100 = (57933 pixels / 87093 pixels) × 100 = 67 (%) (step S8 in FIG. 4). ).

[Calculation process of unwashed amount (remaining amount of fluorescent substance)]
The unwashed amount (remaining amount of fluorescent substance) in the unwashed area Au is used as a barometer for determining the unwashed amount by quantifying the image of the unwashed area Au of both hands by the brightness (density) of fluorescence.

To explain an example, the hue image of the unwashed area Au of both hands is grayscaled as shown in FIGS. 6 (a) to 6 (b). That is, the grayscaled image is displayed including the light and shade of gray between the white with the strongest light and the black with the weakest light.
The unwashed area Au is divided into measurement unit areas as shown in FIG. 6 (c), and the fluorescence brightness value (0 to 255) is measured for each measurement unit area. The table of FIG. 6 (c) shows the brightness values of a part of the unwashed area Au of FIG. 6 (b) measured for each measurement unit area.

Further, each measured luminance value is normalized by converting from the table of FIG. 6 (c) to the ratio of the fluorescence to the maximum luminance value (255) as shown in the table of FIG. 6 (d). That is, the normalized numerical value is converted by the luminance value (0 to 1), and is referred to as the "normalized luminance value" in the present embodiment.

Therefore, the total unwashed amount of the unwashed area Au can be shown by a histogram of the normalized luminance value as shown in FIG. 6 (e). The average value of the histogram of the normalized luminance value is the "unwashed amount (darkness)" in the unwashed area Au.
In the example of FIG. 6, since the average value of the normalized luminance values is 0.4955, when converted to%, the unwashed amount (darkness) becomes about 50%.

[Pass / fail judgment process of the comprehensive evaluation value of the unwashed state]
The comprehensive evaluation value is calculated from the above-mentioned quantified "remaining area ratio" and "remaining amount (thickness)". For example, both the "residual unwashed area ratio" and the "unwashed amount (thickness)" indicate that the smaller the numerical value, the smaller the unwashed area. As a comprehensive evaluation, 100 points are calculated as the upper limit so that the evaluation points become higher as the amount of unwashed parts decreases.

For example, if (1- "Unwashed area ratio") is the evaluation value of the area ratio and (1- "Unwashed amount (thickness)") is the evaluation value of the amount (thickness), each evaluation value is washed. The smaller the number left, the higher the value. Furthermore, in order to increase the importance of evaluation with respect to the area ratio, a weighting coefficient is added to each evaluation value. For example, the evaluation value of the area ratio is 80%, and the evaluation value of the amount (darkness) is 20%.
Therefore, the comprehensive evaluation is expressed as a comprehensive evaluation point = {(1-" unwashed area ratio") x 0.8 + (1- "unwashed amount (thickness)") x 0.2} x 100.

As an example, in the image of the processing result shown in FIG. 7, when the “unwashed area ratio” is 0.6651 and the unwashed amount (thickness) is 0.4955, the overall evaluation score = {(1-(1-). 0.6651) × 0.8 + (1-0.4955) × 0.2} × 100 = 37 (points).

As the pass / fail judgment reference value, for example, the above-mentioned overall evaluation points are divided into 5 stages, with 81 to 100 points for A judgment, 61 to 80 points for B judgment, 41 to 60 points for C judgment, and 21 to 40 points. Can be used as a D-judgment, and 0 to 20 points can be used as an E-judgment.
Therefore, the determination result for the image of the processing result shown in FIG. 7 is D determination.
Further, for one subject, a comprehensive judgment reference value for comprehensively determining the evaluation points of the palm (front) and the evaluation points of the back (back) can be set to make a comprehensive judgment.

The comprehensive evaluation points determined as described above are displayed on the screen of the display device 80 as shown in FIG. That is, the pass / fail judgment display unit 81 displays the date of measurement, the subject name, the overall evaluation score, and the like, and the face recognition display unit 82 displays the face photograph of the subject.

From the above, when the instructor uses the hand-washing state visualization determination device 1 when training and instructing the subject to wash their hands, the result of each subject washing both hands coated with lotion is displayed on the display device 80. Since it is displayed numerically on the monitor and the pass / fail judgment is made, the subject is urged to devise a method of hand-washing so as to reduce the amount of unwashed residue. As a result, the subject is aware of the importance of hand-washing and is motivated to wash the hand, so that the subject is trained and educated to enthusiastically learn how to wash the hand. The instructor can easily and effectively provide the subject with hand-washing training and instruction.

Further, since various data are stored in the storage device 72, it is possible to accumulate an education implementation record of the history of hand-washing training / education, and it is possible to use it for future hand-washing training / education. Furthermore, it is possible to accurately respond to instructions for keeping educational implementation records by HACCP and confirming educational effects.

As an example, it can be seen that one subject is trained and educated on how to wash his / her hands while confirming the comprehensive evaluations of the first hand-washing, the second hand-washing, and the third hand-washing as shown in FIGS. 9 and 10. ..

Further, the pass / fail judgment display unit 81 displayed on the screen of the display device 80 displays the name of the subject and the processing result images of the palm (front) and the back (back) of the palm as shown in FIG. 11, for example, each image. In FIG. 11, for example, in FIG. 11, some evaluation points out of 100 points are displayed in the upper left of the image. Furthermore, if the overall evaluation score is judged on a 5-point scale of A, B, C, D, and E, the overall evaluation score of the subject should be clearly displayed with letters and illustrations of A, B, C, D, and E. Can be done. Further, as shown in FIG. 11, the above-mentioned face photograph of the face recognition display unit 82 may not be present.
As described above, the display method of the pass / fail determination display unit 81 can be devised in various ways in order to motivate the subject to wash his / her hands.

The present invention relates to food-related facilities such as restaurants and food manufacturing industries, facilities where many people gather such as nursing care facilities, nursery schools and schools, medical-related facilities such as hospitals, health centers, pharmacies and drug factories, and service industries such as convenience stores and supermarkets. It has the potential to be used in a wide range of fields such as.

1 Visualization judgment device for hand-washed state 10 Device body 11 Front side plate 12 Left side plate 13 Right side plate 14 Rear side plate 15 Bottom plate 16 Opening 17 Ceiling opening 18 Ceiling lid 19 Hinge 20 Lighting device 21 Lighting body 22 Black light 30 Irradiation area 31 Both-hand mounting table 32 Hand holding unit 40 First camera (first imaging device) 41 Lens unit 50 Second camera (second imaging device)
60 Image processing device 61 Unwashed area extraction unit 62 Hand area extraction unit 63 Unwashed area ratio calculation unit 64 Unwashed amount calculation unit 70 Control device 71 Comparison judgment device 72 Storage device 80 Display device 81 Pass / fail judgment display unit 82 Face recognition display Part Aa Hand area Au Unwashed area

Claims (8)

It is a hand-washing state visualization judgment device in which an opening is formed inside the main body of the device so that the subject's hands can enter and exit.
A lighting device that irradiates the inside of the device body with light that emits a fluorescent substance.
After the subject has washed the hands coated with the fluorescent substance, the irradiation area formed for irradiating the subject's hand inserted into the main body of the device with the light of the lighting device, and the irradiation area.
A first imaging device that captures the fluorescence state of the subject's hand in the irradiation area,
An image processing device that quantifies the unwashed state of the subject's hand from the image captured by the first imaging device, and
A comparison judgment device that judges pass / fail by comparing the data digitized by the image processing device with a preset pass / fail judgment reference value.
A display device that displays the pass / fail judgment judged by the comparison judgment device, and
A visualization judgment device for the state of hand washing, which is characterized by being equipped with. The image processing device is
An unwashed area extraction unit that extracts the unwashed area from the image,
A hand area extraction unit that extracts the hand area from the image, and a hand area extraction unit.
An unwashed area ratio calculation unit that calculates the area ratio of the unwashed area to the hand area,
An unwashed amount calculation unit that calculates the fluorescence brightness value for each unit area obtained by dividing the unwashed area into a large number and calculates the average value of these brightness values as the unwashed amount.
With
The hand-washing state according to claim 1, wherein the comparison determination device uses data of both or either of the unwashed area ratio and the unwashed amount, and compares the unwashed area ratio with the pass / fail judgment reference value to make a pass / fail judgment. Visualization judgment device. The visualization determination device for a hand-washing state according to claim 1 or 2, wherein the device main body is formed so as to be foldable. The main body of the device includes a second imaging device that images the face of the subject.
The visualization of the hand-washing state according to claim 1, claim 2 or claim 3, wherein the display device includes a face recognition display unit that displays the face of the subject imaged by the second imaging device. Judgment device. Claim 1, claim 2, claim 3 characterized in that it includes a storage device for storing the pass / fail determination data determined by the comparison determination device and the data of the subject's face imaged by the second imaging device. Alternatively, the visualization determination device for the hand-washed state according to claim 4. Claim 1 or claim 2 is characterized in that the irradiation area includes a hand holding portion for holding the subject's hand so that the distance from the lighting device to the subject's hand is set to a predetermined length. The visualization determination device for the hand-washing state described in 1. The process of applying the fluorescent substance and hand-washing, in which the subject's hands are washed after applying the fluorescent substance,
In the hand-washing state visualization determination device, the unwashed image acquisition step of inserting the subject's hand into the irradiation area inside the main body of the device and irradiating the light to emit the fluorescent substance to image the fluorescent state of the subject's hand.
An unwashed area extraction step for extracting an unwashed area from the image, and an unwashed area extraction step.
The hand area extraction process for extracting the hand area from the image and
A step of calculating the unwashed area ratio to calculate the area ratio of the unwashed area to the hand area, and
A step of calculating the unwashed amount, which calculates the fluorescence brightness value for each unit area obtained by dividing the unwashed area into a large number, and calculates the average value of these measured brightness values as the unwashed amount.
The pass / fail determination step of the unwashed state, in which the unwashed area ratio and / or the unwashed amount are used as data, and this data is compared with a preset pass / fail judgment reference value to determine pass / fail.
A method for visualizing and determining a hand-washing state, which comprises. The pass / fail judgment step of the unwashed state includes calculating a comprehensive evaluation value of the unwashed area ratio and the unwashed amount, and comparing this comprehensive evaluation value with the pass / fail judgment reference value to make a pass / fail judgment. The method for visualizing and determining a hand-washed state according to claim 7, wherein the hand-washed state is visualized.

Images