JP2018005464A - Cleanness management system of clean room visitor and management system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a cleanness management method of a clean room visitor in which a subject is not required to install any instruments on the body and can simply perform the inspection of cleanness only by performing a predetermined roller application in an inspection room.SOLUTION: A method for managing the cleanness of a visitor to a clean room determines whether or not a subject has appropriately performed the roller application before entering the room by image processing and includes the determination whether the roller application has been appropriately performed by extracting a personal area of the subject and the area of a roller obtained by the subject by a background difference by comparing a captured image including the subject imaged in the inspection room and the background image and by obtaining and analyzing the relative movement of the roller for each body site of the personal area by an optical follow.SELECTED DRAWING: Figure 3

Description

  The present invention relates to a clean room resident cleanliness management method and management system, and more specifically, when an operator enters a clean room installed in a food factory, a pharmaceutical factory, a precision equipment handling factory, etc. The present invention relates to a clean room occupant cleanliness management method and a management system for monitoring whether or not a roller for removing dust adhering to clothes is correctly executed.

  In particular, in recent years, with increasing demands for food safety and quality improvement, awareness of cleanliness at work sites has also increased. Therefore, those engaged in facilities such as food factories, pharmaceutical factories, precision instrument handling factories, etc., should prevent foreign substances and dust such as fibers, hair, animal and plant tissues that may adhere to the body from entering the work room. For this reason, it is supposed that the body must be cleaned before entering the working room. The cleaning process is, for example, performing each process of roller hanging, hand washing, walking on an adhesive mat, and passing an air shower in this order.

  A manual is prepared and an education is provided for the worker to appropriately perform these cleaning processes. However, each worker himself or herself will ultimately determine whether or not the cleaning process has been properly performed based on the manual, etc. Can also happen.

  In consideration of such cases, a hand hygiene enforcement system has been proposed for causing medical staff such as doctors and nurses to perform hand hygiene behavior (Japanese Patent No. 5097965). This system is a motion detection unit that is attached to a subject and detects the movement of the subject's body, and recognizes the subject's behavior based on the detection result of the motion detection unit and creates behavior information Action recognition means, evaluation means for evaluating an execution state including at least one of the number of movements and movement amount of hand hygiene action by the subject based on the action information created by the action recognition means, and the evaluation means It is characterized by comprising advice means for giving advice to the subject in relation to the evaluation result.

  However, in the case of this system, each medical worker is equipped with a motion detection means for detecting body motion, detects the body motion, evaluates the detection result, and performs predetermined hand hygiene behavior. It is costly because it is necessary to prepare a motion detection means for each worker, and there is an inconvenience that each worker must wear the motion detection means each time. Furthermore, there is a problem that it cannot be applied to a person who does not wear the motion detection means.

  Moreover, in the Japanese translations of PCT publication No. 2012-502343, the method and system for monitoring a personal hygiene habit are disclosed, but also in this system, a plurality of personal hygiene events are detected by the system user. For this reason, a problem similar to the above case arises.

Japanese Patent No. 5097965 Special table 2012-502343 gazette

  As described above, in the case of a conventionally proposed hand hygiene enforcement system or personal hygiene habit monitoring system, it is necessary to prepare and attach a motion detection sensor, a personal hygiene monitor, etc. for each user, which is expensive. In addition, there is a problem that the sensors and the like have to be attached and detached each time, and there is a problem that the sensors cannot be applied to non-wearers.

  The present invention has been made to solve the above-described problems in the conventional system, and can be introduced at a low cost with a relatively simple configuration. The inspected person needs to wear any device on the body. It is an object of the present invention to provide a clean room occupant cleanliness management method and management system capable of performing cleanliness inspection simply by applying a predetermined roller in the inspection room.

The invention according to claim 1 for solving the above-described problem is that a subject who is a clean room occupant determines whether or not the roller is properly hung in the examination room before entering the clean room by image processing. A method for managing cleanliness of a resident,
The person area of the subject and the area of the roller held by the subject are extracted by background difference by comparing the acquired image including the subject photographed in the examination room and the background image. And
The relative movement of the roller with respect to each body part of the person area is obtained and analyzed by optical flow, and whether or not the roller is properly applied depending on whether or not the movement of the roller is within a predetermined range. Determining
Is a cleanliness management method for clean room occupants.

  In preferable embodiment, it further includes performing the avatar display which reflected the determination result of the roller hanging.

The invention according to claim 3 for solving the above-described problem is that a subject who is a clean room occupant determines whether or not the roller is properly hung in the examination room by using image processing before entering the clean room. A method for managing cleanliness of a resident,
An initial setting step for setting the position of a monitoring camera for photographing a subject having a roller in the examination room and acquiring an image including the subject;
A subject identification step for identifying a subject from an acquired image by the monitoring camera;
Rolling start step for causing the subject to start rolling,
A person area extracting step of extracting the person area of the subject from a comparison between the acquired image and a background image;
A roller region extraction step for extracting a roller region from the acquired image;
A part extracting step of extracting a body part from the extracted person region;
An optical flow extraction step of extracting the optical flow of the roller for each portion of the extracted person region;
From the extracted optical flow, rubbing determination step for determining the quality of the rubbing state for each body part,
Is a cleanliness management method for clean room occupants.

  In a preferred embodiment, an avatar display step of performing an avatar display reflecting the determination result of the rubbing state is further included.

The invention according to claim 5 for solving the above-mentioned problem is that a subject who is a clean room entrant has determined whether or not a roller is properly hung in the examination room by using image processing before entering the clean room. A system for managing the cleanliness of occupants,
An imaging unit for imaging a subject having a roller in the examination room, and specifying the subject from the person image of the subject imaged by the imaging unit, and analyzing the person image And an analysis device for determining the quality of the rubbing state by the roller for each body part, and a monitor for displaying an analysis result by the analysis device as an avatar,
The analysis device includes an image acquisition unit that captures a person image of the subject photographed by the photographing unit, a subject identification unit that identifies a subject from the person image, and the subject from the person image. A person / roller area extracting means for extracting a person's person area and a roller area of the roller; a body part extracting means for extracting a body part from the extracted person area; and an optical flow of the roller in the person area. Optical flow extraction means for extracting each part, rubbing judgment means for judging whether the roller application is good or bad from the extracted optical flow, and display means for displaying the result of judgment by the rubbing judgment means on the monitor as an avatar This is a cleanliness management system for clean room residents.

  As described above, the cleanliness management method and system for clean room occupants according to the present invention extracts the person area and the roller area of the subject, and acquires the movement of the roller with respect to each body part of the person area by optical flow. It is determined whether or not the roller hanging is properly performed, and whether or not the subject who is a clean room entrant appropriately roller-rolled in the examination room before entering the room. It is possible to determine automatically and appropriately, and therefore, there is an effect that the cleanliness of the clean room occupant can be managed effectively and reliably.

  In addition, the clean room occupant cleanliness management method and system according to the present invention can be introduced at a low cost with a relatively simple configuration, and the subject does not need to wear any equipment on the body. There is an effect that the inspection can be performed only by applying a predetermined roller.

It is a block diagram which shows the structure of the cleanliness management system of the clean room entrant who concerns on this invention. It is a flowchart which shows the rough flow of the cleanliness management method of the clean room entrant who concerns on this invention. It is a flowchart which shows the flow of the flame | frame process of the cleanliness management method of the clean room occupant who concerns on this invention. It is a figure which shows the extraction method of the head area | region, body area | region, and leg area | region in the frame process of the cleanliness management method of the clean room entrant who concerns on this invention. It is a figure which shows the extraction method of the body area | region and arm area | region in the frame process of the cleanliness management method of the clean room occupant who concerns on this invention. It is a figure which shows the length extraction method of the arm in the frame process of the cleanliness management method of the clean room entrant who concerns on this invention. It is a figure which shows the correction method of the determination area | region in the frame process of the cleanliness management method of the clean room occupant who concerns on this invention. It is a figure for demonstrating the conversion method to the avatar in the cleanliness management method of the clean room entrant who concerns on this invention. It is a figure for demonstrating the conversion method to the avatar in the cleanliness management method of the clean room entrant who concerns on this invention. It is a figure which shows the avatar display method in the cleanliness management method of the clean room entrant who concerns on this invention.

  EMBODIMENT OF THE INVENTION Below, the form for implementing this invention is demonstrated in detail, referring an accompanying drawing. The cleanliness management method and system for cleanroom residents according to the present invention is designed to remove dust adhering to work clothes when workers enter cleanrooms installed in food factories, chemical factories, precision instrument handling factories, etc. A method and system for monitoring whether or not the roller application has been performed correctly. The roller hook in the present invention uses a rotating roller wrapped with an adhesive tape, and abuts against the body from the work clothes and rolls to adhere fibers, dust, hair, etc. attached to the body. This is a work to remove, and is performed on the entire body from the head to the toes. This roller hanging is performed in the order of, for example, the head, both arms, the chest, belly, the back, and both legs.

  The cleanliness management method for cleanroom entrants according to the present invention is based on determining whether or not the subject who is a cleanroom entrant has properly applied the roller in the examination room before entering the cleanroom. A method for managing a person's cleanliness, wherein a person's region of a subject and a subject are determined by a background difference by comparing an acquired image including the subject and a background image taken in an examination room. To determine whether or not the roller has been properly applied by extracting the area of the roller that the person holds and acquiring and analyzing the relative movement of the roller with respect to each body part of the human area by optical flow It is characterized by including doing.

More particularly, the method according to the invention is characterized in that it comprises the following steps:
-Initial setting step for setting the position of a surveillance camera for photographing a subject having a roller in the examination room and obtaining an image including the subject-Identifying the subject from the acquired image by the surveillance camera Subject identification step-Rolling start step for starting the subject to apply the roller-Person region extraction step for extracting the subject region of the subject from comparison between the acquired image and the background image-Extracting the roller region from the acquired image Roller region extraction step-Body part extraction step for extracting a body part from the extracted person region-Optical flow extraction step for extracting a roller optical flow for each body part of the extracted person region-Extracted A rubbing judgment step for judging the quality of the rubbing state for each body part from the optical flow.

  FIG. 1 is a block diagram showing a schematic configuration of a system for carrying out a method according to the present invention, and as shown therein, the system is for photographing a subject having a roller in an examination room. The monitoring camera 1 that is an imaging unit and the person image of the patient imaged by the monitoring camera 1 are specified, and the person image is analyzed, and the state of rubbing by a roller for each part of the body is analyzed. It comprises an analysis device 2 for determining pass / fail and a monitor 3 for displaying an analysis result by the analysis device 2 as an avatar.

  Then, the analysis apparatus 2 includes an image acquisition unit 4 that captures a person image of the subject photographed by the monitoring camera 1, a subject identification unit 5 that identifies the subject from the person image, and a subject that is examined from the person image. A person / roller area extracting means 6 for extracting a person's person area and a roller area of the roller, a body part extracting means 7 for extracting a body part from the extracted person area, and an optical flow of the roller in the person area Optical flow extraction means 8 for extracting each part, rubbing judgment means 9 for judging whether or not the roller application is good from the extracted optical flow, and display means 10 for displaying the judgment result by the rubbing judgment means 9 on the monitor 3 as an avatar. Consists of including.

  FIG. 2 is a flowchart showing the overall flow of the clean room occupant cleanliness management method according to the present invention. As shown therein, the processing in this method is roughly divided into the initial setting step of the monitoring camera position. (S1), subject identification step (S2), designated portion roller application start step (S3), frame processing step (S4), and roller application completion step (S5).

Monitoring camera position initial setting step (S1)
The initial setting step (S1) of the monitoring camera position is a step of performing an initial setting for adjusting the position of the monitoring camera 1, which is an imaging unit installed in the examination room, in carrying out the method according to the present invention. In this initial setting, the position of the surveillance camera 1 is adjusted so that, for example, the whole body of a person with a height of 190 cm is captured from diagonally above the front. The surveillance camera 1 is a fixed camera, and the subject is supposed to carry the roller at a fixed position in the room.

Subject identification step (S2)
The subject specifying step (S2) is a step of specifying the subject by the subject specifying means 5 from the frame image captured by the image acquiring means 4. The subject is specified by a method such as reading an IC chip or QR code (registered trademark) owned by each person.

Rolling start step of designated part (S3)
The roller application start step (S3) of the designated part starts the roller application performed by the subject in a predetermined order (for example, the order of the head, both arms, chest, belly, back, and both legs) at a fixed position in the room. It is a step. Typically, when starting this roller application, voice guidance for specifying the body part to be applied to the roller, such as “Please turn forward”, “Scratch your head”, “Scratch your right arm”, etc. The subject will behave accordingly.

  In addition, the roller is prepared in advance in the examination room, and the subject obtains this after entering the room. As the roller, a rotating roller wrapped with an adhesive tape similar to that commercially available for general households is used. In order to facilitate the extraction in a later step, for example, the adhesive tape is yellow or the like. Specific colors (colors different from the color of the work clothes), and in order to enable detection of the degree of rotation, a mark may be attached to the end.

Frame processing step (S4)
In the frame processing step (S4), the roller image captured by the image acquisition means 4 is analyzed, and the rubbing judgment means 9 judges the suitability of the rubbing state for each part of the body, and the judgment result is monitored. In addition to displaying an avatar in 3, a voice guidance about the determination result (for example, content of “the right arm is not rubbed”) is sent. Details of the frame processing step (S4) will be described later.

  The person region is divided into, for example, a head region, a body region (torso), an arm region, and a foot region. In addition, the avatar display of the determination result of the suitability of the rubbing state is performed individually by dividing the avatar area, and is displayed by color coding according to the quality. The avatar area is divided, for example, by dividing the head area into upper and lower parts, and dividing the body area into right and left parts, and dividing them into an upper part, an intermediate part, and a lower part (see FIG. 10).

Roller completion step (S5)
In the frame processing step (S4), when it is determined that all of the avatar areas are appropriate, the roller application is completed, and for example, a sound such as “I wiped it clean. Thank you very much” is played (S5).

  Next, the flow of the frame processing step (S4) will be described with reference to the flowchart of FIG.

Person region extraction step (S11)
In the frame processing step (S4), first, the person / roller area extracting means 6 extracts a person area (step S11). The person area can be obtained from the background difference using the normalized distance.

  That is, a frame image (acquired image) obtained by photographing the room so that the entire body of the subject who has entered the examination room and possesses the predetermined roller is accommodated by the monitoring camera 1 initialized as described above. This frame image is captured in the analysis device 2 via the image acquisition means 4 and stored in advance in the person / roller area extraction means 6 of the analysis device 2. The room is taken before the subject enters the room. A person region including a roller can be extracted by a method of comparing the background image and extracting the luminance value of the N × N local region centered on the target pixel from both images. The work clothes worn by the subject are determined to be white, light pink, light blue, etc. in each factory, etc., so this is stored in advance in the person / roller area extracting means 6 and used as the background difference. Use. The same applies to the color of the roller described later.

Body part extraction step (S12)
After the extraction of the person area, the body part extraction means 7 extracts the body part to be specified for roller application (step S12), and the person / roller area extraction means 6 extracts the roller area. (Step S13). In the specified body part extraction step (step S12), any one of the head region, the body region, the arm region, and the foot region is specified. In specifying each of these areas, first, the horizontal width and vertical width of the person area are extracted, and the head area (large horizontal width) and the foot area (low horizontal width) are specified by using the horizontal width. By using it, an arm region (small vertical width) and a body region (large vertical width) are specified.

  The extraction of the width of the person area is performed by obtaining the width of the person area for each row in the acquired image in which the person area is extracted by the background difference (see FIG. 4). In specifying the head region and the foot region using the horizontal width, first, a reference line for dividing the person region into the upper body and the lower body is set. This reference line includes an A line corresponding to the middle position of the vertical width of the person area, and an intermediate line of B line corresponding to the lowest point of the arm (the width of the body area that has been checked and narrowed). To do. The width of the reference line on the body area is obtained, and in the line above the reference line, the portion of the width of the reference line that is less than two-thirds is specified as the head area, and in the line below the reference line, the reference line is A portion that is less than two-thirds of the horizontal width of the line is identified as a foot region.

  The extraction of the vertical width of the person area is performed by obtaining the vertical width of the person area for each column (see FIG. 5). The identification of the arm region and body region using the vertical width is performed by specifying a portion that is one fifth or less of the maximum value of the vertical width as the arm region and extracting the other portion as the body region. By doing.

  The length is extracted for the arm region specified in this way (see FIG. 6). In extracting the length of the arm region, first, the midpoint of each row of the foot region is obtained, and the average coordinates of the midpoint are obtained. Next, a shoulder point is obtained from half the width of the body region, and the length of the arm region is extracted from the Euclidean distance between the shoulder point and the arm end point. Further, an average value of the vertical width of each column for the arm region is obtained and set as the vertical width of the arm region. Note that the length of the arm region includes the hand portion that protrudes from the work clothes (the portion that does not require roller application), and therefore, in the rubbing determination step (S15) described later, correction for removing the portion is performed. Done.

Roller area extraction step (S13)
In the extraction of the roller area (step S13), the process of extracting the roller area is performed by extracting the area of the maximum area by labeling the area using the RGB information and the HSV color system. In the present case, since the roller is set to yellow, for example, the yellow area of the maximum area is used as the roller area.

Optical flow extraction step (S14)
Next, the rubbing determination means 9 determines whether the rubbing state is good or bad for each part from the movement of the roller area with respect to the specified part of the person area specified as described above (rubbing determination step S15). In doing so, the motion of the roller area is extracted. The movement of the roller area is extracted by extracting the optical flow of the roller and observing a change in the position of the roller. That is, the movement of the roller is analyzed from the change in the luminance value information in the acquired image, and the movement of the roller is acquired from the velocity vector.

Rub determination step (S15)
In the rubbing determination step (S15), an area that is rolled by an optical flow is estimated. In the estimation of the roller area in the case of the arm region, the work wear part that is subject to rubbing determination and the hand part that is not the target are identified, and correction for removing the hand part is performed ( (See FIG. 7). The example shown in FIG. 7 is an example in which one half of the left arm (hand side) is hung with a roller. In this case, first, the optical flow generated from the roller is used to maximize the X and Y coordinates in the moving range of the roller. The value and the minimum value are extracted, and the moving range of the roller is estimated (region a).

  By the way, even if the roller is rubbed and moved in the lower right direction, the generated flow contains not only the lower right but also a lot of noise such as the left direction and the lower direction. In order to narrow down the correct movement direction from the flow including these noises, in the present invention, the direction of the largest flow is extracted as the rubbing determination direction (maximum value is extracted). The intensity of the vector is used for the comparison of the flow sizes. Since the minimum value is deleted by this process, it is not used in the rubbing determination.

  Since the region a includes a hand portion that is not subject to rubbing determination, the region a is corrected to a region b excluding this portion (correction in orientation). In addition, since the area a includes a portion that overlaps the rubbing determination area (area c) in the previous frame, the area a is corrected to the area d excluding this overlapping portion (correction in the previous frame). A region e where the regions b and d overlap is set as a target region for rubbing determination, and the quality of the rubbing state is determined from the movement of the roller in the region.

  In addition, correction for correcting an overlapping portion between the acquired image and the previous frame image (correction for rubbing determination) is performed. In this case, the area near the roller is the end point in the (t-2) → (t-1) frame and the start point in the (t-1) → (t) frame, so the flow is extracted continuously for two frames. Will be. Therefore, even if it is actually rubbed once, it is determined that it has been rubbed twice. Therefore, the flow area generated between (t-2) → (t-1) frames is compared with the flow area generated between (t-1) → (t) frames. The rubbing determination is corrected by adding a process that does not double-count the position of the current flow.

Avatar display step (S15)
The determination result of the rubbing state for each divided area of the avatar obtained as described above is displayed as an avatar for each divided area (avatar display step S15). At the time of displaying the avatar, a process of reflecting the person area on the avatar image is performed. That is, the reflection of the person area in the avatar image is performed by calculating the scale of the person image extracted from the avatar image by the background difference.

Specifically, corresponding point extraction is calculated using an avatar and an image as shown in FIG. In the example shown there, the width of the head of the avatar is 50 px, and the width of the head of the extracted person area is 200 px, and here, an arbitrary point (i, j) is extracted from the avatar. This arbitrary point (i, j) is the distance to the upper end of the avatar and the distance to the lateral end (note that it is the distance obtained from the end of the avatar, not the distance of the entire image). When converting to human coordinates based on the obtained (i, j), the coordinates are converted using the following equation.
Person area (x, y) = arbitrary coordinates of avatar (i, j) × horizontal width of a person area part / horizontal width of avatar part In the above example, (25,25) × 200/50 = (100,100 ) That is, the portion corresponding to (100, 100) in the person region is a point corresponding to the arbitrary coordinates (i, j) of the avatar (see FIG. 9). The same processing is performed on the body and arm using the width of the part.

  This method is characterized in that the length changes depending on the ratio. According to this method, reflection is performed regardless of whether the person is large or small relative to the entire image. Is possible. Then, by associating an arbitrary pixel in the avatar with the coordinate converted into the person area, if a rubbing determination is made for a certain point in the person area, it can be reflected in the corresponding pixel on the avatar side. It becomes possible. The calculation of the reflection point is performed for all the pixels of the body area in the avatar.

The evaluation of rubbing determination is performed for each divided area of the avatar, and the evaluation is performed by calculating the divided area area and the rubbing determination area, and determining the ratio of rubbing determination for each divided area. For example, the ratio of rubbing determination is obtained from the following equation.
Rubbing judgment area in divided area / divided area area × 100 ≧ 80
And avatar display is performed according to a color according to a determination result (refer FIG. 10). For example, when the roller is applied once, it is displayed in blue, when it is twice, light blue, when it is three, green when it is four, and red when it is completed.

  As described above, the clean room resident cleanliness management method and management system according to the present invention extracts the person area and the roller area of the subject, and the relative movement of the roller with respect to each body part of the person area by optical flow. It is essential to determine whether or not the roller hanging has been properly performed by acquiring and analyzing.According to this method and system, the person who is a clean room occupant with a simple configuration is used. The examiner can automatically and easily determine whether or not the roller has been properly hung in the examination room before entering the room, so that the cleanliness of the clean room entry person can be appropriately managed. Therefore, industrial applicability is great.

DESCRIPTION OF SYMBOLS 1 Imaging | photography means 2 Analyzing apparatus 3 Monitor 4 Image acquisition means 5 Subject identification means 6 Person / roller area extraction means 7 Body part extraction means 8 Optical flow extraction means 9 Rub determination means
10 Display means

Claims (5)

It is a method for managing the cleanliness of a clean room occupant by determining whether or not a subject who is a clean room entrant has appropriately performed roller hanging in the examination room before entering the room,
The person area of the subject and the area of the roller held by the subject are extracted by background difference by comparing the acquired image including the subject photographed in the examination room and the background image. And
The movement of the roller with respect to each part of the person area is acquired and analyzed by optical flow, and it is determined whether or not the roller is properly applied depending on whether or not the movement of the roller is within a predetermined range. And
The cleanliness management method of the clean room resident characterized by including this.   Furthermore, the cleanliness management method of the clean room occupant of Claim 1 including performing the avatar display which reflected the determination result of the said roller hanging. It is a method for managing the cleanliness of a clean room occupant by determining whether or not a subject who is a clean room entrant has appropriately performed roller hanging in the examination room before entering the room,
An initial setting step for setting the position of a monitoring camera for photographing a subject having a roller in the examination room and acquiring an image including the subject;
A subject identification step for identifying a subject from an acquired image by the monitoring camera;
Rolling start step for causing the subject to start rolling,
A person area extracting step of extracting the person area of the subject from a comparison between the acquired image and a background image;
A roller region extraction step for extracting a roller region from the acquired image;
A part extracting step of extracting a body part from the extracted person region;
An optical flow extraction step of extracting the optical flow of the roller for each portion of the extracted person region;
From the extracted optical flow, a rubbing determination step for determining the quality of the rubbing state for each part,
The cleanliness management method of the clean room resident characterized by including this.   Furthermore, the cleanliness management method of the clean room occupant of Claim 3 including the avatar display step which performs the avatar display which reflected the determination result of the said rubbing state. It is a system for managing the cleanliness of clean room occupants by determining whether or not a subject who is a clean room entrant has appropriately performed roller hanging in the examination room before entering the room,
An imaging unit for imaging a subject having a roller in the examination room, and specifying the subject from the person image of the subject imaged by the imaging unit, and analyzing the person image And an analysis device for determining the quality of the rubbing state by the roller for each body part, and a monitor for displaying an analysis result by the analysis device as an avatar,
The analysis device includes an image acquisition unit that captures a person image of the subject photographed by the photographing unit, a subject identification unit that identifies a subject from the person image, and the subject from the person image. A person / roller area extracting means for extracting a person's person area and a roller area of the roller; a body part extracting means for extracting a body part from the extracted person area; and an optical flow of the roller in the person area. Optical flow extraction means for extracting each part, rubbing judgment means for judging whether or not the roller application is good from the extracted optical flow, and display means for displaying the judgment result by the rubbing judgment means on the monitor as an avatar A cleanliness management system for cleanroom residents.