JP2012026857A - Cleaning work support device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To reduce the burden of a worker and to improve the certainty of cleaning work by indicating positions to clean to the worker on the spot in work for cleaning stains on a transparent flat plate of a touch panel, or the like.SOLUTION: The cleaning work support device for clearly indicating defect positions to the cleaning worker by displaying the defect positions due to stains on a screen has: inspection means for detecting a stain state including the positions of stains on the surface of the transparent flat plate; and display means for displaying the stain state on a display device arranged in contact with the back face of the transparent flat plate in parallel with the transparent flat plate.

Description

  The present invention relates to a cleaning work support device.

  Cleaning of glass substrates such as display devices, especially on optical touch panels, may be performed after sensitive parts such as electronic boards are mounted, and humans often perform cleaning work. . However, in the cleaning work, it is difficult for the worker to specify the position of the dirt, and it may be difficult to determine whether or not the cleaning has been sufficiently performed.

  On the other hand, conventionally, as a method of making it easy to understand the state of dirt (dirt position, dirt condition), using a dirt inspection device, the location of the defect detected from the inspection result is given to the cleaning worker by the coordinates of the defect position. In addition, a method of showing a map of defect positions has been proposed.

  In another method, in order to confirm the position of the defect on the analyzer, the vicinity of the defect position is irradiated with spot light, and the defect is inspected again on the analyzer to confirm that it is the same point and perform alignment. A method has been proposed.

JP 2003-75367 A JP 07-325041 A

  However, in the method according to Patent Document 1, it is difficult for the cleaning operator to match the actual position of dirt on the glass. Moreover, in the method by patent document 2, as a means to let a cleaning operator know the dirt position, it will be spot light irradiated to a target object, and the position of the spot light irradiated on transparent glass is the operator. Had the problem of being difficult to recognize. In addition, since the worker decides the amount of cleaning work based on his / her own judgment, there are problems such as excessive and insufficient amount of necessary cleaning work, extra cleaning time, and lack of cleaning. It was.

  Therefore, the present invention provides a cleaning work support device that clearly conveys the defect position as the inspection result of the inspection apparatus to the cleaning operator, instructs an appropriate amount of cleaning work, and facilitates the cleaning work.

  One aspect of the present invention is the inspection means for detecting a dirt state including the position of dirt on the surface of the transparent flat plate, and the display device disposed in parallel with the transparent flat plate in contact with the back surface of the transparent flat plate. The present invention relates to a cleaning work support device characterized by comprising:

  According to the present invention, the cleaning work support device can clearly notify the cleaning operator of the defect position due to the dirt as the inspection result of the inspection device, and facilitates the cleaning work by instructing an appropriate amount of cleaning work. .

It is a figure which shows one basic composition of the cleaning work assistance apparatus which becomes embodiment of this invention. It is a figure explaining the mechanism of the surface dirt inspection in the transparent flat plate which becomes embodiment of this invention. It is a figure which shows the example of a display process of the stain | pollution | contamination state in the transparent flat plate which becomes embodiment of this invention. It is a figure which shows the basic operation | movement flow of the cleaning work assistance apparatus which becomes embodiment of this invention. It is a figure which shows the structural example of the cleaning work assistance apparatus provided with the hand detection camera and pressure sensor which become embodiment of this invention. It is a figure which shows the modification of the display device which displays the dirt state which becomes embodiment of this invention. It is a figure which shows the evaluation method of the amount of cleaning work by the movement detection of the operator's hand which becomes embodiment of this invention. It is a figure which shows the example of a display of the cleaning work condition in the cleaning work assistance apparatus which becomes embodiment of this invention. It is a figure which shows the setting flow of the cleaning work amount database with respect to the test result which becomes embodiment of this invention. It is a figure which shows the display flow of the cleaning operation condition which becomes embodiment of this invention.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 shows a basic configuration of the cleaning work support apparatus of the present invention. The cleaning work support device 1 includes illumination means having a pattern illumination 4 and an illumination control unit 13, inspection means having a camera 5 and an inspection control unit 11, and display means having a display device 3 and a display control unit 12.

  The illumination means irradiates the surface of the transparent flat plate 2 with pattern illumination 4 having a stripe-like bright and dark pattern at a predetermined pitch from an oblique direction.

  The inspection means images the pattern reflected from the transparent flat plate 2 by the camera 5 having the imaging lens 6, inspects the dirt from the acquired image, acquires inspection data including the dirt location and the degree of dirt, and the storage unit The inspection data is stored in Further, the inspection means detects the size and thickness of the dirt and the density of the dirt by measuring the disturbance of the outline of the light and dark stripe pattern and the image contrast in the image captured by the camera 5.

  The display means displays the dirt position and the degree of dirt as instruction data to the operator based on the inspection data acquired on the display device 3 arranged in close contact with the back surface of the transparent flat plate 2 and in parallel with the transparent flat plate 2.

  The inspection control unit 11 processes the imaging timing of the camera 5 and the captured image of the dirt portion, the display control unit 12 controls display of the inspection result on the display device 3, and the illumination control unit 13 The timing of the illumination 4 is controlled. Furthermore, the control apparatus 10 controls each control part by an illumination means, an inspection means, and a display means.

  According to the present invention, based on the image acquired by the camera 5, the dirt position such as the position of dirt on the surface of the transparent flat plate 2, the degree of dirt (size, darkness) and the like are detected and brought into close contact with the back surface of the transparent flat plate 2. The dirt state can be displayed on the display device 3 arranged in parallel with the transparent flat plate 2.

  The inspection control unit 11 that inspects the dirt on the surface side in FIG. 1 uses, for example, a method of using a pattern illumination 4 having a stripe-shaped light and dark pattern with a predetermined pitch (for example, about 0.1 to 1 mm). Only inspect for dirt on the side. As the inspection result, information on the position and state of dirt on the surface side is acquired. Based on the information of the inspection result, the position of the dirt is presented to the operator by the display device 3. By such display, the cleaning operator can confirm on the actual object by viewing the information on the dirt position and the dirt condition (size, darkness) through the transparent flat plate 2 (through the glass).

  Although not shown, the cleaning work support device 1 is a computer having a CPU (Central Processing Unit) and a memory, and a processing program to be executed by each control unit is built in the auxiliary storage device and stored in the memory at the time of startup. This is expanded and executed by the CPU.

  In the embodiment, the display device 3 is assumed to be, for example, an LCD (Liquid Crystal Display). For example, a transmissive screen is disposed immediately below the transparent flat plate 2 and the projector is irradiated from the back side. A configuration may be used (see FIG. 6).

  FIG. 2 shows a mechanism for surface contamination inspection on a transparent flat plate. By using the pattern illumination 4 shown in FIG. 1, the pattern reflected on the surface side of the transparent flat plate 2 is distorted in a pattern with a predetermined pitch in a dirty place and is detected as a disordered pattern by the camera 5. . As shown in FIG. 1, in the inspection optical system, by reducing the angle between the pattern illumination 4 and the camera 5 that detects reflected light, the reflection pattern disturbed by dirt detects only the surface side of the transparent flat plate 2. Become. That is, this method uses the fact that the transparent plate 2 to be inspected is regarded as a mirror, and the illumination pattern detected at the dirt position is disturbed.

  FIG. 3 shows an example of display processing of a dirt state on a transparent flat plate. FIG. 3A shows an example in which the display of the dirty part and the intensity of the instruction color are changed according to the degree of the dirt. For example, in the method of using pattern illumination, the operator can determine the degree of dirt that can be cleaned one place at a time, depending on how the detected pattern is disturbed or the contrast is lowered.

  FIG. 3B shows an example of sequentially displaying dirt at a plurality of locations. By sequentially displaying the stains at a plurality of locations, the operator can perform cleaning at each location according to the display.

  FIG. 4 shows a basic operation flow of the cleaning work support apparatus. First, in step S11, the transparent flat plate 2 (glass) to be inspected is set on a support base (not shown), and the inspection means performs surface contamination inspection with the pattern illumination 4, and the contamination position and contamination condition are detected. Data is acquired, and inspection data is stored in the storage unit of the cleaning work support apparatus.

  Next, in step S12, the display means refers to the inspection data and determines whether there is a dirty portion to be cleaned. If there is no cleaning point, this flow ends.

  When there are a plurality of cleaning locations, one of them is selected, and display data for instructing the cleaning operator is created in step S13. In step S14, the cleaning location is displayed.

  In accordance with the display in step S15, after the cleaning by the cleaning worker is completed, in step S16, a dirt inspection after cleaning is performed.

  Next, in step S17, it is determined whether or not the cleaning is completed. If the cleaning has not been completed, the process returns to step S15, and the subsequent processing is repeated until the selected stain is removed.

  When the cleaning of the selected portion is completed, the process returns to step S12, the next dirty portion is selected, and the subsequent processing is repeated until there is no dirty portion.

  FIG. 5 shows a configuration example of a cleaning work support apparatus including a hand detection camera and a pressure sensor according to the present invention. In the configuration example shown in FIG. 5, in addition to the dirt inspection optical system, a hand detection camera 7 for detecting a hand and a pressure sensor 8 for detecting an operator's pressure during cleaning are arranged on the surface side of the transparent flat plate 2. An example is shown. As the pressure sensor 8, for example, a pressure sensor such as a load cell is disposed between the transparent flat plate 2 and a support base (not shown). If the pressure sensor is arranged not only at the portion in contact with the lower support base of the transparent flat plate 2 but also on the side of the transparent flat plate 2, the force in the direction of rubbing the transparent flat plate 2 can be measured during the cleaning operation. . Further, the amount of cleaning work at the time of the cleaning work by the operator is defined as follows.

  As a function of detecting the work status of the cleaning operator, a hand detection camera 7 is provided on the surface side of the transparent flat plate 2 to detect the operator's hand on the transparent flat plate 2. Thus, the operator checks whether or not there is a hand near the dirt spot being displayed, and if there is a hand near the dirt spot, it is determined that the cleaning work is being performed, and the cleaning work status is determined at a certain time t. The movement (speed: V (t)) of the hand is detected (see FIG. 7).

  In addition, as a function of detecting the force applied during cleaning, a pressure sensor 8 is provided between the transparent flat plate 2 and the indicator plate of the transparent flat plate 2 so that an operator on the transparent flat plate 2 can attach the transparent flat plate 2 for cleaning. The contact pressure is measured as a pressure F (t) at a certain time t.

  The above speed V (t) and pressure F (t) are defined as the cleaning work amount C with respect to the cleaning target dirt, and is defined by the following formula 1 integrated by the time during which the hand stays at one spot of the cleaning target dirt. .

C = ∫ (F (t) × V (t)) dt ---- Equation 1
FIG. 6 shows a modification of the display device for displaying the dirt state in the cleaning support apparatus of the present invention. The projector 9 disposed on the back surface of the transparent flat plate 2 in FIG. 1 is configured so that the dirt position can be displayed on the transmissive screen 3 ′ disposed so as to be in close contact with the transparent flat plate 2.

  FIG. 7 shows a method for evaluating the amount of cleaning work by detecting movement of an operator's hand. For hand detection, as shown in FIG. 7, feature points of the hand, for example, the coordinates of the top, right, and left points of the hand are detected for each frame of imaging, and the coordinates of each point are as follows. The amount of movement in the frame is measured, compared with the previous imaging frame, and the distance of movement of the hand in one frame = speed is calculated as the maximum value of the movement distance of each point.

  Since the interval of one frame by the hand detection camera 7 is different, the speed unit is preferably set to mm / s.

  In the case of hand detection, a gray image is used in the example of FIG. 7, but when hand detection is difficult, such as when cloth (cloth) is used, the hand is detected from a color using a color camera. A detection method may be used.

  FIG. 8 shows a display example of the cleaning work status in the cleaning work support apparatus. As shown in FIG. 8, the display color is thinned according to the amount of cleaning work. The display disappears when it becomes larger than the cleaning work amount set in the cleaning work amount database 100 in advance.

  In this configuration, at the time of disappearance, for example, it may be displayed by characters such as “complete”, or may be notified by sound, a lamp or the like.

  Further, since it is possible to detect that the instructed dirt position is not cleaned, when another part is being cleaned (position detection by the hand detection camera 7 and hand contact detection by the pressure sensor 8), display means May indicate that the location is wrong, for example, by blinking the display color.

  Furthermore, it is preferable to indicate to the operator that the cleaning is performed by reducing the darkness of the display color of the dirt position in accordance with the cleaning work amount C in Expression 1.

  FIG. 9 shows a flow of setting the cleaning work amount database for the inspection result of the present invention. First, in step S <b> 21, during the cleaning operation, the hand moving speed by the operator's hand detection camera 7 is measured and the pressure of the hand at the time of cleaning is detected by the pressure sensor 8. Next, in step S22, the amount of cleaning work is calculated according to Equation 1 based on the acquired hand movement speed and pressure. In step S23, the amount of cleaning work for a plurality of dirt levels is obtained, and the amount of cleaning work applied to the dirt level is associated with the display level (for example, the density of a predetermined instruction color) on the display device 3 as the amount of cleaning work applied. 100 is registered.

  Although the data structure of the cleaning work amount database 100 is not particularly illustrated, the cleaning work amount database 100 has a dirt level, a cleaning work amount, and a display level (such as large, medium, and small densities of predetermined indication colors). It consists of multiple records consisting of items.

  FIG. 10 shows a display flow of the cleaning work status in the cleaning support apparatus of the present invention. First, in step S31, the surface contamination of the transparent flat plate 2 is inspected. In step S32, it is determined as a result of the inspection whether there is a portion to be cleaned. If there is no cleaning point, this flow ends. If there are a plurality of cleaning locations, one of them is selected in step S33, and the display data to be displayed to the operator is created in step S34 with reference to the cleaning work amount database 100. In step S35, the cleaning location is displayed on the display device based on the created display data.

  Next, when cleaning by the operator in step S36 is performed, in step S37, the moving speed and pressure of the hand are detected as the cleaning status, and the amount of cleaning work is calculated. In step S38, the amount of cleaning work is displayed as the cleaning status in the intensity of a predetermined instruction color.

  Next, in step S39, the cleaning work amount is compared with a display set value set in advance in the database. If not, the process returns to step S36, and the subsequent processing is repeated until the cleaning work amount reaches the set value.

  If it exceeds the set value, a stain inspection after cleaning is performed in step S40. In step S41, it is determined whether the cleaning is completed.

  Here, the display disappears when the preset amount of cleaning work is exceeded (for example, as shown in FIG. 8, the display density corresponding to the amount of cleaning work is reduced, and the display is finally lost). The completion of cleaning is presented to the operator by displaying the word “complete”. Thereafter, an inspection for confirmation is performed, and if the result of the inspection is that the dirt is not present, the next cleaning portion is displayed.

  In step S41, if the wiping is incomplete in the soil inspection after cleaning and the cleaning is not completed, the process returns to step S33, and the cleaning operation is repeated until no stain is detected in the inspection after cleaning.

  If the cleaning is completed, the cleaning work amount database 100 is updated, and the process returns to step S32 to select the next dirt location, and thereafter the same processing is repeated.

  By creating a database in which the dirt status obtained in the inspection and the amount of cleaning work performed for the dirt status are associated with each other through the above flow, and updating the database each time the cleaning work is performed, It is possible to improve the accuracy of estimating the amount of cleaning work from the dirt situation.

  The present invention relates to a visualization technique for cleaning dirt on a transparent substrate used for a touch panel or the like.

DESCRIPTION OF SYMBOLS 1 Cleaning work assistance apparatus 2 Transparent flat plate 3 Display device 3 'Transmission type screen 4 Pattern illumination 5 Camera 6 Imaging lens 7 Hand detection camera 8 Pressure sensor 9 Projector 10 Control apparatus 11 Inspection control part 12 Display control part 13 Illumination control part 14 Cleaning work amount calculation unit 100 Cleaning work amount database

Claims (5)

An inspection means for irradiating light on the surface of the transparent flat plate, imaging the reflected light with a camera, and detecting a dirt state including the position of the dirt on the surface of the transparent flat plate;
Display means for displaying the stain status on a display device arranged in parallel with the transparent flat plate in contact with the back surface of the transparent flat plate,
A cleaning work support device characterized by comprising:   The cleaning operation support apparatus according to claim 1, wherein the display unit displays the state of dirt detected by the inspection unit according to the intensity of the instruction color.   3. The display device according to claim 1, wherein the display device includes a transmissive screen and a projection unit onto the screen, and displays the inspection result including the dirt position obtained by the inspection unit on the screen. The cleaning work support apparatus described.   The cleaning work support device further includes a hand detecting means for detecting a hand of an operator who cleans the surface of the transparent flat plate, a pressure sensor for detecting a pressure applied to the transparent flat plate during cleaning work, and the hand Means for integrating the product of the movement speed of the operator's hand detected by the detection means and the pressure detected by the pressure sensor with the stay time of the operator's hand, and calculating the amount of cleaning work; The cleaning work support apparatus according to claim 1, further comprising: a cleaning work amount database that stores the work in association with the contamination status detected by the inspection unit.   The display means refers to the cleaning work amount database, displays the cleaning work amount on the display device at a darkness of a predetermined instruction color during cleaning work, and measures the cleaning work amount measured after cleaning by an operator. The cleaning operation support device according to claim 4, wherein the darkness is reduced according to the frequency.