JPH09264856A - Article appearance inspection device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To accurately inspect by storing a rule in advance which decides whether visual inspection should be done or not, and discriminating between an article which is vasually inspected and an article which is decided by automatic inspection, based on the decision rule and according to the result of automatic appearance inspection. SOLUTION: An inspector sets a tape carrier package device (TCP) on a tape feeder 6, and a tape is intermittently fed with a space of a device length under an instruction of a personal computer 6. A CCD camera 1 images each TCP in synchronization, sends it to the computer 5, and differentiates in a set inspection range for finding a maximum brightness value. It is so compared with two threshold values that the sample TCP is automatically classified into three, nondefectives, defectives or non-discriminative. After the decision result of automatic inspection, it is decided whether further visual inspection should be done or not for selection, based on the decision rule stored in the computer 5. Based on the specification, the stored image is displayed on a monitor 3 for visual decision, or the tape is fed fast for visual decision of a substance, and the result is inputted into a computer 5.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an article appearance inspecting apparatus, and more particularly, to the appearance of an electronic device component TCP (Tape Carrier Package, hereinafter referred to as TCP) printed on a tape and other articles automatically. The present invention relates to an article appearance inspection device that inspects, further visually inspects if necessary, and updates the determination result by automatic inspection.

[0002]

2. Description of the Related Art Conventionally, in visual inspection of TCP, a visual inspection apparatus for actually inspecting by an inspector or an image obtained by picking up the external appearance of TCP is subjected to predetermined image processing. Automatic inspection devices that automatically perform inspection have been used. For a visual inspection apparatus that has been widely used conventionally, for example, a technique disclosed in Japanese Patent Laid-Open No. 6-124987 (hereinafter referred to as a first reference document) is known. The technique disclosed in the above-mentioned first cited document relates to a device that can automatically position a TCP image at the center of a CRT to reduce the burden on the worker and perform visual inspection at a high magnification. Common to other visual inspection devices for the purpose of reducing the burden as much as possible. In such a visual inspection device, since the inspector makes a pass / fail judgment of TCP, it is not necessary to prepare a strict inspection standard, and it is possible to deal with an ambiguous expression inspection standard. On the other hand, in the recently developed automatic inspection device, the quality judgment part, which places the greatest burden on the inspector, is also automated, greatly reducing the workload of the inspector. In this automatic inspection device, for example, Japanese Patent Laid-Open No. 5-1524
The technique disclosed in Japanese Patent Publication No. 05 (hereinafter referred to as the second cited document) is known. The technique disclosed in the second cited document realizes a fully automated appearance inspection device by improving the hardware of the illumination system and the camera / lens system for the purpose of inspecting fine leads. Generally, in an automatic inspection device, an image of the appearance of an article is subjected to image processing according to a predetermined standard to make a determination, so that it is necessary to learn only the driving method, which shortens the training period for inspectors. It also has advantages.

[0003]

However, in the visual inspection apparatus, due to the essential nature of human beings, the risk of defective leakage due to careless mistake cannot be eliminated. In addition, there is a possibility that the inspection standards may not be stable due to differences in the inspection standards between individual inspectors or the physical and mental condition of one inspector. In addition, the work load on the inspector is naturally heavy, and a considerable education period is required to learn the inspection standards to some extent. In addition, in the automatic inspection device, although the automatic inspection device was developed as a means to replace the visual inspection device, the “over detection And “oversight” may be judged. Also,
When the inspection standard once set is changed, it is only by adjusting the parameters and testing, and it is difficult to flexibly deal with the ambiguous expression of the inspection standard. SUMMARY OF THE INVENTION In order to solve the above-mentioned problems in the prior art, the present invention provides an article appearance inspection apparatus that improves the article appearance inspection apparatus and can perform accurate inspection by automation while leaving the advantage of visual inspection. The purpose is.

[0004]

In order to achieve the above object, the present invention provides an automatic appearance of an article by subjecting an image obtained by picking up the appearance of the article by an image pickup means to a predetermined image processing according to an inspection standard. In a visual inspection apparatus for visually inspecting visually, a visual inspection means for visually inspecting the appearance of the article, and a visual inspection determination rule storage for storing in advance a determination rule as to whether or not the visual inspection is performed by the visual inspection means Means, and the visual inspection determination rule storing means, based on the determination rule stored in the storage means, according to the result of the automatic inspection of the appearance of the article, the article to be visually inspected using the visual inspection means, and the result of the automatic inspection. It is configured as an article appearance inspecting apparatus, characterized by comprising article selecting means for selecting an article whose appearance is to be determined.

Further, there is provided an article appearance inspection apparatus in which the appearance of the article inspected by the visual inspection means is the actual appearance of the article. Further, the article appearance inspection device includes an image display means for displaying an image of the appearance of the article picked up by the image pickup means, wherein the appearance of the article inspected by the visual inspection means is an image. Furthermore, it is an article appearance inspection device comprising a correction means for correcting the result of the automatic inspection based on the result of the visual inspection by the visual inspection means. Furthermore, the above-mentioned article is an article appearance inspection apparatus which is an electronic device component provided on a tape. Moreover,
It is an article appearance inspection device in which the electronic device component is printed on a tape.

Further, the tape is fast-forwarded based on the selection result of the article appearance inspection device by the article appearance inspection device selection means, and the tape is stopped when the article requiring visual inspection comes to the visual inspection position. It is an article appearance inspection device. Further, the storage device is provided with a storage means for storing an image of the appearance of the article obtained by imaging by the imaging means and an automatic inspection result corresponding to the image, and the article stored in the storage means as necessary. Is an article appearance inspecting device adapted to reproduce the above image on the image display means. Furthermore, in the article appearance inspection apparatus, the image display means is spatially separated from the image pickup means, and both means are connected via a communication means for exchanging information with each other.
Further, whether or not the judgment rule stored in the visual inspection judgment rule storage means conducts a visual inspection according to the result of the automatic inspection of the appearance of the article, and the visual inspection based on the image displayed by the image display means is performed. It is an article appearance inspection device including a rule of whether or not to perform.

[0007]

BEST MODE FOR CARRYING OUT THE INVENTION Embodiments of the present invention for carrying out a visual inspection of an electronic device component TCP printed on a tape will be described below with reference to the accompanying drawings for the understanding of the present invention. It should be noted that the following embodiments are examples of embodying the present invention and are not intended to limit the technical scope of the present invention. 1 is a block diagram showing a schematic configuration of an article appearance inspection apparatus A1 according to an embodiment of the present invention, FIG. 2 is a flow chart showing a processing procedure of image processing in the article appearance inspection apparatus A1, and FIG. It is a chart showing a determination rule in the article appearance inspection device A1.

As shown in FIG. 1, the above-mentioned article appearance inspection apparatus A
1 is a CC as a common object of the imaging means and the visual inspection means
A D camera 1, a white light source illumination 2, a monitor as an image display means 3, a puncher 4 for removing a defective TCP device from a tape, a personal computer 5, and a tape feeder 6, and the personal computer 5 performs image processing. It has a function as means, automatic inspection result storage means, visual inspection determination rule storage means, article selection means, correction means, image storage means, tape position storage means of TCP device. That is, as compared with both the conventional automatic inspection device and the conventional visual inspection device, the novel configuration of this embodiment has a visual inspection determination rule storage means for storing a determination rule of whether or not to perform a visual inspection, and the above visual inspection. According to the judgment rule stored in the judgment rule storage means, an article selection means for selecting a TCP device to be visually inspected is further provided for the TCP device after the automatic inspection is completed. A visual inspection system for articles is realized.

In FIG. 1, when a TCP is set in the tape feeder 6 by an inspector and an automatic inspection start command is sent from the personal computer 5, the tape feeder 6 that received the command is stepwise at device length intervals. The tape is fed in the direction of arrow A. At this time, the CCD camera 1 is synchronized with the tape feeder 6, picks up an image of each TCP device, and sends the image information to the personal computer 5. In the personal computer 5, the image information shown in FIG. 2 is applied to the image information.

In FIG. 2, S51, S52, S53,
S54, S55, S56, and S57 indicate procedure (step) numbers. When an image is input (S51), a preset inspection range (S52) is subjected to differential processing (S53), and the inspection range is determined. The highest brightness value is obtained (S
54). If the maximum brightness value is smaller than the predetermined first threshold value, the TCP as the inspection target is judged to be a good product (S55), and if it is larger than the predetermined second threshold value,
If the TCP is determined to be a defective product (S56) and the maximum brightness value is larger than the first threshold value and smaller than the second threshold value, a result that determination is impossible is output. (S57). Whether or not further visual inspection is to be performed according to the determination rule stored in the personal computer 5 in advance as shown in FIG. The selection is done. For example, as for the “indistinguishable” determination made by image processing in FIG. 3, if a rule of “performing inspector determination by image” or “Yes” is stored, the determination result by image processing is “not determined”. For TCP devices that are
The image is stored in, and the tape position corresponding to the image is stored. In addition, for example, regarding “indistinguishable” in the determination by image processing, a rule that “Yes to inspect the actual inspector” is stored, and “To perform inspector determination by the image” is “No”. If the rule is stored, the image is not stored for the TCP device whose determination result by the image processing is “undeterminable”, and only the tape position is stored. According to the determination rule stored in the personal computer 5 in this way, after the automatic inspection by image processing is completed, if there is an image stored, the image is displayed on the monitor 3 and the inspector looks at the image and visually inspects it. Then, the judgment result is input to the personal computer 5. TC of "perform inspector judgment by real thing"
When there is a P device, after the automatic inspection by image processing is completed, the tape is fed by the tape feeder 6 continuously and at high speed in the direction of arrow B, not stepwise, and when the TCP device comes directly under the CCD camera 1. Stop the tape,
The inspector makes a visual inspection and inputs the judgment result to the personal computer 5. The TCP device determined to be “defective” based on the final determination result is removed from the tape by the puncher 4.

[0011]

EXAMPLE FIG. 4 is a block diagram illustrating an article appearance inspection apparatus in which a plurality of CCD cameras 1 and light source illuminations 2 are used in an article appearance inspection apparatus according to an embodiment of the present invention and applied to an inspection line. . By using multiple CCD cameras 1 and light source illumination 2, the magnification of the CCD camera 1 is changed to the use of a lens according to various defects in the TCP device, and the TCP device can be imaged from the back or in an oblique direction. It is possible to make a spatial device such as capturing an image from the device or to illuminate the device with light of different wavelengths using a colored glass filter, so that defects in the TCP device can be recognized more clearly in an image. Such an article appearance inspection device is also an example of the present invention.

Further, a communication means is added to the personal computer 5 in the article appearance inspection apparatus according to one embodiment of the present invention, and a plurality of article appearance inspection apparatuses are connected via a network via the communication means to obtain the article appearance. Of the functions of the inspection device, a portion for performing inspector determination based on an image, at least the input device of the monitor 3 and the personal computer 5 which are image display means are installed at spatially separated places, and a plurality of article appearance inspection devices are concentrated. FIG. 5 is a block diagram showing a schematic configuration of an article appearance inspection device that can be managed in a physical manner. In this case, since the inspector determination based on the image can be performed at spatially distant places, even one person can simultaneously determine the plurality of article appearance inspection devices by an image inspection specialist inspector. Such an article appearance inspection device is also an example of the present invention.

Further, by adding a database type external storage device capable of managing the automatic inspection result stored in the personal computer 5 shown in FIG. 1 and the image and tape position corresponding to the result, one article appearance inspection device Is used as a device for performing only automatic inspection for a certain period of time, the lot for which automatic inspection is completed is temporarily retained, and for another certain period of time as a device for performing an inspector determination function using images, It is possible to inspect the lots that have been automatically inspected at one time. If one device is operated in a manner in which the functions of the device are separated temporally, the inspector only needs to perform each specialized operation, which shortens the learning period accordingly. Such an article appearance inspection device is also an example of the present invention. Also, according to various defects of TCP devices,
Without performing the differential processing in the image processing of FIG. 2, the original image itself is used as the evaluation value of the maximum brightness value and the minimum brightness value, and compared with the evaluation value to make a three-stage judgment of good / bad / impossible judgment. Labeling processing such as changing to image processing or binarizing with a predetermined threshold value in a preset inspection range and assigning a number to each figure generated by binarization is performed. Calculates the width / height of the
An article appearance inspection apparatus in which image processing is applied to which a graphic shape recognition method is performed to determine that a defect is impossible / undecidable is also an example of the invention.

[0014]

Since the article appearance inspection apparatus according to the present invention is configured as described above, in the automatic inspection, there is a possibility of making an erroneous determination corresponding to "over detection" and "oversight". Screening can be done and further visual inspection can be performed if necessary. As a result, the inspector does not need to inspect all the articles, the burden on the inspector is reduced, and ambiguous inspection standards can be dealt with. Further, if the visual inspection is performed on the actual appearance of the article, the reliability of the inspection is further improved. Further, if a visual inspection is performed using the image display means, it is possible to make a judgment to some extent without visually observing the external appearance of the actual article.
The burden on the inspector is further reduced. Further, since the result of the automatic inspection can be corrected based on the result of the visual inspection, the inspector's judgment is finally reflected in the device judgment. If the article to be inspected is an electronic device component provided on or printed on the tape, fast forward the tape and stop the tape when the article requiring visual inspection reaches the visual inspection position. Therefore, the inspection can be performed quickly. Further, if the image obtained by the image pickup means is stored, the visual inspection by the image can be collectively performed after the automatic inspection is completed, and a temporally flexible inspection environment is provided.

Further, if the image display means is spatially separated and installed, it is possible to intensively visually inspect the articles requiring inspector determination by images in a plurality of the above-mentioned article appearance inspecting apparatuses, and to specialize the inspector. The learning period is shortened accordingly. In addition, if the visual inspection determination rule is stored, it is possible to select whether to perform a visual inspection based on an actual product or whether to perform a visual inspection based on an image according to the inspection situation, and a flexible inspection environment that can deal with various defects. Will be provided.

[Brief description of drawings]

FIG. 1 is a block diagram showing a schematic configuration of an article appearance inspection device A1 according to an embodiment of the present invention.

FIG. 2 is a flowchart showing a processing procedure of image processing in the article appearance inspection device A1.

FIG. 3 is a diagram showing a determination rule in the article appearance inspection device A1.

FIG. 4 is a block diagram for explaining a case where there are a plurality of image pickup means and light sources in the article appearance inspection device A1.

FIG. 5 is a block diagram showing a schematic configuration of an article appearance inspection apparatus when a plurality of apparatuses are centrally managed by a network in the article appearance inspection apparatus A1.

[Explanation of symbols]

 1 ... CCD camera 2 ... White light source 3 ... Monitor 4 ... Puncher 5 ... Personal computer 6 ... Tape feeder A ... Tape feeding direction B ... Tape feeding direction opposite to A S51 ... Image input S52 ... Inspection range setting S53 ... Differentiation Process S54 ... Acquisition of maximum brightness S55 ... Judgment of good product S56 ... Judgment of defective product S57 ... Judgment of impossible judgment

Continued Front Page (72) Masatoshi Fujimoto Inventor Masatoshi Fujiwara, Tokorozawa, Higashidokorozawa, Saitama Prefecture 2-3-3 MMM Building, 3rd floor, Genesis Technology Co., Ltd. (72) Eiji Takahashi, Takatsukadai, Nishi-ku, Kobe 5-5 Kobe Steel Works, Ltd. Kobe Research Institute (72) Inventor Yuichiro Goto 1-5-5 Takatsukadai, Nishi-ku, Kobe-shi, Hyogo Prefecture Kobe Steel Research Institute (72) Inventor Yoshiro Nishimoto 1-5-5 Takatsukadai, Nishi-ku, Kobe-shi, Hyogo Kobe Steel Co., Ltd. Kobe Research Institute (72) Inventor Manki Nakayama 1-5-5 Takatsukadai, Nishi-ku, Kobe-shi, Kobe Kobe Steel, Ltd. In the Kobe Research Institute of Kobe (72) Inventor Sato Yamaguchi 1-5-5 Takatsukadai, Nishi-ku, Kobe-shi, Hyogo Inside the Kobe Research Institute of Kobe Steel, Ltd.

Claims (10)

[Claims] 1. An image obtained by picking up an image of the appearance of an article by an image pickup means is subjected to predetermined image processing according to inspection standards,
In an article appearance inspection device for automatically inspecting the appearance of an article, a visual inspection means for visually inspecting the appearance of the article and a rule for determining whether or not the visual inspection is performed by the visual inspection means are stored in advance. A visual inspection determination rule storage means, and an article for performing a visual inspection using the visual inspection means according to the result of the automatic inspection of the appearance of the article based on the determination rule stored in the visual inspection determination rule storage means; An article appearance inspecting apparatus, comprising: an article selecting unit that selects an article whose appearance is to be determined according to a result of an automatic inspection. 2. The article appearance inspection apparatus according to claim 1, wherein the appearance of the article inspected by the visual inspection means is the actual appearance of the article. 3. The external appearance of the article inspected by the visual inspection means is an image, including image display means for displaying an image of the external appearance of the article imaged by the imaging means.
The article visual inspection device described. 4. The article appearance inspection apparatus according to claim 1, further comprising a correction unit that corrects a result of the automatic inspection based on a result of the visual inspection by the visual inspection unit. 5. The article appearance inspection apparatus according to claim 1, wherein the article is an electronic device component provided on a tape. 6. The article appearance inspection apparatus according to claim 5, wherein the electronic device component is printed on a tape. 7. The tape is fast-forwarded based on the selection result of the article appearance inspection device by the article appearance inspection device selection means, and the tape is stopped when the article requiring visual inspection reaches the visual inspection position. Item 5. The article appearance inspection device according to item 5. 8. A storage unit is provided for storing an image of the appearance of the article obtained by the image pickup by the image pickup unit and an automatic inspection result corresponding to the image, and stored in the storage unit as necessary. The article appearance inspection apparatus according to claim 3, wherein an image of the article is reproduced on the image display means. 9. The article according to claim 8, wherein the image display means is spatially separated from the image pickup means, and both means are connected via a communication means for exchanging information with each other. Appearance inspection device. 10. The visual inspection determination rule storage means determines whether or not the visual inspection is carried out according to the result of the automatic visual inspection of the appearance of the article, and the visual inspection based on the image displayed by the image display means. The article appearance inspection device according to claim 3, which includes a rule as to whether or not to inspect.