JPS62203287A - Check device for component mounting board - Google Patents

Abstract

PURPOSE:To check each component accurately in response to the characteristic of each component by applying hierarchy to a processing means for processing board information, changing the processing depth depending on the state of component information and processing the information by the processing section to reduce the decision time at checking. CONSTITUTION:A processing section 12, in the teaching mode, uses a hierarchy processing means to process an image signal image signal of a reference printed board 16-1) supplied from an image pickup section 11 to find out the optimum processing means for components 19-1-19-n in response to the characteristics of th components 19-a-19-n on the reference printed board 16-1 and stores the result in a processing procedure file. Then each optimum processing means stores a parameter (reference parameter) of the components 19-1-19-n obtained by processing the image signal as the reference parameter file. Then the decision time at the check is decreased and accurate check is attained depending on the characteristic of respective components.

Description

DETAILED DESCRIPTION OF THE INVENTION (Industrial Application Field) The present invention processes an image obtained by capturing an image of a board to be inspected on which components are mounted to determine the presence or absence of components on the board to be inspected, positional deviation, etc. The present invention relates to an inspection device for inspecting a component mounting board.

(Prior Art) When an automatic mounting device is used to mount various chip components such as resistors and semiconductor elements on a printed circuit board, the components may not be mounted according to the mount data after mounting.

Therefore, when using such automatic mounting equipment, the printed circuit board is checked after mounting to ensure that the correct chip components are mounted in the correct position and orientation (position and direction) on the printed circuit board. Whether there is
It is also necessary to inspect whether or not it has fallen off.

However, if such an inspection is performed by manual visual inspection as in the past, there are problems in that the occurrence of inspection errors cannot be completely eliminated and the inspection speed cannot be increased.

Therefore, in recent years, manufacturers have proposed various automatic inspection devices for printed circuit boards that can automatically perform this type of inspection.

FIG. 9 is a block diagram showing an example of such an automatic inspection device.

The automatic inspection device shown in this figure includes a TV camera 3 that images a printed circuit board 2-2 to be inspected on which a component 1 is mounted, and data input from a keyboard 8, that is, a reference board as shown in FIG. Data regarding the type, etc. of the reference printed circuit board 2-1, data regarding the type, arrangement position, mounting posture, shape, etc. of each component 1 mounted on this reference printed circuit board 2-1, and inspection of each of these components 1. a storage unit 4 that stores information (data) regarding processing procedures, etc.;
The information stored in this storage unit 4 and the TV camera 3
A determination circuit that compares the information shown by the image with the information shown by the image and determines whether all the components 1 are present on the printed circuit board 2-2 to be inspected and whether or not these components 1 are misaligned or the like. 5, and a display 6 for displaying the determination result of the determination circuit 5.

When using this automatic inspection device, before inspecting the printed circuit board 2-2 to be inspected, first enter data regarding the reference printed circuit board 2-1 on which each component 1 is correctly placed on the bare board 7 from the keyboard 8 ( teaching).

In this case, as shown in the flowchart of FIG. 11, in this teaching operation, the card number of the reference printed circuit board 2-1 is input from the keyboard 8 in step STI.

Next, in step ST2, numerical data regarding the position, shape, etc. of the component 1 mounted on this reference printed circuit board 2-1 and the characteristics of this component 1 (this component 1
(color, brightness, etc.), numerical data regarding processing procedures, etc. are input.

Next, in step ST3, it is checked whether numerical data regarding all parts 1 have been input. If there is a component for which numerical data has not been input yet, the process returns from step ST3 to step ST2 to input numerical data regarding the remaining components. Data entry is performed repeatedly.

When data input for all parts 1 is completed, these numerical data are stored in the storage section 4 as reference data in step ST4.

Furthermore, when inspecting the printed circuit board 2-2 to be inspected,
Numerical data obtained from the image of the printed circuit board 2-2 to be inspected taken by the TV camera 3 and the storage unit 4
The determination circuit 5 compares the numerical data outputted by the determination circuit 5 and the comparison result is displayed on the display 6.

If a certain component of the printed circuit board 2-2 to be inspected, which is imaged by the TV camera 3, is missing, the T
The numerical data obtained based on the image output by the V-camera 3 and the numerical data output by the storage section 4 no longer match, and the determination circuit 5 detects this and displays the missing parts on the display 6. Display above.

(Problem to be solved by the invention) However, in such a conventional automatic inspection device, if the number of numerical data serving as judgment criteria is increased to improve inspection accuracy, it is necessary to The amount of data that must be entered increases,
There is a problem in that inputting this information requires a great deal of time and effort.

In addition, since the same inspection is performed on every component 1 on the printed circuit board 2-2 to be inspected, if you try to increase the inspection accuracy, the number of judgments will increase and a large amount of time will be required for judgment. There was a problem.

In view of the above circumstances, the present invention makes it possible to obtain optimal inspection accuracy according to the characteristics of each part without increasing the number of input data during teaching, and thereby shorten the judgment time during inspection. It is an object of the present invention to provide a component mounting board inspection device that can accurately inspect each component according to its characteristics.

(Means for Solving the Problems) In order to solve the above problems, a component mounting board inspection apparatus according to the present invention processes board information of a board on which components are mounted to inspect the components on the board. In an inspection apparatus for a component-mounted board, the processing means for processing the board information is hierarchical, and the processing depth of this component information is changed depending on the state of the component information in the board information, and the processing means for processing the board information is hierarchically arranged. It is characterized by having a processing section that processes information.

(Embodiment) FIG. 1 is a block diagram showing an embodiment of a component mounting board inspection apparatus according to the present invention.

The component mounting board inspection apparatus shown in this figure images and processes a reference printed circuit board 16-1 to inspect the printed circuit board 16-1, the printed circuit board to be inspected, and each component 19-2 necessary for determining the quality of the printed circuit board 16-2. Reference parameters for each of 1 to 19-n and each part 19-1 necessary to obtain each of these reference parameters
~19-n, and includes an X-Y table unit 10, an imaging unit 11, a processing unit 12, a determination result output unit 26, an information input unit 27, It includes a table controller 29 and an imaging controller 30.

The X-Y table section 10 includes two pulse motors 13 and 14 controlled by a table controller 29, a table 15 driven in the X-axis direction and the Y-axis direction by each of these pulse motors 13 and 14, and this table. The reference printed circuit board 16-1 placed on the table 15 and a chuck mechanism 17 for fixing the printed board to be inspected 16-2 are mounted on the reference printed board 16-1 placed on the table 15. 1 (or the printed circuit board 16-2 to be inspected) is fixed by the chuck mechanism 17, and then
The positions in the axial direction and the Y-axis direction are determined, and the image is captured by the imaging unit 11.

In this case, the reference printed circuit board 16-1 includes a bare board 18, as shown in FIG. It is being

Further, the printed circuit board 16-2 to be inspected is a mass-produced board equipped with the same bare board 18 as the reference printed board 16-1, and on this bare board 18 there is a reference printed board 16-
Components 19-1 to 19-n are arranged in the same manner as components 19-1 to 19-n above.

The imaging unit 11 is arranged above the X-Y table unit 10, and the focus, magnification, sensitivity, etc. of the imaging unit 11 are controlled by control signals output from the imaging controller 30.
A ring illumination device 21 which is arranged coaxially with respect to the camera 20 and the TV camera 20 and whose brightness etc. are controlled by a control signal output from the image pickup controller 30.
and the TV camera 20.
The image and image signal (analog signal) obtained by this are supplied to the processing section 12.

In the teaching mode, the processing section 12 processes the image signal supplied from the imaging section 11 (the image signal of the reference printed circuit board 16-1) using hierarchical processing means (processing hierarchy). The reference printed circuit board 16
Depending on the characteristics of the parts 19-1 to 19-n on -1,
An optimal processing means is found for each of these parts 19-1 to 19-n, and these are stored as a processing procedure file, and each part 19-n obtained by processing the image signal by each of the optimal processing means is Parameters 1 to 19-n (reference parameters) are stored as a reference parameter file.

Further, in the inspection mode, the processing unit 12 processes each component 19-1 to 19-1 indicated by the processing procedure file.
The parameters (parameters to be inspected) of each component 19-1 to 19-n are determined from the image signal (image signal of the printed circuit board 16-2 to be inspected) supplied from the imaging unit 11 based on the optimal processing means for each n. At the same time, each component 19-1 to 19-1 on the printed circuit board 16-2 to be inspected is extracted and compared with each reference parameter of the reference parameter file.
19-n has fallen off, misaligned, etc., and includes an image input section 22, an image processing section 23, a memory 24, a determination section 25, and a control section 28. It is composed of

The image input section 22 performs A/D conversion on the image signal supplied from the imaging section 11, performs various correction processes (for example, shading correction, etc.), and outputs the reference printed circuit board 16-1 to be inspected. This is to create image data (data obtained by correcting and quantizing the image signal) of the printed circuit board 16-2, and the reference printed circuit board 16 obtained here
-1° Image data regarding the printed circuit board 16-2 to be inspected is supplied to the control section 28 and the like.

Further, the image processing section 23 is equipped with a processing procedure in which the first to mth processing means are hierarchically arranged, and in the teaching mode, the image processing section 23 uses the window information supplied from the control section 28 and the processing procedure. By processing the image data of the reference printed circuit board 16-1 supplied via the control section 28 using
The optimum processing means is determined for each of the parts 19-1 to 19-n placed on -1, and these are supplied to the control unit 28 as a processing procedure file, and the obtained products are processed by these optimum processing means. Each of the above-mentioned parts 19-1 to 19
-n parameters (reference parameters) are collected and supplied to the control unit 28 as a reference parameter file.

In this case, as the first processing means, for example, normal binarization processing or the like is used.

Further, as the second processing means, processing that is more complicated and time-consuming than the first processing means, such as processing for removing micropixels or filling in holes, is used.

Similarly, as the third to m-th processing procedures, processing that is sequentially more complicated and takes more time than the second processing means is used.

Further, in the inspection mode, the image processing section 23 inputs image data of the printed circuit board 16-2 to be inspected supplied via the control section 28 based on the window information, the processing procedure file, etc. Each part 19-1 to 19-n is processed by an optimal processing means to extract the parameters (parameters to be inspected) of the parts 19-1 to 19-n on this printed circuit board 16-2 to be inspected. A parameter file to be inspected is created by putting these together, and the control unit 2
8 etc.

The memory 24 also receives image data of the reference printed circuit board 16-1 from the control section 28, and receives image data of the reference printed circuit board 16-1 from the control section 28.
2 image data, parameters (reference parameters) 9 position data of each component 19-1 to 19-n on the reference printed circuit board 16-1.

When shape data, window information, processing procedure files, etc. are supplied, these are stored, and when a transfer request is received from the control section 28, the reference parameters etc. are sent to the image processing section 23 or the judgment section. 25 and the like.

The determination unit 25 compares the reference parameters outputted by the memory 24 in the inspection mode with the parameters to be inspected obtained by the image processing unit 23 supplied via the control unit 28, and determines the parameters to be inspected. This is to determine whether the components 19-1 to 19-n of the inspection printed circuit board 16-2 have fallen off or not, and whether these components 19-1 to 19-n have shifted their posture. The determination result is supplied to the control section 28 and the like.

Further, the control unit 28 receives position data of each of the parts 19-1 to 19-n input from the information input unit 27.

From the shape data, windows 31-1 as shown in FIG.
31-n and store it in the memory 24 as window information.
5 to operate them in a teaching mode or in an inspection mode, and the data obtained in each of these modes is sent to the judgment result output section 2.
6 etc.

The judgment result output section 26 is configured with a CRT (cathode ray tube display), a printer, etc., and is supplied with reference parameters and parameters to be inspected from the control section 28, and outputs information such as the reference printed circuit board 16-1 and the parameters to be inspected. When the image data of the printed circuit board 16-2 or the determination result is supplied, it is displayed or printed out.

The information input unit 27 also includes the type of the reference printed circuit board 16-1 (for example, the board number, etc.) and the types, number, and positions of the components 19-1 to 19-n mounted on the reference printed circuit board 16-1. , equipped with a keyboard and mouse for inputting data related to shape, etc. and operation information when determining processing procedures, etc., and also equipped with a monitor, printer, etc. for checking input data and operation information, etc. The data, operation information, etc. input from here are supplied to the control section 28.

Further, the table controller 29 is configured with an interface etc. for connecting the control section 28 and the X-Y table section 10, and transmits data obtained from the X-Y table section 10 to the control section. 28, and controls the XY table section 10 based on the control signal supplied from the control section 28.

Further, the imaging controller 1-0-30 is configured to include an interface for connecting the control section 28 and the imaging section 11, and performs the control based on the control signal supplied from the control section 28. It also controls the imaging unit 11.

Next, the operation of this embodiment will be explained separately in teaching mode and inspection mode. In the following explanation, in order to simplify the explanation, the first and second processing means will be explained, and the explanation of the third to mth processing means will be omitted.

First, in the teaching mode, step ST5 of the flowchart shown in FIG.
1 board number, and this reference printed board 16-1
Position data and shape data of each of the parts 19-1 to 19-n placed thereon are input.

When each of these data is input, the control section 28 stores the board number etc. in the memory 24 in step ST7, and also stores the board number etc. for each component 19-1 to 19-n based on the position data and shape data. Windows (data cutting windows) 31-1 to 31-n shown in FIG. 3 are created and stored in the memory 24 as window information.

In this case, each window 31-1 to 31-n is circumscribed to the corresponding part 19-1 to one-n, or by 1.5 mm.
After this, X-Y is made to surround the outside of the
A reference printed circuit board 1 is placed on the table 15 of the table section 10.
6-1, the control unit 28 operates the chuck mechanism 17 in step ST8 to fix the reference printed circuit board 16-1, and operates each pulse motor 13 and 14 to secure the reference printed circuit board 16-1. 16-1 X
The axial position and the Y-axis position are determined, and the brightness of the ring illumination device 21 and the imaging conditions of the TV camera 20 are adjusted.

Next, in step ST9, the control unit 2 causes the TV camera 20 to take an image of the reference printed circuit board 16-1, and controls the image input unit 22 to the determination unit 25 to capture the reference printed circuit board obtained by the TV camera 20. 16-1
The image signal is converted into image data by the image input section 22, and this conversion result (reference board image data) is stored in the memory 2.
4 to be memorized.

Next, the control unit 28 reads the memory 2 in step 5T10.
4 and the window information are transferred to the image processing section 23, and the image processing section 23 is caused to execute the parameter extraction routine 42.

In this parameter extraction routine 42, the image processing 23
First, step 5T of the flowchart shown in FIG. 4(B)
In step 5T11, a component image of each component 19-1 to 19-n is cut out from the reference board image data using each window 31-1 to 31-n indicated by the window information, and in step 5T12, the memory (image Processing section 23
Set the part number data N in the internal memory) to N=0.
Make it. Thereafter, the image processing unit 23 causes the determination result output unit 26 to display each of the component images in step 5T13.

In this case, if the component image S1 included in the image signal is sharp as shown in the waveform diagram of FIG. 5, the edge of the component is clearly displayed in the judgment result output unit 24 as shown in FIG. If the component image 51-1 is displayed and the component image S1 included in the image signal has a degraded S/N ratio as shown in the waveform diagram of FIG.
As shown in Figure (A), a component image 51-3 with a lot of noise is displayed.

After that, in step 5T14, the image processing unit 23 displays a message on the determination result output unit 26 to tell the operator:
Ask if there are any parts that need processing.

If the operator inputs information indicating that there are unprocessed parts through the information input unit 27, the image processing unit 23 detects this in step 5T15 and branches from step 5T15 to step 5T16. , where the part number data N is incremented, and
In step 5T17, a message is displayed on the determination result output unit 26 and the operator is asked about the binarization method.

Then, if this operator instructs binarization using a fixed threshold value via the information input unit 27, the image processing unit 23 detects this in step 5T18, and
The process branches to step STI 9, where the parameters are binarized using a predetermined fixed threshold value, and the two
After displaying the value conversion result on the determination result output unit 26, the process proceeds to step 5T22.

Further, if the operator instructs binarization using the mode method via the information input unit 27, the image processing unit 23 branches from step 5T18 to steps 5T20-19 = where each pixel of the component image is The part image is binarized using a threshold value obtained from the valley point value when the histogram is formed, and this binarization result is sent to the judgment result output unit 2.
6, the process advances to step 5T22.

Further, if the operator instructs binarization using the P-tile method via the information input section 27, the image processing section 23 branches from step 5T18 to step 5T21, where the area given in advance or The part image is binarized using a threshold value obtained from the value of the number of pixels, etc.
After displaying the value conversion result on the determination result output unit 26, the process proceeds to step 5T22.

In this case, if the component image s1 included in the image signal is sharp as shown in the waveform diagram of FIG. 5, the determination result output unit 26 displays the component image 51-2 shown in FIG. 6(B). If the component image S1 included in the image signal has a degraded SN ratio as shown in the waveform diagram of FIG. -4
is displayed.

Here, if the operator who has viewed the part image displayed on the determination result output section 26 instructs through the information input section 27 that noise removal is not necessary, the image processing section 23 removes this in step 5T22. Detected, this step 5T22 branches to step 5T26. In other words, in this case, only the first layer process 50 is executed and the second layer process 50 is executed.
Hierarchical processing 51 is skipped.

Further, in step 5T22, the operator determines that noise removal is necessary and instructs via the information input section 27 to fill in the holes of the part image with the largest area among the parts images displayed on the judgment result output section 26. For example, the image processing section 23
The process branches from step 5T22 to step 5T23, and as shown in FIG. 8(C), the maximum area in the component machine indicated by the component image S1 is obtained (maximum component image) S
After extracting l-5, if there is a hole (missing bit, missing block) in this largest part image 51-5, step 5T
In step 24, hole filling processing is performed on this largest part image 51-5, and as shown in FIG. 8(D), this processing result (part image) S
1-6 is displayed on the determination result output unit 26, and the process proceeds to step 5T26.

Further, in step 5T22, the operator determines that noise removal is necessary and instructs the process to remove minute objects in the part image 51-3 displayed on the determination result output unit 26 via the information input unit 27. For example, the image processing unit 23 branches from step 5T22 to step 5T25,
The minute objects in the component machine indicated by the component image 81-3 are removed, and the removal result (component image) is displayed on the determination result output unit 26.

Next, in step 5T26, the image processing section 23 displays a message on the determination result output section 26 and asks the operator whether or not to redo the component processing.

Then, if this operator instructs via the information input unit 27 that it is necessary to reprocess this part, the image processing unit 23 detects this in step 5T27, and proceeds from step 5T27 to step 5T18. Go back and perform the above-described process again on this part.

Furthermore, if the operator instructs through the information input section 27 that there is no need to perform the above-mentioned processing on this part again, the image processing section 23 stores the last obtained image as the reference parameter and , the processing performed on this part is stored as the optimum processing means, and after that, the process branches from the step 5T27 to the step 5T14, and the above-mentioned processing is performed on the remaining parts, and the processing is performed as the optimum processing means for each part. , binarized image (standard parameters)
seek.

Then, if the optimal processing means and standard parameters are obtained for each part 19-1 to 19-n, the image processing unit 2
3, in step 5T28, a processing procedure file in which the optimum processing means for each part 19-1 to 19-n is written is created and stored in the memory 24. In the inspection mode, the control section 28 executes step 5T30 of the flowchart shown in FIG. and the processing procedure file are transferred to the image processing section 23, and the reference parameter file stored in the memory 24 is transferred to the determination section 25.

Next, when the printed circuit board 16-2 to be inspected is placed on the table 15 of the X-Y table section 10, the control section 28 operates the chuck mechanism 17 in step 5T32,
This printed circuit board 16-2 to be inspected is fixed, and then each pulse motor 13, 14 is controlled to determine the position of the printed circuit board 16-2 in the X-axis direction and the Y-axis direction, and the ring illumination device 21 is The brightness, the imaging conditions of the TV camera 20, etc. are adjusted.

Next, in step 5T33, the control unit 28 causes the TV camera 20 to take an image of the printed circuit board to be inspected 16-2, and operates the image input unit 22 to capture the printed circuit board to be inspected obtained by the TV camera 20. Image data (substrate image data to be inspected) is created from the image signal 16-2 and stored in the memory 24.

Next, in step 5T34, the control unit 28 causes the image processing unit 23 to transfer the image data of the board to be inspected to the image processing unit 23, and causes the image processing unit 23 to select each component 19-1 from the image data of the board to be inspected based on the window information. 19-n are cut out, and in step 5T35, each part image is processed by the process indicated in the processing procedure file, that is, by the optimal processing means for each part, and the binary values of each part are obtained. Extract the converted part image (parameters to be inspected).

Next, in step 5T36, the control unit 28 causes an inspection parameter file to be created from these inspection parameters, and transfers this to the determination unit 25, where it is compared with the reference parameters regarding each of the parts 19-1 to 19-n. Then, the component 19-1 of the printed circuit board 16-2 to be inspected
It is determined whether ~1-n has fallen off and whether these parts 19-1 to 19-n have shifted their postures, and in step 5T37, the determination results are supplied to the determination result output unit 26. and display it.

Furthermore, in the embodiment described above, the image processing unit 23 and the determination unit 25 perform image processing and parameter determination processing, but the processing performed by the image processing unit 23 and the determination unit 25 is performed by the control unit. 28 programs may be used.

In addition, in the above-mentioned embodiment, one part is
Although we have two windows, even if it is just one part,
If each part has different characteristics, a plurality of windows may be provided for one part, and parameters may be extracted for each window.

Furthermore, as described above, in the embodiment, the extraction processing of the binarization parameters is hierarchical, and includes a shape recognition process, a position recognition process, and a component presence/absence determination process.

Color processing etc. may be layered.

Furthermore, as mentioned above, in the embodiment, the operator decides whether or not to proceed from the first processing layer to the next processing layer, but it is possible to automate this by using a judgment criterion formula or the like. It's okay.

(Effects of the Invention) As explained above, according to the present invention, it is possible to obtain optimal inspection accuracy according to the characteristics of each part without increasing the number of input data during teaching, and to improve judgment during inspection. In addition to being able to shorten the time,
This can be accurately inspected according to the characteristics of each part.

[Brief explanation of drawings]

FIG. 1 is a circuit block diagram showing an embodiment of a component mounting board inspection device according to the present invention, FIG. 2 is a plan view showing an example of a reference printed circuit board used in this embodiment, and FIG. 3 is a plan view of this embodiment. 4(A) is a flowchart showing an example of the teaching operation of this embodiment, and FIG. 4(B) is a parameter extraction routine used in the teaching operation of this embodiment. FIG. 4(C) is a flowchart showing an example of the inspection operation of this embodiment, FIG. 5 is a schematic diagram showing a waveform diagram of a component image signal in this embodiment, and FIG.
A) and (B) are schematic diagrams for explaining the processing example of the component image signal shown in FIG. 5, FIG. ) to (D) are
Fig. 7 is a schematic diagram for explaining an example of processing a component image signal, Fig. 9 is a block diagram showing an example of this conventional automatic inspection device, and Fig. 10 is an inspection standard for this automatic inspection device. FIG. 11 is a side view showing an example of a reference printed circuit board, and is a flowchart showing an example of the teaching operation of this automatic inspection device. 11... Imaging unit, 12... Processing unit, 16-1...
Reference board (reference printed board), 16-2... Board to be inspected (printed board to be inspected), 18... Base board, 19
-1 to 19-n... parts. Patent Applicant Tateishi Electric Co., Ltd. Agent Patent Attorney Tetsuji Iwakura (and 1 other person) Figure 5 Figure 6 (A)

Claims (1)

[Claims] In a component mounting board inspection device that processes board information of a board on which components are mounted to inspect components on the board,
The processing means for processing the board information is hierarchical, and includes a processing unit that processes information regarding the components on the board by changing the processing depth of the component information according to the state of the component information in the board information. An inspection device for component mounting boards, which is characterized by: