JP2003194733A - Visual inspection system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a visual inspection system that can easily perform the inputting work of correcting inspection result data to improve work efficiency even in a state that both the hands of an operator are full. <P>SOLUTION: The inspection result data of an inspection device 2 as a visual inspection means inspecting the appearance of an object to be inspected is displayed on the display 15 of a correction terminal 3 as an information processing means. Then reinspection is performed by the visual observation of the operator based on the inspection result data displayed on this display 15, and the inspection result data is corrected to be inputted with a data correction inputting means when the inspection result data of the inspection device 2 has an error. At that time, the data correction inputting means has a voice recognizing device 20 as a voice recognizing means, and therefore the voice vocalized by the operator is inputted to the terminal 3 via a microphone 21, and the correction inputting work of the inspection result data can be performed without the operation of a keyboard 13. <P>COPYRIGHT: (C)2003,JPO

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an appearance inspection means for inspecting the appearance of an object to be inspected by image processing, a data input / output means for writing and reading inspection result data and the like by the appearance inspection means, and a personal computer. The present invention relates to an appearance inspection support system having an information processing means such as, and more particularly, to an appearance inspection support system for recognizing a voice uttered by an operator by a voice recognition means and correcting inspection result data of the appearance inspection means. .

[0002]

2. Description of the Related Art Conventionally, when inspecting an object to be inspected such as a printed circuit board for the presence or absence of solder on a functional component such as an IC or the presence or absence of a solder bridge, an operator generally performs visual inspection. Was there. However, even if it is a visual inspection by the operator, 100% complete inspection is difficult,
There were some inspection omissions and erroneous judgments. In addition, the visual inspection by the operator requires a large amount of labor and is a factor of increasing the manufacturing cost.

Therefore, a visual inspection support system for automatically inspecting the presence or absence of solder on a functional component such as an IC or the presence or absence of a solder bridge by performing image processing on a captured image of a printed circuit board with a CCD camera or the like. Is being developed. This appearance inspection support system performs a combination of automatic inspection by image processing and visual re-inspection by an operator for a target that is considered to be defective in automatic inspection, thereby preventing inspection omission and erroneous determination, Labor costs can be reduced by improving inspection processing capacity.

[0004]

In the re-inspection, the inspection result data of the image processing stored in the hard disk or the like is read out and displayed on the display of the personal computer, and the operator visually inspects while holding the actual printed circuit board in both hands. , Check the quality of the inspection result data. Then, if the inspection result data of the image processing has an error, the operator uses the input device such as the mouse or the keyboard to perform the correction input operation of the inspection result data.

However, when performing the correction input operation of the inspection result data, the operator often keeps his / her both hands closed.
Alternatively, there is a problem that the work is difficult to perform and the work efficiency is deteriorated because the mouse or the keyboard is operated after the hand is held in one hand.

The above problem is not limited to the case where the object to be inspected is a printed circuit board, but can also occur when the appearance inspection support system is used, for example, when inspecting a silicon wafer for scratches. .

The present invention has been made in view of the above problems, and an object of the present invention is to easily perform correction input operation of inspection result data even when both hands are occupied, thereby improving work efficiency. It is to provide a visual inspection support system that can be improved.

[0008]

In order to achieve the above-mentioned object, the invention of claim 1 takes an image of the appearance of an object to be inspected by an image pickup device and performs image processing to determine whether the object to be inspected is good or bad. A visual inspection means for inspecting, a data input / output means for writing inspection result data of the visual inspection means and reading the written data, and a reading and displaying of the inspection result data written in the data input / output means Display means, data correction input means for correcting and inputting the inspection result data displayed on the display means, and data correction processing means for correcting the inspection result data based on the correction input of the data correction input means. And an information processing means including
Based on the inspection result data displayed on the display means,
The operator visually re-inspects the object to be inspected, and when there is an error in the inspection result data, the operator corrects the inspection result data using the data correction input means,
In the visual inspection support system for the inspection object, which writes the corrected inspection result data to the data input / output means,
The data correction input means includes a voice recognition means for recognizing a voice uttered by the operator and outputting recognition data corresponding to the voice to the data correction processing means.

In this appearance inspection support system, when there is an error in the inspection result data of the object to be inspected by the appearance inspection means, the operator can correct the inspection result data with his own voice. This allows
Compared to the case where correction work was performed by operating an input device such as a mouse or keyboard, it is possible to easily perform correction input work of inspection result data even when both hands are occupied, improving work efficiency. You can

According to a second aspect of the present invention, in the appearance inspection support system according to the first aspect, the voice recognition means is a voice input means for inputting voice, and an input voice signal of the voice input means is converted into a digital signal A. It is characterized by comprising A / D conversion means for D / D conversion and collation means for performing recognition processing by a voice dictionary on the converted digital signal and outputting matching recognition data.

In this appearance inspection support system, the voice uttered by the operator is taken in as an analog input voice signal by voice input means such as a microphone, and the input voice signal is A / D converted into a digital signal. Then, since the matching means performs recognition processing by the voice dictionary on the digital signal and outputs matching recognition data, it is possible to perform high-accuracy voice recognition processing with less erroneous recognition. More specifically, for example, DSP (digital signal processor)
To analyze the voice data and recognize what the operator said. It suffices if well-known recognition processing is performed,
Dynamic programming method (Dynamic programming method, DP method)
Hidden Markov model (Hidden Markov model, HM
A probabilistic method using M) is applicable. In general, for example, window function processing, Fourier transform processing, and the like are performed on the input audio signal to obtain the cepstrum of the audio data (acoustic processing). Next, the matching unit performs pattern matching between the sound-processed signal and a word template (standard data of recognition target words) prepared in advance in the voice data storage unit (voice dictionary). The word with a good matching result is determined to be the spoken word.
Then, the recognition result is sent to the input / output port of the personal computer or the like.

According to a third aspect of the present invention, in the appearance inspection support system according to the second aspect, the data input / output means is configured by using a server and a database, and the server is connected with a plurality of the information processing means. The present invention is characterized in that a plurality of objects to be inspected can be inspected at the same time.

In this appearance inspection support system, the inspection result data of the appearance inspection means is written in the database, and the inspection result data is read out by the plurality of information processing means connected to the server to perform the correction input work. As a result, it is possible to simultaneously inspect a plurality of inspection objects,
The inspection processing capability can be dramatically improved as compared with the case where there is only one information repair means.

According to a fourth aspect of the invention, in the appearance inspection support system according to the first, second or third aspect, the object to be inspected is:
The functional component is a soldered printed circuit board, and the appearance inspection means is a printed circuit board appearance inspection device for inspecting the printed circuit board.

In this appearance inspection support system, the appearance inspection of the printed circuit board is performed by the printed circuit board appearance inspection device.
It is possible to efficiently inspect the presence or absence of solder or the presence or absence of a solder bridge for functional parts such as ICs, and to perform inspection efficiently.

[0016]

BEST MODE FOR CARRYING OUT THE INVENTION An example of an embodiment in which the present invention is applied to a printed circuit board visual inspection support system will be described below.
Description will be given with reference to the drawings.

FIG. 1 is a schematic configuration diagram of a printed board appearance inspection support system according to the present embodiment. This printed circuit board appearance inspection support system includes a bar code automatic reading device 1, an inspection device 2 that inspects a printed circuit board with a CCD camera for image processing and inspects for defective parts such as defective soldering and missing chip parts. A correction terminal 3 for the operator to visually inspect again whether or not the inspection result by the device 2 is correct, and to correct the inspection result data when there is an error in the inspection result.
It consists of and.

In this printed board appearance inspection support system, the bar code information of the printed board read by the automatic bar code reader 1 and the inspection result data of the inspection device 2 are transmitted to the correction terminal 3 through the serial communication cable. , Saved. The stored inspection result data is displayed on the display 15 of the correction terminal 3, and the operator compares the display 15 with an actual printed circuit board,
Check if it was really bad and perform input work.

FIG. 2 is a block diagram of the correction terminal 3. The correction terminal 3 is a personal computer (hereinafter referred to as a personal computer) 10 and an input / output port 1 of the personal computer 10.
It is composed of various input / output devices connected to 0D.

The personal computer 10 includes a CPU (central processing unit) 10A, a ROM (read only memory) 10B,
A RAM (random access memory) 10C and an input / output port 10D are provided, and these are connected to each other by a bus.

As another input / output device connected to the input / output port 10D, a hard disk having a magnetic recording disk for writing inspection result data of a printed circuit board by an inspection device and reading the written inspection result data. A drive (hereinafter referred to as HDD) 11, a flexible disk drive (hereinafter referred to as FDD) 12 for reading and writing programs and inspection result data from a flexible disk (not shown), a keyboard 13 for an operator to input data, a mouse 14 A display 15 for displaying the inspection result of the printed circuit board by the inspection device 2, a bar code reader 16 for reading the bar code information of the printed circuit board, and a voice recognition device 20 are used.

Conventionally, an operator visually inspects an actual printed circuit board, and if the inspection result data of the inspection device 2 displayed on the display 15 has an error, the operator uses an input device such as a keyboard 13 or a mouse 14. , The inspection result data was corrected manually. At this time, the operator
Display 1 while holding the actual printed circuit board in both hands
To make a comparison with the test result data displayed on 5,
Since the inspection result is corrected manually by using the keyboard 13 and the mouse 14, it is necessary to place the printed circuit board on the work table once or hold the printed circuit board with one hand.
The work was difficult and the work efficiency was poor.

Therefore, the correction terminal 3 of the printed circuit board appearance inspection support system according to the present embodiment is configured so that voice input can be performed in addition to manual input using the keyboard 13 and the mouse 14. Therefore, the input / output port 10D is provided with the voice recognition device 20 as an input device. A microphone 21 for collecting a voice emitted by an operator is connected to the voice recognition device 20, the voice of the operator collected by the microphone 21 is recognized, and a recognition result corresponding to the recognized voice is output. To be done.

The operator issues the quality of the inspection result data of the printed circuit board displayed on the display 15 and issues a voice command for continuing the process. Voice commands such as "bad" and "next" are predetermined. The voice is
It is input to the microphone 21 as an input unit and sent to the voice analysis unit 20A as an electrical input voice signal. The voice analysis unit 20A includes an A / D converter and a DSP (not shown).
(Digital signal processor) and analyzes voice data to recognize what the operator said. Known recognition processing may be performed, and a dynamic programming method (dynamic programming method, DP method), a stochastic method using a Hidden Markov model (Hidden Markov Model, HMM), or the like can be applied. In general, for example, window function processing, Fourier transform processing, and the like are performed on the input audio signal to obtain the cepstrum of the audio data (acoustic processing). Next, the matching unit 20B performs pattern matching between the signal after the acoustic processing and the word template (standard data of the recognition target word) prepared in advance in the voice data storage unit 20C. Here, templates such as "bad" and "next" are prepared. The word with a good matching result is determined to be the spoken word. Then, the matching unit 20B sends the recognition result to the input / output port 10D of the personal computer 10.

Next, the correction operation of the inspection result data in the correction terminal 3 of the printed circuit board appearance inspection support system according to this embodiment will be described with reference to the flow chart shown in FIG. The correction terminal 3 is powered on, the program is started by a predetermined operation, and the initial setting is executed in step 100.

When the correction support screen display shown in FIG. 4 is displayed in step 101, the process proceeds to step 102, and it is determined whether or not voice input is made. If no voice input is made, the result in step 102 is negative, and step 103
Etc., and it is determined whether or not input is made by an input device other than voice input such as mouse input or keyboard input. When an input is made by an input device other than the voice input, the affirmative answer is obtained in step 103 or 104, and the next step 1
In 05 or 106, input processing is performed by an input device other than voice input such as mouse input or keyboard input, and the process proceeds to step 111. On the other hand, when no input is made, the result in step 104 is negative, and step 1
Return to 02.

If voice input is made, step 10
If the result is affirmative, the process proceeds to step 107, and the voice recognition device 2
Recognition data corresponding to the voice recognized by the voice recognition device 20 from 0 is output to the personal computer 10. This step 10
Next step 108 is performed based on the voice recognition data in Step 7.
Then, it is determined whether or not the correction processing of the inspection result data of the inspection device 2 is necessary.

Specifically, for a predetermined inspection item, when the inspection result data of the inspection device 2 and the inspection result of the operator match, it is not necessary to correct the inspection result data, so the operator utters "next". To do. The voice command “next” uttered by this operator is used as the voice recognition means 2
0 is recognized and recognition data corresponding to "next" is output.
When the recognition data corresponding to "next" is input to the personal computer 10, step 108 is denied, the process proceeds to step 111, and it is determined whether or not the correction work is completed. . On the other hand, if another inspection item remains, the result of the determination in step 111 is negative, the process proceeds to step 112, and the process proceeds to the next inspection item.
Return to 02.

On the other hand, when the inspection result data of the inspection device 2 and the inspection result of the operator do not match, it is necessary to correct the inspection result data, and the operator utters "defective". The voice recognition device 20 recognizes the voice command "poor" uttered by the operator, and the recognition data corresponding to the "poor" is output. PC 10
When the recognition data corresponding to “defective” is input to, the result in step 108 is affirmative, and the process proceeds to steps 109 and 110. For example, when the operator visually inspects “with solder” in spite of “no solder” in the inspection result data of the inspection device 2, the operator utters “with solder”. The voice recognition device 20 recognizes the voice command “with solder” uttered by the operator, and the recognition data corresponding to “with solder” is output, and the personal computer 10 changes the inspection result data on the display 15 from “without solder”. Correct to "with solder". After the inspection result data correction processing in step 110, the process proceeds to step 111, and it is determined whether or not the correction work is completed.

As described above, in the printed circuit board appearance inspection support system according to the present embodiment, the operator can perform input work in a hands-free manner because the correction terminal can be used for voice input. There was no need to put the board on the workbench or carry it with one hand, and the work efficiency could be greatly improved.

In the above embodiment, the description has been given of the configuration in which the voice can be input at the correction terminal of the printed board appearance inspection support system for performing the appearance inspection of the printed board.
The present invention can be applied not only to printed circuit boards but also to an appearance inspection support system that causes an erroneous determination with a certain probability, such as an appearance inspection of a silicon wafer or a print mask.

[Modification 1] In the printed circuit board appearance inspection support system of the above embodiment, one correction terminal 3 is provided to perform correction input processing of the inspection result data of the printed circuit board. It is also possible to adopt a configuration in which. FIG. 5 is a schematic configuration diagram of a printed circuit board appearance inspection support system according to this modification. This printed circuit board visual inspection support system comprises an automatic bar code reader 1, an inspection device 2, a plurality of correction terminals 3, a server 4, and a database 5 (for example, an Oracle database). Are connected via Ethernet (registered trademark).

In this printed board appearance inspection support system, the inspection result data of the inspection device 2 is written in the database 5 via the server 4, and the inspection result data written in the database 5 by the plurality of correction terminals 3 connected to the server 4. To read and perform correction input work. Thereby, a plurality of inspection objects can be inspected at the same time, so that the inspection processing capability can be dramatically improved as compared with the case where there is only one correction terminal.

[0034]

According to the first to fourth aspects of the invention, the operator can correct the inspection result data with his or her own voice, so that the inspection result data can be easily displayed even when both hands are occupied. There is an excellent effect that the correction input work can be performed and the work efficiency can be improved.

In particular, the invention of claim 2 has an excellent effect that it is possible to perform a highly accurate voice recognition process with less erroneous recognition.

In particular, according to the invention of claim 3, a plurality of inspection objects can be inspected at the same time.
Compared with the case where only one information repairing means is used, a large number of objects to be inspected can be inspected at one time, and the inspection processing capability can be dramatically improved.

In particular, the invention of claim 4 has an excellent effect that the appearance inspection of the printed circuit board can be efficiently performed with respect to the proper amount of solder for each functional component, the presence or absence of a solder bridge, and the like.

[Brief description of drawings]

FIG. 1 is a schematic configuration diagram of a printed circuit board appearance inspection support system according to an embodiment.

FIG. 2 is a block diagram of a correction terminal 3.

FIG. 3 is a flowchart for explaining an operation of correcting inspection result data.

FIG. 4 is an example of a correction support screen displayed on a display.

FIG. 5 is a schematic configuration diagram of a printed board appearance inspection support system according to a modification.

[Explanation of symbols]

1 Bar code automatic reading device 2 inspection equipment 3 correction terminal 4 servers 5 database 10 PC 10D input / output port 13 keyboard 14 mice 20 Speech recognition device 21A Speech analysis section 21B Matching unit 21C audio data storage unit 21 microphone

Claims (4)

[Claims] 1. A visual inspection means for inspecting the quality of an object to be inspected by photographing the appearance of the object to be inspected with an image pickup device, and writing inspection result data of the appearance inspection means. Data input / output means for reading the written data, display means for reading and displaying the inspection result data written in the data input / output means, and correction input for the inspection result data displayed on the display means. The information processing means includes a data correction input means for performing the correction and a data correction processing means for correcting the inspection result data based on the correction input of the data correction input means. Based on the inspection result data, the operator visually re-inspects the object to be inspected, and when there is an error in the inspection result data, the operator uses the data correction input means to detect the error. In the visual inspection support system for an inspection object, which corrects inspection result data and writes the corrected inspection result data to the data input / output means, the data correction input means recognizes a voice uttered by the operator. An appearance inspection support system comprising a voice recognition means for outputting recognition data corresponding to the voice to the data correction processing means. 2. The appearance inspection support system according to claim 1, wherein the voice recognition means A / D converts a voice input means for inputting voice and an input voice signal of the voice input means into a digital signal. An appearance inspection support system comprising: a / D conversion means and a matching means for performing recognition processing by a voice dictionary on the converted digital signal and outputting matching recognition data. 3. The appearance inspection support system according to claim 2, wherein the data input / output means is configured by using a server and a database, and a plurality of the information processing means are connected to the server to provide a plurality of inspection objects. An appearance inspection support system characterized by being configured to be able to inspect objects at the same time. 4. The appearance inspection support system according to claim 1, 2 or 3, wherein the object to be inspected is a printed circuit board to which functional components are soldered, and the appearance inspection means inspects the printed circuit board. A visual inspection support system, which is a printed circuit board visual inspection device.