CN1724999A - Methods of and apparatus for inspecting substrate - Google Patents

Abstract

The invention provides a method to determine the window-setting conditions for the checking of a substrate, a method of checking a substrate, a method of checking the creation of substrate data, and a substrate checking device, capable of roughly determining the window-setting conditions for the checking of a substrate. The substrate checking device photos the model of the substrate with the components installed, and receives the image supply of the same substrate from the solder printing testing machine as the testing machine of the preceding working procedure. After the data of each component is drawn through the calculation of the difference between images and the binary processing of the contrast images, each component is specified through the contrast of the component sizes drawn from the component base recording the standard checking data of each component. The window-setting conditions for the components are determined through the components drawn, and the setting conditions and the specific information are recorded together. In the checking, based on the recorded setting conditions, the component windows are arranged on the component mounting images of the checked objects, and the mounting states of the components are checked through the use of the image data in the window and the standard checking data corresponding to the specific information of the components.

Description

Substrate inspecting method and device

Technical field

The present invention relates to printed circuit board (PCB) (below abbreviate " substrate " as) be object, in the method for determining to check to the installment state of each parts, when the scolding tin welded condition is checked with window that imposes a condition.In addition, the invention still further relates to the method and apparatus that has adopted above-mentioned inspection to carry out the inspection of substrate with the definite method that imposes a condition of window, and the generation method of the inspection data of using in checking.

Background technology

Component-mounted substrate, in general be by implementing successively, the operation (solder printing operation) of printing emulsus scolding tin on printing distributing board, the operation (parts installation procedure) of built-up member on the position that has been coated with emulsus (cream) scolding tin heats the substrate after the parts assemblings and to make parts be welded in that operation (scolding tin welding sequence) on the substrate produces.In addition, after the enforcement of each operation, the inspection that whether has produced defective in the substrate after usually also will implementing to handle about each.

As the inspection machine of the representative that is used for this kind inspection, the appearance inspection device that uses image processing techniques is arranged.In this appearance inspection device, at first the position that the object position is checked in registration during inspection, check impose a condition (position of window and size etc.) with window, be used to extract the 2 value threshold values of checking the object position, the whether suitable judgment standard of judging at the inspection object position that is used to extract etc. (following, be referred to as these data " inspection data ").

Inspection imposes a condition with window, and is different with checking the object position according to the purpose of checking.Such as in, the inspection after the parts installation procedure,, on the position that parts are installed, set and have onesize inspection window with these parts for the disappearance of checking out parts and wrong parts assembling.In addition, in the inspection after the scolding tin welding sequence,, set the inspection window of pad unit in order to check the shape of the scolding tin fillet (fillet) that on each pad, forms.

As definite inspection in past method that imposes a condition with window, can enumerate the image of display model substrate, accept regional assigned operation (with devices such as mouses) to this display frame, with the position in the zone of appointment and size as the method that imposes a condition.

In addition, utilize the method for the cad data of substrate in addition.Such as, under the definite situation about imposing a condition of parts inspection with window, can utilize frame information (information of expression parts profile) automatic additional examination window on cad data of the parts of in cad data, registering, with this position of window and big or small as imposing a condition.

And, there is the standard of every kind of parts to check the substrate design data of the part library of data and cad data etc. by combination registration, comprise that then except the imposing a condition of inspection other check that data also can generate (with reference to patent documentation 1) automatically.

Patent documentation 1:JP speciallys permit No. 2570239 communiques.

In determine the method that inspection imposes a condition with window according to user's assigned operation, exist workload huge, the problem of elapsed time and troublesome poeration.In addition, for utilizing cad data to determine the method that the parts inspection imposes a condition with window, because the component framework information that exists in the cad data may not correctly be represented the situation of component sizes, so, to additional window manual modification in addition, so still be difficult to alleviate user's setting work.

In addition, the method described in the patent documentation 1 is that the standard of the installation site of each parts in the cad data of substrate and part library is checked that data carry out corresponding method, the problem of its existence be between the two should correspondence crucial inconsistent.Cad data, in each parts kind, form, at the mounted component that can specifically define, in part library as other data, the part classification that function is identical with shape is the unit registration data with the mutation in the group that is called as " mutation (variation) ".Thus, in the definition mutation corresponding with cad data, need as the form with two kinds of data correspondences of patent documentation 1, it is complicated to have produced processing thus, problem that can't high efficiency generation inspection data.

Summary of the invention

The present invention is conceived to above-mentioned problem and the invention that proposes, and its 1st purpose is to utilize makes a video recording and the image that generates to the substrate of reality, can simply determine to check imposing a condition with window.

In addition, the 2nd purpose of the present invention is for the parts inspection with the generation of checking data, and the simpler more efficient methods of method of the prior art that cad data and part library was made up than the past is provided.

(1) the definite method that imposes a condition with window about inspecting substrate

Definite method that the window of using as inspecting substrate imposes a condition, the 1st kind of method provided by the invention, in order to check in the production or to produce and finish substrate afterwards, to being set in the method that aforesaid substrate is made a video recording and adopted when inspection on the gained image is determined with imposing a condition of window, its each step by the following the 1st, the 2nd, the 3rd is implemented.

In the 1st step, after the predetermined operation in a plurality of operations of having implemented to implement, the substrate as the objective for implementation of this operation is made a video recording for the production of component-mounted substrate, obtain the image of generation.In the 2nd step, with in above-mentioned the 1st step as the substrate of shooting object, after the next operation of having implemented above-mentioned predetermined operation, make a video recording once more, obtain the image of generation.

In the 3rd step, extract the difference between 2 width of cloth images that obtain in the 1st step and the 2nd step, utilize this extraction result to be identified for imposing a condition of window that predetermined position is checked.And imposing a condition of window can think to represent the information of position of window and size.

As mentioned above, " a plurality of operations of implementing for the production of component-mounted substrate ", such as the solder printing operation, parts installation procedure, scolding tin welding sequence.Under this situation, respectively in the 1st step to the substrate after the solder printing, the substrate after in the 2nd step parts being installed is made a video recording.Perhaps, in the 1st step, parts are installed substrate afterwards and make a video recording, and the substrate after the butt welding soldering connects in the 2nd step is made a video recording.

In the 3rd step, between 2 width of cloth images, produce difference image by obtaining corresponding pixel gray scale difference each other, further this difference image is carried out 2 values or edge extracting etc. and handle, so can extract the difference between the image.Here the difference of obtaining can think and finish structure on the substrate additional to the operation of being implemented between the 2nd step is implemented from the 1st step that perhaps the variation that produces on the substrate in this operation is relevant.

Below, propose 3 kinds of schemes of said method, and be described in detail.

(1)-1 the 1st scheme

In this scheme, in the 1st step, the substrate after the solder printing is made a video recording, in the 2nd step, parts are installed this substrate afterwards and make a video recording.Under this situation, the difference that in the 3rd step, extracts can think with the parts installation procedure in the structure of on substrate, adding, promptly relevant with parts.So, in the 3rd step,, determine parts inspection imposing a condition with window based on the position and the size that extract the zone of difference between above-mentioned 2 width of cloth images.

According to such scheme, such as, the solder printing state carries out the 2nd shooting having confirmed installation good on this substrate under the situation of parts after suitable substrate having been carried out shooting, can utilize 2 width of cloth images of generation to determine the imposing a condition of window of parts inspection usefulness.If imposing a condition of determining registers in the storer, in congener substrate, just can use imposing a condition of above-mentioned registration to check later on here.

Like this,, need not to use cad data, can alleviate user's burden significantly so be used for the operation of regional appointment owing to can from the image of the substrate of reality, extract the imposing a condition of window of parts inspection usefulness automatically.

In addition, the window of parts inspection usefulness preferably includes such zones such as boundary rectangle in the zone that above-mentioned difference is extracted, and, preferably be suitable for the size of checking.In addition, in extracting the zone of difference, under the also little situation of the size of the minimum parts of its size ratio, it is preferred being counted as noise and not carrying out window setting processing.These aspects also are same in following additive method.

In addition, in the 2nd step, under the situation about departing from the installation site of the substrate upper-part that uses, check and also depart from, become the state that can't high-precision definite window imposes a condition with position of window.Under these circumstances, in the 3rd step, preferably adopt the step that extracts the printing zone of emulsus scolding tin the image of the substrate behind above-mentioned solder printing, and based on respect to the position in above-mentioned emulsus solder printing zone relation, the step that the position of window of above-mentioned parts inspection usefulness is proofreaied and correct.As like this, install even departed from parts under the situation of position, check to be set under the situation of unsuitable position with window, also the desired location of window can be corrected to the position that these parts should be installed.

(1)-2 the 2nd scheme

In this programme, in the 1st step, parts to be installed substrate afterwards and make a video recording, this substrate after the butt welding soldering connects in the 2nd step is made a video recording.Under this situation, the difference that extracts in the 3rd step can think, the emulsus scolding tin fusion on the pad and the variation that causes.So, in the 3rd step, based on the position and the size that extract the zone of difference between above-mentioned 2 width of cloth images, determine imposing a condition of window that the scolding tin welding inspection is used.

And, the regional external rectangle that is preferably and extracts with window of the inspection under this situation, perhaps be set at than bigger a little the shape of this rectangle.

In the 2nd scheme, also can from 2 width of cloth images that generate, extract scolding tin welding inspection imposing a condition automatically after parts are installed and after the scolding tin welding by specific substrate is made a video recording with window.The window that the scolding tin welding inspection is used, owing to need on each pad, set, so, be considered to thinner than the window of parts inspection usefulness, and more.So, by extracting imposing a condition of this window automatically, can alleviate user's burden significantly.

And, though exist the print range of scolding tin to depart from from pad, and form the state that overflows from pad, but under these circumstances, when carrying out scolding tin welding, the capillary effect of the scolding tin by fusion can the scolding tin that pad is outer be drawn and be got back in the pad.But under these circumstances, the zone broadening that said extracted goes out difference has arrived pad part in addition, and the zone that extracts from pad position deviation has taken place, and may become also bigger than pad.

In order to tackle the problems referred to above, in the 3rd step, preferred enforcement: extract the step in the zone of exposing substrate quality color and the step of proofreading and correct the image of the substrate after the scolding tin welding based on the window that the extraction result of aforesaid substrate quality color region uses above-mentioned scolding tin welding inspection.

Here, " zone of exposing substrate quality color " can think the surface corresponding to the substrate that does not have parts or pad self.The image that this zone can utilize the substrate of butt welding soldering after connecing carries out 2 values with pre-set threshold to be waited and extracts.In the treatment for correcting of window, can expand the width of window, remove in the window and the overlapping part of substrate quality color region, perhaps make the border of window near the border of substrate quality color region.By such treatment for correcting, even in the printing zone of scolding tin, exist under the situation of defective, also can in the scope corresponding, set inspection and use window with pad, can high-precision definite inspection imposing a condition with window.

(1)-3 the 3rd scheme

Similar in the scheme with the 1st scheme, in the 1st step, the substrate after the solder printing is made a video recording, in the 2nd step, parts are installed this substrate afterwards and make a video recording.On the other hand, in the 3rd step, be benchmark with the predetermined unique point that comprises in the difference that in above-mentioned 2 width of cloth images, extracts, determine imposing a condition of window that the scolding tin welding inspection is used.

For example, when the IC with a plurality of electrode part (lead (lead)) is carried out the scolding tin welding inspection, in the scope included, must set the inspection window corresponding to the pad of each lead.Even under these circumstances, when the image of the substrate after adopting solder printing and parts are installed the image of substrate afterwards, extract after the image of parts integral body, the unique point at edge by extracting each lead leading section from this image etc. can be set the inspection window of each pad.

As mentioned above, definite inspecting substrate according to the present invention is with the first method that imposes a condition of window, by specific substrate is carried out 2 shootings respectively after predetermined operation is implemented and after its subsequent processing enforcement, can adopt the image that in each shooting, produces, extract automatically and check imposing a condition with window.Therefore, come the method in the past of specified window to compare by manual operation, can very simply determine to check, can alleviate user's burden with the imposing a condition of window with the user.In addition, set and check and use window owing to be based on the part of the structure of in fact on substrate, adding and variation, so can keep the precision that imposes a condition.

In addition, as described in above-mentioned the 1st scheme, above-mentioned inspection is that 1 specific plate base is implemented with the definite method that imposes a condition of window, can be with the registration of determining that imposes a condition.In this case, all substrates of later on same kind can adopt imposing a condition of this registration.

In addition, the inspection of scolding tin welded condition is such as described later, also can be to checking the indivedual definite methods that impose a condition that adopt above-mentioned window in 11 ground of object substrate.Like this, for the position of parts and pad and size etc., even the extent of deviation between the substrate is confirmed to be under the bigger situation, electricity can be checked with window with the inspection that is adapted to each substrate.But, in checking, parts are suitable under the situation of this inspection method, and the words of parts disappearance just can't be set window, so, wish other setting quantity and position to window, contrasted etc. with component locations information in the cad data and handled.

Then, with the 2nd kind of method that window imposes a condition be, in order to check the component installation state of substrate, to being set in to the aforesaid substrate method that inspection on the resulting image determines with imposing a condition of window of making a video recording about determining inspecting substrate of the present invention.Implement each following step in the method, comprising: for various parts, the standard of registering the size data that comprises each parts is respectively checked the 1st step of data; Parts are installed preceding substrate make a video recording, obtain the 2nd step of the image of generation; To the substrate of the shooting object that becomes above-mentioned the 2nd step, after installing, parts make a video recording once more, obtain the 3rd step of the image of generation; Be extracted in the difference between 2 width of cloth images that obtain in the 2nd step and the 3rd step, with extract difference each zone size and above-mentioned standard check that the size data in the data compares, and specifies the 4th step with the above-mentioned zone corresponding components; Based on the position and the size in the specified zone of corresponding component in above-mentioned the 4th step, determine the 5th step that imposes a condition of the window of parts inspection usefulness.

In above-mentioned method, the standard of various parts is checked that data can be thought and is equivalent to above-mentioned part library.In this method, for specific substrate, extract after the image and the difference between the image before the parts installation value after parts are installed, the size in each zone and the standard that extract difference are checked that the size data in the data compares, can be and the above-mentioned zone corresponding components with the parts of difference in predetermined error range of size are specific.And, can also to this corresponding component the window of specific region setting part spare inspection usefulness.

In said method, the size of the difference that extracts between the image of the substrate after image by the substrate before parts are installed and parts are installed and the size of various parts contrast, the specific more accurately zone corresponding with parts is so can improve the extraction precision that imposes a condition of the window of checking usefulness.And, under situation about registering in order to check imposing a condition of this window, preferably can be to the imposing a condition of each window, register accordingly with the information (such as the kinds of information that can utilize the expression parts, the identifying information in the part library) of the particular result of the parts of above-mentioned the 4th step of expression respectively.If so, when checking, set and check, on each of each window, can utilize the standard of corresponding component to check that data implement to check with after the window based on being registered in imposing a condition on the image of checking the substrate after the object parts are installed.

(2) substrate inspecting method

The present invention can also be applicable to scolding tin is welded substrate afterwards as checking object, check the method for the scolding tin welded condition of this substrate.Below, to describing about 2 kinds of substrate inspecting methods of the present invention.

(2)-1 the 1st substrate inspecting method

Implemented by each following step in this substrate inspecting method, comprising: the substrate after the butt welding soldering connects is made a video recording, and obtains the 1st step of the image of generation; To the substrate of the shooting object that becomes above-mentioned the 1st step, before the scolding tin welding, make a video recording, obtain the 2nd step of the image of generation; Extract the difference between 2 width of cloth images that obtain in above-mentioned the 1st step and the 2nd step,, determine the 3rd step that imposes a condition of the window that the scolding tin welding inspection is used based on the position and the size in the zone that extracts difference; Based on imposing a condition of in above-mentioned the 3rd step, determining, set inspection on the image of the substrate after above-mentioned scolding tin welding and use window, utilize the interior view data of this window to implement the 4th step of checking about the scolding tin welded condition.

In said method, the substrate image before the scolding tin welding can be thought to be equivalent to the image that parts are installed metacoxal plate.Therefore, be kept at parts the image that uses in the inspection of metacoxal plate is installed, in the scolding tin welding inspection, can read this preservation image is preferred to utilize.But, the invention is not restricted to this, can also make a video recording to implementing scolding tin welding sequence substrate before, and the image of preservation gained is when checking.The inspection method of the 2nd substrate of this point and back is similar.

In said method, based on above-mentioned inspection with impose a condition the 2nd form in the 1st definite method of window, owing to check that at each setting scolding tin on the object substrate welds, the window of inspection usefulness is checked, so, even deviation has all taken place in the position of pad and size on each substrate, also can set inspection and use window corresponding to each substrate, keep the precision of inspection.

(2)-2 the 2nd substrate inspecting method

In this substrate inspecting method, implemented by each following step, being comprised: expression is checked the installing component data of each position component on the object substrate and parts kind and checked the 1st step that data are registered about the standard of the scolding tin welded condition inspection of various parts; Substrate after the butt welding soldering connects is made a video recording, and obtains the 2nd step of the image of generation; To the substrate of the shooting object that becomes above-mentioned the 2nd step, make a video recording before the scolding tin welding implementing, obtain to generate the 3rd step of image; Extract the 4th step of the difference between 2 width of cloth images that obtain in above-mentioned the 2nd step and the 3rd step; Each has been registered the position that extracts the zone of difference in the position component data of above-mentioned installing component data and above-mentioned the 4th step compared specific the 5th step corresponding to each component area on the substrate; Based on corresponding component in above-mentioned the 5th step the position and the size in specific zone, the butt welding soldering connects the 6th step that imposes a condition and determine of the window of checking usefulness; Based on imposing a condition of determining in above-mentioned the 6th step, set inspection on the substrate image after above-mentioned scolding tin welding and use window, utilize the view data in this window and implement the butt welding soldering to connect the 7th step that the position is checked with the standard inspection data of this window corresponding components.

In the said method, standard inspection data can be thought the data suitable with part library.On the other hand,, be not limited thereto, can also from the testing fixture of component installation state, obtain though the installing component data are to generate from the substrate design data of cad data etc.Especially, parts are installed substrate afterwards, under the situation that adopts the 2nd kind of method determining that the aforesaid substrate inspection imposes a condition with window, can with expression parts inspection with the desired location of window and with the information (information of representing the specific adopted result of above-mentioned parts) of this window corresponding components, obtain as the installing component data.In this case, can be before inspection, accept the installing component data that testing fixture provided by component installation state, on the basis of it having been carried out registration, begin again to check.

In the 5th step of said method, often can be with each of the installing component on the substrate, and carry out corresponding with the nearest zone of parts in the zone that in the 4th step, extracts difference.Under this situation, be not limited to 1 zone, and can think with the scolding tin position several the zone corresponding a plurality of zones, owing to check in the data in standard, comprise the information of representing various component shape, and the information of representing the number of pads of 1 parts and relative position relation etc., by they are contrasted, can identify should be corresponding with each parts the zone.

And, in the 6th step, by position and size based on the corresponding region, set the window that the scolding tin welding inspection is used, can to other inspection data, also can the use standard check data setting inspection changeably corresponding to the scolding tin position of reality with in the window.So the deviation of corresponding pad locations and size is implemented high efficiency inspection simultaneously.

State the 1st on the implementation, under the situation of 2 substrate inspecting methods, extract the zone of exposing substrate quality color among the image of the substrate after above-mentioned scolding tin welding, based on the extraction result in this zone, it is preferred that above-mentioned scolding tin welding inspection is proofreaied and correct with imposing a condition of window.Like this, even the print range of emulsus scolding tin is overflowed from pad when the solder printing operation, the capillary effect of the fusion scolding tin during by the scolding tin welding sequence, the scolding tin after the fusion is drawn to be got back on the pad, thereby avoids checking the misspecification with window.

(3) be used for the inspection data creation method of inspecting substrate

This method is the method that data are checked in the generation used in the inspection of component installation state, and it is implemented by following various steps: for each parts, registration comprises that the standard of the size data of these parts checks the 1st step of data respectively; Parts are installed substrate before make a video recording, obtain the 2nd step of the image of generation; To the substrate of the shooting object that becomes above-mentioned the 2nd step, shooting once more after parts are installed obtains the 3rd step of the image of generation; Extract the difference between 2 width of cloth images that obtain in above-mentioned the 2nd step and the 3rd step, each size in zone and above-mentioned standard that extracts difference is checked that the size data in the data compares, the 4th step of specific parts corresponding to above-mentioned zone; Based on corresponding component in above-mentioned the 4th step the position and the size in specific zone, when the parts inspection is determined with imposing a condition of window, generate corresponding inspection data are set up in the standard inspection data and the above-mentioned inspection of above-mentioned corresponding component with window the 5th step.

Above-mentioned standard checks that data are and foregoing general identical data, that is, can think to be equivalent to the parts data storehouse.In this method,, before parts are installed and after the parts installation, all make a video recording the difference between the image of extraction gained respectively to specific substrate.And, with extracting specific corresponding component in each zone of difference, then in this specific zone, determine parts inspection imposing a condition with window.On the other hand, for the inspection data except the imposing a condition of window, the standard that is suitable for above-mentioned corresponding component is checked data.

And, for above-mentioned parts substrate before is installed, all confirm that the printing state of identification emulsus scolding tin and the installment state of parts are good for two of the substrate after parts are installed, it is preferred making a video recording on this basis.In addition, for the processing of checking in the 1st in the said method, the 2nd step and the 3rd step with window of determining that imposes a condition, can adopt with the 2nd kind of way that method is identical that window imposes a condition with definite aforesaid substrate inspection.

Said method does not use cad data, is to use the make a video recording image that obtains and standard of the substrate of reality checked data and generated the inspection data.In this method, check that by the size and the standard of the physical unit that will be extracted out the size data in the data compares, installing component and standard can be checked that data carry out correspondence simply as the difference between 2 images.So, can reduce significantly and check that data generate the needed time.

(3) about base board checking device

Among the present invention, the device as the component installation state of checking substrate provides a kind of device that possesses following various devices, wherein possesses: input block is installed the 1st image-input device of metacoxal plate image; Substrate after above-mentioned parts are installed was made a video recording before this substrate installing component and is generated image, with the 2nd image-input device of this image input; For specific substrate, extract the difference extraction element of the image difference that above-mentioned each image-input device of the 1st, the 2nd imports; Extract the position and the size in the zone of difference based on above-mentioned difference extraction element, to the definite device that imposes a condition that imposes a condition and determine of the window of parts inspection usefulness, store above-mentioned imposing a condition and determine the memory storage that the determined window of device imposes a condition; During the image of the substrate after installing with above-mentioned the 1st image-input device input checking object parts, based on imposing a condition that above-mentioned memory storage is stored, the set parts inspection is with the window setting device of window on this input picture; Utilize the view data in the window of setting by above-mentioned window setting device, parts are implemented the inspection device for carrying out said of checking.

In addition, among the present invention,, a kind of device that possesses following various devices is provided, has wherein possessed: the 1st image-input device of the substrate image after the scolding tin welding of input checking object as the device of the scolding tin welded condition of checking substrate; For the substrate after the welding of above-mentioned scolding tin, before this substrate scolding tin welding, make a video recording and generate image, import the 2nd image-input device of this image; Extract the difference extraction element of the difference between 2 width of cloth images that above-mentioned each image-input device of the 1st, the 2nd imports; Based on the position and the size that extract the difference zone by above-mentioned difference extraction element, set the window setting device of scolding tin welding inspection on the substrate image after above-mentioned scolding tin welding with window; Utilize the view data in the window of setting by above-mentioned window setting device, the butt welding soldering connects the inspection device for carrying out said that state is checked.

In each above-mentioned device, the 1st image-input device can also be made of following array apparatus: the device (comprising the video camera interface, A/D change-over circuit etc.) of reading images from the camera head that the inspection object substrate is made a video recording; Read the device that is stored in image in the predetermined storage medium; Device of the view data that acceptance sends from other device etc.The 2nd image-input device can adopt and the similar structure of the 1st image-input device.

As preferred scheme, its structure is: the 1st image-input device is made of the device of reading images from camera head, and in the testing fixture that the 2nd image device is checked substrate after finishing with preceding 1 operation (solder printing with the testing fixture of testing fixture or component installation state), the device of accepting to send of employed view data in the inspection of this device.

Difference extraction element, window setting device, check the definite device that imposes a condition in the testing fixture of device for carrying out said and component installation state, can constitute by the computer of having set the handling procedure that is used to implement these each devices.In addition, the function of these devices can also be realized with 1 computer.But,, can also adopt the non-computer device of similar ASIC (IC) etc. to constitute with special-purpose for a part of device wherein.

In the testing fixture of component installation state, before can utilizing the parts of specific in advance substrate to install and the image of parts after installing determine the parts inspection with the imposing a condition of window, and they are registered in the memory storage (can be set at the storer in the above-mentioned computer).When checking, checking set parts inspection window on the object images based on the information of registration, implement to check.

On the other hand, in the testing fixture of scolding tin welded condition, on every of inspection object substrate, the scolding tin that obtains this substrate welds before and scolding tin welding image afterwards, extracts scolding tin welding inspection window from these images automatically.And, set above-mentioned window on the image after the scolding tin welding that can in above-mentioned the 1st image-input device, import and implement to check.Further the 1st, the 2nd image-input device at this testing fixture has used under the situation of above-mentioned preferred version, can be after adopting the inspection object substrate, read image from camera head, accept picture signal simultaneously, implement to check after with window extracting inspection automatically from the testing fixture of preceding 1 operation.

And, in the testing fixture of scolding tin welded condition, can also set the structure that is used to implement above-mentioned the 2nd substrate inspecting method.

Furtherly, in the testing fixture of component installation state, the preferred setting: install the image of prebasal plate from the parts of the 2nd image-input device input, extract the device of the dispensing area of scolding tin; With, before checking, based on the position relation of the dispensing area of above-mentioned relatively scolding tin, the device that the inspection that above-mentioned window setting device is set is proofreaied and correct with window.In addition, in the testing fixture of scolding tin welded condition, the preferred setting: the image of the substrate after the scolding tin welding of the 1st image-input device input, extract the device in the zone corresponding with substrate quality color; With, before checking, based on the extraction result in the zone corresponding with aforesaid substrate quality color, the device that the inspection that above-mentioned window setting device is set is proofreaied and correct with window.

According to the present invention, to specific substrate, after implementing back and its next operation enforcement, predetermined operation carries out 2 shootings, and 2 width of cloth images of processing generation, by this method, check with the imposing a condition of window owing to can extract automatically, so can determine simply that inspection with the imposing a condition of window, can alleviate user's burden significantly.

In addition, among the present invention,, carry out corresponding owing to can simply each parts on the substrate and standard be checked data generating the parts inspection with checking under the data conditions, carry out corresponding existing method and compare with cad data and standard being checked data, can generate the inspection data expeditiously.

Description of drawings

Fig. 1 is the functional block diagram about parts inspection machine of the present invention.

Fig. 2 is from the installation prebasal plate image of certain components and the example key diagram that the metacoxal plate image generates difference image and 2 value images is installed.

Fig. 3 is used for the process flow diagram that window is set the exemplary treatments step that generates with file.

Fig. 4 is the process flow diagram that the expression parts are checked step.

Fig. 5 is the key diagram of the bearing calibration of expression parts window.

Fig. 6 is the process flow diagram of other steps of expression parts inspection.

Fig. 7 is the functional block diagram about scolding tin welding inspection machine of the present invention.

Fig. 8 is that expression is from the installation metacoxal plate image of certain components and the example key diagram of backflow metacoxal plate image generation difference image and 2 value images.

Fig. 9 is the key diagram of the bearing calibration of expression pad window.

Figure 10 is the process flow diagram of the step of expression scolding tin welding inspection.

Figure 11 is the key diagram that is illustrated in the setting data method for making of the pad window in the parts installation check machine.

Figure 12 is the key diagram of the setting data method for making of the pad window in the expression parts installation check machine.

Figure 13 is the key diagram of the object lesson of substrate manufacturing line.

Figure 14 is the calcspar of the common structure of the inspection machine of expression and Figure 13.

Figure 15 is the process flow diagram of generation step of the reference inspection data of expression parts inspection usefulness.

Embodiment

Fig. 1 represents the major function that the parts inspection machine of one embodiment of the present of invention is had.

This parts inspection machine 1 is, will through the parts installation procedure and import substrate before the reflow ovens as checking object, the setup error of inspection part, position deviation, rotation depart from etc., the machine that whether suitable the inspection part installment state is.

Above-mentioned parts inspection machine 1 has: the part library 19 that installation prebasal plate image input part 11, installation metacoxal plate image input part 12, difference image generating unit 13,2 value handling parts 14, noise are removed portion 15, parts extraction unit 16, window data generating unit 17, inspection portion 18 and registered the standard inspection data of multiple parts.

The metacoxal plate image is installed is, checks object substrate, promptly passes through the image of parts installation procedure substrate afterwards.On the other hand, the prebasal plate image is installed is, the image before the parts of above-mentioned inspection object substrate are installed, that is, and to this substrate carry out making a video recording after emulsus printing image of gained.And, the prebasal plate image is installed, the digital color image that the metacoxal plate image all is made up of the shades of colour data of r, g, b is installed.And between image, the difference of the position of base main body and size is all proofreaied and correct in advance.

Difference image generating unit 13 is carried out the calculus of differences processing to above-mentioned installation prebasal plate image and installation metacoxal plate image, generates difference image from this operation result.In this calculus of differences, on each corresponding between image pixel, the color data of obtaining each r, g, b respectively is poor, should differ from predetermined threshold value to compare.Here, surpassing the pixel place of above-mentioned threshold value in the difference of any one color data, set the numerical value of the differential data of each color of reflection, is zero with the setting value of in addition pixel, so generates difference image.By this method, the part that color between above-mentioned 2 width of cloth images has been produced than big-difference is reflected on the difference image.And, in above-mentioned calculus of differences is handled, can also replace color data, ask for the poor of lightness, chroma, tone value etc. at each pixel place.

2 value handling parts 14 with difference image 2 values that above-mentioned difference image generating unit 13 generates, will produce the part black of above-mentioned heterochromia with predetermined threshold value, and other part generates black white image with white.And, above-mentioned black and white can also be set conversely.

Noise is removed portion 15, and above-mentioned 2 value images are implemented the smoothing of profiles and expansion shrink process etc., removes the noise that produces when calculus of differences is handled.Parts extraction unit 16 is implemented Contour tracing processing and decals (labeling) processing by 2 value images after noise is removed, and cutting and separating also extracts the zone of black pixel thus.

Fig. 2 is to be example with the representative like this parts of chip part, at the installation prebasal plate image of expression certain components with when the example of metacoxal plate image is installed, and difference image and 2 value images that expression produces from these images.And, in each substrate image after before installation, installing, the 101st, the pad in the presentation video, the printing zone of 102 expression emulsus printings, 103 expression parts (Fig. 8 of back is also the same therewith).In addition, in difference image, represent to extract the pixel of color change with predetermined coating figure.

Prebasal plate is installed, and is the substrate that has carried out the emulsus printing on the pad, and it is the substrate that parts have been installed on the emulsus printing that metacoxal plate is installed.Therefore, if the difference of the prebasal plate image being installed and install between the metacoxal plate image is implemented computing, just the corresponding regional 103a place of the image of component 103 that can add in the parts installation procedure (image that also comprises the electrode part except the image of article body) extracts predetermined COLOR COMPOSITION THROUGH DISTRIBUTION.Each pixel in the 103a of this zone converts black pixel to without exception by 2 values.Above-mentioned parts extraction unit 16 just can extract the image that should zone 103a be parts.

In above-mentioned part library 19, will have said function, the parts that difference in appearance is little conclude in the group that is called " mutation ", in each mutation, have registered the standard of the size data that comprises parts and pad etc. and have checked data.In addition, in each mutation, added the independent identifying information that is called " mutation name " respectively.

Above-mentioned parts extraction unit 16, the size data of the size by the black pixel zone that shows in the 2 value images after noise is removed and the parts of each mutation in the part library 19 compares successively, the mutation of specific and the regional corresponding components of black pixel.Below, the processing of the specific mutation corresponding with these parts is called " definition process of parts ".

Window data generating unit 17, to parts extraction unit 16 specific each parts, make expression and check the data that impose a condition with window (below be called " parts window ") (below be called " setting data ").Among this embodiment, be set and the external rectangle of black pixel zone 103a that is equivalent to parts, with the position of this rectangle of expression and the data of size (such as, the coordinate on the left upper apex of rectangle and summit, bottom right) setting data as the parts window.

And, window data generating unit 17, with the information of representing the parts particular result with above-mentioned parts extraction unit 16 (below be called " parts definition information ".This information comprises: the mutation name of certain components) corresponding.

In the present embodiment, before inspection, printing state to the emulsus printing is good, and the installment state of parts also is good substrate, the a series of processing that implement to generate above-mentioned installation prebasal plate image and the metacoxal plate image is installed can obtain the setting data of parts window of each parts and the combined result of parts customizing messages.Here with the combined result of the data that generate with the in addition documentation (below this document being called " window is set and use file ") of substrate unit, and be registered in and register in the usefulness storer (storer 57 of Figure 14 described later).

When checking,, metacoxal plate image input part 12 supplies with the image of checking object to inspection portion 18 from being installed.Inspection portion 18 sets with the setting data in the file and is set in parts window on the installation metacoxal plate image of supply based on being stored in above-mentioned window.In addition, inspection portion 18 reads from part library 19 and is combined in the above-mentioned setting data, and the normal data corresponding with the parts customizing messages utilizes this standard to check that data implement Flame Image Process and inspection.

Fig. 3 represents the demonstration program in the above-mentioned parts inspection machine 1.The demonstration of present embodiment is owing to be with the be generated as purpose of above-mentioned window setting with file, before processing, the particular substrate that the printing state of emulsus scolding tin is good is made a video recording, generate thus and install after the prebasal plate image, at this substrate upper mounting component, confirming to carry out the 2nd shooting on the suitable basis of its installment state, generating the metacoxal plate image is installed.

In initial ST1 (ST is the abbreviation of " step ", below too), import above-mentioned installation metacoxal plate image, then in ST2, the prebasal plate image is installed in input.

Among the ST3 then, utilize the image of importing among above-mentioned ST1, the ST2, generate difference image with above-mentioned main points.In ST4,, and further implement noise and remove processing these difference image 2 values.In ST5, implement Contour tracing processing and decals on the 2 value images after removing noise and handle, extract the black pixel zone corresponding with each parts.

Below, pay close attention to the parts that extract successively, each parts is implemented the step of ST6～8.At first, in ST6, the formation pixel number in above-mentioned black pixel zone is extracted size data as the concern parts, the size data of each mutation in itself and the part library 19 is compared.If it is find the mutation of difference in predetermined error range of size here, that this mutation is in addition specific as the content relevant with the parts of being paid close attention to.And, the mutation name of specific mutation, be kept in the not shown working storage as the parts customizing messages.

If specific features, in the ST7 of bottom, set with the external rectangle in above-mentioned black pixel zone after, the position of this rectangle and the size setting data as the parts window is extracted.In addition, in ST8, the parts customizing messages that ST6 is set is corresponding with above-mentioned setting data.

Below too, in addition specific to each parts, make the setting data of parts window simultaneously, with itself and the combination of parts customizing messages.

If the processing to all parts is through with, then ST9 becomes "Yes", enters ST10 thus, the data splitting of each parts is set as above-mentioned window concluded with file, and they are stored in the storer of registration usefulness.

And, in the above-mentioned step, precision for the setting data that improves the parts window, for multi-piece substrate, generating respectively on the basis that metacoxal plate image and installation prebasal plate image are installed, implement the processing of above-mentioned ST3～ST9 on every plate base, the data that will obtain the averaging of setting data that every substrate is obtained are preferred as final setting data.

In addition, in Fig. 3, for ease of explanation, for all parts on the substrate, all be by utilizing the 2 value images that come from the difference image conversion to come parts are defined, still in the parts of reality, also exist by size data and be difficult to parts that it is defined.For such parts, can be in advance by the position of indicating device, come from the processing of above-mentioned ST6～9 its eliminating in ST6, also can by the kind of user's input block then.

Then, the inspection that utilizes the window of registering by above-mentioned demonstration to set with file is described.When checking, to read the window setting corresponding and use file with checking object substrate, the work that is arranged on is with in the storer.And, check on the object substrate at every, by implementing following step shown in Figure 4, come having or not and installment state whether suitable of inspection part.

In Fig. 4, in initial ST11, the installation metacoxal plate image of input checking object substrate.

Then in ST12, from above-mentioned working storage, read out the combination that begins most of the setting data and the parts customizing messages of parts window.In ST13, based on the setting data of reading among the above-mentioned ST12, set parts window on the substrate image after the above-mentioned installation.

In ST14, from above-mentioned part library 19, read the standard corresponding and check data with parts definition information.And, in the ST15 that follows,, utilize above-mentioned standard to check that data handle to the image in the parts window of in ST12, setting, whereby, come inspection part to have or not and installment state whether suitable.

And, as the method that has or not that is used for inspection part, can consider above-mentioned parts window is scanned along Width, judge to represent having or not of electrode color area.In addition,, the image in the parts window is carried out processing such as 2 values, extract parts thus, and its center of gravity and spindle angular measured etc. handled judging under the whether suitable situation of installment state.

The processing of above-mentioned ST12～15 is implemented with every kind of combination of all data in the file being arranged on above-mentioned window setting.If last data combination processing is finished, then ST16 becomes "Yes", enters ST17 thus, the outgoing inspection result.Arrive here, the inspection of 1 chip part being installed metacoxal plate finishes.

According to above-mentioned Fig. 3,4 demonstration and inspection, utilize the installation prebasal plate image of specific substrate and the metacoxal plate image is installed, extract each position component and size, by this method, specific in addition the time, can make the setting data of parts window to each parts to the parts on the substrate.And, in inspection, after based on setting data set parts window, based on this setting data corresponding components customizing messages, from part library 19, read the standard that needs and check data, check thus.So, can need not on one side to carry out zone and specify by the user, one side trouble that the window that extracts automatically from cad data is proofreaied and correct etc. processing, the simple and high-precision setting data that makes the parts window.

And, in the example of above-mentioned Fig. 3, though be to be prerequisite with the situation of the metacoxal plate image being installed and the image with good quality that the prebasal plate image all is to use being installed, generate the setting data of parts window, but the invention is not restricted to this, if the solder printing state of prebasal plate is installed at least is good, also can carry out correspondence even the parts of installation metacoxal plate image have produced some position deviations.

Fig. 5 represents the corresponding example of the situation that depart from the installation site of the parts of parts installation metacoxal plate.In this embodiment, the difference image before utilizing above-mentioned parts that back image and parts are installed to install between the image has been set after the parts window W1, based on the printing zone of emulsus scolding tin (below be called " soldering tin ") position of this window W1 is proofreaied and correct.

Among this Fig. 5, W1 is the parts window of chip part, O ₁It is the central point of this parts window W1.In addition, the rectangular area the 104, the 105th of dotted line is corresponding to the soldering tin of both sides pad.These zones the 104, the 105th, by to installation base plate image before the above-mentioned parts on emulsus scolding tin, carry out the zone that 2 values extract with suitable color.

In the present embodiment, on each soldering tin 104,105, obtain central point c ₁, c ₂Afterwards, obtain these central points c ₁, c ₂Between mid point O ₂, extract above-mentioned central point O ₁Relative this mid point O ₂Distance D 1.In addition, extract the distance D 2 between the edge of the edge of parts window W1 and corresponding therewith soldering tin 104,105, these distance D 1, D2 are compared with predetermined threshold value respectively.Here surpass under the situation of threshold value in any one of distance D 1, D2, the position of parts window W1 is proofreaied and correct, make this distance in threshold value.Under the situation of Fig. 3, preferably make parts window W1 on the direction of arrow F, move, so that distance D 1 is in predetermined value.

As shown in this embodiment, extracting parts from the image of the substrate of reality, extracting under the situation of set parts window W1 as a result based on this, if the parts deviation position, parts window W1 also can't be positioned at suitable place.But, according to treatment for correcting shown in Figure 5, can be in suitable fitting limit with soldering tin with the position correction of parts window W as benchmark, so can be with the position correction of parts window W1 to suitable place.

And, in the example of Fig. 5, as parts window W1 and soldering tin 104, distance between 105 the edge, though only represent the distance D 2 between the coboundary, in fact preferably also detect the distance between the lower limb, and distance is up and down compared with threshold value respectively.In addition, preferably being not only above-below direction, also is the same for left and right directions, proofreaies and correct as the position to parts window W1 of benchmark with soldering tin 104,105.

Furtherly, if enter the processing of above-mentioned Fig. 5, need not to consider the disappearance of parts and significantly under the situation of position deviation, can be without the setting data of registration means window, on each plate base, carry out the setting of parts window and handle, in each parts window, implement to be suitable for the inspection that above-mentioned standard is checked data.Fig. 6 is the block diagram of the inspection under this situation of expression.And this step is from ST21.

In this step, after the metacoxal plate image was installed in the ST21 input that begins most, the prebasal plate image was installed in input in the ST22 that follows.

And, in ST21, input picture from video camera 51 described later in ST22, can be imported the image that sends from other inspection machine.But, the invention is not restricted to this, can also be in each step, the image that input generates in advance and preserves.

In ST23～ST25,, extract the black pixel zone corresponding with each parts by the same processing in ST3～5 of enforcement with above-mentioned Fig. 3.

Pay close attention to the parts that extract afterwards, successively, on each parts, implement the step of ST26～30.At first, in ST26, will compare about the size data of each interior parts of the formation pixel number in the black pixel zone of the parts in paying close attention to and part library 19, come definition component.

Then, in step ST27, by setting and the method for the rectangle that above-mentioned black pixel zone is external the setting data of generation parts window.And, this setting data, identical with the situation of above-mentioned exemplary treatments, information (parts customizing messages) combination with the particular result of the expression parts of ST26 is kept in the working storage.

Then, in ST28, setting comprises the zone of the pre-sizing that the above-mentioned black pixel zone of above-mentioned installation prebasal plate image is such, by the image in this zone is carried out 2 values, extracts soldering tin 104,105 as shown in Figure 5.In ST29, judge whether relative soldering tin is in suitable position to the parts window of setting in above-mentioned ST27.This judgment processing, imaginary 2 dimension coordinates that are used in the working storage are fastened above-mentioned parts window of setting and soldering tin, and with judging above-mentioned distance D shown in Figure 51, the method for D2 etc. is carried out.Here,, the desired location of parts window is proofreaied and correct, made the position relation become suitable if the unsuitable words of decision means position of window then enter into ST30.

For all parts that extract, all implemented ST26～30 and handled, ST31 becomes "Yes".In ST32 below～35, pay close attention to each parts again successively, simultaneously each parts is implemented to check, and export its check result.And the processing of this ST32～35 is owing to be identical with the processing of ST13～17 of above-mentioned Fig. 4, so omit detailed description thereof here.

According to above-mentioned inspection step, on each plate base, can the set parts window, make the physical unit that contains on this substrate.In addition, owing to adopt above-mentioned method shown in Figure 5, the parts position of window is proofreaied and correct, so, even produced on the parts under the situation of position deviation, also the parts window can be corrected to its should the position, detect the inappropriate of position component thus, can guarantee the precision of checking.

In addition, in the step of above-mentioned Fig. 6, after the setting processing of the particular procedure of each parts on substrate and parts window finishes, enforcement is to the inspection of each parts, but the invention is not restricted to this, can also on each parts, implement according to the particular procedure of parts, the setting processing of parts window and the order of checking.

Fig. 7 is the function of expression as the scolding tin welding inspection machine of other embodiment of the present invention.

This scolding tin welding inspection machine 2, owing to be to be object with the substrate that in reflow ovens, carries out scolding tin welding, check the whether suitable machine of the scolding tin welding of each parts, so possess: installing component data input part 20, installation metacoxal plate image input part 21, backflow metacoxal plate image input part 22, difference image generating unit 23,2 value handling parts 24, noise are removed portion 25, pad extraction unit 26, window data generating unit 27, inspection portion 28, part library 29 etc.

Substrate image after the backflow is exactly that this base board checking device has promptly been implemented the image of the substrate of scolding tin welding as checking object substrate in reflow ovens.And, in the present embodiment, in the shooting of backflow metacoxal plate, use is with the three primary colors light source of red, green, blue, substrate is configured in the lighting device (referring to following patent documentation 2) on the different angles respectively relatively, and the part of the scolding tin on image produces the COLOR COMPOSITION THROUGH DISTRIBUTION of its graded of reflection thus.

Patent documentation 2 special fair 6-1173 communiques

It is the image before dropping into reflow ovens of this inspection object substrate that the metacoxal plate image is installed.And, as this metacoxal plate image is installed, can use above-mentioned parts inspection machine 1 as the image of checking the object input.

Installing component data, expression are for each parts of checking on the object substrate, with the specific data of representing component locations and parts kind of above-mentioned parts inspection machine 1.Component locations is particularly represented with the setting data of above-mentioned parts window, and the parts kind is used in above-mentioned parts definition information, and promptly common mutation name is represented in the part library 19,29.Here Shu Ru installing component data offer places such as pad extraction unit 26 and inspection portion 27.

Difference image generating unit 23,2 value handling parts 24, noise are removed portion 25, have the identical processing of handling part 13,14,15 enforcements of same names respectively with above-mentioned parts inspection machine 1.

In the scolding tin welding inspection machine 2 of present embodiment, the backflow metacoxal plate image of input checking object substrate and installation metacoxal plate image, automatically the inspection that extracts the scolding tin welded condition from these images is with window (below, be called " pad window "), and checks.

Fig. 8 represents the example of certain components installation metacoxal plate image and backflow metacoxal plate image respectively, and difference image that generates from these images and 2 value images.And, in this routine difference image, because the complex forms of the variation of color,, changing unit extracted out uses a kind of diagrammatic representation for easy.

If substrate has been implemented heat treated in reflow ovens, the emulsus scolding tin melting and solidification on the pad, its surface has become mirror-like.When under with the condition of above-mentioned lighting device lighting, this scolding tin being made a video recording, then on zone corresponding on the pad, generate the shades of colour of red, green, blue, produce and the corresponding distributed image 106 of heeling condition.

In the difference image of installing between metacoxal plate image and the backflow metacoxal plate image, extract the color change that changes corresponding to above-mentioned scolding tin.That is, extract and the corresponding regional 101a of outer edge part that does not have the installing component pad.Pixel in the 101a of this zone converts black pixel to without exception by 2 values.

Above-mentioned pad extraction unit 26, component locations based on above-mentioned installing component data representation, and the pad information of from part library 29, reading (quantity of expression pad and the information of position), extract the black pixel zone corresponding the 2 value images after above-mentioned noise is removed with the pad of each parts.Window data generating unit 27 is set the external rectangular-shaped window in above-mentioned black pixel zone as above-mentioned pad window, and this setting data (data of expression position of window and size) is offered inspection portion 28.

Inspection portion 28 based on the setting data that transmits from above-mentioned window data generating unit 27, sets the pad window of each parts on above-mentioned backflow metacoxal plate image.In addition, this inspection portion 28 is based on the parts customizing messages in the above-mentioned installing component data, read the standard corresponding and check data with each parts, according to its content, on one side the image in the above-mentioned pad window is handled, check on one side the scolding tin welded condition suitably whether.

From above-mentioned backflow metacoxal plate image with the method that the difference that produces between the metacoxal plate image is set the pad window is installed, be suitably to be coated on the pad, and the scolding tin after the fusion scope of also not crossing pad is a prerequisite with emulsus scolding tin.But the formation position of pad and size have small deviation, and also have deviation in the coating weight of emulsus scolding tin, so, emulsus scolding tin sometimes also can take place cross pad, the situation that occurrence positions departs from.Under these circumstances, handle the black pixel zone that extracts with calculus of differences and 2 values and be unsuitable for pad, might cause the position of scolding tin and size can't obtain right judgement.

In view of the above problems, in the present embodiment, has the function of adjusting based on the size of the regional pad window of setting of black pixel on the window data generating unit 27.This adjustment is passed through, and extracts pixel with substrate quality color (below be called " background pixels ") from above-mentioned backflow metacoxal plate image, and the method for utilizing this extraction result to change the border of pad window is carried out.

Fig. 9 represents the concrete example that the adjustment of pad window is handled.

In the installation metacoxal plate image of Fig. 9 (1), position deviation has taken place in emulsus scolding tin 102 relative pads 101, and in the installation metacoxal plate image of Fig. 9 (2), the amount of emulsus scolding tin 102 is many, is the state that pad 101 is covered fully.But in any one example, the scolding tin 106 on the backflow metacoxal plate image all belongs within the formation scope of pad 101.This is by the capillary effect the scolding tin fusion time in the reflow process, and the scolding tin that pad is outer draws to be got back to suitable scope and cause.

Yet, implement calculus of differences and 2 values processing if utilize the installation metacoxal plate image of such state and backflow metacoxal plate image, the outside at pad also can extract black pixel, shown in the example of Fig. 9 (1), depart from the position of pad window W2, shown in the example of Fig. 9 (2), the size of pad window W2 is set at than bigger under the general case.

Window data generating unit 27 is used the threshold value corresponding to aforesaid substrate quality color, above-mentioned backflow metacoxal plate image is implemented 2 values handle, and extracts background image by this method.And, by from the pad window W2 that sets, removing the pixel corresponding, adjust to the border of pad window W2 consistent with the border of pad 101 with background pixels.And, shown in the example of Fig. 9 (1), because the position deviation of pad window W2, between the zone of the border (lower edge portion of window W2 among Fig. 9 (1)) of the part of window W2 and background pixels, produce under the predetermined situation, preferably on this direction of shrinking, enlarge the width of pad window apart from δ apart from δ.

According to adjustment as described above, pad window W2 can be set for corresponding with actual pad.And, in calculus of differences is handled, owing to can't extract the scolding tin part that is hidden in the parts 103, so cause the border of component side of pad window W2 incorrect.But, in the inspection of scolding tin welding, because the main inspection of only carrying out than place, article body more lateral, so can not produce very big influence to checking.

Figure 10 represents the treatment scheme under the situation of above-mentioned 1 backflow metacoxal plate of scolding tin welding inspection machine check.And during this was handled, the step that begins most was ST41.

The step of this Figure 10 is to begin after the installing component data input of checking the object substrate kind.At first, in ST41, input checking object backflow metacoxal plate image, then in ST42, the metacoxal plate image is installed in input.And backflow metacoxal plate image can also be from video camera 51 inputs of installing self, and installing component data and installation metacoxal plate image can also be transmitted by above-mentioned parts inspection machine 1.

In ST43, the image by with above-mentioned ST41,42 inputs generates difference image.In ST44,, and further implement noise and remove processing these difference image 2 values.In ST45 below～49, based on above-mentioned installing component data, when paying close attention to each parts successively, implement the pad window setting data generation with and the adjustment of size handle.

At first, in ST45, identification component position and parts kind in the installing component data of the parts from pay close attention to.And, based on above-mentioned component locations, on above-mentioned 2 value images, set region of search with pre-sizing, in this region of search, extract the black pixel zone corresponding with pad.And, during this extracts and handles, based on above-mentioned parts kind searching part storehouse 29, discern the quantity of the pad that extract and the relative position relation between each pad and the parts thus, to concern the black pixel zone of the predetermined quantity that coincide with this quantity and position, as extracting with above-mentioned parts kind corresponding components pad.

In ensuing ST46, in each the black pixel zone that extracts, generate the setting data of pad window.Under this situation, also similar with the setting data of above-mentioned parts window, set and the external window in black pixel zone, this position of window and size are made corresponding data of sign (label) with these parts.

In ST47, with the size and the relative position relative of above-mentioned pad window, check that with above-mentioned standard the pad data of data compare with the parts window, judge whether to have position deviation significantly and big or small different.If be judged as the pad position of window and the big or small unsuitable words of setting here, then enter ST48, above-mentioned backflow metacoxal plate image is carried out 2 values, extract background pixels thus.In ensuing ST49,, the size of pad window is adjusted based on the extraction result of above-mentioned background pixel with above-mentioned main points shown in Figure 9.

For all parts on the substrate, when all implementing ST45～49 and handling, then pay close attention to each parts limit more successively and implement the step that is used to check.At first, in ST51,, on backflow metacoxal plate image, set the pad window based on the setting data of paying close attention to parts.Then, in ST52, from above-mentioned part library 29, read out the standard corresponding and check data with paying close attention to parts.In ST53, check data based on this standard, the view data in the pad window is handled, and, checked the scolding tin welded condition by judgement to its result.

After finishing for the processing of above-mentioned ST51～53 of all parts, ST54 becomes "Yes", enters ST55, and the outgoing inspection result, finishes the processing to above-mentioned backflow metacoxal plate.

Also have, in the above-described embodiments, though be to accept providing to the installing component data of each substrate from parts inspection machine 1, but the invention is not restricted to this, as the embodiment of above-mentioned Fig. 3, in parts inspection machine 1, generate window and set under the situation about also registering, window setting data in this document and parts information specific etc. can also be used as the installing component data with file.Under this situation, in scolding tin welding inspection machine 2, before inspection, the window that reception is sent from parts inspection machine 1 is set and is used file, is registered at the file that will receive on the basis of storer, begins to check.

According to above-mentioned parts inspection machine 1 and scolding tin welding inspection machine 2, handle by image the substrate of the inspection object of reality, can set inspection and make it corresponding with actual parts and pad etc. with window.Therefore,, also can suitably set the inspection window even deviation takes place for parts and pad locations and size etc., can be to carrying out high-precision inspection as parts that are examined the position and scolding tin weld part etc.

Then, among the embodiment shown here, though be to have utilized difference image, be created on the inspection setting data of window that uses in the device self, but the invention is not restricted to this, also can generate the setting data that window is used in the inspection of using in other the inspection machine.

Figure 11 and Figure 12 represent, with wire guiding member as the situation of checking object under, use the parts inspection machine, the example the during setting data of the pad window when making the scolding tin welded condition of checking each lead afterwards that refluxes.When checking the scolding tin welded condition of wire guiding member, need on every lead, set the pad window.In the present embodiment, at lead this point of the structure that on image, occurs first after parts are installed, without scolding tin welding inspection machine 2, but with the setting data of parts inspection machine 1 generation pad window.

In the installation metacoxal plate image of Figure 11, the image of 104 expression article body, 105 expression leads.And the 106th, with 1 lead corresponding bonding pad, the 107th, the emulsus scolding tin on the above-mentioned pad 106.

In the present embodiment, identical with the example of above-mentioned Fig. 2, after the difference image generation of installing between prebasal plate image and the installation metacoxal plate image, carry out 2 values, extract the parts general image zone 104a (referring to Figure 11) that comprises lead.

And, in the present embodiment, as shown in figure 12, from above-mentioned image-region 104a, extract the some P0～P9 (below, they are called " front edge point ") of the front edge that constitutes each lead.Then, these front edge points P0～P9 as benchmark, is set rectangular area W30～W39 in comprising the preset range of this front edge point, with them respectively as the pad window.The setting data of these pad windows W30～W39 is sent to the scolding tin welding, and inspection machine 2 in the scolding tin welding of above-mentioned wire guiding member, uses in the time of inspection.Also have, front edge point P0～P9 can utilize the projection process of image, and known image processing methods such as figure coupling extract.

Next, the concrete use example to above-mentioned inspection machine 1,2 describes.

Figure 13 represents the manufacturing of component-mounted substrate and the example of the substrate manufacturing line that inspection has realized robotization.Be equipped with following various devices on the substrate manufacturing line here, comprise: the solder printing machine 201 that is used for printed circuit board (PCB) is advanced to spin the emulsus solder printing; The assembly machine 202 that is used for the substrate upper mounting component behind solder printing; Substrate after the parts installation is implemented the reflow ovens 203 of heat treated.In addition, between solder printing machine 201 and assembly machine 202, be equipped with solder printing inspection machine 3, between assembly machine 202 and cocurrent flow stove 203, be equipped with parts inspection machine 1, be equipped with scolding tin welding inspection machine 2 in the downstream of reflow ovens 203.Between these devices, be equipped with the transport tape that board carrying is used, substrate is sent to each device successively, handle thus.In addition, each inspection machine 1,2,3, the network line 4 by LAN circuit etc. connects, and is set at the state that can communicate by letter each other.

Each inspection machine 1,2,3 all possesses: contain the video camera 51 that generates the CCD that coloured image uses and contain (all as shown in figure 11) such as substrate platforms 53 with respect to the twin shaft drives structure of XY.In addition, each inspection machine 1,2,3 all is equipped with the illuminating lighting device of substrate (not shown) near video camera 51.Especially in above-mentioned scolding tin welding inspection machine 2, imported light source illuminating apparatus with above-mentioned 3 primary colors.

On parts inspection machine 1 and scolding tin welding inspection machine 2, set the function shown in Fig. 1,7 respectively, the inspection object substrate is being made a video recording, generate thus and check object images, simultaneously, receiving about this substrate, (is exactly the solder printing inspection machine under the situation of parts inspection machine 1 by the inspection machine of preceding 1 operation, be exactly parts inspection machine 1 under the situation of scolding tin welding inspection machine 2) view data that generates when checking with this inspection machine is provided.And, image that provides and the image that device generates self are provided, when checking the setting data of using window, from part library 19,29, read the standard corresponding and check data with each parts with above-mentioned main points generation, implement inspection thus.In addition, the substrate that the inspection of 1 pair of parts inspection machine is finished can offer scolding tin welding inspection machine 2 as above-mentioned installing component data with the setting data of parts window that each parts on this substrate are set and the customizing messages of parts.In addition, shown in the example shown in above-mentioned Figure 11,12, can also make pad window setting data, they are offered scolding tin welding inspection machine 2 specific features.

Solder printing inspection machine 3 owing to have and in the past identical structure, so utilize the reference inspection data that in advance every kind of substrate generated, the image that object substrate is checked in processing, is judged the scolding tin welded condition suitability in each pad.In addition, in this solder printing inspection machine 3, the image that will use in also will checking is stored in the storer successively, goes so that this image is provided in the parts inspection machine 1.

Also have, parts inspection machine 1 and scolding tin welding inspection machine 2 receive from the image of inspection machine of an operation when providing, need implement image to this inspection machine and send requirement, this image sends and requires to be included in the substrate identifying information of device self in handling.Under this situation, identifying information with bar code and 2 dimension sign indicating number processing can be positioned on each substrate, but under need not situation in manufacture process to the sampling of substrate, the substrate that can also transport for each inspection machine 1,2,3 adds continuous numbering, and the identifying information of this numbering as substrate used.

Figure 14 represents common structure in above-mentioned each inspection machine 1,2,3.

This inspection machine comprises: be connected with on the control part 50 that is made of computer: image input part 52, XY platform control part 54, input part 55, monitor 56, storer 57, communication interface 58 etc.Also have, in control part 50, except CPU, also comprise the ROM and the memory-aided RAM of conduct work that store base program.On the other hand, storer 57 is jumbo hard disks, stores about the program checked, part library etc.In addition, view data of using in inspection and check result etc. all are stored in this storer 57.

Image input part 52 is installed between above-mentioned video camera 51 and the control part 50, comprises the interface loop of image input usefulness and the device in A/D conversion loop.XY platform control part 54, according to the indication from control part 50, mobile aforesaid substrate platform 53 makes and comprises in the camera watch region of above-mentioned video camera 51 and be examined the position.Input part 55 is keyboard and mouse etc., and it is used as: select the pattern of inspection and demonstration, checking at first the kind of input checking object substrate etc.Monitor 56 is used in the data input, the image and the check result of the prompting at explicit user interface, inspection object.

In parts inspection machine 1 and scolding tin welding inspection machine 2, adopt above-mentioned input part 55, make window setting file in advance, select whether to register.In addition, when not having the windows registry setting to use file, utilization checks that the image that the inspection machine of object images and last 1 operation provides carries out under the situation of self-verifying, can select whether to proofread and correct with window to checking, and the operation of from the automatic setting of window is handled, specifying excluded parts.By such structure, can be according to the extent of deviation of parts and pad in the inspection object substrate, user's purpose etc., the technical manual of change inspection machine 1,2 provides the inspection machine with high convenience.

In above-mentioned inspection machine 1,2,,, implement to check so can generate the inspection data in advance owing to used the standard of part library to check data for except checking with the inspection data the setting data of window.But, replace, the reference inspection data that also can generate each parts with the exemplary treatments identical with the past are (by the installation site of parts, to the connection data of checking with program, the judgment standard value, the data that all information that needs in other the inspection is formed).In this case, if utilize part library to generate the reference inspection data, can be with the time with above-mentioned inspection identical method generate and check and use the window setting data that it can check that data are corresponding with corresponding standard.

The step of the processing when Figure 15 represents to make the reference inspection data of parts inspection usefulness.In this is handled, in advance the good particular substrate of the printing state of emulsus scolding tin is made a video recording, generate thus the prebasal plate image is installed.In addition, at this substrate upper mounting component,,, the metacoxal plate image makes a video recording to being installed confirming to carry out the 2nd shooting on the suitable basis of its installment state.And, in the processing of this figure, the step that begins most is ST61.

At first in ST61～65,, extract each parts on the substrate by the same processing in ST1～5 of enforcement with above-mentioned Fig. 3.Afterwards, pay close attention to each parts successively, make the inspection data of the parts of paying close attention to simultaneously.

In ST66, same with the ST6 of above-mentioned Fig. 3, the size data of each mutation in size by will paying close attention to parts and the part library 19 compares, and comes specific features.In ST67, for certain components, use the method same with the ST7 of above-mentioned Fig. 3, generate the setting data of parts window.

In ensuing ST68, from part library 19, read the standard of above-mentioned ST66 certain components and check data.Then, in ST69, check that by the data and the standard of will read data are corresponding, set corresponding to the inspection data of paying close attention to parts.

Below too, on each parts, the setting data and the standard of the parts window that will generate from the image of the substrate of reality are checked data combination, generate and check data.The inspection data that generate temporarily are kept at work with in the storer.

If the processing to all parts is through with, ST70 becomes "Yes", enters into ST71.In ST71, generate the inspection data file of the inspection data of each parts that combine above-mentioned temporary transient preservation, they are registered in the above-mentioned storer 57 end process.

Also have, check in the generation of data, especially, preferably utilize multi-piece substrate to generate data respectively for the generation of the setting data of parts window in said reference, with the average result of each data as final setting data.

Generation according to above-mentioned inspection data is handled, can utilize the prebasal plate image to be installed and the metacoxal plate image is installed and simply extract each position component and size, on this basis, carry out specific method, normal data that can the corresponding component storehouse by size based on each parts.So, can be as the method for in the past use cad data, need not the corresponding step between parts and the normal data, can high efficiency generation check data.But,,, carry out other correspondence preferably by the kind of user's alternative pack for only being difficult to carry out certain components from mass data.

Also have, the inspection data that welding inspection is used for scolding tin, with generating after the setting data of pad window with the same step in ST41～46 of Figure 10, this setting data and the standard corresponding with parts are checked that data are made up, generate the reference inspection data that the scolding tin welding inspection is used.In addition,, can generate the inspection data, and they are imported in the inspection machine 1,2 shown in above-mentioned Fig. 1,7 go with the device outside the inspection machines such as PC for parts installation check, scolding tin welding inspection any one.

Claims (12)

1, a kind of inspecting substrate is with the definite method that imposes a condition of window, it is to be used for the substrate of producing or produce after finishing is checked, to being set in to the aforesaid substrate method that inspection on the gained image determines with imposing a condition of window of making a video recording, it is characterized in that, adopt following steps to be implemented:

Among the multinomial operation of implementing in the production that is used for component-mounted substrate decide after operation implements, the substrate as the objective for implementation of this operation is made a video recording, obtain the 1st step that generates image;

To becoming the substrate of shooting object in above-mentioned the 1st step, state the next operation that institute decide operation on the implementation and make a video recording once more afterwards, obtain the 2nd step of generation image;

Extract the difference between 2 width of cloth images that obtain in above-mentioned the 1st step and the 2nd step, the 3rd step of utilizing this extraction result that the window that is used to check position, institute bonding part is imposed a condition and determines.

2, inspecting substrate as claimed in claim 1 is with the definite method that imposes a condition of window, it is characterized in that, in above-mentioned the 1st step, when the substrate after the solder printing is made a video recording, in the 2nd step, parts are installed this substrate afterwards make a video recording, in the 3rd step, based on the position and the size that extract the zone of difference between above-mentioned 2 width of cloth images, the parts inspection is determined with imposing a condition of window.

3, inspecting substrate as claimed in claim 2 is with the definite method that imposes a condition of window, it is characterized in that, in above-mentioned the 3rd step, comprise: extract the step of the printing zone of emulsus scolding tin the image of the substrate after the above-mentioned solder printing, the step of above-mentioned parts inspection being proofreaied and correct with position of window based on the position relation of the printing zone of above-mentioned relatively emulsus scolding tin.

4, inspecting substrate as claimed in claim 1 is with the definite method that imposes a condition of window, it is characterized in that, in above-mentioned the 1st step, when the substrate after the parts installation is made a video recording, in the 2nd step, this substrate after the butt welding soldering connects is made a video recording, in the 3rd step, based on the position and the size that extract the zone of difference between above-mentioned 2 width of cloth images, the butt welding soldering connects inspection and determines with imposing a condition of window.

5, inspecting substrate as claimed in claim 4 is with the definite method that imposes a condition of window, it is characterized in that, above-mentioned the 3rd step comprises: extract the step in the zone of exposing substrate quality color the image of the substrate after the welding of above-mentioned scolding tin, the step of the window of the inspection usefulness of above-mentioned scolding tin welding being proofreaied and correct based on the extraction result of aforesaid substrate quality color region.

6, inspecting substrate as claimed in claim 1 is with the definite method that imposes a condition of window, it is characterized in that, in above-mentioned the 1st step, when the substrate after the solder printing is made a video recording, in the 2nd step, parts are installed this substrate afterwards make a video recording, in the 3rd step, with comprise in the difference that in above-mentioned 2 width of cloth images, extracts fixed unique point as benchmark, determine that the butt welding soldering connects to check imposing a condition with window.

7, a kind of inspecting substrate is with the definite method that imposes a condition of window, it is the component installation state that is used to check substrate, to being set in to the aforesaid substrate method that inspection on the gained image determines with imposing a condition of window of making a video recording, it is characterized in that, implemented through the following steps:

To various parts, the standard of registering the size data that comprises these parts is respectively checked the 1st step of data;

Parts are installed substrate before make a video recording, obtain the 2nd step of the image of generation;

To the substrate of the shooting object that becomes above-mentioned the 2nd step, obtain it and after parts are installed, make a video recording once more and the 3rd step of the image that generates;

Extract the difference between 2 width of cloth images that obtain in the 2nd step and the 3rd step, each size in zone and above-mentioned standard that extracts difference is checked that the size data in the data compares, the 4th step of specific and above-mentioned zone corresponding components;

Based on the position and the size in the specific zone of corresponding component in above-mentioned the 4th step, the 5th step that the parts inspection is determined with imposing a condition of window.

8, a kind of substrate inspecting method, it is a method of checking the scolding tin welded condition of substrate, it is characterized in that, implements following steps:

Substrate after the butt welding soldering connects is made a video recording, and obtains the 1st step of the image of generation;

Substrate to the shooting object that becomes above-mentioned the 1st step was made a video recording before the scolding tin welding, obtained the 2nd step that generates image;

Extract the difference between 2 width of cloth images that obtain in above-mentioned the 1st step and the 2nd step,, determine 3rd step that impose a condition of scolding tin welding inspection with window based on the position and the size in the zone that extracts difference;

Based on imposing a condition of in above-mentioned the 3rd step, determining, on the image of substrate after the above-mentioned scolding tin welding, set inspection and use window, utilize the view data in this window to implement the 4th step that the scolding tin welded condition is checked.

9, a kind of substrate inspecting method is a method of checking the scolding tin welded condition of substrate, it is characterized in that, implements following steps:

Expression is checked each position component on the substrate of object and variety of components the installing component data, check the 1st step that data are registered with the standard of the inspection of the scolding tin welded condition that relates to various parts;

Substrate after the butt welding soldering connects is made a video recording, and obtains the 2nd step of the image of generation;

Substrate to the shooting object that becomes above-mentioned the 2nd step was made a video recording before the scolding tin welding, obtained the 3rd step that generates image;

Extract the 4th step of difference between 2 width of cloth images that obtain in above-mentioned the 2nd step and the 3rd step;

Each has been registered the position that extracts the zone of difference in the position component data of above-mentioned installing component data and above-mentioned the 4th step compared, corresponding to the 5th specific in addition step of the zone of each parts on the substrate;

Based on corresponding component in above-mentioned the 5th step the position and the size in specific zone, the butt welding soldering connects the 6th step that imposes a condition and determine of the window of checking usefulness,

Based on imposing a condition of in above-mentioned the 6th step, determining, on the image of substrate after the above-mentioned scolding tin welding, set the inspection window, utilize the interior view data of this window and check data with the standard of this window corresponding components, the butt welding soldering connects the 7th step that inspection is implemented at the position.

10, the generation method of the inspection data used of a kind of inspecting substrate, it is the method that generates the inspection data of the component installation state that is used to check substrate, it is characterized in that, implements following steps:

For each parts, respectively the standard that contains these component sizes data is checked the 1st step that data are registered;

Parts are installed substrate before make a video recording, obtain the 2nd step of the image of generation;

To becoming the substrate of above-mentioned the 2nd step shooting object, after installing, parts make a video recording once more, obtain the 3rd step of the image of generation;

Extract the difference between 2 width of cloth images that obtain in above-mentioned the 2nd step and the 3rd step, each size in zone and above-mentioned standard that extracts difference is checked that the size data in the data compares, corresponding to the 4th in addition specific step of the parts of above-mentioned zone;

Based on corresponding component in above-mentioned the 4th step the position and the size in specific zone, determine parts inspection imposing a condition with window, simultaneously, generate corresponding inspection data are set up in the standard inspection data and the above-mentioned inspection of above-mentioned corresponding component with window the 5th step.

11, a kind of base board checking device, it is a device of checking the component installation state of substrate, it is characterized in that, comprising:

Input block is installed the 1st image-input device of metacoxal plate image;

To the substrate after the above-mentioned parts installation, before this substrate installing component, make a video recording the 2nd image-input device of the image that input generates;

For specific substrate, the difference extraction element that the image differences that above-mentioned each image-input device of the 1st, the 2nd is imported is extracted;

Based on the position and the size that extract the zone of difference with above-mentioned difference extraction element, determine the impose a condition definite device that impose a condition of parts inspection with window;

The memory storage that imposes a condition and stored of the above-mentioned definite window of definite device that imposes a condition;

During the image of the substrate after installing with above-mentioned the 1st image-input device input checking object parts, based on imposing a condition that above-mentioned memory storage is stored, the window setting device of set parts inspection usefulness window on this input picture;

Utilize the view data in the window of setting by above-mentioned window setting device, parts are implemented the inspection device for carrying out said of checking.

12, a kind of base board checking device, it is a device of checking the scolding tin welded condition of substrate, it is characterized in that, comprising:

The 1st image-input device of the substrate image after the scolding tin welding of input checking object;

For the substrate after the above-mentioned scolding tin welding, before this substrate scolding tin welding, make a video recording the 2nd image-input device of the image that input generates;

Extract the difference extraction element of the difference between 2 width of cloth images that above-mentioned each image-input device of the 1st, the 2nd imports;

Based on the position and the size that extract the zone of difference by above-mentioned difference extraction element, set the window setting device of scolding tin welding inspection on the image of the substrate after above-mentioned scolding tin welding with window;

Utilize view data in the window of setting by above-mentioned window setting device, the butt welding soldering connects the inspection device for carrying out said that state is implemented inspection.

Images