JP4963284B2 - Standard data creation method - Google Patents

Description

  The present invention relates to a method of creating reference data used when inspecting an inspection object.

  Generally, when inspecting the formation state of a printed circuit board or the like, the surface image is acquired by a camera, and the formation state of the printed circuit board is determined by comparing with a reference data.

  When the reference data is created by such an automatic visual inspection apparatus, normally, reference data such as the entire shape and wiring pattern is created in advance and stored in the storage unit. When many appear, a library corresponding to the area is created, and reference data corresponding to the area is stored in the storage unit in the storage unit (Patent Document 1, Patent Document 2, etc.). Here, the “reference data” is data stored in advance at the time of inspection, and is used by comparing with data obtained from an inspection object to be inspected. The reference data is generated from a printed circuit board that is determined to be a non-defective product by visual inspection or other automatic inspection apparatus, or is generated from CAD data used when generating the printed circuit board.

  FIG. 6 shows the structure of reference data in a conventional automatic inspection apparatus. In the figure, reference numeral 41 denotes overall reference data. The entire reference data is reference data relating to a wiring pattern, silk, resist, and the like that appear only once on the printed circuit board, in addition to the size and outer shape of the printed circuit board. Reference numeral 42 denotes a library, which is reference data used in common when a large number of the same area appears in the printed circuit board. This library is provided independently for each common area, and is stored in association with the corresponding area of the entire area.

When the inspection object is inspected, an image of the printed circuit board is acquired by a camera, and the overall shape, wiring pattern, and the like are determined by comparing with the entire reference data. At this time, for a common area that appears many times, the library associated with the area is referred to, and the quality of the area is determined by comparing with the reference data stored in the library.
JP 2006-330003 A JP 2006-250610 A

  However, when the reference data is created by the library as described above, the following problems occur.

  First of all, in the method of creating a library for each common area and storing the reference data, prepare a reference data creation screen for each library and create the reference data individually according to the screen (or Edit). However, in such a method, since a screen for creating reference data must be prepared for each library, cost and labor are required. In addition, the reference data must be created by displaying another reference data creation screen for each different area, which complicates the work and takes time.

  Furthermore, when the reference data is created using an individual screen for each library, the area corresponding to the library is located at any position in the whole, and at what position the entire inspection area is positioned. Since it is difficult to sensuously judge whether there is any, there is a problem that it is difficult to grasp the whole image of the reference data.

  Accordingly, the present invention has been made paying attention to the above-mentioned problems, and provides a reference data creation method that enables creation of reference data while grasping the overall image at a low cost and with a simple operation. Objective.

  That is, in order to solve the above problems, the present invention provides a reference data creation method for creating reference data used for inspection of an inspection object based on an image acquired from the reference object. To create reference data based on the first display area for displaying the acquired wide area image, the second display area for displaying a partial area of the wide area image, and the image displayed in the second display area And receiving the selection of a part of the image displayed in the second display area to display the image displayed in the second display area in the first display area, An image of the selected partial area is displayed in the second display area, and creation of reference data is accepted based on the image displayed in the second display area A.

  In this way, it is possible to create a nested structure from the wide area image to the reference data for a part of the image in order, and create these reference data on a common screen. Compared to the case, the reference data can be easily created. In addition, since the reference data can be created while grasping the position of the corresponding region in the whole image, the reference data can be created while grasping the whole image. Further, since it is not necessary to start up a screen for creating reference data for each library as in the prior art, the input work becomes easier and the time for creating reference data can be shortened.

  In such an invention, when the image of the area selected in the second display area is displayed in the second display area, the selected area is enlarged and displayed in the second display area.

  In this way, it is possible to solve the problem that the image becomes smaller and the reference data cannot be created as it proceeds to the lower floor in the nested structure, and the image becomes blurred when the image is enlarged and displayed. If the reference data cannot be created, it can be reflected in work such as increasing the resolution and acquiring an image again.

  Furthermore, an area corresponding to the area displayed in the second display area is displayed separately from the other areas in the first display area.

  In this way, it is possible to easily grasp where the image displayed in the second display area is located in the wide area image, and create the reference data by judging the overall positioning and importance To be able to.

  According to the present invention, in the reference data creation method for creating the reference data used for the inspection of the inspection object from the image acquired from the reference object, the display displays the wide area image acquired from the reference object. A display area, a second display area for displaying a partial area of the wide area image, and a reference data creation area for creating reference data based on the image displayed in the second display area, By accepting selection of a part of the image displayed in the second display area, the image displayed in the second display area is displayed in the first display area, and the selected part of the area is displayed. When displaying the image in the second display area and accepting the creation of the reference data based on the image displayed in the second display area. Compared to easily it is possible to create a reference data. In addition, since the reference data can be created while grasping the position of the corresponding region in the whole image, the reference data can be created while grasping the whole image. Further, since it is not necessary to start up a screen for creating reference data for each library as in the prior art, the input work becomes easier and the time for creating reference data can be shortened.

  Hereinafter, an embodiment of the present invention will be described with reference to the drawings. FIG. 1 shows an outline of an appearance inspection system 1 in which this reference data creation method is used, and shows a reference data creation device 2 and an automatic appearance inspection device 3. FIG. 2 shows functional blocks of the appearance inspection system 1.

  The appearance inspection system 1 includes a reference data creation device 2 and an automatic appearance inspection device 3, and stores reference data created by the reference data creation device 2 in a storage unit 27 (see FIG. 2). The stored reference data and the data obtained by the automatic visual inspection apparatus 3 are compared so that the quality of the inspection object 4b can be determined. In this appearance inspection system 1, the reference data creation device 2 includes an image acquisition unit 21 that acquires a surface image of a reference object 4 a that is a non-defective product, and reference data based on the image acquired by the image acquisition unit 21. And a computer 22 to be created. The computer 22 may be a general-purpose personal computer or a dedicated computer used only for creating reference data. Alternatively, the automatic visual inspection apparatus 3 may be used as a computer having a display unit, an input unit, etc., but at least a display 23, an input device 24 such as a keyboard / mouse, a CPU, a ROM, a RAM, etc. Provide equipment. Based on the image of the reference object 4 a acquired from the image acquisition unit 21, reference data for each region is created and stored in the storage unit 27.

  On the other hand, the automatic appearance inspection apparatus 3 is configured to automatically inspect the formation state of the inspection object 4b. The stacker 31 accumulates a plurality of inspection objects 4b and the stacker 31 one by one. Determination is performed based on the transfer mechanism 32 that places the inspection object 4b on the stage and conveys it to the image acquisition unit 34, and the image acquired from the image acquisition unit 34, and the inspection object 4b is determined based on the determination result. And a collection mechanism 33 for sorting and collecting. Then, when inspecting based on the image of the inspection object 4b acquired by the image acquisition unit 34, the image is A / D converted, and the image is divided and extracted for each region, and obtained from the divided image. By comparing the received data with the reference data stored in advance in the storage unit 27, it is possible to make a pass / fail judgment.

  In such an appearance inspection system 1, the reference data creation device 2 realizes the function shown in FIG. 2 by cooperating the camera, the display 23, the CPU, the storage device, the input device 24, and the like.

  First, the image acquisition unit 21 acquires a surface image from the reference object 4a with a camera, and the surface of the reference object 4a under substantially the same condition as that acquired by the automatic visual inspection apparatus 3 for the inspection object 4b. Get an image. That is, the image is acquired from the surface by setting the light irradiation angle, the image acquisition resolution, the distance to the inspection object 4b, and the like set by the automatic appearance inspection apparatus 3 to be substantially the same. As this camera, a CCD line sensor or a CMOS sensor or the like is used. When images are acquired with these cameras, images are acquired in black and white or full color.

  The image acquired by the image acquisition unit 21 is subjected to processing such as A / D conversion by the preprocessing unit 25 and stored in the storage unit 27 as image information having information such as luminance and RGB.

  The reference data creation means 26 creates reference data for each area based on the image data stored in the storage unit 27. At this time, when a printed circuit board is used as the reference object 4a, an image is separated for each pattern, pad, resist, silk, or the like formed on the surface, and for each pattern, pad, resist, or silk. Create reference data. When creating the reference data for each area, first, as shown in FIG. 3, for example, a wide area image such as an entire image is displayed on the first display area 231 on the left side of the display 23. Selection of a part of the area in the wide area image is accepted by the mouse or the like. Here, it is assumed that a rectangular area A in the wide area image is selected by the mouse or the like after the “area selection” button 235 is pressed. This region A shows a region including a high-density surface mounting package (QFP) in which lead pins are drawn from four sides of the IC package, and is a region appearing at a plurality of locations on one printed board. When the area A is selected in this way, an enlarged image of the area is displayed in an enlarged state in the second display area 232 on the display 23, and a reference is made based on the image displayed in the second display area 232. Accept creation of data. When creating reference data, the user assigns identification information to the selected area A, and creates individual reference data in the reference data display area 233 for the assigned area. At this time, for the area A of the package (QFP), for example, reference data such as the size and shape of the package (QFP) and the allowable luminance width of the pixels in the area are set by the user. Next, after the QFP reference data is created, similarly, selection of an image in a specific area from the images displayed in the second display area 232 is accepted, and the data is displayed in the second display area 232 until now. The displayed image is displayed in the first display area 231, and the image of the area selected this time is enlarged and displayed in the second display area 232 as shown in FIG. FIG. 4 shows a state in which the region B in FIG. 3 is selected and the region selection button 236 is pressed. A region B in FIG. 3 shows a lead pin of the package (QFP). When the region B is selected, an enlarged image of the selected lead pin is displayed in the second display region 232 as shown in FIG. To display. Similarly, reference data is created in the reference data display area 233 based on the shape and size of the lead pin, and the reference data is stored in the storage unit 27. Further, in this work, when the same pattern repeatedly appears, the same reference data is assigned to the same region. When assigning the same reference data, selection of the same area is accepted in the first display area 231 and the same identification information is assigned to the accepted area. Hereinafter, similarly, the selection of the image of the specific area from the images displayed in the second display area 232 is accepted, and the image displayed in the second display area 232 so far is displayed in the first display area 231. The area received this time is enlarged and displayed in the second display area 232. Then, reference data is created based on the image displayed in the second display area 232. That is, first level reference data for a wide area image is created as a nested structure, second level reference data is created for a part of the image, and third part reference data is created for the part of the image. Create reference data for the hierarchy. Here, the case of creating the reference data up to the third hierarchy has been described. However, the lower level reference data may be created by performing the same operation below.

  The reference data created by the reference data creating means 26 in this way is stored in the storage unit 27 as a hierarchical structure having a nested structure as shown in FIG. 5, and when the reference data is edited later or automatically This is read when the appearance inspection apparatus 3 performs an appearance inspection.

  When editing the already created reference data, the wide area image stored in the storage unit 27 is read out and displayed in the first display area 231 and the selection of a part of the area is accepted. Then, the enlarged image of the selected area is displayed in the second display area 232 and the reference data of the area displayed in the second display area 232 is displayed in the reference data display area 233. At this time, in order to be able to specify the area displayed in the second display area 232 in the first display area 231, for example, a rectangular frame is attached and displayed in the first display area 231. When there are a plurality of areas corresponding to the reference data, the corresponding area is displayed in the first display area 231 with a rectangular frame. Then, after editing the reference data for the wide area image, when editing the reference data in the lower layer from the image displayed in the second display area 232, the image displayed in the second display area 232 is selected from the images displayed in the second display area 232. Selection of a part of the area is accepted, and an enlarged image corresponding to the accepted area is displayed in the second display area 232. Then, the image that has been displayed in the second display area 232 until now is displayed in the first display area 231, and the reference data corresponding to the selected area is read from the storage unit 27 and displayed on the reference data creation screen. At this time, if there are a plurality of areas corresponding to the reference data to be edited, a rectangular frame is attached to the corresponding area and displayed in the first display area 231.

  Next, the configuration of the automatic visual inspection apparatus 3 that inspects the inspection object 4b using the reference data created in this way will be described.

  First, the storage unit 36 of the automatic visual inspection apparatus 3 reads and stores the reference data stored in the storage unit 27 of the reference data creation apparatus 2. When the reference data is read from the storage unit 27 of the reference data creation device 2, the reference data may be temporarily stored in a portable storage medium, and the reference data may be read and stored from the storage medium. You may enable it to read using networks, such as the internet and LAN.

  The image acquisition unit 34 acquires a surface image of the inspection object 4b by a camera, irradiates light from an oblique direction, and acquires a surface image by a camera such as a CCD line sensor provided directly above. As described above, the image acquisition unit 34 acquires an image from the inspection object 4b under substantially the same conditions as the image acquisition unit 21 of the reference data creation device 2.

  Similar to the preprocessing unit 25 of the reference data creation device 2, the preprocessing unit 35 performs A / D conversion on the image acquired by the image acquisition unit 34 and stores it as image information having luminance, RGB, and the like.

  The determination unit 37 divides the acquired image for each specific area, and determines whether the formation state is good for each of the divided areas. At this time, for example, when inspecting the formation state of the printed circuit board, an image of an exposed pad or a wiring pattern is extracted from the high luminance area, and images such as silk and resist are extracted toward the low luminance area. And about the extracted area | region, first, the formation state test | inspection is performed about the whole area | region, and a detailed inspection is performed by narrowing down an inspection area | region sequentially below. When the entire area is inspected, the inspection is performed using the first layer reference data stored in the storage unit 27, and the second layer or third layer reference data is used for the narrowed area. Inspect.

  The determination result output unit 38 outputs that it is “defective” when there are several locations determined to be defective by the determination unit 37, and “non-defective product” is output for the other inspection objects 4b. Is output. Based on the output result, the transfer mechanism 32 is driven, and the inspection object 4b is sorted and collected in a collection box for each non-defective product or defective product.

  As described above, according to the above embodiment, the reference data for the enlarged region is nested from the reference data for the wide area image, and the creation of these reference data can be performed on a common screen. Compared to creating reference data independently, it is easier to create a screen for creating reference data, and create reference data for a specific area in the enlarged image while grasping the position in the entire image. Therefore, the reference data can be created while grasping the whole image. Furthermore, since it is not necessary to start up a screen for creating reference data for each library as in the prior art, the input work becomes easier and the time for creating reference data can be shortened.

  Further, when an image of the area selected in the second display area 232 is displayed in the second display area 232, the selected area is enlarged and displayed in the second display area 232. If you can not solve the problem that it becomes difficult to create the reference data because the image becomes smaller as you progress to the hierarchy, and if you can not create the reference data due to the image blurring when enlarged display, It becomes possible to reflect this in work such as obtaining an image with a higher resolution.

  Furthermore, since the area corresponding to the area displayed in the second display area 232 is displayed separately from the other areas in the first display area 231, it is displayed in the second display area 232. It is possible to easily grasp where an existing image is located in the wide-area image, and it is possible to create reference data by judging the overall positioning and importance compared with others.

  In addition, this invention is not limited to the said embodiment, It can implement in a various aspect.

  For example, in the above-described embodiment, the case of inspecting the formation state of a printed circuit board pad, wiring pattern, silk, resist, etc. has been described as an example. It can be used for a wide variety of inspections such as inspection of the printing state of chips, characters and figures.

  In the above embodiment, the first display area 231 and the second display area 232 are displayed on the same screen. However, when the display 23 is large, the screens up to the third layer are displayed simultaneously. Also good. At this time, the third and subsequent layers may be similarly displayed in the third display area by the data nesting structure.

  Furthermore, in the above-described embodiment, a minute region is further enlarged as it proceeds to the lower layer, but if the enlargement process is repeated, the image may be blurred. In such a case, the image up to the lower layer may be displayed without creating the reference data first. If the image is blurred, the resolution may be increased and the image taken again.

  In addition, in the above embodiment, the reference data creation device 2 and the automatic appearance inspection device 3 are configured separately. However, the automatic appearance inspection device 3 may be used to create reference data. Good. In this case, the reference data creation device 2 becomes the automatic visual inspection device 3 in relation to the present invention.

The figure which shows the outline | summary of the external appearance inspection system in one embodiment of this invention The figure which shows the functional block of the external appearance inspection system in the form The figure which shows the example which displayed the image of the 1st hierarchy and the 2nd hierarchy of the reference | standard data creation apparatus in the same form The figure which shows the example which displayed the image of the 2nd hierarchy of the reference | standard data creation apparatus in the same form, and a 3rd hierarchy The figure which shows the hierarchical structure of the reference data in the same form The figure which shows the structure of the reference data in the conventional example

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Appearance inspection system 2 ... Reference | standard data creation apparatus 21 ... Image acquisition part 22 ... Computer 23 ... Display 24 ... Input device 25 ... Pre-processing part 26 ... Reference | standard Data creation means 27 ... storage unit 231 ... first display area 232 ... second display area 233 ... reference data display area 3 ... automatic visual inspection device 31 ... stacker 32 ... Transfer mechanism 33 ... Recovery mechanism 34 ... Image acquisition unit 35 ... Pre-processing unit 36 ... Storage unit 37 ... Determination unit 38 ... Determination result output unit 4a ... Reference object 4b ... Inspection objects

Claims (3)

In a reference data creation method for creating reference data used for inspection of an inspection object based on an image acquired from the reference object,
Based on a first display area for displaying a wide area image acquired from a reference object on the display, a second display area for displaying a partial area of the wide area image, and an image displayed in the second display area A reference data creation area for creating reference data
By accepting selection of a part of the image displayed in the second display area, the image displayed in the second display area is displayed in the first display area, and the selected part of the area is displayed. A reference data creation method, wherein an image is displayed in the second display area, and creation of reference data is received based on the image displayed in the second display area.   The reference data according to claim 1, wherein when the image of the area selected in the second display area is displayed in the second display area, the selected area is enlarged and displayed in the second display area. How to make.   The reference data creation method according to claim 1, wherein an area corresponding to an area displayed in the second display area is displayed separately from other areas in the first display area.

Images