JP2008218737A - Image processing device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To enable recording of only necessary part of a processed judgement image, and also enable correct judgement whether the recorded image is good or bad. <P>SOLUTION: It is judged based on image processing whether or not a component pin 26 is correctly inserted in a through hole of a printed circuit board 21. An OK mark is applied to an image (a) judged as good, and an NG mark is applied to an image (b) judged as bad. The NG mark is automatically applied to the bad image at a selected location away from a judgement target image so that the mark is not overlapped with the judgement target image. Only the image having the NG mark applied thereonto can be recorded by triggering the NG mark. Since the NG mark is not overlapped with the judgement target image, the NG mark avoids the hindrance of later good or bad judgement. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to an image processing apparatus capable of recording only necessary images, and more particularly to an image processing apparatus capable of recording only images that need to be analyzed for image processing results.

  For example, in manufacturing equipment for automobile parts and electronic parts, an image picked up by a video camera or the like is subjected to image processing to check the operation of the equipment or determine whether the product is good or bad (see Patent Document 1). An image processing unit that performs such image processing is generally built in equipment with the necessary functions in consideration of the purpose of use and the cost of installation, and a large amount of images captured from a video camera are used. Often you do not wait for the function to save. In such a case, it was impossible to check whether or not the image processing for determining good or bad was appropriate.

  However, it is possible to record the image displayed on the monitor screen on the hard disk of an external personal computer using the video capture function. After the image is recorded, the image recorded offline is read out, and the same image processing as the image processing determined to be defective is performed on the image determined to be defective. Judgment or misjudgment can be checked.

  However, some of the product assembly facilities such as the insertion of ICs into the board have, for example, a facility for processing 5,000 to 10,000 a day, and a large-capacity storage device is required to store all images. As a result, there is a problem that the cost is increased and a great effort is required to find an image judged to be defective, which needs to be checked.

  In other words, in the production line, image processing parameters are selected so as not to cause misjudgment and overjudgment. However, misjudgment, that is, judging that a defective product is non-defective will have a fatal effect on quality. In other words, there is a bias in determining an over-determination, that is, a non-defective product as a non-defective product. Therefore, reducing the number of excessive determinations leads to an increase in the efficiency of the production line. However, it is very difficult to retrieve the over-determined image later for checking if all the images are stored.

JP 2003-229699 A

  In view of the above problems, an object of the present invention is to provide an image processing apparatus that can store only necessary images among determined images and that can correctly perform later analysis.

  In order to achieve the object, the image processing apparatus according to claim 1, an imaging unit (11) that images the determination target (20), and a determination target image in the output image output from the imaging unit (11). Image processing means (15) for providing a mark indicating a determination result by the image processing at a position separated from the determination target image in the output image by a predetermined distance or more, and to the output image And a recording means (17) for performing image processing on the given mark to recognize the mark and recording an output image to which the mark is given.

  In the image processing apparatus according to claim 1, since the mark indicating the determination result by the image processing is recognized and the image is recorded, only the image that needs to be recorded can be recorded, and the mark does not overlap the determination target image. Since it is assigned to, it does not interfere with later image analysis.

  The image processing apparatus according to claim 2 is characterized in that the determination target is a part or a product flowing in a production line. According to this, it is possible to correctly evaluate the result of the image analysis for a part or product that has been excessively determined or erroneously determined in the production line.

  The image processing apparatus according to claim 3, wherein a plurality of the marks are provided corresponding to the types of the determination results, and the recording unit includes a plurality of files corresponding to the types of the determination results, and the output An output image having the mark added thereto is recorded in a file corresponding to the mark assigned to the image. According to this, since it is stored in a different file according to the determination result, it is easy to read and analyze an image corresponding to the specific determination result. In addition, a plurality of files can be arranged in a hierarchy, and the images are organized and stored, so that later use is easy.

  The image processing apparatus according to claim 4, wherein the mark includes a mark indicating a defect, and the image processing unit (15) determines whether the determination target is good or bad and at least determines that the defect is defective. The mark which shows is provided. Therefore, it is possible to record only an image determined to be defective, and it is not necessary to use a large-capacity recording means such as a hard disk, and the cost can be reduced.

  The image processing apparatus according to claim 5, wherein a plurality of marks indicating the defects are provided corresponding to the types of defects, and the image processing means (15) determines the types of defects and corresponds to the types of defects. The mark to give is given. Therefore, it is possible to identify the type of defect and analyze only the image determined as the defect, and it is possible to analyze the image processing more precisely.

  The image processing apparatus according to claim 6 is characterized in that the mark is composed of at least one selected from a character, a figure, and a color. Thereby, the visibility of a mark can be improved and the error which misidentifies a mark can be reduced. Furthermore, it is possible to easily cope with cases where there are many types of defects.

  The image processing apparatus according to claim 7 is characterized in that the mark is given to a location selected from a plurality of predetermined locations (41 to 44) of the output image. According to this, since the place where the mark is arranged is determined in advance, the process for recognizing the mark can be simply configured, and since the selection is made from a plurality of places, the place that does not overlap with the determination target image can be selected. Can do.

  The image processing apparatus according to claim 8, wherein the plurality of predetermined portions include four corners of the output image. According to this, when the image to be judged is usually captured in the center of the screen and the image to be judged is shifted to the upper, lower, left and right of the output image, it is possible to easily select the location to which the mark is added. .

  The image processing apparatus according to claim 9 is characterized in that the mark is provided at a position farthest from the determination target image. According to this, since a mark is given to a part farthest from the determination target image, it is easy to specify a part that does not overlap the determination target image.

  The image processing apparatus according to claim 10, wherein the recording unit (17) can execute the same image processing as the image processing performed by the image processing unit, and reads an output image to which the mark is added. The image processing executed by the image processing means is analyzed by executing the image processing. If it does in this way, analysis will become possible by a recording means, and an image check can be performed simply.

  In addition, the code | symbol of drawing which wrote in parentheses about the component of this invention is an example explaining a response | compatibility with the specific means of embodiment described below.

  Embodiments of the present invention will be described below with reference to the drawings.

  FIG. 1 shows an image processing apparatus according to an embodiment of the present invention. The image processing apparatus 10 includes: a CCD camera 11 that is an imaging unit that images a determination target 20 that determines good or bad by image processing; an image processing unit 13 that processes an image output from the CCD camera; A monitor 15 having a monitor screen 15s for displaying the image is provided.

  Further, in the present embodiment, the image processing apparatus 10 includes a capture unit 17 having a capture screen 17s made of a personal computer (PC), and an image signal from the image processing unit 13 is transmitted via the branch connector 14 and the video capture adapter 16. Then, the image is recorded in the image file 18 in the hard disk of the capture means 17.

  In the present embodiment, it is determined by image processing whether or not the pin 26 of the component 25 such as a connector is correctly inserted into the through hole of the printed wiring board 21. In this case, the determination target 20 that is also an imaging target is around the pin 26 and the through hole. Note that a light source 32 connected to a power source 31 is disposed to illuminate the determination target 20.

  FIG. 2 shows an example of image processing by the image processing means 13 of this embodiment, and shows a monitor and an image displayed on the monitor. The monitor 15 is arranged for monitoring or confirmation by the operator, and includes a screen 15s and a knob or button 15b for adjusting the brightness of the screen 15s, contrast, or power on / off. On the screen 15s, images subjected to online image processing and judged to be good or bad are displayed one after another. The image displayed on the screen 15s is an image in which it is determined whether or not the pin is normally inserted into the through hole of the printed wiring board.

  FIG. 2A shows an image in which the pins 26 are normally inserted into the through holes of the printed wiring board 21. The fact that the substantially central portion of the screen 15s of the monitor 15 is shown in white is due to the reflection of the pin 26, and indicates that the pin 26 is inserted normally. The white ring around the pin 26 is due to the reflection of the land 23 for soldering around the through hole. The dark shadow on the land on the left side of the figure is a shadow caused by the inserted pin 26 and is caused by the illumination for imaging.

  The image output from the imaging camera 11 is input to the image processing means 13, and the image processing means 13 calculates the center of gravity of the pin 26 and the center of gravity of the land 23 in the image and determines whether or not they match. To do. In FIG. 2A, the center of gravity of the pin 26 and the center of the land 23 coincide with each other, and “OK” is displayed as an OK mark indicating good determination in the lower right corner 44 of the screen 15s.

  FIG. 2B shows a case where the pin 26 is not normally inserted into the through hole of the printed wiring board 21. The position of the land 23 is shifted to the lower right of the screen, the part surrounded by the land is dark, and the pin cannot be seen. This occurs when the position of the pin of the component and the position of the through hole of the printed wiring board do not match at all and the pin 26 is not inserted, for example, when the selection of the printed wiring board to be used is wrong. Many. In the case shown in FIG. 2B, since the pin is not shown in the first place, the center of gravity of the pin cannot be calculated, and it is determined to be defective.

  In FIG. 2B, the NG mark indicating that it is defective is different from the position of the OK mark shown in FIG. 2A, and “NG” is displayed as the NG mark in the upper right corner 42 of the screen 15s. . As will be described in detail later, in the present embodiment, the NG mark is not disposed at a fixed position, but is automatically disposed at a position that is not less than a predetermined distance away from the determination target image and does not overlap. Therefore, it does not interfere with the image analysis for checking the suitability of the later determination. In the present embodiment, the OK mark is displayed in green and the NG mark is displayed in red to improve visibility.

  The OK mark is not necessary when only an image determined to be defective is captured, and in some embodiments, the OK mark is not added. However, when the parameter is changed as a result of the analysis of the defective image, it is necessary to examine the influence on the image determined to be good, and it is necessary to record the image with the OK mark added. In such a case, if the OK mark is captured as a trigger, an image determined to be good can be recorded. Since an image determined to be good does not deviate greatly, the OK mark may be arranged at a fixed position that does not overlap with the image to be normally determined as shown in FIG. However, when it is necessary to analyze a good-determined image offline, as in the case of the NG mark, it is not arranged at a fixed position, but is selected and arranged so as not to interfere with subsequent checks. It is good to do so.

  5 (a) and 5 (b) are reference examples, and the defects when the marks are arranged at fixed positions will be described with reference to this reference example. In FIG. 6A, an image determined to be good is displayed on the screen 15s of the monitor 15, and an OK mark is displayed in the lower right corner of the image displayed on the screen 15s. FIG. 5A is the same as FIG. 2A, and there is no particular problem. On the other hand, as shown in FIG. 5B, when the NG mark is displayed at the lower right corner of the image determined to be defective, the NG mark overlaps the image to be determined.

  If an image to which an NG mark is added is stored, the NG mark is also subjected to image processing when an image processing is executed later for a check for analyzing the suitability of image processing. In this case, it is impossible to perform image processing on an image that is actually determined to be NG on-line, and it is impossible to perform appropriate or inappropriate analysis of image processing. For example, if an algorithm that calculates the center of gravity of the target image and determines good / bad based on the position of the center of gravity is used, the center of gravity position is calculated including the NG mark. Cannot be done.

  In the present embodiment, the NG mark given to the image determined to be defective is arranged at a position away from the determination target image by a predetermined distance so as not to interfere with the subsequent image processing check. Therefore, it is possible to read an image stored off-line and check whether or not there has been an excessive determination due to an error such as an image processing condition. Further, when the capture device recognizes the NG mark, the NG mark does not overlap with the determination target, so there is an advantage that the NG mark can be easily recognized.

  Next, with reference to FIG. 3, a method for providing an NG mark will be described. FIG. 3 is a diagram illustrating a position where an NG mark of an image displayed on the monitor screen is displayed. Mark planned portions 41 to 44 that may be marked with NG marks are designated in advance at the four corners of the monitor screen 15s, that is, the upper left corner, the upper right corner, the lower left corner, and the lower right corner. An example of the center of gravity G of the determination target image 20 is shown, and the schematic shape of the determination target image is indicated by a virtual line.

  In the present embodiment, since the normal image is captured almost at the center of the screen, at least one of the four corners is the image to be analyzed even if it is defective in one direction from the center of the screen. Apart from, do not touch or overlap. Therefore, when an NG mark is placed, a place that is more than a predetermined distance away from the image to be determined is selected from the mark places 41 to 44 at the four corners, and the NG mark is placed at the selected place. Does not get in the way.

  In order to select the location where the NG mark is to be placed, first, the image of the pin 26 or the land 23 around the through hole, which is the determination target image, is processed to calculate the center of gravity of the pin or the land and calculate the center of gravity of the determination target image. Determine the position. Next, the distance from the centroid position of the determination target image to the centroid positions of the planned mark positions 41 to 44 at the four corners is calculated. As a result, a planned mark location where the calculated distance is more than a predetermined distance is selected. In FIG. 3, as an example, it is shown that the distance L1 between the center of gravity G of the determination target image and the center of gravity 42G of the planned mark portion 42 is larger than the predetermined distance L0. The predetermined distance L0 can be appropriately set according to the shape, size, shading, color, etc. of the determination target image so as to separate the determination target image from the planned mark portion to the extent that it does not interfere with the subsequent analysis. In the present embodiment, the distance between the determination target image and the planned mark location is the distance between the respective gravity center positions, but is not limited thereto. For example, the distance between the determination target image and the planned mark location can be obtained from a plurality of points on the boundary of the determination target image, and the minimum value can be calculated as the distance between the determination target image and the planned mark location.

  If there are a plurality of locations separated by a predetermined distance or more, the NG mark may be arranged at any location, but a location to be selected from the plurality of locations can be determined in advance. In the example of FIG. 2B, any of the three planned mark locations 41 to 43 may be used. However, if the planned mark location 42 can be selected, the planned mark location 42 may be selected as the NG mark placement location in advance. It is an example that has been decided. Alternatively, the distance from the center position of the determination target image to the center positions of the four corners 41 to 44 can be calculated, and the NG mark can be arranged at the planned mark location 41 at the farthest distance. Furthermore, it is also possible to give an NG mark to a place that is farthest from the center position of the determination target image without predetermining the planned mark location.

  A method of selecting a place to add the NG mark can be appropriately adopted in relation to the shape to be analyzed, that is, the determination target. For example, binarization processing may be performed on the four corner locations, and the brightest location may be designated to give an NG mark.

  In the present embodiment, when a good determination is made, the determination target image is picked up almost at the center of the screen, so that it is possible to determine in advance that the OK mark is arranged at the mark location 44, for example. In addition, when an OK mark is added and the OK mark is used as a trigger condition for capture, the subsequent image processing is not performed like the NG mark so that the subsequent image processing is not adversely affected by the OK mark. It is better to give an OK mark where it will not get in the way.

  In this embodiment, the capture means 17 that captures the image of the monitor 15 displays the same image as the image of the monitor screen 15s on the screen 17s, recognizes the NG mark on this image, and is given the NG mark. Capture only images. That is, a program equivalent to the image processing program installed in the image processing unit 13 is also installed in the capture unit 17, and an NG mark on the image displayed on the screen 17 s of the capture unit 17 may be arranged. An NG mark is recognized by performing image processing on a characteristic portion, and it is determined whether the image is to be recorded in a file.

  Furthermore, if the NG marks are made different according to the types of defects and stored in different storage files, NG images classified according to the types of defects can be accumulated, and later check or analysis can be performed. Can be executed efficiently. Furthermore, the types of defects may be classified into a hierarchical structure, and a storage file having a hierarchical structure corresponding to this may be formed. For example, the NG marks can be NG1 and NG2 corresponding to two types of errors, and the NG marks corresponding to the three types of errors can be NG11 to NG13 by further expanding NG1. The storage file can be formed corresponding to the NG marks NG1, NG2, and NG11 to NG13. In addition to alphanumeric characters, kanji and kana characters, the NG mark may be anything that can be distinguished from other figures such as ○ and △, such as red and green colors, and can be displayed on the screen. May be used.

  FIG. 4 is an example of a setting screen for setting a trigger condition serving as a trigger for capturing an image. As described above, the capture unit 17 records the image with the NG mark by recognizing the NG mark on the screen. In order to correctly recognize the NG mark by image processing, it is necessary to set a trigger condition for setting an image processing parameter. In order to set the trigger condition, an image with an NG mark stored in the file is displayed off-line on the screen of the capture means 17. In this embodiment, since the capture means is composed of a PC, the trigger condition setting screen shown in FIG. 4 can be displayed by selecting the trigger condition setting from, for example, the menu bar on the PC screen 17s. .

  As described above, in this embodiment, the red character “NG” is used as a mark indicating a defect. In order to recognize the red character “NG”, first, the red character is determined by the binarization threshold, the area is obtained from the total number of pixels constituting the character “NG”, and the coordinates of each pixel are obtained. The center of gravity of the character “NG” is obtained. Next, the determined area and the value of the center of gravity are compared with a preset area and the value of the center of gravity.

  In FIG. 4, the upper and lower limits of the binarization threshold, area, and center of gravity can be set. That is, in the binarization threshold determination box 51, a lower limit and an upper limit for binarizing the target image are determined. In the area determination box 52, a lower limit and an upper limit of the area where it can be determined that the target image is a preset image are determined. In the center-of-gravity determination boxes 53X and 53Y, the lower limit and the upper limit of the XY coordinates of the center of gravity with which it can be determined that the target image is a preset image are determined. When the values for the binarization threshold, the area, and the center of gravity are determined and the setting button at the upper right of the screen is pressed, the determined condition settings are read.

  Next, the character “NG” displayed on the display screen of the capture device 17 is input to the input image screen 541 in the processing confirmation box 54. When the execute button 542 is pressed, image processing is started for the character “NG” under the conditions set as the trigger conditions. When the image processing is completed, the result can be confirmed on the processing image screen 543. The calculated area and the numerical value of the barycentric coordinates are displayed in the result column 544.

  When the numerical value obtained by the image processing from the input image screen 541 is within the range of the set condition, the match confirmation box 545 is lit to indicate that there is a match. The number displayed in the trigger condition number box 55 indicates the condition number of the condition set on the screen. A plurality of trigger conditions can be set and can be stored with a number. If the trigger condition is not corrected, the execution result can be reflected in the setting by pressing the result reflection button 56. That is, the set condition can be stored and stored in the setting file as the fifth setting condition.

  As described above, in the present embodiment, only the image to which the NG mark is added is accumulated, and analysis by subsequent image processing can be executed accurately. In another embodiment, an image with an OK mark can be stored. In addition, even when three or more types of determination results appear, marks can be set corresponding to the three or more types of determination results, respectively, and a mark set like the NG mark of the present embodiment can be added to the image. it can. The stored file is also formed corresponding to the set mark.

It is a figure which shows one Embodiment of the image processing apparatus of this invention. It is a figure explaining provision of the NG mark by one Embodiment of this invention. It is a figure which shows the location which arrange | positions the NG mark of the monitor screen by one Embodiment of this invention. It is a figure which shows the setting screen which sets the trigger conditions which perform the capture by one Embodiment of this invention. It is a figure explaining the problem of the arrangement part of a NG mark.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 Image processing apparatus 11 Imaging camera 13 Image processing means 14 Branch connector 15 Monitor 15S Monitor screen 16 Video capture adapter 17 Capture means 17S Capture screen 18 Image file 20 Imaging object 21 Printed wiring board 25 Parts 26 Pin 31 Illumination power supply 32 Illumination 41 ~ 44 Mark planned location 50 Trigger condition setting screen

Claims (10)

Imaging means (11) for imaging the determination target (20);
A determination target image in the output image output from the imaging means (11) is determined by performing image processing, and the determination result of the image processing is shown at a position away from the determination target image by a predetermined distance or more in the output image. Image processing means (15) for providing a mark;
Recording means (17) for performing image processing on the mark given to the output image, recognizing the mark, and recording the output image with the mark;
An image processing apparatus comprising:   The image processing apparatus according to claim 1, wherein the determination target is a part or a product flowing in a production line.   A plurality of the marks are provided corresponding to the types of the determination results, and the recording unit has a plurality of files corresponding to the types of the determination results, and the files corresponding to the marks attached to the output image The image processing apparatus according to claim 1, wherein an output image to which the mark is added is recorded.   The mark includes a mark indicating a defect, and the image processing means (15) determines whether the determination target is good or not, and assigns a mark indicating the defect when it is determined to be defective at least. The image processing apparatus according to claim 1.   A plurality of marks indicating the defect are provided corresponding to the type of defect, and the image processing means (15) determines the type of defect and gives a mark corresponding to the type of defect. Item 5. The image processing apparatus according to Item 4.   The image processing apparatus according to claim 1, wherein the mark includes at least one selected from a character, a figure, and a color.   The image processing apparatus according to claim 1, wherein the mark is given to a location selected from a plurality of predetermined locations (41 to 44) of the output image. .   The image processing apparatus according to claim 7, wherein the plurality of predetermined portions include four corners of the output image.   The image processing apparatus according to claim 1, wherein the mark is given to a place farthest from the determination target image.   Further, the recording means (17) can execute the same image processing as the image processing executed by the image processing means (15), and reads out the output image to which the mark is added and executes the image processing. The image processing apparatus according to claim 1, wherein the image processing performed by the image processing unit is analyzed.

Images