JP2013080524A - Image comparison device and image comparison program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image comparison device and an image comparison program capable of easily and accurately carrying out an image comparison test.SOLUTION: An image comparison device 10 includes image reading means 11 and 16 for generating first image data and second image data by reading an image serving as a reference and an image to be tested with the substantially same resolution; image display means 11 and 12 for making a flap display of the first image data and the second image data on a screen; and difference point extracting means 11 for comparing the first image data with the second image data to detect the difference between both image data, and when the difference exceeds a predetermined threshold, determining that there is a difference point in a region where the difference exists, and making a marking display on the flap-displayed image data. Marking displayed on the image data is configured to be freely added/deleted by operations of a pointing device 15.

Description

  The present invention relates to an image comparison apparatus and an image comparison program, and more particularly to an image comparison apparatus and an image comparison program capable of easily and accurately performing an image comparison inspection.

  Conventionally, an image comparison inspection is performed in which two images are compared to inspect their identity. As one method of such an image comparison inspection, it is known that two images are overlapped and displayed alternately, and the difference between the two images is found by the human eye by a visual afterimage effect. (The term “tilting display” in the present specification and claims indicates a state in which images are displayed alternately.)

  As another method, a method is also known in which an image comparison inspection is performed by extracting a difference by superimposing a comparison image on a reference image and marking the difference with a frame.

  As prior art documents disclosing this type of technology, for example, there are Patent Documents 1 and 2 below.

JP-A-8-184953 JP 2002-252751 A

  However, since it is necessary to extract differences between images by tilt display with the human eye, the time and fatigue burden on the inspector is large, and the inspection accuracy varies depending on the skill level of the inspector. There was a problem of end.

  On the other hand, when an image comparison inspection by marking display is performed by a person, there is a variation in inspection accuracy setting by an inspector. Therefore, in order to solve this problem, automatic marking display is performed by computer processing based on numerical data such as the amount of difference between the two images, such as brightness, saturation, and hue, and the amount of deviation of images and characters. Attempts to do so have also been proposed. However, with regard to marking display by computer processing, the conditions such as illumination when acquiring an image and the conditions of the image to be inspected differ individually, so the threshold value as a judgment condition is changed every time the inspection condition is changed. Must be set again. Therefore, the automatic inspection using a computer also has a problem that much time and effort are required to ensure a certain accuracy.

  The present invention has been made in view of the above-described problems, and an object thereof is to provide an image comparison apparatus and an image comparison program capable of easily and accurately performing an image comparison inspection.

  The image comparison apparatus according to the present invention displays first and second image data created as data representing an image to be inspected and second image data created as data representing an image to be inspected. An image comparison apparatus that automatically extracts the difference between the first image data and the second image data, wherein the reference image and the image to be inspected are substantially the same. Image reading means for generating the first image data and the second image data by reading at a resolution, and an image display for displaying the first image data and the second image data on the screen. A difference between the image data by comparing the first image data and the second image data, and an area where the difference exists when the difference exceeds a predetermined threshold Differences A difference extracting unit configured to mark displayed on the image data being tilting displayed determined that, characterized in that it comprises a.

  In the image comparison apparatus according to the present invention, it is preferable that the marking displayed on the image data is configured to be freely added / deleted by operating a pointing device.

  Further, in the image comparison apparatus according to the present invention, when the marking displayed on the image data is added or deleted by the operation of the pointing device, the threshold value set for performing the marking display until then is It can be configured to be freely changeable in conjunction with addition / deletion by the operation of the pointing device.

  Furthermore, in the image comparison apparatus according to the present invention, the threshold value only at a place where the marking is added or deleted can be configured to be changeable.

  Furthermore, the image comparison apparatus according to the present invention may further include a noise determination unit that acquires an area where the difference exists or the shape of the difference and determines whether the difference is due to noise. .

  Furthermore, in the image comparison apparatus according to the present invention, the first image data and the second image data are displayed on the screen before or after the first image data and the second image data are displayed. It is possible to provide a pre-adjusting means for adjusting by the filtering process.

  The image comparison program according to the present invention displays first and second image data created as data representing an image to be a reference and second image data created as data representing an image to be inspected. An image comparison program for automatically extracting the difference between the first image data and the second image data, wherein the computer substantially omits the reference image and the image to be inspected. An image reading step for generating the first image data and the second image data by reading at the same resolution, and displaying the first image data and the second image data on the screen. When a difference between both image data is detected by comparing the first image data and the second image data in the image display step, and the difference exceeds a predetermined threshold value Characterized in that to execute the processing including, a difference extracting step of causing the marking display is determined that there are differences in the image data being tilt displayed the existence region of said differences.

  In the image comparison program according to the present invention, it is preferable that the marking displayed on the image data can be added and deleted by operating a pointing device.

  ADVANTAGE OF THE INVENTION According to this invention, the image comparison apparatus and image comparison program which can implement an image comparison test | inspection easily and correctly can be provided.

It is an external view which shows one Example of the image comparison apparatus which concerns on this embodiment. It is a block block diagram of the image comparison apparatus shown in FIG. It is a conceptual diagram for demonstrating the image comparison test | inspection implemented by using the image comparison apparatus which concerns on this embodiment. It is a processing flow figure implemented by running the image comparison program concerning this embodiment.

  DESCRIPTION OF EXEMPLARY EMBODIMENTS Hereinafter, preferred embodiments for carrying out the invention will be described with reference to the drawings. The following embodiments do not limit the invention according to each claim, and all combinations of features described in the embodiments are not necessarily essential to the solution means of the invention. .

  FIG. 1 is an external view showing an example of an image comparison apparatus according to this embodiment. FIG. 2 is a block diagram of the image comparison apparatus shown in FIG.

  The image comparison apparatus 10 according to this embodiment includes a personal computer main body 11, a CRT display 12 connected to the personal computer main body 11, a mouse 13, a keyboard 14, a pointing device 15, and a CCD camera 16.

  The personal computer main body 11 has a built-in CPU 11a. The CPU 11a sequentially reads and interprets a sequence of instructions called a program on the main memory 11b, and performs the operation of the image comparison apparatus 10 according to the result. ing. Note that the program temporarily stored in the main memory 11b includes software for image comparison inspection, and in addition to a dedicated computer system, Web-compatible application software can be adopted as this software. It has become.

  The CPU 11a is connected to the image control unit 11d, the CCD control unit 11e, the operation input unit 11f, and the image memory 11g via the bus 11c, and can exchange data and programs with external peripheral devices. It can be done. More specifically, the image control unit 11d controls the screen of the CRT display 12, and the CCD control unit 11e stores image data captured by the CCD camera 16 in the image memory 11g and controls the operation of the CCD camera 16. It is possible to go. Further, the operation input unit 11f has a role of transmitting input signals from the mouse 13, the keyboard 14, and the pointing device 15 to the CPU 11a, and transmitting and controlling an operation command to the image comparison apparatus 10. In addition to a general CCD (Charge Coupled Device) camera, the CCD camera 16 may employ a CMOS camera, various line sensors, special image sensors, or an input device that digitally converts an analog camera image. It is.

  In the image comparison apparatus 10 having the above-described configuration, “image data” or “inputable subject” is assumed as an image for comparison inspection. That is, “image data” in this specification means an image created from a CAD device or the like, or vector data such as postscript data from CAD or DTP from RIP or the like, and an image created by a CPU and various application software. Data is converted into a file such as PDF, TIFF, Bitmap, JPEG, or PICT. On the other hand, the “inputable subject” in this specification refers to a PDF that is input by any other image input device such as a scanner or a digital camera, an MRI of a medical image device, or an X-ray device, or converted after input. Files such as TIFF, Bitmap, JPEG, PICT, DAICOM. The term “image data” in the claims includes both the “image data” and the “inputable subject”.

  Subsequently, the contents of the image comparison inspection using the image comparison apparatus 10 according to the present embodiment will be described with reference to FIGS. 1 to 3. Here, FIG. 3 is a conceptual diagram for explaining an image comparison inspection performed by using the image comparison apparatus according to the present embodiment.

  First, in the image comparison apparatus 10 according to the present embodiment, a reference image is captured by the CCD camera 16, and the first image data 31 obtained from the captured image is stored in the image memory 11g. Next, an image to be inspected is photographed by the CCD camera 16, and second image data 32 obtained from the photographed image is stored in the image memory 11g. That is, the first image data 31 and the second image data 32 are first generated by using the personal computer main body 11 and the CCD camera 16 as image reading means. At this time, it is preferable that the reference image and the image to be inspected are read with substantially the same resolution.

  The two image data 31 and 32 are stored in advance in the image memory 11g of the personal computer main body 11, and the first image data or the second image data is transmitted via the image memory 11g or the network line. Alternatively, both image data can be called up. In the case of the “inputable subject” described above, two images to be compared are captured from the CCD camera 16, and the brightness, saturation, hue, contrast (or the like) are compared using comparison software temporarily installed in the main memory 11b. It is also possible to prepare inspection accuracy values such as misregistration in advance and perform comparison between multi-valued or binarized data. Furthermore, the “inputable subject” can be stored in the image memory (storage device) 11 g of the personal computer main body 11 in advance.

  In addition, when the image data 31 and 32 to be compared are digital data, or in the case of an output product from a laser printer, an ink jet printer, or an X-ray or MRI, the color and material of the output material, the reflectance, the output device Depending on the type, device output settings, output accuracy variations, and the like, a situation may occur in which the thickness of an image or line segment differs. As described above, when the image data 31 and 32 to be compared have different image quality and line segment thickness, the first image data 31 and the second image data 32 are displayed in a superimposed manner on different image layers, and the whole or By pointing one or more specific parts with the pointing device 15, image quality adjustments such as color tone (brightness, saturation, hue, contrast), etc., and each image or line segment is adjusted to be thicker or thinner. It is also possible to perform predetermined image processing such as predetermined filtering processing and color management processing for color tone adjustment. As a specific method for realizing such image processing, by using the personal computer main body 11 as a pre-adjustment unit, the image data 31 and 32 to be compared are adjusted with an intermediate value of the thickness difference. Alternatively, the first image data 31 can be matched with the image / line segment of the second image data 32, or the second image data 32 can be matched with the image / line segment of the first image data 31. .

  Next, the first and second image data 31 and 32 stored in the image memory 11g are displayed on the screen by using the CRT display 12 as an image display means. A display image of the two image data displayed in a tilted manner is indicated by reference numeral 33 in FIG.

  As for the method of image polymerization as indicated by reference numeral 33 in FIG. 3, techniques such as feature point polymerization, one-point polymerization, multi-point polymerization, and matrix division sequential polymerization are already known, and these known techniques are used. This can be achieved. The image comparison apparatus 10 according to the present embodiment extracts brightness, saturation, hue, positional deviation, and the like between the two image data 31 and 32 to be compared by using comparison software, and multi-value or A comparison between the binarized data is performed, a difference between the image data 31 and 32 is detected, and a difference exists in an area where the difference exists when a preset threshold value (inspection accuracy value) is exceeded. Marking display is performed on image data that is determined to be present and displayed in a tilted manner. These processes are realized by the personal computer main body 11 serving as the difference extraction means, the comparison software installed in the CPU 11a and the main memory 11b, and a specific form of the marking display obtained as a result of the process is represented by reference numeral 33. Is a boxed display as indicated by reference numeral 34 in the tilt display image data indicated by.

  As described above, the first-stage image comparison is performed by using a preset threshold value. However, in the image comparison apparatus 10 according to the present embodiment, it is displayed on the image data as the second stage. The marking 34 can be added / deleted by operating the pointing device. Specifically, since the two image data 31 and 32 displayed on the screen of the CRT display 12 are displayed on the screen, the inspector can easily view both the image data 31 and 32 by viewing the screen. It is possible to detect a difference between 32.

  Here, for example, when no marking is displayed at a location where a difference exists, the marking 34 can be added to the difference point on the screen by operating the pointing device 15. Furthermore, in the image comparison apparatus 10 according to the present embodiment, when the marking 34 displayed on the image data is added by the operation of the pointing device 15, the threshold value set for performing the marking display until then is set, It can be automatically changed in conjunction with the marking addition operation by the operation of the pointing device 15. In other words, the threshold value is optimized based on the image data at the location where the marking 34 is added. Therefore, according to the image comparison apparatus 10 according to the present embodiment, the optimum threshold value for the image data that is the subject of the comparison inspection at the present time can be easily set. Therefore, an image comparison apparatus that is easy and has high accuracy is realized.

  In addition, when the marking 34 is added by the pointing device 15 as described above, it is considered that the threshold value set in advance is large and the difference point is overlooked. On the contrary, it is set in advance. It is also conceivable that the threshold value is too strict and the marking is displayed even in a portion that is not practically determined to be a difference. Specifically, it is like a boxed display indicated by the reference numeral 35 in the tilt-displayed image data indicated by the reference numeral 33 in FIG. In such a case, the operator deletes the erroneous marking 35 by operating the pointing device 15, so that the threshold value is automatically changed in conjunction with the deletion operation, and the practical inspection accuracy is improved from the next time. It is possible to perform an image comparison inspection with a certain threshold.

  The specific contents of the image comparison inspection using the image comparison apparatus 10 according to the present embodiment have been described above. Next, the processing contents of the image comparison program used for realizing the above-described image comparison inspection will be described with reference to FIGS. 1 to 4. Here, FIG. 4 is a processing flowchart executed by executing the image comparison program according to the present embodiment.

  First, in the image comparison processing according to the present embodiment, a reference image is captured by the CCD camera 16, and the first image data 31 obtained from the captured image is stored in the image memory 11g (step S40).

  Next, an image to be inspected is photographed by the CCD camera 16, and the second image data 32 obtained from the photographed image is stored in the image memory 11g (step S41). Through the processing from step S40 to step S41 (image reading step), acquisition of the first image data 31 that is the reference image and the second image data 32 that is the inspection target image is completed.

  Thereafter, color management processing for color tone adjustment is executed (step S42). The color management process is performed when there is a color error between the first image data 31 that is a reference image and the second image data 32 that is an image to be inspected although the image is originally the same image. This color error is regarded as the same. In this color management process, the first image data 31 and the second image data 32 are generally compared by using a color chart. Then, the color management process is executed by generating a profile that compensates for the difference and using this profile as the color management profile.

  Next, the first and second image data 31 and 32 stored in the image memory 11g are used by using the color profile whose color tone has been adjusted in the process of step S42 by using the CRT display 12 as the image display means. Then, it is displayed on the screen (step S43; image display step).

  Then, an inspection reference value is set at the stage where it is displayed on the screen (step S44), and a predetermined filtering process is performed (step S45). This filtering process is a process performed to correct these differences when the image data 31 and 32 to be compared have different image quality and line segment thickness. Specifically, the first image data 31 And the second image data 32 are superimposed on different image layers, and the whole or one or a plurality of specific parts are instructed by the pointing device 15 to adjust the image conditions such as thickness and thinness. It will be.

  After undergoing the above processing, the two image data 31 and 32 are superposed (step S46). A display image of the two superposed image data is indicated by reference numeral 33 in FIG. As for the method of image polymerization as indicated by reference numeral 33 in FIG. 3, techniques such as feature point polymerization, one-point polymerization, multi-point polymerization, and matrix division sequential polymerization are already known, and these known techniques are used. This can be achieved. Furthermore, repolymerization is also possible.

  In the image comparison processing according to the present embodiment, brightness, saturation, hue, positional deviation, and the like between the two image data 31 and 32 to be compared are extracted by using comparison software, and multi-valued or binary. A pixel comparison between the binarized data is performed, and a difference between both the image data 31 and 32 is detected. When a preset threshold value (inspection accuracy value) is exceeded, a difference exists in an area where the difference exists. It is determined that there is a marking, and marking is displayed on the image data displayed in a tilted manner (step S47; difference extraction step). A specific form of the marking display obtained as a result of these processes is a boxed display as indicated by reference numeral 34 in the tilt display image data indicated by reference numeral 33.

  As described above, image comparison in the first stage (step S40 to step S47) is performed by using a preset threshold value. In the image comparison processing according to the present embodiment, second image comparison is performed. As a stage, the markings 34 and 35 displayed on the image data can be added / deleted by operating the pointing device 15 (step S48). If the operator does not add or delete the markings 34 and 35 at this stage, it is considered that the preset threshold value is correct, and the image comparison inspection under the appropriate setting conditions is performed as it is. Will continue.

  On the other hand, when the operator adds or deletes the markings 34 and 35 (step S48), the preset threshold value is changed and stored in an optimum manner in conjunction with the marking 34 and 35 changing operation. (Step S49). By this processing, the subsequent image comparison inspection is executed with the optimum threshold value.

  Through the above processing, it is possible to realize an image comparison process that is easy to operate and has high accuracy, which could not be realized by the prior art.

  As mentioned above, although preferred embodiment of this invention was described, the technical scope of this invention is not limited to the range as described in the said embodiment. Various modifications or improvements can be added to the embodiment.

  For example, a process for removing noise (noise determination step) can be added to the image comparison process described above. That is, in the case of comparative inspection using multi-valued image data of “inputtable subject” and “image data”, the image edge of the image portion to be marked is not clearly blurred, and the degree of blurring within a few dots is extremely small. (Large computer or special purpose computer) and software, and after superimposition, only one of the subject images that can be input contains an image with a few edges of the sweet image (for example, blurring that occurs during imaging) Therefore, it is determined that the image data is not noise, and the threshold value is also changed in conjunction with this operation. Alternatively, when the image edge of only one of the image data portions is clear, it is determined that the noise is other than the input image information, and the threshold value is not converted in conjunction with this operation. An extremely small-sized image obtained through the lens system has an image blur different from that of the pixel obtained from the data. Therefore, it is effective to perform such processing.

  In addition, the process of storing the shape of dust and dust in advance in the memory of a computer, and separating the dust and dust from those that have the same shape, improves the accuracy of the image comparison inspection. It is effective in.

  Further, when performing image comparison, only one or N portions selected from one image can be comparatively inspected. In addition to the purpose of shortening the inspection time, such an inspection method can be used to realize an inspection with an optimum accuracy according to the comparison target such as a barcode, a character or an image. .

  Further, a plurality of threshold values obtained by repeating the image comparison inspection are registered and held as control data for subsequent inspections, and necessary control data is selected from the plurality of threshold values when performing the same image comparison inspection. It is suitable to use.

  Furthermore, before the two image data 31 and 32 are displayed on the screen (step S43; image display step), the image data 31 and 32 to be compared are adjusted by the intermediate value of the thickness difference, or the first Predetermined filtering such as aligning the image / line segment of the second image data 32 with the image data 31 of the image, or aligning the image / line segment of the first image data 31 with the second image data 32 It is also preferable to add a process (preliminary adjustment step). For example, when the image data 31 and 32 to be compared are digital data, or in the case of an output product from a laser printer, an ink jet printer, or an X-ray or MRI, the color and reflectance of the output material, the type of output device, and the device Depending on the output setting and output accuracy variation, the thickness of the image or line segment may vary. Therefore, by executing the pre-adjustment step as described above, it is possible to correct variations and the like existing between the two image data 31 and 32, so that the accuracy of the image comparison inspection can be easily improved. Become.

  In the above-described embodiment, the case where there is one second image data 32 that is an inspection target image has been described as an example. However, a plurality of second image data 32 that are comparative inspection target images are included. Even so, the present invention can be applied.

  Furthermore, a plurality of threshold values of the present invention can be set for one set of comparison target image data. For example, it is possible to divide the area in the image data and set a threshold value for each of the divided areas, and change the threshold value only for the divided areas where the markings 34 and 35 are added or deleted. is there. By adopting such a configuration, an image comparison apparatus with higher inspection accuracy can be realized.

  Furthermore, a plurality of patterns of threshold values are set in advance for a plurality of sets of comparison target image data, different threshold patterns are designated for each set of comparison target image data, and these are subjected to image comparison inspection by batch processing. Can be executed continuously.

  Furthermore, in the above-described embodiment, the case where a dedicated terminal indicated by reference numeral 15 is installed as a pointing device has been described as an example. However, the pointing device according to the present invention can be substituted by the mouse 13. .

  In the above-described embodiment, the case where the main memory 11b and the image memory 11g are provided as separate HDDs (storage devices) has been described as an example. However, these may be configured as one HDD (storage device). It is. In the above-described embodiment, the case where the comparison software used for the difference extraction unit is installed in the main memory 11b is described as an example. However, the comparison software is not installed in the main memory 11b. It can also be used for temporary reading.

  Furthermore, the comparative inspection process according to the present invention can be performed via a network. Specifically, it is also possible to perform comparison inspection from within the company or from a remote place by acquiring image data to be compared through the same or different networks.

  Furthermore, in the above-described embodiment, the case where the first image data 31 and the second image data 32 are acquired by the CCD camera 16 is exemplified. However, these image data are three-dimensional data such as CAD. Or postscript data from the DTP.

  It is apparent from the description of the scope of claims that embodiments with such changes or improvements can be included in the technical scope of the present invention.

  An image comparison apparatus and an image comparison program according to the present invention include, for example, CAD drawings, architectural exterior images, maps / aerial photographs, satellite photographs, medical examination images, various company documents, contract documents, patent documents, printed materials, packages It can be suitably used for image comparison inspection in the fields of various production lines such as home appliances / electronic devices or parts, and cars. The prints, films, and output materials that can be output as comparative inspection targets at this time are printed materials, home appliances / electronic equipment bases or parts, automobiles and other industrial products or parts, human bodies, people, faces, and impressions. Any inputable subject such as agricultural products, cloths, fluids, animals and plants, buildings, terrain, etc. shall be included.

  DESCRIPTION OF SYMBOLS 10 Image comparison apparatus, 11 Personal computer main body, 11a CPU, 11b Main memory, 11c Bus, 11d Image control part, 11e CCD control part, 11f Operation input part, 11g Image memory, 12 CRT display, 13 Mouse, 14 Keyboard, 15 Pointing device, 16 CCD camera, 31 1st image data, 32 2nd image data, 33 Display image of two image data displayed side by side, 34, 35 Marking.

Claims (8)

By first displaying the first image data created as data representing the reference image and the second image data created as data representing the image to be inspected, the first image data and the first image data are displayed. 2 is an image comparison device that automatically extracts differences from the image data of 2.
Image display means for displaying the first image data and the second image data on a screen;
The first image data and the second image data are compared to detect a difference between the two image data, and when the difference exceeds a predetermined threshold, the difference exists in an area where the difference exists. A difference extraction means for performing marking display on the image data displayed in a tilted manner,
A pointing device that operates the marking display according to an operation input,
The difference comparison means comprises: adjusting the threshold based on a marking display operation by the pointing device. The image comparison apparatus according to claim 1,
The image comparison apparatus, wherein the marking displayed on the image data is configured to be freely added / deleted by operating the pointing device. The image comparison apparatus according to claim 2,
When the marking displayed on the image data is added or deleted by the operation of the pointing device, the threshold set for performing the marking display is linked to the addition / deletion by the operation of the pointing device. An image comparison apparatus characterized by being configured to be freely changeable. The image comparison apparatus according to claim 3.
The image comparison apparatus according to claim 1, wherein the threshold value only at a place where the marking is added or deleted is configured to be changeable. In the image comparison device according to any one of claims 1 to 4,
An image comparison apparatus comprising: a noise determination unit that acquires an area where the difference exists or the shape of the difference and determines whether the difference is caused by noise. In the image comparison device according to any one of claims 1 to 5,
A pre-adjustment unit that adjusts the first and second image data by a predetermined filtering process before or after displaying the first image data and the second image data on the screen; An image comparison apparatus. By first displaying the first image data created as data representing the reference image and the second image data created as data representing the image to be inspected, the first image data and the first image data are displayed. An image comparison program for automatically extracting differences from the image data of
On the computer,
An image display step for displaying the first image data and the second image data on a screen;
The first image data and the second image data are compared to detect a difference between the two image data, and when the difference exceeds a predetermined threshold, the difference exists in an area where the difference exists. A difference extraction step for determining that there is a marking on the image data displayed in a tilted manner,
A marking display operation step of operating the marking display according to an input from a pointing device;
An image comparison program, comprising: a threshold adjustment step of adjusting the threshold based on the marking display operation step. In the image comparison program according to claim 7,
An image comparison program characterized in that the marking displayed on image data can be freely added and deleted by operating the pointing device.

Images