JP2009003839A - Image processing device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image processing device for properly handling displacement of an image as an inspection reference for re-registration. <P>SOLUTION: When a displacement occurs between the image as the inspection reference for the re-registration and an inspection image of an original inspection reference, when confirming that the displacement falls within a predetermined allowable range, an inspection area set to at least the original inspection image is positionally corrected according to the displacement, and the position-corrected inspection area is re-registered as a new inspection reference. Thus, since whether or not the displacement of the image as the inspection reference for re-registration falls within the allowable range can be confirmed, this image processing device can properly handle the displacement. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to an image processing apparatus that captures an image of a conveyed product with an image sensor and performs image processing on image data of the product.

  As shown in FIG. 1, an image pickup device (such as an image sensor) is conventionally used at a shooting timing when a product P is detected by, for example, the synchronization sensor S while moving a number of products P one after another on the conveyor C. The imaging data of the label attached to, for example, the product P captured by the imaging camera 1) is image-processed, and the photographed image of the label of the product P is compared with the inspection image that is the inspection reference image. An image processing apparatus for inspecting pass / fail is known.

  By the way, the appearance of the product P changes due to changes in ambient light and illumination light at the time of photographing, changes in the label printing state, etc., and the product P itself is displaced due to vibration of the conveyor C, etc. When the image is re-registered (saved), positional deviation may occur from the original inspection image.

  In this case, conventionally, the position of the inspection area set for the inspection image or the inspection image remains the same, and the camera or product is finely adjusted so as to match the inspection image (for example, Patent Document 1). ).

On the other hand, it is also known to set the inspection area in a new inspection image by correcting the position of the inspection image or the inspection area in accordance with the displacement of the inspection image (for example, Patent Document 2).
JP-A-11-191840 JP 2002-288633 A

  However, in Patent Document 1, it is difficult to fine-tune the camera or product so that it matches the inspection image while the production line is in operation. If the production line is stopped and fine-tuned, the production efficiency decreases. To do.

  Further, in Patent Document 2, when an image serving as an inspection standard for re-registration deviates from an unexpected position, it is not possible to appropriately cope with this, and the production line is also stopped and re-registered. As a result, production efficiency decreases.

  SUMMARY OF THE INVENTION An object of the present invention is to provide an image processing apparatus that solves the above-described problems and can appropriately cope with a positional deviation of an image serving as an inspection standard for re-registration.

  In order to achieve the above object, an image processing apparatus according to the present invention performs image processing on imaging data of a product photographed by an imaging device, and compares the photographed image of the product with an inspection image that is an inspection standard image. An image processing apparatus for inspecting the quality of a product, and when re-registering an inspection standard, between an image that is a re-registration inspection standard among the captured images of the product and an inspection image of the original inspection standard If the positional deviation is confirmed to be within a predetermined allowable range, at least the inspection area set for the original inspection image is corrected according to the positional deviation, and a new An inspection standard re-registration control unit that performs control for re-registering the position-corrected inspection region as a proper inspection standard is provided.

  According to this configuration, when there is a positional deviation between the image serving as the inspection reference for re-registration and the inspection image based on the original inspection standard, the positional deviation is confirmed to be within a predetermined allowable range. Then, at least the inspection area set for the original inspection image is position-corrected according to the positional deviation, and the position-corrected inspection area is re-registered as a new inspection standard. Therefore, it is possible to check whether the image misregistration that is the inspection standard for re-registration is within an allowable range and appropriately deal with the misregistration, so that the production line is stopped and re-registered as in the past. Therefore, it is possible to prevent a decrease in production efficiency.

  Preferably, the inspection reference re-registration control means includes a position-corrected image search means for searching for a re-registered inspection reference image that matches the inspection image of the original inspection reference from the photographed image of the product, and the original inspection reference The position of the re-registered inspection reference image stored based on the degree of coincidence between the inspection image and the re-registered inspection reference image and the position of the original inspection reference inspection image When it is confirmed that a positional deviation amount detecting means for detecting a deviation amount, a positional deviation range checking means for confirming whether or not the positional deviation amount is within a predetermined allowable range, and that the positional deviation amount exceeds the allowable range. The re-registration is canceled, and when it is confirmed that the value is within the allowable range, the inspection reference position correcting unit that uses the inspection area corrected according to the amount of positional deviation from the original inspection area as a new inspection reference; , The position corrected detection And a test reference reregistration means for re-registering the region as a new inspection standard. Accordingly, it is possible to more appropriately cope with the positional deviation of the image that is the inspection standard for re-registration.

  Preferably, the inspection standard to be re-registered is an inspection image that is an image of the inspection reference and an inspection region set for the inspection image. Therefore, it is possible to appropriately re-register the inspection image and the inspection area according to the change of the product type.

  Preferably, the misregistration range confirmation means displays the permissible range of misregistration on the monitor by manual operation and confirms it, and automatically confirms based on a threshold value that defines the permissible range of misregistration. Is set to Therefore, the inspection standard can be re-registered appropriately according to the re-registration situation.

  Preferably, the position-corrected image search means searches for an image serving as a re-registration inspection standard having the highest degree of coincidence with the original inspection standard inspection image, and the positional deviation amount of the searched image satisfies the allowable range. If it is confirmed by the misregistration range confirmation means that the image has exceeded the original inspection standard inspection image, the image having the next highest matching score is searched. Next, the amount of positional deviation between the position of the image with the next highest degree of coincidence and the position of the original inspection reference inspection image is detected. Therefore, even when the re-registration inspection area deviates from an unexpected position, it is possible to cope more appropriately.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
FIG. 2 is a block diagram showing the image processing apparatus according to the first embodiment of the present invention. This apparatus captures image data obtained by imaging an image sensor (imaging camera) 1 such as an image sensor on the product P conveyed by the conveyor C shown in FIG. As shown in FIG. 2, the image processing includes an imaging device (imaging camera) 1 and an image memory 2 that stores imaging data captured by the imaging device 1, and performs image processing on imaging data of the product P Unit 3 and inspection standard re-registration control means 10.

  The product P in FIG. 1 is, for example, food stored in a case, and the inspection target portion of the product P is a product label on which characters such as the expiration date, manufacturing location, and manufacturing time of the food are printed on the case. The apparatus determines the quality of the product P by detecting characters such as the expiration date in the product label and the positional deviation of the product label.

  The inspection standard re-registration control means 10 in FIG. 2 is positioned between the image that is the re-registered inspection standard among the captured images of the product P and the original inspection standard inspection image when re-registering the inspection standard. In the case where there is a deviation, when it is confirmed that the positional deviation is within a predetermined allowable range, at least the inspection area set for the original inspection image is corrected according to the positional deviation, and a new inspection is performed. As a reference, control is performed to re-register the inspection area whose position has been corrected.

  This inspection standard re-registration control means 10 stores an image registration command unit 4 for instructing registration of an inspection image (reference image) that is an inspection standard image, and the position of the inspection image (reference image) that is an inspection standard image. An inspection image registration unit 5 for performing inspection and an inspection region registration unit 6 for storing the size and position of the inspection region are provided.

  Further, the inspection standard re-registration control means 10 converts all the pixel coordinates from the captured image of the product P to an image (reference image to be corrected) that is a re-registered inspection standard that matches the inspection image of the original inspection standard. Re-registered image search means 7 for searching from and an image for correcting the position of the inspection area as a position correction result based on the degree of coincidence between the original inspection standard inspection image and the searched image as the re-registration inspection standard A misalignment processing means 8 is provided. In this example, the position of the inspection area is corrected using the pixel coordinates of the image with the highest degree of matching as the position correction result. The determination unit 9 determines the quality of the product P by comparing the photographed image of the product P with the inspection image in the corrected inspection region.

  As shown in FIG. 3, the image misregistration processing means 10 includes a misregistration amount detection means 11, a misregistration range confirmation means 12, and an inspection reference position correction means 13. The misregistration amount detection means 11 includes the re-registration inspection standard stored based on the degree of coincidence (highest coincidence) between the inspection image of the original inspection standard and the searched image as the re-registration inspection standard. The amount of positional deviation between the position of the image to be detected and the position of the original inspection reference inspection image is detected. The misregistration range confirmation unit 12 confirms whether or not the misregistration amount is within a predetermined allowable range. The inspection reference position correcting means 13 stops the re-registration when it is confirmed that the amount of positional deviation exceeds the allowable range, and the position from the original inspection area when it is confirmed that the amount is within the allowable range. The inspection area whose position is corrected according to the amount of deviation is set as a new inspection standard. In this case, only the inspection area is re-registered as a new inspection standard and the inspection image is not re-registered, but the inspection image may be re-registered in addition to the inspection area.

  An example of the inspection area re-registration operation in the apparatus having the above configuration will be described with reference to the flowchart of FIG. In advance, the position of the original inspection image is stored in the inspection image registration unit 5, and the size and position of the original inspection region are stored in the inspection region registration unit 6.

  First, when the re-registration operation starts, an image (reference image) having the highest degree of coincidence is searched from the captured image obtained by photographing the product P, and the position is stored (step S1). Next, a displacement amount between the position of the original inspection image and the position of the reference image of the stored captured image is extracted (step S2).

  Next, it is confirmed whether the displacement amount is within a predetermined allowable range and whether the position of the inspection region may be corrected according to the displacement amount (step S3). If it is within the allowable range (step S4), the position of the inspection area is moved according to the amount of displacement, and this is re-registered as a new inspection area (step S5), and the re-registration is terminated (step S6).

  A state within this allowable range is shown in FIG. (A) shows the original inspection image such as “ABC” and “123” and the inspection area set for the inspection image. (B) shows a state in which the position of the inspection region is corrected for, for example, “123” having the highest degree of coincidence according to the positional deviation of the reference image of the captured image. In this way, at the time of re-registering the inspection standard, the position of the new inspection region is corrected so as to follow the reference image whose position of the photographed image is shifted.

  If it is outside the allowable range in step S4, the re-registration is terminated (step S6). FIG. 6 shows a state outside this allowable range. In this case, since the inspection area protrudes outside the image range, it cannot be used as a new inspection area. Since this state is displayed on the monitor, it is confirmed based on this, and when this position is not adopted by manual operation, the re-registration is terminated without changing the original position. Instead of manual operation, the re-registration may be terminated by setting so as to be automatically confirmed based on a threshold value that defines an allowable range of the positional deviation amount.

  Thus, in the first embodiment, when there is a positional deviation between the image serving as the inspection standard for re-registration and the inspection image based on the original inspection standard, it is confirmed that the positional deviation is within a predetermined allowable range. The position of the inspection area set for at least the original inspection image is corrected according to the displacement, and the position-corrected inspection area is re-registered as a new inspection standard, and is confirmed to be out of the allowable range. When finished, re-registration is terminated. Therefore, it is possible to check whether the image misregistration that is the inspection standard for re-registration is within an allowable range and appropriately deal with the misregistration, so that the production line is stopped and re-registered as in the past. Therefore, it is possible to prevent a decrease in production efficiency.

  Next, a second embodiment will be described. Unlike the first embodiment, the second embodiment re-registers the next highest matching image as a reference image when the highest matching image is in an unexpected position and cannot be re-registered as a reference image. To do. That is, the position-corrected image search means 7 in FIG. 2 searches for an image as a re-registration inspection standard having the highest degree of coincidence with the inspection image of the original inspection standard, and the positional deviation amount of the searched image is the allowable amount. If it is confirmed by the misregistration range confirmation means 12 in FIG. 3 that it exceeds the range, an image having the next highest matching degree is searched for the original inspection standard inspection image, and the misregistration amount detection means 11 is detected. However, the amount of positional deviation between the position of the stored image having the next highest degree of coincidence and the position of the original inspection reference inspection image is detected. Other configurations are the same as those of the first embodiment.

  An example of the inspection area re-registration operation in the apparatus having the above configuration will be described with reference to the flowchart of FIG. Similarly to the first embodiment, the position of the original inspection image is stored in the inspection image registration unit 5 in advance, and the size and position of the original inspection region are stored in the inspection region registration unit 6 in advance.

  First, when the re-registration operation starts, an image (reference image) having the highest degree of coincidence is searched from the captured image obtained by photographing the product P, and the position is stored (step T1). Next, the amount of positional deviation between the position of the original inspection image and the position of the reference image of the stored captured image is extracted (step T2).

  Next, it is confirmed whether the positional deviation amount is within a predetermined allowable range and whether the position of the inspection area may be corrected according to the positional deviation amount (step T3). If it is within the allowable range (step T4), the position of the inspection area is moved according to the amount of displacement, this is re-registered as a new inspection area (step T5), and the re-registration is terminated (step T6).

  If it is out of the allowable range in step T4, an image (reference image) having the next highest matching score is searched from the captured image obtained by photographing the product P, and its position is stored (step T7). . Next, the amount of positional deviation between the position of the original inspection image and the position of the reference image having the next highest matching degree after the stored captured image is extracted (step T8).

  Next, it is confirmed whether the positional deviation amount is within a predetermined allowable range and whether the position of the inspection region may be corrected according to the positional deviation amount (step T9). If it is within the allowable range (step T10), the position of the inspection area is moved in accordance with the amount of displacement, this is re-registered as a new inspection area (step T5), and the re-registration ends (step T6). If it is outside the allowable range in step T10, the re-registration is terminated (step S6).

  A state within this allowable range is shown in FIG. “ABC” is the reference image of the photographed image with the highest degree of coincidence, and “123” is the reference image of the photographed image with the highest degree of coincidence. In this case, when “ABC” is in an unexpected position (not shown), the image “123” having the next highest matching score after “ABC” is searched for, and this is used as the reference image of the photographed image. As another candidate, it is confirmed whether the positional deviation amount is within a predetermined allowable range, and if it is within the allowable range, it is re-registered as a new inspection region.

  Thus, in the second embodiment, even when the reference image of the candidate captured image deviates from an unexpected position during the re-registration of the inspection standard, the reference image of another candidate captured image is used instead. Since the position is corrected so that the new inspection area follows, it is possible to appropriately cope with the positional deviation of the image serving as the inspection reference for re-registration.

  Next, a third embodiment will be described. Unlike the first embodiment, the third embodiment is a case where the product P is changed in type and the image serving as an inspection standard for re-registration is misaligned. In this case, the product P is inspected. The image and inspection area are re-registered. Other configurations are the same as those of the first embodiment.

  The re-registration state is shown in FIG. (A) shows the reference image to be re-registered. “124” is different from the original inspection image “123”. (B) shows a state in which the reference image to be re-registered is photographed with a positional shift, and (C) shows a state in which the positions of the inspection image and the inspection region are corrected according to the positional shift of the reference image of the photographed image. Indicates. As described above, at the time of re-registering the inspection standard, the position is corrected so that the new inspection image and the inspection region follow the reference image whose position of the photographed image is shifted.

  Thus, in the third embodiment, in accordance with the change in the type of the product P that is the inspection reference for re-registration and the positional deviation of the reference image of the photographed image, the inspection image and the inspection reference for the inspection area are appropriately re-registered, Can respond appropriately.

It is a block diagram which shows an image pick-up element, a conveyance conveyor, and an image processing apparatus. 1 is a block diagram illustrating an image processing apparatus according to a first embodiment of the present invention. It is a block diagram which shows the structure of the image position shift process means of FIG. It is a flowchart which shows operation | movement of the image processing apparatus of FIG. It is a figure which shows the re-registration state of a test | inspection area | region. It is a figure which shows the confirmation state of a test | inspection area | region. It is a flowchart which shows operation | movement of the image processing apparatus which concerns on 2nd Embodiment of this invention. It is a figure which shows the confirmation state of a test | inspection area | region. It is a figure which shows the re-registration state of the test | inspection image and test | inspection area | region of the image processing apparatus which concerns on 3rd Embodiment of this invention.

Explanation of symbols

1: Image sensor 5: Inspection image registration means 6: Inspection area registration means 7: Re-registered image search means 8: Image position deviation processing means 9: Determination unit 10: Inspection reference re-registration control means 11: Position deviation amount detection means 12 : Misalignment range confirmation means 13: Inspection reference position correction means P: Product

Claims (5)

An image processing device that performs image processing on imaging data of a product photographed by an imaging device, compares a photographed image of the product with an inspection image that is an inspection standard image, and performs an inspection of the quality of the product,
When the inspection standard is re-registered, if there is a positional deviation between the image that is the re-registered inspection standard among the captured images of the product and the inspection image of the original inspection standard, the positional deviation is a predetermined tolerance. Control that, when confirmed as being within the range, at least corrects the inspection area set for the original inspection image according to the positional deviation and re-registers the inspection area that has been corrected as a new inspection standard An image processing apparatus comprising inspection standard re-registration control means for performing In claim 1,
The inspection standard re-registration control means includes
A position-corrected image search means for searching a re-registered inspection reference image that matches the inspection image of the original inspection reference from the photographed image of the product;
The position of the image as the inspection standard of the re-registration stored based on the degree of coincidence between the inspection image of the original inspection standard and the searched image as the inspection standard of the re-registration, and the inspection image of the original inspection standard A positional deviation amount detecting means for detecting a positional deviation amount from the position;
A displacement range confirmation means for confirming whether or not the displacement amount is within a predetermined allowable range;
When it is confirmed that the amount of positional deviation exceeds the allowable range, re-registration is stopped, and when it is confirmed that the positional deviation is within the allowable range, the position is corrected from the original inspection area according to the amount of positional deviation. Inspection reference position correcting means using the inspection area as a new inspection reference;
Inspection standard re-registering means for re-registering the position-corrected inspection region as a new inspection standard;
An image processing apparatus. In claim 1,
An image processing apparatus in which the re-registered inspection standard is an inspection image that is an image of an inspection standard and an inspection region that is set for the inspection image. In claim 2,
The misregistration range confirmation means is set so that the permissible range of misregistration is displayed on a monitor by manual operation, and is confirmed automatically based on a threshold value that defines the permissible range of misregistration. An image processing apparatus. In claim 2, further:
The position-corrected image search means searches for an image as a re-registration inspection standard having the highest degree of coincidence with the inspection image of the original inspection standard, and the amount of positional deviation of the searched image exceeds the allowable range. When it is confirmed by the misalignment range confirmation means, it searches for an image having the next highest matching degree with the original inspection standard inspection image,
The image processing apparatus, wherein the misregistration amount detection means detects a misregistration amount between the position of the stored image having the next highest degree of coincidence and the position of the original inspection reference inspection image.

Images