WO2013118305A1

WO2013118305A1 - Image generation device, image generation method, and computer-readable recording medium having image generation program recorded therein

Info

Publication number: WO2013118305A1
Application number: PCT/JP2012/053190
Authority: WO
Inventors: 章太植木; 泰広上田
Original assignee: シャープ株式会社
Priority date: 2012-02-10
Filing date: 2012-02-10
Publication date: 2013-08-15

Abstract

An image processing system (100) comprising: an imaging position setting unit (31) that sets the imaging position for each captured image; an imaging control unit (33) that controls an imaging device (10) and an actuator (20) such that an imaging subject (P) is captured at each imaging position set by the imaging position setting unit (31); and a high-resolution image generation unit (37) that generates a high resolution image from a plurality of captured images captured at each imaging position set by the imaging position setting unit (31). The imaging position setting unit (31) sets each imaging position such that the imaging areas captured by the same imaging pixel in a solid-state imaging element (12) are not duplicated between the plurality of captured images.

Description

Image generating apparatus, image generating method, and computer-readable recording medium recording image generating program

The present invention relates to an image generation apparatus that generates an image having a higher resolution than a captured image based on the captured image, an image generation method, and a computer-readable recording medium that records the image generation program.

In recent years, measurements and inspections in industrial applications have been widely performed using solid-state imaging devices such as CCD (Charge Coupled Device) image sensors and CMOS (Complementary Metal Oxide Semiconductor) image sensors. Especially in applications where high frequency components need to be detected, such as inspection of scratches and foreign matter on silicon wafers, detection of minute detection objects in flat panel display (abbreviation "FPD") lighting inspection, etc. In this measurement and inspection, in order to improve the accuracy, it is required to obtain an image of an inspection (measurement) object with high resolution. Also, consumer cameras and the like have recently been requested to capture subjects with higher definition.

In response to such demands, development of solid-state imaging devices with increased pixel density has been underway. However, there is a limit to such a hardware approach, and there is a problem that the solid-state imaging device itself becomes more expensive as the pixel density is increased. Therefore, recently, a technique for generating an image (hereinafter, referred to as “high-resolution image”) having a higher resolution than an image captured by a solid-state imaging device (hereinafter, referred to as “captured image”) by image processing has been practically used. Has been.

For example, while shifting the position of the solid-state imaging device or the entire camera with respect to the imaging object by a minute amount, the imaging object is imaged at each position, and the pixel shifting method for combining the captured images at each position, or optical blurring. High resolution techniques such as a super-resolution technique for generating a high resolution image in consideration of the above have been put into practical use.

When using these high resolution technologies, it is necessary to perform imaging multiple times while shifting the relative position of the imaging object and the solid-state imaging device, but when the amount of movement of the imaging object or the solid-state imaging device increases, There are problems such as an increase in movement time, a decrease in movement position accuracy, and a decrease in the life of the actuator for movement. Therefore, when the relative position between the imaging object and the solid-state imaging device is shifted, imaging is conventionally performed while shifting the position by a minimum necessary distance.

Specifically, when a high-resolution image having three times the resolution of a captured image is generated using a solid-state image sensor in which imaging pixels (that is, pixels in the solid-state image sensor) are arranged in a matrix, solid-state imaging The element is imaged a total of nine times while shifting the position by 1/3 of the size of the imaging pixel along each arrangement direction of the imaging pixels, and a high-resolution image is generated by synthesizing the nine captured images. (For example, refer to Patent Document 1).

JP 2010-73035 A

Incidentally, it is known that in a solid-state imaging device, a defect is likely to occur in an imaging pixel due to a local crystal defect of a semiconductor or the like. For example, in a solid-state imaging device having a number of imaging pixels of about several millions, imaging pixels with defects (hereinafter referred to as “defective pixels”) may occur in the order of several pixels. In such a defective pixel, a constant bias voltage is always added to the imaging output corresponding to the amount of incident light, and normal imaging output cannot be performed. Therefore, in the image data output by such a solid-state imaging device, the luminance value of the pixel corresponding to the defective pixel is higher or lower than the normal value.

Therefore, if a solid-state imaging device having such defective pixels is used for detecting a detection target such as a minute scratch or a foreign object based on a captured image of the imaging target, There is a risk of overlooking.

Hereinafter, this problem will be described with reference to the drawings. FIG. 10 is a diagram illustrating an imaging region V by each imaging pixel when an imaging target is imaged by a solid-state imaging device having defective pixels. In FIG. 10, nine rectangular imaging areas V correspond to areas on the imaging surface captured by 3 × 3 vertical and horizontal imaging pixels arranged in a matrix in the solid-state imaging device. In particular, the imaging region v1 that is hatched corresponds to the region on the imaging target surface that is imaged by the defective pixel, and the imaging region v0 that is not hatched, that is, 8 around the imaging region v1. The two imaging areas v0 correspond to areas on the imaging surface captured by normal imaging pixels. Further, in FIG. 10, a minute detection target generated on the imaging target is shown with a reference mark U. The same applies to FIGS. 11A to 11D described later.

As described above, normal imaging output cannot be performed with defective pixels, and as shown in FIG. 10, when the detection target U is completely included in the imaging area v1 of the defective pixels, The detection target U cannot be detected. In this case, even if correction processing for the defective pixel is performed based on luminance value information captured and output by the normal imaging pixels around the defective pixel, the detection target object is present in the imaging region v0 of the normal imaging pixel. Since U is not included, the detection object U cannot be detected.

Although FIG. 10 illustrates the case where the pixel shifting method is not performed, the pixel shifting method that has been used conventionally, that is, the pixel shifting method that performs imaging while shifting the position by the minimum necessary distance is also employed. There is a possibility that a minute detection target generated on the imaging target may be missed. Hereinafter, a case where a high-resolution image having a resolution twice that of the captured image is generated using a conventional pixel shifting method will be described as an example.

FIGS. 11A to 11D are diagrams showing an imaging region V by each imaging pixel when an imaging object is imaged by a solid-state imaging device in a conventional pixel shifting method. Here, when the arrangement directions of the imaging pixels arranged in a matrix in the solid-state imaging device are denoted as an X direction and a Y direction, in the conventional pixel shifting method, in order to double the resolution, A total of four imaging operations are performed as shown in FIGS. 11A to 11D while shifting the solid-state imaging device by 1/2 of the size of the imaging pixel along the Y direction.

FIG. 11A shows the imaging region V by each imaging pixel when the relative positional relationship between the imaging object and the solid-state imaging device is in the initial state. FIG. 11A shows an imaging region V by each imaging pixel when the solid-state imaging device is moved in the X direction by ½ of the imaging pixel size from the initial state shown in FIG. 11A. FIG. 11C shows an imaging region V by each imaging pixel when the solid-state imaging device is moved in the Y direction by ½ of the imaging pixel size from the initial state shown in FIG. 11A. FIG. 11D shows an imaging region V by each imaging pixel when the solid-state imaging device is moved in the X direction and the Y direction by ½ of the size of the imaging pixel from the state shown in FIG. 11A. In FIG. 11A to FIG. 11D, a reference point on the imaging surface is indicated by a reference symbol O.

As shown in FIGS. 11A to 11D, in the conventional pixel shifting method, the solid-state imaging device is moved only by the minimum necessary distance. Therefore, in all four times of imaging, the detection target is within the imaging area v1 of the defective pixel. U may be completely included. In such a case, since the defective pixel cannot perform normal imaging output, the correction for the defective pixel is performed based on the luminance value information captured and output by the normal imaging pixels around the defective pixel, as described above. Even if the process is performed, the detection target U cannot be detected because the detection target U is not included in the imaging region v0 of the normal imaging pixel.

FIG. 12 is a diagram showing a high-resolution image H generated by combining the captured images corresponding to FIGS. 11A to 11D. The high resolution image H is generated by superimposing four captured images corresponding to FIGS. 11A to 11D with the reference point O coincident. Therefore, the luminance value information of each pixel E of the high resolution image H is generated based on the luminance value information of the pixel corresponding to the pixel E among the pixels in each captured image.

Here, of the pixels in the captured image, if the luminance value information captured and output by the defective pixel is invalid, the pixel E of the high-resolution image H has four effective pixels e0 and an effective number of pixels e0. A pixel e1 having three images, a pixel e2 having two effective images, and a pixel e3 having zero effective images are included. Here, the effective number of images corresponds to the number of effective luminance value information among the four luminance value information based on the four captured images for generating the pixel E.

Therefore, the detection target U is completely within the area on the imaging surface corresponding to the pixel e3 whose effective imaging number is 0, in other words, the area where the imaging areas v1 due to the defective pixels overlap each other. If it is included, the detection object U cannot be detected as described above.

Further, in the conventional pixel shifting method, a pixel e2 with a small effective number of images appears in the vicinity of the pixel e3 with zero effective number of images. In such a pixel e2, the number of effective luminance value information decreases as the number of effective imaging images decreases, so that the pixel e2 is easily affected by noise due to a decrease in the S / N ratio. As described above, when the detection target U is included in the area on the imaging target surface corresponding to the pixel e2 having a small number of effective images, the detection is increased as the number of effective images is decreased. The detection accuracy of the object U is lowered.

An object of the present invention is to suppress a decrease in accuracy of a high-resolution image generated based on a captured image even when a defective pixel is included in a solid-state imaging device that captures an imaging object. An image generation apparatus, an image generation method, and a computer-readable recording medium on which an image generation program is recorded.

The present invention provides an imaging unit in which a plurality of imaging pixels are two-dimensionally arranged, and an imaging position changing unit that changes a relative position between the imaging object and the imaging unit in a direction in which the imaging pixels are arranged. An image generation apparatus that generates a high-resolution image having a higher resolution than the low-resolution image from a plurality of low-resolution images when the imaging unit images the imaging object while shifting the relative position Because
An imaging position setting unit that sets the relative position when each low-resolution image is captured, so that imaging regions captured by the same imaging pixel do not overlap each other between a plurality of low-resolution images. An imaging position setting unit for setting each imaging position;
An imaging control unit that controls the imaging unit and the imaging position changing unit so that the imaging object is imaged at each imaging position set by the imaging position setting unit;
An image generation apparatus comprising: a high-resolution image generation unit configured to generate a high-resolution image from a plurality of low-resolution images captured at each imaging position set by the imaging position setting unit.

In the present invention, the imaging position setting unit
When the magnification for increasing the resolution in one arrangement direction in which the imaging pixels are arranged is A, the size of the imaging area taken by one imaging pixel in the one arrangement direction is W, and N is a natural number,
In two low-resolution images captured at imaging positions adjacent to each other in the one arrangement direction, a separation distance L in the one arrangement direction between the imaging regions captured by the same imaging pixel is
L = (N + 1 / A) × W
It is preferable to set each imaging position so that the following relational expression is satisfied.

In the present invention, the imaging position setting unit
The magnifications for increasing the resolution in the first and second arrangement directions in which the image pickup pixels are arranged are Ax and Ay, respectively, and the sizes in the first and second arrangement directions of the image pickup regions picked up by one image pickup pixel are Wx, When Wy and Nx and Ny are natural numbers,
In two low-resolution images captured at imaging positions adjacent to each other in the first arrangement direction, the separation distance Lx in the first arrangement direction between the imaging regions captured by the same imaging pixel is
Lx = (Nx + 1 / Ax) × Wx
In the two low-resolution images captured at the imaging positions adjacent to each other in the second arrangement direction, the imaging areas captured by the same imaging pixel are separated in the second arrangement direction. The distance Ly is
Ly = (Ny + 1 / Ay) × Wy
It is preferable to set each imaging position so that the following relational expression is satisfied.

The present invention also relates to an imaging unit in which a plurality of imaging pixels are two-dimensionally arranged, and an imaging position change that changes a relative position between the imaging object and the imaging unit in the direction in which the imaging pixels are arranged. Generating a high-resolution image having a higher resolution than the low-resolution image from a plurality of low-resolution images when the imaging unit images the imaging object while shifting the relative position A method,
An imaging position setting step for setting the relative position when each low-resolution image is captured, so that imaging regions captured by the same imaging pixel do not overlap each other between a plurality of low-resolution images. An imaging position setting step for setting each imaging position;
An imaging control step for controlling the imaging unit and the imaging position changing unit so that the imaging object is imaged at each imaging position set by the imaging position setting step;
And a high-resolution image generation step of generating a high-resolution image from a plurality of low-resolution images captured at each imaging position set in the imaging position setting step.

The present invention is also a computer-readable recording medium on which an image generation program for causing a computer to execute the image generation method is recorded.

According to the present invention, imaging of each low-resolution image is performed so that imaging regions captured by the same imaging pixel in the solid-state imaging device do not overlap each other between a plurality of low-resolution images for generating a high-resolution image. The position is set. Thereby, even if it is a case where a defective pixel is contained in a solid-state image sensor, the fall of the effective imaging number can be suppressed in each pixel in a high resolution image. Accordingly, it is possible to suppress a decrease in accuracy of the high resolution image generated based on the low resolution image.

Objects, features, and advantages of the present invention will become more apparent from the following detailed description and drawings.
1 is a schematic diagram illustrating a schematic configuration of an image processing system according to an embodiment of the present invention. 1 is a block diagram illustrating a configuration of an image processing system according to an embodiment of the present invention. It is a figure which shows the imaging area by each imaging pixel when an imaging target object is imaged in each imaging position set by the imaging position setting part in 1st Example. It is a figure which shows the imaging area by each imaging pixel when an imaging target object is imaged in each imaging position set by the imaging position setting part in 1st Example. It is a figure which shows the imaging area by each imaging pixel when an imaging target object is imaged in each imaging position set by the imaging position setting part in 1st Example. It is a figure which shows the imaging area by each imaging pixel when an imaging target object is imaged in each imaging position set by the imaging position setting part in 1st Example. FIG. 4 is a diagram showing a high-resolution image generated by combining each captured image corresponding to FIGS. 3A to 3D. It is a figure which shows the imaging area by each imaging pixel when an imaging target object is imaged in each imaging position set by the imaging position setting part in 2nd Example. It is a figure which shows the imaging area by each imaging pixel when an imaging target object is imaged in each imaging position set by the imaging position setting part in 2nd Example. It is a figure which shows the imaging area by each imaging pixel when an imaging target object is imaged in each imaging position set by the imaging position setting part in 2nd Example. It is a figure which shows the imaging area by each imaging pixel when an imaging target object is imaged in each imaging position set by the imaging position setting part in 2nd Example. FIG. 6 is a diagram illustrating a high-resolution image generated by combining the captured images corresponding to FIGS. 5A to 5D. It is a figure which shows the imaging area by each imaging pixel when an imaging target object is imaged in each imaging position set by the imaging position setting part in 3rd Example. It is a figure which shows the imaging area by each imaging pixel when an imaging target object is imaged in each imaging position set by the imaging position setting part in 3rd Example. It is a figure which shows the imaging area by each imaging pixel when an imaging target object is imaged in each imaging position set by the imaging position setting part in 3rd Example. It is a figure which shows the imaging area by each imaging pixel when an imaging target object is imaged in each imaging position set by the imaging position setting part in 3rd Example. FIG. 8 is a diagram showing a high-resolution image generated by combining the captured images corresponding to FIGS. 7A to 7D. It is a flowchart which shows the procedure of the image generation process by the image processing system which concerns on embodiment of this invention. It is a figure which shows the imaging area V by each imaging pixel when an imaging target object is imaged with the solid-state image sensor which has a defective pixel. It is a figure which shows the imaging region by each imaging pixel when an imaging target object is imaged with the solid-state image sensor in the conventional pixel shift method. It is a figure which shows the imaging region by each imaging pixel when an imaging target object is imaged with the solid-state image sensor in the conventional pixel shift method. It is a figure which shows the imaging region by each imaging pixel when an imaging target object is imaged with the solid-state image sensor in the conventional pixel shift method. It is a figure which shows the imaging region by each imaging pixel when an imaging target object is imaged with the solid-state image sensor in the conventional pixel shift method. FIG. 12 is a diagram showing a high-resolution image generated by combining the captured images corresponding to FIGS. 11A to 11D.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the drawings.
FIG. 1 is a schematic diagram showing a schematic configuration of an image processing system 100 according to an embodiment of the present invention. FIG. 2 is a block diagram showing a configuration of the image processing system 100 according to the embodiment of the present invention. An image processing system 100 that is an image generation device includes an imaging device 10, an actuator 20, a control device 30, and a display device 40 as illustrated.

The imaging device 10 is a device that includes the solid-state imaging element 12 in which a plurality of imaging pixels are two-dimensionally arranged, and performs imaging of the imaging target P in accordance with instructions from the control device 30. Here, the “imaging pixel” is a part that outputs information for one pixel in the captured image. That is, one pixel in the captured image corresponds to an imaging region captured by one imaging pixel in the solid-state imaging device 12.

The actuator 20 is a device that changes the relative position of the solid-state imaging device 12 and the imaging object P in the arrangement direction of the imaging pixels in the solid-state imaging device 12 in accordance with an instruction from the control device 30.

The control device 30 sets a relative position (hereinafter referred to as “imaging position”) between the solid-state imaging device 12 and the imaging object P when imaging the imaging object P. In particular, in the present embodiment, a plurality of imaging positions are set by the control device 30 in order to generate a high resolution image based on a plurality of captured images by the pixel shifting method. Note that the captured image in the present embodiment corresponds to a low-resolution image.

Also, the control device 30 controls the operations of the imaging device 10 and the actuator 20 so that imaging is sequentially performed at each set imaging position. Further, the control device 30 is configured to generate an image of a high-resolution image based on image data of a captured image (hereinafter referred to as “captured image data”) when the solid-state imaging device 12 images the imaging target P at each imaging position. Data (hereinafter referred to as “high resolution image data”) is generated.

The display device 40 is a device for displaying a high-resolution image of the imaging target P based on the high-resolution image data generated by the control device 30.

In this way, the image processing system 100 adopts the pixel shifting method to provide the display device 40 with a high-resolution image of the imaging target P that has a higher resolution than the captured image acquired by the solid-state imaging device 12. It is configured to be displayed. Such an image processing system 100 can be suitably used for an application that needs to detect a high-frequency component in a captured image of the imaging target P.

For example, by using a silicon wafer as the imaging target P, it can be used for inspecting a detection target such as a flaw or a foreign matter on the silicon wafer. In addition, by using FPDs such as liquid crystal displays (Liquid Crystal Display: abbreviated as “LCD”) and plasma display panels (Plasma Display Panel: abbreviated as “PDP”) as the imaging object P, in the FPD lighting inspection, the FPD in minute It can be used to detect an object to be detected.

In particular, the image processing system 100 according to the present embodiment is a high-resolution image generated by the pixel shifting method even when a plurality of imaging pixels constituting the solid-state imaging device 12 includes defective pixels. It is comprised so that the fall of the precision of can be suppressed.

In the following description, of the defects in the solid-state imaging device 12, a defect in which defective pixels are gathered in a plurality of units is referred to as a “cluster defect”, and a defect in which defective pixels exist alone is referred to as a “non-cluster defect”. Called.

Hereinafter, details of the imaging device 10, the actuator 20, the control device 30, and the display device 40 that are components of the image processing system 100 will be described.

First, the imaging device 10 will be described. As shown in FIG. 2, the imaging device 10 includes a lens 11 that is an optical imaging unit, a solid-state imaging device 12 that is an imaging unit, and a housing that houses the lens 11 and the solid-state imaging device 12. .

The imaging device 10 is installed inside the casing through a lens 11 that is installed facing the imaging target P and that reflects light reflected from the imaging target P inside the casing. It is configured to form an optical image on the imaging surface of the solid-state imaging device 12.

The solid-state imaging device 12 is configured by arranging a plurality of imaging pixels in a matrix on the imaging surface, and is provided in the casing so that the imaging surface is perpendicular to the optical axis of the lens 11. ing. In accordance with an instruction from the control device 30, the solid-state imaging device 12 spatially discretizes the image of the imaging target P that has been optically imaged on the imaging surface, and converts the image into an image signal. In this way, the imaging device 10 acquires the image of the imaging target P imaged on the imaging surface as captured image data, and outputs it to the control device 30. The solid-state imaging device 12 is configured as an area sensor, and a CCD image sensor, a CMOS image sensor, or the like can be used.

In the following description, the arrangement directions of the imaging pixels arranged in a matrix are referred to as an X direction and a Y direction, respectively. That is, the X direction and the Y direction are directions orthogonal to each other, and both directions are directions parallel to the imaging surface of the solid-state imaging device 12.

Next, the actuator 20 that is the imaging position changing unit will be described. The actuator 20 is a device for changing the relative position between the imaging object P and the solid-state imaging device 12, and in the present embodiment, for the imaging object P placed on a stage (not shown), The position of the solid-state imaging device 12 is changed. That is, the actuator 20 is configured to move the solid-state imaging device 12 with respect to the imaging object P that is fixedly arranged.

The actuator 20 is fixedly provided on the inner wall of the housing of the imaging apparatus 10, and the solid-state imaging device 12 is supported by the actuator 20. The actuator 20 is configured to displace the solid-state imaging device 12 along the X direction and the Y direction described above in accordance with an instruction from the control device 30.

As the actuator 20, for example, a device such as a piezo actuator and a stepping motor can be used. The actuator 20 is not particularly limited as long as the relative position between the imaging object P and the solid-state imaging device 12 can be changed, but a piezo actuator is used here.

Further, in the present embodiment, the actuator 20 is configured to move the solid-state imaging device 12 with respect to the imaging target P, but is not limited to such a configuration, and the imaging target P is moved to the solid-state imaging device. 12 may be configured to move two-dimensionally along a plane perpendicular to the optical axis of the lens 11 of the imaging device 10. Moreover, you may be comprised so that both the solid-state image sensor 12 and the imaging target object P may be moved.

Next, the control device 30 will be described. As shown in FIG. 2, the control device 30 includes an imaging position setting unit 31, an imaging condition storage unit 32, an imaging control unit 33, a captured image storage unit 36, and a high-resolution image generation unit 37. Is done. That is, the functions of the control device 30 as described above are realized by these configurations. The control device 30 is constituted by, for example, a personal computer and a workstation.

The imaging position setting unit 31 reads the imaging conditions stored in advance in the imaging condition storage unit 32, and sets the imaging position of the solid-state imaging device 12 when imaging the imaging target P. Details of the setting of the imaging position will be described later.

The imaging condition storage unit 32 stores data of magnification A (hereinafter referred to as “high resolution magnification”) A when a high-resolution image is generated based on a captured image. In the present embodiment, it is configured such that the resolution can be individually increased in the X direction that is the first arrangement direction of the imaging pixels and the Y direction that is the second arrangement direction. Therefore, the imaging condition storage unit 32 stores data of high resolution magnifications Ax and Ay (where Ax and Ay are integers of 2 or more) in the X direction and the Y direction.

In addition, the imaging condition storage unit 32 stores data of pixel pitches Dx and Dy regarding the X direction and the Y direction of the imaging pixels in the solid-state imaging device 12. Here, the pixel pitch Dx corresponds to the distance between the centers of the imaging pixels adjacent in the X direction in the solid-state imaging device 12. Similarly, the pixel pitch Dy corresponds to the distance between the centers of the imaging pixels adjacent in the Y direction in the solid-state imaging device 12. That is, the pixel pitches Dx and Dy are values determined according to the solid-state imaging device 12 mounted on the imaging device 10.

Further, the imaging condition storage unit 32 stores data on the position and size of defects occurring in the solid-state imaging device 12. Here, the position of the defect corresponds to a position coordinate on the imaging surface of the defective pixel in the solid-state imaging device 12.

The defect size refers to the maximum number of pixels Cx in the X direction (where Cx is a natural number) and the Y direction in the defect having the largest size in the X direction with respect to one or a plurality of defects occurring in the solid-state imaging device 12. This corresponds to the maximum number of pixels Cy in the Y direction in the defect having the largest size (where Cy is a natural number).

That is, when the defects occurring in the solid-state imaging device 12 do not include cluster defects (that is, only non-cluster defects), the defect sizes Cx and Cy are both 1 (that is, Cx = Cy = 1). ) When one or a plurality of cluster defects are included in the defect occurring in the solid-state imaging device 12, the defect sizes Cx and Cy are determined according to the size of each cluster defect. At least one of Cx and Cy is 2 or more.

The data of such defect positions and sizes Cx and Cy are acquired by inspecting, for example, the solid-state imaging device 12 mounted on the imaging device 10 with a dedicated inspection device in advance.

The user uses the input device (not shown) to set the desired high-resolution magnifications Ax and Ay, and also sets each data related to the solid-state imaging device 12. Thereby, each of these data is stored in the imaging condition storage unit 32 as imaging conditions.

In addition to these pieces of data, the imaging condition storage unit 32 has an exposure time (shutter speed), imaging sensitivity, an optical filter to be used, and an iris (aperture) when imaging the imaging object P at each imaging position. Data relating to imaging conditions such as are set and stored by the user.

The imaging control unit 33 includes an actuator control unit 34 and an imaging timing control unit 35 as shown in FIG. The actuator control unit 34 controls the driving of the actuator 20 based on the imaging position data set by the imaging position setting unit 31. Specifically, the actuator control unit 34 controls the drive start and stop timings of the actuator 20, the drive speed of the actuator 20, and the like. By such control of the actuator control unit 34, the actuator 20 can sequentially move the solid-state imaging device 12 to each imaging position set by the imaging position setting unit 31.

The imaging timing control unit 35 controls the timing of starting and stopping imaging by the solid-state imaging device 12. Specifically, the imaging timing control unit 35 controls the imaging time at each imaging position, that is, the exposure time, by sending a control signal to the imaging device 10 based on the imaging conditions stored in the imaging condition storage unit 32. To do.

In the imaging control unit 33, the actuator control unit 34 and the imaging timing control unit 35 are configured to be synchronized with each other, and the imaging control unit 33 moves the solid-state imaging device 12 to the imaging position by driving the actuator 20. After that, the operations of the imaging device 10 and the actuator 20 are controlled so that the imaging by the solid-state imaging device 12 is performed.

In the image processing system 100, when imaging is performed at a certain imaging position in accordance with an instruction from the imaging timing control unit 35, the imaging device 10 adds an identifier that can identify the captured image data to the captured image data acquired by imaging. In addition, the captured image storage unit 36 of the control device 30 stores the captured image. Therefore, the captured image storage unit 36 stores a plurality of captured image data that can identify the imaging position.

The high-resolution image generation unit 37 performs pixel shift processing on the high-resolution image data that is Ax times in the X direction and Ay times in the Y direction based on the captured image data for each imaging position stored in the captured image storage unit 36. Generate by. At this time, the high resolution image generation unit 37 corrects the high resolution image data based on the position coordinate data of the defective pixel stored in the imaging condition storage unit 32. Specifically, correction is performed so that the luminance value information of the pixel corresponding to the defective pixel among the pixels in the captured image data is not reflected in the high-resolution image data. The high-resolution image data generated in this way is stored in a storage area (not shown).

Next, the display device 40 will be described. When the display device 40 receives the high-resolution image data generated by the control device 30, the display device 40 displays a high-resolution image of the imaging target P on the display unit. The display device 40 is realized by, for example, a CRT (Cathode Ray Tube), LCD, or PDP.

Hereinafter, a method for setting the imaging position by the imaging position setting unit 31 will be described. The imaging position setting unit 31 sets each imaging position so that imaging areas V captured by the same imaging pixel do not overlap each other between a plurality of captured images.

That is, the imaging position setting unit 31 captures an image at an imaging position adjacent to the X direction, where Wx is the size in the X direction of the imaging region V on the imaging surface captured by one imaging pixel in the solid-state imaging device 12. The imaging positions adjacent to each other in the X direction are set so that the distance Lx between the imaging areas V captured by the same imaging pixel satisfies Lx ≧ Wx.

Similarly, the imaging position setting unit 31 captures an image at an imaging position adjacent to the Y direction when the size in the Y direction of the imaging region V on the imaging surface captured by one imaging pixel in the solid-state imaging device 12 is Wy. The imaging positions adjacent to each other in the Y direction are set so that the distance Ly between the imaging regions V imaged by the same imaging pixel satisfies Ly ≧ Wy between the captured images.

Specifically, the imaging position setting unit 31 determines that the separation distances Lx and Ly in the X direction and the Y direction are based on the resolution enhancement magnifications Ax and Ay in the X direction and the Y direction stored in the imaging condition storage unit 32. Each imaging position is set so as to satisfy the following formulas (1) and (2).
Lx = (Nx + Mx / Ax) × Wx (1)
Ly = (Ny + My / Ay) × Wy (2)

Here, Nx and Ny are both natural numbers, and are values determined based on the defect sizes Cx and Cy stored in the imaging condition storage unit 32, as will be described later. Mx and My are arbitrary natural numbers that satisfy 1 ≦ Mx <Ax and 1 ≦ My <Ay, respectively. Therefore, in Expressions (1) and (2), since Nx + Mx / Ax> 1 and Ny + My / Ay> 1, the separation distances Lx and Ly are set so as to satisfy Lx> Wx and Ly> Wy.

The image processing system 100 according to the present embodiment is configured to move the solid-state imaging device 12 with respect to the imaging target P as described above. Therefore, the imaging position setting unit 31 is configured to set the imaging position by setting the amount of movement of the solid-state imaging device 12 so as to satisfy the mathematical expressions (1) and (2).

Specifically, assuming that the movement amounts of the solid-state imaging device 12 between the imaging positions adjacent to each other in the X direction and the Y direction are Fx and Fy, the movement amounts Fx and Fy are stored in the imaging condition storage unit 32. Based on the resolution enhancement magnifications Ax and Ay and the pixel pitches Dx and Dy, the following mathematical formulas (3) and (4) are set.
Fx = (Nx + Mx / Ax) × Dx (3)
Fy = (Ny + My / Ay) × Dy (4)

Here, the mathematical formulas (1) and (2) describe the relationship between the imaging regions V captured by the same imaging pixel between the captured images captured at the adjacent imaging positions, whereas the mathematical formula ( 3) and (4) correspond to equations obtained by converting the relationship described in Equations (1) and (2) into the amount of movement of the solid-state imaging device 12.

When the imaging position setting unit 31 sets the movement amounts Fx and Fy based on the equations (3) and (4), the imaging resolution setting magnifications Ax and Ay and the pixel pitches Dx and Dy are imaged as described above. A numerical value is input based on the data stored in the condition storage unit 32.

In Expressions (3) and (4), Nx and Ny correspond to variables that define how many image pickup pixels need to be moved in the X direction and the Y direction, respectively. Yes. According to the conventional pixel shifting method, the movement amounts Fx, Fy are set with Nx = Ny = 0 in order to reduce the movement amounts Fx, Fy of the solid-state imaging device 12, but in this embodiment, the solid-state imaging device. 12, in order to suppress the decrease in the number of effective images in each pixel of the high resolution image to one, that is, the number of effective images in each pixel of the high resolution image is equal to the number of captured images (that is, In order to avoid a decrease of two or more images with respect to the number of imaging positions), the imaging position setting unit 31 is based on the defect sizes Cx and Cy stored in the imaging condition storage unit 32. Nx and Ny are set according to the following equations (5) and (6).
Nx ≧ Cx (5)
Ny ≧ Cy (6)

That is, according to Equations (5) and (6), with respect to the X direction, the amount of movement is such that the solid-state imaging device 12 is moved by more than the maximum number of pixels Cx in the X direction in the defect having the largest size in the X direction. Fx is set. For the Y direction, the movement amount Fy is set so that the solid-state imaging device 12 is moved by the maximum number of pixels Cy in the Y direction in the defect having the largest size in the Y direction. That is, by setting the movement amounts Fx and Fy so as to satisfy the expressions (5) and (6), the imaging position can be set so as to suppress the decrease in the effective imaging number to only one.

By the way, as long as the conditions described in Equations (5) and (6) are satisfied, no matter what the numerical values Nx and Ny are set, the reduction in the effective number of images can be suppressed to only one. The effect is achieved. Therefore, it is preferable to set Nx and Ny based on the condition that the movement amounts Fx and Fy of the solid-state imaging device 12 are further reduced in addition to the conditions described in the mathematical expressions (5) and (6). That is, since Fx and Nx and Fy and Ny are proportional to each other, it is preferable to set Nx = Cx and Ny = Cy in order to reduce the movement amounts Fx and Fy.

Further, as described above, Mx and My are arbitrary natural numbers that satisfy 1 ≦ Mx <Ax and 1 ≦ My <Ay, respectively, and in equations (3) and (4), Mx / Ax and My / Ay Is a positive value less than 1. Therefore, similarly to the above, it is preferable to set Mx = My = 1 in consideration of the condition of reducing the movement amounts Fx and Fy of the solid-state imaging device 12.

In consideration of the above, in this embodiment, the imaging position setting unit 31 sets the resolution enhancement magnifications Ax, Ay, pixel pitches Dx, Dy, and defect sizes Cx, Cy stored in the imaging condition storage unit 32. Based on this, the movement amounts Fx and Fy are set so as to satisfy the following formulas (7) and (8).
Fx = (Cx + 1 / Ax) × Dx (7)
Fy = (Cy + 1 / Ay) × Dy (8)

When the movement amounts Fx and Fy are set in this way, the imaging position setting unit 31 performs imaging for the number of sheets determined based on the resolution enhancement magnifications Ax and Ay. Set. For example, in the case of generating a high-resolution image obtained by increasing the resolution of the captured image three times in the X direction and the Y direction (that is, Ax = Ay = 3), a matrix shape of 3 (X direction) × 3 (Y direction) Are set within a virtual plane including the imaging plane.

Specifically, when the coordinates in the X direction and the Y direction on the virtual plane are expressed as (x, y), when the coordinates of the reference imaging position are (0, 0), the coordinates of the other imaging positions are As (Fx, 0), (2Fx, 0), (0, Fy), (Fx, Fy), (2Fx, Fy), (0,2Fy), (Fx, 2Fy), (2Fx, 2Fy), respectively. Is set.

Thus, in this embodiment, when setting the imaging position of the solid-state imaging device 12 for suppressing the decrease in the effective imaging number to only one, the movement amounts Fx and Fy of the solid-state imaging device 12 are reduced. Since the imaging position is set, the influence due to the increase in the movement amounts Fx and Fy of the solid-state imaging device 12 compared to the conventional pixel shifting method, that is, the increase in the movement time between the imaging positions, the actuator 20 A decrease in accuracy with respect to the imaging position of the moved position and a decrease in the life of the actuator 20 can be suppressed.

Here, the pixel shift method of this embodiment will be described in a plurality of examples, taking as an example the case of generating a high-resolution image in which the resolution of the captured image is doubled in the X direction and doubled in the Y direction. .

First, an example (hereinafter referred to as “first example”) in the case where a defect occurring in the solid-state imaging device 12 does not include a cluster defect will be described. That is, in the first embodiment, the resolution enhancement magnifications Ax and Ay stored in the imaging condition storage unit 32 are 2 (that is, Ax = Ay = 2), and the defect sizes Cx and Cy are Each is 1 (ie, Cx = Cy = 1).

Therefore, the imaging position setting unit 31 sets the movement amounts Fx and Fy of the solid-state imaging device 12 as Fx = 3Dx / 2 and Fy = 3Dy / 2 based on the mathematical expressions (7) and (8). Thereby, the imaging position setting unit 31 sets the imaging position of the solid-state imaging device 12 to (0, 0), (3Dx / 2, 0), (0, 3Dy / 2), (3Dx / 2, 3Dy / 2). And set. Here, (0, 0) represents the coordinates of the reference imaging position.

3A to 3D are diagrams showing the imaging region V by each imaging pixel when the imaging object P is imaged at each imaging position set by the imaging position setting unit 31 in the first embodiment. In FIG. 3A to FIG. 3D, nine rectangular imaging regions V correspond to regions on the imaging surface imaged by 3 × 3 vertical and horizontal imaging pixels arranged in a matrix in the solid-state imaging device 12. is doing. In particular, the imaging region v1 that is hatched corresponds to the region on the imaging target surface that is imaged by the defective pixel, and the imaging region v0 that is not hatched, that is, 8 around the imaging region v1. The two imaging areas v0 correspond to areas on the imaging surface captured by normal imaging pixels. Further, in FIGS. 3A to 3D, detection objects such as minute foreign matters and scratches generated on the imaging object P are indicated with a reference symbol U.

FIG. 3A shows an imaging region V by each imaging pixel when the imaging object P is imaged at the reference imaging position (0, 0). FIG. 3B shows the imaging object P at the imaging position (3Dx / 2, 0) obtained by moving the solid-state imaging device 12 in the X direction by 3/2 of the pixel pitch Dx from the reference imaging position (0, 0). The imaging region V by each imaging pixel when it imaged is shown.

FIG. 3C shows the imaging object P at the imaging position (0, 3Dy / 2) where the solid-state imaging device 12 is moved in the Y direction by 3/2 of the pixel pitch Dy from the reference imaging position (0, 0). The imaging region V by each imaging pixel when it imaged is shown. 3D shows the imaging positions (3Dx / 2, 3Dy / 3) in which the solid-state imaging device 12 is moved in the X and Y directions by 3/2 of the pixel pitches Dx and Dy from the reference imaging position (0, 0). The imaging region V by each imaging pixel when the imaging target P is imaged in 2) is shown. In FIG. 3A to FIG. 3D, the reference point on the imaging surface is indicated by the reference symbol O.

Here, there is no particular limitation on the order in the case of performing the imaging four times. If the reference imaging position (0, 0) is the first imaging position, for example, (3Dx / 2, 0), (3Dx / 2, 3Dy / 2) and (0, 3Dy / 2) are moved in the order of (0, 3Dy / 2), so that the overall movement amount of the solid-state image sensor 12 can be reduced.

As shown in FIGS. 3A to 3D, according to the pixel shifting method in the first embodiment, each imaging position is set so that the imaging areas v1 captured by the defective pixels do not overlap each other in each captured image. be able to.

FIG. 4 is a diagram illustrating a high-resolution image H1 generated by combining the captured images corresponding to FIGS. 3A to 3D. The high resolution image H1 is generated by superimposing four captured images corresponding to FIGS. 3A to 3D with the reference point O coincident. Therefore, the luminance value information of each pixel E of the high-resolution image H1 is generated based on the luminance value information of the pixel corresponding to the pixel E among the pixels in each captured image.

Here, among the pixels in the captured image, if the luminance value information captured and output by the defective pixel is invalid, the pixel E of the high-resolution image H1 according to the present embodiment has four effective captured images. e0 and a pixel e1 having three effective images are included.

That is, according to the first embodiment, the pixel E of the high resolution image H1 includes the pixel e0 having the same number of effective captured images as the number of captured images and the pixel e1 having an effective captured number of one less than the number of captured images. And the number of effective captured images is not two or fewer than the number of captured images.

As described above, according to the image processing system 100 according to the present embodiment, even if the solid-state imaging device 12 includes a defective pixel, the number of effective captured images is reduced in each pixel E in the high-resolution image H1. Can be suppressed. Therefore, it is possible to suppress a decrease in accuracy of the high resolution image H1 generated based on the captured image. By using such an image processing system 100 for the purpose of detecting a detection object such as a minute foreign object or a flaw occurring on the imaging object P, the possibility that the detection object of the minute detection object is missed is reduced. be able to.

Further, in the high resolution image H1 according to the present embodiment, four islands formed by aggregating the pixels e1 having the effective number of images of three are mutually connected by one row and one column of the pixels E of the high resolution image H1. It exists apart. As described above, in the equations (3) and (4) for setting the movement amounts Fx and Fy, as long as Nx and Ny are set so as to satisfy the equations (5) and (6), a high-resolution image is obtained. In H1, it is possible to avoid generation of pixels having an effective number of images of 2 or less, and the set values of Nx and Ny contribute to the interval between the four islands in the high resolution image H1. However, as long as the four islands do not overlap with each other, the effect of suppressing the reduction in the number of effective images is the same regardless of the interval between the four islands. Therefore, in the present embodiment, as described above, Nx and Ny are set so as to reduce the movement amounts Fx and Fy of the solid-state imaging device 12.

Therefore, the influence of the movement amounts Fx and Fy of the solid-state imaging device 12 increasing as compared with the conventional pixel shifting method, that is, the movement time between the imaging positions increases, and the imaging position of the position moved by the actuator 20 It is possible to suppress a decrease in accuracy and a decrease in the life of the actuator 20.

Next, an example in which a defect occurring in the solid-state imaging device 12 includes a cluster defect in which two defective pixels continue in the X direction as the maximum defect (hereinafter referred to as “second example”). ). That is, in the second embodiment, the resolution enhancement magnifications Ax and Ay stored in the imaging condition storage unit 32 are each 2 (that is, Ax = Ay = 2), and the defect size Cx is 2. , Cy is 1 (that is, Cx = 2, Cy = 1).

Therefore, the imaging position setting unit 31 sets the movement amounts Fx and Fy of the solid-state imaging device 12 as Fx = 5Dx / 2 and Fy = 3Dy / 2 based on the mathematical formulas (7) and (8). Thereby, the imaging position setting unit 31 sets the imaging position of the solid-state imaging device 12 to (0, 0), (5Dx / 2, 0), (0, 3Dy / 2), (5Dx / 2, 3Dy / 2). And set. Here, (0, 0) represents the coordinates of the reference imaging position.

FIGS. 5A to 5D are diagrams showing the imaging region V by each imaging pixel when the imaging object P is imaged at each imaging position set by the imaging position setting unit 31 in the second embodiment. FIG. 5A shows an imaging region V by each imaging pixel when the imaging object P is imaged at the reference imaging position (0, 0). FIG. 5B shows the imaging object P at the imaging position (5Dx / 2, 0) obtained by moving the solid-state imaging device 12 in the X direction by 5/2 of the pixel pitch Dx from the reference imaging position (0, 0). The imaging region V by each imaging pixel when it imaged is shown.

FIG. 5C shows the imaging object P at the imaging position (0, 3Dy / 2) obtained by moving the solid-state imaging device 12 in the Y direction by 3/2 of the pixel pitch Dy from the reference imaging position (0, 0). The imaging region V by each imaging pixel when it imaged is shown. Further, FIG. 5D shows imaging in which the solid-state imaging device 12 is moved from the reference imaging position (0, 0) in the X direction by 5/2 of the pixel pitch Dx and in the Y direction by 3/2 of the pixel pitch Dy. The imaging region V by each imaging pixel when the imaging target P is imaged at the position (5Dx / 2, 3Dy / 2) is shown. In FIG. 5A to FIG. 5D, the reference point on the imaging surface is indicated by the reference symbol O.

As shown in FIGS. 5A to 5D, according to the pixel shifting method in the second embodiment, each imaging position is set so that the imaging regions v1 captured by the defective pixels do not overlap each other in each captured image. be able to.

FIG. 6 is a diagram illustrating a high-resolution image H2 generated by combining the captured images corresponding to FIGS. 5A to 5D. The high resolution image H2 is generated by superimposing four captured images corresponding to FIGS. 5A to 5D with the reference point O coincident. As shown in FIG. 6, the pixel E of the high-resolution image H2 according to the present embodiment includes a pixel e0 having four effective images and a pixel e1 having three effective images.

That is, according to the second embodiment, as in the first embodiment, the pixel E of the high-resolution image H2 has the same number of pixels e0 as the number of effective captured images and the number of effective captured images of the captured images. The number of pixels e1 is one less than the number of pixels, and the number of effective captured images is not two or more than the number of captured images.

As described above, according to the image processing system 100 according to the present embodiment, even when the solid-state imaging device 12 includes a defective pixel, the effective number of images is reduced in each pixel E in the high-resolution image H2. Can be suppressed. Accordingly, it is possible to suppress a decrease in accuracy of the high resolution image H2 generated based on the captured image. By using such an image processing system 100 for the purpose of detecting a detection object such as a minute foreign object or a flaw occurring on the imaging object P, the possibility that the detection object of the minute detection object is missed is reduced. be able to.

In addition, as described above, the effect of increasing the movement amounts Fx and Fy of the solid-state imaging device 12 compared to the conventional pixel shifting method, that is, the movement time between the imaging positions is increased, and the actuator 20 is moved. It is possible to suppress a decrease in accuracy with respect to the image pickup position and a decrease in the life of the actuator 20.

Next, the conditions for setting the imaging position are further based on an increase in the movement time between the imaging positions, a decrease in accuracy with respect to the imaging position of the position moved by the actuator 20, a decrease in the life of the actuator 20, and the like. An example in which the limit amounts Qx and Qy (that is, Fx ≦ Qx, Fy ≦ Qy) are set as the movement amounts Fx and Fy of the solid-state imaging device 12 (hereinafter, referred to as “third embodiment”). Will be described.

When the movement amounts Fx and Fy set by the mathematical expressions (7) and (8) are smaller than the limit amounts Qx and Qy, respectively, the imaging position is set based on the calculated movement amounts Fx and Fy. That's fine. On the other hand, if at least one of the movement amounts Fx and Fy set by the equations (7) and (8) exceeds the limit amounts Qx and Qy, the imaging position is determined based on the limit amounts Qx and Qy. You only have to set it.

In the following, it is assumed that the defect occurring in the solid-state imaging device 12 includes a cluster defect in which two defective pixels are consecutive in the X direction as the maximum defect, and further, conditions for setting the imaging position When the limit amount Qx in the X direction is set to twice the pixel pitch Dx (ie, Qx = 2Dx), and the limit amount Qy in the Y direction is set to twice the pixel pitch Dy (ie, Qy = 2Dy). Examples will be described.

In the third embodiment, the resolution enhancement magnifications Ax and Ay stored in the imaging condition storage unit 32 are 2 (that is, Ax = Ay = 2), respectively, and the defect size Cx is 2 and Cy. Is 1 (ie, Cx = 2, Cy = 1).

Therefore, the imaging position setting unit 31 sets the movement amounts Fx and Fy of the solid-state imaging device 12 as Fx = 5Dx / 2 and Fy = 3Dy / 2 based on the mathematical formulas (7) and (8). Here, the imaging position setting unit 31 compares the set movement amounts Fx and Fy with preset limit amounts Qx and Qy.

In this embodiment, since the set movement amount Fx (= 5Dx / 2) exceeds the limit amount Qx (= 2Dx), it is necessary to reset the movement amount Fx. Specifically, the movement amount Fx is reset by resetting as Nx = Cx−1 in Equation (7) set as Nx = Cx. That is, in this embodiment, Fx = 3Dx / 2 is reset.

Thereby, the imaging position setting unit 31 sets the imaging position of the solid-state imaging device 12 to (0, 0), (3Dx / 2, 0), (0, 3Dy / 2), (3Dx / 2, 3Dy / 2). And set. Here, (0, 0) represents the coordinates of the reference imaging position.

FIGS. 7A to 7D are diagrams showing the imaging region V by each imaging pixel when the imaging object P is imaged at each imaging position set by the imaging position setting unit 31 in the third embodiment. FIG. 7A shows an imaging region V by each imaging pixel when the imaging object P is imaged at the reference imaging position (0, 0). FIG. 7B shows the imaging object P at the imaging position (3Dx / 2, 0) obtained by moving the solid-state imaging device 12 in the X direction by 3/2 of the pixel pitch Dx from the reference imaging position (0, 0). The imaging region V by each imaging pixel when it imaged is shown.

FIG. 7C shows the imaging object P at the imaging position (0, 3Dy / 2) where the solid-state imaging device 12 is moved in the Y direction by 3/2 of the pixel pitch Dy from the reference imaging position (0, 0). The imaging region V by each imaging pixel when it imaged is shown. FIG. 7D shows an imaging position (3Dx / 2, 3Dy / 2) obtained by moving the solid-state imaging device 12 in the X direction and the Y direction by 3/2 of the pixel pitch Dx from the reference imaging position (0, 0). The imaging area V by each imaging pixel when imaging object P is imaged is shown. In FIG. 7A to FIG. 7D, the reference point on the imaging surface is indicated by the reference symbol O.

As shown in FIGS. 7A to 7D, according to the pixel shifting method in the third embodiment, the movement amounts Fx and Fy are not set so as to satisfy the expressions (5) and (6). In this case, the imaging areas v1 imaged by the defective pixels overlap each other.

FIG. 8 is a diagram showing a high resolution image H3 generated by combining the captured images corresponding to FIGS. 7A to 7D. The high resolution image H3 is generated by superimposing four captured images corresponding to FIGS. 7A to 7D with the reference point O coincident. As shown in FIG. 8, the pixel E of the high-resolution image H3 includes a pixel e0 having four effective images, a pixel e1 having three effective images, and a pixel e2 having two effective images. included.

That is, in the third embodiment, unlike the second embodiment, the pixel E of the high resolution image H3 has the same number of pixels e0 as the number of captured images, and the number of effective captured images is the number of captured images. In addition to the pixel e1 that is one fewer than the number of pixels e1, the effective number of captured images includes two pixels e2 that are smaller than the number of captured images.

Therefore, the third embodiment cannot suppress the decrease in the number of effective images as compared with the second embodiment, but the limit amounts Qx and Qy are set for the movement amounts Fx and Fy in this way. Even in this case, compared with the conventional pixel shifting method, it is possible to suppress a decrease in the effective number of images in each pixel E in the high resolution image H3.

Therefore, according to the image processing system 100 according to the present embodiment, it is possible to suppress a decrease in accuracy of the high resolution image H3 generated based on the captured image, as compared with the conventional pixel shifting method. By using such an image processing system 100 for the purpose of detecting a detection object such as a minute foreign object or a flaw occurring on the imaging object P, the possibility that the detection object of the minute detection object is missed is reduced. be able to.

FIG. 9 is a flowchart showing a procedure of image generation processing by the image processing system 100 according to the embodiment of the present invention. The image generation process is started in a state where the imaging target P to be inspected is placed at a predetermined position on a stage (not shown).

In step s1, the imaging position setting unit 31 reads the imaging condition data stored in advance in the imaging condition storage unit 32, and the amount of movement Fx of the solid-state imaging device 12 based on the equations (7) and (8). , Fy is calculated to set the imaging position by the solid-state imaging device 12. When the imaging position is set, the process proceeds to step s2.

In step s2, the imaging control unit 33 controls the operations of the imaging device 10 and the actuator 20 so that imaging is performed at each imaging position set in step s1 according to a preset imaging sequence. Thereby, captured image data of the captured image captured at the imaging position is acquired. The acquired captured image data is stored in the captured image storage unit 36 in the control device 30. When the captured image data is stored in the captured image storage unit 36, the process proceeds to step s3.

In step s3, the imaging control unit 33 determines whether imaging has been performed at all the imaging positions set in step s1. If it is determined that imaging has been performed at all imaging positions, the process proceeds to step s4. If it is determined that imaging has not been performed at all imaging positions, the process returns to step s2.

In step s4, the high resolution image generation unit 37 generates high resolution image data by synthesizing the captured image data of each imaging position stored in the captured image storage unit 36. Furthermore, the generated high-resolution image data is corrected so that the luminance value information of the pixel corresponding to the defective pixel is not reflected in the high-resolution image data in each captured image data. When the high-resolution image data is acquired in this way, the process proceeds to step s5.

In step s5, the display device 40 reads the high-resolution image data acquired in step s4, and displays the high-resolution image of the imaging target P on the display unit. When the high-resolution image is displayed on the display unit, the image generation process ends.

Each block included in the control device 30 of the computer may be configured by hardware logic, or may be realized by software using a CPU (Central Processing Unit) as follows.

That is, the computer control device 30 stores a CPU that executes instructions of an image generation program that realizes each function, a ROM that stores the program, a RAM (Random Access Memory) that expands the program, the program, and various data. And a storage device (recording medium) such as a memory. An object of the present invention is to supply a computer with a recording medium in which a program code (execution format program, intermediate code program, source program) of an image generation program, which is software that realizes the above-described functions, is recorded in a computer-readable manner. This can also be achieved by the computer reading and executing the program code recorded on the recording medium.

Examples of the recording medium include tapes such as magnetic tapes and cassette tapes, magnetic disks such as floppy (registered trademark) disks / hard disks, and disks including optical disks such as CD-ROM / MO / MD / DVD / CD-R. Card system such as IC card, IC card (including memory card) / optical card, or semiconductor memory system such as mask ROM / EPROM / EEPROM / flash ROM.

Further, the computer may be configured to be connectable to a communication network, and the program code may be supplied to the computer via the communication network. The communication network is not particularly limited. For example, the Internet, intranet, extranet, LAN, ISDN, VAN, CATV communication network, virtual private network (Virtual Private Network), telephone line network, mobile communication network, satellite communication. A net or the like is available. Further, the transmission medium constituting the communication network is not particularly limited. For example, even in the case of wired such as IEEE 1394, USB, power line carrier, cable TV line, telephone line, ADSL line, etc., infrared rays such as IrDA and remote control, Bluetooth ( (Registered trademark), 802.11 wireless, HDR, mobile phone network, satellite line, terrestrial digital network, and the like can also be used. The present invention can also be realized in the form of a computer data signal embedded in a carrier wave in which the program code is embodied by electronic transmission.

The present invention can be implemented in various other forms without departing from the spirit or main features thereof. Therefore, the above-described embodiment is merely an example in all respects, and the scope of the present invention is shown in the claims, and is not restricted by the text of the specification. Further, all modifications and changes belonging to the scope of the claims are within the scope of the present invention.

DESCRIPTION OF SYMBOLS 10 Imaging apparatus 12 Solid-state image sensor 20 Actuator 30 Control apparatus 31 Imaging position setting part 32 Imaging condition storage part 33 Imaging control part 34 Actuator control part 35 Imaging timing control part 36 Captured image storage part 37 High-resolution image generation part 40 Display apparatus 100 Image processing system P Imaging object U Detection object

Claims

An imaging unit formed by two-dimensionally arranging a plurality of imaging pixels, and an imaging position changing unit that changes a relative position between the imaging object and the imaging unit in a direction in which the imaging pixels are arranged, An image generation device that generates a high-resolution image having a higher resolution than the low-resolution image from a plurality of low-resolution images when the imaging unit images the imaging object while shifting a relative position,
An imaging position setting unit that sets the relative position when each low-resolution image is captured, so that imaging regions captured by the same imaging pixel do not overlap each other between a plurality of low-resolution images. An imaging position setting unit for setting each imaging position;
An imaging control unit that controls the imaging unit and the imaging position changing unit so that the imaging object is imaged at each imaging position set by the imaging position setting unit;
An image generation apparatus comprising: a high-resolution image generation unit configured to generate a high-resolution image from a plurality of low-resolution images captured at each imaging position set by the imaging position setting unit.
The imaging position setting unit
When the magnification for increasing the resolution in one arrangement direction in which the imaging pixels are arranged is A, the size of the imaging area taken by one imaging pixel in the one arrangement direction is W, and N is a natural number,
In two low-resolution images captured at imaging positions adjacent to each other in the one arrangement direction, a separation distance L in the one arrangement direction between the imaging regions captured by the same imaging pixel is
L = (N + 1 / A) × W
The image generation apparatus according to claim 1, wherein each imaging position is set so as to satisfy the relational expression:
The imaging position setting unit
The magnifications for increasing the resolution in the first and second arrangement directions in which the image pickup pixels are arranged are Ax and Ay, respectively, and the sizes in the first and second arrangement directions of the image pickup regions picked up by one image pickup pixel are Wx, When Wy and Nx and Ny are natural numbers,
In two low-resolution images captured at imaging positions adjacent to each other in the first arrangement direction, the separation distance Lx in the first arrangement direction between the imaging regions captured by the same imaging pixel is
Lx = (Nx + 1 / Ax) × Wx
In the two low-resolution images captured at the imaging positions adjacent to each other in the second arrangement direction, the imaging areas captured by the same imaging pixel are separated in the second arrangement direction. The distance Ly is
Ly = (Ny + 1 / Ay) × Wy
The image generation apparatus according to claim 1, wherein each imaging position is set so as to satisfy the relational expression:
An imaging unit formed by two-dimensionally arranging a plurality of imaging pixels, and an imaging position changing unit that changes a relative position between the imaging object and the imaging unit in a direction in which the imaging pixels are arranged, An image generation method for generating a high-resolution image having a higher resolution than the low-resolution image from a plurality of low-resolution images when the imaging unit images the imaging object while shifting a relative position,
An imaging position setting step for setting the relative position when each low-resolution image is captured, so that imaging regions captured by the same imaging pixel do not overlap each other between a plurality of low-resolution images. An imaging position setting step for setting each imaging position;
An imaging control step for controlling the imaging unit and the imaging position changing unit so that the imaging object is imaged at each imaging position set by the imaging position setting step;
And a high-resolution image generation step of generating a high-resolution image from a plurality of low-resolution images captured at each imaging position set in the imaging position setting step.
A computer-readable recording medium on which an image generation program for causing a computer to execute the image generation method according to claim 4 is recorded.