JPH09130677A - Image pickup device and image information correction device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To make value information, which shows whether a picture element to apply each picture element value is normal or not, flexibly adaptive to the position of the picture element on an image pickup plane by providing picture element information contained corresponding to the order of scanning. SOLUTION: A storage device 13 previously stores binary information, which shows whether the plural picture elements arranged on the image pickup plane of a two-dimensional array infrared detector 11 are normal or not, corresponding to the order of scanning and a synchronizing controller 15 drives the two-dimensional array infrared detector 11 according to the order of scanning. At the same time, that binary information is read out. A multiplexer 17 generates image information by correspondently multiplexing the picture element value outputted from the two-dimensional array infrared detector 11 driven like this and the binary information read from this storage device 13. Concerning a device for fetching and processing that image information, this device can be constituted without mounting a memory for previously storing this binary information and a hardware for performing addressing and synchronizing control for referring to that memory.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image pickup apparatus to which a two-dimensional array infrared detecting element is applied as an image pickup element, and to reduce deterioration caused in image information due to a defect in a pixel unit of the image pickup element. The present invention relates to an image information correction device.

[0002]

2. Description of the Related Art Two-dimensional array infrared detectors (Infrared
Focal Plane Array) is a solid-state image sensor, so it is adaptable to seismic resistance and other poor operating environments.
It is often applied to an image pickup device which is required to shoot a target moving at high speed through infrared rays.

However, in such a two-dimensional array infrared detecting element, it is generally difficult under the current manufacturing technology to secure practical characteristics for all semiconductor elements corresponding to individual pixels. In practice, an image information correction apparatus is used that applies a pixel defective rate of several percent and corrects the pixel value obtained from each abnormal pixel.

FIG. 9 is a diagram showing a configuration example of a conventional image information correction apparatus. In the figure, selectors 111 _{1 to} 11
One input of 1 ₁₂ is provided with parallel image information having a predetermined word length (here, 12 bits), and the above-described corrected image information is obtained at these outputs. Also, the image information is given to the other input of the selector corresponding to the bit unit. Selector 111 ₁ to 1
A synchronization signal synchronized with such image information is given to the synchronization input of 11 _{12 and} the input of the memory 112, and the output of the memory is connected to the selection input of the selectors 111 _{1 to} 111 ₁₂ .

In the image information correction apparatus having such a structure,
The two-dimensional array infrared detection element (not shown) that outputs the image information described above is evaluated in advance for each pixel whether or not it is normal, and the binary information indicating the result of the evaluation is applied to the memory 112. It is stored in association with the order of scanning performed under the selected scanning method (hereinafter, referred to as “raster scanning method” for simplicity).

The memory 112 reads the binary information thus stored in synchronization with the above-mentioned synchronizing signal in accordance with the scanning order. When the logical values of the binary information thus read out are values indicating normal pixels, the selectors 111 _{1 to} 111 ₁₂ select and hold the image information provided to one input in bit units. At the same time, the held image information is output.

On the other hand, when the value indicates an abnormal pixel, on the contrary, the selectors 111 _{1 to} 111 ₁₂ take in the image information already held and output in bit units, and input one of the above-mentioned ones. The image information given to the is re-held instead. That is, the selectors 111 _{1 to} 111 ₁₂
The value of each pixel of the image information obtained in the output is not corrected for the pixel value of a normal pixel, but conversely, for the pixel value of an abnormal pixel under the scanning order described above, The pixel value of the pixel preceding the pixel is applied as a substitute value.

[0008]

However, in such a conventional example, for example, when a raster scan method is applied, when an abnormal pixel is located at the left end of the image pickup surface, the image pickup surface is not detected. Since the pixel value of the pixel located at the right end, which is physically separated by a distance above, is applied as the alternative value described above, a large difference between the alternative value and the pixel value of the adjacent normal pixel is generated. There is a high possibility that abnormal pixels are generated and emphasized.

If the abnormal pixel is located at the upper left corner of the image pickup surface, the pixel value of the pixel located at the lower right corner of the preceding frame is applied as a substitute value. The conventional example cannot be applied to applications in which normal pixels are emphasized and, in particular, a state in which a correlation between adjacent frames is extremely small continues or frequently occurs.

Further, when a plurality of abnormal pixels are consecutively positioned on the image pickup surface in the scanning order, the values of these abnormal pixels all become the same value and are similarly emphasized. However, the conventional example cannot be applied. The present invention provides an image pickup apparatus and an image information correction apparatus that are capable of flexibly adapting to the position of an abnormal pixel on an image pickup surface and accurately correcting pixel values obtained from these pixels. To aim.

[0011]

According to a first aspect of the present invention, photoelectric conversion is performed in parallel in the infrared region for a plurality of pixels having a two-dimensional image pickup surface and arranged on the image pickup surface. A two-dimensional array infrared detection element 11 that outputs the pixel values of these pixels, a storage unit 13 that stores in advance a plurality of pixels that are associated with binary information indicating whether the pixels are normal or not, and scanning. The two-dimensional array infrared detecting element 11 is driven according to the order of, and the synchronous control means 15 for sequentially reading the binary information stored in the storage means 13 corresponding to the scanning order, and the driving of each of the plurality of pixels. Below, the pixel value output by the two-dimensional array infrared detection element 11 and the binary information read by the synchronization control means 15 are associated with each other and multiplexed to generate image information. And wherein the door.

According to a second aspect of the present invention, a column of pixel values arranged in the order of scanning and binary information indicating whether or not a pixel giving these pixel values is normal are associated with the pixel. Image information that is taken in and separates the pixel value and the binary information according to the scanning order, and the pixel value separated by the separating means 21 is delayed by a delay corresponding to the interval on the time axis of the pixel. The first delay means 23 is provided in multiple stages in the order of scanning, and the two are separated by the separation means 21.
The value information is obtained by the second delay means 25 which gives delays in multiple stages in the order of scanning and the second delay means 25 corresponding to a specific stage which is a stage before the final stage of the first delay unit 23. Two
When the value information indicates a normal pixel, the pixel value obtained in the specific stage is selected and held, and on the contrary, the abnormal pixel is displayed and the two adjacent stages before and after the specific stage are displayed. When any of the binary information obtained in the corresponding stage indicates a normal pixel, the stage corresponding to any one of the normal pixels among the stages of the first delay unit corresponding to these stages. The selection means 27 is provided for correcting the pixel value of the abnormal pixel by selecting and holding the pixel value obtained in (1).

According to a third aspect of the present invention, a column of pixel values arranged in the order of scanning and binary information indicating whether or not a pixel giving these pixel values is normal are associated with the pixel. Image information that is taken in and separates the pixel value and the binary information according to the scanning order, and the pixel value separated by the separating means 21 is delayed by a delay corresponding to the interval on the time axis of the pixel. The first delay means 23 is provided in multiple stages in the order of scanning, and the two are separated by the separation means 21.
In the value information, a second delay unit 25 that applies delays in multiple stages in the order of scanning, and a second delay unit of a plurality of stages adjacent before and after a specific stage that is a stage before the final stage of the first delay unit 23 The averaging means 31 for obtaining an average pixel value by averaging the pixel values obtained in the stage where the binary information obtained in the corresponding stage of the delay means 25 indicates a normal pixel, and the second averaging means 31 corresponding to the particular stage. When the binary information obtained in the stage of the delay means 25 indicates a normal pixel, the pixel value obtained in the specific stage is selected and held, and on the contrary, it indicates an abnormal pixel and corresponds to a plurality of stages. When any of the binary information obtained in each stage of the second delay means indicates a normal pixel, the average pixel value obtained by the averaging means 31 is selected and held, And a selecting means 33 for correcting the pixel value of the abnormal pixel.

According to a fourth aspect of the present invention, a synchronization control for fetching image information composed of a column of pixel values arranged in a scanning order and sequentially extracting these pixel values in synchronization based on the scanning method. The means 41 and the binary information indicating whether each pixel unique to the image pickup element that gives the pixel value is normal are stored in advance in correspondence with the scanning order, and these are stored under the synchronization obtained by the synchronization control means 41. Pixel information generating means 42 for sequentially reading the binary information of No. 1 and first delay means 43 for giving a delay corresponding to the interval on the time axis of the pixels to the pixel values extracted by the synchronization control means 41 in the scanning order in multiple stages. And 2 read by the pixel information generation means 42.
The value information is obtained in the second delay means 44 which gives delays in multiple stages in the order of scanning, and the second delay means 44 corresponding to a specific stage which is a stage before the final stage of the first delay unit 43. Two
When the value information indicates a normal pixel, the pixel value obtained in the specific stage is selected and held, and on the contrary, an abnormal pixel is displayed, and it corresponds to two adjacent stages before and after the same specific stage. When any one of the binary information obtained in a stage indicates a normal pixel, it is obtained in the stage corresponding to one of the normal pixels among the stages of the first delay means corresponding to these stages. Selection unit 45 for correcting the pixel value of the abnormal pixel by selecting and holding the selected pixel value.

A fifth aspect of the present invention is a synchronization control for fetching image information consisting of a column of pixel values arranged in a scanning order, and sequentially extracting these pixel values in synchronization based on the scanning method. The means 41 and the binary information indicating whether each pixel unique to the image pickup element that gives the pixel value is normal are stored in advance in correspondence with the scanning order, and these are stored under the synchronization obtained by the synchronization control means 41. Pixel information generating means 42 for sequentially reading the binary information of No. 1 and first delay means 43 for giving a delay corresponding to the interval on the time axis of the pixels to the pixel values separated by the synchronization control means 41 in the scanning order. And 2 read by the pixel information generation means 42.
The second delay unit 44 that gives delay to the value information in multiple stages in the order of scanning, and the second delay unit 44 among the plurality of stages that are adjacent before and after the specific stage that is the stage before the final stage of the first delay unit 43. The averaging means 51 that obtains an average pixel value by averaging the pixel values obtained in the stage where the binary information obtained in the corresponding stage of the delay unit 44 indicates a normal pixel, and the second averaging unit 51 corresponding to the particular stage When the binary information obtained in the stage of the delay means 44 indicates a normal pixel, the pixel value obtained in the specific stage is selected and held, and on the contrary, it indicates an abnormal pixel and corresponds to a plurality of stages. When any of the binary information obtained in each stage of the second delay means indicates a normal pixel, the average pixel value obtained by the averaging means 51 is selected and held, And a selection unit 53 for correcting the pixel value of the abnormal pixel.

According to a sixth aspect of the present invention, in the image information correction apparatus according to the third aspect, the image information includes suitability information indicating suitability of application of the average pixel value, and the separating means 21 includes: In addition to the pixel value and the binary information, it includes means for separating the suitability information according to the scanning order, and it is appropriate for the selecting means 33 to apply the average pixel value based on the suitability information separated by the separating means 21. Determine the truth of something,
When the result is false, and any of the binary information individually obtained in the stages of the second delay unit 23 corresponding to the two stages indicates a normal pixel, the first corresponding to these stages. Among the stages of the delay means 23, there is provided a means for selecting and holding a pixel value obtained in a stage corresponding to one of the normal pixels.

According to a seventh aspect of the present invention, in the image information correction apparatus according to the fifth aspect, the image information includes suitability information indicating suitability for application of the average pixel value, and the synchronization control means 41 includes , The pixel value and the suitability information are separated and extracted according to the scanning order, and the selection unit 53 is appropriate to apply the average pixel value based on the suitability information separated by the synchronization control unit 41. If the result is false and any one of the binary information individually obtained in the stages of the second delay means 44 corresponding to the two stages indicates a normal pixel, Among the stages of the first delay means 43 corresponding to the stage, the pixel value obtained in the stage corresponding to any one of the normal pixels is selected and held.

According to an eighth aspect of the present invention, in the image information correction apparatus according to the second aspect, the image information includes a scanning turn-around point and a turn-around point preceding each turn-around point for each pixel position on the imaging surface. Which is a starting point to be set or a section sandwiched between the turning point and the starting point 3
The value information is included together with the binary information, and the separating unit 21 includes a unit that separates the ternary information according to the scanning order together with the pixel value and the binary information, and the ternary value separated by the separating unit 21. The information is provided with a third delay means 61 that gives a delay corresponding to the interval of pixels on the time axis in multiple stages in the order of scanning, and the selection means 27 has a specific stage among the stages of the third delay means 61. When the ternary information obtained in the stage corresponding to the above indicates the starting point, the binary information is limited to each stage from the specific stage to the stage corresponding to the turning point subsequent to the starting point. It is characterized by

According to a ninth aspect of the present invention, in the image information correction apparatus according to the third aspect, the image information includes a scanning turning point and a turning point preceding the turning point for each pixel position on the image pickup surface. Which is a starting point to be set or a section sandwiched between the turning point and the starting point 3
The value information is included together with the binary information, and the separating unit 21 includes a unit that separates the ternary information according to the scanning order together with the pixel value and the binary information, and the ternary value separated by the separating unit 21. The information is provided with a third delay means 61 for giving a delay corresponding to the interval of pixels on the time axis in multiple stages in the order of scanning, and the averaging means 31 is provided with a specific one of the stages of the third delay means 61. When the ternary information obtained in the stage corresponding to the stage indicates a starting point, a means for limiting a plurality of stages from a stage subsequent to the specific stage to a stage corresponding to a turning point following the starting point is included. Is characterized by.

According to a tenth aspect of the present invention, in the image information correction apparatus according to the fourth aspect, the synchronization control means 41 scans the positions of the pixels giving the extracted individual pixel values on the image pickup surface. It includes means for determining a turning point, a starting point preceding the turning point, and a section sandwiched between the turning point and the starting point, and generating ternary information indicating the result, Third delay means 7 which gives to the ternary information generated by the control means 41 a delay corresponding to the interval of pixels on the time axis in multiple stages in the order of scanning.
1, the selection means 45 follows the starting point from the specific step when the ternary information obtained in the step corresponding to the specific step among the steps of the third delay means 71 indicates the starting point. It is characterized in that it includes means for referencing the binary information limited to each stage up to the stage corresponding to the turning point.

The invention described in claim 11 is the image information correcting apparatus according to claim 5, wherein the synchronization control means 41 scans the positions of the pixels giving the extracted individual pixel values on the imaging surface. It includes means for determining a turning point, a starting point preceding the turning point, and a section sandwiched between the turning point and the starting point, and generating ternary information indicating the result, Third delay means 7 which gives to the ternary information generated by the control means 41 a delay corresponding to the interval of pixels on the time axis in multiple stages in the order of scanning.
1, the averaging means 51 is arranged such that, when the ternary information obtained in a stage corresponding to a particular stage among the stages of the third delay means 71 indicates a starting point, the averaging means 51 starts from the stage after the particular stage. It is characterized by including means for limiting a plurality of stages to a stage corresponding to a turning point following the starting point.

In the image pickup device according to the first aspect of the present invention, the two-dimensional array infrared detecting element 1 is stored in the storage means 13.
Binary information indicating whether or not a plurality of pixels arranged on one imaging surface are normal is stored in advance in association with each other in the order of scanning,
The synchronization control means 15 drives the two-dimensional array infrared detection element 11 in accordance with the scanning order and reads the binary information. The multiplexing means 17 multiplexes the pixel value output from the two-dimensional array infrared detection element 11 driven in this way and the binary information read from the storage means 13 as described above in association with each other. As a result, image information is generated.

Since such image information includes binary information indicating, for each pixel value, whether or not the pixel giving the pixel value is normal, in correspondence with the scanning order, the image information is fetched and processed. It is possible to configure a device that does not include a memory that stores these binary information in advance and hardware that performs addressing and synchronous control to refer to the memory.

In the image information correction apparatus according to the second aspect of the invention, the separating means 21 extracts these pixel values and binary information from the image information in which pixel values and binary information are associated in pixel units. Separately, the first delay means 23 and the second delay means 25 provide such pixel values and binary information with delays corresponding to the intervals of the pixels on the time axis in multiple stages in parallel. . The selection unit 27 determines whether the binary information obtained in the stage of the second delay unit 25 corresponding to the specific stage of the first delay unit 23 indicates a normal pixel, and the result of the determination is When it is true, the pixel value obtained in the particular stage is selected, while when it is false, the pixel value of the second delay means corresponding to two stages adjacent before and after such a particular stage is selected. When any one of the binary information obtained in a stage indicates a normal pixel, it is obtained in the stage corresponding to one of the normal pixels among the stages of the first delay means corresponding to these stages. Selected pixels.

That is, since the pixel value obtained from the abnormal pixel is replaced by the pixel value of the normal pixel preceding or succeeding the pixel in the scanning order, the pixel value of such a pixel succeeding such replacement is replaced. As compared with the conventional example in which the pixel value is used alone, the pixel value is corrected flexibly in response to the abnormal pixel arrangement in the frame. In the image information correction apparatus according to the third aspect of the invention, the separating means 21
Separates the pixel value and the binary information from the image information in which the pixel value and the binary information are associated in a pixel unit, and the first delay means 23 and the second delay means 25 respectively In parallel to such pixel values and binary information, delays corresponding to the intervals of pixels on the time axis are applied in multiple stages. The averaging means 31 is provided in a stage corresponding to the stage of the second delaying means 25 which gives the binary information indicating the normal pixel among a plurality of stages adjacent before and after the specific stage of the first delaying means 23. The averaged pixel value is obtained by taking the average of the pixel values.

Further, the selection means 27 determines whether or not the binary information obtained at the stage of the second delay means 25 corresponding to the above-mentioned specific stage indicates a normal pixel, and the result of the determination. Is true, the pixel value obtained in that particular stage is selected, while if false, it is obtained in the individual stages of the second delay means corresponding to the above-mentioned stages. When any of the value information indicates a normal pixel, the averaging means 31
The average pixel value obtained by is selected and held.

That is, since the pixel value obtained from the abnormal pixel is replaced by the average value of the pixel values of the normal pixels preceding and succeeding the pixel in the scanning order, such replacement is succeeding. Compared to the conventional example that was performed only with the pixel value of the pixel, the pixel value is corrected flexibly in response to the abnormal pixel arrangement in the frame, and the pixel value can change rapidly due to the correction. Sex is suppressed.

In the image information correction apparatus according to the fourth aspect of the present invention, the synchronization control means 41 synchronizes with the image information composed of a column of pixel values arranged in the scanning order, and these pixel values are sequentially obtained. Extract. Pixel information generating means 42
Stores in advance the binary information indicating whether each pixel unique to the image pickup element that gives these pixel values is normal in correspondence with the order of scanning, and sequentially stores these binary information under the synchronization described above. read out. The first delaying means 43, the second delaying means 44 and the selecting means 45 are similar to the first delaying means 23, the second delaying means 25 and the selecting means 27 in claim 2, respectively, and the above-mentioned pixel value. Since the pixel value obtained from the abnormal pixel is replaced with the pixel value of the normal pixel preceding or succeeding the pixel according to the scanning order based on the binary information and the binary information, a detailed description thereof will be given here. Omit it.

Therefore, as compared with the conventional example in which such replacement is performed only by the pixel value of the subsequent pixel,
The pixel value is corrected flexibly in response to the abnormal pixel arrangement in the frame. In the image information correction apparatus according to the fifth aspect of the present invention, the synchronization control means 41 synchronizes with the image information composed of the column of pixel values arranged in the scanning order and sequentially extracts these pixel values. The pixel information generation means 42 stores in advance the binary information indicating whether each pixel unique to the image pickup element that gives these pixel values is normal or not in association with the order of scanning, and these are stored under the above-mentioned synchronization. Binary information is sequentially read. First delay means 43, second delay means 44, averaging means 51 and selecting means 53
Are the first delay means 23, the second delay means 25, the averaging means 31, and the selecting means 27, respectively.
Similarly, based on the above-mentioned pixel value and binary information, the pixel value obtained from the abnormal pixel is calculated as an average value of the pixel values of normal pixels preceding or succeeding the pixel according to the scanning order. Since they are replaced, detailed description thereof will be omitted here.

Therefore, as compared with the conventional example in which such replacement is performed only by the pixel value of the subsequent pixel,
The pixel value is flexibly corrected in response to an abnormal pixel arrangement in the frame, and the possibility that the pixel value suddenly changes can be suppressed by the correction. In the image information correction apparatus according to the sixth aspect of the present invention, the image information includes suitability information indicating suitability for application of the average pixel value, and the separating unit 21 includes such suitability information together with the pixel value and the binary information. Separate in scan order. The selection unit 33 determines whether or not the application of the average pixel value is appropriate based on the appropriateness information, and the result is false, and the binary value individually obtained by the second delay unit corresponding to the two stages. When any of the information indicates a normal pixel, the pixel value obtained in the stage corresponding to any one of the normal pixels among the stages of the first delay unit 23 corresponding to these stages is selected. Hold.

That is, the pixel value obtained from the abnormal pixel is adapted to the propriety information contained in the image information, and the pixel value of the normal pixel adjacent to the pixel value and a plurality of adjacent normal pixels are similarly adjusted. Since the pixel value is replaced by either the average value of the pixel values of the different pixels, the pixel value is dynamically corrected by the optimum pixel value for each unit of the frame of the image information or the area formed by dividing the frame. .

In the image information correction apparatus according to the seventh aspect of the present invention, the suitability information indicating suitability for application of the average pixel value is included in the image information, and the synchronization control means 41 includes such suitability information together with the pixel value. Separate in scan order. The selection means 53 determines whether or not the application of the average pixel value is appropriate based on the appropriateness information, and the result is false and is individually obtained in the second delay stage corresponding to the two stages. When any one of the value information indicates a normal pixel, the pixel value obtained in the stage corresponding to any one of the normal pixels is selected from the stages of the first delay unit 43 corresponding to these stages. Hold.

That is, the pixel value obtained from the abnormal pixel is adapted to the propriety information contained in the image information, and the pixel value of the normal pixel adjacent to the pixel value and a plurality of adjacent normal pixels are similarly adjusted. Since the pixel value is replaced by either the average value of the pixel values of the different pixels, the pixel value is dynamically corrected by the optimum pixel value for each unit of the frame of the image information or the area formed by dividing the frame. .

In the image information correction apparatus according to the present invention, the scanning turning point, the starting point preceding the turning point, and the turning point and the starting point are set for each pixel position on the image pickup surface. The image information includes the ternary information indicating which one of the sections sandwiched between the two is included in the image information, and the separating unit 21 separates the ternary information in the scanning order. The third delay means 61 gives a delay corresponding to the interval of pixels on the time axis to the ternary information separated in this way in multiple stages in the order of scanning. The selection means 27
When the ternary information obtained in the stage corresponding to the specific stage among the stages of the third delay means 61 indicates the above-mentioned starting point, the stage corresponding to the turning point subsequent to the starting point from the specific stage. The binary information is referred to in a very limited manner.

That is, since the normal pixel which gives the pixel value to be replaced with the pixel value obtained from the abnormal pixel is limited to the pixel located on the same scanning line as the abnormal pixel, the replacement is performed. This suppresses the possibility that the pixel value changes abruptly.

According to the ninth aspect of the image information correction apparatus of the present invention, with respect to the position of each pixel on the image pickup surface, the scanning turning point, the starting point preceding the turning point, and the turning point and the starting point. The image information includes the ternary information indicating which one of the sections sandwiched between the two is included in the image information, and the separating unit 21 separates the ternary information in the scanning order. The third delay means 61 gives a delay corresponding to the interval of pixels on the time axis to the ternary information separated in this way in multiple stages in the order of scanning. Averaging means 31
When the ternary information obtained in a stage corresponding to a specific stage among the stages of the third delay means 61 indicates the above-mentioned starting point,
A plurality of stages are limited to a stage from a stage subsequent to the specific stage to a stage corresponding to a turning point subsequent to the starting point.

That is, since the normal pixel which gives the average pixel value to be replaced with the pixel value obtained from the abnormal pixel is limited to the one located on the same scanning line as the abnormal pixel, The replacement suppresses the possibility that the pixel value changes abruptly. In the image information correcting apparatus according to the tenth aspect of the present invention, the synchronization control unit 41 has a scanning turn-around point for each pixel position on the imaging surface,
The ternary information indicating whether the starting point preceding the turning point or the section sandwiched between the turning point and the starting point is generated. The third delay means 71 gives such ternary information a delay corresponding to the interval of pixels on the time axis in multiple stages in the order of scanning. The selection means 45 is the third delay means 61.
In the case where the ternary information obtained in a stage corresponding to a specific stage among the stages indicates the above-mentioned starting point, it is limited to each stage from the specific stage to the stage corresponding to the turning point subsequent to the starting point. Then, the binary information is referred to.

That is, since the normal pixel which gives the pixel value to be replaced with the pixel value obtained from the abnormal pixel is limited to the pixel located on the same scanning line as the abnormal pixel, the replacement is performed. This suppresses the possibility that the pixel value changes abruptly. In the image information correction apparatus according to the eleventh aspect of the present invention, the synchronization control unit 41 is configured such that, regarding the position of each pixel on the imaging surface, the scanning turning point, the starting point preceding the turning point, and these turning points. The ternary information indicating which one of the sections sandwiched between the starting point and the starting point is generated. The third delay means 71 gives such ternary information a delay corresponding to the interval of pixels on the time axis in multiple stages in the order of scanning. When the ternary information obtained in a stage corresponding to a specific stage among the stages of the third delay unit 71 indicates the above-mentioned starting point, the averaging unit 51 follows the starting point from the specific stage. A plurality of steps are limited to the steps corresponding to the turning points.

That is, since the normal pixel which gives the average pixel value to be replaced with the pixel value obtained from the abnormal pixel is limited to the one located on the same scanning line as the abnormal pixel, The replacement suppresses the possibility that the pixel value changes abruptly.

[0040]

Embodiments of the present invention will be described below in detail with reference to the drawings.

FIG. 4 is a diagram showing an embodiment corresponding to the invention described in claim 1. In FIG. In the figure, the output of the two-dimensional array infrared detecting element 81 is connected to one input of the multiplexer 82, and an image signal having a word length of 12 bits is obtained at the output. The first output of the timing control unit 83 is connected to the drive input of the two-dimensional array infrared detection element 81 via the drive unit 84, and the second output of the timing control unit is connected to the address input of the memory 85. The output of the memory 85 is connected to the other input of the multiplexing unit 82, and the third output of the timing control unit 83 is connected to the synchronization input of the multiplexing unit 82.

Regarding the correspondence between this embodiment and the block diagram shown in FIG. 1, the synchronization control means 81 corresponds to the two-dimensional array infrared detection element 11, the memory 85 corresponds to the storage means 13, and the timing control is performed. Section 83 and drive section 8
Reference numeral 4 corresponds to the synchronization control means 15, and the multiplexing unit 82 corresponds to the multiplexing means 17. Hereinafter, the operation of the present embodiment will be described.

Whether or not each pixel arranged on the image pickup surface of the two-dimensional array infrared detection element 81 is individually normal is evaluated in advance, and binary information indicating the result of the evaluation is raster-scanned in the memory 85 in the memory 85. The scanning order performed under the method is stored in association with each pixel. Further, the timing control unit 83 uses the raster scan method to drive signals required for scanning each pixel arranged on the image pickup surface of the two-dimensional array infrared detection element 81, and the time for all of these pixels under the scanning. Addresses sequentially indicating these pixels are generated together with the corresponding synchronization signal on the axis.

The drive section 84 supplies the above-mentioned drive signal to the two-dimensional array infrared detecting element 81, and the two-dimensional array infrared detecting element of the pixel showing the image formed on the image pickup surface in response to such a drive signal. Output the pixel value. On the other hand, the memory 85 includes the two-dimensional array infrared detecting element 81.
In parallel with the operation of, the binary information stored in advance corresponding to the above-mentioned address is sequentially read and output.

As shown in FIGS. 5A and 5B, the multiplexer 82 outputs from the memory 85 at the beginning or the end of the pixel value output from the two-dimensional array infrared detecting element 81 in this way. An image signal is generated by associating and adding binary information based on the synchronization signal. As described above, according to the present embodiment, an image signal in which a pixel value and binary information indicating whether the pixel value is normal are multiplexed is generated for each pixel. The correction device can be configured without providing the memory 112 storing the binary information indicating whether the pixel is normal, as in the conventional example shown in FIG.
Moreover, since it is not necessary to synchronize the memory 112 to refer to it, the hardware configuration is simplified.

FIG. 6 corresponds to the invention described in claims 2-11.
It is a figure which shows the corresponding embodiment. In the figure, the separation unit 9
An image signal is given to the input of 1 and its image output (here
For simplicity, the word length is 12 bits and each pixel
The pixel value of is to be given. ) Is the pixel value correction unit 92₁
~ 92₁₂ Connected to the input of Pixel value correction unit 92 ₁~ 9
2₁₂ The preceding pixel output and the subsequent pixel output of
Connected to the corresponding input of the device 93, the output of which is
Masabe 92₁~ 92₁₂ Connected to the composite input of. Separation part 9
The 8-bit control output of 1 corresponds to that of the decoder 94.
Connected to the input, and the input I of the decoder has a logical value
"0" is given. The output of the decoder 94 is the pixel value complement
Masabe 92₁~ 92₁₂ Connected to the select input of. Separation part 9
The clock output of 1 is the pixel value correction unit 92₁~ 92₁₂ Black
The pixel value is corrected in the output.
Image information is output.

In the pixel value correction unit 92 ₁ , the above-mentioned inputs are connected to the input of the shift register 95 ₁ and the input A of the selector 96 ₁ , and the first stage, the second stage and the fourth stage of the shift register are connected. The outputs are respectively connected to the inputs B, C and E of the selector 96 ₁ . The output of the third stage of the shift register 95 ₁ is connected to the input D of the selector 96 ₁ and the above-mentioned preceding pixel output, and similarly, the above-mentioned composite input is connected to the input I of the selector 96 ₁ . The output of the selector 96 ₁ is connected to the D input of the flip-rop 97 ₁ and its output is connected to the input F of the selector, the subsequent pixel output and the output described above. The selection input of the selector 96 ₁ is connected to the selection input described above, and the clock terminals of the shift register 95 ₁ and the flip-flop 97 ₁ are also connected to the clock input described above. Further, the input S of the selector 96 ₁ has a predetermined constant logical value (here, “0” for simplicity, and hereinafter, a word formed of a set of these logical values is referred to as “word S”). Is given.

Since the pixel value correction units 92 _{2 to} 92 _{12 have} the same configuration as the pixel value correction unit 92 ₁ described above, the corresponding components are assigned subscripts “2” to “12”. The same reference numeral will be given, and the description and illustration thereof will be omitted here. Regarding the correspondence relationship between the present embodiment and the block diagram shown in FIG. 2, the separation unit 91 corresponds to the separation unit 21, the second delay unit 25, and the third delay unit 61, and the shift registers 95 _{1 to} 95. ₁₂
The flip-flops 97 _{1 to} 97 ₁₂ correspond to the first delay means 23, and the decoder 94 and the selectors 96 _{1 to} 9
6 ₁₂ and flip-flops 97 _{1 to} 97 ₁₂ correspond to the selecting means 27 and 33, and the selecting means 93 is the averaging means 3
Corresponds to 1.

FIG. 7 is a diagram (1) for explaining the operation of this embodiment. FIG. 8 is a diagram (2) illustrating the operation of this embodiment. Hereinafter, referring to FIG. 6 to FIG.
The operation of the embodiment corresponding to the invention described in 8 will be described.
As shown in FIGS. 5A and 5B, the image information given to the separation unit 91 includes a pixel value and binary information indicating whether or not each pixel is normal in the scanning order. .

The separating unit 91 takes in such image information, generates a clock synchronized with each pixel, and assumes the above-mentioned pixel value (here, the word length is 12 bits for simplicity. ) And binary information are separated,
The pixel value and the clock and the pixel value correction unit 92 ₁ to 92 ₁₂
Give to. Further, the separation unit 91 sequentially writes the binary information separated in this way into a built-in five-stage shift register (not shown), and the bit a given to the input end of the shift register and each stage. And the bits obtained in parallel with the output of the above (here, for simplification, the identifiers b, c, d, e, and f are shown in order from the frontmost stage, respectively). In addition, these bits a to f
Is included in the above-mentioned 8 bits, and the 8 bits further include bits R and L.

The separating unit 91 determines whether or not the pixel to which the binary signal is given by the bit e is located at either the right end or the left end of the image pickup surface under the applied scanning method. If it is located, the logical value of bit R is set to "1", and if it is located at the left end, the logical value of bit L is "1".
Set to, but if it is not located in any of these,
The logical values of the bits R and L are both set to "0" and given to the decoder 94.

In the pixel value correction units 92 _{1 to} 92 ₁₂ , the shift registers 95 _{1 to} 95 ₁₂ respectively take in the pixel values supplied from the separation unit 91 in synchronization with the clock in bit units in parallel as described above. By performing the parallel-serial conversion, the words B to E output from each stage and the word A input to the frontmost stage are given to the selectors 96 _{1 to} 96 ₁₂ . further,
The flip-flops 97 _{1 to} 97 ₁₂ are selectors 96 _{1 to} 9
6 ₁₂ generates a word F by giving a delay equal to one cycle of the above-mentioned clock to the pixel value to be output as will be described later, and supplies the word F to these selectors in the same manner as the above-mentioned words A to E. .

The decoder 94 uses a 4-bit code to combine the logical value of the bit (logical value is fixedly set to "0") given to its input I and the above-mentioned bits a to f, R and L. encodes give to the selector 96 ₁ to 96 _12. The selectors 96 _{1 to} 96 ₁₂ appropriately select any one of the words A to F and I as shown below according to the code given in this way. Note that, here, the pixel value to be corrected is given by the word E for simplicity.

When the logical values of the bits R and L are both "0", the pixel whose pixel value is given by the word E is shown in FIG.
As shown by shading, it is not located at either the left end or the right end of the imaging surface. In such a case, when the logical value of the bit e is "1", the selectors 96 _{1 to} 96 ₁₂
Indicates that the logical values of both bits d and f are "0" or "1".
Or ((1) and (2) in FIG. 7), the logical value of bit d is "1"
Then, when the logical value of the bit f is "0" (FIG. 7 (3)), the word F following the word E given by the normal pixel is selected instead of the word E.

[0055] However, the bits d, f, logical values of bits f is "1" a logic value of the bit d to is "0" (FIG. 7 (4)) Sometimes, the selector 96 ₁ to 96 ₁₂ Is the word E
The word D following is selected instead of the word E. Further, when the logical values of the bits R and L are “0” and “1”, respectively, the pixel whose pixel value is given by the word E is imaged as shown by hatching in FIG. 8 (b). Located on the left edge of the plane. In such a case, the selectors 96 _{1 to} 96 ₁₂ select bit d → bit c → bit b → of bits d, c, b, and a.
A word (for example, word D for bit d) in uppercase of an identifier indicating a priority value having a logical value of “0” under the priority order of bit a is selected instead of word E (FIG. 7
(5)-(8)).

However, when all the logical values of these bits d, c, b and a are "1", the selector 96 ₁
˜96 ₁₂ selects word S instead of word E (FIG. 7).
(9)). Further, when the logical values of the bits R and L are “1” and “0”, respectively, the pixel to which the pixel value is given by the word E is imaged as shown by hatching in FIG. 8 (c). Located on the right edge of the plane. In such a case, the selector 96
_{1 to} 96 ₁₂ are irrespective of the logical value of the bit f,
The word F is selected instead of the word E (FIGS. 7 (10) to (11)).

That is, if the pixel value E of an abnormal pixel is not located at either the left end or the right end on the image pickup surface, the pixel value E is the closest to the subsequent or preceding position in the scanning order. When the pixel value of a certain normal pixel is reliably replaced and is located at either the left end or the right end, on the contrary, it is positioned on the scanning line formed with the abnormal pixel as one end. Similarly, the pixel value of the most recent normal pixel is replaced.

Therefore, according to this embodiment, the pixel value of the pixel is corrected while flexibly adapting to the position of the abnormal pixel on the image pickup surface as compared with the conventional example. In the present embodiment, the pixel value obtained from the abnormal pixel is replaced with the pixel value of another pixel located on the scanning line where the pixel is located, but the present invention is limited to such a configuration. Without
If the real-time property is ensured, the pixel value of a normal pixel located on another scanning line adjacent on the frame (imaging surface) may be applied.

Hereinafter, referring to FIG. 6 to FIG.
The operation of this embodiment corresponding to the invention described in 9 will be described. In the present embodiment, the separation unit 91, the decoder 94, the shift registers 95 _{1 to} 95 ₁₂ and the flip lop 97 ₁
Since the operations from 9 to 97 ₁₂ are the same as the operations in the embodiment corresponding to the invention described in claim 2, the description thereof will be omitted here.

In the present embodiment, the decoder 94 is provided with a bit "1" which is given to its input I by a logical value "1" which is the opposite of that of the embodiment corresponding to the invention described in claim 2 described above. The combination of the logical values of the bits a to f, R, and L described above is encoded into a 4-bit code and given to the selectors 96 _{1 to} 96 ₁₂ . Further, the adder 93 adds the word F and the word D, and obtains the sum (hereinafter, “word I”) obtained as a result.
That. ) Is given to the selectors 96 _{1 to} 96 ₁₂ .

When the logical values of the bits R and L are both "0" and the logical value of the bit e is "1" according to the above-mentioned code, the selectors 96 _{1 to} 96 ₁₂ perform the following operations. As shown, either word I or F is selected. It should be noted that the pixel value to be corrected is given by the word E as in the embodiment corresponding to the invention described in claim 2.

The selectors 96 _{1 to} 96 ₁₂ have the bits d and f.
7 are both "0", or (FIG. 7 (12)) the bit f has a logic value of "1" and the bit d has a logic value of "0".
(FIG. 7 (13)), the word I is selected in place of the word E. However, the logical value of bit d is “1” and the logical value of bit f is “0” (FIG. 7 (14)), bit d,
When both logical values of f are “1” (FIG. 7 (15)),
The selectors 96 _{1 to} 96 ₁₂ select the word F preceding the word E in place of the word E.

That is, if the pixel value of the abnormal pixel is not located at either the left end or the right end on the image pickup surface, and the following pixels are normal in the scanning order, Since the preceding pixel according to such a scanning order has already been corrected under the application of the invention according to claim 2,
Regardless of whether or not the preceding pixel is normal, it is replaced with the average value of the pixel values of these two pixels, and is reliably corrected.

Therefore, according to this embodiment, as in the embodiment corresponding to the invention described in claim 2, instead of the pixel value of the abnormal pixel, a normal pixel located around the pixel on the image pickup surface is used. The correlation between these pixel values is kept higher than when applying the pixel values of different pixels, and the pixel values may change unnaturally and sharply in the region including such abnormal pixels. It can be kept low.

In the embodiments corresponding to the inventions described in claims 2 and 3, the separating units 91, 100 and 102 are used.
Generates bits R and L corresponding to each pixel in the process of establishing synchronization with the image information based on the format of the image information. However, the present invention is not limited to such a configuration and, for example, When the image information includes these bits R and L, the separation units 91, 100, and 102 may be configured to extract these bits based on the format of the image information.

Embodiments of the present invention corresponding to the inventions described in claims 4, 5, 10 and 11 will be described below. The difference between the present embodiment and the embodiments corresponding to the inventions described in claims 2 and 3 described above is that, as shown in FIG. 6, a separating unit 100 is provided instead of the separating unit 91, and the separating unit 100 is provided. The ROM 101 is provided between the section 100 and the decoder 94.

The block diagram shown in this embodiment and FIG.
With respect to the correspondence relationship with the
A shift register corresponding to the first and second delay means 44.
95 ₁~ 95₁₂ And flip-flop 97₁~ 97₁₂ 
Corresponds to the first delay means 43, and includes a decoder 94 and a selector.
96₁~ 96₁₂ And flip-flop 97₁ ~ 97
₁₂Corresponds to the selecting means 45, and the selecting means 93 is an averaging means.
Corresponding to 51, the ROM 101 is the pixel information generating means 42.
Corresponding.

Hereinafter, referring to FIG.
The operation of this embodiment corresponding to the inventions 0 and 11 will be described. The image information given to the separation unit 100 includes binary information indicating whether or not the pixel corresponding to each pixel value is normal, as in the embodiments according to the inventions of claims 2 and 3. Is not included.

[0069] separating unit 100, by dividing the bits in the order of scanning the pixel value of each pixel takes in such image information, the pixel value correction unit 92 ₁ to 92 ₁₂
And the bits R and L are generated in the same manner as the invention described in claims 2 and 3. Further, the separating unit 10
0 generates an address indicating the position of the pixel forming each frame according to the above-described scanning order, and outputs the address in place of the bits a to f described above.

On the other hand, the ROM 101 pre-stores binary information indicating whether or not each pixel is normal for the two-dimensional array infrared detecting element for giving an image signal in association with the scanning order of these pixels. . Furthermore, the ROM 101
Are bits e, f, d to a indicating whether or not the pixel indicated by the address, one pixel preceding the pixel, and the five pixels following the pixel are normal based on the above-mentioned address. Are sequentially output.

Therefore, the decoder 94 has the selector 9
6 _{1-96 12} similarly to the embodiment of the invention according to claims 2 and 3 with respect to providing a code. The operations of the pixel value correction units 92 _{1 to} 92 ₁₂ and the adder 93 are the same as those of the embodiments corresponding to the inventions described in claims 2 and 3, and therefore the description thereof is omitted here.

As described above, according to the present invention, even when the image information does not include the binary information indicating whether or not each pixel is normal, the invention according to claims 2 and 3 can be realized. Similarly to the corresponding embodiment, the pixel value can be corrected while flexibly adapting to the abnormal pixel arrangement on the imaging surface. Hereinafter, embodiments of the present invention corresponding to the inventions described in claims 6 and 7 will be described.

The difference between the present embodiment and the embodiment corresponding to the invention described in claim 4 is that, as shown in FIG. 6, a separating section 102 is provided instead of the separating section 100, and The point is that a decoder 103 is provided instead of the decoder 94. Hereinafter, the operation of the present embodiment corresponding to the invention described in claims 6 and 7 will be described with reference to FIG.

The image information given to the separating unit 102 includes
Similar to the embodiment corresponding to the invention described in claim 4, binary information indicating whether or not the pixel giving the pixel value is normal is not included for each pixel value, but a predetermined block (for example, , Correction of the pixel value related to the abnormal pixel for each frame or scanning line, the average of the pixel values obtained from the normal pixel (and the preceding normal pixel) following the pixel in the order of scanning is taken. Included is bit I, which indicates whether to apply or not.

[0075] separating unit 102, by dividing the pixel value of each pixel takes in such image information in bit units in the order of scanning, along with providing the pixel value correcting unit 92 ₁ to 92 _12, in claim 4 The bits R and L are generated in the same manner as the embodiment corresponding to the described invention, and the bit I described above is used.
Is extracted. Further, the separating unit 102 generates an address in the same manner as the embodiment corresponding to the invention described in claim 4.

Further, the ROM 101 sequentially outputs the bits e, f, d to a on the basis of such an address as in the embodiment corresponding to the invention described in claim 4, and the decoder 94 outputs these bits. Together with the above-mentioned bits R and L, the bit I extracted by the separation unit 102 is taken in, and coded to the selectors 96 _{1 to} 96 ₁₂ in the same manner as the embodiment corresponding to the invention according to claim 2. give.
The operations of the pixel value correction units 92 _{1 to} 92 ₁₂ and the adder 93 are the same as those of the embodiments corresponding to the inventions described in claims 2 and 3, and therefore the description thereof is omitted here.

As described above, according to the present invention, even when the image information includes the bit I whose logical value changes in units such as a frame, a scanning line, and the like, the invention according to claim 2 or 3 is dealt with. In the above-described embodiment, the pixel value correction calculation that is performed while corresponding to the logical value is dynamically and reliably applied. Therefore, in addition to the abnormal pixel arrangement on the imaging surface, the pixel value can be corrected while flexibly adapting to the correlation of the pixel value column included in the unit of the frame or the scanning line.

In the present embodiment, the image information does not include binary information indicating whether the pixel unit is correct or not, but the present invention is not limited to such a configuration. For example, such binary information is If included, the separation unit 91 is arranged in place of the separation unit 102, and the decoder 9 is replaced in place of the decoder 103.
It is also possible to arrange 4 and not to arrange ROM 101.

Further, in the embodiments corresponding to the invention described in claims 2 to 5, the pixel value applied in place of the pixel value of the abnormal pixel is a normal pixel located on the same scanning line as that pixel. Although only pixel values of pixels are provided, the present invention is not limited to such a configuration. For example, the number of stages of the shift registers 95 _{1 to} 95 ₁₂ is set to a large number within a range where real-time performance can be secured, and the preceding Alternatively, the pixel value of a normal pixel located on the subsequent scan line may be applied.

Furthermore, in the embodiment corresponding to the invention described in claim 3, the adder 93 has one preceding pixel and one succeeding normal pixel with respect to the abnormal pixel in the scanning order. However, the present invention is not limited to such a configuration. For example, regarding the number of normal pixels to be subjected to such calculation, It is also possible to use a plurality of numbers within a range where time can be secured.

Further, in the embodiment corresponding to the invention described in claim 3, the above-mentioned average value is obtained by simple addition, but the present invention is not limited to such arithmetic operation,
For example, a moving average method, an exponential smoothing method, or any other calculation method may be applied.

Further, claim 2 to claim 11
In the embodiment corresponding to the invention of FIG.₁~ 96
₁₂ Is the shift register 95₁~ 95₁₂ And flip flo
97 ₁~ 97₁₂ It is arranged between the stage and
Are not limited to such a configuration, for example
Formed by directly connecting a register and a flip-flop
Selector 96 is provided after the shift register.₁~ 96₁₂ Place
The pixel value of the pixel to be corrected
When the pixel value to be applied is the same as the pixel value output earlier
To the sign update that should be given for these selectors
The operation of a latch that holds or holds the pixel value available at the output
The work may be suspended.

Further, in the embodiments corresponding to the inventions described in claims 2 to 11, the single pixel value corrected in advance is held in the flip-flops 97 _{1 to} 97 _12. The invention is not limited to such a configuration. For example, instead of such a flip-flop, a shift register for accumulating pixel values for a plurality of preceding pixels is arranged, and any one of these pixel values is set as an alternative pixel value. Alternatively, it may be configured to be a calculation target for calculating an average pixel value.

Further, in such a case, the bit indicating whether or not the pixel is normal with respect to the previously corrected pixel value is rewritten to the logical value indicating the normal pixel to replace the alternative pixel value or the average. It may be configured to obtain the pixel value.

[0085]

As described above, according to the first aspect of the present invention, image information including binary information indicating whether or not a pixel giving an individual pixel value is normal is obtained in the scanning order. A device that takes in and processes the image information can be configured without installing a memory that stores these binary information in advance and hardware that performs addressing and synchronization control to refer to the memory. Becomes

According to the second aspect of the invention, the pixel value obtained from the abnormal pixel is replaced with the pixel value of the normal pixel preceding or succeeding the pixel in the scanning order, and such replacement is performed. The pixel value is corrected while flexibly responding to the abnormal pixel arrangement in the frame, as compared with the conventional example in which the pixel value of the subsequent pixel is used only. In the invention described in claim 3, since the pixel value obtained from the abnormal pixel is replaced with the average value of the pixel values of the normal pixels preceding and succeeding the pixel in the scanning order, Compared to the conventional example in which the replacement is performed only by the pixel value of the subsequent pixel, the pixel value is corrected while flexibly responding to the abnormal pixel arrangement in the frame, and the pixel value is sharply corrected by the correction. The possibility of changing to

According to the fourth aspect of the invention, the pixel value obtained from the abnormal pixel is replaced with only the pixel value of the pixel succeeding the pixel in the scanning order, as compared with the conventional example. It is possible to flexibly cope with the normal pixel arrangement. In the invention described in claim 5, as compared with the conventional example in which the pixel value obtained from the abnormal pixel is replaced only with the pixel value of the pixel succeeding the pixel in the scanning order, the abnormal pixel in the frame The arrangement can be flexibly dealt with, and the possibility that the pixel value suddenly changes due to the replacement can be suppressed.

According to the sixth and seventh aspects of the invention, the pixel value obtained from the abnormal pixel is adapted as the pixel value of the normal pixel adjacent to the pixel in conformity with the suitability information contained in the image information. Similarly, the pixel value is corrected by the optimum pixel value for each unit of the image information frame and the area formed by dividing the frame by replacing either one of the average pixel values of a plurality of adjacent normal pixels. It is done dynamically.

According to the invention described in claims 8 to 11, a normal pixel which gives a pixel value to be replaced with a pixel value obtained from an abnormal pixel or an average pixel value is scanned in the same scan as the abnormal pixel. Since it is limited to those located on the line, the possibility that the pixel value suddenly changes due to the replacement is suppressed. Therefore, in the video equipment to which these inventions are applied, it is possible to obtain a high-quality image or image information while adapting to the variety of the abnormal pixels unique to the two-dimensional array infrared detection element and the arrangement on the imaging surface. Performance is improved.

[Brief description of the drawings]

FIG. 1 is a principle block diagram of the invention according to claim 1;

FIG. 2 is a principle block diagram of the invention described in claims 2, 3, 6, 8, and 9.

FIG. 3 is a principle block diagram of the invention according to claims 4, 5, 7, 10, and 11.

FIG. 4 is a diagram showing an embodiment corresponding to the invention described in claim 1;

FIG. 5 is a diagram showing a format of image information.

FIG. 6 is a diagram showing an embodiment corresponding to the invention described in claims 2 to 11.

FIG. 7 is a diagram (1) explaining the operation of the present embodiment.

FIG. 8 is a diagram (2) explaining the operation of the present embodiment.

FIG. 9 is a diagram showing a configuration example of a conventional image information correction apparatus.

[Explanation of symbols]

 11, 81 Two-dimensional array infrared detection element 13 Storage means 15 Synchronization control means 17 Multiplexing means 21 Separation means 23, 43 First delay means 25, 44 Second delay means 27, 33, 45, 53 Selection means 31, 51 averaging means 41 synchronization control means 42 pixel information generating means 61, 71 third delay means 82 multiplex section 83 timing control section 84 driving section 85, 112 memories 91, 100, 102 separating section 92 pixel value correcting section 93 adder 94, 103 Decoder 95 Shift register 96, 111 Selector 97 Flip-rop 101 ROM

─────────────────────────────────────────────────── ─── Continuation of the front page (51) Int.Cl. ⁶ Identification code Internal reference number FI Technical indication location H04N 1/413 H04N 5/335 P 5/335 1/40 101Z (72) Inventor Hiroki Shimozene Kanagawa 1333 Kamiodanaka, Nakahara-ku, Kawasaki-shi, Japan Inside Fujitsu System Integration Laboratories, Inc. (72) Inventor Masaki Kamata 1333, Kamiodanaka, Nakahara-ku, Kawasaki-shi, Kanagawa Inside Fujitsu System Integration Laboratories

Claims (11)

[Claims] 1. A two-dimensional array infrared ray having a two-dimensional image pickup surface and performing photoelectric conversion in parallel in a region of infrared rays on a plurality of pixels arranged on the image pickup surface to output pixel values of these pixels. A sensing element, a storage unit that stores in advance binary information indicating whether or not the plurality of pixels are normal in association with each other in the order of scanning, and drives the two-dimensional array infrared sensing element according to the order of scanning. And a synchronization control means for sequentially reading out the binary information stored in the storage means in correspondence with the scanning order, and for each of the plurality of pixels, output by the two-dimensional array infrared detection element under the drive. An image pickup apparatus comprising: a multiplexing unit that multiplexes the pixel value and the binary information read by the synchronization control unit in association with each other to generate image information. 2. A column of pixel values arranged in the order of scanning and binary information indicating whether or not a pixel giving these pixel values is normal are fetched with image information associated with the pixel, Means for separating the pixel value and the binary information in accordance with the scanning order, and the pixel values separated by the separating means are provided with delays corresponding to the intervals of the pixels on the time axis in multiple stages in the scanning order. A first delay unit, a second delay unit that applies the delay to the binary information separated by the separation unit in multiple stages in the scanning order, and a stage before the final stage of the first delay unit. When the binary information obtained in the stage of the second delay means corresponding to the stage indicates a normal pixel, the pixel value obtained in the specific stage is selected and held, and conversely the abnormal pixel And adjoin before and after that particular column. When any of the binary information obtained in the stages corresponding to the two stages indicates a normal pixel, any one of the normal pixels in the stages of the first delay unit corresponding to these stages. An image information correction apparatus comprising: a selection unit that corrects a pixel value of an abnormal pixel by selecting and holding a pixel value obtained in a stage corresponding to one side. 3. A column of pixel values arranged in the order of scanning and binary information indicating whether or not the pixels giving these pixel values are normal are fetched with image information associated with the pixels, Means for separating the pixel value and the binary information in accordance with the scanning order, and the pixel values separated by the separating means are provided with delays corresponding to the intervals of the pixels on the time axis in multiple stages in the scanning order. A first delay unit, a second delay unit that applies the delay to the binary information separated by the separation unit in multiple stages in the scanning order, and a stage before the final stage of the first delay unit. Of a plurality of stages adjacent to each other before and after the stage, the average pixel value is obtained by averaging the pixel values obtained in the stage in which the binary information obtained in the corresponding stage of the second delay means indicates a normal pixel. Corresponding to the averaging means to obtain and the specific stage When the binary information obtained in the stage of the second delay means indicates a normal pixel, the pixel value obtained in the specific stage is selected and held, and on the contrary, an abnormal pixel is indicated, and When any of the binary information obtained in each stage of the second delay means corresponding to a plurality of stages indicates a normal pixel, the average pixel value obtained by the averaging means is selected and held. By doing so, an image information correction apparatus comprising: a selection unit that corrects the pixel value of the abnormal pixel. 4. A synchronization control means for fetching image information consisting of a column of pixel values arranged in a scanning order, and sequentially extracting these pixel values in synchronization based on the scanning method, and the pixel value Binary information indicating whether each pixel unique to a given image sensor is normal is stored in advance in correspondence with the scanning order, and these binary information are sequentially stored under the synchronization taken by the synchronization control means. Pixel information generation means for reading; first delay means for delaying pixel values extracted by the synchronization control means, the delays corresponding to intervals on the time axis of the pixels in the scanning order; and the pixel information generation means. Second delay means for applying the delay to the binary information read by the means in multiple stages in the scanning order, and the second delay means corresponding to a specific stage that is a stage before the final stage of the first delay unit. Late When the binary information obtained in the step of the means indicates a normal pixel, the pixel value obtained in the specific step is selected and held, and on the contrary, it indicates an abnormal pixel and is adjacent to the same specific front and rear. When any one of the binary information obtained in the stages corresponding to the two stages indicates a normal pixel, any one of the normal pixels in the stages of the first delay unit corresponding to these stages. An image information correction apparatus comprising: a selection unit that corrects a pixel value of an abnormal pixel by selecting and holding a pixel value obtained in a stage corresponding to one side. 5. A synchronization control means for fetching image information consisting of a column of pixel values arranged in a scanning order and sequentially extracting these pixel values in synchronization based on the scanning method, and the pixel value Binary information indicating whether each pixel unique to a given image sensor is normal is stored in advance in correspondence with the scanning order, and these binary information are sequentially stored under the synchronization taken by the synchronization control means. Pixel information generation means for reading; first delay means for delaying pixel values separated by the synchronization control means in multiple stages in the order of the scanning, corresponding to the intervals of the pixels on the time axis; A second delay unit that applies the delay to the binary information read by the unit in multiple stages in the scanning order, and a plurality of adjacent units before and after a specific stage that is a stage before the final stage of the first delay unit. of Averaging means for obtaining an average pixel value by averaging the pixel values obtained in the stage where the binary information obtained in the corresponding stage of the second delay means indicates a normal pixel, When the binary information obtained in the stage of the second delay means corresponding to the pixel indicates a normal pixel, the pixel value obtained in the specific stage is selected and held, and on the contrary, an abnormal pixel is indicated, And when any of the binary information obtained in each stage of the second delay unit corresponding to the plurality of stages indicates a normal pixel, the average pixel value obtained by the averaging unit is selected. And an image information correction apparatus, comprising: a selection unit that corrects the pixel value of the abnormal pixel by holding the pixel value. 6. The image information correction apparatus according to claim 3, wherein the image information includes suitability information indicating suitability for application of the average pixel value, and the separating means separates the pixel value and the binary information. At the same time, it includes means for separating the suitability information according to a scanning order, and the selecting means determines whether the application of the average pixel value is appropriate based on the suitability information separated by the separating means. , When the result is false and any of the binary information individually obtained in the stages of the second delay means corresponding to the two stages indicates a normal pixel, the first stage corresponding to these stages The image information correction apparatus further comprises means for selecting and holding a pixel value obtained in a stage corresponding to any one of the normal pixels of the stages of the delay means. 7. The image information correction apparatus according to claim 5, wherein the image information includes suitability information indicating suitability for application of the average pixel value, and the synchronization control unit stores the pixel value and the suitability information. A means for separating and extracting in accordance with the order of scanning, the selecting means determines whether the application of the average pixel value is appropriate based on the suitability information separated by the synchronization control means,
When the result is false and when any of the binary information individually obtained in the stages of the second delay means corresponding to the two stages indicates a normal pixel, the first information corresponding to these stages is obtained. An image information correction apparatus comprising means for selecting and holding a pixel value obtained in a stage corresponding to one of the normal pixels of the stages of the delay means. 8. The image information correction apparatus according to claim 2, wherein the image information includes, for each pixel position on the imaging surface, a scanning turning point, a starting point preceding the turning point, and these turning points. Three-valued information indicating whether it is a section sandwiched between a point and a starting point is included together with the two-valued information, and the separation means scans the three-valued information in addition to the pixel value and the two-valued information. And a third delay unit for giving the three-valued information separated by the separation unit a delay corresponding to the interval of the pixels on the time axis in multiple stages in the scanning order. When the ternary information obtained in a stage corresponding to a specific stage among the stages of the third delay unit indicates the starting point, the means corresponds to a turnaround point following the starting point from the specific stage. It is limited to each stage up to An image information correction apparatus comprising means for referring to value information. 9. The image information correction apparatus according to claim 3, wherein the image information includes, for each pixel position on the imaging surface, a scanning turning point, a starting point preceding the turning point, and these turning points. Three-valued information indicating whether it is a section sandwiched between a point and a starting point is included together with the two-valued information, and the separation means scans the three-valued information in addition to the pixel value and the two-valued information. And a third delay unit for providing the three-valued information separated by the separation unit with delays corresponding to the intervals of the pixels on the time axis in multiple stages in the scanning order. When the ternary information obtained in the stage corresponding to a specific stage among the stages of the third delay unit indicates the starting point, the converting unit turns back from the stage subsequent to the specific stage to the starting point. Multiple stages up to the stage corresponding to the point An image information correction apparatus including means for limiting the above. 10. The image information correction apparatus according to claim 4, wherein the synchronization control unit includes a scanning turn-around point and a turn-around point for the position of the pixel giving the extracted individual pixel value on the imaging surface. It includes a unit that determines which of the preceding starting point and a section sandwiched between these turnaround points and the starting point, and generates ternary information indicating the result, and which is generated by the synchronization control unit. The value information is provided with a third delay unit that gives a delay corresponding to the interval of the pixels on the time axis in multiple stages in the order of the scanning, and the selection unit includes a specific one of the stages of the third delay unit. When the ternary information obtained in the tier corresponding to the tier indicates the starting point, the binary information is referred to only in each tier from the particular tier to the tier corresponding to the turning point subsequent to the tier. Characterized by including means Image information correction device. 11. The image information correction apparatus according to claim 5, wherein the synchronization control unit includes a scanning turn-around point and a turn-around point for the position of the pixel that gives each extracted pixel value on the imaging surface. It includes a unit that determines which of the preceding starting point and a section sandwiched between these turnaround points and the starting point, and generates ternary information indicating the result, and which is generated by the synchronization control unit. The value information is provided with a third delay unit that gives a delay corresponding to the interval of the pixels on the time axis in multiple stages in the order of the scanning, and the averaging unit is specified among the stages of the third delay unit. When the ternary information obtained in the stage corresponding to the stage indicates the starting point, means for limiting the plurality of stages from the stage after the specific stage to the stage corresponding to the turning point following the starting point is provided. Image information characterized by including Correction device.