JP2012217082A - Imaging apparatus, signal processing apparatus and imaging method, signal processing method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To improve tracking of moving smear due to movement of a high luminance object while removing noise mixed in the smear well.SOLUTION: A solid state image sensor 101 reads only the image data containing a smear component and the smear data in order for each predetermined line. The image data thus read is extracted after AD conversion and stored in a memory circuit 104, and the smear data thus read is extracted after AD conversion and stored in a memory circuit 105. Noise is removed from the smear data thus extracted by a noise removal circuit 106. A subtraction circuit 107 subtracts from the image data thus stored, the smear data adjoining the position of the image data and from which noise is removed, thus removing the smear component from the image data. A smear movement detection circuit 108 and a coefficient calculation circuit 109 calculate the values of coefficients used in the noise removal circuit 106 for noise removal.

Description

  The present invention relates to an image pickup apparatus and a signal processing apparatus for correcting and improving image quality degradation caused by smear that occurs when a high-luminance subject is picked up in a camera system using a CCD.

  Generally, in a camera system using a CCD, smear occurs when a high-luminance subject is imaged. In this smear, charges accumulated in the photodiode leak to the vertical transfer CCD, and charge transfer is read out by the leaked vertical transfer CCD, so that the image read from the CCD does not exist in the subject. It is a phenomenon that a normal vertical line enters.

  Conventionally, there is a technique disclosed in Patent Document 1 as a technique for correcting the smear. This technology utilizes the fact that smear is present in the vertical OB area as well, stores the data in the vertical OB area in the line memory, and simultaneously reads out the data in the line memory when the exposure area data is read out. Thus, smear correction is performed by subtracting the data in the line memory from the exposure area data.

JP 2007-110375 A

  However, the conventional technique is configured to perform smear subtraction correction using the data in the vertical OB area stored in the line memory, and the data in the vertical OB area can be updated only for each frame. As a result, for example, when a high-luminance subject moves during reading of data for one frame, the smear moves simultaneously with the high-luminance subject. At this time, the smear is as described above. It does not become a vertical line with aligned rows, but a diagonally wavy line. As a result, the exposure area data read before the high-brightness object moves is subtracted and corrected with the data in the vertical OB area stored in the line memory to correct smear correctly, but it is read after the high-brightness object moves. Even if the exposed exposure area data is subtracted and corrected with the data of the vertical OB area stored in the line memory, the smear remains at the place where the new smear has occurred, and the smear remains, and the vertical line However, there is a drawback that smear subtraction correction is performed at a place where there was originally no smear, image data is lost, and image quality deteriorates.

  The present invention solves the above-described conventional problems, and an object of the present invention is to improve the followability of smear correction when a high-luminance subject moves in an imaging apparatus using a CCD.

  In order to achieve the above object, the present invention reads out image data and smear data corresponding to the image data in a horizontal line unit in an effective image area, and subtracts and corrects the corresponding smear data from the image data. Even when a high-luminance subject moves in one frame and the smear moves, the dependency on the movement of the smear is increased.

  Specifically, the imaging apparatus according to the first aspect of the invention includes a solid-state imaging device that sequentially reads image data including a smear component and only smear data for each predetermined line, and sequentially from the solid-state imaging device. AD conversion means for AD-converting the image data and smear data read to the image data, image data extraction / storage means for extracting and storing the image data AD-converted by the AD conversion means, and AD conversion means for AD data conversion The smear data extracting / storing means for extracting and storing the converted smear data, and the latest one line of smear data extracted by the smear data extracting / storing means, the past stored in the smear data extracting / storing means Noise removal means for removing noise using one line of smear data, and an image extracted by the image data extraction / storage means From over data, characterized by having a subtraction means for subtracting the smear data adjacent to the position of the image data of the smear data from which noise has been removed by said noise removing means.

  The signal processing device according to claim 2 is an AD conversion means for AD-converting only image data including smear components and smear data read in order for each predetermined line from the solid-state imaging device; Image data extraction / storage means for extracting and storing image data AD-converted by the AD conversion means, smear data extraction / storage means for extracting and storing smear data AD-converted by the AD conversion means, and the smear data Noise removal means for removing noise with respect to the latest one-line smear data extracted by the extraction / storage means, using the past one-line smear data stored in the smear data extraction / storage means, and the image data extraction .Smear data that has been subjected to noise removal by the noise removal means from the image data extracted by the storage means And having a subtraction means for subtracting the smear data adjacent to the position of the image data.

  According to a third aspect of the present invention, in the imaging device or the signal processing device according to any one of the first and second aspects, the solid-state imaging device alternately reads image data and smear data for each line. It is characterized by that.

  According to a fourth aspect of the present invention, in the imaging device or the signal processing device according to any one of the first and second aspects, the solid-state imaging device reads one line of smear data each time a plurality of lines of image data are read. It is characterized by that.

  According to a fifth aspect of the present invention, in the imaging apparatus or the signal processing apparatus according to the third aspect, the subtracting unit is configured to obtain the image data of one line for each image data in the latest one line of obtained image data. The latest smear data at the same horizontal position as the horizontal position of each image data is subtracted from the smear data after noise removal of one line adjacent to.

  According to a sixth aspect of the present invention, in the imaging apparatus or the signal processing apparatus according to the third aspect, the subtracting unit is configured to obtain the image data of the plurality of lines for each image data in the latest image data of the plurality of lines obtained. The latest smear data at the same horizontal position as the horizontal position of each image data is subtracted from the smear data after noise removal of one line adjacent to.

  A seventh aspect of the present invention is the imaging device or the signal processing device according to any one of the first to sixth aspects, wherein the latest one line of smear data extracted by the smear data extraction / storage means, and Smear motion detection means for detecting the amount of movement of the smear in the horizontal direction using the past one line of smear data stored in the smear data extraction / storage means, and the smear horizontal detection detected by the smear motion detection means. A noise removal coefficient calculation means for calculating a noise removal coefficient according to the amount of motion in the direction, and the noise removal means uses the noise removal coefficient calculated by the noise removal coefficient calculation means. The latest one line of smear data is characterized by noise removal.

  The invention according to claim 8 is the imaging device or the signal processing device according to any one of claims 1 to 6, wherein the latest one line of smear data extracted by the smear data extraction / storage means; A smear motion detection means for detecting a smear level change amount using the past one line of smear data stored in the smear data extraction / storage means, and a smear level detected by the smear motion detection means. A noise removal coefficient calculation means for calculating a noise removal coefficient according to the amount of change, and the noise removal means uses the noise removal coefficient calculated by the noise removal coefficient calculation means to The noise is removed from the smear data of one line.

  The invention according to claim 9 is the imaging device or signal processing device according to any one of claims 7 and 8, wherein the noise removing unit includes an IIR filter, and the noise removing coefficient calculating unit includes: A noise reduction coefficient used in the IIR filter is calculated.

  An image pickup apparatus according to a tenth aspect of the present invention includes the signal processing apparatus according to any one of the second to ninth aspects.

  An image pickup method according to an eleventh aspect of the invention includes a step of sequentially reading image data including a smear component and only smear data from the solid-state image sensor for each predetermined line, and sequentially reading from the solid-state image sensor. AD converting the output image data and smear data, extracting and storing the AD-converted image data, extracting and storing the AD-converted smear data, and the extracted A step of removing noise using the stored one-line smear data of the latest one-line smear data, and a position of the image data among the extracted smear data from the extracted image data And subtracting smear data adjacent to.

  A signal processing method according to a twelfth aspect of the present invention includes a step of performing AD conversion on image data and smear data read out in order for each predetermined line from the solid-state image sensor, and the AD converted image data. Extracting and storing the process, extracting and storing the AD-converted smear data, and removing the latest one-line extracted smear data using the stored previous one-line smear data And subtracting smear data adjacent to the position of the image data from the extracted smear data from the extracted image data.

  Accordingly, in the first to twelfth aspects of the present invention, in the imaging apparatus using a CCD, image data and smear data are read from the solid-state imaging device, for example, for each line within the effective area of the screen. Then, noise included in the latest one-line smear data obtained is removed by the noise removing means using the one-line smear data obtained before that. Then, the obtained image data is subtracted by the subtracting circuit by the noise-removed smear data adjacent to the image data, and smear correction of the image data is performed. Therefore, even if a high-luminance subject that is a smear generation source moves in one screen and the smear is obliquely distorted, the image data is smear corrected with smear data that satisfactorily follows the oblique smear. Therefore, it is possible to reduce image quality deterioration due to movement of a high-luminance subject.

  In the inventions according to claims 7 to 9, since the coefficient value used for the noise removal processing by the noise removal means is calculated based on the horizontal movement amount and level change amount of the smear, the movement amount of the high-luminance subject If there is a large change in brightness or brightness, the smear movement can be improved, while if the amount of movement or brightness change of a high-brightness subject is small, that is, if high followability to the smear movement is not required, smear It is possible to improve the noise removal performance for data.

  As described above, according to the first to twelfth aspects of the present invention, image quality deteriorates by improving the followability to smear movement caused by the movement of a high-luminance subject while satisfactorily removing noise mixed in the smear. Can be reduced.

  In particular, in the inventions according to claims 7 to 9, since the removal performance of the noise mixed in the smear is changed in accordance with the horizontal movement amount and level change amount of the smear, the movement of the bright subject and the luminance change thereof are changed. If it is small, the noise removal performance can be improved while maintaining good tracking performance for smear correction, while if the movement of the high-brightness object and its luminance change are large, it matches the large movement and luminance change. Therefore, it is possible to improve the followability to smear correction.

It is a block block diagram of the imaging device which shows the 1st Embodiment of this invention. (A) is a figure which shows the principal part schematic structure of the solid-state image sensor of the embodiment, and the same figure (b) is a figure explaining a mode that a smear is mixed in the vertical transfer CCD with which a solid-state image sensor is equipped. (A) is a diagram for explaining vertical thinning readout of image data and readout of smear data from the solid-state imaging device, and (b) is a diagram showing image data and smear data read out for each line. . (A) is a diagram showing an effective area and OB area of an image, (b) is a diagram in which image data and smear data are alternately read out for each line, and (c) is a diagram in which two lines of image data are read out. It is a figure which reads 1 line of smear data later. It is a figure which shows the noise removal from smear data, and the sequence which subtracts smear data from image data. It is a figure which shows the noise removal using an IIR filter, and the subtraction of smear data. It is a conceptual diagram of the noise removal using an IIR filter. It is a block block diagram of the imaging device which shows the 2nd Embodiment of this invention. It is a figure which shows the calculation method of the horizontal movement distance of a smear. It is a characteristic view which shows the coefficient value for IIR filters with respect to the horizontal movement distance of a smear. It is a figure which shows the calculation method of the change of the maximum value of a smear. It is a characteristic view which shows the coefficient value for IIR filters with respect to the difference of the maximum value of smear.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

(First embodiment)
FIG. 1 shows the overall configuration of an imaging apparatus according to a first embodiment of the present invention.

  In the figure, 101 is a solid-state imaging device including a photodiode, 102 is a timing generator, 103 is an AD converter (AD converting means) for AD-converting image data and smear data from the solid-state imaging device 101, and 104 is the AD An image data extracting / storing circuit (image data extracting / storing means) for extracting and storing only the image data out of the converted image data and smear data, 105 is only the smear data among the AD converted image data and smear data. Is a smear data extraction / storage circuit (smear data extraction / storage means) 106 that extracts and stores the smear data that removes noise components from the latest smear data using the IIR filter using the smear data stored in the past. Circuit (smear data noise removing means) 107 is the image data extraction A subtracting circuit from the image data extracted by the memory circuit 104 subtracts the smear data from which noise has been removed by the smear data noise removing circuit 106 (subtraction means). In the imaging apparatus of FIG. 1, a signal processing circuit is configured except for the solid-state imaging device 101.

  FIG. 2A shows a configuration of a main part of the solid-state imaging device 101, and a plurality of photodiodes 101a in which filters arranged in a Bayer array are arranged, and a plurality of photodiodes arranged on the left in the figure for each of those columns. A vertical transfer CCD 10 and a horizontal transfer CCD 11 arranged below the photodiode 101a in the figure are provided. FIG. 5B shows an image of a state in which, when smear occurs, the charge leaked from each photodiode 101a due to a high-luminance subject is mixed into each vertical transfer CCD 10 as smear data. In the figure, a state in which smear data is mixed in each transfer unit of each vertical transfer CCD 10 is expressed by adding a katakana character “su”.

  FIG. 3 shows an image for reading image data or smear data in units of horizontal lines in the solid-state imaging device 101. In the figure, vertical thinning readout is performed to read out image data only on a predetermined plurality of lines, and the charges contained in the vertical transfer CCD 10 of the line from which the image data is not read out are output as smear data. Here, it is not necessary to read out all smear data, and horizontal lines of smear data that are not used are discarded without performing horizontal transfer after vertical transfer. Specifically, in FIG. 3A, the smear data is discarded without being used in the third line and the sixth line from the horizontal transfer CCD 11 side, and except for these lines, the second and fourth lines surrounded by a broken line are discarded. The image data is transferred to the vertical transfer CCD 10 only on the first and sixth lines, whereas the image data is not transferred to the vertical transfer CCD 10 on the first, third and fifth lines, and these first, third and fifth lines are not transferred. In the vertical transfer CCD 10, only smear data is used.

  As a result, as shown in FIG. 3B, in synchronization with the horizontal synchronizing signal HD, only the smear data is read out on the first line, and the image data including the smear data on the second line (hereinafter simply referred to as an image). Data), the smear data on the third line, the image data on the fourth line, the smear data on the fifth line, the image data on the sixth line, and the smear data for each line. Image data is output alternately. The above operation is performed by a control circuit (not shown) that controls the operation of the solid-state image sensor 101.

  In FIG. 3B, the configuration in which the smear data is read out in the odd lines and the image data is read out in the even lines is illustrated. However, as shown in FIG. 4A, for example, in the effective pixel area of the screen. As shown in FIG. 5B, conversely, a configuration is adopted in which smear data is read out using even lines and image data is read out using odd lines, or image data is continued as shown in FIG. Alternatively, a configuration may be adopted in which smear data is read for one line after reading for two lines.

  Thus, if the number of lines from which smear data is read out is increased or decreased, the frequency of smear data line output relative to the output of image data lines can be changed. If the frequency of the smear data lines to be output is high, smear data closer to the position of the image data can be read, and the followability of smear correction when a high-luminance subject moves can be improved. On the other hand, if the frequency of smear data lines is low, the frame rate of image data output is improved.

  Note that smear data in the OB area is also read out, and smear correction is performed on the first line of the effective area using the smear data in the OB area.

  Next, smear correction under the configuration of FIG. 1 will be described. In FIG. 1, first, image data and smear data are output from the solid-state imaging device 101 for each line according to the rules illustrated in FIGS. 3 and 4, and these data are AD-converted by the AD converter 103. . The image data extracting / storing circuit 104 extracts only the AD-converted image data using a counter (not shown) that changes in units of one horizontal line, and stores it inside. Similarly, the smear data extraction / storage circuit 105 extracts only the AD-converted smear data using a counter that changes in units of one horizontal line, and stores it inside.

  Subsequently, as shown in FIGS. 5, 6, and 7, the smear data noise removing circuit 106 in FIG. 1 has an IIR filter 106a therein. The IIR filter 106 a stores the past one-line smear data obtained by the smear data extraction / storage circuit 105 in the past (stored in the line memory 105 a made up of SRAM provided in the smear data extraction / storage circuit 105. Noise is removed using smear data having the same horizontal address as that of the latest smear data among the smear data of one line immediately before. This noise removal is performed based on the following formula (1).

  Here, K is a coefficient for the IIR filter and is a fixed value Kfix.

  Then, the latest smear data from which noise has been removed is sent to the subtraction circuit 107, and the latest image data after AD conversion at the same horizontal address as the smear data is subtracted by the latest smear data after removal of noise. The smear data is removed from the image data. The latest smear data after noise removal used for the subtraction is stored in the line memory 105a of the smear data extraction / storage circuit 105 as past smear data, and is used for noise removal by the next IIR filter processing. .

  Therefore, in the present embodiment, the latest one line of smear data acquired this time is obtained by the IIR filter 106a for each corresponding horizontal address by the smear data after noise removal for the past one line acquired immediately before. Since the IIR filter processing of the formula (1) is performed, noise is effectively removed.

  Moreover, since the smear data is acquired by a predetermined plurality of lines in the effective image area as can be seen from FIGS. 3B, 4B, and 4C, the smear data for removing the smear component from the image data is obtained. In the correction, as can be seen from FIG. 5 and FIG. 6, the acquired image data for the latest one line is smear corrected by the smear data from which noise is removed for one line adjacent to the image data. Therefore, no matter how the high-luminance subject that is the source of smear moves, image data including a smear component corresponding to the movement is smear data acquired at a position adjacent to the image data, that is, Subtraction processing is performed with smear data according to the movement of the luminance subject, so the followability to the smear is improved, and the high-luminance subject moves as before, leaving smears that are skewed diagonally, or image data without smear components However, there is no drawback such as the image data is partially lost due to the subtraction processing with smear data.

  In the CCD imaging device, as a charge high-speed transfer method for increasing the data transfer rate in the vertical direction, the upper and lower pixel areas of the vertical transfer CCD 10 are transferred at high speed, and the data in these areas are discarded, There is a method of reading out necessary image data at a normal speed only in the intermediate area. Although this method can improve the frame rate of data output by high-speed transfer, if this high-speed transfer method is used in a state where smear is generated by a high-luminance subject, the transfer time of the vertical transfer CCD is increased and decreased. Since the area is different from the intermediate area, the smear level changes in the vertical direction. Here, when the smear subtraction correction is performed using the smear data of the vertical OB area stored in the line memory as in the past, the subtraction is performed with a constant value in the vertical direction of the image, and the smear level is In this embodiment, since the smear overcorrection occurs in the low intermediate area, the image data in the intermediate area having a low smear level is subtracted and corrected by the low level smear data in the vicinity of the image data. Correction is performed.

(Second Embodiment)
FIG. 8 shows a second embodiment of the present invention.

  In the present embodiment, the coefficient K used in the IIR filter 106a of the smear data noise removal circuit 106 is made variable so as to achieve both improvement in followability to smear movement and improvement in noise removal performance.

  In FIG. 8, in addition to the configuration of the imaging apparatus shown in FIG. 1, a smear motion detection circuit 108 and a noise removal coefficient calculation circuit 109 are added, and the coefficient for the IIR filter according to the horizontal movement distance of the smear. Change the value of K. Specifically, it is as follows.

  In FIG. 8, the smear motion detection circuit (smear motion detection means) 108, as shown in FIG. 9, is the horizontal address Hadr_smear_old of the maximum value of the previous smear data stored in the past in the smear data extraction / storage circuit 105. Compares the maximum horizontal address Hadr_smear_new of the latest smear data, calculates the horizontal movement distance length of the smear based on the following equation (2), and calculates the absolute value of the difference between the two horizontal addresses Take and calculate.

  Further, the noise removal coefficient calculation circuit (noise removal coefficient calculation means) 109 calculates the IIR filter coefficient Klength based on the smear horizontal movement distance length calculated by the smear motion detection circuit 108. . The coefficient Klength is calculated as shown in FIG. 10 and the following equation (3).

  When the horizontal movement distance length of the smear data is less than or equal to the threshold 1, the coefficient Klength is set to the minimum value A, and when the horizontal movement distance length of the smear is greater than or equal to the threshold 2 (threshold 1 <threshold 2), the coefficient Klength is set. The maximum value C is set, and between the two values A and C, the coefficient Klength is set to linearly increase in accordance with the increase in the smear horizontal movement distance length. The slope of the linear increase of the coefficient Klength is the constant B in the equation (3).

  Therefore, in the present embodiment, when the horizontal movement distance length of the smear is large, the coefficient Klength for the IIR filter becomes large, so that the latest equation as can be seen from the arithmetic expression (1) for noise removal in the IIR filter 106a. The smear data is greatly reflected, and the followability to the smear movement is enhanced. On the other hand, when the horizontal movement distance length of the smear is small, that is, when high followability is not necessary, the coefficient Klength for the IIR filter is small, so that the reflection amount of the latest smear data is small, and the IIR filter 106a Noise removal performance is improved.

  Therefore, according to the present embodiment, it is possible to achieve both the followability to the smear movement and the noise removal performance included in the smear data.

(Modification)
Next, a modification of this embodiment will be described.

  In this modification, the coefficient K used in the IIR filter 106a of the smear data noise removal circuit 106 shown in FIG. 8 is changed according to the smear level change.

  The overall configuration of the imaging apparatus according to this modification is the same as that shown in FIG. As shown in FIG. 11, the smear motion detection circuit 108 of FIG. 8 compares the maximum value level_smear_old of the smear data previously stored in the smear data extraction / storage circuit 105 with the maximum value level_smear_new of the latest smear data. Then, the difference level between the maximum values of the smear is calculated based on the following equation (4), and the absolute value is taken to calculate the change of the maximum value of the smear.

  The noise removal coefficient calculation circuit 109 calculates the IIR filter coefficient Klevel based on the difference level of the maximum smear value calculated by the smear motion detection circuit 108. The coefficient Klevel is calculated as shown in FIG. 12 and the following equation (5).

  The coefficient Klevel is set to the minimum value E when the maximum smear change level is equal to or less than the threshold 1, and the coefficient Klevel is set when the maximum smear change level is equal to or greater than the threshold 2 (threshold 1 <threshold 2). Is set to the maximum value G, and between the two values E and G, the coefficient Klevel is set to be linearly increased in accordance with the increase of the change level of the maximum value of the smear. The slope of the linear increase of the coefficient Klevel is the constant F in the equation (5).

  Therefore, in the present embodiment, when the change level of the maximum smear value is large, the coefficient Klevel for the IIR filter becomes large, so that the latest smear data is largely reflected and the followability to the smear value change is high. Become. On the other hand, when the change level of the maximum value of the smear is small, that is, when high followability is not required, the coefficient Klevel for the IIR filter becomes small, so that the reflection amount of the latest smear data becomes small and the IIR filter 106a. The noise removal performance of

  Therefore, according to the present embodiment, it is possible to achieve both the followability to the smear value change and the noise removal performance included in the smear data.

  The coefficient K used in the IIR filter 106a of the smear data noise removal circuit 106 is a coefficient Klength corresponding to the horizontal movement distance length of the smear in the third embodiment, and the change level of the maximum smear value of the present modification level. Of course, both the coefficient Klevel corresponding to the above may be used together.

  As described above, the present invention can improve the followability to the smear movement caused by the movement of the high-luminance subject while reducing the noise mixed in the smear, and can reduce the deterioration of the image quality. It is useful as a CCD type imaging device, camera system, and the like.

10 Vertical transfer CCD
11 Horizontal transfer CCD
101 Solid-state imaging device 101a Photodiode 102 Timing generator 103 AD converter (AD conversion means)
104 Image data extraction / storage circuit (image data extraction / storage means)
105 Smear data extraction / storage circuit (smear data extraction / storage means)
105a Line memory 106 Smear data noise removing circuit (Smear data noise removing means)
106a IIR filter 107 Subtraction circuit (subtraction means)
108 Smear motion detection circuit (smear motion detection means)
109 Noise removal coefficient calculation circuit (noise removal coefficient calculation means)

Claims (12)

A solid-state imaging device that sequentially reads out image data including a smear component and only smear data for each predetermined line;
AD conversion means for AD converting image data and smear data sequentially read from the solid-state imaging device;
Image data extraction / storage means for extracting and storing the image data AD-converted by the AD conversion means;
Smear data extracting / storing means for extracting and storing smear data AD-converted by the AD converting means;
Noise removal means for removing noise by using the past one line of smear data stored in the smear data extraction / storage means for the latest one line of smear data extracted by the smear data extraction / storage means;
Subtracting means for subtracting smear data adjacent to the position of the image data from the smear data noise-removed by the noise removing means from the image data extracted by the image data extracting / storing means. An imaging device. AD conversion means for AD-converting only the smear data and the image data including the smear component read out in order for each predetermined line from the solid-state imaging device;
Image data extraction / storage means for extracting and storing the image data AD-converted by the AD conversion means;
Smear data extracting / storing means for extracting and storing smear data AD-converted by the AD converting means;
Noise removal means for removing noise by using the past one line of smear data stored in the smear data extraction / storage means for the latest one line of smear data extracted by the smear data extraction / storage means;
Subtracting means for subtracting smear data adjacent to the position of the image data from the smear data noise-removed by the noise removing means from the image data extracted by the image data extracting / storing means. Signal processing device. In the imaging device or signal processing device according to any one of claims 1 and 2,
The solid-state imaging device is
An image pickup device or a signal processing device, wherein image data and smear data are alternately read out for each line. In the imaging device or signal processing device according to any one of claims 1 and 2,
The solid-state imaging device is
An image pickup apparatus or a signal processing apparatus that reads one line of smear data every time a plurality of lines of image data are read. In the imaging device or signal processing device according to claim 3,
The subtracting means is
With respect to each image data in the latest one-line image data obtained, among the smear data after noise removal of one line adjacent to this one-line image data, at the same horizontal position as the horizontal position of each image data. An imaging apparatus or signal processing apparatus characterized by subtracting the latest smear data. In the imaging device or signal processing device according to claim 3,
The subtracting means is
About each image data in the obtained image data of the plurality of lines, among the smear data after noise removal of one line adjacent to the image data of the plurality of lines, at the same horizontal position as the horizontal position of the image data. An imaging apparatus or signal processing apparatus characterized by subtracting the latest smear data. In the imaging device or signal processing device according to any one of claims 1 to 6,
Using the latest one-line smear data extracted by the smear data extraction / storage means and the past one-line smear data stored in the smear data extraction / storage means, the amount of horizontal movement of the smear Smear motion detection means for detecting
A noise removal coefficient calculation means for calculating a noise removal coefficient according to the horizontal movement amount of the smear detected by the smear movement detection means,
The noise removing means is
An imaging apparatus or signal processing apparatus, wherein noise is removed from the latest one line of smear data using the noise removal coefficient calculated by the noise removal coefficient calculation means. In the imaging device or signal processing device according to any one of claims 1 to 6,
Using the latest one line of smear data extracted by the smear data extraction / storage means and the past one line of smear data stored in the smear data extraction / storage means, the amount of change in the smear level is calculated. Smear motion detecting means for detecting;
A noise removal coefficient calculation means for calculating a noise removal coefficient according to the amount of change in the smear level detected by the smear motion detection means,
The noise removing means is
An imaging apparatus or signal processing apparatus, wherein noise is removed from the latest one line of smear data using the noise removal coefficient calculated by the noise removal coefficient calculation means. In the imaging device or signal processing device according to any one of claims 7 and 8,
The noise removing means includes an IIR filter,
The noise removal coefficient calculation means calculates a noise removal coefficient used in the IIR filter. An image pickup apparatus or a signal processing apparatus. An image pickup apparatus comprising the signal processing apparatus according to claim 2. A step of sequentially reading out image data including a smear component and only smear data for each predetermined line from the solid-state imaging device;
AD conversion of image data and smear data read in sequence from the solid-state imaging device;
Extracting and storing the AD-converted image data;
Extracting and storing the AD-converted smear data;
About the latest extracted one-line smear data extracted, using the stored past one-line smear data, removing noise;
Subtracting smear data adjacent to the position of the image data out of the noise-removed smear data from the extracted image data. AD converting image data and smear data read out in order for each predetermined line from the solid-state imaging device;
Extracting and storing the AD-converted image data;
Extracting and storing the AD-converted smear data;
About the latest extracted one-line smear data extracted, using the stored past one-line smear data, removing noise;
Subtracting smear data adjacent to the position of the image data out of the noise-removed smear data from the extracted image data.

Images