JP2006203438A - Camera and its image processing method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To enhance the image quality of a reduced image through reduction processing combining decimation processing and average processing of image information being outputted from an imaging element. <P>SOLUTION: Pixel position detecting/coefficient selecting sections 10 and 12 input movement amount data indicative of the magnification for CCD data (pixel data), and an offset for first pixel and an offset for second pixel indicative of reduction start position. The pixel position detecting/coefficient selecting sections 10 and 12 determine the position of an interpolation pixel depending on offset and movement amount data, and transmit coefficient data for pixels before and behind that interpolation position from coefficient selecting sections 23 and 33 to a reduction operating section 14. The reduction operating section 14 multiplies the CCD data (pixel data) before and behind the interpolation position by the coefficient data and adds the products to create pixel information of interpolation pixel. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a camera apparatus provided with a moving image shooting mode for shooting a moving image in addition to a still image shooting mode such as a digital still camera or a digital video camera, and an image processing method.

  In general, an electronic still camera is provided with a moving image shooting mode capable of shooting and recording a moving image as well as shooting and recording a still image. When shooting in the movie shooting mode, the image processing speed is required to be significantly higher than when shooting still images. Therefore, the image data input from the image sensor (CCD sensor) is reduced to reduce the image size. In this way, the processing speed is improved and real-time processing for the input image data is realized.

  Conventionally, when reducing image data output from a CCD sensor, an averaging process is often used in which an average value of a plurality of pixels is calculated to obtain a pixel value of an interpolation pixel.

In addition, conventionally, a single-chip color image sensor capable of thinning-out readout is used, and a thinning-out interpolation circuit that generates a reduced image by interpolating a signal read out from the imaging element, and a normal readout signal is interpolated without reduction An interpolation circuit that generates a color image, and in the pixel block, a pixel block that averages and reads out the signals at the four filter positions of G and R, and an average of the signals at the four filter positions of G and B There is also considered an imaging apparatus configured such that pixel blocks to be read are arranged in a checkered pattern and the thinning process is performed so that the checkered pattern is reversed for each frame (for example, Patent Document 1).
JP 2004-15772 A

  Conventionally, in a configuration in which an image is reduced using average processing, when the compression rate is high, an average value is calculated using data of actual pixels included in a wide area. In this case, there is a high possibility that data of actual pixels unrelated to the pixel at the interpolation position will be mixed, and the image quality will deteriorate.

  Further, the imaging apparatus described in Patent Document 1 is configured to suppress the mixing of moiré in the reduced image by interpolating and reducing the signals read out from the imaging element and averaging the signals in the pixel block. In other words, since the signal output from the image sensor has already been thinned out, the amount of data is reduced at this point, and the signal (data) output from the image sensor is simply averaged. However, it was not intended to improve the quality of reduced images.

  An object of the present invention is to provide a camera device and an image processing method for the camera device capable of improving the image quality of a reduced image by a reduction process combining a thinning process and an average process for pixel information output from an image sensor. There is to do.

  The invention according to claim 1 is an image sensor that sequentially outputs pixel information of pixels in the order of arrangement, a magnification setting unit that sets a magnification for pixel information of each pixel output by the image sensor, and the magnification setting unit. Position generating means that sequentially generates and sequentially outputs position information of the interpolation pixels according to the magnification set by the position, and immediately before the position according to the position information of the interpolation pixels that are sequentially output by the position generation means. The first pixel information storage unit that sequentially inputs certain real pixel information from the image sensor and stores the actual pixel information while sequentially updating the information, and the position information of the interpolation pixel that is sequentially output by the position generation unit immediately before the position. First coefficient generation means for sequentially generating and outputting an interpolation coefficient for an actual pixel in the position, and the position information of the interpolation pixel sequentially output by the position generation means, In accordance with the position information of the interpolation pixel sequentially output by the second pixel information storage means that sequentially inputs the actual pixel information immediately after the position from the image pickup device and stores it while sequentially updating, A second coefficient generation means for sequentially generating and outputting an interpolation coefficient for an actual pixel immediately after the position; and a coefficient output by the first coefficient generation means for pixel information stored in the first pixel information storage means The pixel information of the interpolated pixels is sequentially generated by adding the value obtained by multiplying the pixel information stored in the second pixel information storage unit by the value obtained by multiplying the coefficient output from the second coefficient generation unit. And an arithmetic means for performing the processing.

  According to a second aspect of the present invention, in the first aspect of the invention, pixel information corresponding to two different colors is alternately output from the imaging unit, and the pixel information of the interpolated pixel is obtained for each color of the pixel information. It is characterized by generating.

  According to a third aspect of the present invention, in the first aspect of the present invention, two first and second coefficient generation units are provided corresponding to each of two different colors output from the image sensor. Features.

  According to a fourth aspect of the present invention, in the first aspect of the present invention, two first and second pixel storage units are provided corresponding to each of two different colors output from the imaging device. Features.

  According to a fifth aspect of the present invention, in the first aspect of the present invention, the still image mode in which the pixel information output from the image sensor is recorded as it is, and the moving image mode in which the pixel information is subjected to reduction processing and recorded. When the moving image mode is selected, a reduction ratio is set by the magnification setting means, and pixel information of the interpolation pixel is generated.

  According to a sixth aspect of the present invention, in the first or fifth aspect of the present invention, the position generating means, the first, and the first image data of each moving image frame sequentially captured at a predetermined frame rate during moving image shooting. The processing of the pixel information storage unit, the first coefficient generation unit, the second pixel information storage unit, the second coefficient generation unit, and the calculation unit is repeatedly executed in real time.

  According to a seventh aspect of the present invention, there is provided a magnification setting step for setting a magnification for pixel information of pixels that are sequentially output from the image sensor in the order of arrangement, and position information of the interpolation pixel according to the magnification set by the magnification setting step. In accordance with position information of the interpolated pixels sequentially output by the position generation step, and real pixel information immediately before the position is sequentially input from the image sensor. In accordance with the position information of the interpolated pixels sequentially output by the first pixel information storing step that is stored while sequentially updating and the position generating step, the interpolation coefficient for the actual pixel immediately before the position is sequentially generated and output. The first coefficient generation step and the position information of the interpolation pixel sequentially output by the position generation step, immediately after the position The second pixel information storage step that sequentially inputs the actual pixel information from the image sensor and stores the pixel information while sequentially updating the position, and the position information of the interpolated pixel that is sequentially output by the position generation step, immediately after the position. A value obtained by multiplying the pixel information stored in the first pixel information storage step by the coefficient output in the first coefficient generation step A calculation step of sequentially generating pixel information of the interpolated pixels by an operation of adding the pixel information stored in the second pixel information storage step and a value obtained by multiplying the coefficient output in the second coefficient generation step; It is characterized by comprising.

  According to an eighth aspect of the present invention, in a camera device that interpolates pixels based on pixel information corresponding to two different colors that are alternately output from an image sensor, the first color pixel is determined according to a magnification specification. A first setting means for setting the position of the interpolation pixel; and two interpolation coefficients for the same color pixel located before and after the interpolation position for the pixel of the first color according to the interpolation position set by the first setting means A first interpolation coefficient output means for outputting data; a second setting means for setting the position of the interpolation pixel with respect to the second color pixel in accordance with the designation of the magnification; and the interpolation position set by the second setting means. Accordingly, second interpolation coefficient output means for outputting two interpolation coefficient data for the same color pixel located before and after the interpolation position for the pixel of the second color, and first output output alternately from the image sensor. Pixel information storage means for sequentially storing pixel information of a second color, and two pieces of pixel information located before and after the interpolation pixel of the first color stored in the pixel information storage means; First arithmetic means for multiplying two interpolation coefficient data output by one interpolation coefficient output means and adding the multiplication results to generate pixel information of the interpolation pixels of the first color; and the pixels Multiplying two pieces of pixel information located before and after the interpolation pixel of the second color stored in the information storage means by two interpolation coefficient data output by the second interpolation coefficient output means, And a second calculation means for generating pixel information of the interpolation pixel of the second color by adding the multiplication results.

  According to the first aspect of the present invention, the interpolation coefficient for the actual position immediately before and after the position is generated according to the position information of the interpolation pixel, and the multiplication result of the interpolation coefficient for each actual pixel is added. Since the pixel information of the interpolated pixels is generated by the calculation, the reduction process combining the thinning process and the average process can be executed, for example, and a high-quality reduced image can be obtained as compared with the case of performing the interpolation by the simple average process. it can.

  According to the invention of claim 2, in addition to the effect of the invention of claim 1, for example, when pixel information corresponding to two colors is output alternately in the order of the Bayer array, for each color of the pixel information Pixel information of the interpolation pixel can be generated.

  According to the third aspect of the present invention, in addition to the effect of the first aspect of the invention, by providing two first and second coefficient generation means corresponding to each of two different colors, for example, a color moving image At the time of shooting, it is possible to execute sequential processing without delay for pixel information sequentially output from the image sensor and to improve the image quality of the reduced image.

  According to the fourth aspect of the present invention, in addition to the effect of the first aspect of the invention, the first and second pixel storage means are provided corresponding to each of the two different colors, so that the output from the image sensor. It is possible to improve the image quality of the reduced image while sequentially executing the pixel information.

  According to the fifth aspect of the present invention, in addition to the effect of the first aspect of the invention, the reduction ratio is set so that the image is reduced during the operation of the moving image mode that requires higher speed processing than the still image mode. The real-time processing can be realized by reducing the image by executing the reduction processing.

  According to the sixth aspect of the invention, in addition to the effect of the first or fifth aspect of the invention, when moving image frames are sequentially captured at a predetermined frame rate during moving image shooting, the image data of each moving image frame It is possible to generate pixel information of the interpolated pixels with respect to in real time.

  According to the seventh aspect of the present invention, the interpolation coefficient for the actual position immediately before and after the position is generated according to the position information of the interpolation pixel, and the multiplication result of the interpolation coefficient for each actual pixel is added. Since the pixel information of the interpolated pixels is generated by the calculation, the reduction process combining the thinning process and the average process can be executed, for example, and a high-quality reduced image can be obtained as compared with the case of performing the interpolation by the simple average process it can.

  According to the eighth aspect of the present invention, for each piece of pixel information corresponding to two different colors that are alternately output from the image sensor, the pixel information is immediately before and after the position according to the position information of the interpolation pixel. Interpolation pixel information is generated by calculating the interpolation coefficient for the actual position and adding the multiplication result of the interpolation coefficient for each actual pixel. For example, the reduction process combining the thinning process and the averaging process is executed. It is possible to obtain a reduced image with high image quality for each piece of pixel information corresponding to two different colors as compared with the case of interpolation by simple averaging.

  Embodiments of the present invention will be described below with reference to the drawings.

  FIG. 1 is a block diagram showing a configuration of an image processing apparatus provided in a camera apparatus (digital video camera, digital still camera, etc.) in the present embodiment.

  The image processing apparatus shown in FIG. 1 performs a reduction process on CCD data (RGB image data) output from a CCD (Charge Coupled Device) mounted as an imaging device when the camera apparatus operates in a moving image shooting mode. Thus, the image is reduced.

  The image processing apparatus according to the present embodiment operates under a control unit (CPU) that controls the entire camera apparatus. The camera device can operate in a moving image shooting mode for shooting a moving image in addition to a still image shooting mode for shooting a normal still image. When operating in the moving image shooting mode, reduction processing is performed on the CCD data output from the CCD sensor to reduce the image, thereby improving the processing speed and enabling real-time processing.

  In the moving image shooting mode, the image data of each frame constituting the moving image is sequentially captured by the CCD sensor at a speed corresponding to the frame rate of the moving image. Then, a plurality of pixel data included in each frame is read in a predetermined order. Therefore, the reduction process is repeatedly executed in real time for each frame. However, in order to facilitate understanding, processing for one frame will be described below.

  As shown in FIG. 1, the image processing apparatus according to the present embodiment includes pixel position detection / coefficient selection units 10 and 12 and a reduction calculation unit 14.

  In the present embodiment, pixel data of two different colors are alternately output from a CCD sensor in one line. For example, R and G data are alternately output as CCD data for the first line, and G and B data are alternately output as CCD data for the second line according to the pixel array (for example, Bayer array).

  The pixel position detection / coefficient selection unit 10 detects an interpolation pixel position for a pixel of the first pixel color (for example, R) output from the CCD sensor, and an interpolation pixel for an actual pixel located before and after the detected interpolation pixel position. Coefficient data for calculating the value is output. The pixel position detection / coefficient selection unit 12 detects an interpolation pixel position for a pixel of the second pixel color (for example, G) output from the CCD sensor, and performs interpolation for an actual pixel positioned before and after the detected interpolation pixel position. Coefficient data for calculating pixel values is output. Based on the coefficient data output from the pixel position detection / coefficient selection units 10 and 12, the reduction calculation unit 14 performs a calculation on each of the first pixel color pixel and the second pixel color pixel. To output reduced data.

  When the moving image shooting mode is executed, the CPU receives the 1st pixel offset indicating the reduction start position for the pixel of the first pixel color from the CPU, and the pixel position detection / coefficient selection unit 12 receives 2 from the CPU. The 2nd pixel offset indicating the reduction start position for the pixel of the second pixel color is input. Further, in common with the pixel position detection / coefficient selection units 10 and 12, movement amount data indicating an image reduction rate is input. The 1st pixel offset and the 2nd pixel offset can be specified such that, for example, when the actual pixel position and the interpolation pixel position match, a line or the like appears in the reduced image and the image quality does not deteriorate.

  The selector 20 of the pixel position detection / coefficient selection unit 10 inputs the 1st pixel offset supplied as the initial offset for this color pixel as the first CCD data (pixel data) of the same color pixel is input. Then, it is loaded into the flip-flop circuit 21 that functions as a pixel position detection register.

  When the offset value held by the flip-flop circuit 21 exceeds the number of divisions of the same color pixel (here, 8), it is reduced by -8 by the subtractor 22 and output to the selector 24.

  The selector 24 selects the output of the subtractor 22 until the value output from the subtracter 22 becomes 8 or less. When the selector 20 selects the output from the selector 24, reading is skipped through the flip-flop circuit 21, the subtracter 22, and the selector 24 until the 1st pixel offset becomes 8 or less.

  The selector 24 selects the output from the subtracter 26 when the output from the subtractor 22 becomes 8 or less. That is, the value held in the flip-flop circuit 21 is added to the movement amount data (reduction start position) by the adder 25, and then is −8 by the subtractor 26 and output to the selector 24.

  When the value held in the flip-flop circuit 21 becomes 8 or less, the coefficient selection unit 23 selects two coefficients (coefficient a and coefficient b), that is, an interpolation pixel, according to the value held in the flip-flop circuit 21. Interpolation coefficient data for pixels before and after the position is output to the reduction calculation unit 14.

  FIG. 2 is a diagram illustrating an example of a coefficient table provided in the coefficient selection unit 23 of the pixel position detection / coefficient selection unit 10. In the coefficient table, coefficient data (coefficient a, coefficient b) for actual pixels located before and after the interpolation pixel is stored in accordance with each interpolation pixel position. In FIG. 2, coefficient data (coefficient a, coefficient b) is stored in association with the value of the lower 3 bits of the data indicating the interpolation pixel position held in the flip-flop circuit 21.

  The coefficient a is coefficient data for the actual pixel immediately before the interpolation pixel position, and is output to the selector 40 of the reduction calculation unit 14, and the coefficient b is the coefficient data for the actual pixel immediately after the interpolation pixel position, and the reduction calculation unit 14 selectors 41.

  Note that the pixel position detection / coefficient selection unit 12 performs the same operation as that of the pixel position detection / coefficient selection unit 10 and description thereof is omitted. The pixel position detection / coefficient selection unit 12 operates on a pixel having a second pixel color different from the target pixel color in the pixel position detection / coefficient selection unit 10, and the coefficient selection unit 33 according to the interpolation pixel position. The coefficient data selected in is output to the reduction calculation unit 14.

  The reduction calculation unit 14 inputs the coefficient data (coefficient a) output from the pixel position detection / coefficient selection units 10 and 12 to the selector 40 and inputs the coefficient data (coefficient b) to the selector 41. The selectors 40 and 41 select and output either one according to the input of CCD data (pixel data).

  The flip-flop circuits 42, 43, and 44 hold the sequentially input CCD data. That is, the input pixel data is first held in the flip-flop circuit 42, and when the pixel data is next input, the pixel data held in the flip-flop circuit 42 is stored in the flip-flop circuit 43, Newly input pixel data is stored in the flip-flop circuit 42. Similarly, when the pixel data is input next, the pixel data stored in the flip-flop circuit 43 is stored in the flip-flop circuit 44.

  Since two different pixel colors appear alternately in the CCD data, the pixel data of the same color is stored in the flip-flop circuits 42, 44 by sequentially storing them by the three flip-flop circuits 42, 43, 44. Become. The flip-flop circuit 44 holds pixel data immediately before the interpolation pixel position, and the flip-flop circuit 42 holds pixel data immediately after the interpolation pixel position.

  The multiplier 45 multiplies the data held in the flip-flop circuit 44 by the coefficient data (coefficient a) for the actual pixel immediately before the interpolation pixel position selected by the selector 40 and outputs the result. The multiplier 46 multiplies the data held in the flip-flop circuit 42 by coefficient data (coefficient b) for the actual pixel immediately after the interpolation pixel position selected by the selector 41 and outputs the result.

  The calculation results by the multipliers 45 and 46 are added by the adder 47, divided by the divider 48 (1/8 in this case), and held in the flip-flop circuit 49. The data held in the flip-flop circuit 49 is output as reduced data that has been reduced.

  Next, the operation of the reduction process for generating reduced data (interpolated pixel data) by the image processing apparatus according to the present embodiment will be described.

  In the moving image shooting mode, the CCD data of each frame that is sequentially shot at a predetermined frame rate is repeatedly executed in real time for each frame according to each configuration shown in FIG. Hereinafter, processing for one frame will be described.

  In the present embodiment, the same color pixels of the CCD data output from the CCD sensor (imaging device) are divided into eight, and the image is reduced by interpolating the pixels at any of the eight divided positions. Note that the range of the reduction ratio can be made finer by increasing the number of divisions between pixels of the same color.

  FIGS. 3A and 3B are diagrams showing an array of pixel data of the same color output from the CCD sensor. As CCD data, pixel data of two different colors are alternately output for one line. For example, R pixel data shown in FIG. 3A and G pixel data shown in FIG.

  Here, as a simple specific example, a case where the initial offset (1st pixel offset, 2nd pixel offset) is 0 and the movement amount data (reduction ratio) is 12 will be described as an example. Also, processing in the pixel position detection / coefficient selection unit 10 for pixel data of one pixel color shown in FIG.

  When the first pixel data of the same color pixel is input, the initial offset value is loaded into the flip-flop circuit 21 (pixel position detection register) via the selector 20. Here, since the value held in the flip-flop circuit 21 is 8 or less, the coefficient selection unit 23 reads coefficient data (coefficients a, a, a) from the coefficient table according to the lower 3 bits of the value held in the flip-flop circuit 21. Select coefficient b) and output. Further, the movement amount data 12 is added to the value of the pixel position detection register by the adder 25, and the value obtained by subtracting −8 by the subtractor 26 is loaded into the flip-flop circuit 21 via the selector 24 and the selector 20.

  Here, since the value held in the flip-flop circuit 21 is 0 and equal to or less than 8, the coefficient data of 8 as the coefficient a and 0 as the coefficient b is output to the reduction calculation unit 14 as shown in FIG. The

  In this case, the multiplication result of the coefficient data 8 of the coefficient a selected by the selector 45 by the multiplier 45 and the pixel data held in the flip-flop circuit 44, and the coefficient of the coefficient b selected by the selector 41 by the multiplier 46 A value obtained by multiplying the sum of the data 0 and the pixel data held in the flip-flop circuit 42 by 1/8 by the divider 48, that is, the pixel data held in the flip-flop circuit 44 is output as reduced data. The

  FIG. 4 shows interpolation pixels (reduced data) for real pixels of the same color. As shown in FIG. 4, when the initial offset is 0, the first pixel data is output as it is as reduced data.

  When the next pixel of the same color is input, the flip-flop circuit 21 is loaded with a value obtained by subtracting -8 from the movement amount data, that is, 4 via the adder 25, subtractor 26, and selectors 24 and 20. Here, when the value held in the flip-flop circuit 21 becomes 8 or less, the coefficient selection unit 23 sets the coefficient a to 4 as the coefficient a according to the lower 3 bits 100 of the value 4 held in the flip-flop circuit 21. The coefficient data of 4 is output to the reduction calculation unit 14 as b. Further, a value obtained by adding the movement amount to the value 4 held in the flip-flop circuit 21 and −8, that is, 8 is loaded into the flip-flop circuit 21.

  In this case, in the reduction operation unit 14, the actual pixels before and after the interpolation pixel position held in the flip-flop circuits 42 and 44 are multiplied by the coefficient data 4 by the multipliers 45 and 46, respectively. Then, a value obtained by adding 1 to 1/8 by the divider 48 is output as reduced data.

  That is, as shown in FIG. 4, for the interpolated pixel at the position of the movement amount 12, the pixel data of the interpolated pixel is obtained by adding 4/8 times the previous and subsequent real pixels.

  When the next same color pixel data is input, since the value held in the flip-flop circuit 21 is 8, it is not less than 8. Therefore, the value held in the flip-flop circuit 21 is subtracted by -8 by the subtractor 22 (that is, 0) is loaded into the flip-flop circuit 21 via the selectors 24 and 20. In this case, as shown in FIG. 4, the reduced data is not output with respect to the input of the third actual pixel.

  When the next same color pixel data is input, since the value held in the flip-flop circuit 21 is 0, 4 is loaded into the flip-flop circuit 21, and the pixel data input as reduced data is output as it is (FIG. 4). 4th pixel data shown in FIG.

  Thereafter, similarly, coefficient data is output to the reduction calculation unit 14 while detecting the interpolation pixel position with respect to sequentially input CCD data (pixel data), and the reduction calculation unit 14 performs calculation using the coefficient data. To output reduced data.

  In the above description, the processing in the pixel position detection / coefficient selection unit 10 has been described. However, the pixel position detection / coefficient selection unit 12 also includes the pixel color processed in the pixel position detection / coefficient selection unit 10. The same processing is executed for different pixels.

  Since the reduction calculation unit 14 sequentially stores the input CCD data (pixel data) by the flip-flop circuits 42, 43, and 44, the pixel position detection / coefficient selection unit 10 has a different color from the target pixel. The coefficient data (coefficient a and coefficient b) output from the coefficient selection unit 33 of the pixel position detection / coefficient selection unit 12 at the timing at which the image is held in the flip-flop circuits 42 and 44 are respectively selected by the selectors 40 and 41. Select and execute the same arithmetic processing as described above.

  Also, an operation key is provided for the user to arbitrarily set the offset amount at a desired timing, and when moire or the like occurs while the user confirms the display screen for moving image shooting, the offset is set so that moire is eliminated. The amount may be changed.

  In the above description, an example effective in the reduction process has been described. However, a similar process may be applied to the enlargement process, and an effect of removing the moire can be obtained also in the enlargement process.

  In this manner, the pixel position detection / coefficient selection units 10 and 12 and the reduction calculation unit 14 perform reduction processing on pixel data from the CCD sensor that outputs pixel data of two different colors according to the pixel arrangement. This can be realized by thinning-out processing and interpolation processing between two points, and a high-quality reduced image can be generated as compared with the case where interpolation is performed using the average value of all the pixels according to the reduction rate.

  In the above-described embodiment, a camera device such as a digital still camera or a digital video camera is targeted, but a mobile phone with a camera function or a portable information processing device (PDA (personal digital assistant) or PC (Personal Computer) is used. ) Etc.).

  Furthermore, the above embodiments include inventions at various stages, and various inventions can be extracted by appropriately combining a plurality of disclosed constituent elements. For example, even if some constituent elements are deleted from all the constituent elements shown in the embodiment, at least one of the problems described in the column of problems to be solved by the invention can be solved, and described in the column of the effect of the invention. In a case where at least one of the obtained effects can be obtained, a configuration in which this configuration requirement is deleted can be extracted as an invention.

1 is a block diagram illustrating a configuration of an image processing device provided in a camera device according to an embodiment of the present invention. The figure which shows an example of the coefficient table provided in the coefficient selection part 23 of the pixel position detection / coefficient selection part 10 in this embodiment. The figure which shows the arrangement | sequence of the pixel data of the same color output from a CCD sensor. The figure which shows the interpolation pixel (reduction data) with respect to the real pixel of the same color in this embodiment.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 10,12 ... Pixel position detection / coefficient selection part, 14 ... Reduction operation part, 20, 24, 30, 34, 40, 41 ... Selector, 23, 33 ... Coefficient selection part, 21, 31, 42, 43, 44 ... Flip-flop circuit, 22, 26, 32, 36 ... subtractor, 25, 35, 47 ... adder, 45, 46 ... multiplier, 48 ... divider.

Claims (8)

An image sensor that sequentially outputs pixel information of pixels in the order of arrangement;
Magnification setting means for setting a magnification for pixel information of each pixel output by the image sensor;
Position generation means for sequentially generating and sequentially outputting position information of interpolation pixels according to the magnification set by the magnification setting means;
First pixel information storage means for sequentially inputting actual pixel information immediately before the position from the image sensor and storing the information while sequentially updating in accordance with position information of the interpolation pixel sequentially output by the position generation means; ,
First coefficient generation means for sequentially generating and outputting an interpolation coefficient for an actual pixel immediately before the position according to position information of the interpolation pixel sequentially output by the position generation means;
Second pixel information storage means for sequentially inputting actual pixel information immediately after the position from the image sensor and storing it while sequentially updating in accordance with position information of the interpolation pixel sequentially output by the position generation means; ,
Second coefficient generation means for sequentially generating and outputting an interpolation coefficient for an actual pixel immediately after the position in accordance with position information of the interpolation pixel sequentially output by the position generation means;
A value obtained by multiplying the pixel information stored in the first pixel information storage unit by the coefficient output from the first coefficient generation unit, and the pixel information stored in the second pixel information storage unit include the second coefficient. A camera apparatus comprising: a calculation unit that sequentially generates pixel information of the interpolated pixel by a calculation of adding a value multiplied by a coefficient output from the generation unit.   2. The camera apparatus according to claim 1, wherein pixel information corresponding to two different colors is alternately output from the imaging unit, and pixel information of the interpolation pixel is generated for each color of the pixel information.   2. The camera apparatus according to claim 1, wherein two first and second coefficient generation units are provided corresponding to two different colors output from the image sensor.   2. The camera apparatus according to claim 1, wherein two first and second pixel storage units are provided corresponding to two different colors output from the image sensor.   The still image mode in which the pixel information output from the image sensor is recorded as it is and the moving image mode in which the pixel information is reduced and recorded are selected, and the moving image mode is selected. The camera apparatus according to claim 1, wherein pixel information of the interpolated pixel is generated by setting a reduction ratio by the magnification setting means.   At the time of moving image shooting, the position generation means, the first pixel information storage means, the first coefficient generation means, and the second pixel information storage are performed on image data of each moving image frame that is sequentially captured at a predetermined frame rate. 6. The camera apparatus according to claim 1, wherein the processing of said means, said second coefficient generating means, and said calculating means is repeatedly executed in real time. A magnification setting step for setting a magnification for pixel information of pixels sequentially output from the image sensor in the order of arrangement;
A position generation step of sequentially generating and sequentially outputting position information of interpolation pixels according to the magnification set by the magnification setting step;
A first pixel information storing step of sequentially inputting real pixel information immediately before the position from the image sensor and storing it while sequentially updating according to the position information of the interpolation pixel sequentially output by the position generating step; ,
A first coefficient generation step of sequentially generating and outputting an interpolation coefficient for an actual pixel immediately before the position according to position information of the interpolation pixel sequentially output by the position generation step;
A second pixel information storage step of sequentially inputting actual pixel information immediately after the position from the imaging device and storing the information while sequentially updating according to the position information of the interpolation pixel sequentially output by the position generation step; ,
A second coefficient generation step of sequentially generating and outputting an interpolation coefficient for an actual pixel immediately after the position according to position information of the interpolation pixel sequentially output by the position generation step;
A value obtained by multiplying the pixel information stored in the first pixel information storage step by the coefficient output in the first coefficient generation step and the pixel information stored in the second pixel information storage step generate the second coefficient. An image processing method for a camera device, comprising: an operation step of sequentially generating pixel information of the interpolation pixel by an operation of adding a value multiplied by a coefficient output in the step. In a camera device that interpolates pixels based on pixel information corresponding to two different colors that are alternately output from an image sensor,
First setting means for setting the position of the interpolation pixel with respect to the pixel of the first color according to the designation of the magnification;
First interpolation coefficient output means for outputting two interpolation coefficient data for the same color pixel located before and after the interpolation position for the first color pixel according to the interpolation position set by the first setting means;
Second setting means for setting the position of the interpolated pixel with respect to the second color pixel in accordance with the designation of the magnification;
Second interpolation coefficient output means for outputting two interpolation coefficient data for the same color pixel located before and after the interpolation position for the second color pixel according to the interpolation position set by the second setting means;
Pixel information storage means for sequentially storing pixel information of first and second colors alternately output from the image sensor;
The two pieces of pixel information located before and after the interpolation pixel of the first color stored in the pixel information storage unit are respectively multiplied by the two interpolation coefficient data output by the first interpolation coefficient output unit. First calculating means for generating pixel information of the interpolated pixels of the first color by adding the multiplication results;
The two pieces of pixel information located before and after the interpolation pixel of the second color stored in the pixel information storage unit are respectively multiplied by the two interpolation coefficient data output by the second interpolation coefficient output unit. And a second arithmetic unit that generates pixel information of the interpolation pixel of the second color by adding the multiplication results.

Images