JP2005012840A - Digital camera and image processing method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To remarkably raise conveniences when image data is magnified in units of several lines. <P>SOLUTION: A digital camera is equipped with a 2nd transfer portion 18' which shifts a bayer data memorized in a memory 17 in each 2n line in units of 4 n+m (m, n: natural number) line and transmits it one by one, a YUV transformation portion 19 which creates a YUV data in units of 2 n+m line which consists of a pixel corresponding to the content of pixel dimensions comprising vertical (2n+1) × lateral (2n+1) containing each vertical horizontal n pixels in the bayer data transmitted, and a pixel transformation portion 31 which increases the number of configuration pixels by magnification processing based on YUV data in units of 2n+m line acquired from the YUV transformation portion 19 at the time of electronic zoom functional designation. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to a digital camera having an electronic zoom function and an image processing method executed when the digital camera has an electronic zoom function.

  In recent years, with the spread of personal computers, digital still cameras that record digital image data obtained by photographing on a memory card instead of a silver salt film are becoming widespread.

  FIG. 12 shows a partial circuit configuration of this type of digital still camera. Here, basically, compression processing is performed on YUV data before YUV data is expanded on a buffer memory for one screen during single shooting. The thing is illustrated.

  A light image obtained by the optical lens system 11 is formed on the CCD 12 which is an image sensor. The CCD 12 forms, for example, a primary color Bayer array color filter, and the obtained color image data (hereinafter abbreviated as “Bayer data”) is sequentially sampled and held by a sample hold circuit (S / H) 13. Later, it is digitized by the A / D converter 14 and sent to the line processing unit 15.

  The line processing unit 15 collects Bayer data sequentially sent in units of lines, and the combined Bayer data in units of lines is transferred to the memory 17 by the first transfer unit 16 and expanded and stored.

  Thus, when Bayer data corresponding to the required number of lines is developed on the memory 17, it is read out by the second transfer unit 18 to the YUV conversion unit 19 in units of blocks.

  The YUV conversion unit 19 performs interpolation processing and color space processing to convert primary color Bayer data into YUV data which is luminance color difference color image data. The YUV data thus obtained is converted to a switch (SW ) And sent to the JPEG processing unit 21 via 20, and developed and stored in the memory 17 by the third transfer unit 23 via the switch 22.

  The YUV data developed and stored in the memory 17 is transferred to the display control unit 25 by the fourth transfer unit 24, and an analog video output signal is created by the display control unit 25, and a signal for displaying the liquid crystal monitor is also sent. Created and output respectively.

  Further, the JPEG processing unit 21 performs data compression processing such as ADCT (Differential Discrete Cosine Transform) processing and Huffman coding based on the YUV data sent from the YUV conversion unit 19 via the switch 20 to obtain a data amount. The JPEG data obtained in this way is obtained, and the JPEG data obtained in this way is expanded and stored in the memory 17 by the fifth transfer unit 26.

  The JPEG data expanded and stored in the memory 17 is recorded on a memory card as a recording medium.

  On the other hand, the JPEG data read from the memory card in the playback mode is stored in the memory 17 and then read out by the sixth transfer unit 27, transferred again to the JPEG processing unit 21, and restored to the original YUV data. After being transferred to the memory 17 by the third transfer unit 23 via the switch 22 and stored therein, the fourth transfer unit 24 provides the display control unit 25 with it.

  However, all the operations of the circuits are controlled by a system controller 28 including a CPU. The operation control of the system controller 28 is a key directly input from a key input unit 29 including a shutter key and a mode key. It is executed in response to the operation signal.

  Next, specific processing contents when generating YUV data will be described in detail.

  The Bayer data obtained by the line processing unit 15 and developed and stored in the memory 17 is illustrated in FIG.

  When such Bayer data is obtained, in order to generate 1 pixel of YUV data by the YUV conversion unit 19, 5 pixels in the vertical direction × 5 pixels in the horizontal direction are necessary for reference as shown in FIG. Assuming that the YUV data created from the Bayer data has a pixel configuration as shown in FIG.

However, if the generated YUV data is limited to be transferred and output in the order shown in FIG. 14, and the vertical size of the generated YUV data block is 4 pixels, the readout order of the pixel position of the original Bayer data is: As shown in FIG. 15, in the first block in the C1 to C8 line range, C1-1 → C1-2 → C1-3 → C1-4 → C1-5 → C1-6 → C1-7 → C1-8 → C2- 1 → C2-2 → ……
In the second block of the line range from C5 to C12, which is lowered by 4 lines, C1-5 → C1-6 → C1-7 → C1-8 → C1-9 → C1-10 → C1-11 → C1-12 → C2 -5 → C2-6 →
It becomes.

For the Bayer data read out in this order of pixel positions, the transfer order of the pixel positions of the generated YUV data is C3-3 → C3-4 → C3-5 → C3-6 → C4 in the first block. -3 → C4-4 → C4-5 → C4-6 → C5-3 → C5-4 →.
In the second block, C3-7 → C3-8 → C3-9 → C3-10 → C4-7 → C4-8 → C4-9 → C4-10 → C5-7 → C5-8 →.
It becomes.

  FIG. 16A shows a pixel configuration when generating YUV data from Bayer data as described above. The pixel portion indicated by hatching in the Bayer data in FIG. 1A indicates the position of a pixel that is used in generating YUV data but is not directly utilized as corresponding YUV data.

  Of the eight lines of Bayer data read from the memory 17, the upper four lines are read redundantly with the adjacent blocks above, and the generated YUV data is Naturally, there are no overlapping pixel positions.

  FIG. 16B illustrates the relationship between a block read from Bayer data in units of frames and a block of YUV data generated from the Bayer data block.

  As described above, in the process of generating YUV data from Bayer data, only the minimum necessary YUV data is generated as shown in FIG.

  Therefore, if the required data is 4: 2: 2, the vertical size of the YUV data block is set to 8, and if 4: 2: 0, the vertical size of the YUV data block is set to 16, the subsequent data compression Since the JPEG processing unit 21 performing the processing executes the block unit of 8 × 8 pixels, the YUV data can be directly transferred to the JPEG processing unit 21 as it is.

  However, in the circuit configuration as shown in FIG. 12, electronic zoom processing (enlargement processing) for enlarging an image by increasing the number of constituent pixels of the image by performing interpolation processing of image data obtained by photographing. In consideration of providing a circuit for performing pixel conversion by hardware in the subsequent stage of the YUV conversion unit 19, for example, between the switch 22 and the third transfer unit 23, the pixel conversion circuit expands image data. When performing the processing, since only the minimum necessary YUV data is transferred as described above, the pixels on the bottom line of a certain YUV data block and the next YUV data block are transferred. Pixels located between the pixels on the uppermost line cannot be created by interpolation processing.

  Therefore, in the pixel conversion circuit, the same pixel as the pixel on the bottom line of a certain YUV data block is added one line below, or the pixel on the bottom line of a certain YUV data block is overlapped. Assuming that there are similar pixels under another line, it is necessary to execute enlargement processing using these overlapping pixels. As a result, as the enlargement ratio in the vertical direction of the electronic zoom increases, There was a problem that the deterioration of the was severe.

  Further, when an electronic zoom process (enlargement process) is to be executed for each YUV data block in the pixel conversion circuit, since the number of lines of each YUV data block is the same, an enlargement process (interpolation) is performed for each YUV data block. The number of lines in each YUV data block after executing (processing) becomes the same, and there is a problem that the number of zoom magnifications (enlargement ratios) that can be taken is limited.

  Further, when an electronic zoom process (enlargement process) is performed on the YUV data block by the pixel conversion circuit, if the YUV data block generated by the YUV conversion unit 19 is directly transferred to the JPEG processing unit 21, the electronic zoom is performed. Since unprocessed YUV data is compressed and recorded on a memory card as a recording medium, in this case, after the YUV data subjected to the electronic zoom processing by the pixel conversion circuit is temporarily stored in the memory 17. There is a problem that it is necessary to read out and transfer the data to the JPEG processing unit 21, which requires time for image recording processing.

  The present invention has been made in view of the above-described circumstances, and an object of the present invention is to provide a digital camera and an image that can greatly improve convenience when enlarging image data in units of several lines. It is to provide a processing method.

  The invention according to claim 1 is a digital camera having an electronic zoom function, in which image data obtained by an image sensor is sequentially transferred in units of a predetermined number of lines and image data for a predetermined number of lines is transferred. Next, transfer means for transferring the image data for the upper one or more lines among the image data for the predetermined number of lines to be transferred, and the one or more lines sequentially transferred from the transfer means And an enlargement processing unit for enlarging the image data for a predetermined number of lines to which the image data of the amount is added.

  With such a configuration, the transfer unit that generates image data in which one or more lines overlap in advance is used so that image degradation does not occur when performing enlargement processing for electronic zoom. Without using a simple circuit configuration, enlargement processing can be performed without causing unnecessary image degradation even during electronic zooming.

  The invention according to claim 2 is a digital camera having an electronic zoom function, wherein color image data obtained by an image pickup device having a color filter is sequentially shifted every 2n lines in units of 4n + m (m, n: natural number) lines. Transfer means for transferring, and pixels corresponding to the contents of the vertical (2n + 1) × horizontal (2n + 1) pixel range including each of the upper, lower, left, and right n pixels in the color image data sent in units of 4n + m lines. A first pixel conversion unit that creates the same luminance / chrominance data in units of 2n + m lines, and an enlargement process based on the luminance / color difference system color image data in units of 2n + m lines sent from the first pixel conversion unit. And a second pixel conversion means for increasing the number of constituent pixels.

  With such a configuration, a luminance color difference system in which m lines are overlapped in advance in the first pixel conversion unit so that image degradation does not occur when the enlargement process for electronic zoom is performed in the second pixel conversion unit. Since the transfer means for generating the color image data (YUV data) is used, the enlargement process can be performed without causing a deterioration of the image unnecessarily even during the electronic zoom without using a complicated circuit configuration.

  The invention described in claim 3 further comprises zoom instruction means for instructing the operation of the electronic zoom function in the invention described in claim 2, wherein the transfer means, first pixel conversion means, and second pixel conversion are provided. The means is characterized in that when the operation of the electronic zoom function is instructed by the zoom instruction means, the transfer process and the pixel conversion process are executed.

  With such a configuration, in addition to the operation of the invention of the second aspect, the electronic zoom function performs processing such as transfer and pixel conversion as necessary when an operation instruction for the electronic zoom function is given. No unnecessary processing is performed when the function is not operating.

  According to a fourth aspect of the present invention, in the invention of the third aspect, when the operation of the electronic zoom function is not instructed by the zoom instruction unit, the transfer unit transmits the color image data in units of 4n lines by 2n. The first pixel converting means transfers the data sequentially by shifting line by line, and the first pixel converting means includes vertical (2n + 1) × horizontal (2n + 1) including n pixels in the upper, lower, left, and right in the color image data sent from the transferring means in 4n line units. The first pixel conversion unit when the same data of the luminance color difference system in units of 2n lines composed of pixels corresponding to the contents of the pixel range is generated and the operation of the electronic zoom function is not instructed by the zoom instruction unit Color image data sent in units of 2n lines and the second pixel conversion unit when the operation of the electronic zoom function is instructed by the zoom instruction means In wherein the enlargement process has been further comprising data compression means for data compressing at least one of the color image data subjected.

  With such a configuration, in addition to the operation of the invention described in claim 3, the data compression processing for recording the image data on the recording medium can be controlled in accordance with the operation / non-operation of the electronic zoom function. it can.

  The invention described in claim 5 is a digital camera having an electronic zoom function, a transfer means for sequentially transferring image data obtained by the image sensor in units of a predetermined number of lines, and a predetermined number of data sequentially transferred from the transfer means. Enlargement processing means for enlarging line image data based on a predetermined zoom magnification, data compression means for compressing the image data, and predetermined enlargement processing by the enlargement processing means based on a predetermined zoom magnification And transfer control means for sequentially transferring image data for several lines to the data compression means.

  With such a configuration, the image data enlarged at a predetermined zoom magnification can be sequentially compressed, so that the circuit configuration can be further simplified.

  According to a sixth aspect of the present invention, in the fifth aspect of the present invention, the zoom magnification designation means for designating a zoom magnification of the electronic zoom function, and the zoom magnification designated by the zoom magnification designation means is a predetermined zoom magnification. Determining means for determining whether or not the enlargement processing means is based on the zoom magnification designated by the zoom magnification designation means for the image data for a predetermined number of lines sequentially transferred from the transfer means. The transfer control means transfers image data for a predetermined number of lines enlarged by the enlargement processing means to the data compression means when the determination means determines that the predetermined zoom magnification is obtained. It is characterized by transferring sequentially.

  With such a configuration, in addition to the operation of the invention described in claim 5, data compression can be performed more quickly when a specific zoom magnification is designated.

  According to a seventh aspect of the present invention, in the sixth aspect of the present invention, when the transfer control means determines that the zoom magnification is not a predetermined zoom magnification, the predetermined number of lines subjected to the enlargement processing by the enlargement processing means. Image data is sequentially developed on the memory, and the image data is read from the memory in the data compression unit of the data compression means and transferred to the data compression means.

  According to such a configuration, in addition to the operation of the invention described in claim 6, in a state where the zoom magnification is not a predetermined value, the image data is expanded in the memory, read out in units of data compression, and used for data compression processing. Therefore, the processing speed can be prevented from being lowered more than necessary by using only the state where the memory must be used.

  The invention according to claim 8 is the invention according to any one of claims 5 to 8, wherein the transfer control means sequentially transfers image data for a predetermined number of lines sequentially transferred from the transfer means to the data compression means. It is characterized by doing.

  With such a configuration, in addition to the operation of the invention according to any one of claims 5 to 7, data compression when recording image data on a recording medium can be processed more smoothly.

  The invention according to claim 9 is a digital camera having an electronic zoom function, wherein transfer means for sequentially transferring image data obtained by the image sensor in units of a predetermined number of lines, and a predetermined number of data sequentially transferred from the transfer means. Zoom processing means is provided for performing zoom processing with respect to image data for lines for which the number of lines differs for each image data.

  With such a configuration, even when the number of lines constituting the image data after the enlargement process is different, by executing this, there is no restriction on the enlargement magnification specified as the enlargement process of the electronic zoom, An electronic zoom function with a wide variety of magnifications can be realized.

  According to a tenth aspect of the present invention, in the invention according to the ninth aspect, when the transfer means transfers the image data for a predetermined number of lines, the transfer means is a higher rank of the image data for the predetermined number of lines to be transferred next. One or more lines of image data are transferred and transferred.

  With such a configuration, in addition to the operation of the invention described in claim 9 above, since the transfer means is used that generates image data in which one or more lines overlap in advance so as not to cause image degradation. Therefore, enlargement processing can be performed without causing unnecessary image degradation even during electronic zooming without using a complicated circuit configuration.

  According to an eleventh aspect of the present invention, in the invention according to the ninth or tenth aspect, the zoom processing means outputs line number information of image data for a predetermined number of lines after the zoom processing.

  With such a configuration, in addition to the operation of the invention according to claim 9 or 10, the line number information is also updated even when the number of lines constituting each image data after zoom processing is different. It can be output to the stage to deal with this.

  According to a twelfth aspect of the present invention, there is provided an image processing method for a digital camera having an electronic zoom function, in which image data obtained by an image sensor is sequentially transferred in units of a predetermined number of lines, and image data for a predetermined number of lines is transferred When transferring, a transfer step of transferring the image data for the upper several lines of the image data for the predetermined number of lines to be transferred next, and the above-mentioned several lines sequentially obtained by this transfer step And an enlargement processing step for enlarging the image data for a predetermined number of lines to which the image data is added.

  With such a method, when performing enlargement processing for electronic zoom, transfer is performed so that image data in which one or more lines overlap in advance is generated so that image degradation does not occur. Without using a simple circuit configuration, enlargement processing can be performed without causing unnecessary image degradation even during electronic zooming.

  The invention according to claim 13 is an image processing method in a digital camera having an electronic zoom function, wherein 2n lines of color image data obtained by an image pickup device having a color filter are obtained in units of 4n + m (m, n: natural number) lines. A transfer process in which each pixel is sequentially shifted, and the contents of the vertical (2n + 1) × horizontal (2n + 1) pixel range including each of the upper, lower, left, and right n pixels in the color image data sent in units of 4n + m by this transfer process. Based on the first pixel conversion step of creating the same 2n + m line unit luminance / chrominance data composed of corresponding pixels, and the 2n + m line unit luminance / chrominance color image data obtained in the first pixel conversion step. And a second pixel conversion step for increasing the number of constituent pixels by enlargement processing.

  According to such a method, a luminance color difference system in which m lines are overlapped in advance in the first pixel conversion step so that image degradation does not occur when enlargement processing for electronic zoom is performed in the second pixel conversion step. Since the transfer process for generating the color image data (YUV data) is used, the enlargement process can be performed without causing a deterioration of the image unnecessarily even during the electronic zoom without using a complicated circuit configuration.

  The invention according to claim 14 is an image processing method in a digital camera having an electronic zoom function, wherein the image data obtained by the image sensor is sequentially transferred in units of a predetermined number of lines, and the transfer means sequentially obtains the image data. An enlargement processing step for enlarging the predetermined number of lines of image data based on a predetermined zoom magnification, a data compression step for compressing the image data, and an enlargement processing based on the predetermined zoom magnification by the enlargement processing step And a transfer control step of sequentially transferring the image data for a predetermined number of lines to the data compression means.

  With such a method, the image data enlarged at a predetermined zoom magnification can be sequentially compressed, so that the circuit configuration can be further simplified.

  The invention according to claim 15 is an image processing method for a digital camera having an electronic zoom function, wherein a transfer step of sequentially transferring image data obtained by an image sensor in units of a predetermined number of lines, and the transfer step are sequentially obtained. And a zoom processing step of performing zoom processing with different number of lines for each image data on image data for a predetermined number of lines.

  With such a method, even when the number of lines constituting the image data after the enlargement process is different, by executing this, there is no restriction on the enlargement magnification designated as the enlargement process of the electronic zoom, An electronic zoom function with a wide variety of enlargement magnifications can be realized.

  According to the first aspect of the present invention, the transfer means that generates image data in which one or more lines overlap in advance is used so that the image is not deteriorated when the enlargement process for electronic zoom is performed. Therefore, enlargement processing can be performed without causing unnecessary image degradation even during electronic zooming without using a complicated circuit configuration.

  According to the second aspect of the present invention, when the second pixel conversion unit performs enlargement processing for electronic zooming, the luminance in which m lines are overlapped in advance by the first pixel conversion unit so as not to cause image degradation. Since the transfer means for generating color difference color image data (YUV data) is used, enlargement processing can be performed without causing unnecessary image degradation even during electronic zooming without using a complicated circuit configuration. it can.

  According to the third aspect of the invention, in addition to the effect of the second aspect of the invention, when performing an operation instruction of the electronic zoom function, processing such as transfer and pixel conversion is performed as necessary. No unnecessary processing is performed when the electronic zoom function is not operating.

  According to the fourth aspect of the invention, in addition to the effect of the third aspect of the invention, the data compression processing for recording the image data on the recording medium is controlled in accordance with the operation / non-operation of the electronic zoom function. can do.

  According to the fifth aspect of the present invention, since the image data enlarged at a predetermined zoom magnification can be sequentially compressed, the circuit configuration can be further simplified.

  According to the sixth aspect of the invention, in addition to the effect of the fifth aspect of the invention, data compression can be performed more quickly when a specific zoom magnification is designated.

  According to the seventh aspect of the invention, in addition to the effect of the sixth aspect of the invention, in a state where the zoom magnification is not a predetermined value, the image data is developed in the memory and read out in units of data compression to perform data compression processing. Therefore, the processing speed can be prevented from being lowered more than necessary by using the memory only in a state where the memory must be used.

  According to the invention described in claim 8, in addition to the effect of the invention described in any of claims 5 to 7, it is possible to more smoothly process the data compression when recording the image data on the recording medium.

  According to the ninth aspect of the invention, even when the number of lines constituting the image data after the enlargement process is different, by executing this, the enlargement magnification specified as the enlargement process of the electronic zoom is restricted. In addition, it is possible to realize an electronic zoom function with extremely various enlargement magnifications.

  According to the tenth aspect of the invention, in addition to the effect of the ninth aspect of the invention, there is provided transfer means for generating image data in which one or more lines overlap in advance so as not to cause image degradation. Therefore, enlargement processing can be performed without causing unnecessary image degradation even during electronic zooming without using a complicated circuit configuration.

  According to the invention of claim 11, in addition to the effect of the invention of claim 9 or 10, even when the number of lines constituting each image data after the zoom processing is different, the line number information Can be output to the next stage to deal with this.

  According to the twelfth aspect of the present invention, when the enlargement process for electronic zoom is performed, transfer is performed so that image data in which one or more lines overlap is generated in advance so as not to cause image degradation. Therefore, enlargement processing can be performed without causing unnecessary image degradation even during electronic zooming without using a complicated circuit configuration.

  According to the thirteenth aspect of the present invention, the luminance in which m lines are overlapped in advance in the first pixel conversion step so that image degradation does not occur when performing enlargement processing for electronic zoom in the second pixel conversion step. Since a transfer process that generates color-difference color image data (YUV data) is used, enlargement processing can be performed without causing unnecessary image degradation even during electronic zooming without using a complicated circuit configuration. it can.

  According to the fourteenth aspect of the present invention, since the image data enlarged at a predetermined zoom magnification can be sequentially compressed, the circuit configuration can be further simplified.

  According to the fifteenth aspect of the present invention, even when the number of lines constituting the image data after the enlargement process is different, by executing this, the enlargement magnification designated as the enlargement process of the electronic zoom is restricted. In addition, it is possible to realize an electronic zoom function with extremely various enlargement magnifications.

(First embodiment)
A digital still camera according to a first embodiment of the present invention will be described below with reference to the drawings.

  FIG. 1 shows a partial circuit configuration thereof, which is basically the same as that shown in FIG. 12 described above.

  Therefore, for example, as shown in FIG. 13 (2), it is assumed that Bayer data of 5 vertical pixels × 5 horizontal pixels is required to generate 1 pixel of YUV data, and the combined generation is performed from the Bayer data. Assuming that the minimum required vertical size of the YUV data block is 4 pixels, the second transfer unit 18 ′ that reads the Bayer data stored in the memory 17 reads the Bayer data by shifting it by 4 lines in units of 9 lines. It is assumed that the data is transferred to the YUV conversion unit 19.

  Further, a switch 22 that opens and closes a transfer path for the YUV data generated by the YUV conversion unit 19, and a third transfer unit 23 that develops and stores the YUV data transferred through the switch 22 in the memory 17, The pixel conversion unit 31 is disposed between the two.

  This pixel conversion unit 31 performs enlargement processing of given YUV data when the electronic zoom function is designated, and increases the number of constituent pixels in accordance with the zoom magnification.

  Next, the operation of the above embodiment will be described.

  FIG. 2 shows the processing contents corresponding to whether or not the electronic zoom is executed in the shooting mode. Initially, whether or not the electronic zoom function is designated by the operation of the zoom key constituting the key input unit 29 is determined. Is determined (step A01).

  Here, when the electronic zoom function is not designated, the second transfer unit 18 'uses the Bayer data from the memory 17 as one block and 8 line units as shown in FIG. The data is read as being duplicated in the block and transferred to the YUV converter 19.

  Therefore, the YUV data created by the YUV converter 19 based on this does not have overlapping pixel positions, and the created YUV data passes through the pixel converter 31 via the switch 22 through, After being expanded and stored in the memory 17 by the third transfer unit 23, it is sent to the display control unit 25 by the fourth transfer unit 24 and displayed on the liquid crystal monitor of this digital still camera (step A03).

  On the other hand, if it is determined in step A01 that the electronic zoom function is designated, the second transfer unit 18 'reads the Bayer data from the memory 17 in units of 9 lines per block as shown in FIG. The data is transferred to the unit 19.

For example, the order of reading the pixel positions of the Bayer data by the second transfer unit 18 ′ is C1-1 → C1-2 → C1-3 → C1- in the first block in the line range C1 to C9 shown in FIG. 4 → C1-5 → C1-6 → C1-7 → C1-8 → C1-9 → C2-1 → C2-2 →.
In the second block of the line range from C5 to C13, which is lowered by 4 lines, C1-5 → C1-6 → C1-7 → C1-8 → C1-9 → C1-10 → C1-11 → C1-12 → C1 -13 → C2-5 → C2-6 →
It becomes.

Therefore, the YUV converter 19 creates YUV data for 5 lines from the Bayer data for 9 lines. For example, the transfer order of the pixel positions of the generated YUV data is C3-3 → C3-4 → C3-5 → C3-6 → C3-7 → C4-3 → C4-4 → C4-5 → C4-6 → C4-7 → C5-3 → C5-4 →.
In the second block, C3-7 → C3-8 → C3-9 → C3-10 → C3-11 → C4-7 → C4-8 → C4-9 → C4-10 → C4-11 → C5-7 → C5-8 → ……
As shown in FIG. 3, the YUV data of a block at a certain position is generated so that one line at the bottom line overlaps with the top line position of the YUV data at the block at the next position. The

  Pixel conversion including image enlargement processing corresponding to the enlargement magnification at that time is executed by the pixel conversion unit 31 via the switch 22 on the YUV data created by overlapping one line in this way. In this enlargement process, since the YUV data is sent so as to overlap with the next block as described above, the image quality of the created image is also generated when the pixels between the blocks are generated. Will not deteriorate.

  Specifically, as the enlargement process, pixel data located at the center is generated by referring to the vertical 2 pixels x horizontal 2 pixels of YUV data, and the fifth overlapping line is added as YUV data. Therefore, with respect to the 4th line YUV data, the 4th line and the 5th line are referred to by using the 4th line and 5th line YUV data, respectively. Each pixel data of a line to be interpolated between the first line of the block can be created.

  The increased YUV data obtained by the enlargement process is expanded and stored in the memory 17 by the third transfer unit 23 and then sent to the display control unit 25 by the fourth transfer unit 24. A display is output on the liquid crystal monitor of the digital still camera (step A02).

  At this time, the YUV data of the fifth line in the block is used only for performing the electronic zoom enlargement process in the pixel conversion unit 31, and the third transfer unit 23 relates to the YUV data of the fifth line. Is not transferred to the memory 17.

  As described above, after the monitor display process according to whether the electronic zoom function is designated in step A02 or A03, it is determined whether or not the shutter key constituting the key input unit 29 has been operated (step A04). If not, the process waits until the shutter key is operated while repeatedly executing the process of returning to the process from step A01.

  If it is determined in step A04 that the shutter key has been operated, it is then determined whether or not the electronic zoom function is designated at that time (step A05).

  If the electronic zoom function is not designated, as normal image recording processing, Bayer data obtained by imaging with the CCD 12 at the next timing is passed through the sample hold circuit 13, the A / D converter 14, and the line processing unit 15. After the first transfer unit 16 stores the data in the memory 17, the second transfer unit 18 'reads the Bayer data from the memory 17 in units of 8 blocks per block, and there is no overlap as shown in FIG. Four lines of YUV data are generated and generated by the YUV converter 19.

  The 4-line YUV data sequentially generated by the YUV conversion unit 19 is sequentially transferred to the JPEG processing unit 21 via the switch 20 to compress the data to obtain JPEG data in block units. The 5 transfer unit 26 stores the data for one screen in the memory 17 and then records it on a memory card as a recording medium (step A07).

  Thus, when the normal image recording process is executed, the process returns to step A01 in preparation for the next shooting again.

  If it is determined in step A05 that the electronic zoom function is designated when the shutter key is operated, the Bayer data obtained by imaging with the CCD 12 is sampled and held as an image recording process including an image enlargement process. 13, after being stored in the memory 17 by the first transfer unit 16 via the A / D converter 14 and the line processing unit 15, the second transfer unit 18 ′ stores the data from the memory 17 in units of 9 blocks per block. Data is read, and YUV data in units of 5 lines, which are overlapped line by line as shown in FIG.

  YUV data in units of 5 lines generated by the YUV conversion unit 19 is sequentially sent to the pixel conversion unit 31 via the switch 22 and subjected to enlargement processing so that the number of pixels increases according to the enlargement magnification set at that time. Thereafter, the obtained YUV data is transferred to the memory 17 by the third transfer unit 23 and stored.

  Specifically, as described above, as described above, pixel data positioned at the center is generated by interpolation with reference to 2 vertical pixels × 2 horizontal pixels of YUV data, and the fifth line overlaps as YUV data. Therefore, the 4 lines of YUV data are also referred to by using the 4th line and the 5th line of YUV data to refer to the area of 2 pixels in the vertical direction and 2 pixels in the horizontal direction. Each pixel data of a line to be interpolated between the first line and the first line of the next block can be created.

  Thereafter, the enlarged YUV data stored in the memory 17 is transferred to the JPEG processing unit 21 by the sixth transfer unit 27 and compressed to create JPEG data, and the JPEG data is generated by the fifth transfer unit 26. After being stored in the memory 17, it is recorded on a memory card which is a recording medium (step A06).

  Thus, when the image recording process including the image enlargement process is executed, the process returns to step A01 in preparation for the next photographing again.

  In the above embodiment, as shown in FIG. 13B, one pixel of YUV data is generated by referring to 5 vertical pixels × 5 horizontal pixels including 2 pixels (n = 2) in the vertical and horizontal directions. As shown in FIG. 3, the case where the generated YUV data overlaps by one line (m = 1) in units of blocks as shown in FIG. 3 is illustrated. However, the present invention is not limited to this, and the second transfer unit 18 ′ shifts every 2n lines in units of 4n + m (m, n: natural number) lines and sequentially transfers the Bayer data to the YUV conversion unit 19, so that the YUV conversion unit 19 YUV data is generated in units of 2n + m lines based on the contents of the vertical (2n + 1) × horizontal (2n + 1) pixel range including each of the upper, lower, left and right n pixels, and the variables m and n are within the range of natural numbers as described above. Set arbitrarily It shall be possible.

  For example, when n = m = 2, as shown in FIG. 4, one block that the second transfer unit 18 ′ reads from the memory 17 and transfers to the YUV conversion unit 19 is a block of 10 (= 4 × 2 + 2) lines. Therefore, the YUV conversion unit 19 sequentially generates YUV data for 6 (= 2 × 2 + 2) lines overlapping by 2 lines according to this.

In this case, the readout order of the pixel positions of the Bayer data by the second transfer unit 18 ′ is C1-1 → C1-2 → C1-3 → C1 in the first block in the line range C1 to C10 shown in FIG. -4 → C1-5 → C1-6 → C1-7 → C1-8 → C1-9 → C1-10 → C2-1 → C2-2 →.
Then, in the second block of the line range from C5 to C14 down by 4 lines, C1-5 → C1-6 → C1-7 → C1-8 → C1-9 → C1-10 → C1-11 → C1-12 → C1 -13 → C1-14 → C2-5 → C2-6 →.
It becomes.

Therefore, the YUV conversion unit 19 generates YUV data for 6 lines from the Bayer data for 10 lines. For example, the transfer order of the pixel positions of the generated YUV data is C3-3 → C3-4 → C3-5 → C3-6 → C3-7 → C3-8 → C4-3 → C4-4 → C4-5 → C4-6 → C4-7 → C4-8 → C5-3 → C5- 4 → ……
In the second block, C3-7 → C3-8 → C3-9 → C3-10 → C3-11 → C3-12 → C4-7 → C4-8 → C4-9 → C4-10 → C4-11 → C4-12 → C5-7 → C5-8 →
As shown by hatching in FIG. 4, the lowermost two lines of YUV data of a block at a certain position overlap with the uppermost two lines of YUV data of the block at the next position. Generated.

  In this case, as a specific enlargement process executed by the pixel conversion unit 31, pixel data located at the center is generated by interpolation with reference to vertical 4 pixels × horizontal 4 pixels of YUV data. Since two overlapping lines of 5th and 6th lines are added, YUV data for 4 lines of 3 to 6 lines are also used for the 4th line of YUV data, and each of 4 pixels in the vertical direction and 4 pixels in the horizontal direction. By referring to the area, each pixel data of a line that interpolates between the fourth line and the first line of the next block can be created.

  As described above, in the first embodiment, YUV data in which m lines are overlapped in advance in the YUV conversion unit 19 so that image degradation does not occur when the pixel conversion unit 31 performs enlargement processing for electronic zoom. Since the second transfer unit 18 'transfers the Bayer data so that the image is generated, the image is not unnecessarily deteriorated even during the electronic zoom without using a complicated circuit configuration.

  Although the first embodiment has been described as an object that follows the processing of color image data, it is easy to focus on only Y that is a luminance component in YUV data and consider the case where similar processing is performed. In addition, it can be seen that monochrome image data can be processed in the same manner.

(Second Embodiment)
A digital still camera according to a second embodiment of the present invention will be described below with reference to the drawings.

  FIG. 5 shows a partial circuit configuration thereof, which is basically the same as that shown in FIG. 1, and therefore, the same parts are denoted by the same reference numerals and the description thereof is omitted.

  Accordingly, it is assumed that the pixel conversion unit 31 is directly disposed at the subsequent stage of the YUV conversion unit 19 and the output is output to the JPEG processing unit 21 and the third transfer unit 23 via the switches 20 and 22.

  Next, the operation of the above embodiment will be described.

  FIG. 6 shows the processing contents corresponding to whether or not the electronic zoom is executed in the shooting mode. Initially, whether or not the electronic zoom function is designated by the operation of the zoom key constituting the key input unit 29 is determined. Is determined (step B01).

  Here, when the electronic zoom function is not designated, the second transfer unit 18 'uses the Bayer data from the memory 17 in units of 8 blocks as shown in FIG. 16, and the upper 4 lines are adjacent to the upper side. The data is read as being duplicated in the block and transferred to the YUV converter 19.

  Therefore, the YUV data created by the YUV conversion unit 19 based on this is such that there is no overlapping pixel position, and the created YUV data is passed through the pixel conversion unit 31 and the switch 22 via the third one. The data is developed and stored in the memory 17 by the transfer unit 23, sent to the display control unit 25 by the fourth transfer unit 24, and displayed on the liquid crystal monitor of this digital still camera (step B03).

  On the other hand, if it is determined in step B01 that the electronic zoom function is designated, the second transfer unit 18 'reads the Bayer data from the memory 17 as one block 9 lines as shown in FIG. Transfer to the YUV converter 19.

For example, the order of reading the pixel positions of the Bayer data by the second transfer unit 18 ′ is C1-1 → C1-2 → C1-3 → C1- in the first block in the line range C1 to C9 shown in FIG. 4 → C1-5 → C1-6 → C1-7 → C1-8 → C1-9 → C2-1 → C2-2 →.
In the second block of the line range from C5 to C13, which is lowered by 4 lines, C1-5 → C1-6 → C1-7 → C1-8 → C1-9 → C1-10 → C1-11 → C1-12 → C1 -13 → C2-5 → C2-6 →
It becomes.

Therefore, the YUV conversion unit 19 creates YUV data for five lines from the Bayer data for nine lines. For example, the transfer order of the pixel positions of the generated YUV data is C3-3 in the first block. → C3-4 → C3-5 → C3-6 → C3-7 → C4-3 → C4-4 → C4-5 → C4-6 → C4-7 → C5-3 → C5-4 →.
In the second block, C3-7 → C3-8 → C3-9 → C3-10 → C3-11 → C4-7 → C4-8 → C4-9 → C4-10 → C4-11 → C5-7 → C5-8 → ……
As shown in FIG. 3, the YUV data of a block at a certain position is such that one line at the bottom line overlaps with the top line position of the YUV data at the block at the next position. Generated.

  For the YUV data created by duplicating one line in this way, the pixel conversion including the image enlargement process corresponding to the enlargement magnification at that time is executed by the pixel conversion unit 31. Since the YUV data is sent so as to overlap with the next block as described in the first embodiment with respect to the specific processing contents, the pixels between the blocks are changed. Even when it is generated, the image quality of the created image does not deteriorate.

  Then, the YUV data with the increased number of pixels obtained by the enlargement process is expanded and stored in the memory 17 by the third transfer unit 23 via the switch 22 and then stored in the display control unit 25 by the fourth transfer unit 24. The necessary display range is displayed and output on the liquid crystal monitor of the digital still camera (step B02).

  As described above, after performing the monitor display process according to whether or not the electronic zoom function is designated in step B02 or B03, it is determined whether or not the shutter key constituting the key input unit 29 has been operated (step B04). If not, the process waits until the shutter key is operated while repeatedly executing the process of returning to the process from step B01.

  If it is determined in step B04 that the shutter key has been operated, it is then determined whether or not the electronic zoom function is designated at that time (step B05).

  If the electronic zoom function is not designated, as a normal image recording process, Bayer data obtained by imaging with the CCD 12 is first processed via the sample hold circuit 13, the A / D converter 14, and the line processing unit 15. After being stored in the memory 17 by the transfer unit 16, the second transfer unit 18 ′ reads Bayer data from the memory 17 in units of 8 lines per block. As shown in FIG. The YUV data is generated by the YUV converter 19.

  The YUV data in units of 4 lines sequentially generated by the YUV conversion unit 19 is directly transferred to the JPEG processing unit 21 sequentially through the pixel conversion unit 31 and the switch 20, and the JPEG processing unit 21 has 8 blocks worth of 2 blocks. Data compression processing is performed in units of YUV data to obtain JPEG data in block units (step B08).

  Then, the obtained JPEG data is stored in the memory 17 for one screen by the fifth transfer unit 26, and then recorded on a memory card as a recording medium (step B09).

  Thus, when the normal image recording process is executed, the process returns to step B01 in preparation for the next photographing again.

  If it is determined in step B05 that the electronic zoom function is designated when the shutter key is operated, it is then determined whether or not the zoom magnification designated by the operation of the zoom key is just double ( Step B06).

  Here, when the enlargement magnification is not twice, as image recording processing including image enlargement processing, Bayer data obtained by imaging with the CCD 12 is then sampled and held by the sample hold circuit 13, the A / D converter 14, and After the first transfer unit 16 stores the data in the memory 17 via the line processing unit 15, the second transfer unit 18 'reads the Bayer data from the memory 17 in units of one block and nine lines. As shown, the YUV conversion unit 19 generates YUV data in units of 5 lines which are overlapped line by line.

  The YUV data generated by the YUV conversion unit 19 is directly enlarged so that the number of pixels increases in accordance with the magnification specified by the pixel conversion unit 31, and the obtained YUV data is transmitted through the switch 20 here. The YUV data for one screen is sequentially developed and stored in a buffer memory (not shown).

  Then, when the YUV data for the first picture is aligned on the buffer memory, the YUV data is read from the buffer memory every 8 lines suitable for JPEG processing, transferred to the JPEG processing unit 21, and compressed. Data is created (step B07).

  The JPEG data created in this way is stored in the memory 17 by the fifth transfer unit 26, and then recorded on the memory card as the recording medium (step B09). Returning to the process from step B01 in preparation for the shooting.

  Further, when the electronic zoom function is designated in step B06 and it is determined that the zoom magnification is exactly double, the image recording process including the image enlargement process is obtained by the CCD 12 next. The Bayer data is stored in the memory 17 by the first transfer unit 16 via the sample and hold circuit 13, the A / D converter 14, and the line processing unit 15, and then 9 lines for one block are stored by the second transfer unit 18 '. Bayer data is read out from the memory 17 as a unit, and YUV data in units of 5 lines, which are overlapped line by line as shown in FIG.

  The YUV data in units of 5 lines generated by the YUV conversion unit 19 is sequentially sent to the pixel conversion unit 31 and subjected to enlargement processing so that the number of pixels increases according to the enlargement magnification set at that time, and then obtained 8 The line-by-line YUV data is sequentially transferred to the JPEG processing unit 21.

  That is, the original YUV data input to the pixel conversion unit 31 is four lines for one block and five lines excluding a line portion overlapping with an adjacent block, whereas the YUV data output from the pixel conversion unit 31 Is subjected to double enlargement processing (interpolation processing), so that it is 8 lines, twice as many, excluding the line portion that overlaps the adjacent block, and is the basic processing unit of JPEG processing of 8 pixels × Since it is in a state suitable for 8 pixels, it is transferred to the JPEG processing unit 21 as it is and compressed in this case to create JPEG data in block units (step B08).

  The JPEG data in block units thus created is stored in the memory 17 by the fifth transfer unit 26 for one screen, and then recorded on a memory card as a recording medium (step B09). When the process is finished, the process returns to step B01 in preparation for the next shooting.

  As described above, the pixel conversion unit 31 is arranged directly after the YUV conversion unit 19 and enlargement processing is not performed, or for YUV data enlarged at a specific magnification, YUV data for one screen is stored in the buffer memory. Since the YPEG data can be immediately compressed by the JPEG processing unit 21 without being developed, the circuit configuration can be further simplified and the recording of the image data on the medium can be executed in a shorter time. .

  In the second embodiment, as described in the first embodiment, YUV data with overlapping lines is generated as described in the first embodiment. However, as described with reference to FIG. 16, YUV data without overlapping lines is created. However, the YUV data enlarged at a specific magnification can be directly transferred to the JPEG processing unit 21, and the same effect can be obtained.

(Third embodiment)
A digital still camera according to a third embodiment of the present invention will be described below with reference to the drawings.

  FIG. 7 shows a partial circuit configuration thereof, which is basically the same as that shown in FIGS. 1 and 5 described above, and therefore, the same parts are denoted by the same reference numerals and description thereof is omitted.

  Therefore, it is assumed that the YUV data output from the YUV conversion unit 19 is sent to the pixel conversion unit 31 and the switch 22, and the output of the pixel conversion unit 31 is directly sent only to the JPEG processing unit 21 without passing through the switch 20. Shall.

  In addition, a pixel conversion unit 32 having a configuration similar to that of the pixel conversion unit 31 is provided at the subsequent stage of the switch 22, and the YUV data sent through the switch 22 by the pixel conversion unit 32 is enlarged when the electronic zoom function is designated. The processed data is transferred to the third transfer unit 23 and expanded and stored in the memory 17.

  Next, the operation of the above embodiment will be described.

  FIG. 8 is a diagram for explaining specific contents of the enlargement process at the time of electronic zoom executed by the pixel conversion units 31 and 32. Here, for ease of explanation, one block of YUV data input to the pixel conversion unit 31 (32) is for three lines, and therefore, the number of vertical pixels constituting the block is 3, One line in one block is an overlapping line, and this is enlarged by the pixel conversion unit 31 to be converted into three or four pixels.

  A portion indicated by a circled number in the figure is referred to as “<1>” in the text, and this is each pixel data input from the YUV conversion unit 19 before the enlargement process is performed.

  Therefore, in the first first block, the pixels of <1> to <3> are input in the vertical direction, and in the next second block, the pixels of <3> to <5> shifted by two pixels are input to the subsequent block. As for the pixels of <5> to <7>, pixel values in which lines of one pixel overlap between adjacent blocks are input.

  When a new pixel is generated as an enlargement process corresponding to two adjacent upper and lower pixels, the 16 equal points of the pixel value are obtained by a sampling operation. In FIG. The case where the enlargement process of / 10 times is performed is illustrated.

When the pixel <1> is first selected and new pixels are subsequently generated at a 10/16 pixel interval, the new pixel positions are indicated by black dots BP1, BP2,. For example, a pixel is generated at the position of two new black points BP6 and BP7 between the pixel <4> and the pixel <5>. In this case, each pixel value is obtained by sampling operation BP6 = (<4> × 14 + <5> × 2) / 16
BP7 = (<4> × 4 + <5> × 12) / 16
As described above, the sampling operation is performed on the assumption that the contents of the original pixel value on the closer side are accurately reflected according to the distance.

  Thus, as shown in the figure, pixel values of four black points BP1 to BP4 including the original pixel <1> are generated from the first block including the pixels <1> to <3>, while the pixels <3> to From the second block consisting of <5>, pixel values of three black spots BP5 to BP7 are generated.

  This takes into account only the enlargement in the vertical direction. If the number of pixels in the horizontal direction of the original YUV data is 100 and no enlargement process is performed in the horizontal direction, the entire first block is assumed. While 400 pixels are generated by the enlargement process, 300 pixels are generated by the enlargement process of the entire second block, and this is transferred in the pixel order as shown in FIG.

  FIG. 9 exemplifies a configuration of a circuit provided in the pixel conversion units 31 and 32 for calculating the extraction pixel position as described above, that is, the position of the next black point BPi. The hold value of 21 bits held in the E register 41 is added to the hold value of 22 bits in the A register 43 by the adder 42, and the sum output is updated and held in the A register 43.

  The 22 bits held in the A register 43 are output to the adder 42 as described above, while being output as the extracted pixel position. The contents of the division of the A register 43 are shown in FIG. The register 45 and the D register 46 are expressed.

  Here, the B register 44 holds the upper 8 bits of the 22 bits, and the 8 bits represent the contents corresponding to the line (vertical pixel) position in the original YUV data block.

  The C register 45 holds 4 bits following the 8 bits of the B register 44 in the 22 bits, and the offset position from the line position indicated by the B register 44, specifically, 16 etc. between two pixels. It represents the value when divided.

  The D register 46 holds the lower 10 bits of the 22 bits and is used as a dummy register for accuracy matching.

  For example, considering the extraction of the pixel position as shown in FIG. 8 above, the initial value “000000 (H)” is input to the A register 43, while the enlarged pixel interval is input to the E register 41. A 21-bit numerical value “002800 (H)” corresponding to “10 (/ 16)” is set.

The E register 41 is such that the upper 7 bits are an integer part and becomes “000400 (H)” at the same magnification without enlargement, so here 000400 (H) × 10/16
As described above, “002800 (H)” is set.

  That is, the first sampling position BP1 is A = “000000 (H)”, B = “00 (H)”, C = “0 (H)”, and the second sampling position BP2 is A + E = “002800”. (H) ”, B =“ 00 (H) ”, C =“ a (H) ”(= 10), the third sampling position BP3 is A + E =“ 005000 (H) ”, B =“ 01 (H ) ”, C =“ 4 (H) ”, the fourth sampling position BP4,..., And so on, the contents of the A register 43 are sequentially added by the holding value of the E register 41 to extract the pixel position. To go.

  When one scanning in the vertical direction is completed and one pixel is shifted in the horizontal direction, the contents of the A register 43 are initialized again and sampling positions are extracted.

  When the block is switched, the holding value of the E register 41 is added again to the photographing for initializing the A register 43, and the sum output is used as the initial value in the new block.

  The accuracy of the calculation related to the extraction of the pixel position as described above varies depending on the size of the D register 46, but is assumed to be 10 bits in the present embodiment.

  The capacity of the B register 44 is set in accordance with the maximum value of the number of pixels in the vertical direction (= number of lines) constituting one block of the original YUV data. Since a value of about is used, 8 bits are set so as to indicate a pixel position sufficiently larger than that.

  In this way, the pixel position is extracted from the pixel conversion unit 31 (32), and the YUV data after the pixel conversion as the enlargement process is performed on one screen from the pixel conversion unit 31 to a buffer memory not shown here. Sequentially develop and store until the minute YUV data is stored.

  Then, when the YUV data for the first image is aligned on the buffer memory, the YUV data is read from the buffer memory every 8 lines suitable for JPEG processing, transferred to the JPEG processing unit 21, and compressed. Create data.

  On the other hand, the YUV data enlarged by the pixel conversion unit 32 is sent to the memory 17 by the third transfer unit 23 and used for display. When the YUV data is transferred, the YUV data is also displayed for each block. Line number data is also transferred.

  FIG. 10 shows a state in which the line number data “LINECNT” is transferred in parallel with the YUV data “DATA” together with the reference clock “CLK”.

  Here, as an example of the case where the number of lines can be expanded to a maximum of 16 pixels (lines) per block, a case of transferring with parallel data having a 5-bit width is illustrated.

  Further, FIG. 11 shows a state in which the line number data “LINECNT” is serially transferred prior to the YUV data in synchronization with the enable signal “ENB” when the YUV data is transferred serially. ".

  In this way, the number of pixels is increased / decreased as an enlargement process in units of blocks consisting of a plurality of line areas, and even when the number of lines constituting each increased / decreased block differs, line number information is output to the next stage Can be dealt with.

  Therefore, in the case where enlargement processing for electronic zoom is performed with the same number of pixel lines in any block, the number of pixel configurations before enlargement and after enlargement must maintain an integer ratio relationship. Although the numerical value that can be set as the enlargement magnification is restricted, in the embodiment of the present application, there is no restriction on the enlargement magnification designated as the enlargement processing of such electronic zoom, and the electronic at a wide variety of enlargement magnifications. A zoom function can be realized.

  In the configuration shown in FIG. 7, two pixel conversion units 31 and 32 are provided, and YUV data to be compressed by the JPEG processing unit 21 and recorded on the memory card is enlarged by the pixel conversion unit 31. On the other hand, YUV data for display output on a liquid crystal monitor or the like is subjected to enlargement processing by the pixel conversion unit 32. This is because YUV data having a different number of pixels, that is, monitor display and recording on a medium. This is done in order to maintain responsiveness as a digital still camera without wasting time by parallelizing the mutual processing in handling.

  In the third embodiment, as described in the first and second embodiments, YUV data having a line overlapping with the next block is generated for each block. As described in FIG. 16, YUV data in which no lines overlap at all between blocks may be created, and enlargement processing may be performed with different enlargement magnifications for each block so that various electronic zoom enlargement magnifications can be supported. .

  The first to third embodiments have been described with respect to the case where the present invention is applied to a digital still camera. However, a digital video camera or the like can be used as long as the camera device has an electronic zoom function. Of course, the present invention can be similarly applied.

  In addition, the present invention is not limited to the above-described embodiment, and various modifications can be made without departing from the scope of the invention.

  Further, the above embodiments include inventions at various stages, and various inventions can be extracted by appropriately combining a plurality of disclosed constituent elements. For example, even if some constituent requirements are deleted from all the constituent requirements shown in the embodiment, at least one of the issues described in the column of the problem to be solved by the invention can be solved, and is described in the column of the effect of the invention. In a case where at least one of the obtained effects can be obtained, a configuration in which this configuration requirement is deleted can be extracted as an invention.

1 is a block diagram showing a partial circuit configuration of a digital still camera according to a first embodiment of the present invention. 7 is a flowchart showing processing contents corresponding to whether or not the electronic zoom function is executed in the shooting mode according to the embodiment. The figure which shows the relationship between the transfer state of Bayer data which concerns on the embodiment, and the YUV data produced | generated corresponding to it. The figure which shows the other state of the transfer state of the Bayer data which concerns on the embodiment, and the YUV data produced | generated corresponding to it. The block diagram which shows the partial circuit structure of the digital still camera which concerns on the 2nd Embodiment of this invention. 7 is a flowchart showing processing contents corresponding to whether or not the electronic zoom function is executed in the shooting mode according to the embodiment. The block diagram which shows the partial circuit structure of the digital still camera which concerns on the 3rd Embodiment of this invention. The figure explaining the correspondence of the specific pixel position of the expansion process which concerns on the same embodiment. FIG. 3 is a block diagram showing a configuration of a circuit that performs pixel position extraction according to the embodiment. The figure which illustrates the output form of the line number data which concerns on the same embodiment. The figure which illustrates other output forms of line number data concerning the embodiment. The block diagram which shows the partial circuit structure of a common digital still camera. The figure which shows the concept which produces | generates YUV data from Bayer data. The figure which shows the concept which produces | generates YUV data from Bayer data. The figure which shows the concept which produces | generates YUV data from Bayer data. The figure which shows the concept which produces | generates YUV data from Bayer data.

Explanation of symbols

11 ... Optical lens system 12 ... CCD
13 ... Sample hold circuit (S / H)
14 ... A / D converter (A / D)
DESCRIPTION OF SYMBOLS 15 ... Line processing part 16 ... 1st transfer part 17 ... Memory 18, 18 '... 2nd transfer part 19 ... YUV conversion part 20 ... Switch (SW)
21 ... JPEG processing unit 22 ... Switch (SW)
23 ... Third transfer unit 24 ... Fourth transfer unit 25 ... Display control unit 26 ... Fifth transfer unit 27 ... Sixth transfer unit 28 ... System controller 29 ... Key input units 31, 32 ... Pixel conversion unit 41 ... E register 42 ... Adder 43 ... A register 44 ... B register 45 ... C register 46 ... D register

Claims (15)

A digital camera having an electronic zoom function,
The image data obtained by the image sensor is sequentially transferred in units of a predetermined number of lines, and when transferring a predetermined number of lines of image data, the top one or more lines of the predetermined number of lines of image data to be transferred next Transfer means for transferring with image data for
A digital camera comprising: enlargement processing means for performing enlargement processing on a predetermined number of lines of image data to which image data for one to a plurality of lines is sequentially transferred from the transfer means. A digital camera having an electronic zoom function,
Transfer means for sequentially transferring color image data obtained by an image sensor having a color filter by shifting every 2n lines in units of 4n + m (m, n: natural number) lines;
Luminance color difference in units of 2n + m lines composed of pixels corresponding to the contents of the vertical (2n + 1) × horizontal (2n + 1) pixel range including each of the upper, lower, left and right n pixels in the color image data sent in units of 4n + m lines from this transfer means. First pixel conversion means for creating the same data of the system;
And a second pixel conversion means for increasing the number of constituent pixels by an enlargement process based on 2n + m line luminance color difference system color image data sent from the first pixel conversion means. Digital camera. A zoom instruction means for instructing an operation of the electronic zoom function;
The transfer unit, the first pixel conversion unit, and the second pixel conversion unit execute the transfer process and the pixel conversion process when an operation of an electronic zoom function is instructed by the zoom instruction unit. The digital camera according to claim 2. When the operation of the electronic zoom function is not instructed by the zoom instruction means, the transfer means sequentially transfers the color image data by shifting every 2n lines in units of 4n lines, and the first pixel conversion means Luminance color difference in units of 2n lines composed of pixels corresponding to the contents of a vertical (2n + 1) × horizontal (2n + 1) pixel range including each of the upper, lower, left and right n pixels in the color image data sent from the transfer means in units of 4n lines. Create the same data of the system,
Color image data in units of 2n lines sent from the first pixel conversion means when the operation of the electronic zoom function is not instructed by the zoom instruction means, and the operation of the electronic zoom function is instructed by the zoom instruction means 4. The digital camera according to claim 3, further comprising data compression means for compressing at least one of the color image data that has been subjected to enlargement processing by the second pixel conversion means. A digital camera having an electronic zoom function,
Transfer means for sequentially transferring image data obtained by the image sensor in units of a predetermined number of lines;
An enlargement processing means for enlarging a predetermined number of lines of image data sequentially transferred from the transfer means based on a predetermined zoom magnification;
Data compression means for compressing the image data;
A digital camera comprising transfer control means for sequentially transferring image data for a predetermined number of lines enlarged by the enlargement processing means based on a predetermined zoom magnification to the data compression means. Zoom magnification specifying means for specifying the zoom magnification of the electronic zoom function;
Determining means for determining whether or not the zoom magnification designated by the zoom magnification designation means is a predetermined zoom magnification;
The enlargement processing means enlarges the image data for a predetermined number of lines sequentially transferred from the transfer means based on the zoom magnification designated by the zoom magnification designation means,
The transfer control means sequentially transfers the image data for a predetermined number of lines enlarged by the enlargement processing means to the data compression means when it is determined that the predetermined zoom magnification is obtained by the determination means. The digital camera according to claim 5, wherein The transfer control means sequentially develops image data for a predetermined number of lines enlarged by the enlargement processing means on a memory when the determination means determines that the zoom magnification is not a predetermined zoom magnification, and the image from the memory. 7. The digital camera according to claim 6, wherein the data is read in a data compression unit of the data compression means and transferred to the data compression means.   8. The digital camera according to claim 5, wherein the transfer control means sequentially transfers a predetermined number of lines of image data sequentially transferred from the transfer means to the data compression means. A digital camera having an electronic zoom function,
Transfer means for sequentially transferring image data obtained by the image sensor in units of a predetermined number of lines;
A digital camera comprising zoom processing means for performing zoom processing with different number of lines for each image data on image data for a predetermined number of lines sequentially transferred from the transfer means.   When transferring the image data for a predetermined number of lines, the transfer means transfers the image data for the first one or more lines among the image data for the predetermined number of lines to be transferred next. 10. The digital camera according to claim 9, wherein   11. The digital camera according to claim 9, wherein the zoom processing means outputs line number information of a predetermined number of lines of image data after the zoom processing. An image processing method in a digital camera having an electronic zoom function,
The image data obtained by the image sensor is sequentially transferred in units of a predetermined number of lines, and when transferring a predetermined number of lines of image data, the top one or more lines of the predetermined number of lines of image data to be transferred next A transfer process for transferring the image data for the
An image processing method comprising: an enlarging process step of enlarging a predetermined number of lines of image data to which image data for one to a plurality of lines is sequentially obtained by the transfer step. An image processing method in a digital camera having an electronic zoom function,
A transfer step of sequentially transferring color image data obtained by an image sensor having a color filter by shifting every 2n lines in units of 4n + m (m, n: natural number) lines;
Luminance color difference of 2n + m line units composed of pixels corresponding to the contents of the vertical (2n + 1) × horizontal (2n + 1) pixel range including each of the upper, lower, left and right n pixels in the color image data sent in 4n + m line units by this transfer process. A first pixel conversion step for creating the same data of the system;
And a second pixel conversion step for increasing the number of constituent pixels by an enlargement process based on 2n + m line-unit luminance / color-difference color image data obtained in the first pixel conversion step. Method. An image processing method in a digital camera having an electronic zoom function,
A transfer step of sequentially transferring image data obtained by the image sensor in units of a predetermined number of lines;
An enlargement process step of enlarging the image data for a predetermined number of lines sequentially obtained by the transfer means based on a predetermined zoom magnification;
A data compression step for compressing the image data;
An image processing method comprising: a transfer control step of sequentially transferring image data for a predetermined number of lines subjected to enlargement processing based on a predetermined zoom magnification in the enlargement processing step to the data compression means. An image processing method for a digital camera having an electronic zoom function,
A transfer step of sequentially transferring image data obtained by the image sensor in units of a predetermined number of lines;
An image processing method comprising: a zoom processing step of performing a zoom process in which the number of lines differs for each image data with respect to image data for a predetermined number of lines sequentially obtained by the transfer step.

Images