JP2005244760A - Imaging apparatus and image forming method thereof - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an imaging apparatus having a completely new imaging system which is not employed in a conventional technique, and an image forming method thereof. <P>SOLUTION: If one screen of a second compression image is designated, the imaging apparatus 1 generates a high resolution static image data for performing expansion decoding to display a designated screen by the second compression image and another compression image including a first compression image before or after the second compression image. The device 1 has a control unit 16 for using both a rolling shutter function and a global shutter function during taking one moving image data; and an image processing unit 14 for applying intraframe compression to the data of pixels taken by the global shutter to generate the first compression image, and applying interframe compression to the data of pixels taken by the rolling shutter in a period before or after the period for generating the first compression image to generate the second compression image. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to an image pickup apparatus such as a digital camera and an image pickup method, and more specifically, an image taken out as a moving image main body (a relatively low number of pixels) and an image that can be handled as a still side (a relatively high number of pixels) on the same stream. The present invention relates to an imaging apparatus to be handled and an image generation method thereof.

  2. Description of the Related Art Conventionally, various imaging devices that can capture a high-resolution still image during moving image shooting have been proposed as shown as first to eighth imaging devices below.

  The first imaging device captures a still image at a predetermined cycle during moving image capturing (see Patent Document 1).

  The second imaging device captures a high-resolution still image at a fixed interval by an operator's operation or automatically during normal-resolution video recording, and the still image is used as still image data. The recorded moving image is recorded as moving image data, and the presence of still image data is displayed during moving image reproduction, and the still image display is switched by the operation of the operator (see Patent Document 2).

  The third imaging device is an image recording device that captures a still image by shooting a moving image of a predetermined period by an operator's shot button operation, and corrects the captured still image using the preceding and following moving images. It is.

  The fourth imaging device is a moving image recording device such as a camcorder that captures a high-definition still image when a shot button is operated during moving image shooting, and forcibly encodes a high-definition still image during shutter button operation. It is encoded as an image (I picture) (see Patent Document 3).

  The fifth imaging device is capable of still image shooting during moving image shooting, and when there is no desired still image, a high-resolution image corresponding to the desired moving image is obtained as a desired moving image and It is synthesized with related still images (see Patent Document 4).

  The sixth imaging device is a digital camera that starts recording a moving image by half-pressing the shutter button and captures a still image while recording an operation by pressing the shutter button. Is stored in association with the moving image data (see Patent Document 5).

  A seventh imaging device is an image recording device that captures a still image by operating an operator's shutter button during moving image shooting, and corrects the captured still image using moving images before and after (Patent Document). 6).

  The eighth imaging device records moving image and still image data as a series of files, the moving image is recorded in MP @ ML (Main Profile at Main Level), and the still image is recorded in MP @ HL (Main Profile at High). Level) (see Patent Document 7).

JP-A-7-245722 Japanese Patent Laid-Open No. 9-51498 JP-A-7-284058 JP 2002-51252 A JP 2002-84442 A JP-A-7-143439 JP-A-11-234623

By the way, in each of the above-described imaging apparatuses, in general, when an image of a moving image level is captured, exposure and data transfer are sequentially performed by repeating a rolling shutter. In addition, when continuous shooting of still images is performed, a rolling shutter is similarly continued or a mechanical shutter is used.
Here, in the image capture using only the rolling shutter, image distortion occurs at the top and bottom of the image. However, since it is a moving image to the last, it is permissible.
However, if that becomes the capture of a still image, this image distortion becomes unacceptable. Therefore, a mechanical shutter is necessary, but there is a limit to mechanical shutter driving in order to capture continuous images at high speed.

Further, in a digital camera or the like, in order to obtain a desired image with high resolution, it is necessary for an operator to observe a subject to be photographed and to operate a release button at a timing considered here.
However, even if it is operated at the timing considered here, a desired image is not always obtained, and a continuous shooting function for solving this problem has been put into practical use.
However, if the image is taken at a high resolution, for example, several frames per second for 10 seconds, the recorded image data is enormous, and considering the capacity of the current memory card or the like, the practicality is poor.
Also, those with such a continuous shooting function, in the case of high resolution still image continuous shooting with millions of pixels, the upper limit of the continuous shooting speed greatly depends on the readout processing capacity of the CCD, etc., so about several frames per second If the desired image is a fast moving subject, for example, it is difficult to obtain the desired image even if continuous shooting is used.

  Therefore, an imaging apparatus that allows an operator to obtain a desired high-resolution still image without worrying about shutter timing without worrying about the speed of continuous shooting or the like and with a practically reduced recording capacity. Newly developed.

  The present invention is completely new that has occurred in such development, and is not particularly based on the above-described problem of obtaining a high-resolution generated image. The purpose is to provide.

  According to a first aspect of the present invention, there is provided an imaging apparatus that performs predetermined image processing on image data obtained by an imaging device that forms an optical image of a subject on an imaging device and captures the image with the shutter function. A control unit that includes a global shutter function and a rolling shutter function, and uses both the rolling shutter and the global shutter during capture of moving image data, and intra-frame compression of the pixel data captured by the global shutter. An image processing unit that generates one compressed image and generates a second compressed image by inter-frame compression of pixel data captured by the rolling shutter in a period before and after the period for generating the first compressed image And have.

  Preferably, the image processing unit reads and generates the first compressed image from the image sensor without thinning out the image data, and reads the second compressed image from the image sensor by thinning out the image data. Generate.

  Preferably, the image processing unit performs intra-frame compression on high-pixel image data when generating the first compressed image, and inter-frame compresses low-pixel image data when generating the second compressed image. Compress.

  Preferably, when the second compressed image is generated by thinning out data from the image sensor, thinning readout is performed by integrating pixels in the vicinity of the same color.

  Preferably, the image processing unit corrects the image level of the first compressed image and the image level of the second compressed image to substantially the same level.

  Preferably, the image processing unit corrects the image level of the first compressed image on the basis of the R level obtained by performing the integration process reading of the second compressed image, thereby obtaining an image of the first compressed image. The level and the image level of the second compressed image are corrected to substantially the same level.

  Preferably, the image processing unit maintains the image level of the first compressed image, and corrects the image level of the second compressed image by dividing by an integration amount of integration processing. The image level of one compressed image and the image level of the second compressed image are corrected to substantially the same level.

  Preferably, when the image processing unit designates one screen of the second compressed image, the image processing unit performs decompression decoding using the second compressed image and another compressed image including the first compressed image before and after the second compressed image. Thus, high-resolution still image data representing the designated one screen is generated.

  According to a second aspect of the present invention, a predetermined image processing is performed on image data obtained by an image pickup device that is formed by forming an optical image of a subject on the image pickup device and captured by a shutter function including a global shutter function and a rolling shutter function. An image generation method of an imaging apparatus for generating image data, wherein during the acquisition of moving image data, the pixel data acquired by the global shutter is intra-frame compressed to generate a first compressed image within one screen. Then, in a period before and after the period for generating the first compressed image, the pixel data captured by the rolling shutter is inter-frame compressed to generate a second compressed image.

  According to the present invention, an unprecedented new imaging apparatus can be provided.

  Embodiments of an imaging apparatus according to the present invention will be described below with reference to the accompanying drawings.

  FIG. 1 is a diagram illustrating an overall configuration of an imaging apparatus 1 in the present embodiment. The imaging apparatus 1 is roughly composed of an optical system, a signal processing system, a recording system, a display system, and a control system.

The imaging apparatus 1 according to the present embodiment generates a first compressed image by intra-frame compression of high pixel image data in a signal processing system during moving image shooting, and before and after a period for generating the first compressed image. When the second compressed image is generated by inter-frame compression of the low-pixel image data during a period and one screen of the second compressed image is designated, the second compressed image and the first compressed image before and after the second compressed image are High-definition still image data representing one designated screen is generated by decompression decoding using the other compressed images included.
The image pickup apparatus 1 according to the present embodiment uses both the rolling shutter function and the global shutter function while capturing one moving image data.
In addition, the imaging apparatus 1 according to the present embodiment corrects the image level of the first compressed image and the image level of the second compressed image at substantially the same level.
Hereinafter, the configuration and function of each unit will be described.

The optical system includes a lens optical system 10 and an image sensor 11 such as a CMOS sensor.
The lens optical system 10 includes an optical lens 101 that faces a subject, an optical low-pass filter (not shown), and the like. In the lens optical system 10, an optical image of the subject is collected by the optical lens 101 and an image of the subject is formed on the image sensor 11.

The image sensor 11 as an image sensor is composed of, for example, a CMOS image sensor provided with a color filter, and photoelectrically converts an object image formed by the lens optical system 10.
Further, it has a shutter function including a global shutter function and a rolling shutter function.
The shutter function is controlled so that the global shutter function or the rolling shutter function is selectively used according to the control of the control system, and the image can be captured by the global shutter while the pixels are captured by the rolling shutter. The In other words, the rolling shutter function and the global shutter function are used in combination during capture of the single moving image data.

  The signal processing system digitally outputs a CDS 12 that is a correlated double sampling circuit (CDS: Correlated Double Sampling) for reducing noise by sampling an electrical signal output from the image sensor 11 and an analog signal output from the CDS 12. An A / D converter 13 that converts the signal into a signal and an image processing unit 14 that performs predetermined image processing to be described later on the digital signal output from the A / D converter 13 are configured.

The image processing unit 14 according to the present embodiment basically generates the first compressed image by intra-frame compressing the pixel data captured by the global shutter, and before and after the period for generating the first compressed image. During this period, the pixel data captured by the rolling shutter is inter-frame compressed to generate a second compressed image.
As will be described in detail later, the image processing unit 14 reads and generates the first compressed image from the image sensor without thinning out the image data, and reads the second compressed image by thinning out the image data from the image sensor. To generate.
The image processing unit 14 performs intra-frame compression on high-pixel image data when generating the first compressed image, and inter-frame compresses on low-pixel image data when generating the second compressed image.
In addition, when the image processing unit 14 generates the second compressed image by thinning out data from the image sensor, the image processing unit 14 performs thinning out reading by performing integration processing of pixels in the vicinity of the same color.
The image processing unit 14 has a function of correcting the image level of the first compressed image and the image level of the second compressed image to substantially the same level.

As will be described in detail later, the image processing unit 14 corrects the image level of the first compressed image based on the R level obtained by performing the integration process readout of the second compressed image, thereby correcting the first compressed image. It has a function of correcting the image level and the image level of the second compressed image to substantially the same level.
Further, the image processing unit 14 maintains the image level of the first compressed image, and corrects the image level of the second compressed image by dividing by the integration amount of the integration process, thereby correcting the first compressed image. It has a function of correcting the image level and the image level of the second compressed image to substantially the same level.
When the image processing unit 14 designates one screen of the second compressed image, the image processing unit 14 decompresses and decodes the second compressed image and the other compressed images including the first compressed image before and after the second compressed image. A function of generating high-resolution still image data representing a screen;

  The recording system includes a memory 15 that stores a control program executed by the control unit 16 and compressed data of the image data generated by the image processing unit 14.

  The display system includes a D / A converter 18 that converts image data processed by the image processing unit 14 and stored in a built-in image memory, and an LCD (Liquid Crystal) that functions as a finder by displaying an input image. The display unit 19 including a display) is included.

  The control system includes a timing generator 17 that controls the operation timing of the image sensor 11 to the A / D converter 13, an operation input unit 20 for inputting a shutter operation and other commands by the user, an image processing unit 14, A control program stored in the memory 15 is read out, and a CPU (Central Processing Unit) that controls the entire imaging apparatus 1 based on the read control program and a command from the user input from the operation input unit 20. ) And the like.

  The control unit 16 controls to use a rolling shutter function in the case of a moving image and to use a global shutter in the case of a still image when capturing image data having a different number of pixels on one stream.

  Here, when capturing image data with a different number of pixels on one stream, a moving shutter is used for a moving image, and a rolling shutter or a global shutter is used for a still image.

  That is, in the imaging apparatus 1 according to the present embodiment, in a system in which the control unit 16 extracts a different number of pixels from the imaging element in a series of operations, an image (relatively low number of pixels) to be extracted as a moving image main body and a still image are extracted. When handling images (relatively high number of pixels) that can be handled on the same stream, the global shutter is not used when capturing low pixels, and the global shutter (or mechanical shutter) is used only when capturing high pixels. Do.

Normally, when capturing an image of a moving image level, exposure and data transfer are sequentially performed by repeating a rolling shutter. In addition, when performing continuous shooting of still images, control is similarly performed using a rolling shutter, a mechanical shutter, or a global shutter.
Here, in the image capture using only the rolling shutter, image distortion occurs at the top and bottom of the image. However, since it is a moving image to the last, it is permissible.
However, this image distortion becomes unacceptable when it becomes the capture of a still image. Therefore, a mechanical shutter and a global shutter are required. Infinitely, in order to capture continuous images at high speed, there is a limit to mechanical shutter drive, and a global shutter becomes indispensable.
Here, when capturing image data with a different number of pixels on one stream, the moving image uses the rolling shutter function, and the still image uses the rolling shutter or the global shutter.

FIG. 2 is a diagram illustrating an example of an image sensor (image sensor) when the rolling shutter is used.
Assuming that lines A to F exist in the element as shown in FIG. 2, the control of the image is as shown in FIG.
Usually, when this rolling shutter is used, an exposure time shift occurs between the A to F lines, causing image distortion.

  FIG. 4 is a diagram illustrating an example of an image control waveform when it is assumed that lines A to F exist in the element as in FIG. 2 when the global shutter is used.

In this case, when the global shutter is used, the exposure time is not shifted, so that the image is not distorted. However, since exposure ends simultaneously, it is necessary to start exposure for all pixels simultaneously. In addition, compared to the rolling shutter, the image transfer time is generated all at once, so a long time is required.
Therefore, the advantage of the rolling shutter is that the capturing speed is faster than the global shutter and the mechanical shutter. The disadvantage is that it causes image distortion between lines.
In contrast, the advantage of the global shutter (or mechanical shutter) is that data that does not cause image distortion can be obtained, while the capturing speed is slower than that of the rolling shutter.
If these advantages and disadvantages are predicted in advance as a camera system, depending on the camera situation (for example, user settings), image distortion is acceptable but speed priority is absolutely necessary. Even if it is an image, all images are captured by a rolling shutter. If priority is given to image quality, a global shutter is used for the necessary image data.
The same applies to a case where the same number of pixels is handled in a series of operations, not limited to a system in which different numbers of pixels are extracted from the image sensor.

In the imaging apparatus 1, an optical image of a subject is incident on an image sensor 11 via a lens optical system 10, and is photoelectrically converted by the image sensor 11 to become an electrical signal. The obtained electrical signal is removed of noise components by the CDS 12, digitized by the A / D converter 13, and then temporarily stored in an image memory built in the image processing unit 14.
In a normal state, an image signal is constantly overwritten at a constant frame rate in the image memory built in the image processing unit 14 by the control of the signal processing system by the timing generator 17. The image signal of the image memory built in the image processing unit 14 is converted into an analog signal by the D / A converter 18, and a corresponding image is displayed on the display unit 19.

  The display unit 19 also serves as a finder for the imaging apparatus 1. After the user presses (operates) the shutter button included in the operation input unit 20, the control unit 16 holds the image signal immediately after the shutter button is pressed to the timing generator 17, that is, image processing. The signal processing system is controlled so that the image signal is not overwritten in the image memory of the unit 14. Then, the image data held in the image memory of the image processing unit 14 is compressed by a predetermined method and recorded in the memory 15.

  Next, characteristic processing executed in the image processing unit 14 will be described.

An image that can be handled as a moving image (a relatively low number of pixels) and an image that can be handled as a still image in a system that takes out the number of different pixels from the image sensor in a series of gain scaling or averaging control operations when capturing images with different numbers of pixels When handling (relatively high number of pixels) on the same stream, in the case of low pixel capture, the output pixel consists of integrated pixel data of at least one pixel of the same color pixel. In the case of high pixel capture, the number of pixels is less than the number of integrated pixels at the time of low pixel capture.
The output of one of the output pixels is naturally different due to the difference in the number of original integrated pixels. If it is determined that the outputs of the different one pixel and the same pixel are the same, in the image processing, images having particularly different luminances are continuously generated, resulting in a strange image.
In order to solve this problem, the image processing unit 14 is provided with a digital gain circuit (or an analog gain circuit) corresponding to the number of pixels or a circuit that averages the number of pixels at the pixel output portion. A circuit that corrects the occurrence of a difference in the image output of pixels and pixels is provided.

  FIG. 5 is a conceptual diagram of the image sensor. In FIG. 5, RGB indicates the three primary colors red, blue, and green.

In the sensor diagram as shown in FIG. 5, when capturing a still image (high pixel), pixels corresponding to almost all pixels are captured. On the other hand, in the case of a moving image (low pixels), since the number of pixels can be small, all pixels need not be captured, and the minimum necessary pixels are captured.
Normally, unnecessary pixels are eliminated by simple thinning, but when obtaining the quality of a moving image or the like, the surrounding R is integrated and extracted as shown in FIG.
At that time, the output pixel data differs between the case of the still image (high pixel) and the case of the moving image (low pixel).
In order to correct this, at the time of high pixels and low pixels, a coefficient corresponding to the ratio of the integrated pixel is applied to the output data for correction, or the integrated pixel data is corrected according to the number of integrated pixels. The output level for still images and moving images is corrected by averaging with.
FIG. 6 shows a conceptual diagram of correction processing according to the present embodiment.

S / N information control at the time of high pixels In a system in which a different number of pixels is extracted from the image sensor, an image to be extracted as a moving image (relatively low number of pixels) and an image that can be handled as a still image (relatively high pixels) In the case of low pixel capture, the output pixel consists of integrated pixel data of at least one pixel of the same color pixel, and in the case of high pixel capture, the low pixel The number of pixels is less than the number of integrated pixels at capture.
In the case of low pixel capture, the single pixel data is generated from the integration of a plurality of pixels. Compared with that at the time of short pixel capture, the output is increased by the number of integrals. Compared with N, the information is excellent in S / N.
In this embodiment, the integrated data (S / N information of information at the time of moving images is used to improve the image quality of short pixel data (still image information) that is relatively noisy.

The output of one of the output pixels is naturally different due to the difference in the number of original integrated pixels. If it is determined that the outputs of the different one pixel and the same pixel are the same, in the image processing, images having particularly different luminances are continuously generated, resulting in a strange image.
In order to solve this problem, as described above, a digital gain circuit (or an analog gain circuit) corresponding to the number of pixels or a circuit that averages the number of pixels is provided in the portion where the pixels are output. A circuit for correcting occurrence of a difference in the image output of one pixel is provided.

Referring to FIG. 5, FIG. 5 shows a diagram integrating four pixels.
That is, as compared with a single pixel, (R) output therefrom is an image output having an output about four times. This is advantageous for about two stages in terms of ISO sensitivity. This (R) information is always used during low pixel output.
In contrast, at the time of high pixel output, information of single pixel output information rl to r4 is used.
In order to adjust the level output from the image sensor 11, the single pixels rl to r4 are corrected by increasing the analog or digital gain on the same stream. This gain increase causes a serious deterioration with respect to S / N.
If the original is corrected, the (R) information is the integration information of rl to r4, and can be inferred from the (R) information with less noise.
On the other hand, the single pixel rn finally becomes Rn whose gain has been increased.

That is, the sum (R1 + R2 + R3 + R4) of the data obtained by increasing the gain of each single pixel must be logically equal to (R), which is the sum of the original (r1 + r2 + r3 + r4). However, the following relationship is generally established due to an increase in noise such as gain increase. R1 + r2 + r3 + r4 >> (R)

Therefore, if there is a component (R1 + R2 + R3 + R4) that matches the moving image information (R) from the address of a single pixel, the gain multiplied by each is calculated backward, and the content returned to the original component (r1 + r2 + r3 + r4) And (R), which should consist of the integral,
r1 + r2 + r3 + r4 >> (R)
When the relationship is established, it is determined that the excess is noise, and (r1−n1) + (r2−n2) + (r3−n3) + (r4−n4) + (r4−n4) (1)
Correction is performed to reduce N1 to N4 corresponding to n1 to n4.

At this time, n1 to n4 may be constant values, may be output ratios of rl to r4, or may be mixed. It depends on what kind of noise is dominant in the noise component in the camera system.
Also, there is a calculation error (quantization error, etc.). The right side of equation (1) is not (R) fixed but (R) ± x.
At this time, x is the number of error corrections caused by errors such as rounding in calculation.

Method of generating still image quality even during playback at the time of video timing In a series of operations that take out a different number of pixels from the image sensor, an image that can be extracted as a video subject (a relatively low number of pixels) and an image that can be handled as a still image ( A relatively high number of pixels) is handled and controlled on the same stream, and even when it has only video image quality (low pixel count) at the time of playback, the image quality is determined based on information predicted from surrounding still image information. Is restored as a still image.

FIG. 7 shows a stream including a moving image (low pixel) and a still image (high pixel).
Here, the difference between the high pixel (still image) image data In and the low pixel (moving image) image data bn is that, in the output image information corresponding to one pixel, In is information of one corresponding pixel, and bn is a pixel to be integrated. There is a difference in information.
In addition, since In can be integrated digitally, information at the time of In substantially includes still image information and moving image information.
Here, from the moving image information bn including information predicted from I, object movement information is calculated by integrating the integrated information.
In addition, the content ratio information of each integrated single pixel is obtained from In.
Therefore, for example, b5 still image generation that has only information on the number of moving image pixels can be restored to the pixel component here by multiplying the component ratio of each integrated single pixel expected from the fluctuation of I information. . An image of still image quality can be created by generating an image from the individual single pixel information. For the above-described reason, an image between b and b can also be created from the object movement information of bn and the content ratio information of In.

As described above, according to the imaging device 1 in the present embodiment, during moving image shooting in the signal processing system, the first compressed image is generated by intra-frame compressing the high-pixel image data and generating the first compressed image. When the second compressed image is generated by inter-frame compression of the low pixel image data in a period before and after the period for generating the second compressed image and one screen of the second compressed image is designated, High-resolution still image data representing one designated screen is generated by decompression decoding with other compressed images including the first compressed image.
The imaging apparatus 1 according to the present embodiment uses the rolling shutter function and the global shutter function together during capturing of single moving image data, so that continuous image capturing is performed at high speed while suppressing the occurrence of image distortion. There are advantages that can be made.
In addition, the imaging apparatus 1 according to the present embodiment can correct the image level of the first compressed image and the image level of the second compressed image at substantially the same level, and continuously capture images having different image luminances. Therefore, there is an advantage that can be prevented from being generated.

It is a block diagram showing one embodiment of an imaging device concerning this embodiment. It is a figure which shows an example of the image pick-up element (image sensor) at the time of rolling shutter use. FIG. 3 is a diagram illustrating an example of a control waveform of an image when it is assumed that lines A to F exist in the element as illustrated in FIG. 2. FIG. 3 is a diagram illustrating an example of a control waveform of an image when it is assumed that lines A to F exist in the element as in FIG. 2 when the global shutter is used. It is a conceptual diagram of an image sensor. It is a figure which shows the conceptual diagram of the correction process which concerns on this embodiment. It is a conceptual diagram on the stream of a moving image (low pixel) and still image (high pixel) mixed.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Imaging device 10 ... Lens optical system 11 ... Image sensor 12 ... CDS
DESCRIPTION OF SYMBOLS 13 ... A / D converter 14 ... Image processing part 15 ... Memory 16 ... Control part 17 ... Timing generator 18 ... D / A converter 19 ... Display part 20 ... Operation input part

Claims (9)

An imaging device that performs predetermined image processing on image data obtained by an imaging device that forms an optical image of a subject on an imaging device and captures the image by a shutter function.
The shutter function includes a global shutter function and a rolling shutter function,
A control unit that uses both the rolling shutter and the global shutter during one moving image data capture;
The pixel data captured by the global shutter is subjected to intra-frame compression to generate a first compressed image, and the pixel data captured by the rolling shutter is generated before and after the period for generating the first compressed image. And an image processing unit that generates a second compressed image by inter-frame compression. The image processing unit generates the first compressed image by reading out the image data from the image sensor without thinning out the image data, and generates the second compressed image by reading out the image data from the image sensor. The imaging apparatus according to 1. The image processing unit performs intra-frame compression on high-pixel image data when generating the first compressed image, and performs inter-frame compression on low-pixel image data when generating the second compressed image. The imaging apparatus according to 1 or 2. The imaging apparatus according to claim 2, wherein when the second compressed image is generated by thinning out data from the image sensor, thinning readout is performed by performing integration processing of pixels in the vicinity of the same color. The imaging apparatus according to any one of claims 1 to 4, wherein the image processing unit corrects an image level of the first compressed image and an image level of the second compressed image to substantially equal levels. The image processing unit corrects the image level of the first compressed image based on the R level from which the integration processing read of the second compressed image is performed, whereby the image level of the first compressed image and the first level of the first compressed image are corrected. The imaging apparatus according to claim 4, wherein the image level of the second compressed image is corrected to a substantially equal level. The image processing unit maintains the image level of the first compressed image, and corrects the image level of the second compressed image by dividing by an integration amount of the integration process, thereby correcting the first compressed image. The imaging apparatus according to claim 4, wherein the image level of the second compressed image and the image level of the second compressed image are corrected to substantially the same level. When the image processing unit designates one screen of the second compressed image, the image processing unit decompresses and decodes the second compressed image and the other compressed images including the first compressed image before and after the second compressed image and designates the second compressed image. The imaging device according to any one of claims 1 to 7, wherein high-resolution still image data representing one screen is generated. An image of an imaging apparatus that forms an optical image of a subject on an image sensor and performs predetermined image processing on image data from the image sensor captured by a shutter function including a global shutter function and a rolling shutter function to generate image data A generation method,
During the capture of the single moving image data, the pixel data captured by the global shutter is intra-frame compressed to generate a first compressed image within one screen,
An image generation method for an imaging apparatus, wherein the second compressed image is generated by inter-frame compression of pixel data captured by the rolling shutter in a period before and after the period for generating the first compressed image.

Images