JP2010062905A - Imaging device and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To acquire a still image with less blurring when recording a moving image. <P>SOLUTION: The imaging device 100 includes: a resolution conversion part 8 configured to sequentially generate image frames of low resolution relative to resolution of a still image by being related to each of a plurality of image frames generated by an electronic imaging part 2; a control part 16 configured to detect an image blurring amount in each of the plurality of image frames constituting a moving image, and identifying an image frame having the smallest image blurring amount among the plurality of image frames based on the detection result; and a recording medium 13 for recording a moving image comprising the generated low-resolution image frames, and the identified image frame as a still image. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an imaging apparatus and a program for capturing a moving image and a still image.

  Conventionally, a digital camera that captures a moving image or a still image related to one scene is known (see, for example, Patent Document 1). This digital camera records one stream in which high resolution images are mixed at regular intervals in a low resolution video, and when displaying a single still image, the frame of the still image has a high resolution. If it is, the high-resolution image is displayed, and if it is low-resolution, a high-resolution image is generated from the previous and subsequent images and displayed.

By the way, when shooting moving images, the exposure time is set to be as long as possible in order to achieve smoothness during video playback, while when shooting still images, the exposure time is set to prevent image blurring. Is preferably set shorter. Therefore, in a camera having a “blur reduction” function, a method has been developed in which an exposure time is shortened for an image frame recorded as a still image during recording of a moving image.
JP 2006-214261 A

  However, if only the image frame recorded as a still image is recorded with a shorter exposure time, the exposure time is different for the image frame related to the still image at the time of moving image reproduction, so the continuity as the moving image quality is impaired. There was a problem.

  Accordingly, an object of the present invention is to provide an imaging apparatus and a program that can acquire a still image with less blurring when recording a moving image.

In order to solve the above problem, an imaging apparatus according to claim 1 is provided.
An imaging control unit that sequentially captures a subject at a predetermined frame rate and sequentially generates a plurality of first resolution image frames, and the first resolution corresponding to each of the plurality of image frames generated by the imaging control unit. A low-resolution image generating unit that sequentially generates a second-resolution image frame having a lower resolution than the moving-image recording unit that records a moving image including the second-resolution image frame generated by the low-resolution image generating unit; The blur amount detecting means for detecting the amount of image blur in each of the plurality of image frames generated by the imaging control means during the moving image recording operation by the moving image recording means, and the detection result of the blur amount detecting means Based on the image frame, the image frame having the smallest image blur amount is identified from the plurality of image frames generated by the imaging control unit. A specifying unit, it is characterized by and a still image recording means for recording a high-resolution still images than the image frame specified the second resolution by the specifying means.

The invention according to claim 2 is the imaging apparatus according to claim 1,
The imaging control unit sets an exposure time by the imaging element to a predetermined first exposure time during a moving image recording operation by the moving image recording unit, and both the moving image recording unit and the still image recording unit An image frame obtained by imaging in the first exposure time is recorded.

The invention according to claim 3 is the imaging apparatus according to claim 2,
When still image recording is instructed during the moving image recording operation by the moving image recording unit, the still image recording unit records an image frame with the smallest image blur amount specified by the specifying unit as a still image. On the other hand, if recording of a still image is instructed when the moving image recording unit is not recording a moving image, it is determined based on this still image recording instruction timing regardless of the amount of image blurring. The image frame is recorded as a still image.

The invention according to claim 4 is the imaging apparatus according to claim 3,
When the recording control unit is instructed to record a still image when the moving image recording unit is not recording a moving image, the imaging control unit sets a second exposure time shorter than the first exposure time. The still image recording means is an image obtained by taking an image during the second exposure time when the recording of a still image is instructed when the moving image recording means is not recording a moving image. It is characterized by recording a frame.

Invention of Claim 5 is an imaging device as described in any one of Claims 1-4,
The imaging control unit images the subject by exposing the imaging device, and sets an exposure time during which the imaging device is exposed to a predetermined first exposure time when a moving image is recorded by the moving image recording unit. When a still image is recorded by the still image recording means, a second exposure time shorter than the first exposure time is set, and the moving image recording means records the still image while recording a moving image. When a still image is recorded by the image recording means, an exposure time setting means for setting the first exposure time is provided.

Invention of Claim 6 is an imaging device as described in any one of Claims 1-5,
The shake amount detection means includes angular velocity detection means for detecting an angular velocity of the imaging apparatus main body and outputting a predetermined detection signal, and based on the predetermined detection signal output from the angular velocity detection means, the imaging control means The amount of image blur in each of the plurality of image frames generated by the above is detected.

The invention according to claim 7 is the imaging apparatus according to any one of claims 1 to 5,
The blur amount detecting means includes high frequency component calculating means for calculating a high frequency component in each of the plurality of image frames generated by the imaging control means, and based on the high frequency component calculated by the high frequency component calculating means. The image blur amount in each of the plurality of image frames is detected.

The invention according to claim 8 is the imaging apparatus according to any one of claims 1 to 5,
The blur amount detecting means detects an angular velocity of the imaging apparatus main body and outputs a predetermined detection signal, and a high frequency component that calculates a high frequency component in each of the plurality of image frames generated by the imaging control means. Component calculation means, and based on the predetermined detection signal output from the angular velocity detection means and the high frequency component calculated by the high frequency component calculation means, an image blur amount in each of the plurality of image frames is calculated. It is characterized by detecting.

The invention according to claim 9 is the imaging apparatus according to any one of claims 1 to 8,
During the moving image recording operation by the moving image recording unit, the moving image recording unit includes a still image recording instruction unit for instructing recording of the still image by the still image recording unit, and the blur amount detecting unit is configured by the still image recording instruction unit. The image blur amount in each of the plurality of image frames generated by the imaging control unit is detected based on an instruction to record the still image.

The invention according to claim 10 is the imaging apparatus according to claim 9,
The imaging control unit is configured to generate the plurality of image frames by imaging a subject at a higher frame rate than before the instruction in response to an instruction to record the still image by the still image recording instruction unit. It is said.

The invention according to claim 11 is the imaging apparatus according to any one of claims 1 to 10,
Temporary storage means for temporarily storing the plurality of image frames generated by the imaging control means, and the blur amount detection means and the specifying means are connected to the plurality of image frames stored by the temporary storage means. Based on this, the image blur amount is detected and the image frame with the smallest image blur amount is identified.

The invention according to claim 12 is the imaging apparatus according to claim 11,
The temporary storage unit relates to the still image temporarily stored when the still image recording unit does not record the still image or after the still image recording unit records the still image. An image frame other than the image frame is discarded.

Invention of Claim 13 in the imaging device as described in any one of Claims 1-12,
Based on the plurality of image frames generated by the imaging control unit, display means for displaying a subject image, and the first resolution corresponding to each of the plurality of image frames generated by the imaging control unit. Medium resolution image generation means for sequentially generating a third resolution image frame having a lower resolution and higher resolution than the second resolution, and the third resolution image frame generated by the medium resolution image generation means Display resolution image generation means for generating a fourth resolution image frame for displaying the subject image by the display unit in correspondence with each of the display resolution image generation means, the low resolution image generation means, the medium resolution image generation means Generating the second resolution image frame in correspondence with each of the third resolution image frames generated by .

The program of the invention according to claim 14 is:
A computer of an imaging apparatus including an imaging control unit that sequentially captures a subject at a predetermined frame rate and sequentially generates a plurality of first-resolution image frames corresponds to each of the plurality of image frames generated by the imaging control unit. A low-resolution image generation unit that sequentially generates a second-resolution image frame having a lower resolution than the first resolution, and a moving image including the second-resolution image frame generated by the low-resolution image generation unit is recorded. Moving image recording means, a blur amount detecting means for detecting an image blur amount in each of the plurality of image frames generated by the imaging control means during a moving image recording operation by the moving image recording means, and a blur amount detecting means Based on the detection result, the image blur amount is the smallest among the plurality of image frames generated by the imaging control means. Specifying means for specifying the image frame have, is characterized in that to function the image frame specified as a still image recording means, for recording a high-resolution still images than the second resolution by the specifying means.

  According to the present invention, a smooth moving image can be acquired, and a still image with less blur can be acquired.

  Hereinafter, specific embodiments of the present invention will be described with reference to the drawings. However, the scope of the invention is not limited to the illustrated examples.

[Embodiment 1]
FIG. 1 is a block diagram illustrating a schematic configuration of an imaging apparatus 100 according to the first embodiment to which the present invention is applied.
The imaging apparatus 100 according to the first embodiment detects an image blur amount based on the gyro data output from the gyro module, and acquires a still image with less blur.
Specifically, as illustrated in FIG. 1, the imaging device 100 includes an imaging lens 1, an electronic imaging unit 2, a preprocessing unit 3, a Bayer reduction unit 4, an AF detection unit 5, a gyro module 6, an image generation unit 7, A resolution conversion unit 8, a CODEC 9, a display control unit 10, a display unit 11, a recording medium control unit 12, a recording medium 13, an operation input unit 14, a memory 15, and a control unit 16 are provided.

The electronic imaging unit 2 includes an imaging element such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal-oxide Semiconductor) that converts a subject image that has passed through the imaging lens 1 into a two-dimensional image signal. Specifically, the electronic imaging unit 2 images a subject with an exposure time corresponding to a predetermined frame rate (for example, 30 fps) under the control of an imaging control unit (imaging control unit; not shown). , 77 Mpix (3200 × 2400 pixels) image signals of a predetermined resolution are sequentially read out at a predetermined frame rate and output to the preprocessing unit 3.
Here, the imaging lens 1 and the electronic imaging unit 2 sequentially generate a plurality of image frames with a predetermined resolution (first resolution) by continuously imaging a subject at a predetermined frame rate as an imaging unit.

The imaging control unit of the electronic imaging unit 2 records the exposure time during which the imaging element is exposed under the control of the control unit 16 when recording a moving image and when recording a still image while recording a moving image. When a still image is recorded when a moving image is not being recorded, the second exposure time is set shorter than the first exposure time. When recording a moving image, the first frame rate is set. When a still image is recorded during recording of the moving image, the second frame rate is temporarily higher than the first frame rate. The operation set to is also performed.
Here, the imaging control unit and the control unit 16 of the electronic imaging unit 2 function as an exposure time setting unit.

The preprocessing unit 3 operates in synchronism with the electronic imaging unit 2, performs basic signal processing on the electric signal output from the electronic imaging unit 2 and inputs the final data before interpolation processing. Is generated and output to the memory 15.
Further, the preprocessing unit 3 is configured not to output the Bayer data directly to the memory 15 during the monitoring process. Specifically, the preprocessing unit 3 performs various processes on the electrical signal output from the electronic imaging unit 2 and outputs the Bayer data to the Bayer reduction unit 4. In addition, the preprocessing unit 3 performs various processes on the electric signal output from the electronic imaging unit 2 and generates an AF detection signal corresponding to the luminance signal and outputs the AF detection signal to the AF detection unit 5. To do.
Note that the preprocessing unit 3 may perform black level adjustment and defect correction.

The Bayer reduction unit 4 generates Bayer data obtained by reducing the Bayer data generated by the preprocessing unit 3 at a predetermined ratio, and outputs the Bayer data to the memory 15. For example, during the monitoring process, the Bayer reduction unit 4 reduces the intermediate resolution of 800 × 600 pixels by performing a reduction process that reduces the horizontal and vertical to 1/4 for 3200 × 2400 pixel Bayer data. Bayer data is generated and output to the memory 15.
Here, the Bayer reduction unit 4 corresponds to each of the plurality of image frames generated by the electronic imaging unit 2 and has a lower resolution than the first resolution for still image recording and the second resolution for moving image recording. The intermediate-resolution image generating means for sequentially generating image frames of intermediate resolution (third resolution), which is higher resolution than that, is configured.

  The AF detection unit 5 operates in synchronism with the preprocessing unit 3 in units of frames, and performs AF detection using the AF detection signal output from the preprocessing unit 3 and input. Specifically, the AF detection unit 5 applies a high-pass filter and a band-pass filter to the AF detection signal in the horizontal direction, and integrates the absolute value of the filter output for each predetermined image area to generate AF detection data. To the memory 15.

  The gyro module 6 operates in synchronization with the electronic imaging unit 2 and the preprocessing unit 3 in units of frames. The gyro module 6 serves as an angular velocity detection means for detecting angular velocities of rotation about the vertical and horizontal axes of the imaging apparatus body when photographing a subject. Specifically, the gyro module 6 performs A / D conversion on the electrical signal output from the gyro detection unit 61 by the A / D conversion unit 62, and then performs a predetermined period (for example, a frame period) in the integration processing unit 63. Are integrated every 1/8), and the result is output to the memory 15 as gyro data. In other words, the gyro module 6 detects the rotation direction and the rotation amount of the image pickup apparatus main body as the image blur amount when photographing the subject.

  The image generation unit 7 acquires Bayer data stored in the memory 15, performs interpolation processing, image quality adjustment processing, and the like on the Bayer data to generate image data (hereinafter, YUV data), and then stores the data in the memory 15. Store.

The resolution conversion unit 8 acquires YUV data stored in the memory 15 and YUV data output from the image generation unit 7, and performs resolution conversion processing on the YUV data.
In addition, the resolution conversion unit 8 can obtain, for example, image outputs with a maximum of two different resolutions for one image input. For example, every time one image is input, the resolution conversion unit 8 performs 320 × 240 pixel YUV data (display YUV data) for monitoring and 640 × 480 pixel YUV data (moving image YUV data) for moving image recording. ) Is generated and output sequentially.
Here, the resolution conversion unit 8 generates a fourth resolution image frame for monitoring the subject image by the display unit 11 in correspondence with each image frame of the reduced resolution Bayer data having the intermediate resolution generated by the Bayer reduction unit 4. The display resolution image generation means is configured.
Further, the resolution conversion unit 8 sequentially generates second resolution image frames having a lower resolution than the first resolution for still image recording in correspondence with each of the plurality of image frames generated by the electronic imaging unit 2. Low-resolution image generation means is configured. Specifically, the resolution conversion unit 8 serves as a low resolution image generation unit that generates a low resolution second resolution image frame corresponding to each of the intermediate resolution reduced Bayer data image frames generated by the Bayer reduction unit 4. Generate.

  The CODEC 9 encodes the YUV data by the JPEG method when recording an image, and reads the encoded data stored in the memory 15 and decodes the reproduced image data when reproducing the image.

  The display control unit 10 controls display of image frames on the display unit 11. Specifically, when recording an image, the display control unit 10 sequentially reads out the image data generated by the image generation unit 7 and the resolution conversion unit 8 and stored in the memory 15, and displays it in the display unit 11. On the other hand, at the time of image reproduction, reproduced image data stored in the memory 15 by the CODEC 9 and YUV data obtained by converting the resolution thereof are output to the display unit 11 in a predetermined order.

  The display unit 11 is composed of, for example, liquid crystal, and displays a subject image based on a plurality of image frames generated by the electronic imaging unit 2 as display means. Specifically, the display unit 11 displays the display video signal output and input from the display control unit 10 while sequentially updating at 320 × 240 × RGB, an aspect ratio of 4: 3, and a display frame rate of 60 fps. .

  The recording medium control unit 12 records the generated file on the recording medium 13 and reads the file from the recording medium 13 under the control of the control unit 16. In other words, the recording medium control unit 12 controls to record the encoded data of the image frame encoded by the CODEC 9 on the recording medium 13 and to read out the encoded data recorded on the recording medium 13.

The recording medium 13 is configured by, for example, a card-type nonvolatile memory (flash memory), a hard disk, or the like.
In addition, the recording medium 13 records a moving image including a second resolution image frame generated by the resolution conversion unit 8 and encoded by the CODEC 9 as a moving image recording unit.

  In addition, the recording medium 13 is evaluated as the still image recording unit with the smallest image blur amount from the detection result of the gyro module 6 among the image frames specified by the specifying process, that is, the plurality of image frames. Coded data of an image frame having a resolution higher than 2 resolution is recorded as a still image.

The operation input unit 14 is for performing a predetermined operation of the imaging apparatus 100. Specifically, although not shown in the figure, the operation input unit 14 includes a REC key that instructs recording start and end of a moving image of the subject imaged by the imaging unit, and a still image of the subject imaged by the imaging unit. A shutter key for instructing recording, up / down / left / right cursor keys for selecting various operation modes and various items, a determination key for instructing determination of an operation mode and items selected by these cursor keys, and the like are provided.
When a predetermined key of the operation input unit 14 is operated by the user, a control instruction corresponding to the key is output to the CPU via an input circuit (not shown). When a control instruction is input, the CPU performs a process of controlling each unit in accordance with the operated key.

  The shutter key serves as an imaging instruction unit, and outputs a still image imaging instruction from the electronic imaging unit 2 to the CPU when a predetermined operation is performed by the user while a moving image is recorded on the recording medium 13.

  The memory 15 is composed of, for example, a flash memory, and temporarily stores data processed by the CPU, image data, encoded data, and the like.

  The control unit 16 controls each unit of the imaging apparatus 100. Specifically, although not shown, the control unit 16 includes a CPU and a program memory.

  The CPU performs various control operations according to various programs for the imaging apparatus 100 stored in the program memory.

The program memory stores various programs and data necessary for the operation of the CPU. Here, the program includes an exposure time setting control routine, a moving image recording control routine, a first blur amount detection routine, a first image frame specifying routine, and a still image recording control routine which will be described later.
Note that the term “routine” here refers to a series of instructions having a certain function and constituting a part of a computer program.

  The exposure time setting control routine is a program part for causing the CPU to function as exposure time setting means. That is, the exposure time setting control routine sets the exposure time during which the image sensor is exposed to the imaging control unit of the electronic imaging unit 2 when recording a moving image and when recording a still image while recording a moving image. In order to set a predetermined first exposure time while recording a still image, a command group for causing the CPU to realize a function related to a process for setting a second exposure time shorter than the first exposure time. Including.

The moving image recording control routine records a moving image composed of low resolution second resolution image frames sequentially generated by the resolution conversion unit 8 in correspondence with each of the plurality of image frames generated by the electronic imaging unit 2. 13 includes a group of instructions for causing the CPU to realize a function related to the processing to be recorded in the CPU 13.
Specifically, according to this moving image recording control routine, the CPU sequentially records the encoded data of the VGA size image frame generated in the M-JPEG format by the CODEC 9 as a moving image. 13 to record.

The first shake amount detection routine is a program part for causing the CPU to function as a shake amount detection means. That is, the first blur amount detection routine includes a command group for causing the CPU to implement a function related to the blur amount detection process for detecting the amount of image blur in each of the plurality of image frames captured by the electronic imaging unit 2.
Specifically, according to the first blur amount detection routine, the CPU is configured to detect the plurality of image frames based on the detection result of the gyro module 6 corresponding to each of the plurality of image frames captured by the electronic imaging unit 2. The maximum gyro displacement (difference between the maximum value and the minimum value of the gyro data) in each is calculated as the image blur amount.

The first image frame specifying routine is a program part for causing the CPU to function as specifying means. That is, the first image frame specifying routine specifies an image frame specifying the image frame having the smallest image blur amount among the plurality of image frames captured by the electronic imaging unit 2 based on the detection result of the blur amount detecting process. It includes a group of instructions for causing the CPU to realize functions related to processing.
Specifically, according to the first image frame specifying routine, the CPU compares the maximum gyro displacement of each of the plurality of image frames captured by the electronic imaging unit 2, and the image with the smallest gyro maximum displacement is blurred. The image frame with the smallest amount is specified.

The still image recording control routine includes a command group for causing the CPU to realize a function related to the process of recording the image frame specified by the image frame specifying process on the recording medium 13 as a still image.
Specifically, according to this still image recording control routine, the CPU encodes an image frame (still image YUV data) of 3200 × 2400 pixels specified by the image frame specifying process and encoded by the CODEC 9 in the JPEG format. Data is recorded on the recording medium 13 as a still image.

Next, the operation of the imaging apparatus 100 will be described with reference to FIGS.
2, 3, 5, and 8 are flowcharts for explaining the overall operation of the imaging apparatus 100 and a flowchart showing the algorithm structure of the program stored in the program memory. Description of specific program code corresponding to the CPU to be actually used is omitted, but it may be designed as appropriate based on this flowchart (algorithm structure).

FIG. 2 is a flowchart illustrating an example of the main operation of the imaging process.
As shown in FIG. 2, after the power is turned on, the CPU waits until the predetermined pre-processing being executed is completed (step S1), and then the moving image is based on a predetermined operation of the REC key of the operation input unit 14 by the user. It is determined whether or not an instruction to start recording is instructed (step S2).
Here, if it is determined that the start of moving image recording has been instructed (step S2; YES), the CPU controls each part of the imaging apparatus 100 to execute a moving image recording process (described later) (step S3). Thereafter, the CPU determines whether or not the recording end of the moving image is instructed based on a predetermined operation of the REC key of the operation input unit 14 by the user (step S4), and the recording end of the moving image is not instructed. In the case (step S4; NO), the process returns to step S1 and the subsequent processing is repeatedly executed.

On the other hand, if an instruction to end the recording of the moving image is given in step S4 (step S4; YES), the CPU determines whether there is a still image taken in the moving image recording process (step S5). ).
If it is determined that there is a still image (step S5; YES), the CPU controls each part of the imaging apparatus 100 to execute a still image recording process (described later) (step S6), and then step S1. Return to, and repeat the subsequent processing.
If it is determined in step S5 that there is no still image (step S6; NO), the process returns to step S1, and the subsequent processing is repeatedly executed.

On the other hand, if it is determined in step S2 that the start of moving image recording has not been instructed (step S2; NO), the CPU determines the still image based on a predetermined operation of the shutter key of the operation input unit 14 by the user. It is determined whether shooting is instructed (step S7).
Here, when an instruction to shoot a still image is given (step S7; YES), the CPU controls each part of the imaging device 100 to execute a still image shooting process (described later) (step S8), and then step. Returning to S1, the subsequent processing is repeatedly executed.

Still image recording is performed in the moving image recording processing in step S3. However, the still image shooting processing performed in step S8 is different in the setting of the exposure time and the processing for specifying the image frame to be recorded.
That is, in the still image shooting process in step S8, an image frame determined based on a still image shooting (recording) instruction timing is recorded on the recording medium 13 as a still image regardless of the image blur amount. Specifically, if the start of moving image recording is not instructed in step S2, step S2; NO), the imaging control unit performs the second exposure in which the exposure time by the image sensor is shorter than the first exposure time. Set to time. When an instruction to capture a still image is instructed based on a predetermined operation of the shutter key of the operation input unit 14 by the user, a basic signal is output with respect to the image data output and input from the electronic imaging unit 2 at the instruction timing. Processing is performed to generate 3200 × 2400 pixel still image Bayer data, which is output to the image generation unit 7.
The image generation unit 7 generates 3200 × 2400 pixel still image YUV data from the still image Bayer data, converts the still image YUV data to a maximum of 3200 × 2400 pixels by the resolution conversion unit 8, and outputs the still image YUV data to the memory 15.
After that, the CODEC 9 performs a coding process of acquiring still image YUV data stored in the memory 15 and encoding the still image YUV data in the JPEG format to generate JPEG data of 3200 × 2400 pixels.
Next, the recording medium control unit 12 acquires JPEG data encoded in JPEG format by the CODEC 9 and records it on the recording medium 13 as a still image.
As described above, the recording medium 13 records, as a still image, encoded data of an image frame obtained by imaging with the second exposure time as a still image recording unit.

  On the other hand, if it is determined in step S7 that an instruction to capture a still image has not been given (step S7; NO), the CPU controls each unit of the imaging device 100 to display an image captured by the imaging unit. After executing a monitoring process (described later) to be displayed on the display unit 11 (step S9), the process returns to step S1, and the subsequent processes are repeatedly executed.

Next, the moving image recording process will be described with reference to FIGS.
FIG. 3 is a flowchart illustrating an example of an operation related to the moving image recording process. FIG. 4 is a diagram schematically showing a data flow in the moving image recording process.

The moving image recording process is a process that is executed when the user has instructed the recording start of the moving image by performing a predetermined operation of the REC key during the monitoring process.
The data flow in the monitoring process corresponds to the area surrounded by the broken line in FIG.

As shown in FIG. 3 and FIG. 4, first, the exposure control setting routine sets the frame rate for repeatedly performing imaging with the imaging device to 30 fps in the imaging control unit of the electronic imaging unit 2, and the imaging device is exposed. The exposure time to be set is set to a predetermined first exposure time shorter than the imaging interval at the set frame rate. Thereby, the electronic imaging unit 2 captures a moving image, generates a plurality of image frames of 77 Mpix (3200 × 2400 pixels) per frame at 30 fps, and outputs the generated image data to the preprocessing unit 3. (Step S31).
The preprocessing unit 3 performs basic signal processing on the input image data to generate 3200 × 2400 pixel Bayer data, outputs the Bayer data to the Bayer reduction unit 4, and performs various processes on the image data. Then, an AF detection signal corresponding to the luminance signal is generated and output to the AF detection unit 5 (step S32).

The AF detection unit 5 performs AF detection processing using the AF detection signal output and input from the preprocessing unit 3, and outputs the processing result to the memory 15 as AF detection data (step S33).
The Bayer reduction unit 4 performs a reduction process so that the horizontal and vertical 1/4 of the 3200 × 2400 pixel Bayer data output from the preprocessing unit 3 and input is reduced to 800 × 600 pixels. Bayer data is generated and output to the memory 15 (step S34).
Note that the AF detection processing (step S33) by the AF detection unit 5 and the generation of reduced Bayer data (step S34) by the Bayer reduction unit 4 may be executed in a reversed order.

  The series of processes so far are performed in synchronization with the imaging of the subject by the electronic imaging unit 2, and for example, from the signal input to the storage of each generated data in the memory 15 is completed in less than 1/30 second per frame. (See FIG. 6).

Next, the image generation unit 7 acquires the reduced Bayer data stored in the memory 15, generates YUV data from the reduced Bayer data, and then stores the YUV data in the memory 15. Subsequently, the resolution conversion unit 8 continues the memory 15 YUV data stored in the image data is acquired, 320 × 240 pixel display YUV data for monitoring and 640 × 480 pixel moving image YUV data for moving image recording are generated and output to the memory 15 (step S35). .
Here, the generation of the display YUV data and the moving image YUV data is sequentially processed in the order of imaging, and is completed in, for example, less than 1/30 seconds (see FIG. 6).

Next, the display control unit 10 updates the display screen by sequentially reading the display YUV data stored in the memory 15 in the order of storage and outputting the data to the display unit 11 (step S36).
Here, since the display YUV data is updated every 1/30 seconds, the display control unit 10 displays the 1-frame display YUV so as to match the display frame rate (60 fps) of the display unit 11. Data will be displayed and output twice.
The display YUV data may be updated every 1/60 seconds in accordance with the display frame rate (60 fps) of the display unit 11.

Next, the CPU determines whether or not the moving image YUV data generated through the image generation unit 7 and the resolution conversion unit 8 is stored in the memory 15 (step S37).
Here, if it is determined that moving image YUV data is stored (step S37; YES), the CODEC 9 acquires the moving image YUV data stored in the memory 15, and stores the moving image YUV data in the M-JPEG format. Encoding processing for encoding and generating M-JPEG data of 640 × 480 pixels is performed (step S38).

Next, the CPU determines whether or not there is M-JPEG data generated by the encoding process (step S39).
If it is determined that there is M-JPEG data (step S39; YES), the moving image recording control routine causes the recording medium control unit 12 to store the M-JPEG data encoded in the M-JPEG format by the CODEC 9. Obtained and recorded on the recording medium 13 (step S3A).

  The above process is executed until the user operates the REC key again to instruct the end of the moving image recording process (step S4 in FIG. 2).

Next, still image shooting processing during the moving image shooting operation will be described with reference to FIGS.
FIG. 5 is a flowchart illustrating an example of an operation related to the still image shooting process. FIG. 6 is a diagram showing a timing chart of each image frame process in the still image shooting process, and FIG. 7 is a diagram schematically showing a data flow in the still image shooting process.
In FIG. 7, as in FIG. 4, the data flow in the monitoring process corresponds to a region surrounded by a broken line.

  The still image shooting process in the flowchart shown in FIG. 5 is a process executed when a still image shooting instruction is given during the moving image recording process. Accordingly, processing other than the processing described in detail below in the still image shooting processing is substantially the same as the processing in the normal moving image recording processing in a state where shooting of a still image is not instructed.

Specifically, as shown in FIGS. 5 to 7, when an instruction to capture a still image is given based on a predetermined operation of the shutter key of the operation input unit 14 by the user (step S <b>41; YES), the CPU The respective modes of the imaging apparatus 100 are controlled to set the operation mode to “still image shooting” (step S42).
Subsequently, the pre-processing unit 3 performs basic signal processing on the image data output and input from the electronic imaging unit 2 to generate 3200 × 2400 pixel Bayer data, similarly to the moving image recording processing, While outputting to the Bayer reduction part 4 and the memory 15, various processes are performed with respect to image data, the AF detection signal equivalent to a luminance signal is produced | generated, and it outputs to the AF detection part 5. Further, in synchronization with the generation and output of the Bayer data and the AF detection signal, the gyro module 6 detects the rotation of the imaging device main body and outputs the gyro data to the memory 15 (step S43).
Subsequently, the CPU performs a process of associating the still image Bayer data and the gyro data stored in the memory 15 (step S44).

As in the moving image recording process, the AF detection unit 5 performs the AF detection process using the AF detection signal, and outputs the AF detection data to the memory 15 (step S45).
Similarly to the moving image recording process, the Bayer reduction unit 4 performs the reduction process on the 3200 × 2400 pixel Bayer data, generates 800 × 600 pixel reduced Bayer data, and outputs it to the memory 15 (step S46).

  The series of processes so far are performed in synchronization with the imaging of the subject by the electronic imaging unit 2 as in the moving image recording process. For example, 1/30 per frame from signal input to storage of each generated data in the memory 15. It is completed in less than a second (see FIG. 6).

  Next, the image generation unit 7 generates YUV data from the reduced Bayer data in the same manner as the moving image recording process, and then the resolution conversion unit 8 continues to display 320 × 240 pixel display YUV data for monitoring and moving image recording. 640 × 480 pixel moving image YUV data is generated and output to the memory 15 (step S47).

Next, similarly to the moving image recording process, the display control unit 10 sequentially reads the display YUV data in the storage order of the memory 15 and outputs it to the display unit 11 to update the display screen (step S48).
Next, similarly to the moving image recording process, the CPU determines whether or not the moving image YUV data generated through the image generation unit 7 and the resolution conversion unit 8 is stored in the memory 15 (step S49). If it is determined that the YUV data is stored (step S49; YES), the CODEC 9 performs an encoding process for encoding the moving image YUV data in the M-JPEG format to generate 640 × 480 pixel M-JPEG data. Perform (step S4A).

  Next, the CPU determines whether or not there is M-JPEG data generated by the encoding process (step S4B), as in the moving image recording process, and determines that there is M-JPEG data. (Step S4B; YES), according to the moving image recording control routine, the recording medium control unit 12 acquires the M-JPEG data encoded in the M-JPEG format by the CODEC 9 and records it on the recording medium 13 (Step S4C).

Next, the CPU performs a process of subtracting 1 from a still image shooting counter (not shown) of the memory 15 for each operation corresponding to one image frame (step S4D).
Next, the CPU determines whether or not the still image shooting counter in the memory 15 is 0 (step S4E). If it is determined that the still image shooting counter is not 0 (step S4E; NO), the process returns to step S43, and the subsequent processing is repeatedly executed.
On the other hand, when it is determined in step S4E that the still image shooting counter is 0 (step S4E; YES), the CPU controls each part of the imaging apparatus 100 and sets the operation mode to “movie recording”. Then, the still image shooting operation is finished (step S4F).

In this manner, a still image data set including 10 frames of still image Bayer data and gyro data corresponding to each frame can be obtained based on one operation of the shutter key by the user.
After that, although not shown in the figure, the CPU adds 1 to the still image shooting number counter (not shown) in the memory 15 and then permits the next still image shooting operation if the memory 15 has sufficient free space. To control.

Next, the still image recording process will be described with reference to FIGS.
FIG. 8 is a flowchart illustrating an example of an operation related to the still image recording process. FIG. 9 is a diagram schematically showing the flow of data in the still image recording process.

The still image recording process is a process executed when the still image shooting number counter is 1 or more after the moving image recording process ends, that is, when it is determined that a still image has been shot.
The still image recording process is executed for the number of times of the still image shooting number counter. In the present embodiment, a case where the still image shooting number counter is 1 will be described below.

Specifically, as shown in FIGS. 8 and 9, first, the CPU evaluates the gyro data corresponding to each still image Bayer data in the still image data set in the memory 15 by the first blur detection routine. Then, blur amount detection processing is performed to calculate the maximum gyro displacement, which is the difference between the maximum value and the minimum value of the gyro data, as the image blur amount (step S61).
Next, the CPU compares the plurality of maximum gyro displacements of the still image data set calculated in the blur amount detection process by the first image frame specifying routine, and images the still image Bayer data having the smallest maximum gyro displacement. An image frame specifying process for specifying the image frame with the least amount of blur is performed (step S62).

Subsequently, the image generation unit 7 acquires the still image Bayer data specified by the image frame specifying process, and after the image generation unit 7 generates the still image YUV data of 3200 × 2400 pixels from the still image Bayer data, The resolution converter 8 converts the still image YUV data of a maximum of 3200 × 2400 pixels and outputs it to the memory 15 (step S63).
Thereafter, the CODEC 9 acquires the still image YUV data stored in the memory 15, and performs an encoding process for encoding the still image YUV data in the JPEG format to generate JPEG data of 3200 × 2400 pixels (step S64). ).
Note that the resolution conversion unit 8 and the CODEC 9 process a still image with a maximum of 3200 × 2400 pixels, but it is also possible to process a still image with a smaller pixel depending on user settings.
Next, according to the still image recording control routine, the recording medium control unit 12 acquires JPEG data encoded in the JPEG format by the CODEC 9 and records it on the recording medium 13 as a still image (step S65).

As described above, according to the imaging apparatus 100 of the first embodiment, in the moving image recording process, when an instruction to capture a still image is issued based on the operation of the shutter key by the user, the electronic imaging unit 2 has a plurality of image frames. The amount of image blur in each of a plurality of image frames generated by imaging at 30 fps is detected. Specifically, based on the detection result of the gyro module 6 corresponding to each of the plurality of image frames captured by the electronic imaging unit 2, the maximum gyro displacement in each of the plurality of image frames is calculated as the image blur amount. .
Then, based on the detection result of the image blur amount, among the plurality of image frames generated by the electronic imaging unit 2, the frame having the smallest gyro maximum displacement is identified and identified as the image frame having the smallest image blur amount. Since the captured image frame is recorded on the recording medium 13 as a still image, the movement of the imaging apparatus body is evaluated as the amount of blur, and an image with less blur is obtained even when shooting conditions are severe such as a dark shooting environment. be able to.
As described above, when the user instructs to shoot a still image, the time taken to acquire all the image frames (10 frames × 1/30 seconds = 1/3 seconds) is the camera shake period (for example, 1/10 seconds). ), The possibility of including a moment with less camera shake can be increased.
Therefore, since a still image can be acquired without changing the exposure conditions during moving image recording, a smooth moving image can be acquired without affecting the image quality, and a still image with less blur can be acquired. be able to.

  In addition, when recording a moving image and when recording a still image while recording a moving image, a smooth moving image can be obtained by setting the exposure time during which the image sensor is exposed to a predetermined first exposure time. Can be acquired. On the other hand, when a still image is recorded when a moving image is not being recorded, the exposure time during which the image sensor is exposed is set to a second exposure time that is shorter than the first exposure time, thereby reducing blurring. A still image can be acquired.

  Further, the resolution converting unit 8 uses the reduced Bayer data generated by the Bayer reducing unit 4 to monitor 320 × 240 pixel YUV data (display YUV data) and 640 × 480 pixel YUV data (moving image data) for moving image recording. YUV data) is generated, the processing load can be reduced and the processing efficiency can be improved compared to the case of generating monitoring data or moving image recording data directly from Bayer data of 3200 × 2400 pixels.

<Modification 1>
Below, the modification 1 of the imaging device 100 of Embodiment 1 is demonstrated with reference to FIGS.
FIG. 10 is a block diagram illustrating a schematic configuration of the imaging apparatus 200 according to the first modification.

As illustrated in FIG. 10, the imaging apparatus 200 according to the first modification detects the amount of image blur based on the result of the AF detection processing by the AF detection unit 5 without including the gyro module 6.
Note that the imaging apparatus 200 according to the first modification does not include the gyro module 6 and has substantially the same configuration as the imaging apparatus 100 according to the first embodiment except for the content of the shake amount detection process, and the description thereof is omitted.

  The AF detection unit 5 calculates AF detection data (high frequency component) of each of a plurality of image frames generated by the electronic imaging unit 2 as high frequency component calculation means.

  The program stored in the program memory is not shown, but in addition to the exposure time setting control routine, the moving image recording control routine, and the still image recording control routine, the second blur amount detection routine and the second image frame specification Includes routines.

The second shake amount detection routine is a program portion that causes the CPU to function as a shake amount detection means. That is, the second blur amount detection routine includes a command group for causing the CPU to realize a function related to the blur amount detection process for detecting the image blur amount in each of the plurality of image frames captured by the electronic imaging unit 2.
Specifically, the CPU detects the AF detection data corresponding to each of the plurality of image frames calculated by the AF detection unit 5 as the image blur amount by the second blur amount detection routine.

The second image frame specifying routine is an image frame specifying process for specifying an image frame with the smallest image blur amount among a plurality of image frames captured by the electronic imaging unit 2 based on the detection result of the blur amount detecting process. A group of instructions for causing the CPU to realize such a function is included.
Specifically, according to the second image frame specifying routine, the CPU compares the AF detection data of each of the plurality of image frames captured by the electronic image capturing unit 2 and image blurring the frame having the largest AF detection data. The image frame with the smallest amount is specified.

  11 and 12 are flowcharts for explaining the overall operation of the imaging apparatus 200, and are flowcharts showing the algorithm structure of the program stored in the program memory. Description of specific program code corresponding to the CPU to be actually used is omitted, but it may be designed as appropriate based on this flowchart (algorithm structure).

Next, the still image shooting process will be described with reference to FIG.
FIG. 11 is a flowchart illustrating an example of an operation related to a still image shooting process performed by the imaging apparatus 200 according to the first modification.

  Similar to the still image shooting process performed by the imaging apparatus 100 according to the first embodiment, the still image shooting process performed by the imaging apparatus 200 according to the first modification is executed when a still image shooting instruction is issued during the moving image recording process. Process.

Specifically, as shown in FIG. 11, as in the still image shooting process of the first embodiment, when a user is instructed to take a still image based on a predetermined operation of the shutter key of the operation input unit 14 (step 1). S101; YES), the CPU controls each part of the imaging apparatus 100 to set the operation mode to “still image shooting” (step S102).
Subsequently, the preprocessing unit 3 performs basic signal processing on the image data output from the electronic imaging unit 2 and inputs Bayer data of 3200 × 2400 pixels, similarly to the moving image recording processing of the first embodiment. Generate and output to the Bayer reduction unit 4 and the memory 15, perform various processing on the image data, generate an AF detection signal corresponding to the luminance signal, and output to the AF detection unit 5 (step) S103).

The AF detection unit 5 performs AF detection processing using the AF detection signal, and outputs AF detection data to the memory 15 as in the still image shooting processing of the first embodiment (step S104).
Subsequently, the CPU performs processing for associating the still image Bayer data stored in the memory 15 with the AF detection data (step S105).

The processing after step S105 is substantially the same as the still image shooting processing of the first embodiment shown in FIG.
That is, the Bayer reduction unit 4 performs the reduction process on the 3200 × 2400 pixel Bayer data, generates 800 × 600 pixel reduced Bayer data, and outputs it to the memory 15 as in the still image shooting process (Step S1). S106).

  Next, the image generation unit 7 generates YUV data from the reduced Bayer data in the same manner as the still image shooting process, and then the resolution conversion unit 8 continues to display 320 × 240 pixel display YUV data for monitoring, The moving image YUV data of 640 × 480 pixels for recording is generated and output to the memory 15 (step S107).

Next, the display control unit 10 updates the display screen by sequentially reading the display YUV data in the storage order of the memory 15 and outputting it to the display unit 11 as in the still image shooting process (step S108).
Next, the CPU determines whether the moving image YUV data generated through the image generation unit 7 and the resolution conversion unit 8 is stored in the memory 15 as in the still image shooting process (step S109). When it is determined that moving image YUV data is stored (step S109; YES), the CODEC 9 encodes the moving image YUV data in the M-JPEG format to generate M-JPEG data of 640 × 480 pixels. (Step S10A).

  Next, the CPU determines whether there is M-JPEG data generated by the encoding process (step S10B), as in the still image shooting process, and determines that there is M-JPEG data. (Step S10B; YES), according to the moving image recording control routine, the recording medium control unit 12 acquires the M-JPEG data encoded in the M-JPEG format by the CODEC 9 and records it on the recording medium 13 (Step S10C). .

Next, the CPU performs a process of subtracting 1 from a still image shooting counter (not shown) in the memory 15 for each operation corresponding to one image frame (step S10D).
Next, the CPU determines whether or not the still image shooting counter in the memory 15 is 0 (step S10E). If it is determined that the still image shooting counter is not 0 (step S10E; NO), the process returns to step S103, and the subsequent processing is repeatedly executed.
On the other hand, if it is determined in step S10E that the still image shooting counter is 0 (step S10E; YES), the CPU controls each part of the imaging apparatus 100 and sets the operation mode to “movie recording”. Then, the still image shooting operation is finished (step S10F).

  As described above, a still image data set including 10 frames of still image Bayer data and AF detection data corresponding to each frame can be obtained based on one operation of the shutter key by the user.

Next, the still image recording process will be described with reference to FIG.
FIG. 12 is a flowchart illustrating an example of an operation related to a still image recording process performed by the imaging apparatus 200 according to the first modification.

  In the still image recording process performed by the imaging apparatus 200 according to the first modification, the still image shooting number counter is 1 or more after the moving image recording process is completed, as in the still image recording process performed by the imaging apparatus 100 according to the first embodiment. This process is executed when it is determined that a still image has been taken.

Specifically, as shown in FIG. 12, first, the CPU detects AF detection data corresponding to each still image Bayer data in the still image data set in the memory 15 as an image blur amount by the second blur amount detection routine. A blur amount detection process is performed (step S111).
Next, the CPU compares a plurality of AF detection data of the still image data set calculated in the shake amount detection process by the second image frame specifying routine, and images the still image Bayer data having the largest AF detection data. An image frame specifying process for specifying the image frame with the least amount of blur is performed (step S112).

The processing after step S112 is substantially the same as the still image recording processing of the first embodiment shown in FIG.
That is, the image generation unit 7 acquires the still image Bayer data specified by the image frame specifying process, generates 3200 × 2400 pixel still image YUV data from the still image Bayer data, and then generates the resolution. The conversion unit 8 converts the still image YUV data of a maximum of 3200 × 2400 pixels and outputs it to the memory 15 (step S113).
Thereafter, the CODEC 9 acquires the still image YUV data stored in the memory 15, and performs an encoding process for encoding the still image YUV data in the JPEG format to generate JPEG data of 3200 × 2400 pixels (step S114). ).
Next, according to the still image recording control routine, the recording medium control unit 12 acquires JPEG data encoded in the JPEG format by the CODEC 9 and records it as a still image on the recording medium 13 (step S115).

Therefore, according to the imaging apparatus 200 of the first modification, AF detection data corresponding to each of a plurality of image frames captured by the electronic imaging unit 2 is detected as an image blur amount, and AF detection data of the plurality of image frames is detected. The image frames having the largest AF detection data are compared with each other and specified as the image frame with the smallest image blur amount, and the specified image frame is recorded on the recording medium 13 as a still image, so that the moving subject is followed. Even in the case of shooting, an image with less blur can be acquired without being influenced by the evaluation value of the gyro data.
Therefore, as in the first embodiment, when recording a moving image, a still image can be acquired without changing the exposure condition, so that a smooth moving image can be acquired without affecting the image quality of the moving image. A still image with less blur can be acquired.
Further, since the gyro module 6 is not necessary, the cost of the imaging device 200 can be reduced.

  In the first modification, AF detection data for detecting the amount of image blur is generated when a still image is captured. The generation timing of AF detection data for detecting the amount of image blur is as follows. For example, the image data may be temporarily stored in the memory 15 and may be performed after shooting a plurality of still images.

  In Embodiment 1 and Modification 1, image frames for 10 frames are acquired based on one operation of the shutter key by the user. However, the number of image frames acquired is not limited to this. Absent. That is, if the time taken to acquire all image frames is longer than the camera shake period, the number of image frames acquired can be arbitrarily changed as appropriate.

[Embodiment 2]
Hereinafter, the imaging apparatus according to the second embodiment will be described with reference to FIGS. 13 and 14.
As illustrated in FIGS. 13 and 14, the imaging apparatus according to the second embodiment acquires an image frame with the least image blur among a plurality of image frames generated by the electronic imaging unit 2 when recording a moving image. Perform the still image acquisition video recording process.
Note that the imaging apparatus of Embodiment 2 has substantially the same configuration as the imaging apparatus 200 of Modification 1 above, except for performing still image acquisition moving image recording processing, and a description thereof will be omitted.

  The program stored in the program memory is not shown, but in addition to the exposure time setting control routine, the moving image recording control routine, the still image recording control routine, and the second blur amount detection routine, the first memory control routine, Includes a three image frame identification routine.

The first memory control routine includes a group of instructions for causing the CPU to realize a function related to processing for controlling recording and erasing of data with respect to the memory 15.
Here, the memory 15 includes, for example, a ring buffer that can temporarily store image frames for five frames, and constitutes a temporary storage unit that temporarily stores a plurality of image frames generated by the electronic imaging unit 2. is doing.
Then, by this first memory control routine, the CPU stores the still image Bayer data and AF detection data of the image frames in the ring buffer of the memory 15 in the order of imaging, and the oldest data from the time when the storage capacity becomes full is stored. Control overwriting sequentially.
Further, according to the first memory control routine, the CPU is temporarily stored in the memory 15 when the JPEG data of the still image is not recorded on the recording medium 13 or after the JPEG data of the still image is recorded on the recording medium 13. The still image Bayer data and the AF detection data related to the image frame other than the still image are deleted from the memory 15.

The third image frame specifying routine is an image frame specifying process for specifying an image frame with the smallest image blur amount among a plurality of image frames captured by the electronic imaging unit 2 based on the detection result of the blur amount detecting process. A group of instructions for causing the CPU to realize such a function is included.
Specifically, the third image frame specifying routine allows the CPU to compare the AF detection data of a plurality of still image Bayer data temporarily stored in the memory 15 when the user operates the shutter key, A frame with a large detection data is identified as the most prominent image frame with the smallest image blur amount. Then, the AF detection data of the image frames sequentially captured after the operation of the shutter key is compared with the AF detection data of the most prominent image frame, and a frame having a larger AF detection data is specified as the most prominent image frame.

  FIGS. 13 to 15 are flowcharts for explaining the overall operation of the imaging apparatus, and are flowcharts showing the algorithm structure of the program stored in the program memory. Description of specific program code corresponding to the CPU to be actually used is omitted, but it may be designed as appropriate based on this flowchart (algorithm structure).

Next, still image acquisition moving image recording processing will be described with reference to FIGS.
13 and 14 are flowcharts illustrating an example of an operation related to a still image acquisition moving image recording process performed by the imaging apparatus according to the second embodiment.

  The still image acquisition moving image recording process is a process that is executed when a still image shooting is instructed during the moving image recording process, as in the still image shooting process performed by the imaging apparatus 200 of the first modification.

Specifically, as shown in FIG. 13, as in the still image shooting process of the first modification, when the user gives an instruction to take a still image based on a predetermined operation of the shutter key of the operation input unit 14 (step 1). (S201; YES), the CPU controls each part of the imaging apparatus to set the operation mode to “still image acquisition” (step S202).
Subsequently, the pre-processing unit 3 performs basic signal processing on the image data output from the electronic imaging unit 2 and inputs Bayer data of 3200 × 2400 pixels, similarly to the moving image recording processing of the first modification. Generate and output to the Bayer reduction unit 4 and the memory 15, perform various processing on the image data, generate an AF detection signal corresponding to the luminance signal, and output to the AF detection unit 5 (step) S203).

The AF detection unit 5 performs AF detection processing using the AF detection signal and outputs AF detection data to the memory 15 in the same manner as in the still image shooting processing of Modification 1 (step S204).
Subsequently, the CPU performs a process of storing still image Bayer data and AF detection data of an image frame in association with the imaging order in the ring buffer of the memory 15 by the first memory control routine (step S205). At this time, the CPU performs control so that the oldest data is sequentially overwritten from when the storage capacity of the link buffer of the memory 15 becomes full.

The processing after step S205 is substantially the same as the still image shooting processing of the first embodiment shown in FIG.
That is, the Bayer reduction unit 4 performs the reduction process on the 3200 × 2400 pixel Bayer data, generates 800 × 600 pixel reduced Bayer data, and outputs it to the memory 15 as in the still image shooting process (Step S1). S206).

  Next, the image generation unit 7 generates YUV data from the reduced Bayer data in the same manner as the still image shooting process, and then the resolution conversion unit 8 continues to display 320 × 240 pixel display YUV data for monitoring, The moving image YUV data of 640 × 480 pixels for recording is generated and output to the memory 15 (step S207).

Next, similarly to the still image shooting process, the display control unit 10 sequentially reads the display YUV data in the storage order of the memory 15 and outputs the data to the display unit 11 to update the display screen (step S208).
Next, the CPU determines whether the moving image YUV data generated through the image generation unit 7 and the resolution conversion unit 8 is stored in the memory 15 as in the still image shooting process (step S209). When it is determined that moving image YUV data is stored (step S209; YES), the CODEC 9 encodes the moving image YUV data in the M-JPEG format to generate M-JPEG data of 640 × 480 pixels. Is performed (step S20A).

  Next, the CPU determines whether there is M-JPEG data generated by the encoding process (step S20B), as in the still image shooting process, and determines that there is M-JPEG data. (Step S20B; YES), according to the moving image recording control routine, the recording medium control unit 12 acquires the M-JPEG data encoded in the M-JPEG format by the CODEC 9 and records it on the recording medium 13 (Step S20C). .

Then, as shown in FIG. 14, the CPU determines whether or not the still image shooting counter in the memory 15 is 10 (step S20D). If it is determined that the still image shooting counter is 10 (step S20D; YES), the CPU is temporarily stored in the memory 15 when the user operates the shutter key by the second shake amount detection routine. A blur amount detection process for detecting the AF detection data of the still image data set for five frames as the image blur amount is performed. Subsequently, the CPU compares the AF detection data of the still image data set for five frames by the third image frame specifying routine, and sets the frame with the largest AF detection data as the most prominent image frame with the smallest image blur amount. Identify. Then, the CPU sets an overwrite prohibition flag with the still image data set relating to the most prominent image frame as the most prominent data set (step S20E).
Thereafter, the CPU performs a process of subtracting 5 from a still image shooting counter (not shown) in the memory 15 (step S20F), returns to step S203, and repeatedly executes the subsequent processes.

On the other hand, if it is determined in step S20D that the still image shooting counter is not 10 (step S20D; NO), the CPU temporarily stores data in the memory 15 sequentially after the operation of the shutter key by the second blur detection routine. Among the stored still image data sets, blur amount detection processing is performed for detecting AF detection data of the immediately preceding still image data set as an image blur amount. Subsequently, the CPU compares the AF detection data of the immediately preceding still image data set with the AF detection data of the most prominent image frame by the third image frame specifying routine, and determines a frame having a larger AF detection data as the dominant image. Identifies as a frame. Then, the CPU sets an overwriting prohibition flag with the still image data set relating to the most prominent image frame as the most prominent data set (step S20G).
After that, the CPU performs a process of subtracting 1 from a still image shooting counter (not shown) in the memory 15 (step S20H), and then the still image shooting counter in the memory 15 stores the same as the still image shooting process in the first embodiment. It is determined whether it is 0 (step S20I). If it is determined that the still image shooting counter is not 0 (step S20I; NO), the process returns to step S203, and the subsequent processing is repeatedly executed.
On the other hand, if it is determined in step S20I that the still image shooting counter is 0 (step S20I; YES), the CPU controls each unit of the imaging apparatus, similarly to the still image shooting process of the first embodiment. Then, the operation mode is set to “recording recording”, and the still image acquisition moving image recording operation is ended (step S20J).

Next, the still image recording process will be described with reference to FIG.
FIG. 15 is a flowchart illustrating an example of an operation related to a still image recording process performed by the imaging apparatus according to the second embodiment.

  In the still image recording process performed by the imaging apparatus according to the second embodiment, the still image capturing number counter is 1 or more after the still image acquisition moving image recording process is completed, similarly to the still image recording process performed by the imaging apparatus 100 according to the first embodiment. That is, this process is executed when it is determined that a still image has been taken.

  Specifically, as illustrated in FIG. 15, first, the image generation unit 7 acquires the still image Bayer data of the most significant remaining data set (step S211), and then 3200 × 2400 pixels from the still image Bayer data. After the still image YUV data is generated, the resolution conversion unit 8 converts the still image YUV data into still image YUV data having a maximum of 3200 × 2400 pixels and outputs the still image YUV data to the memory 15 (step S212).

The processing after step S212 is substantially the same as the still image recording processing of the first modification shown in FIG.
That is, the CODEC 9 performs the encoding process of acquiring the still image YUV data stored in the memory 15 and encoding the still image YUV data in the JPEG format to generate JPEG data of 3200 × 2400 pixels (step S213). ).
Next, according to the still image recording control routine, the recording medium control unit 12 acquires JPEG data encoded in the JPEG format by the CODEC 9 and records it on the recording medium 13 as a still image (step S214).

  As described above, according to the imaging apparatus of the second embodiment, it is needless to say that the same effect as that of the first embodiment can be obtained, and a plurality of images generated by the electronic imaging unit 2 when recording a moving image. Among the image frames, an image frame with the least image blur can be acquired based on the AF detection data of each image frame. Specifically, since the still image recording operation is continued before the operation of the shutter key, the still image that is closest to the operation timing of the shutter key and has the least blur is acquired from the period including the time before the operation of the shutter key. Can do.

  Further, after the JPEG data of the still image is recorded on the recording medium 13, the still image Bayer data and the AF detection data related to the image frames other than the still image temporarily stored in the memory 15 are deleted from the memory 15. That is, image blur is evaluated during still image shooting operation, and still image Bayer data for only one frame is left in the memory 15 for one operation of the shutter key. More still image shooting can be performed.

<Modification 2>
Hereinafter, an imaging apparatus according to Modification 2 will be described with reference to FIGS. 16 and 17.
As illustrated in FIGS. 16 and 17, the imaging apparatus according to the second modification uses the gyro data in addition to the AF detection data to identify the image frame with the least image blur in the still image acquisition moving image recording process.
Note that the imaging apparatus according to the second modification has substantially the same configuration as the imaging apparatus according to the second embodiment except that AF detection data and gyro data are used in the still image acquisition moving image recording process, and the description thereof is omitted. To do.

  Although not shown, the program stored in the program memory includes a third blur detection routine, a second memory control routine, a second memory control routine, an exposure time setting control routine, a moving image recording control routine, and a still image recording control routine. 4 image frame identification routine is included.

The third shake amount detection routine is a program portion that causes the CPU to function as a shake amount detection means. That is, the third blur amount detection routine includes a command group for causing the CPU to realize a function related to the blur amount detection process for detecting the amount of image blur in each of a plurality of image frames captured by the electronic imaging unit 2.
Specifically, in the third blur amount detection routine, the CPU determines the maximum gyro displacement (gyro data in each of the plurality of image frames) based on the detection result of the gyro module 6 corresponding to each of the plurality of image frames. The difference between the maximum value and the minimum value) is calculated as an image blur amount, or AF detection data corresponding to each of a plurality of image frames calculated by the AF detection unit 5 is detected as an image blur amount.

The second memory control routine includes a group of instructions for causing the CPU to realize a function related to processing for controlling recording and erasing of data with respect to the memory 15.
Here, the memory 15 includes, for example, a ring buffer that can temporarily store image frames for five frames, and constitutes a temporary storage unit that temporarily stores a plurality of image frames generated by the electronic imaging unit 2. is doing.
Then, according to the second memory control routine, the CPU stores still image Bayer data, gyro data, and AF detection data of the image frame in the ring buffer of the memory 15 in the order of imaging, and is the oldest when the storage capacity becomes full. Control to overwrite data sequentially.
Further, according to the second memory control routine, the CPU temporarily stores the JPEG data of the still image on the recording medium 13 or temporarily stores it in the memory 15 after recording the JPEG data of the still image on the recording medium 13. Still image Bayer data, gyro data, and AF detection data relating to image frames other than the still image are deleted from the memory 15.

The fourth image frame specifying routine is an image frame specifying process for specifying an image frame with the smallest image blur amount among a plurality of image frames captured by the electronic imaging unit 2 based on the detection result of the blur amount detecting process. A group of instructions for causing the CPU to realize such a function is included.
Specifically, according to the fourth image frame specifying routine, when the AF detection data of the plurality of still image Bayer data temporarily stored in the memory 15 is different when the user operates the shutter key, the most AF is performed. While the frame having the largest detection data is identified as the most prominent image frame with the smallest image blur amount, and the AF detection data is substantially equal, the maximum gyro displacement of each of the plurality of image frames is compared, and the largest gyro maximum A frame with a small displacement is specified as an image frame with the smallest image blur amount. Then, the AF detection data of the image frame sequentially captured after the operation of the shutter key is compared with the AF detection data of the most prominent image frame, and a frame having a larger AF detection data is identified as the most prominent image frame, while sequentially When the AF detection data of the captured image frame and the AF detection data of the most prominent image frame are substantially equal, the maximum gyro displacement of the sequentially captured image frame is compared with the maximum gyro displacement of the most prominent image frame. A frame having a smaller maximum displacement is identified as the most prominent image frame.

  FIGS. 16 and 17 are flowcharts for explaining the overall operation of the imaging apparatus, and are flowcharts showing the algorithm structure of the program stored in the program memory. Description of specific program code corresponding to the CPU to be actually used is omitted, but it may be designed as appropriate based on this flowchart (algorithm structure).

Next, still image acquisition moving image recording processing will be described with reference to FIGS.
16 and 17 are flowcharts illustrating an example of an operation related to a still image acquisition moving image recording process performed by the imaging apparatus according to the second modification.

The still image acquisition moving image recording process is a process that is executed when shooting of a still image is instructed during the moving image recording process, similarly to the still image shooting process performed by the imaging apparatus of the second embodiment.
Also, among the still image acquisition moving image recording processing, processing other than the processing described in detail below is substantially the same as the still image acquisition moving image recording processing by the imaging apparatus of the second embodiment.

Specifically, as shown in FIG. 16, as in the still image shooting process of the first modification, when the user gives an instruction to take a still image based on a predetermined operation of the shutter key of the operation input unit 14 (step 1). (S301; YES), the CPU controls each part of the imaging apparatus 100 to set the operation mode to “still image acquisition” (step S302).
Subsequently, the pre-processing unit 3 performs basic signal processing on the input image data output from the electronic imaging unit 2 and performs Bayer data of 3200 × 2400 pixels, as in the still image shooting process of the first embodiment. Is generated and output to the Bayer reduction unit 4 and the memory 15, and various processes are performed on the image data to generate an AF detection signal corresponding to the luminance signal and output to the AF detection unit 5. Further, in synchronization with the generation and output of the Bayer data and the AF detection signal, the gyro module 6 detects the rotation of the imaging device main body and outputs the gyro data to the memory 15 (step S303).

The AF detection unit 5 performs AF detection processing using the AF detection signal and outputs AF detection data to the memory 15 as in the still image shooting processing of the first modification (step S304).
Subsequently, the CPU performs a process of storing the still image Bayer data, AF detection data, and gyro data of the image frame in the ring buffer of the memory 15 in association with each other in the imaging order by the second memory control routine (step S305).

The processing after step S305 shown in FIG. 16 is substantially the same as the still image shooting processing of the first embodiment shown in FIG.
That is, the Bayer reduction unit 4 performs the reduction process on the 3200 × 2400 pixel Bayer data, generates 800 × 600 pixel reduced Bayer data, and outputs it to the memory 15 as in the still image shooting process (Step S1). S306).

  Next, the image generation unit 7 generates YUV data from the reduced Bayer data in the same manner as the still image shooting process, and then the resolution conversion unit 8 continues to display 320 × 240 pixel display YUV data for monitoring, The moving image YUV data of 640 × 480 pixels for recording is generated and output to the memory 15 (step S307).

Next, the display control unit 10 updates the display screen by sequentially reading the display YUV data in the order of storage in the memory 15 and outputting it to the display unit 11 as in the still image shooting process (step S308).
Next, the CPU determines whether the moving image YUV data generated through the image generation unit 7 and the resolution conversion unit 8 is stored in the memory 15 as in the still image shooting process (step S309). If it is determined that moving image YUV data is stored (step S309; YES), the CODEC 9 encodes the moving image YUV data in the M-JPEG format to generate 640 × 480 pixel M-JPEG data. Is performed (step S310).

  Next, as in the still image shooting process, the CPU determines whether there is M-JPEG data generated by the encoding process (step S311), and determines that there is M-JPEG data. (Step S311; YES), according to the moving image recording control routine, the recording medium control unit 12 acquires the M-JPEG data encoded in the M-JPEG format by the CODEC 9 and records it on the recording medium 13 (Step S312). .

Then, as shown in FIG. 17, the CPU determines whether or not the still image shooting counter in the memory 15 is 10 as in the still image acquisition moving image recording process of the second embodiment (step S313). If it is determined that the still image shooting counter is 10 (step S313; YES), the CPU is temporarily stored in the memory 15 when the user operates the shutter key by the third blur amount detection routine. It is determined whether or not the AF detection data of the still image data set for five frames is below a predetermined threshold value (step S314). If it is determined that the AF detection data is below the threshold value (step S314) ; YES), while AF detection data = 0 (step S315), if it is determined that it is not below the threshold (step S314; NO), the value of the AF detection data is left as it is.
Subsequently, the CPU compares the AF detection data of the still image data set for five frames by the fourth image frame specifying routine, and determines whether or not these AF detection data are all the same (step S316). ), It is determined that they are not all the same (step S316; NO), among the AF detection data of the still image data set for five frames, the most probable image with the smallest image blurring amount in the frame with the largest AF detection data. Identifies as a frame. Then, the CPU sets an overwrite prohibition flag with the still image data set relating to the most prominent image frame as the most prominent data set (step S317). On the other hand, if it is determined in step S316 that the AF detection data are all the same (step S316; YES), each gyro data of the still image data set for five frames is evaluated, and the maximum gyro displacement is detected. As a quantity, the frame with the smallest gyro maximum displacement is specified as the most prominent image frame with the smallest image blur amount. Then, the CPU sets the overwrite prohibition flag with the still image data set relating to the most prominent image frame as the most prominent data set (step S318).
After that, the CPU performs a process of subtracting 5 from a still image shooting counter (not shown) in the memory 15 (step S319), and returns to step S303, as in the still image acquisition moving image recording process of the second embodiment. Repeat the process.

On the other hand, if it is determined in step S313 that the still image shooting counter is not 10 (step S313; NO), the CPU temporarily stores the memory 15 sequentially after the operation of the shutter key by the third blur amount detection routine. Of the stored still image data sets, it is determined whether or not the AF detection data of the immediately preceding still image data set is equal to or less than a predetermined threshold value (step S320), and is determined to be equal to or less than the threshold value. If it is determined (step S320; YES), the AF detection data is set to 0 (step S321). If it is determined that it is not less than the threshold value (step S320; NO), the value of the AF detection data is determined. Is as it is.
Subsequently, the CPU compares the AF detection data of the still image data set for five frames with the fourth image frame specifying routine, and the AF detection data of the most recent still image data set and the AF detection of the most prominent image frame. The data are compared to determine whether or not these AF detection data are the same (step S322). If it is determined that they are not the same (step S322; NO), the larger frame of the AF detection data is selected. It is specified as a leading image frame. Then, the CPU sets the overwrite prohibition flag with the still image data set relating to the most prominent image frame as the most prominent data set (step S323). On the other hand, if it is determined in step S322 that the AF detection data is the same (step S322; YES), the gyro data of the still image data set of the immediately preceding image frame is evaluated, and the maximum gyro displacement is used as the image blur amount. The frame having the smaller gyro maximum displacement is identified as the most powerful image frame by calculating and comparing with the maximum gyro displacement of the most powerful image frame. Then, the CPU sets an overwrite prohibition flag with the still image data set relating to the most prominent image frame as the most prominent data set (step S324).
After that, the CPU performs a process of subtracting 1 from a still image shooting counter (not shown) in the memory 15 (step S325), and then the still image shooting counter in the memory 15 performs a process similar to the still image shooting process of the first embodiment. It is determined whether it is 0 (step S326). If it is determined that the still image shooting counter is not 0 (step S326; NO), the process returns to step S303, and the subsequent processing is repeatedly executed.
On the other hand, if it is determined in step S326 that the still image shooting counter is 0 (step S326; YES), the CPU controls each unit of the imaging apparatus 100 as in the still image shooting process of the first embodiment. Then, the operation mode is set to “recording recording”, and the still image acquisition moving image recording operation is ended (step S327).

In the still image recording process by the imaging apparatus of the second modification, the still image shooting number counter is 1 or more after the still image acquisition moving image recording process is completed, as in the still image recording process by the imaging apparatus of the second embodiment. This process is executed when it is determined that a still image has been taken.
The still image recording process performed by the imaging apparatus according to the second modification is substantially the same as the still image recording process performed by the imaging apparatus according to the second embodiment, and a detailed description thereof is omitted.

Therefore, according to the imaging apparatus of the second modification, it is needless to say that the same effect as in the first embodiment can be obtained, and AF detection data is smaller than a predetermined threshold value in the still image acquisition moving image recording process. If the shooting conditions are severe, such as when the shooting environment is dark, the gyro data can be used to evaluate the amount of image blur so that images with less subject blur can be obtained when the shooting conditions are good, such as a bright shooting environment. Even so, it is possible to obtain an image with little camera shake.
Further, since the still image recording operation is continued before the shutter key is operated, it is possible to acquire a still image that is closest to the operation timing of the shutter key and has the least blur from the period including the time before the shutter key is operated.

<Modification 3>
In the still image acquisition moving image recording process, the imaging apparatus of Modification 3 outputs still image Bayer data from the preprocessing unit 3, AF detection data, and gyro data when the user presses the shutter key halfway. First, the still image Bayer data is associated with AF detection data and gyro data.
Note that the imaging apparatus according to the third modification starts outputting still image Bayer data, AF detection data, and gyro data from the preprocessing unit 3 based on a half-press operation of the shutter key, and associates these data with each other. Except for this point, the configuration is substantially the same as that of the imaging device of Modification 2 described above, and a description thereof is omitted.

  That is, the shutter key is configured to be capable of two-stage pressing operation, for example, a half-pressing operation and a full-pressing operation, and outputs a predetermined operation signal corresponding to each operation step. Specifically, when the shutter key is pressed halfway by the user, in the still image acquisition moving image recording process, the output start of the still image Bayer data from the preprocessing unit 3 or the AF detection data from the AF detection unit 5 is performed. In response to a full-press operation by the user, the electronic imaging unit 2 captures an image in the still image acquisition moving image recording process. An instruction to record a still image of the subject is output.

  The program stored in the program memory is not shown, but the exposure time setting control routine, moving image recording control routine, still image recording control routine, third blur amount detection routine, second memory control routine, fourth In addition to the image frame specifying routine, a first control routine is included.

  In the first control routine, before the shutter key is operated by the user in the still image acquisition moving image recording process, the output of still image Bayer data from the preprocessing unit 3 or the output of AF detection data from the AF detection unit 5 The output of the gyro data from the gyro module 6 is stopped, and based on the half-pressing operation of the shutter key by the user, the output of the still image Bayer data to the preprocessing unit 3 is started, or the AF detection data to the AF detection unit 5 is started. And a group of instructions for causing the CPU to realize a function related to a process of outputting a gyro data output start instruction to the gyro module 6.

Therefore, according to the imaging apparatus of the third modification, the output of the still image Bayer data, the AF detection data, and the gyro data from the preprocessing unit 3 is started based on the half-pressing operation of the shutter key by the user. The period during which these data are output and associated can be shortened to reduce power consumption.
That is, in the imaging device of the second embodiment and the second modification, the still image acquisition moving image recording process outputs the still image Bayer data from the preprocessing unit 3 regardless of whether the user operates the shutter key. Since the still image Bayer data and AF detection data and gyro data are associated with each other, the viewpoint of still image acquisition is effective, but there is a problem that power consumption increases. . However, as in the third modification, the output of the still image Bayer data, the AF detection data, and the gyro data from the pre-processing unit 3 is started based on the half-press operation of the shutter key, so that all of the shutter keys can be operated. The image frame before the push operation can be set as a still image acquisition target, and an increase in power consumption can be suppressed.

<Modification 4>
In the image pickup apparatus of the modification example 4, in the still image acquisition moving image recording process, the output of the still image Bayer data from the preprocessing unit 3 is output by the electronic image pickup unit 2 before the half pressing operation of the shutter key by the user. On the other hand, after halfway pressing of the shutter key, still image Bayer data is output from the preprocessing unit 3 for each frame output by the electronic imaging unit 2.
Note that the imaging apparatus according to the modified example 4 changes the number of output times of still image Bayer data from the preprocessing unit 3 per predetermined number of frames before and after the shutter key is half-pressed in the still image acquisition moving image recording process. In this respect, the configuration is substantially the same as that of the imaging device of Modification 2 described above, and a description thereof is omitted.

  That is, the program stored in the program memory is not shown, but the exposure time setting control routine, the moving image recording control routine, the still image recording control routine, the third blur amount detection routine, the second memory control routine, the fourth In addition to the image frame specifying routine, a second control routine is included.

In the second control routine, in the still image acquisition moving image recording process, before the user half-presses the shutter key, the output of the still image Bayer data from the preprocessing unit 3 is output for every two frames output by the electronic imaging unit 2. On the other hand, after the shutter key is half-pressed, the CPU performs a function related to processing for outputting the still image Bayer data from the preprocessing unit 3 for each frame output by the electronic imaging unit 2. Includes instructions.
That is, according to the second control routine, under the control of the imaging control unit, the electronic imaging unit 2 images the subject at a frame rate that is higher than that before the instruction based on an instruction to capture a still image using the shutter key. The same processing as that for generating a plurality of image frames is performed.
Before the user presses the shutter key halfway, the output of the still image Bayer data from the preprocessing unit 3 may be performed every three frames or more output by the electronic imaging unit 2, but there is little blurring. From the viewpoint of obtaining a still image, it is preferable to perform the output every two frames or more and fewer frames.

Therefore, according to the imaging apparatus of the modification 4, as in the modification 3, the output of the still image Bayer data, the AF detection data, and the gyro data from the preprocessing unit 3 is performed based on the half-press operation of the shutter key. By starting the image frame, the image frame before the full pressing operation of the shutter key can be set as a still image acquisition target, and an increase in power consumption can be suppressed. In particular, when the user is instructed to capture a still image based on a predetermined operation of the shutter key by the user, the electronic imaging unit 2 captures the subject at a higher frame rate than before the instruction and generates a plurality of image frames. Therefore, it is possible to more appropriately suppress the increase in power consumption.
Furthermore, even if the user does not press the shutter key halfway and operates it all at once, the still image recording operation continues from before the shutter key operation. It is possible to obtain a still image that is closest to the key operation timing and has less blur.

The present invention is not limited to the above-described embodiment, and various improvements and design changes may be made without departing from the spirit of the present invention.
For example, the configuration of the imaging apparatus illustrated in the above embodiment is an example, and is not limited thereto.

  In addition, in the above-described embodiment, the functions as the shake amount detection unit, the identification unit, and the exposure time setting unit are realized by executing a predetermined program or the like by the CPU. However, the present invention is not limited to this. Instead, for example, it may be configured by a logic circuit for realizing various functions.

It is a block diagram which shows schematic structure of the imaging device of Embodiment 1 to which this invention is applied. 3 is a flowchart illustrating an example of a main operation of the imaging apparatus in FIG. 1. 3 is a flowchart illustrating an example of an operation related to a moving image recording process by the imaging apparatus of FIG. 1. It is a figure which shows typically the data flow in the moving image recording process of FIG. 3 is a flowchart illustrating an example of an operation related to a still image shooting process performed by the imaging apparatus of FIG. 1. It is a figure which shows the timing chart of the process of each image frame in the still image shooting process of FIG. FIG. 6 is a diagram schematically illustrating a data flow in the still image shooting process of FIG. 5. 3 is a flowchart illustrating an example of an operation related to a still image recording process performed by the imaging apparatus of FIG. 1. It is a figure which shows typically the flow of the data in the still image recording process of FIG. FIG. 11 is a block diagram illustrating a schematic configuration of an imaging apparatus according to a first modification. 11 is a flowchart illustrating an example of an operation related to a still image shooting process performed by the imaging apparatus of FIG. 10. 11 is a flowchart illustrating an example of an operation related to a still image recording process performed by the imaging apparatus in FIG. 10. It is a flowchart which shows an example of the operation | movement which concerns on the still image acquisition moving image recording process by the imaging device of Embodiment 2 to which this invention is applied. It is a figure which shows the continuation of the still image acquisition moving image recording process of FIG. 14 is a flowchart illustrating an example of an operation related to a still image recording process performed by the imaging apparatus in FIG. 13. 12 is a flowchart illustrating an example of an operation related to a still image acquisition moving image recording process performed by the imaging apparatus according to the second modification. It is a figure which shows the continuation of the still image acquisition moving image recording process of FIG.

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 Imaging device 2 Electronic imaging part 4 Bayer reduction part 7 Image generation part 8 Resolution conversion part 13 Recording medium 16 Control part

Claims (14)

Imaging control means for imaging a subject at a predetermined frame rate and sequentially generating a plurality of first resolution image frames;
Low resolution image generation means for sequentially generating second resolution image frames lower than the first resolution in correspondence with each of the plurality of image frames generated by the imaging control means;
Moving image recording means for recording a moving image composed of the image frames of the second resolution generated by the low resolution image generating means;
A blur amount detecting means for detecting an image blur amount in each of the plurality of image frames generated by the imaging control means during a moving image recording operation by the moving image recording means;
Based on the detection result of the blur amount detection unit, a specifying unit that specifies an image frame with the smallest image blur amount among the plurality of image frames generated by the imaging control unit;
Still image recording means for recording the image frame specified by the specifying means as a still image having a resolution higher than the second resolution;
An imaging apparatus comprising: The imaging control means sets an exposure time by the imaging element to a predetermined first exposure time during a moving image recording operation by the moving image recording means,
2. The imaging apparatus according to claim 1, wherein both the moving image recording unit and the still image recording unit record an image frame obtained by imaging with the first exposure time.   When still image recording is instructed during the moving image recording operation by the moving image recording unit, the still image recording unit records an image frame with the smallest image blur amount specified by the specifying unit as a still image. On the other hand, if recording of a still image is instructed when the moving image recording unit is not recording a moving image, it is determined based on this still image recording instruction timing regardless of the amount of image blurring. The imaging apparatus according to claim 2, wherein the recorded image frame is recorded as a still image. When the recording control unit is instructed to record a still image when the moving image recording unit is not recording a moving image, the imaging control unit sets a second exposure time shorter than the first exposure time. Set to
The still image recording unit records an image frame obtained by imaging in the second exposure time when an instruction to record a still image is given when the moving image recording unit is not recording a moving image. The imaging apparatus according to claim 3. The imaging control means performs imaging of a subject by exposing an imaging element,
When recording a moving image by the moving image recording unit, the exposure time during which the image sensor is exposed is set to a predetermined first exposure time, and when recording a still image by the still image recording unit The second exposure time is set shorter than the first exposure time, and the first exposure time is set when the still image recording unit records a still image while the moving image recording unit records the moving image. The imaging apparatus according to claim 1, further comprising an exposure time setting unit that performs the exposure time setting. The shake amount detecting means includes
An angular velocity detection unit that detects an angular velocity of the imaging apparatus main body and outputs a predetermined detection signal, and based on the predetermined detection signal output from the angular velocity detection unit, the plurality of the plurality of image generated by the imaging control unit The image pickup apparatus according to claim 1, wherein an image blur amount in each of the image frames is detected. The shake amount detecting means includes
High-frequency component calculating means for calculating a high-frequency component in each of the plurality of image frames generated by the imaging control means, and based on the high-frequency component calculated by the high-frequency component calculating means, The image pickup apparatus according to claim 1, wherein an image blur amount in each is detected. The shake amount detecting means includes
An angular velocity detection unit that detects an angular velocity of the imaging apparatus body and outputs a predetermined detection signal; and a high-frequency component calculation unit that calculates a high-frequency component in each of the plurality of image frames generated by the imaging control unit. The image blur amount in each of the plurality of image frames is detected based on the predetermined detection signal output from the angular velocity detection means and the high frequency component calculated by the high frequency component calculation means. The imaging device according to any one of claims 1 to 5. Still image recording instruction means for instructing recording of the still image by the still image recording means during the moving image recording operation by the moving image recording means,
The blur amount detection unit detects an image blur amount in each of the plurality of image frames generated by the imaging control unit based on an instruction to record the still image by the still image recording instruction unit. The imaging device according to any one of claims 1 to 8.   The imaging control unit is configured to generate the plurality of image frames by imaging a subject at a higher frame rate than before the instruction in response to an instruction to record the still image by the still image recording instruction unit. The imaging device according to claim 9. Temporary storage means for temporarily storing the plurality of image frames generated by the imaging control means;
The blur amount detecting unit and the specifying unit are configured to detect the image blur amount and identify an image frame with the smallest image blur amount based on a plurality of image frames stored in the temporary storage unit. The imaging device according to any one of claims 1 to 10.   The temporary storage unit relates to the still image temporarily stored when the still image recording unit does not record the still image or after the still image recording unit records the still image. The image pickup apparatus according to claim 11, wherein an image frame other than the image frame is discarded. Display means for displaying a subject image based on the plurality of image frames generated by the imaging control means;
Corresponding to each of the plurality of image frames generated by the imaging control means, image frames having a third resolution that is lower than the first resolution and higher than the second resolution are sequentially generated. Medium resolution image generating means;
Display resolution image generation means for generating a fourth resolution image frame for displaying the subject image by the display unit in correspondence with each of the third resolution image frames generated by the medium resolution image generation means; With
The low-resolution image generation unit generates the second-resolution image frame corresponding to each of the third-resolution image frames generated by the medium-resolution image generation unit. The imaging device according to any one of 12. A computer of an imaging apparatus comprising imaging control means for imaging a subject at a predetermined frame rate and sequentially generating a plurality of first resolution image frames;
Low-resolution image generation means for sequentially generating a second resolution image frame having a lower resolution than the first resolution in correspondence with each of the plurality of image frames generated by the imaging control means;
Moving image recording means for recording a moving image composed of the image frames of the second resolution generated by the low resolution image generating means;
A blur amount detecting unit that detects an image blur amount in each of the plurality of image frames generated by the imaging control unit during a moving image recording operation by the moving image recording unit;
A specifying unit for specifying an image frame having the smallest image blur amount among the plurality of image frames generated by the imaging control unit based on a detection result of the blur amount detecting unit;
A still image recording means for recording the image frame specified by the specifying means as a still image having a resolution higher than the second resolution;
A program characterized by functioning as

Images