JP5888272B2 - Imaging apparatus, imaging control method, and program - Google Patents

Description

  The present invention relates to an imaging apparatus, an imaging control method, and a program.

  2. Description of the Related Art Conventionally, an imaging apparatus such as a video camera is premised on shooting with a hand held, and thus various techniques for eliminating camera shake during shooting are installed.

  For example, Patent Document 1 discloses a technique for measuring the motion of a video camera using an acceleration sensor or the like and setting a correction amount for camera shake correction in an imaging range based on the measurement result.

JP 2004-056578 A

  However, the technique described above detects fine camera shake at the time of shooting and is difficult to predict, and as a result, an unnecessarily camera shake correction margin may be set. For this reason, there is a problem that even if the vibration is periodic and predictable to some extent, the camera shake correction margin is taken too much and the effective pixel region is narrowed more than necessary.

  The present invention has been made in view of the above-described problems, and an object of the present invention is to provide an imaging apparatus, an imaging control method, and a program that enable suitable imaging in consideration of a movement mode such as walking.

In order to achieve the above object, an imaging device according to an aspect of the present invention includes an imaging unit, at least a detection unit that detects a movement mode of a moving body that moves together with the imaging unit, and a movement mode detected by the detection unit. A setting unit for setting an effective pixel area in the imaging unit having a size corresponding to the image capturing unit, and, when blurring occurs, an image with reduced blur is obtained by moving the effective pixel region set by the setting unit. And a control means for controlling , wherein a predetermined time difference is provided between the detection timing of the movement mode by the detection means and the setting timing by the setting means .
In order to achieve the above object, an imaging apparatus according to an aspect of the present invention is detected by an imaging unit, at least a detection unit that detects a movement mode of a moving body that moves with the imaging unit, and the detection unit. A setting unit that sets an effective pixel area in the imaging unit having a size according to a moving mode, and an image obtained by reducing the blur by moving the effective pixel area set by the setting unit when a blur occurs. Control means for controlling to detect, and the detection means detects, as the movement mode, a degree of vibration periodically applied to the imaging means.

  ADVANTAGE OF THE INVENTION According to this invention, suitable imaging | photography which considered movement modes, such as a walk, can be performed.

It is a block diagram which shows the structure of the hardware of the imaging device which concerns on one Embodiment of this invention. It is a figure which shows the state which attached the imaging device of this embodiment to the attachment object. It is a figure explaining the principle of an electronic blur correction system. It is a functional block diagram which shows the functional structure for performing an imaging | photography process among the functional structures of an imaging device. It is a figure which shows the blurring correction margin setting table memorize | stored in the blurring correction margin setting table memory | storage part. 5 is a flowchart for explaining a flow of imaging processing executed by the imaging apparatus of FIG. 1 having the functional configuration of FIG. 4. 5 is a flowchart for explaining a flow of blur correction margin setting processing executed by the imaging apparatus of FIG. 1 having the functional configuration of FIG. 4.

  Hereinafter, an embodiment of the present invention will be described with reference to the drawings as appropriate.

FIG. 1 is a block diagram showing a hardware configuration of an imaging apparatus 1 according to an embodiment of the present invention.
The imaging device 1 is configured as a digital camera, for example.

  The imaging device 1 includes a CPU (Central Processing Unit) 11, a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, an image processing unit 14, a bus 15, an input / output interface 16, and an imaging unit. 18, an input unit 19, an output unit 20, a storage unit 21, a communication unit 22, and a drive 23.

  The CPU 11 executes various processes according to a program recorded in the ROM 12 or a program loaded from the storage unit 21 to the RAM 13.

  The RAM 13 appropriately stores data necessary for the CPU 11 to execute various processes.

  The image processing unit 14 is configured by a DSP (Digital Signal Processor), a VRAM (Video Random Access Memory), and the like, and performs various image processing on image data in cooperation with the CPU 11.

  The CPU 11, ROM 12 and RAM 13 are connected to each other via a bus 15. An input / output interface 16 is also connected to the bus 15. A sensor unit 17, an imaging unit 18, an input unit 19, an output unit 20, a storage unit 21, a communication unit 22, and a drive 23 are connected to the input / output interface 16.

The sensor unit 17 is built in the imaging device 1 and is configured by a three-axis acceleration sensor capable of measuring movement of the imaging device 1 in the XYZ-axis directions (at least the movement of the imaging device).
In addition, the sensor unit 17 includes a piezoresistive type or a capacitance type detection mechanism. Using the detection mechanism, the three-axis (X, Y, Z) components of acceleration are detected, and the detection result is obtained. Output the indicated data. The data indicating the detection result of the three-axis acceleration sensor is hereinafter referred to as “sensor information”.
Here, in the sensor information, the X component is the horizontal vibration when the imaging surface of the imaging apparatus 1 is vertically set, the Y component is the vertical vibration when the imaging surface is vertically set, and the Z component. Corresponds to the vibration in the optical axis (vertical) direction when the imaging surface is set up vertically.
The sensor unit 17 detects the movement of the imaging device 1 (at least the imaging device) and outputs sensor information for detecting the movement mode of the attachment target (a person in the present embodiment) of the imaging device 1. In the present embodiment, the sensor unit 17 outputs, for example, sensor information representing a periodic movement (moving mode) of an attachment target of the imaging device 1 such as walking or running.

  Although not shown, the imaging unit 18 includes an optical lens unit and an image sensor.

  The optical lens unit is configured by a lens that collects light, for example, a focus lens or a zoom lens, in order to photograph a subject. The focus lens is a lens that forms a subject image on the light receiving surface of the image sensor. The zoom lens is a lens that freely changes the focal length within a certain range. The optical lens unit is also provided with a peripheral circuit for adjusting setting parameters such as focus, exposure, and white balance as necessary.

The image sensor includes an image sensor, AFE (Analog Front End), and the like. The image sensor is composed of, for example, a CMOS (Complementary Metal Oxide Semiconductor) type photoelectric conversion element or the like. A subject image is incident on the image sensor from the optical lens unit. Therefore, the image sensor photoelectrically converts (captures) the subject image, accumulates the image signal for a predetermined time, and sequentially supplies the accumulated image signal to the AFE as an analog signal.
The AFE performs various signal processing such as A / D (Analog / Digital) conversion processing on the analog image signal. Through various signal processing, a digital signal is generated and output as an output signal of the imaging unit 18.
Such an output signal of the imaging unit 18 is hereinafter referred to as “captured image data”. The captured image data is appropriately supplied to the CPU 11, RAM 13, image processing unit 14, and the like.
The captured image data output from the imaging unit 18 is frame image data constituting moving image data.

The input unit 19 is configured with various buttons and the like, and inputs various types of information according to user instruction operations.
The output unit 20 includes a display, a speaker, and the like, and outputs an image and sound.
The storage unit 21 is configured with a hard disk, a DRAM (Dynamic Random Access Memory), or the like, and stores various image data.
The communication unit 22 controls communication with other devices (not shown) via a network including the Internet.

  A removable medium 31 made of a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is appropriately attached to the drive 23. The program read from the removable medium 31 by the drive 23 is installed in the storage unit 21 as necessary. The removable medium 31 can also store various data such as image data stored in the storage unit 21 in the same manner as the storage unit 21.

FIG. 2 is a diagram illustrating a state in which the imaging device 1 according to the present embodiment is attached to an attachment target.
As shown in FIG. 2, the imaging apparatus 1 having the hardware configuration described above is attached to a person's head with the line-of-sight direction as the shooting direction, and takes a first-person viewpoint moving image that approximates the person's line of sight. .
The sensor unit 17 built in the imaging apparatus 1 outputs the movement of the imaging apparatus 1 in the XYZ-axis directions (at least the movement of the imaging element) as sensor information. In the present embodiment, the X axis is set in the horizontal direction with respect to the line-of-sight direction (traveling direction) to be attached, the Y axis is set in the vertical direction with respect to the same direction, and the Z axis is set in the same direction (traveling direction).

  Thus, the use of the imaging device 1 that is attached to a person's head and shoots the frequency and amount of movement of the device itself as compared with the use of a normal imaging device that shoots with a hand. Will increase. For this reason, the shake correction function of the degree of camera shake correction that is mounted on a normal image pickup apparatus does not absorb the shake and tends to be a picked-up image with a shake.

As a blur correction function that can withstand blur more than the above-described camera shake correction, for example, there is an electronic blur correction. Electronic blur correction analyzes each acquired frame image, aligns each frame image so that the subject is at the same position between the frame images, and sets the aligned common part area to the frame image. This is a method for correcting motion blur of a moving image. In this electronic blur correction, since each frame image is shifted for alignment, it is necessary to secure a certain amount of alignment margin (hereinafter referred to as “blur correction margin”). The range in which blurring can be corrected varies depending on the area. That is, if the alignment margin area is wide, the effective pixels used in the frame image are reduced and the angle of view is narrowed, but the range in which blurring can be corrected is increased. On the other hand, if the blur correction margin area is narrowed, the number of effective pixels used in the frame image increases and the angle of view becomes wider, but the range in which blurring can be corrected becomes smaller.
In view of the above-described circumstances, in the imaging apparatus 1 of the present embodiment, a blur range is predicted, and a blur correction margin is set in consideration of the predicted blur range. In this way, by setting the blur correction margin, it is possible to widen the angle of view while suppressing blurring.

FIG. 3 is a diagram for explaining the principle of the electronic blur correction method.
In the electronic blur correction method, when the blur correction function is not enabled, the pixel area 100 of the entire image sensor is used as a pixel area for a frame image (hereinafter referred to as “effective pixel area”). On the other hand, when the blur correction function is enabled, as shown in FIG. 3, a part of the entire pixel region 100 of the image sensor is set as the effective pixel region 101, and pixel regions other than the effective pixel region 101 are used. Are used for a pixel region (hereinafter referred to as “blur correction margin region”) 102 for blur correction. In other words, by setting the effective pixel area 101 as the main pixel area for the frame image and the blur correction margin area 102 as the complementary pixel area for blur correction in this way, blurring occurs when blurring occurs. Correspondingly, by changing the position of the effective pixel region 101 and acquiring a frame image in which blur is absorbed, a moving image in which blur is suppressed can be acquired.

In the present embodiment, the blur correction margin area 102 is set according to the movement mode of the attachment target (specifically, the movement mode such as stop, walking, and running). In movement modes such as stop, walking, and running, the apparatus moves at a predetermined cycle depending on the type of movement mode, and a predetermined movement range (blurring range) tends to appear. For this reason, in the imaging apparatus 1 of the present embodiment, the movement mode is detected, and a blur correction margin area having a width that matches the detected movement mode is set.
Therefore, in the imaging apparatus 1 of the present embodiment, blur correction margin areas that match the detected movement mode are set, and blur correction is performed using the blur correction margin areas, thereby capturing a moving image, thereby suppressing blurring. However, it has a function of acquiring a moving image with a wider angle of view.

FIG. 4 is a functional block diagram illustrating a functional configuration for executing the imaging process among the functional configurations of the imaging apparatus 1.
“Imaging processing” is a series of steps from setting a blur correction margin based on sensor information of a device a predetermined time before the start of shooting to shooting a moving image with reduced blur based on the blur correction margin. It is processing of.
The “imaging process” includes a “blur correction margin setting process”. The “blur correction margin setting process” is a process related to the setting of the blur correction margin. Based on the sensor information acquired from the sensor unit 17, the movement mode of the attachment target is detected, and the blur mode is detected from the detected movement mode. This is a series of processes until the correction margin is set.

  When executing the imaging process, in the CPU 11, the sensor information acquisition unit 51, the movement mode detection unit 52, the shake correction margin setting unit 53, the imaging control unit 54, the pixel acquisition control unit 55, and the moving image acquisition unit. 56 function.

  In one area of the storage unit 21, a sensor information storage unit 71, a blur correction margin setting table storage unit 72, a blur correction margin information storage unit 73, and a moving image storage unit 74 are provided.

  The sensor information storage unit 71 sequentially stores sensor information that is position information (X-axis, Y-axis, and Z-axis data) obtained by the imaging unit 1 obtained from the sensor unit 17.

The shake correction margin setting table storage unit 72 stores a shake correction margin setting table.
The “blur correction margin setting table” is a table in which the maximum amplitude value of the imaging apparatus 1 and the blur correction margin area are associated with each other, and the blur correction in the case of the maximum amplitude assumed from the detected movement mode. It is a table which sets the ratio of a margin area.

FIG. 5 is a diagram illustrating a blur correction margin setting table stored in the blur correction margin setting table storage unit 72.
Here, the “maximum amplitude value (cm)” is a value of the maximum amplitude among the detected periodic amplitudes.
The “blur correction margin (%)” is the remaining area (hereinafter referred to as “blur correction margin area”) of the recording pixel area (hereinafter referred to as “effective pixel area”) when the total pixel area is 100%. )) As a percentage. In the present embodiment, the blur correction margin area and the effective pixel area are indicated by an area ratio.

In the example of FIG. 5, the movement mode is divided into three states: a stationary state in which the attachment target is stopped, a walking state in which the attachment target is walking, and a running state in which the attachment target is running. This is because these states are periodic movements and are movement modes in which blurring can be predicted.
In the example of FIG. 5, it is assumed that a frequency component from 0 Hz to 5 Hz is detected as the movement mode of the attachment target described above. The maximum amplitude value when the waveform of the frequency component from 0 Hz to 5 Hz is periodically detected is between “2 (cm) or less” and “greater than 5 (cm)”, that is, in the range of 2 cm to 5 cm. Is set.
Specifically, as shown in FIG. 5, when the maximum amplitude value is “2 (cm) or less”, it is assumed that the movement mode is a stationary state, the effective pixel area is “90%”, and the blur correction margin area. “10%”.
When the maximum amplitude value is “over 2 (cm) to 5 (cm) or less”, it is assumed that the movement mode is the walking state, the effective pixel area is “80%”, and the blur correction margin area is “20%”. "
When the maximum amplitude value is “over 5 cm”, it is assumed that the movement mode is the traveling state, and the reference storage pixel area is “70%” and the blur correction margin area is “30%”.
With this configuration, when the amplitude is small, priority is given to a large storage pixel area and a wide angle of view, and when the amplitude is large, the storage pixel area is reduced to reduce the blur correction margin area. It is possible to prioritize the acquisition of a blur-free image.

  Returning to FIG. 4, the blur correction margin information storage unit 73 stores a blur correction margin value set by the blur correction margin setting table (hereinafter referred to as “blur correction margin information”).

  The moving image storage unit 74 stores moving image data including a frame image group obtained by acquiring a plurality of frame images composed of effective recording pixels at positions corresponding to the predicted blur from the imaging unit 18.

  The sensor information acquisition unit 51 acquires sensor information from the sensor unit 17 and outputs the sensor information to the sensor information storage unit 71.

  The movement mode detection unit 52 detects the movement mode of the attachment target based on the sensor information sequentially stored in the sensor information storage unit 71. In this embodiment, the movement mode detection unit 52 detects three movement modes of a stationary state, a walking state, and a running state among the movement modes of a person who is an attachment target. In the present embodiment, the movement mode detection unit 52 detects the maximum value of the amplitude in the waveform of the frequency component as an index indicating the movement mode.

  The movement mode detection unit 52 includes a frequency extraction unit 521 and an amplitude derivation unit 522.

  The frequency extraction unit 521 extracts a frequency component from the sensor information for a predetermined period stored in the sensor information storage unit 71. In the present embodiment, the frequency extraction unit 521 extracts a frequency component from the sensor information for 3 seconds before imaging is started.

  The amplitude deriving unit 522 derives the maximum value of the amplitude of the waveform constituting the frequency component from the frequency component extracted by the frequency extracting unit 521. The maximum value of the derived amplitude is an index indicating the movement mode. In the present embodiment, as shown in FIG. 5, when the maximum amplitude value is “2 (cm) or less”, the movement mode indicates a stationary state, and the maximum amplitude value exceeds “2 (cm) to 5 ( In the case of “cm) or less”, the movement mode indicates a walking state, and in the case where the maximum amplitude value is “greater than 5 (cm)”, the movement mode indicates a running state.

The blur correction margin setting unit 53 sets a blur correction margin based on the movement mode detected by the movement mode detection unit 52. In the present embodiment, the shake correction margin setting unit 53 uses the maximum value of the amplitude in the movement mode derived by the amplitude deriving unit 522 of the movement mode detection unit 52 to store the blur correction margin setting table storage unit 72. The blur correction margin is set with reference to the correction margin setting table.
Further, the blur correction margin setting unit 53 causes the blur correction margin information storage unit 73 to store the set blur correction margin value (in this embodiment, the ratio of the blur correction margin area to the entire pixel area).

  Note that the movement mode detection unit 52 (the frequency extraction unit 521 and the amplitude derivation unit 522) and the shake correction margin setting unit 53 execute a shake correction margin setting process in the imaging process.

  The imaging control unit 54 controls the imaging unit 18 based on an instruction to start shooting. As a result, captured image data is output from the imaging unit 18.

  The pixel acquisition control unit 55 is based on the value of the blur correction margin stored in the blur correction margin information storage unit 73, and the common pixel effective pixel region obtained by aligning a plurality of frame images acquired from the imaging unit 18. The moving image acquisition unit 56 is controlled so as to acquire the image as a blur-corrected frame image.

Under the control of the pixel acquisition control unit 55, the moving image acquisition unit 56 acquires an image of an effective pixel region of a common portion corresponding to a plurality of frame images among all the pixel regions based on the blur correction margin value (ratio). Then, a plurality of frame images composed of images of the effective pixel area of the common part are acquired as moving image data.
The moving image acquisition unit 56 stores the acquired moving image data in the moving image storage unit 74.

Next, imaging processing executed by the imaging apparatus 1 having the functional configuration shown in FIG. 4 will be described with reference to FIG.
FIG. 6 is a flowchart for explaining the flow of imaging processing executed by the imaging device 1 of FIG. 1 having the functional configuration of FIG.

  The imaging process is started when the user performs an operation for starting the imaging process on the input unit 19, and the following process is executed.

  In step S1, the sensor information acquisition unit 51 monitors the output of the sensor unit 17 in the standby state. The monitored output of the sensor unit 17 is stored in the sensor information storage unit 71 as sensor information.

In step S <b> 2, the CPU 11 determines whether or not a shooting start operation has been performed on the input unit 19.
If there is no shooting start operation, NO is determined in step S2, and the process returns to step S2. That is, when there is no photographing start operation, the output of the sensor unit 17 is continuously monitored.

  On the other hand, if there is a shooting start operation, YES is determined in step S2, and the process proceeds to step S3.

In step S3, the movement mode detection unit 52 and the shake correction margin setting unit 53 execute a shake correction margin setting process. In other words, the movement mode detection unit 52 and the shake correction margin setting unit 53 perform a process of setting a shake correction margin using the output (sensor information) of the sensor that has been monitored at the time of shooting start operation. With this step, a blur correction margin is set. A detailed flow of the blur correction margin setting process will be described later.
In the present embodiment, as shown in step S1 and step S3, the sensor information acquisition timing and the blur correction margin setting timing are configured to be performed at different timings.

In step S4, the CPU 11 captures a moving image with the set blur correction margin. Specifically, the imaging control unit 54 controls the imaging unit 18 to shoot a moving image based on an instruction to start shooting. As a result, captured image data is output from the imaging unit 18. The pixel acquisition control unit 55 then validates the common part obtained by aligning the plurality of frame images acquired from the imaging unit 18 based on the value of the blur correction margin stored in the blur correction margin information storage unit 73. The moving image acquisition unit 56 is controlled to acquire the image of the pixel area as a frame image. Under the control of the pixel acquisition control unit 55, the moving image acquisition unit 56 acquires an image of an effective pixel region of a common portion corresponding to a plurality of frame images among all the pixel regions based on the blur correction margin value (ratio). Then, a plurality of frame images composed of images of the effective pixel area are acquired as moving image data.
The moving image acquisition unit 56 stores the acquired moving image data in the moving image storage unit 74.
Thereafter, the photographing process ends.

Next, the blur correction margin setting process executed by the imaging apparatus 1 having the functional configuration shown in FIG. 4 will be described with reference to FIG.
FIG. 7 is a flowchart for explaining the flow of blur correction margin setting processing executed by the imaging apparatus 1 of FIG. 1 having the functional configuration of FIG.

In step S <b> 31, the frequency extraction unit 521 extracts a frequency component from the output of the sensor unit 17. That is, the frequency extraction unit 521 extracts a frequency component from the sensor information for a predetermined period stored in the sensor information storage unit 71.
Specifically, the frequency extraction unit 521 acquires the X-axis and Y-axis outputs of the sensor information for 3 seconds before the start of imaging, and extracts 0 to 5 Hz frequency components generated depending on the movement mode.

  In step S32, the amplitude deriving unit 522 derives the maximum amplitude (cm) of the waveform of the frequency component extracted by the frequency extracting unit 521.

In step S33, the blur correction margin setting unit 523 sets a blur correction margin (%) corresponding to the maximum value of the amplitude derived by the amplitude deriving unit 522 with reference to the blur correction margin setting table.
Specifically, for example, when the maximum value of the amplitude derived by the amplitude deriving unit 522 is “3 cm”, “over 2 and under 5” is selected in the shake correction margin setting table, and the corresponding “ 20 (%) "is set as the blur correction margin.
Thereafter, the blur correction margin setting process ends.

As described above, the imaging apparatus 1 according to the present embodiment includes the imaging unit 18, the sensor unit 17, the blur correction margin setting unit 523, and the pixel acquisition control unit 55.
The sensor unit 17 detects at least the movement mode of the moving body that moves together with the imaging unit 18.
The blur correction margin setting unit 523 sets an effective pixel area in the imaging unit 18 having a size corresponding to the movement mode detected by the sensor unit 17.
When blurring occurs, the pixel acquisition control unit 55 controls to acquire an image with reduced blurring by moving the effective pixel region set by the blur correction margin setting unit 523.
Thereby, in the imaging device 1, it is possible to acquire an image with reduced blur by moving the effective pixel region set by the blur correction margin setting unit 523 according to the movement mode.
Therefore, the imaging apparatus 1 can perform suitable shooting in consideration of a movement mode such as walking.

Moreover, the sensor part 17 detects a movement aspect in steps according to the degree of the change.
In addition, the blur correction margin setting unit 523 sets the effective pixel area to be smaller as the degree of change in the movement mode is larger.
Thereby, in the imaging device 1, the effective pixel area can be set according to the type of movement mode. For example, the effective pixel area is set to be smaller as the degree of change in the movement mode is larger.
Therefore, in the imaging device 1, for example, it is possible to perform suitable shooting in consideration of a movement mode in which the degree of change such as traveling is large.

In the imaging apparatus 1, a predetermined time difference is provided between the timing at which the sensor information of the sensor unit 17 is acquired and the timing at which the blur correction margin setting unit 523 sets the blur correction margin.
Thereby, in the imaging device 1, the blur correction margin can be set from the state in which the sensor information has already been acquired, and it is possible to immediately perform suitable shooting in consideration of the movement mode.

The sensor unit 17 detects the degree of vibration periodically applied to the imaging unit 18 as a movement mode.
Thereby, for example, a stationary state, a walking state, a running state, and the like that are continuously performed can be detected as the movement mode.

  In addition, this invention is not limited to the above-mentioned embodiment, The deformation | transformation in the range which can achieve the objective of this invention, improvement, etc. are included in this invention.

  In the above-described embodiment, it may be used in combination with the image sensor shift type blur correction or the lens shift type blur correction. In this case, when the correction by them is effective, the blur correction margin may be set slightly narrower.

  In the above-described embodiment, an example in which a triaxial acceleration sensor is used as the sensor unit 17 is described. However, the present invention is not limited to this, and positioning using other sensor devices (speed, illuminance, gyroscope, GPS (Global Positioning System)). ).

  Moreover, although the example which detects a person's stillness, a walk, running, etc. is given as a movement mode of a moving body in the above-mentioned embodiment, it is not restricted to this. It is possible to detect not only a person's stillness / walking / running, but also a movement of a bicycle to be attached, running of an automobile, and the like. Further, not only simple periodic movement, but also a series of possible operations such as batting can be considered as a movement mode.

  In the above-described embodiment, the CPU 11 is configured to analyze the sensor information output by the sensor unit 17 and detect the movement mode. However, the present invention is not limited to this. For example, the sensor unit 17 may have a function of performing measurement and analysis so that the detection result of the movement mode is output.

In the above-described embodiment, the imaging apparatus 1 to which the present invention is applied has been described using a digital camera as an example, but is not particularly limited thereto.
For example, the present invention can be applied to general electronic devices having an imaging processing function. Specifically, for example, the present invention can be applied to a notebook personal computer, a television receiver, a video camera, a portable navigation device, a mobile phone, a smartphone, a portable game machine, and the like.

The series of processes described above can be executed by hardware or can be executed by software.
In other words, the functional configuration of FIG. 4 is merely an example, and is not particularly limited. That is, it is sufficient that the imaging apparatus 1 has a function capable of executing the above-described series of processing as a whole, and what functional block is used to realize this function is not particularly limited to the example of FIG.
In addition, one functional block may be constituted by hardware alone, software alone, or a combination thereof.

When a series of processing is executed by software, a program constituting the software is installed on a computer or the like from a network or a recording medium.
The computer may be a computer incorporated in dedicated hardware. The computer may be a computer capable of executing various functions by installing various programs, for example, a general-purpose personal computer.

  The recording medium including such a program is not only constituted by the removable medium 31 of FIG. 1 distributed separately from the apparatus main body in order to provide the program to the user, but also in a state of being incorporated in the apparatus main body in advance. It is comprised with the recording medium etc. which are provided in this. The removable medium 31 is composed of, for example, a magnetic disk (including a floppy disk), a Blu-ray Disc (Blu-ray disk), an optical disk, a magneto-optical disk, or the like. The optical disc is composed of, for example, a CD-ROM (Compact Disk-Read Only Memory), a DVD (Digital Versatile Disc), a Blu-ray Disc (Blu-ray Disc), and the like. The magneto-optical disk is configured by an MD (Mini-Disk) or the like. In addition, the recording medium provided to the user in a state of being preinstalled in the apparatus main body includes, for example, the ROM 12 in FIG. 1 in which the program is recorded, the hard disk included in the storage unit 21 in FIG.

  In the present specification, the step of describing the program recorded on the recording medium is not limited to the processing performed in time series along the order, but is not necessarily performed in time series, either in parallel or individually. The process to be executed is also included.

  As mentioned above, although several embodiment of this invention was described, these embodiment is only an illustration and does not limit the technical scope of this invention. The present invention can take other various embodiments, and various modifications such as omission and replacement can be made without departing from the gist of the present invention. These embodiments and modifications thereof are included in the scope and gist of the invention described in this specification and the like, and are included in the invention described in the claims and the equivalent scope thereof.

The invention described in the scope of claims at the beginning of the filing of the present application will be appended.
[Appendix 1]
Imaging means;
At least detection means for detecting a movement mode of a moving body that moves together with the imaging means;
Setting means for setting an effective pixel area in the imaging means having a size according to the movement mode detected by the detection means;
An image pickup apparatus comprising: a control unit configured to control to acquire an image in which the blur is reduced by moving the effective pixel region set by the setting unit when the blur occurs.
[Appendix 2]
The detection means detects the movement mode stepwise according to the degree of change,
The imaging apparatus according to claim 1, wherein the setting unit sets the effective pixel region to be smaller as the degree is larger.
[Appendix 3]
The imaging apparatus according to appendix 1 or 2, wherein a predetermined time difference is provided between the detection timing of the movement mode by the detection unit and the setting timing by the setting unit.
[Appendix 4]
The imaging device according to any one of appendices 1 to 3, wherein the detection unit detects, as the movement mode, a degree of vibration periodically applied to the imaging unit.
[Appendix 5]
An imaging control method for controlling an imaging apparatus including an imaging means,
At least a detection step of detecting a movement mode of a moving body that moves together with the imaging means;
A setting step for setting an effective pixel area in the imaging means having a size according to the movement mode detected by the detection step;
And a control step for controlling to acquire an image with reduced blur by moving the effective pixel region set in the setting step when blurring occurs.
[Appendix 6]
A computer for controlling an imaging apparatus including an imaging means;
At least detection means for detecting a movement mode of a moving body that moves together with the imaging means;
Setting means for setting an effective pixel area in the imaging means having a size corresponding to the movement mode detected by the detection means;
When blurring occurs, the program functions as control means for controlling to acquire an image with reduced blurring by moving the effective pixel area set by the setting means.

  DESCRIPTION OF SYMBOLS 1 ... Imaging device, 11 ... CPU, 12 ... ROM, 13 ... RAM, 14 ... Image processing part, 15 ... Bus, 16 ... Input / output interface, 17 ... Sensor unit, 18 ... imaging unit, 19 ... input unit, 20 ... output unit, 21 ... storage unit, 22 ... communication unit, 23 ... drive, 31 ... removable Media 51... Sensor information acquisition unit 52... Movement mode detection unit 53... Shake correction margin setting unit 54 54 Imaging control unit 55 55 Pixel acquisition control unit 56.・ Moving image acquisition unit, 71... Sensor information storage unit, 72... Blur correction margin table storage unit, 73... Blur correction margin information storage unit, 74. Part, 522... Amplitude deriving part

Claims (7)

Imaging means;
At least detection means for detecting a movement mode of a moving body that moves together with the imaging means;
Setting means for setting an effective pixel area in the imaging means having a size according to the movement mode detected by the detection means;
When blurring occurs, control means for controlling to acquire an image with reduced blurring by moving the effective pixel region set by the setting means;
Equipped with a,
An imaging apparatus , wherein a predetermined time difference is provided between a detection timing of a movement mode by the detection unit and a setting timing by the setting unit. Imaging means;
At least detection means for detecting a movement mode of a moving body that moves together with the imaging means;
Setting means for setting an effective pixel area in the imaging means having a size according to the movement mode detected by the detection means;
When blurring occurs, control means for controlling to acquire an image with reduced blurring by moving the effective pixel region set by the setting means;
With
The said detection means detects the degree of the vibration periodically given to the said imaging means as the said movement aspect, The imaging device characterized by the above-mentioned. The detection means detects the movement mode stepwise according to the degree of change,
The imaging apparatus according to claim 1, wherein the setting unit sets the effective pixel area to be smaller as the degree is higher. An imaging control method for controlling an imaging apparatus including an imaging means,
At least a detection step of detecting a movement mode of a moving body that moves together with the imaging means;
A setting step for setting an effective pixel area in the imaging means having a size according to the movement mode detected by the detection step;
When blurring occurs, a control step for controlling to acquire an image with reduced blurring by moving the effective pixel region set in the setting step;
Including
An imaging control method, comprising: providing a predetermined time difference between the detection timing of the movement mode in the detection step and the setting timing in the setting step. An imaging control method for controlling an imaging apparatus including an imaging means,
At least a detection step of detecting a movement mode of a moving body that moves together with the imaging means;
A setting step for setting an effective pixel area in the imaging means having a size according to the movement mode detected by the detection step;
When blurring occurs, a control step for controlling to acquire an image with reduced blurring by moving the effective pixel region set in the setting step;
Including
In the imaging control method, the detecting step detects, as the movement mode, a degree of vibration periodically applied to the imaging unit. A computer for controlling an imaging apparatus including an imaging means;
At least detection means for detecting a movement mode of a moving body that moves together with the imaging means;
Setting means for setting an effective pixel area in the imaging means having a size corresponding to the movement mode detected by the detection means;
When blurring occurs, control means for controlling to acquire an image with reduced blurring by moving the effective pixel area set by the setting means,
Function as
A program characterized in that a predetermined time difference is provided between the detection timing of the movement mode by the detection means and the setting timing by the setting means. A computer for controlling an imaging apparatus including an imaging means;
At least detection means for detecting a movement mode of a moving body that moves together with the imaging means;
Setting means for setting an effective pixel area in the imaging means having a size corresponding to the movement mode detected by the detection means;
When blurring occurs, control means for controlling to acquire an image with reduced blurring by moving the effective pixel area set by the setting means,
Function as
The said detection means detects the degree of the vibration given periodically to the said imaging means as the said movement aspect, The program characterized by the above-mentioned.

Images