JP2014145974A - Imaging apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To achieve adaptive focus control considering movement of an imaging surface in a direction orthogonal to an optical axis.SOLUTION: An image sensor 16 has an imaging surface irradiated with an optical image representing an imaged scene and repeatedly outputs live image data. A correlation value calculation circuit provided in a motion detection circuit 22 calculates, as correlation values, brightness differences between a representative pixel on live image data of a previous frame and a plurality of peripheral pixels on live image data of a current frame. A CPU 28 sets a step width of a focus lens 12 to W_S or W_L on the basis of the calculated correlation values and changes the position of the focus lens 12 by W_S or W_L at a time on the basis of live image data outputted from the image sensor 16.

Description

  The present invention relates to an imaging device, and more particularly, to an imaging device having a function of detecting a motion of an electronic image output from an imaging device.

  An example of this type of imaging device is disclosed in Patent Document 1. According to this background art, a motion vector indicating the motion of the imaging surface in the direction orthogonal to the optical axis is created based on the electronic image output from the imaging device. Whether or not the movement of the imaging surface is caused by the pan / tilt operation is determined based on the created motion vector, and activation / stop of the camera shake correction process is controlled based on the determination result.

JP 2009-239425 A

  However, in the background art, the amount of movement of the imaging surface in the direction orthogonal to the optical axis is not reflected in the AF processing. For this reason, the background art has a limit in AF performance.

  Therefore, a main object of the present invention is to provide an imaging apparatus capable of realizing adaptive focus control in consideration of the movement of the imaging surface in a direction orthogonal to the optical axis.

  An imaging device according to the present invention (10: reference numeral corresponding to the embodiment; the same applies hereinafter) has an imaging surface for capturing a scene through a focus lens (12), and repeatedly outputs an electronic image generated on the imaging surface. (16) calculating means for calculating a luminance difference between the representative pixel on the electronic image output in advance from the imaging means and each of a plurality of peripheral pixels on the electronic image output delayed from the imaging means ( 62), a changing unit (S11) for changing the distance from the focus lens to the imaging surface by a predetermined amount based on the electronic image output from the imaging unit, and a predetermined amount based on the luminance difference calculated by the calculating unit Adjustment means (S35 to S43, S5 to S9) for adjusting the height is provided.

  Preferably, first allocation means (60) for assigning a plurality of pixel blocks (SBK, SBK,...) Each having a representative pixel to the imaging surface is further provided, and the calculation means is a pixel block assigned by the first assignment means. The brightness difference is calculated every time.

  More preferably, a second allocation unit (48) for allocating a plurality of large pixel blocks to the imaging surface is further provided, and the plurality of pixel blocks form each of the plurality of large pixel blocks allocated by the second allocation unit.

  Preferably, the adjusting means is a characteristic means (S35 to S37) for specifying the correlation between the two electronic images noticed by the calculating means based on the luminance difference, and the predetermined amount is set when the correlation specified by the specifying means is high. Reduction means (S39, S43, S5 to S7) for reducing, and increase means (S39 to S41, S5, S9) for increasing the predetermined amount when the correlation specified by the specifying means is low are included.

  More preferably, the extraction means (36) for extracting a part of the electronic image belonging to the extraction area (EX) from the electronic image output from the imaging means, the movement of the imaging surface in the direction orthogonal to the optical axis is compensated. As described above, a change means (S21 to S25, S29) for changing the position of the extraction area and a restriction means (S27) for restricting the process of the change means in relation to the process of the increase means are further provided.

  More preferably, the changing means compensates the motion vector created by the creating means (S23 to S25) for creating a motion vector indicating the motion of the imaging surface based on the electronic image output from the imaging means, and the creating means. In this way, there is included arrangement adjustment means (S29) for adjusting the arrangement of the extraction areas.

  An imaging control program according to the present invention has an imaging surface for capturing a scene through a focus lens (12), and outputs the electronic image generated on the imaging surface repeatedly (16), and is output in advance from the imaging means. The processor of the imaging device (10), comprising a calculation means (62) for calculating a luminance difference between the representative pixel on the electronic image and each of a plurality of peripheral pixels on the electronic image output delayed from the imaging means ( 28), a change step (S11) for changing the distance from the focus lens to the imaging surface by a predetermined amount based on the electronic image output from the imaging means, and a predetermined amount based on the luminance difference calculated by the calculating means. It is an imaging control program for executing adjustment steps (S35 to S43, S5 to S9) for adjusting the size.

  The imaging control method according to the present invention has an imaging surface for capturing a scene through a focus lens (12), and repeatedly outputs an electronic image generated on the imaging surface (16), and is output in advance from the imaging means. Executed by an imaging device (10) comprising a calculation means (62) for calculating a luminance difference between the representative pixel on the electronic image and each of a plurality of peripheral pixels on the electronic image output delayed from the imaging means. A change step (S11) for changing the distance from the focus lens to the imaging surface by a predetermined amount based on the electronic image output from the imaging means, and the luminance difference calculated by the calculation means Adjustment steps (S35 to S43, S5 to S9) for adjusting the size of the predetermined amount.

  The external control program according to the present invention has an imaging surface for capturing a scene through the focus lens (12), and repeatedly outputs an electronic image generated on the imaging surface (16), which is output in advance from the imaging means. Calculation means (62) for calculating a luminance difference between the representative pixel on the electronic image and each of a plurality of peripheral pixels on the electronic image output delayed from the imaging means, and an internal stored in the memory (46) An external control program that is supplied to an imaging device (10) that includes a processor (28) that executes processing according to a control program, and sets a distance from the focus lens to the imaging surface based on an electronic image output from the imaging means A change step (S11) for changing by an amount and an adjustment step (S35 to S43, S5 to S9) for adjusting the size of the predetermined amount based on the luminance difference calculated by the calculation means in cooperation with the internal control program For execution by the processor Te, an external control program.

  An imaging device (10) according to the present invention has an imaging surface for capturing a scene through a focus lens (12), and repeatedly outputs an electronic image generated on the imaging surface (16). Calculating means (62) for calculating a luminance difference between the representative pixel on the electronic image and each of a plurality of peripheral pixels on the electronic image output delayed from the imaging means, and a capturing means for taking in the external control program ( 68), and an imaging device comprising a processor (28) for executing processing according to the external control program fetched by the fetching means and the internal control program stored in the memory (46), the electronic device output from the imaging means A change step (S11) for changing the distance from the focus lens to the imaging surface by a predetermined amount based on the image, and the size of the predetermined amount based on the luminance difference calculated by the calculation means Adjustment adjusting steps (S35 ~ S43, S5 ~ S9) corresponds to the internal control program in cooperation with a program to be executed.

  The distance from the focus lens to the imaging surface is changed by a predetermined amount based on the electronic image output from the imaging means. The size of the predetermined amount is a representative pixel on the preceding electronic image and a plurality of pixels on the subsequent electronic image. It adjusts based on the luminance difference between each of the peripheral pixels. Thereby, adaptive focus control in consideration of the movement of the imaging surface in the direction orthogonal to the optical axis is realized.

  The above object, other objects, features and advantages of the present invention will become more apparent from the following detailed description of embodiments with reference to the drawings.

It is a block diagram which shows the basic composition of one Example of this invention. It is a block diagram which shows the structure of one Example of this invention. It is an illustration figure which shows an example of the state which allocated the several motion detection block and the single extraction area to the imaging surface. It is an illustration figure which shows an example of camera shake correction operation | movement. 3 is a block diagram illustrating an example of a configuration of a motion detection circuit applied to the embodiment in FIG. 2; FIG. FIG. 6 is a block diagram showing an example of a configuration of a motion information creation circuit applied to the embodiment in FIG. 5. (A) is an illustration figure which shows an example of a structure of a motion detection block, (B) is an illustration figure which shows an example of a structure of a micro block. It is a flowchart which shows a part of operation | movement of CPU applied to the FIG. 2 Example. It is a flowchart which shows a part of other operation | movement of CPU applied to the FIG. 2 Example. FIG. 11 is a flowchart showing still another portion of behavior of the CPU applied to the embodiment in FIG. 2; It is a block diagram which shows the structure of another Example of this invention.

Embodiments of the present invention will be described below with reference to the drawings.
[Basic configuration]

  With reference to FIG. 1, the imaging device of this embodiment is basically configured as follows. The imaging unit 1 has an imaging surface for capturing a scene through the focus lens 5 and repeatedly outputs an electronic image generated on the imaging surface. The calculating unit 2 calculates a luminance difference between the representative pixel on the electronic image output in advance from the imaging unit 1 and each of a plurality of peripheral pixels on the electronic image output delayed from the imaging unit 1. . The changing unit 3 changes the distance from the focus lens 5 to the imaging surface by a predetermined amount based on the electronic image output from the imaging unit 1. The adjusting unit 4 adjusts the predetermined amount based on the luminance difference calculated by the calculating unit 2.

The distance from the focus lens 5 to the imaging surface is changed by a predetermined amount based on the electronic image output from the imaging means 1, and the size of the predetermined amount is the representative pixel on the preceding electronic image and the succeeding electronic image. Is adjusted based on the luminance difference between each of the plurality of peripheral pixels. Thereby, adaptive focus control in consideration of the movement of the imaging surface in the direction orthogonal to the optical axis is realized.
[Example]

  Referring to FIG. 2, the digital video camera 10 of this embodiment includes a focus lens 12 and an aperture unit 14 driven by drivers 18a and 18b, respectively. The optical image representing the imaging scene is irradiated on the imaging surface of the image sensor 16 through these members. The imaging surface is covered by a primary color Bayer array color filter (not shown). Therefore, in each pixel, a charge having color information of any one of R (Red), G (Green), and B (Blue) is generated by photoelectric conversion.

  When the power is turned on, the CPU 28 activates the driver 18c to execute the moving image capturing process. In response to the vertical synchronization signal Vsync generated every 1/60 seconds, the driver 18c exposes the imaging surface and reads out the charges generated on the imaging surface in a raster scanning manner. From the image sensor 16, raw image data representing an imaging scene is output at a frame rate of 60 fps.

  The preprocessing circuit 20 performs processing such as digital clamping, pixel defect correction, and gain control on the raw image data from the image sensor 16. The raw image data generated thereby is written into the raw image area 34 a of the SDRAM 34 through the memory control circuit 32.

  An extraction area EX is allocated to the imaging surface in the manner shown in FIG. The post-processing circuit 36 reads out part of the raw image data belonging to the extraction area EX from the raw image data stored in the raw image area 34a through the memory control circuit 32 every 1/60 seconds, and the read raw image The data is subjected to processing such as color separation, white balance adjustment, and YUV conversion. As a result, image data corresponding to the YUV format is created every 1/60 seconds. The created image data is written into the YUV image area 34 b of the SDRAM 34 through the memory control circuit 32.

  The LCD driver 38 repeatedly reads the image data stored in the YUV image area 34b, and drives the LCD monitor 40 based on the read image data. As a result, a real-time moving image (through image) representing the imaging scene is displayed on the monitor screen.

  The preprocessing circuit 20 executes simple Y generation processing in addition to the above processing, and simply converts raw image data into Y data. The converted Y data is supplied to the motion detection circuit 22, the AE evaluation circuit 24, and the AF evaluation circuit 26.

  Referring to FIG. 3, five motion detection blocks MD_1 to MD_5 are assigned to the imaging surface. The motion detection blocks MD_1 and MD_2 are arranged in the horizontal direction on the upper stage of the imaging plane, the motion detection block MD_3 is arranged in the center of the imaging plane, and the motion detection blocks MD_4 and MD_5 are arranged in the horizontal direction on the lower stage of the imaging plane. Arranged side by side.

  The motion detection circuit 22 detects the motion of the imaging scene in each of the motion detection blocks MD_1 to MD_5 every 1/60 seconds based on the Y data given from the preprocessing circuit 20, and motion information indicating the detected motion Is given to the CPU. The CPU 28 creates an overall motion vector based on the given motion information, and moves the extraction area EX along the created overall motion vector. The position of the extraction area EX is changed so that the movement of the imaging surface due to camera shake is compensated (cancelled). When camera shake occurs on the imaging surface, the extraction area EX moves on the imaging surface in the manner shown in FIG. 4, thereby suppressing camera shake.

  Such camera shake correction processing is permitted when the movement of the imaging surface in the direction orthogonal to the optical axis corresponds to camera shake, while the movement of the imaging surface in the direction orthogonal to the optical axis is used for the pan / tilt operation. Restricted at corresponding times. Whether to determine the cause of the movement of the imaging surface will be described later.

  Returning to FIG. 2, the AE evaluation circuit 24 integrates a part of Y data belonging to the evaluation area among the Y data output from the preprocessing circuit 20 every 1/60 seconds, and obtains an integration value, that is, a luminance evaluation value. Output. The CPU 28 calculates an appropriate EV value based on the luminance evaluation value output from the AE evaluation circuit 24, and sets the aperture amount and the exposure time that define the calculated appropriate EV value in the drivers 18b and 18c. As a result, the brightness of the moving image output from the LCD monitor 40 is adjusted appropriately.

  The AF evaluation circuit 26 integrates the high frequency components of some Y data belonging to the evaluation area (not shown) of the Y data output from the preprocessing circuit 20 every 1/60 seconds, and the integrated value, that is, focus evaluation. A value is given to the CPU. The CPU 28 executes AF processing (continuous AF processing) based on the given focus evaluation value, and moves the focus lens 12 in the direction where the in-focus point exists. The focus lens 12 is moved stepwise by the driver 18a. As a result, the sharpness of the moving image output from the LCD monitor 40 is continuously maintained.

  The single movement width, that is, the step width of the focus lens 12 is set to “W_S” in a period other than the period in which the pan / tilt operation is performed, while it is set to “W_L” in the period in which the pan / tilt operation is performed. Is set. Here, the step width W_L is larger than the step width W_S. Adaptive focus control in consideration of the movement of the imaging surface in the direction orthogonal to the optical axis is realized.

  When the movie button 30mv provided in the key input device 30 is operated, the CPU 28 activates the memory I / F 42 to start the recording process. The memory I / F 42 reads the image data stored in the YUV image area 34b every 1/60 seconds, and writes the read image data into a moving image file in the recording medium 44. The memory I / F 42 is stopped by the CPU 28 when the movie button 30mv is operated again. As a result, the image data recording process is completed.

  The motion detection circuit 22 is configured as shown in FIG. Since the raw image data is output from the image sensor 16 in a raster scanning manner, the Y data is also input to the motion detection circuit 22 in a raster scanning manner. The distributor 48 provides Y data belonging to each of the motion detection blocks MD_1 and MD_4 to the motion information creation circuit 50, provides Y data belonging to the motion detection block MD_3 to the motion information creation circuit 52, and motion detection blocks MD_2 and MD_5. Y data belonging to the motion information creation circuit 54 is provided.

  The motion information creation circuit 50 pays attention to the motion of the imaging scene captured by each of the motion detection blocks MD_1 and MD_4, and outputs the partial motion vector VC_1 and the minimum correlation value MIN_1 as motion information of the motion detection block MD_1. The motion vector VC_4 and the minimum correlation value MIN_4 are output as motion information of the motion detection block MD_4.

  The motion information creation circuit 52 pays attention to the motion of the imaging scene captured by the motion detection block MD_3, and outputs the partial motion vector VC_3 and the minimum correlation value MIN_3 as motion information of the motion detection block MD_3.

  The motion information creation circuit 54 pays attention to the motion of the imaging scene captured by each of the motion detection blocks MD_2 and MD_5, and outputs the partial motion vector VC_2 and the minimum correlation value MIN_2 as motion information of the motion detection block MD_2. The motion vector VC_5 and the minimum correlation value MIN_5 are output as motion information of the motion detection block MD_5.

  The entire motion vector is created based on the partial motion vectors VC_1 to VC_5 among the motion information output from the motion information creation circuits 50 to 54. Specifically, the entire motion vector is created by combining the partial motion vectors VC_1 to VC_5. The camera shake correction process is executed with reference to the overall motion vector thus created.

  Further, the cause of the movement of the imaging surface in the direction orthogonal to the optical axis is determined based on the minimum correlation values MIN_1 to MIN_5 that form the movement information. Specifically, the average value of the minimum correlation values MIN_1 to MIN_5 is calculated as the average correlation value AV, the calculated average correlation value AV is compared with the reference value REF, and the cause of the movement of the imaging surface is determined according to the comparison result. Determined.

  As will be described later, the minimum correlation values MIN_1 to MIN_5 and the average correlation value AV increase as the amount of motion of the imaging surface in the direction orthogonal to the optical axis increases. Therefore, if the average correlation value AV is greater than or equal to the reference value REF, it is determined that the cause of the movement of the imaging surface is pan / tilt operation, and if the average correlation value AV is less than the reference value REF, the cause of the movement of the imaging surface is It is determined that the camera shake has occurred.

  Each of the motion information creation circuits 50 to 54 is configured as shown in FIG. The Y data is subjected to noise removal processing by the LPF 56 and is then supplied to the representative point memory 58 and the correlation value calculation circuit 62. Referring to FIG. 7A, each of motion detection blocks MD_1 to MD_5 is formed by P × Q minute blocks SBK, SBK,. Also, referring to FIG. 7B, each micro block SBK is formed by p × q pixels.

  The arrangement of the minute blocks SBK, SBK,... Is registered in the register 60. “P”, “Q”, “p”, and “q” all correspond to integers of 2 or more. Hereinafter, a pixel present at the center of each micro block SBK, that is, a pixel indicated by a black circle in FIGS. 7A and 7B is defined as a “representative pixel”.

  Returning to FIG. 6, the representative point memory 58 extracts Y data of P × Q representative pixels from the Y data belonging to the motion detection block MD_N (N: any one of 1 to 5), and the extracted Y data Remember. The correlation value calculation circuit 62 corresponds to each of the P × Q minute blocks SBK, SBK,... Belonging to the motion detection block MD_N and the Y data value of the representative pixel of the previous frame stored in the representative point memory 58. A difference from the Y data value of each pixel of the current frame given from the LPF 56 is calculated as a correlation value. As a result, P × Q × p × q correlation values are output from the correlation value calculation circuit 60 corresponding to the motion detection block MD_N. Each of the output P × Q × p × q correlation values is accompanied by pixel position information indicating the positions of two pixels that are the basis for calculating the correlation value.

  The minimum value calculation circuit 64 extracts the minimum value from the P × Q × p × q correlation values, and outputs the extracted minimum value as the minimum correlation value MIN_N. The minimum correlation value MIN_N increases when a motion occurs in the motion detection block MD_N. Therefore, by paying attention to the minimum correlation value MIN_N, it is possible to determine whether or not a motion has occurred in the imaging scene.

  The partial motion vector creation circuit 66 creates a partial motion vector VC_N based on pixel position information associated with the minimum correlation value MIN_N. The created partial motion vector VC_N is a vector having a pixel of the previous frame as a starting point and a pixel of the current frame as an end point among two pixels indicated by the pixel position information. When the pixel of the current frame is a pixel indicated by hatching in FIG. 7B, the partial motion vector VC_N indicates a direction and a size indicated by an arrow in FIG. 7B.

  The CPU 28 processes in parallel a plurality of tasks including a moving image capturing task shown in FIG. 8, a camera shake correction task shown in FIG. 9, and a pan / tilt discrimination task shown in FIG. Note that control programs corresponding to these tasks are stored in the flash memory 46.

  Referring to FIG. 8, a moving image capturing process is executed in step S1, and an AE process is executed in step S3. As a result of the processing in step S1, a through image is displayed on the LCD monitor 40. Further, as a result of the processing in step S3, the brightness of the through image is appropriately adjusted.

  In step S5, it is determined whether or not the flag FLGpt indicates “0”. If the determination result is YES, it is considered that no pan / tilt operation has occurred, and the step width is set to “W_S” in step S7. On the other hand, if the determination result is NO, it is considered that a pan / tilt operation has occurred, and the step width is set to “W_L” in step S9.

  When the setting of the step width is completed, AF processing (continuous AF processing) is executed in step S11. As a result of the processing in step S11, the focus lens 12 moves by one step in the direction in which the focal point exists. The movement width corresponds to the step width set in step S7 or S9. This improves the sharpness of the live view image.

  In step S13, it is determined whether or not the movie button 30mv has been operated. If the determination result is NO, the process returns to step S3, whereas if the determination result is YES, the process proceeds to step S15. In step S15, it is determined whether or not the recording process is being executed. If the determination result is NO, the memory I / F 42 is commanded to start the recording process in step S17. If the determination result is YES, step S19 is performed. The memory I / F 42 is commanded to stop the recording process. When the process of step S17 or S19 is completed, the process returns to step S3.

  Referring to FIG. 9, in step S21, it is repeatedly determined whether or not the vertical synchronization signal Vsync is generated. When the determination result is updated from NO to YES, the process proceeds to step S23, and the partial motion vectors VC_1 to VC_5 are fetched from the motion detection circuit 22. In step S25, an overall motion vector is created based on the captured partial motion vectors VC_1 to VC_5.

  In step S27, it is determined whether or not the flag FLGpt is “0”. If the determination result is NO, it is considered that a pan / tilt operation has occurred, and the process returns to step S21. On the other hand, if the determination result is YES, it is considered that no pan / tilt operation has occurred, and the process proceeds to step S29. In step S29, the extraction area EX is moved along the entire motion vector created in step S25. When the process of step S29 is completed, the process returns to step S21.

  Referring to FIG. 10, in step S31, the flag FLGpt is set to “0”, and in step S33, it is repeatedly determined whether or not the vertical synchronization signal Vsync has been generated. When the determination result is updated from NO to YES, the process proceeds to step S35, and the minimum correlation values MIN_1 to MIN_5 are fetched from the motion detection circuit 22.

  In step S37, the average correlation value AV is calculated by averaging the acquired minimum correlation values MIN_1 to MIN_5. In step S39, it is determined whether or not the calculated average correlation value AV is equal to or greater than the reference value REF. If the determination result is YES, it is considered that a pan / tilt operation has occurred, and the flag FLGpt is set to “1” in a step S41. On the other hand, if the determination result is NO, it is considered that no pan / tilt operation has occurred, and the flag FLGpt is set to “0” in step S43. When the process of step S41 or S43 is completed, the process returns to step S33.

  As can be seen from the above description, the image sensor 16 has an imaging surface on which an optical image representing an imaging scene is irradiated, and repeatedly outputs raw image data. The correlation value calculation circuit 62 provided in the motion detection circuit 22 uses a luminance difference between the representative pixel on the raw image data of the previous frame and each of a plurality of peripheral pixels on the raw image data of the current frame as a correlation value. calculate. The CPU 28 sets the step width of the focus lens 12 to “W_S” or “W_L” based on the calculated correlation value (S35 to S43, S5 to S9), and based on the raw image data output from the image sensor 16. The position of the focus lens 12 is changed by “W_S” or “W_L” (S11).

  The distance from the focus lens 12 to the imaging surface is changed step by step based on the raw image data output from the image sensor 16, and the step width is the representative pixel on the raw image data of the previous frame and the current frame. Is adjusted based on the luminance difference between each of the plurality of peripheral pixels on the raw image data. Thereby, adaptive focus control in consideration of the movement of the imaging surface in the direction orthogonal to the optical axis is realized.

  In this embodiment, the step width is set to “W_S” when the flag FLGpt indicates “0”, and the step width is set to “W_L” when the flag FLGpt indicates “1”. . However, the step width may be set to “W_L” when the flag FLGpt indicates “0”, and the step width may be set to “W_S” when the flag FLGpt indicates “1”.

  In this embodiment, the multitask OS and control programs corresponding to a plurality of tasks executed thereby are stored in the flash memory 46 in advance. However, as shown in FIG. 11, a communication I / F 68 is provided in the digital camera 10, and some control programs are prepared as internal control programs in the flash memory 46 from the beginning, while some other control programs are prepared as external control programs. May be acquired from an external server. In this case, the above-described operation is realized by cooperation of the internal control program and the external control program.

  Furthermore, in this embodiment, the processing executed by the CPU 28 is divided into a plurality of tasks as described above. However, each task may be further divided into a plurality of small tasks, and a part of the divided plurality of small tasks may be integrated with other tasks. Further, when each task is divided into a plurality of small tasks, all or part of the tasks may be acquired from an external server.

DESCRIPTION OF SYMBOLS 10 ... Digital video camera 16 ... Image sensor 20 ... Pre-processing circuit 22 ... Motion detection circuit 28 ... CPU
34 ... SDRAM
36: Post-processing circuit 46: Flash memory

Claims (10)

An imaging unit having an imaging surface for capturing a scene through a focus lens, and repeatedly outputting an electronic image generated on the imaging surface;
Calculating means for calculating a luminance difference between a representative pixel on the electronic image output in advance from the imaging means and each of a plurality of peripheral pixels on the electronic image output delayed from the imaging means;
A changing unit that changes a distance from the focus lens to the imaging surface by a predetermined amount based on an electronic image output from the imaging unit; and a size of the predetermined amount based on a luminance difference calculated by the calculating unit. An imaging device comprising adjustment means for adjusting First assigning means for assigning a plurality of pixel blocks each having the representative pixel to the imaging surface;
The imaging apparatus according to claim 1, wherein the calculation unit calculates the luminance difference for each pixel block allocated by the first allocation unit. A second assigning means for assigning a plurality of large pixel blocks to the imaging surface;
The imaging device according to claim 2, wherein the plurality of pixel blocks form each of a plurality of large pixel blocks allocated by the second allocation unit.   The adjusting means is a characteristic means for specifying the correlation between the two electronic images noticed by the calculating means based on the luminance difference, and a reduction for reducing the predetermined amount when the correlation specified by the specifying means is high. The imaging apparatus according to claim 1, further comprising: an increase unit configured to increase the predetermined amount when the correlation specified by the specifying unit is low. Extraction means for extracting a part of the electronic image belonging to the extraction area from the electronic image output from the imaging means;
Changing means for changing the position of the extraction area so that the movement of the imaging surface in a direction orthogonal to the optical axis is compensated; and limiting means for restricting the processing of the changing means in relation to the processing of the increasing means The imaging device according to claim 4, further comprising:   The changing unit creates a motion vector indicating the motion of the imaging surface based on the electronic image output from the imaging unit, and the extraction so that the motion vector created by the creating unit is compensated The imaging apparatus according to claim 5, further comprising arrangement adjusting means for adjusting the arrangement of the area. An imaging unit having an imaging surface for capturing a scene through a focus lens, and repeatedly outputting an electronic image generated on the imaging surface; a representative pixel on the electronic image output in advance from the imaging unit; and the imaging unit In a processor of an imaging device including a calculation unit that calculates a luminance difference between each of a plurality of peripheral pixels on an electronic image output with a delay,
A changing step of changing a distance from the focus lens to the imaging surface by a predetermined amount based on an electronic image output from the imaging unit; and a size of the predetermined amount based on a luminance difference calculated by the calculating unit The imaging control program for performing the adjustment step which adjusts. An imaging unit having an imaging surface for capturing a scene through a focus lens, and repeatedly outputting an electronic image generated on the imaging surface; a representative pixel on the electronic image output in advance from the imaging unit; and the imaging unit An imaging control method executed by an imaging device including a calculation unit that calculates a luminance difference between each of a plurality of peripheral pixels on a delayed electronic image,
A changing step of changing a distance from the focus lens to the imaging surface by a predetermined amount based on an electronic image output from the imaging unit; and a size of the predetermined amount based on a luminance difference calculated by the calculating unit An imaging control method, comprising an adjustment step for adjusting. An imaging unit having an imaging surface for capturing a scene through a focus lens, and repeatedly outputting an electronic image generated on the imaging surface;
A calculating means for calculating a luminance difference between a representative pixel on the electronic image output in advance from the imaging means and each of a plurality of peripheral pixels on the electronic image output delayed from the imaging means; and a memory An external control program supplied to an imaging device including a processor that executes processing according to the internal control program stored in
A changing step of changing a distance from the focus lens to the imaging surface by a predetermined amount based on an electronic image output from the imaging unit; and a size of the predetermined amount based on a luminance difference calculated by the calculating unit An external control program for causing the processor to execute an adjustment step for adjusting the value in cooperation with the internal control program. An imaging unit having an imaging surface for capturing a scene through a focus lens, and repeatedly outputting an electronic image generated on the imaging surface;
Calculating means for calculating a luminance difference between a representative pixel on the electronic image output in advance from the imaging means and each of a plurality of peripheral pixels on the electronic image output delayed from the imaging means;
An imaging device comprising: a capturing unit that captures an external control program; and a processor that executes processing according to the external control program captured by the capturing unit and an internal control program stored in a memory,
A changing step of changing a distance from the focus lens to the imaging surface by a predetermined amount based on an electronic image output from the imaging unit; and a size of the predetermined amount based on a luminance difference calculated by the calculating unit An imaging apparatus corresponding to a program that executes an adjustment step for adjusting the image in cooperation with the internal control program.

Images