JP2009207063A - Video camera - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To enhance the precision of adjustment of an imaging condition to improve the quality of an output image. <P>SOLUTION: An image sensor 16 has an imaging face on which an optical image in a field is projected, and repeatedly outputs a field image generated on the imaging face. An LCD driver 38 displays a moving image on an LCD monitor 40, based on a partial field image belonging to an extraction area EX among field images output from the image sensor 16. A CPU 28 adjusts an imaging condition, based on a partial field image belonging to an evaluation area EA of the field image output from the image sensor 16. The CPU 28 also detects the move of the imaging face in the direction perpendicular to the optical axis. Further, the CPU 28 moves the extraction area EX in response to a detected move, thus moves the evaluation area EA in relation with the process of moving the extraction area EX. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a video camera, and more particularly to a video camera that adjusts imaging conditions based on an object scene image generated on an imaging surface.

An example of this type of device is disclosed in Patent Document 1. According to this background art, a high frequency component of a video signal is extracted by a high pass filter. The gate circuit extracts a high-frequency component belonging to the AF area from the extracted high-frequency components, and the focus detection circuit detects focus information for focus adjustment based on the extracted high-frequency components.
JP-A-5-236327

  However, in the background art, the position of the AF area is not changed according to the camera shake on the imaging surface, and the quality of the output image is limited.

  Therefore, a main object of the present invention is to provide a video camera capable of improving the quality of an output image.

  The video camera according to the present invention (10: reference numeral corresponding to the embodiment; the same applies hereinafter) has an imaging surface on which an optical image of the object scene is irradiated, and repeatedly outputs the object scene image generated on the imaging surface. Imaging means (16), display means (38, 40) for displaying a moving image based on a partial scene image belonging to the first designated area among the scene images output from the imaging means, and output from the imaging means Adjusting means (S3, S7, S9, S15, S17) for adjusting the imaging condition based on the partial object scene image belonging to the second designated area among the received object scene images, the image pickup surface in the direction orthogonal to the optical axis Detection means (S33) for detecting the movement of the first movement means, first movement means (S39) for moving the first designated area corresponding to the movement detected by the detection means, and movement processing of the first movement means. 2 A second moving means (S41, S43) for moving the designated area is provided.

  The imaging unit has an imaging surface on which an optical image of the object scene is irradiated, and repeatedly outputs the object scene image generated on the imaging surface. The display means displays a moving image based on a partial scene image belonging to the first designated area among the scene images output from the imaging means. The adjusting unit adjusts the imaging condition based on the partial scene image belonging to the second designated area among the scene images output from the imaging unit. The movement of the imaging surface in the direction orthogonal to the optical axis is detected by the detection means. The first designated area is moved by the first moving means in response to the movement detected by the detecting means. The second designated area is moved by the second moving means in association with the moving process of the first moving means.

  Accordingly, the second designated area that is referred to for adjustment of the imaging condition moves so as to follow the first designated area that is referred to for output of the moving image. Thereby, the adjustment accuracy of the imaging condition is improved, and the quality of the output image is improved.

  Preferably, the second moving means predicts a future movement of the imaging surface based on the movement detected by the detecting means, and a second designated area corresponding to the movement predicted by the prediction means. Includes area moving means (S43). This improves the followability of the second designated area.

  More preferably, the imaging unit performs an exposure operation of a focal plane electronic shutter system, and the detection unit allocates a plurality of blocks arranged in the vertical direction in the object scene image output from the imaging unit (50 to 56), And motion vector generation means (58-74) for individually generating motion vectors of a plurality of block images belonging to the plurality of blocks assigned by the assignment means, and the prediction means includes a plurality of motions generated by the motion vector generation means Predict future movement of the imaging surface based on the vector.

  More preferably, the number of blocks assigned in the vertical direction by the assigning unit is determined based on the imaging period of the imaging unit and the vibration frequency of the imaging surface.

  Preferably, writing means (20) for writing the object scene image output from the imaging means to the memory, and a partial object scene image belonging to the first designated area among the object scene images stored in the memory by the writing means. A reading means (38) for reading for display processing of the display means is further provided.

  An imaging control program according to the present invention has an imaging surface on which an optical image of a scene is illuminated, an imaging means (16) that repeatedly outputs the scene image, and an image of the scene image output from the imaging means Of these, the scene output from the imaging means to the processor (28) of the video camera (10) provided with the display means (38, 40) for displaying a moving image based on the partial scene image belonging to the first designated area. An adjustment step (S3, S7, S9, S15, S17) for adjusting the imaging condition based on the partial object scene image belonging to the second designated area in the image, and detecting the movement of the imaging surface in the direction orthogonal to the optical axis A detection step (S33, S35), a first movement step (S39) for moving the first designated area corresponding to the movement detected in the detection step, and a second designated area in relation to the movement process of the first movement step. For moving the second movement step (S41, S43) , An imaging control program.

  The imaging control method according to the present invention has an imaging surface on which an optical image of the object scene is irradiated, an image pickup means (16) that repeatedly outputs the object scene image, and an object scene image output from the image pickup means. An imaging control method executed by a video camera (10) including display means (38, 40) for displaying a moving image based on a partial scene image belonging to the first designated area, which is output from the imaging means Adjustment step (S3, S7, S9, S15, S17) for adjusting the imaging condition based on the partial object scene image belonging to the second designated area of the object scene image, the imaging surface in the direction orthogonal to the optical axis In relation to the detection steps (S33, S35) for detecting movement, the first movement step (S39) for moving the first designated area corresponding to the movement detected in the detection step, and the movement process of the first movement step The second movement step (S41, S43) to move the second designated area Obtain.

  According to the present invention, the second designated area that is referred to for adjustment of the imaging condition moves so as to follow the first designated area that is referred to for output of the moving image. Thereby, the adjustment accuracy of the imaging condition is improved, and the quality of the output image is improved.

  The above object, other objects, features and advantages of the present invention will become more apparent from the following detailed description of embodiments with reference to the drawings.

  Referring to FIG. 1, a digital video camera 10 of this embodiment includes an optical lens 12 and an aperture unit 14. The optical image of the object scene is irradiated on the imaging surface of the CMOS image sensor 16 through these members. The imaging surface is covered by a primary color Bayer array color filter (not shown). Therefore, in each pixel, a charge having color information of any one of R (Red), G (Green), and B (Blue) is generated by photoelectric conversion.

  When the power is turned on, the CPU 28 activates the driver 18 to execute the moving image capturing process. In response to the vertical synchronization signal Vsync generated every 1/60 seconds, the driver 18 exposes the imaging surface by a focal plane electronic shutter method (a method in which the exposure timing differs depending on the horizontal pixel row), and is generated on the imaging surface. The charge is read out in a raster scanning manner. From the image sensor 16, raw image data representing the object scene is output at a frame rate of 60 fps.

  The preprocessing circuit 20 performs processing such as digital clamping, pixel defect correction, and gain control on the raw image data from the image sensor 16. The raw image data generated thereby is written into the raw image area 34a (see FIG. 4) of the SDRAM 34 through the memory control circuit 32.

  An extraction area EX is allocated to the imaging surface in the manner shown in FIG. The post-processing circuit 36 reads a part of the raw image data belonging to the extraction area EX from the raw image data stored in the raw image area 24a through the memory control circuit 32 every 1/60 seconds, and the read raw image The data is subjected to processing such as color separation, white balance adjustment, and YUV conversion. As a result, image data corresponding to the YUV format is created every 1/60 seconds. The created image data is written into the YUV image area 34b (see FIG. 4) of the SDRAM 34 through the memory control circuit 32.

  The LCD driver 38 repeatedly reads the image data stored in the YUV image area 34b, and drives the LCD monitor 40 based on the read image data. As a result, a real-time moving image (through image) representing the scene is displayed on the monitor screen.

  The preprocessing circuit 20 executes a simple Y generation process and a simple RGB generation process in addition to the above-described processes. The raw image data is converted into Y data by a simple Y conversion process, and converted into RGB data (data in which each pixel has all color information of R, G, and B) by a simple RGB conversion process. The Y data generated by the simple Y conversion process is supplied to the motion detection circuit 22 and the AF evaluation circuit 24, and the RGB data generated by the simple RGB conversion process is supplied to the AE / AWB evaluation circuit 26.

Referring to FIG. 2, nine motion detection blocks MD1 to MD9 are assigned to the imaging surface. The motion detection blocks MD1 to MD3 are arranged horizontally in the upper stage of the imaging surface, the motion detection blocks MD4 to MD6 are arranged horizontally in the interruption of the imaging surface, and the motion detection blocks MD7 to MD9 are arranged horizontally in the lower stage of the imaging surface. . The minimum number of motion detection blocks to be allocated in the vertical direction is determined according to Equation 1.
[Equation 1]
MN = TM × SF × α
MN: Minimum number of motion detection blocks to be assigned in the vertical direction TM: Imaging period (generation period of the vertical synchronization signal Vsync)
SF: imaging surface vibration frequency α: constant (= 18)

  According to Equation 1, the minimum number of motion detection blocks to be assigned in the vertical direction can be obtained by multiplying the multiplication value of the imaging period and the vibration frequency of the imaging surface by a constant α. Here, the vibration frequency of the imaging surface corresponds to the hand vibration frequency (= about 10 Hz) of the operator. Therefore, if the imaging cycle is “1/60 seconds” as in this embodiment, the minimum number of motion detection blocks to be assigned in the vertical direction is “3”. If the imaging cycle is “1/30 seconds”, the minimum number of motion detection blocks to be assigned in the vertical direction is “6”.

  The motion detection circuit 22 detects a partial motion vector representing the motion of the object scene in each of the motion detection blocks MD1 to MD9 based on the Y data given from the preprocessing circuit 20 every 1/60 seconds. The motion detection circuit 22 also combines the partial motion vectors of the motion detection blocks MD1 to MD3 to generate a combined motion vector UVC every 1/60 seconds, and combines and combines the partial motion vectors of the motion detection blocks MD4 to MD6. A motion vector MVC is generated every 1/60 seconds, and the combined motion vectors LVC are generated every 1/60 seconds by synthesizing the partial motion vectors of the motion detection blocks MD7 to MD9.

  The composite motion vector UVC represents the motion of the scene on the upper stage of the imaging surface, the composite motion vector MVC represents the motion of the scene on the interruption of the imaging surface, and the composite motion vector LVC represents the scene of the scene on the lower stage of the imaging surface. Represents the movement.

  The CPU 28 creates an overall motion vector based on the combined motion vectors UVC, MVC, and LVC output from the motion detection circuit 22, and the movement of the imaging surface in the direction orthogonal to the optical axis is either a camera shake or a pan / tilt operation. Whether it is caused or not is discriminated based on the entire motion vector, and the extraction area EX is moved along the entire motion vector when the motion of the imaging surface is caused by camera shake. The position of the extraction area EX is changed so that the movement of the imaging surface due to camera shake is compensated (cancelled). The extraction area EX moves on the imaging surface in the manner shown in FIG. 5A when camera shake occurs on the imaging surface.

  Referring to FIG. 3, an evaluation area EA is assigned to the imaging surface. The evaluation area EA is divided into eight in each of the vertical direction and the horizontal direction, and is formed by a total of 64 partial evaluation areas. Coordinate values (X, Y) = (1, 1) to (8, 8) are assigned to the 64 partial evaluation areas.

  The AF evaluation circuit 24 pays attention to the Y data belonging to each partial evaluation area among the Y data output from the preprocessing circuit 20, and sets the high frequency component of the noticed Y data in 1/60 seconds in each of the horizontal direction and the vertical direction. Integrate every time. As a result, 64 integral values HIh (1,1) to HIh (8,8) related to the high-frequency component in the horizontal direction are obtained corresponding to the 64 partial evaluation areas (1,1) to (8,8). 64 integrated values HIv (1,1) to HIv (8,8) related to the high frequency component in the vertical direction are obtained corresponding to the 64 partial evaluation areas (1,1) to (8,8). . The CPU 28 executes so-called continuous AF processing based on these integrated values output from the AF evaluation circuit 24, and places the optical lens 12 at the focal point.

  The AE / AWB evaluation circuit 24 pays attention to the RGB data belonging to each partial evaluation area among the RGB data output from the preprocessing circuit 20, and converts each of the R data, G data, and B data to be noticed every 1/60 seconds. Integrate into. As a result, 64 integral values Ir (1,1) to Ir (8,8) related to the R data are obtained corresponding to the 64 partial evaluation areas (1,1) to (8,8). 64 integral values Ig (1,1) to Ig (8,8) for data are obtained corresponding to 64 partial evaluation areas (1,1) to (8,8), and 64 for B data. The integral values Ib (1,1) to Ib (8,8) are obtained corresponding to the 64 partial evaluation areas (1,1) to (8,8).

  Based on these integrated values output from the AE / AWB evaluation value, the CPU 28 calculates an EV value for obtaining an appropriate exposure amount and a white balance adjustment gain for obtaining an appropriate white balance. Further, the CPU 28 sets the aperture amount and the exposure time that define the calculated EV value in the aperture unit and the driver 18, and sets the calculated white balance adjustment gain in the post-processing circuit 36. As a result of executing the AE process and the AWB process, the brightness and white balance of the moving image output from the LCD monitor 40 are appropriately adjusted.

  As described above, the extraction area EX is moved so that camera shake on the imaging surface is compensated. Nevertheless, if the evaluation area EA is fixed at the position shown in FIG. 3, the subject at a position outside the extraction area EX may affect the above-described adjustment operation of the imaging condition. Therefore, in this embodiment, the evaluation area EA is also moved in association with the movement process of the extraction area EX. The evaluation area EA moves as shown in FIG. 5B following the extraction area EX, thereby improving the adjustment accuracy of the imaging conditions.

  However, since the raw image data output from the pre-processing circuit 20 is temporarily stored in the SDRAM 34, a one-frame grace period is provided for the movement of the extraction area EX by the post-processing circuit 36. Since the AF evaluation circuit 24 and the AE / AWB evaluation circuit 26 focus on the same frame as the frame on which the motion detection circuit 22 focuses on at the same timing as the timing on which the motion detection circuit 22 focuses on, the AF evaluation circuit 24 and the AE / AWB evaluation circuit There is no such grace period for 26 operations.

Therefore, the CPU 28 predicts the next frame, that is, the future global motion vector based on the synthesized motion vectors UVC, MVC, and LVC output from the motion detection circuit 22 according to the equations 2 and 3, and follows the predicted global motion vector. The evaluation area EA is moved.
[Equation 2]
EVCx = 2 * LVCx− (ΔUMx * α + ΔMLx) / 2
EVCx: predicted horizontal component of overall motion vector LVCx: horizontal component of combined motion vector LVC ΔUMx: difference between horizontal components of combined motion vector UVC and MVC ΔMLx: difference between horizontal components of combined motion vectors MVC and LVC α: constant [ Equation 3]
EVCy = 2 * LVCy− (ΔUMy * β + ΔMLy) / 2
EVCy: predicted vertical component of the entire motion vector LVCy: vertical component of the combined motion vector LVC ΔUMy: difference between the vertical components of the combined motion vector UVC and MVC ΔMLy: difference between the vertical components of the combined motion vectors MVC and LVC β: constant

  Therefore, when the horizontal components of the combined motion vectors UVC, MVC, and LVC change in the manner shown in the upper part of FIG. 6A, the horizontal component of the entire motion vector is predicted in the manner shown in the lower part of FIG. . When the vertical components of the combined motion vectors UVC, MVC, and LVC change in the manner shown in the upper part of FIG. 6B, the vertical component of the entire motion vector is predicted in the manner shown in the lower part of FIG. . Thereby, the followability of the evaluation area EA with respect to the extraction area EX is improved.

  When a recording start operation is performed by the key input device 30, the CPU 28 activates the I / F 42 to start the recording process. The I / F 42 reads the image data stored in the YUV image area 34b every 1/60 seconds, and writes the read image data to the moving image file in the recording medium 44 in a compressed state. The I / F 42 is stopped by the CPU 28 when a recording end operation is performed on the key input device 30. As a result, the image data recording process is completed.

  The motion detection circuit 22 is configured as shown in FIG. The Y data is given to the frame memory 48 and the distributor 50. The frame memory 48 is formed by two banks each having a capacity corresponding to one frame, and the supplied Y data is alternately written into the two banks.

  Distributor 50 provides Y data belonging to motion detection blocks MD1, MD4 and MD7 to distributor 52, Y data belonging to motion detection blocks MD2, MD5 and MD8 to distributor 54, and motion detection blocks MD3, MD6. Y data belonging to MD9 is applied to the distributor 56.

  The distributor 52 gives Y data belonging to the motion detection block MD1 to the partial motion vector detection circuit 58, gives Y data belonging to the motion detection block MD4 to the partial motion vector detection circuit 64, and Y data belonging to the motion detection block MD7. Is supplied to the partial motion vector detection circuit 70. The distributor 54 provides Y data belonging to the motion detection block MD2 to the partial motion vector detection circuit 60, Y data belonging to the motion detection block MD5 to the partial motion vector detection circuit 66, and Y data belonging to the motion detection block MD8. Is given to the partial motion vector detection circuit 72. The distributor 56 gives Y data belonging to the motion detection block MD3 to the partial motion vector detection circuit 62, gives Y data belonging to the motion detection block MD6 to the partial motion vector detection circuit 68, and Y data belonging to the motion detection block MD9. Is supplied to the partial motion vector detection circuit 74.

  Each of the partial motion vector detection circuits 58 to 74 compares the Y data supplied from the distributor 52, 54 or 56 with the Y data of the previous frame stored in the frame memory 48, and compares the Y data supplied from the distributor 52, 54 or 56 with the target motion detection block. A partial motion vector representing the motion of the scene is detected. As a result, nine partial motion vectors respectively corresponding to the motion detection blocks MD1 to MD9 are obtained.

  The combined motion vector generation circuit 76 combines the three partial motion vectors detected by the partial motion vector detection circuits 58, 60 and 62, respectively, and generates a combined motion vector UVC representing the motion of the object scene on the upper stage of the imaging surface. To do. The combined motion vector generation circuit 78 combines the three partial motion vectors detected by the partial motion vector detection circuits 64, 66 and 68, respectively, and generates a combined motion vector MVC representing the motion of the object scene in the middle stage of the imaging surface. To do. The combined motion vector generation circuit 80 combines the three partial motion vectors detected by the partial motion vector detection circuits 70, 72, and 74, respectively, and generates a combined motion vector LVC representing the motion of the object scene on the lower stage of the imaging surface. To do.

  The AF evaluation circuit 24 is configured as shown in FIG. The HPF 82 extracts the high frequency component in the horizontal direction of the Y data supplied from the preprocessing circuit 20, and the HPF 92 extracts the high frequency component in the vertical direction of the Y data supplied from the preprocessing circuit 20. The integration circuits 8601 to 8664 respectively correspond to the 64 partial evaluation areas (1, 1) to (8, 8) described above, and the integration circuits 9601 to 9664 also correspond to the 64 partial evaluation areas (1, 1) to (64) described above. (8, 8) respectively.

  The distributor 84 takes in the high-frequency component extracted by the HPF 82, specifies a partial evaluation area to which the taken-in high-frequency component belongs, and supplies the taken-in high-frequency component to the integration circuit corresponding to the specified partial evaluation area. The distributor 92 also takes in the high-frequency component extracted by the HPF 94, specifies the partial evaluation area to which the taken-in high-frequency component belongs, and applies the taken-in high-frequency component to the integration circuit corresponding to the specified partial evaluation area. . Each of the distributors 84 and 94 is given a coordinate value indicating the upper left coordinate of the evaluation area EA shown in FIG. Each of the distributors 84 and 94 performs a partial evaluation area specifying process with reference to the coordinate values.

  The integrating circuit 86 ** (**: 01 to 64) is formed by an adder 88 ** and a register 90 **. The adder 88 ** adds the Y data value given from the distributor 84 with the set value of the register 90 **, and sets the added value in the register 88 **. The integrating circuit 96 ** is also formed by the adder 98 ** and the register 100 **. The adder 98 ** adds the Y data value given from the distributor 94 to the set value of the register 100 **, and sets the added value in the register 98 **. The set values of the registers 88 ** and 100 ** are cleared every time the vertical synchronization signal Vsync is generated.

  Therefore, the set value of register 90 ** represents the integral value of the high frequency component in the horizontal direction of the Y data belonging to each divided evaluation area of the current frame. The set value of the register 100 ** represents the integral value of the high frequency component in the vertical direction of the Y data belonging to each divided evaluation area of the current frame.

  The AE / AWB evaluation circuit 26 is configured as shown in FIG. The R data, G data, and B data supplied from the preprocessing circuit 20 are supplied to the distributors 102, 110, and 118, respectively. The integration circuits 10401 to 10464 correspond to 64 partial evaluation areas (1, 1) to (8, 8), respectively, and the integration circuits 111201 to 11264 also correspond to 64 partial evaluation areas (1, 1) to (8, 8). ) And the integration circuits 12001 to 12064 also correspond to the 64 partial evaluation areas (1, 1) to (8, 8), respectively.

  The distributor 102 specifies the partial evaluation area to which the given R data belongs, and inputs the R data to the integration circuit corresponding to the specified partial evaluation area. The distributor 110 also identifies the partial evaluation area to which the given G data belongs, and inputs the G data to the integration circuit corresponding to the identified partial evaluation area. The distributor 118 also specifies the partial evaluation area to which the given B data belongs, and inputs the B data to the integration circuit corresponding to the specified partial evaluation area. Each of the distributors 102, 110, and 118 is also given a coordinate value indicating the upper left coordinate of the evaluation area EA. The distributors 102, 110, and 118 also perform processing for specifying the partial evaluation area with reference to the coordinate values.

  The integrating circuit 104 ** is formed by an adder 106 ** and a register 108 **. The adder 106 ** adds the R data value given from the distributor 102 to the set value of the register 108 **, and sets the added value in the register 108 **. The integrating circuit 112 ** is also formed by the adder 114 ** and the register 116 **. The adder 114 ** adds the G data value given from the distributor 110 to the set value of the register 116 **, and sets the added value in the register 116 **. The integrating circuit 120 ** is also formed by the adder 122 ** and the register 124 **. The adder 122 ** adds the B data value supplied from the distributor 118 with the set value of the register 124 **, and sets the added value in the register 124 **. The set values of the registers 108 **, 116 ** and 124 ** are cleared every time the vertical synchronization signal Vsync is generated.

  Therefore, the set value of register 108 ** represents the integral value of R data belonging to each partial evaluation area of the current frame. The set value of the register 116 ** represents the integral value of G data belonging to each partial evaluation area of the current frame. Furthermore, the set value of the register 124 ** represents the integral value of B data belonging to each partial evaluation area of the current frame.

  The post-processing circuit 36 is configured as shown in FIG. The controller 126 repeatedly issues a read request to the memory control circuit 32 in order to read Y data belonging to the extraction area EX from the raw image area 34 a of the SDRAM 34. The raw image data read in response to this is given to the color separation circuit 130 via the SRAM 128. The color separation circuit 130 generates RGB data in which each pixel has all the R, G, and B color information based on the given raw image data.

  The generated RGB data is subjected to white balance adjustment processing by the white balance adjustment circuit 132 and then converted to YUV format image data by the YUV conversion circuit 134. The converted image data is written in the SRAM 138. The controller 136 outputs the image data stored in the SRAM 138 to the memory control circuit 32 together with a write request. The output image data is written into the YUV image area 34 b of the SDRAM 34 by the memory control circuit 32.

  The CPU 28 processes in parallel a plurality of tasks including the moving image capturing task shown in FIG. 11 and the camera shake correction task shown in FIG. Note that control programs corresponding to these tasks are stored in the flash memory 46.

  Referring to FIG. 11, a moving image capturing process is executed in step S1, and a continuous AF task is activated in step S5. A through image is output from the LCD monitor 40 by the process of step S1, and the focus is continuously adjusted by the process of step S3. In step S5, it is determined whether or not a recording start operation has been performed. As long as the result is NO, the AE process in step S7 and the AWB process in step S9 are repeated. As a result, the exposure amount and the white balance are appropriately adjusted. When the recording start operation is performed, the process proceeds to step S11, and the I / F 42 is activated to start the recording process. In step S13, it is determined whether or not a recording end operation has been performed. As long as the result is NO, the AE process in step S15 and the AWB process in step S17 are repeated. When the recording end operation is performed, the process proceeds to step S19, and the I / F 42 is stopped to end the recording process. When the process of step S19 is completed, the process returns to step S5.

  Referring to FIG. 12, in step S31, it is determined whether or not the vertical synchronization signal Vsync is generated. If YES, the combined motion vectors UVC, MVC and LVC are fetched from the motion detection circuit 22 in step S33. In step S35, an entire motion vector is created based on the fetched synthesized motion vectors UVC, MVC, and LVC. In subsequent step S37, it is determined based on the entire motion vector whether or not the current motion of the imaging surface is caused by the pan / tilt operation. If “YES” here, the process directly returns to the step S31, and if “NO”, the process proceeds to a step S39.

  In step S39, the extraction area EX is moved along the entire motion vector created in step S35. In step S41, the overall motion vector of the next frame is predicted according to the above-described equations 2 and 3, and in step S43, the evaluation area EA is moved along the predicted overall motion vector. As a result of the processing in step S43, the coordinate values referred to by the AF evaluation circuit 24 and the AE / AWB evaluation circuit 26 change. When the process of step S43 is completed, the process returns to step S31.

  As can be seen from the above description, the image sensor 16 has an imaging surface on which an optical image of the object scene is irradiated, and repeatedly outputs the object scene image generated on the imaging surface. The LCD driver 38 displays a moving image on the LCD monitor 40 based on the partial scene image belonging to the extraction area EX (first designated area) among the scene images output from the image sensor 16. The CPU 28 adjusts the imaging conditions based on the partial scene image belonging to the evaluation area EA (second designated area) among the scene images output from the image sensor 16 (S3, S7, S9, S15, S17). ). The CPU 28 also detects the movement of the imaging surface in the direction orthogonal to the optical axis (22, S33, S35). Further, the CPU 28 moves the extraction area EX in accordance with the detected movement (S39), and moves the evaluation area EA in relation to the movement process of the extraction area EX (S41, S43).

  Therefore, the evaluation area EA referred to for adjustment of the imaging condition moves so as to follow the extraction area EX referred to for moving image output. Thereby, the adjustment accuracy of the imaging condition is improved, and the quality of the output image is improved.

  In this embodiment, a CMOS type image sensor is adopted as the image sensor 16, but a CCD type image sensor may be adopted instead. However, in this case, it is necessary to predict the motion of the next frame based on the motion of several past frames.

It is a block diagram which shows the structure of one Example of this invention. It is an illustration figure which shows an example of the allocation state of the extraction area and motion detection block in an imaging surface. It is an illustration figure which shows an example of the allocation state of the evaluation area in an imaging surface. It is an illustration figure which shows an example of the mapping state of SDRAM applied to FIG. 1 Example. (A) is an illustration figure which shows an example of the movement process of the extraction area according to hand movement, (B) is an illustration figure which shows an example of the movement process of the evaluation area according to hand movement. (A) is an illustration figure which shows an example of the process which estimates the horizontal component of a whole motion vector, (B) is an illustration figure which shows an example of the process which estimates the vertical component of a whole motion vector. It is a block diagram which shows an example of a structure of the motion detection circuit applied to the FIG. 1 Example. It is a block diagram which shows an example of a structure of AF evaluation circuit applied to the FIG. 1 Example. It is a block diagram which shows an example of a structure of the AE / AWB evaluation circuit applied to the FIG. 1 Example. It is a block diagram which shows an example of a structure of the post-processing circuit applied to FIG. 1 Example. It is a flowchart which shows a part of operation | movement of CPU applied to the FIG. 1 Example. It is a flowchart which shows a part of other operation | movement of CPU applied to the FIG. 1 Example.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 ... Digital video camera 16 ... Image sensor 20 ... Pre-processing circuit 22 ... Motion detection circuit 28 ... CPU
32 ... Memory control circuit 34 ... SDRAM
36 ... Post-processing circuit 38 ... LCD driver

Claims (7)

An imaging unit having an imaging surface on which an optical image of the object scene is irradiated, and repeatedly outputting the object scene image generated on the imaging surface;
Display means for displaying a moving image based on a partial scene image belonging to the first designated area among the scene images output from the imaging means;
Adjusting means for adjusting an imaging condition based on a partial scene image belonging to the second designated area among the scene images output from the imaging means;
Detecting means for detecting movement of the imaging surface in a direction perpendicular to the optical axis;
First moving means for moving the first designated area corresponding to the movement detected by the detecting means; and second moving means for moving the second designated area in relation to movement processing of the first moving means. With a video camera.   The second moving unit predicts a future movement of the imaging surface based on the movement detected by the detecting unit, and the second designated area corresponding to the movement predicted by the prediction unit. The video camera according to claim 1, further comprising an area moving means for moving. The imaging means performs an exposure operation of a focal plane electronic shutter system,
The detection means assigns a plurality of blocks arranged in the vertical direction to the object scene image output from the imaging means, and motion vectors of a plurality of block images belonging to the plurality of blocks assigned by the assignment means. Including individually generated motion vector generating means,
The video camera according to claim 2, wherein the predicting unit predicts a future motion of the imaging surface based on a plurality of motion vectors generated by the motion vector generating unit.   The video camera according to claim 3, wherein the number of blocks assigned in the vertical direction by the assigning unit is determined based on an imaging period of the imaging unit and a vibration frequency of the imaging surface. Write means for writing the object scene image output from the image pickup means into a memory, and display the partial object scene image belonging to the first designated area among the object scene images stored in the memory by the writing means 5. The video camera according to claim 1, further comprising reading means for reading out for display processing of the means. An imaging unit having an imaging surface on which an optical image of the object scene is irradiated and outputting the object scene image repeatedly, and a partial object belonging to the first designated area among the object scene images output from the imaging unit In a video camera processor having display means for displaying a moving image based on a field image,
An adjustment step of adjusting an imaging condition based on a partial scene image belonging to the second designated area among the scene images output from the imaging means;
A detection step of detecting movement of the imaging surface in a direction orthogonal to the optical axis;
A first movement step for moving the first designated area corresponding to the movement detected by the detection step; and a second movement step for moving the second designated area in relation to the movement process of the first movement step. An imaging control program for executing An imaging unit having an imaging surface on which an optical image of the object scene is irradiated and outputting the object scene image repeatedly, and a partial object belonging to the first designated area among the object scene images output from the imaging unit An imaging control method executed by a video camera including display means for displaying a moving image based on a field image,
An adjustment step of adjusting an imaging condition based on a partial scene image belonging to the second designated area among the scene images output from the imaging means;
A detection step of detecting movement of the imaging surface in a direction orthogonal to the optical axis;
A first movement step for moving the first designated area corresponding to the movement detected by the detection step; and a second movement step for moving the second designated area in relation to the movement process of the first movement step. An imaging control method comprising:

Images